JP4946332B2 - Information processing program and information processing apparatus - Google Patents

Description

  The present invention relates to an information processing program and an information processing apparatus.

  The following automatic album creation methods are known. In this method, an event at the time of shooting is determined based on audio data added to an image obtained by imaging a subject, and an album is created by dividing the image into events (for example, patents). Reference 1).

JP 2003-85190 A

  However, according to the conventional method, an event at the time of shooting is used only for dividing an image when creating an album, and the event cannot be fully utilized.

The information processing program according to claim 1, wherein the information processing program calculates a feature amount of the acquired image to a computer, and specifies a feature of a subject in the image based on the calculated feature amount, An event setting procedure for setting an event corresponding to the feature of the subject specified by the feature specifying procedure with reference to an event storage means for storing the subject's feature in association with the event, set by the event setting procedure Based on the event, the subject storage means for storing the subject to be identified related to the event is determined to determine the subject to be identified, and the feature amount of the subject to be identified and the feature identification procedure are calculated. An event that represents an event set in the event setting procedure and the event setting procedure that compares the feature quantity of the image to specify a subject included in the image Distribution, and the object information representative of the identified object in the object specifying step to execute the image storing procedure for storing in association with said image.
The information processing apparatus according to claim 8 calculates a feature amount of the acquired image, and based on the calculated feature amount, specifies a feature of a subject in the image, and an event Event setting means for setting an event corresponding to the feature of the subject specified by the feature specifying means, and an event set by the event setting means with reference to event storage means for storing the feature of the subject in association with each other Based on the above, the subject storage means for storing the subject to be identified relating to the event is determined to determine the subject to be identified, and the feature amount of the subject to be identified and the image calculated by the feature identification means A subject specifying means for specifying a subject included in the image by comparing with a feature amount of the event, event information indicating an event set by the event setting means, and Characterized in that it comprises an image storage means for storing in association with the subject information to the image representing the subject identified in Utsushitai specifying means.

  According to the present invention, event information is stored in association with an image together with subject information, so that it can be fully utilized.

-First embodiment-
FIG. 1 is a block diagram illustrating a configuration of an information processing apparatus according to an embodiment of the first embodiment. For example, a personal computer (personal computer) is used as the information processing apparatus 100. The information processing apparatus 100 includes an input device 101, an external interface 102, a control device 103, an HDD (Hard Disk Drive) 104, and a monitor 105.

  The input device 101 includes various input members operated by a user such as a keyboard and a mouse. The external interface 102 is an interface for capturing an image to be processed, which will be described later, from an external device such as a digital camera. For example, a USB interface or a wireless LAN interface is used. The HDD 104 records various data such as image data captured via the external interface 102 and an information processing program executed by the control device 103 as will be described later. The monitor 105 displays an operation screen for operating the information processing apparatus 100, an image recorded in the HDD 104, and the like. The recording of data on the HDD 104 and the display on the monitor 105 are controlled by the control device 103.

  The control device 103 includes a CPU, a memory, and other peripheral circuits, and includes an event setting unit 103a, a subject specifying unit 103b, a storage control unit 103c, an image search unit 103d, and a display control unit 103e. In preparation.

  The event setting unit 103a reads images captured via the external interface 102 one by one, calculates image feature values, and sets an event at the time of image capture based on the calculated image feature values. That is, the event at which each image was captured is specified, and the specified event is set as an event at the time of image capture. For example, if the image was taken at a wedding, “wedding” is set as an event when the image was taken. If the image was taken during a flower photography trip, “flower photography trip” is set as an event when the image was taken.

  The subject specifying unit 103b specifies only the subject corresponding to the event at the time of shooting the image set by the event setting unit 103a among the subjects appearing in the image.

  The storage control unit 103c associates, with an image, event information indicating an event at the time of shooting the image set by the event setting unit 103a and subject information indicating a subject related to the event at the time of shooting of the image specified by the subject specifying unit 103b. And stored in the HDD 104. In the present embodiment, the storage control unit 103c associates event information and subject information with an image by storing event information and subject information in an image file. In this case, for example, the Exif format may be adopted as the image file storage format, and event information and subject information may be included in the Exif information in the image file.

  A specific example of processing by the event setting unit 103a, the subject specifying unit 103b, and the storage control unit 103c will be described below with reference to the flowchart shown in FIG. Note that FIG. 2 illustrates a case where the event setting unit 103a sets either “wedding” or “flower photography trip” as an event at the time of image shooting. The processing shown in FIG. 2 is executed by each unit 103a to 103c as an information processing program that is activated when an image is captured via the external interface 102.

  In step S <b> 10, the event setting unit 103 a identifies the type of subject that is captured in the image captured via the external interface 102. Specifically, the event setting unit 103a calculates the feature amount of the image, and identifies the type of the subject appearing in the image based on the calculated feature amount.

  For example, the event setting unit 103a calculates color information obtained by generating a histogram of an image as an image feature amount. Alternatively, the shape of the subject obtained by extracting the edge in the image is calculated as the feature amount of the image. In addition, the brightness of the image, the spatial frequency in each direction within the predetermined area, the character information included in the image, the sound information added to the image and stored, and the like may be used as the image feature amount. If the subject includes flowers, the number of petals may be calculated as a feature amount. If the subject includes a person's face, the facial features such as the eyes, nose, mouth position, and facial contours may be calculated. A value indicating a feature may be calculated as a feature amount.

  Then, the event setting unit 103a identifies a region (subject region) in which the same subject is captured by merging regions in the image where the feature amount of the image approximates. Then, based on the feature amount of the image for each subject area, the type of the subject included in the subject area is specified.

  For example, when the captured image is an image including the automobile 3a as a subject as shown in FIG. 3, the event setting unit 103a first uses the same color based on the color information calculated as the feature amount of the image. Merge regions with components. Thereby, the area including the automobile 3a is merged as an area having the color of the automobile 3a. Then, the event setting unit 103a extracts the shape of the subject in the merged area based on the shape calculated as the feature amount of the image, and compares the extracted shape with the shape pattern of the subject stored in the HDD 104 in advance. To identify the type of subject. As a result, in the area including the automobile 3a, the type of subject is specified as “automobile”.

  In steps S20 to S40, the event setting unit 103a refers to the event table shown in FIG. 4 and determines whether or not the identified subject type is associated with the event “wedding”. The event table is stored in advance in the HDD 104, and stores image characteristics for specifying an event in association with the event. In the event table shown in FIG. 4, the type of the identified subject and the event are associated with each other, but the image feature amount and the event for each subject may be associated with each other.

  That is, in step S20, the event setting unit 103a determines whether or not the type of the subject is “female in a wedding dress” in order to determine whether or not the event at the time of image capturing is “wedding”. Judging. If it is determined that the subject type is not “women in wedding dress”, the process proceeds to step S80 described later. On the other hand, if it is determined that the type of subject is “female in a wedding dress”, the process proceeds to step S30.

  In step S30, the event setting unit 103a determines whether or not the type of the subject is “a man in a tuxedo” in order to determine whether or not the event at the time of shooting the image is “wedding”. . If it is determined that the subject type is not “a man in a tuxedo”, the process proceeds to step S80 described later. On the other hand, if it is determined that the type of subject is “a man in a tuxedo”, the process proceeds to step S40.

  In step S <b> 40, the event setting unit 103 a determines whether the subject type is “person dressed up” in order to determine whether the event at the time of image capture is “wedding”. If it is determined that the subject type is not “person in full dress”, the process proceeds to step S80 described later. On the other hand, if it is determined that the subject type is “person in full dress”, the process proceeds to step S50.

  In step S50, the event setting unit 103a includes all types of subjects that are likely to be included in the image when the event is “wedding”. It is determined that the event is “wedding”. That is, “wedding” is set as an event at the time of shooting the image. Thereafter, the process proceeds to step S60.

  In step S60, the subject specifying unit 103b specifies only the subject related to the event at the time of shooting the image set by the event setting unit 103a among the subjects appearing in the image. For this purpose, the subject specifying unit 103b specifies a subject corresponding to the event with reference to a subject table storing information used for specifying a subject related to the event stored in advance in the HDD 104.

  A specific example of the subject table is shown in FIG. First, the subject specifying unit 103b refers to the subject table shown in FIG. 5 and specifies the subject related to the event at the time of image capture. That is, the subject specifying unit 103b specifies only the subject 5b for which the circle is set for the event 5a at the time of image capture as the subject related to the event at the time of image capture. Here, “Mr. A”, “Mr. B”, and “Mr. C” are specified as subjects 5b when the event 5a is “wedding”.

  The subject specifying unit 103b then calculates the feature amount of each subject image calculated by the event setting unit 103a and the feature amounts 5c of “Mr. A”, “Mr. B”, and “Mr. C” stored in the subject table. Are identified to identify individuals included in the image. For example, the event setting unit 103a specifies that “the woman in the wedding dress” is “Mr. A” as the type of subject. Further, the “male in a tuxedo” is identified as “Mr. B”. Further, the “person in full dress” is identified as “Mr. C”.

  In this way, by specifying in detail only the subject related to the event at the time of image capture, it is not necessary to specify the subject not related to the event, rather than specifying all subjects present in the image. The processing load can be reduced. For example, if the event at the time of shooting an image is “wedding”, even if “flower” (type of subject) is shown in the image, the specific variety (subject) of this “flower” is “marriage” Since there is no direct relationship with the event “expression”, it is not necessary to specify the subject. According to the present invention, when the event at the time of shooting an image is “wedding”, the type of “flower” included in the image is not specified, and therefore it is possible to reduce useless processing and reduce processing load. .

  Thereafter, the process proceeds to step S70, and the storage control unit 103c selects event information indicating an event at the time of shooting the image set by the event setting unit 103a, and a subject related to the event at the time of shooting the image specified by the subject specifying unit 103b. The subject information shown is stored in the HDD 104 in association with the image, and the process is terminated. In the present embodiment, the storage control unit 103c associates the event information and the subject information with the image by storing the event information and the subject information in the image file. In this case, for example, the Exif format may be adopted as the image file storage format, and event information and subject information may be included in the Exif information in the image file.

  Next, the process after step S80 is demonstrated. In step S80, when the event described above is a wedding, the event setting unit 103a does not include at least one of the types of subjects that are highly likely to be included in the image. Judge that is not a "wedding". Then, with reference to the event table shown in FIG. 4, it is determined whether or not the recognized subject type is associated with the event “flower photography trip”. That is, it is determined whether or not the type of subject is “flower”.

  If it is determined that the subject type is not “flower”, the process proceeds to step S130 described later. On the other hand, if it is determined that the subject type is “flower”, the process proceeds to step S90. In step S90, the event setting unit 103a determines whether or not the AF area at the time of image capturing overlaps with the area where the flower exists in the image. Information about the AF area at the time of image shooting is stored in an image file, for example, Exif information. If it is determined that the AF area does not overlap the area where the flower exists in the image, the process proceeds to step S130 described later. On the other hand, if it is determined that the AF area overlaps the area where the flower exists in the image, the process proceeds to step S100.

  In step S100, the event setting unit 103a includes, in the image, the type of subject that is likely to be included in the image when the event is “flower photography trip”, and an AF area is included in the subject. Since they overlap, it is determined that the event at the time of shooting this image is “flower shooting trip”. That is, “flower photography trip” is set as an event at the time of photographing the image. Then, it progresses to step S110.

  In step S110, the subject specifying unit 103b refers to the subject table shown in FIG. 5 and specifies only the subject corresponding to the “flower photography trip”. Here, “rose”, “cherry blossom”, and “tulip” are specified as subjects 5b when the event 5a is “flower photography trip”.

  Then, the subject specifying unit 103b uses the feature amount of each subject image calculated by the event setting unit 103a and the feature amount 5c of “rose”, “sakura”, and “tulip” stored in the subject table, respectively. In comparison, the type of flower contained in the image is specified. For example, the event setting unit 103a specifies that the flower included in the image is “tulip”. As a result, if the event at the time of image shooting is “flower shooting trip”, even if a person is shown in the image, who this person is is directly related to the event “flower shooting trip” In view of the fact that there is no need to specify the subject, there is no need to specify the subject, and the processing load can be reduced.

  Thereafter, the process proceeds to step S70, and the storage control unit 103c selects event information indicating an event at the time of shooting the image set by the event setting unit 103a, and a subject related to the event at the time of shooting the image specified by the subject specifying unit 103b. The subject information shown is stored in the HDD 104 in association with the image, and the process is terminated.

  In step S120, the event setting unit 103a sets other events when the event at the time of image shooting is neither “wedding” nor “flower shooting trip”. For example, when data for setting another event is stored in the event table, the event setting unit 103a sets the event. Thereafter, the process proceeds to step S130, and the subject specifying unit 103b specifies a subject related to the event set by the event setting unit 103a.

  Further, when audio data is added to the image, the event setting unit 103a may identify an event from the audio data in step S120. For example, when the event setting unit 103a reads voice data and performs voice recognition processing and determines that the voice is a train sound, the event setting unit 103a determines that the event at the time of shooting the image is a “train photo session”. To do. In this case, the subject specifying unit 103b determines in step S130 that “train” is shown as a subject in the image.

  Thereafter, the process proceeds to step S70 described above, and the storage control unit 103c relates to event information indicating an event at the time of shooting the image set by the event setting unit 103a and an event at the time of shooting the image specified by the subject specifying unit 103b. The subject information indicating the subject is stored in the HDD 104 in association with the image, and the process ends.

  In information processing apparatus 100 according to the present embodiment, a user can search for an image by specifying event information or subject information stored in association with the image as a search condition for searching for the image. it can. That is, when the user operates the input device 101 and instructs to search for an image, the image search unit 103d displays an input screen for inputting search conditions on the monitor 105, and the search conditions from the user are displayed. Accepts input.

  When event information as a search condition is input by the user, the image search unit 103d displays an image in which event information that matches the search condition is stored in association with the image file stored in the HDD 104. Extract files as search results. Further, when subject information is input as a search condition by the user, the image search unit 103 d displays an image file in which subject information that matches the search condition is stored in association with the image file stored in the HDD 104. Is extracted as a search result.

  Then, the display control unit 103e displays the search result by the image search unit 103d on the monitor 105. At this time, the display control unit 103e displays an image (extracted image) included in the image file extracted by the image search unit 103d and an image (other image) included in another image file stored in the HDD 104. And are displayed on the monitor 105. For example, the display control unit 103e displays only the extracted image on the monitor 105.

  Alternatively, as shown in FIG. 6A, the display control unit 103e divides the display area of the image displayed on the monitor 105 into two, and displays the extracted image in one area 6a. Other images may be displayed in the area 6b. Alternatively, as shown in FIG. 6B, all the images stored in the HDD 104 may be displayed on the monitor 105, and only the extracted images may be displayed surrounded by a frame 6c. Further, an image extracted by another method may be displayed separately from other images. It should be noted that the images are displayed on the monitor 105 in a predetermined display order, for example, in order of shooting date and time.

  The user can select any image from the images displayed on the monitor 105 and change the event information stored in association with the image. For example, when the event automatically set by the event setting unit 103a is incorrect, the user can reset the correct event as an event at the time of image capturing. When the change of the event information is instructed by the user, the storage control unit 103c displays a change screen for changing the event information of the selected image on the monitor 105, and the event information is changed by the user. Accept.

  When the event information is changed by the user, the storage control unit 103c overwrites and saves the changed event information in association with the image. At this time, the storage control unit 103c refers to the subject table described above, and determines whether or not subject information associated with the image corresponds to the changed event information. If the subject information associated with the image corresponds to the changed event information, the subject information is directly associated with the image and stored. On the other hand, if the subject information associated with the image does not correspond to the changed event information, the storage control unit 103c deletes the subject information associated with the image. That is, only subject information corresponding to the changed event information is stored in the HDD 104 in association with the image.

  FIG. 7 is a flowchart showing each process of image search, display, and event information change in the first embodiment. The processing shown in FIG. 7 is executed by the storage control unit 103c, the image search unit 103d, and the display control unit 103e as an information processing program that is activated when an image search is instructed by the user.

  In step S210, the image search unit 103d determines whether event information or subject information is input as a search condition by the user. If it is determined that the search condition has been input, the process proceeds to step S220. In step S220, the image search unit 103d extracts, from the image files stored in the HDD 104, an event file that matches the search condition or an image file that is stored in association with subject information as a search result. Thereafter, the process proceeds to step S230.

  In step S230, the display control unit 103e displays the search result obtained by the image search unit 103d on the monitor 105. At this time, as described above, the display control unit 103e distinguishes and displays the image extracted by the image search unit 103d and other images on the monitor 105. Thereafter, the process proceeds to step S240, and the storage control unit 103c determines whether or not the event information stored in association with any image has been changed by the user. If it is determined that the event information has not been changed, the process ends.

  On the other hand, if it is determined that the event information has been changed, the process proceeds to step S250. In step S250, the storage control unit 103c stores the changed event information in association with the image, and proceeds to step S260. In step S260, the storage control unit 103c refers to the subject table described above and determines whether the subject information associated with the image corresponds to the changed event information. If it is determined that the subject information corresponds to the changed event information, the process ends. In contrast, if it is determined that the subject information does not correspond to the changed event information, the process proceeds to step S270. In step S270, the storage control unit 103c deletes the subject information associated with the image and ends the process.

According to the first embodiment described above, the following operational effects can be obtained.
(1) An event at the time of shooting an image is set, a subject related to the event is specified, and event information representing the event and subject information representing the subject are stored in association with the image. As a result, the event information and subject information can be fully utilized after the image is stored. Further, the subject information stored in association with the image is only related to the event at the time of shooting the image, and it is possible to prevent subject information irrelevant to the event from being stored in association with the image.

(2) An input of subject information is accepted as a search condition, and an image associated with the accepted subject information is retrieved and displayed. Thus, the user can browse the image for each subject, and convenience is improved.

(3) A change in event information stored in association with an image is accepted, and when subject information that does not correspond to the changed event information is stored in association with an image, the subject information is deleted. . As a result, when the event information is changed, it is possible to prevent a subject that is not related to the event from being stored in association with the image as it is.

(4) When an image is searched under the specified search condition, the image extracted as the search result is displayed separately from other images. As a result, the user can easily grasp the search result.

-Second embodiment-
In the first embodiment described above, the subject specifying unit 103b specifies only the subject related to the event set by the event setting unit 103a from the subjects in the image, and the storage control unit 103c. Explained an example of storing event information and subject information in association with an image. On the other hand, in the second embodiment, the subject specifying unit 103b specifies all subjects appearing in the image regardless of the event set by the event setting unit 103a. The storage control unit 103c stores event information and subject information representing all subjects specified by the subject specifying unit 103b in association with images.

  In the second embodiment, FIG. 1 is a block diagram, FIG. 3 is a diagram illustrating a method for specifying the type of subject, FIG. 4 is a diagram illustrating a specific example of an event table, and FIG. A diagram showing a specific example of the shown subject table and a flowchart showing each processing of image search, display, and event information change shown in FIG. 7 are the same as those in the first embodiment, and thus description thereof is omitted. To do.

  FIG. 8 is a flowchart illustrating a specific example of processing by the event setting unit 103a, the subject specifying unit 103b, and the storage control unit 103c in the second embodiment. In FIG. 8, the same processes as those in the first embodiment shown in FIG.

  If an event at the time of shooting an image is set by the event setting unit 103a in any of steps S50, S100, and S120, the process proceeds to step S61. In step S61, the subject specifying unit 103b specifies all the subjects included in the image. That is, the subject specifying unit 103b refers to the subject table shown in FIG. 5 and specifies all subjects 5b as specific targets regardless of the presence or absence of the circle for the event 5a at the time of image capture. Then, the subject specifying unit 103b compares the feature amount of each subject image calculated by the event setting unit 103a with the feature amount 5c of all the subjects 5b stored in the subject table, and compares them in the image. Identify all included subjects.

  In step S70, the event information and the subject information of all subjects included in the image are stored in the HDD 104 in association with the image. As described above, when subject information of all subjects is stored in association with images, when a user performs a search using subject information as a search condition, images of various events with which the subject information is associated. Will be searched. For this reason, an image that the user does not want may be searched.

  For example, consider a case where the user has instructed to search for an image associated with “rose” as subject information. In this case, it is presumed that the user wants to search and browse an image in which “rose” is captured as a main subject, for example, “an image of a rose taken on a flower photography trip”. However, if an image associated with “roses” is extracted unconditionally as subject information, “an image of a rose taken at a wedding” in addition to a “rose image taken at a flower photography trip” It will be extracted.

  Therefore, in this embodiment, such a problem is avoided by any one of the following methods (A) and (B).

(A) First Method In the first method, the image search unit 103d determines event information to be searched according to subject information set as a search condition in step S220 of FIG. Then, only the image associated with the subject information set as the search condition and the event information to be searched is extracted as the search result. For example, when “rose” is set as a search condition by the user, only “flower photography trip” is determined as event information to be searched, and “wedding” is not a search target. As a result, it is possible to extract only the “rose image taken during the flower photography trip” and to search only the image desired by the user. It should be noted that which event information is to be searched according to the subject information set as the search condition is set in advance for each subject information.

(B) Second Method In the second method, the image search unit 103d searches all images associated with subject information set as a search condition in step S220 of FIG. In step S230 of FIG. 7, the display control unit 103e determines event information to be preferentially displayed according to the subject information set as the search condition. Then, the display control unit 103e distinguishes and displays on the monitor 105 images associated with event information to be displayed with priority. It is assumed that which event information is preferentially displayed according to the subject information set as the search condition is set in advance for each subject information.

  For example, as shown in FIG. 6, the display control unit 103e divides the display area of the image displayed on the monitor 105 into two, and event information to be displayed with priority given to the one area 6a is associated. The other image may be displayed in the other area 6b. Alternatively, as shown in FIG. 6B, only an image associated with event information to be preferentially displayed may be displayed surrounded by a frame 6c. Here, it is assumed that images are displayed on the monitor 105 in a predetermined display order, for example, in order of shooting date and time.

  Note that either the first method or the second method may be used, or the user may select either one.

According to the second embodiment described above, the following operational effects can be obtained.
(1) The image search unit 103d determines event information to be searched according to the subject information set as the search condition, and associates the subject information set as the search condition and the event information to be searched. Only images that are included are extracted as search results. Thereby, it is possible to extract only images that are highly likely to be desired by the user according to the search conditions.

(2) The image search unit 103d searches all the images associated with the subject information set as the search condition, and the display control unit 103e selects the images associated with the event information to be displayed with priority. Differently displayed. As a result, it is possible to preferentially display an image that is likely to be desired by the user according to the search condition.

-Modification-
Note that the information processing apparatus of the above-described embodiment can be modified as follows.
(1) In the first and second embodiments described above, an example in which a personal computer is used as the information processing apparatus 100 and an image captured through the external interface 102 is read and processed is described. However, the information processing apparatus 100 may be applied to a camera including an image acquisition unit that acquires an image, and the image acquired by the image acquisition unit may be the target of processing.

(2) In the above-described first and second embodiments, the event information and the subject information are stored in the image file, and the event information and the subject information are stored in association with the image. However, the event information and subject information may be stored in association with the image by storing the event information and subject information in the image file name in association with the HDD 104.

(3) In the first and second embodiments described above, the display control unit 103e has been described as an example in which images are displayed on the monitor 105 in order of shooting date and time. However, the images may be displayed not in order of shooting date but in other order of arrangement. For example, when subject information is set as a search condition, the display control means 103e determines the subject's reflection such as the size of the corresponding subject in the image, the degree of focus match, or the background blur. It may be determined and displayed in order from an image with a good subject image.

(4) In the first and second embodiments described above, the display control unit 103e has described the example in which a plurality of images (thumbnail images) are displayed on the monitor 105 as shown in FIG. However, images may be displayed on the monitor 105 one by one. That is, when a plurality of images are retrieved by the image retrieval unit 103d, the display control unit 103e displays one of the images on the monitor 105, and when the user is instructed to display the next image. The next image may be displayed on the monitor 105.

(5) In the first and second embodiments described above, when all of steps S20 to S40 are affirmed in the flowchart shown in FIG. 2, the event at the time of image shooting is “wedding”. An example of determination has been described. However, when an affirmative determination is made in at least one of the steps, it may be determined that the event at the time of image capture is “wedding”.

(6) In the first and second embodiments described above, the user selects an arbitrary image from the images displayed on the monitor 105, and stores the event information stored in association with the image. The example which can be changed was demonstrated. However, the storage control unit 103c may be able to automatically correct an error in event information. For example, when there are a plurality of images shot on the same day, the storage control unit 103c identifies event information (first event information) associated with the image with the earliest shooting time (first image). Then, the event information associated with each image is compared with the first event information in order from the image with the latest shooting time to the image with the earliest shooting time.

  When the storage control unit 103c finds an image associated with the same event information as the first event information, the storage control unit 103c takes the image as the last image, and the first image to the last image are all taken at the same event. It is determined that it is an image. Then, if there is an image associated with different event information between the first image and the last image, the storage control unit 103c displays the event information of the image as the first image (or the last image). Change to event information associated with.

  The storage control unit 103c can automatically correct the event information associated with all the images by repeating this process as a new first image after the image after the last image. At this time, as in the first and second embodiments described above, if the subject information associated with the image does not correspond to the changed event information, the storage control unit 103c associates with the image. What is necessary is just to delete the subject information.

  Note that the present invention is not limited to the configurations in the above-described embodiments as long as the characteristic functions of the present invention are not impaired.

It is a block diagram which shows the structure of one Embodiment of information processing apparatus. It is a flowchart figure which shows the specific example of the process by the event setting part 103a in 1st Embodiment, the to-be-specified part 103b, and the memory | storage control part 103c. It is a figure which shows the identification method of the kind of to-be-photographed object. It is a figure which shows the specific example of an event table. It is a figure which shows the specific example of a to-be-photographed table. 6 is a diagram illustrating an example of an image displayed on a monitor 105. FIG. It is a flowchart figure which shows each process of a search of an image, a display, and a change of event information. It is a flowchart figure which shows the specific example of the process by the event setting part 103a in 2nd Embodiment, the to-be-specified part 103b, and the memory | storage control part 103c.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Information processing apparatus, 101 Input device, 102 External interface, 103 Control apparatus, 103a Event setting part, 103b Subject identification part, 103c Storage control part, 103d Image search part, 103e Display control part, 104 HDD, 105 Monitor

Claims (13)

On the computer,
A feature specifying procedure for calculating the feature amount of the acquired image and specifying the feature of the subject in the image based on the calculated feature amount;
An event setting procedure for setting an event corresponding to the feature of the subject specified by the feature specifying procedure with reference to an event storage means for storing the feature of the subject in association with the event;
Based on the event set in the event setting procedure, the specific target subject is determined with reference to the subject storage means for storing the specific target subject related to the event, and the feature amount of the specific target subject A subject identification procedure for identifying a subject included in the image by comparing the feature amount of the image calculated in the feature identification procedure;
An information processing program for executing an image storing procedure for storing event information representing an event set in the event setting procedure and subject information representing a subject specified in the subject specifying procedure in association with the image. The information processing program according to claim 1,
The subject specifying procedure compares the feature amount of only the target subject determined as the target subject with the feature amount of the image calculated by the feature specifying procedure, and determines the subject included in the image. An information processing program characterized by specifying. The information processing program according to claim 1,
On the computer,
An input procedure for receiving input of the subject information as a search condition for searching for the image,
An image search procedure for searching for the image associated with the subject information received as the search condition;
An information processing program for further executing a display procedure for displaying a search result by the image search procedure. In the information processing program according to any one of claims 1 to 3,
On the computer,
An event change procedure for changing the event information stored in association with the image;
Information processing for further executing a deletion procedure for deleting the subject information when the event information is changed and subject information not corresponding to the changed event information is stored in association with the image. program. The information processing program according to claim 3 ,
The image search procedure refers to the subject storage means, and searches for an image associated with event information related to the subject information received as a search condition from the input procedure. In the information processing program according to claim 3 or claim 5 ,
In the information processing program, the display procedure distinguishes and displays an image searched in the image search procedure and other images. In the information processing program according to any one of claims 1 to 6,
The feature specifying procedure specifies the type of the first subject based on the feature of the subject in the image,
The event setting procedure sets an event corresponding to the type of the first subject specified in the feature specifying procedure,
The subject specifying procedure specifies a second subject as a subject to be specified related to the event,
In the image storage procedure, event information representing an event set in the event setting procedure and subject information representing a second subject specified in the subject specifying procedure are stored in association with the image. program. A feature specifying means for calculating a feature amount of the acquired image and specifying a feature of a subject in the image based on the calculated feature amount;
Event setting means for setting an event corresponding to the feature of the subject specified by the feature specifying means with reference to an event storage means for storing the feature of the subject in association with the event;
Based on the event set by the event setting means, the subject storage means for storing the subject to be identified related to the event is determined, the subject to be identified is determined, and the feature amount of the subject to be identified Subject identification means for identifying a subject included in the image by comparing the feature amount of the image calculated by the feature identification means;
An information processing apparatus comprising: event information representing an event set by the event setting means; and image storage means for storing subject information representing a subject specified by the subject specifying means in association with the image. The information processing apparatus according to claim 8,
The subject specifying unit compares the feature amount of only the specific target subject determined as the target subject with the feature amount of the image calculated by the feature specifying unit, and determines the subject included in the image. An information processing apparatus characterized by specifying. The information processing apparatus according to any one of claims 8 to 9,
Event changing means for changing the event information stored in association with the image;
And deleting means for deleting the subject information when subject information that does not correspond to the changed event information is stored in association with the image when the event information is changed. Information processing device. In the information processing apparatus according to any one of claims 8 to 10,
An input means for inputting the subject information as a search condition for searching for the image;
Image search means for searching for an image associated with event information related to the subject information received as a search condition from the input means with reference to the subject storage means;
An information processing apparatus comprising: display means for displaying a search result obtained by the image search means. The information processing apparatus according to claim 11,
The information processing apparatus, wherein the display means distinguishes and displays an image searched by the image search means and other images. The information processing apparatus according to any one of claims 8 to 12,
The feature specifying means specifies the type of the first subject based on the feature of the subject in the image,
The event setting means sets an event corresponding to the type of the first subject specified by the feature specifying means,
The subject specifying means specifies a second subject as a subject to be specified related to the event,
The image storage means stores event information representing an event set by the event setting means and subject information representing a second subject specified by the subject specifying means in association with the image. apparatus.

Images