JP2010074638A - Photographing support device, photographing system, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing support device automatically setting a photographing condition suitable for an object and its condition, to provide a photographing system, and to provide a program. <P>SOLUTION: A feature amount calculation part 202 acquires an image of an object to calculate the feature amount of the image. An object identification part 201 compares the calculated feature amount of the image with the feature amounts of images of a plurality of objects to identify an object corresponding to the acquired image. A state estimation part 207 compares the feature amount of an image of the identified object with the feature amount for each state of the plurality of objects to estimate the state of the identified object. A photographing condition setting part 206 selects an photographing condition from data to which photographing conditions are related for every state of each object based on the identified object and the estimated state of the object to set the selected photographing condition in a camera 3. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a photographing assistance device, a photographing system, and a program.

2. Description of the Related Art Conventionally, a server that receives a shooting information request including a keyword representing a shooting situation from a shooting device and transmits shooting information corresponding to the received keyword to the shooting device is known (see, for example, Patent Document 1).
JP 2007-36716 A

  An object of the present invention is to provide a photographing auxiliary device, a photographing system, and a program capable of automatically setting photographing conditions suitable for a subject and its state.

  In order to achieve the above object, a photographing auxiliary apparatus according to claim 1 acquires a feature image of a subject and calculates a feature amount of the image, a feature amount of the calculated image, and a plurality of subjects. A subject identifying means for comparing a feature amount of the image and identifying a subject corresponding to the acquired image, a feature amount of the image of the identified subject, and a feature amount for each state of the plurality of subjects The state estimation means for estimating the state of the identified subject, and shooting based on the identified subject and the estimated state of the subject based on the data associated with the shooting condition for each state of the subject And setting means for selecting a condition and setting the selected photographing condition in the photographing apparatus.

  The imaging assistance device according to claim 2 is the imaging assistance device according to claim 1, wherein the feature amount of the image is at least one of color information, density information, spatial frequency information, and texture information, and The condition is characterized by scratches, dirt, rubbing or peeling.

  The imaging assistance device according to claim 3 is the imaging assistance device according to claim 1 or 2, wherein the feature amount of the image of the plurality of subjects, the feature amount for each state of the plurality of subjects, and the state of each subject. The image processing apparatus further includes storage means for storing data associated with shooting conditions.

  The photographing auxiliary device according to claim 4 is the photographing auxiliary device according to claim 1 or 2, wherein the photographing auxiliary device includes a feature amount of the image of the plurality of subjects, a feature amount for each state of the plurality of subjects, and It is connected to an external storage device for storing data in which photographing conditions are associated with each state of each subject.

  The photographing auxiliary device according to claim 5 is the photographing auxiliary device according to any one of claims 1 to 4, wherein the photographing condition includes setting information at the time of photographing of the photographing device, information indicating a photographing method, and the It is characterized by including information indicating a setting for capturing a change with time of the subject.

  According to another aspect of the present invention, there is provided a photographing system for photographing a subject, a feature amount calculating unit that obtains an image of the subject from the photographing device and calculating a feature amount of the image, and a feature amount of the calculated image. Comparing the feature amounts of the images of a plurality of subjects and identifying a subject corresponding to the acquired image, the feature amounts of the images of the identified subjects, and the states of the plurality of subjects The state estimation means for comparing the feature amount and estimating the state of the identified subject, and the photographing condition is associated for each state of the subject based on the identified subject and the state of the estimated subject And a photographing assisting device having setting means for selecting photographing conditions from the data and setting the selected photographing conditions in the photographing apparatus.

  The imaging system according to claim 7 is the imaging system according to claim 6, wherein the feature amount of the image is at least one of color information, density information, spatial frequency information, and texture information, and the state of the subject is It is characterized by scratches, dirt, rubbing or peeling.

  The photographing system according to claim 8 is the photographing system according to claim 6 or 7, wherein the feature amount of the image of the plurality of subjects, the feature amount of each state of the plurality of subjects, and the state of each subject are photographed. It further comprises storage means for storing data associated with conditions.

  The photographing system according to claim 9 is the photographing system according to claim 6 or 7, wherein the photographing assisting device includes a feature amount of the images of the plurality of subjects, a feature amount for each state of the plurality of subjects, It is connected to the external storage device which memorize | stores the data which linked | related the imaging conditions for every state of a to-be-photographed object.

  The photographing system according to claim 10 is the photographing system according to any one of claims 6 to 9, wherein the photographing condition includes setting information at the time of photographing of the photographing device, information indicating a photographing method, and information on the subject. It includes information indicating settings for capturing changes with time.

  The photographing system according to claim 11 is the photographing system according to any one of claims 6 to 10, wherein a display device is connected to the photographing auxiliary device, and the setting means is set to the photographing device. The displayed photographing condition is displayed on the display means.

  In the imaging system according to claim 12, in the imaging system according to claim 11, when there is no imaging condition that can be set for the subject, the setting unit has an imaging condition that can be set for the subject. Information indicating that there is no data is displayed on the display device.

  A program according to a thirteenth aspect is characterized in that a computer obtains an image of a subject, calculates a feature amount of the image, and calculates a feature amount of the image, a feature amount of the calculated image, and a feature amount of images of a plurality of subjects. A subject identification means for identifying a subject corresponding to the acquired image, comparing a feature amount of the image of the identified subject with a feature amount for each state of the plurality of subjects, and Based on the state estimation means for estimating the state of the subject, the identified subject and the state of the estimated subject, the photographing condition is selected from data associated with the photographing condition for each state of the subject, and the selected It is characterized by functioning as a setting means for setting photographing conditions in the photographing apparatus.

  According to the first, sixth, and thirteenth inventions, it is possible to automatically set the photographing conditions suitable for the subject and its state.

  According to the second and seventh aspects of the present invention, the subject can be specified using at least one of color information, density information, spatial frequency information, and texture information, such as scratches, dirt, rubbing, or peeling. The shooting conditions can be set in consideration of a specific subject state.

  According to the third and eighth aspects of the present invention, it is possible to automatically set the photographing condition suitable for the subject and its state based on the data stored in the storage means.

  According to the fourth and ninth aspects of the present invention, it is possible to automatically set the photographing condition suitable for the subject and its state based on the data stored in the external storage device.

  According to the fifth and tenth aspects of the present invention, it is possible to automatically perform a plurality of shooting settings suitable for the subject and its state.

  According to the invention of claim 11, the user can grasp the automatically set photographing condition.

  According to the invention of claim 12, the user can grasp that there is no photographing condition that can be automatically set.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a schematic configuration diagram of a photographing system 1 according to an embodiment of the present invention.

  In FIG. 1, a photographing system 1 includes a camera 3 for photographing a subject, a computer (PC) 2 for automatically setting photographing conditions of the camera 3, and a monitor 4 for displaying photographed images and photographing conditions. In addition, the imaging system 1 may include a plurality of cameras (for example, cameras 3 and 5). The PC 2 functions as a photographing assistance device and is connected between the camera 3 and the monitor 4.

  FIG. 2 is a block diagram illustrating a hardware configuration of the PC 2.

  The PC 2 is connected to a CPU 21 that controls the entire apparatus, a ROM 22 that includes a control program, a RAM 23 that functions as a working area, a hard disk drive (HDD) 24 that includes various types of information and programs, a mouse and keyboard 25, and other computers not shown. Network interface 26, video interface 27 for connecting monitor 4, and USB (universal serial bus) interface 28 for connecting cameras 3 and 5. The CPU 21 is connected to a ROM 22, a RAM 23, a hard disk drive (HDD) 24, a mouse and keyboard 25, a network interface 26, a video interface 27 and a USB interface 28 via a system bus 29.

  FIG. 3 is a functional block diagram of the photographing system 1 of FIG.

  The camera 3 includes a CCD (Charge Coupled Device), a lens, a microcomputer, and the like, and includes a photographing unit 301 that photographs a subject. The monitor 4 includes a display unit 401 that includes a liquid crystal or an organic EL (Organic Electro-Luminescence). It has.

  The PC 2 includes a subject identification unit 201 (subject identification unit), a feature amount calculation unit 202 (feature amount calculation unit), a feature amount storage unit 203, a condition storage unit 204, a state storage unit 205, and a shooting condition setting unit 206 (setting unit). And a state estimation unit 207 (state estimation means). The feature amount storage unit 203, the condition storage unit 204, and the state storage unit 205 are realized by the HDD 24, and the subject identification unit 201, the feature amount calculation unit 202, the shooting condition setting unit 206, and the state estimation unit 207 execute a predetermined program. This is realized by the CPU 21.

  The feature amount calculation unit 202 acquires the image captured by the capturing unit 203 via the subject identification 201, and calculates the feature amount of the image from the acquired image. Specifically, the feature extraction unit 202 performs color conversion processing on the acquired image, and calculates color information indicating the R ratio, G ratio, and B ratio included in the image. In addition, the feature extraction unit 202 performs density conversion of the image by integrating a known density conversion table to the image, and calculates density information of the image. The density information indicates, for example, the density of the R signal, the G signal, and the B signal within a scale of 0 to 100 for each color of RGB. The feature extraction unit 202 performs a known multi-resolution analysis on the color-converted signal and the density-converted signal, and includes spatial frequency information including the peak frequency and total power of each signal, and the peak position of each signal. Calculate texture information. FIG. 4 shows an example of a plurality of information calculated from an image by the feature quantity calculation unit 202, and FIG. 5 shows an example of spatial frequency information calculated from an image by the feature quantity calculation unit 202.

  The feature amount storage unit 203 stores the feature amount of the image for each subject in advance. The feature amount storage unit 203 stores color information, density information, spatial frequency information, and texture information for each subject (for example, a component of a multifunction peripheral) as image feature amounts. FIG. 6 shows an example of the feature amount of the image for each subject stored in the feature amount storage unit 203. In FIG. 6, color information, density information, spatial frequency information, and texture information are stored for each component of the multifunction machine. Examples of the components of the multifunction machine include a drum, a transfer roller, and a blade.

  The condition storage unit 204 stores table data in which each state of each subject is associated with shooting conditions such as camera settings, environment information, and time resolution. FIG. 7 shows an example of table data in which each state of each subject is associated with a shooting condition.

  In the table data of FIG. 7, the camera setting item indicates setting information at the time of shooting by the shooting unit 301 and includes conditions such as ISO sensitivity, flash light amount, and shutter speed. The environment information item indicates a shooting method, and includes conditions such as whether or not the subject is fixed, whether or not the lens is in contact with the subject, and whether or not lighting is turned on. The item of time resolution includes a condition for presence / absence of continuous shooting in order to capture a subject's temporal change.

  The state storage unit 205 stores the feature amount of each subject for each state. FIG. 8 shows an example of information stored in the state storage unit 205. FIG. 8 shows the spatial frequency information of a drum having scratches, dirt due to toner, or other dirt. Although not shown in FIG. 8, the state storage unit 205 transfers the scratches, scratches, or stains in addition to the color information, density information, and texture information of the drums that have scratches, toner stains, or other stains. Color information, density information, spatial frequency information, texture information, and the like of a roller and a blade with rubbing, peeling, and dirt are stored.

  The subject identifying unit 201 identifies the subject of the image photographed by the photographing unit 301 based on the feature amount of the image stored in the feature amount storage unit 203 in advance and the feature amount of the image calculated by the feature amount calculation unit 202. Identify.

  FIG. 9 is a flowchart showing subject identification processing executed by the feature amount calculation unit 202 and the subject identification unit 201.

  First, the feature amount calculation unit 202 acquires an image of a subject photographed by the photographing unit 301 via the subject identification unit 201 (step S1), and color information, density information, spatial frequency information, and texture from the obtained image. Any one of the information is calculated (step S2).

  The subject identification unit 201 includes color information, density information, spatial frequency information, and texture information calculated by the feature amount calculation unit 202, and color information of a plurality of subjects stored in the feature amount storage unit 203. It is determined whether or not it matches or approximates the corresponding one of the density information, spatial frequency information, and texture information (step S3). For example, when the color information value calculated by the feature amount calculation unit 202 is included in a predetermined range centered on the color information value of one subject stored in the feature amount storage unit 203, subject identification is performed. The unit 201 determines that the color information calculated by the feature amount calculation unit 202 approximates the color information of the subject stored in the feature amount storage unit 203.

  If YES in step S3, the subject identifying unit 201 has information that matches or approximates any one of the color information, density information, spatial frequency information, and texture information calculated by the feature amount calculation unit 202. The subject is identified (specified) (step S4), and this process is terminated. On the other hand, in the case of NO in step S3, the feature amount calculation unit 202 calculates information different from the information used in step S3 among the color information, density information, spatial frequency information, and texture information (step S5).

  Returning to step S <b> 3, the subject identification unit 201 uses the information calculated by the feature amount calculation unit 202 in step S <b> 5 as color information, density information, spatial frequency information, and the like for a plurality of subjects stored in the feature amount storage unit 203. It is determined whether or not it matches or approximates a corresponding one of the texture information.

  In steps S2 and S5, the feature amount calculation unit 202 calculates any one of color information, density information, spatial frequency information, and texture information. In these steps, the feature amount calculation unit 202 Calculates a plurality of pieces of information among color information, density information, spatial frequency information, and texture information. In step S3, the subject identification unit 201 stores the plurality of pieces of information calculated by the feature amount calculation unit 202 in the feature amount storage. It may be determined whether or not it matches or approximates a plurality of corresponding information among color information, density information, spatial frequency information, and texture information of a plurality of subjects stored in the unit 203. As a result, the accuracy of subject identification by the subject identification unit 201 increases.

  Returning to FIG. 3, the state estimation unit 207 compares the feature amount of the image of the subject identified by the subject identification unit 201 with the feature amount of each of the plurality of subjects stored in the state storage unit 205, The state of the subject identified by the subject identifying unit 201 is estimated. The shooting condition setting unit 206 sets shooting conditions from the table data in FIG. 7 stored in the condition storage unit 204 based on the subject identified by the subject identification unit 201 and the state of the subject estimated by the state estimation unit 207. The imaging condition is set in the imaging unit 301. The shooting condition setting unit 206 displays the shooting conditions set in the shooting unit 301 on the display unit 401. As a result, the user grasps the automatically set photographing conditions. Further, when there is no shooting condition that can be set for the subject, the shooting condition setting unit 206 displays information on the display unit 401 that there is no shooting condition that can be set for the subject.

  FIG. 10 is a flowchart illustrating processing executed in the imaging system 1.

  First, the imaging unit 301 provisionally captures a subject (step S11). The feature amount calculation unit 202 acquires an image of the subject from the photographing unit 301 via the subject identification unit 201 (step S12), and calculates the feature amount of the image (step S13).

  Next, the subject identifying unit 201 compares the feature amount of the image for each subject stored in the feature amount storage unit 203 with the feature amount of the image calculated in step S13 to identify the subject (step S14). . Next, the state estimation unit 207 compares the feature amount of the subject image identified in step S14 with the feature amount for each state of the plurality of subjects stored in the state storage unit 205, and the subject identification unit 201. The state of the subject identified by is estimated (step S15). Thereafter, the imaging condition setting unit 206 performs imaging from the table data of FIG. 7 stored in the condition storage unit 204 based on the subject identified by the subject identification unit 201 and the state of the subject estimated by the state estimation unit 207. A condition is selected, and the shooting condition is set in the shooting unit 301 (step S16). The photographing unit 301 photographs the subject according to the set photographing condition (step S17), and ends this process.

  As described above, according to the present embodiment, the feature amount calculation unit 202 acquires an image of a subject, calculates the feature amount of the image, and the subject identification unit 201 determines the feature amount of the calculated image. The feature amounts of the images of a plurality of subjects are compared, and the subject corresponding to the acquired image is identified. In addition, the state estimation unit 207 compares the feature amount of the identified subject image with the feature amount for each of the plurality of subject states, estimates the state of the identified subject, and the imaging condition setting unit 206 Based on the identified subject and the estimated subject state, the photographing condition is selected from data in which the photographing condition is associated with each subject state, and the selected photographing condition is set in the camera 3. Therefore, the shooting conditions suitable for the subject and its state are automatically set.

  In FIG. 3, the PC 2 includes a feature amount storage unit 203, a condition storage unit 204, and a state storage unit 205, but as shown in FIG. 11, the external storage device 7 connected to the PC 2 is a feature amount storage unit. 203, a condition storage unit 204, and a state storage unit 205 may be provided.

  The same effect as the above embodiment can be obtained by supplying a recording medium in which a software program for realizing the functions of the PC 2 is recorded to the PC 2 and the CPU 21 reads and executes the program stored in the storage medium. Play. Examples of the storage medium for supplying the program include a CD-ROM, a DVD, or an SD card.

  In addition, the CPU 21 executes the software program for realizing the PC 2 to achieve the same effect as that of the above embodiment.

  Note that the present invention is not limited to the above-described embodiment, and can be implemented with various modifications without departing from the scope of the invention.

1 is a schematic configuration diagram of an imaging system 1 according to an embodiment of the present invention. It is a block diagram which shows the hardware constitutions of PC2. It is a functional block diagram of the imaging system 1 of FIG. It is a figure which shows the example of the some information calculated from the image in the feature-value calculation part 202. FIG. It is a figure which shows the example of the spatial frequency information calculated from the image in the feature-value calculation part 202. FIG. FIG. 5 is a diagram illustrating an example of image feature amounts for each subject stored in a feature amount storage unit 203; It is a figure which shows an example of the table data which linked | related each state of each subject with the imaging condition. It is a figure which shows the example of the information memorize | stored in the state memory | storage part. 5 is a flowchart showing subject identification processing executed by a feature amount calculation unit 202 and a subject identification unit 201. 3 is a flowchart illustrating processing executed in the imaging system 1; It is a functional block diagram of the modification of the imaging | photography system 1 of FIG.

Explanation of symbols

1 photographing system 2 computer (PC)
3,5 Camera 4 Monitor 201 Subject identification unit 202 Feature amount calculation unit 203 Feature amount storage unit 204 Condition storage unit 205 State storage unit 206 Shooting condition setting unit 207 State estimation unit

Claims (13)

Feature amount calculation means for acquiring an image of a subject and calculating a feature amount of the image;
Subject identification means for comparing the calculated feature amount of the image and the feature amounts of the images of a plurality of subjects to identify a subject corresponding to the acquired image;
A state estimation unit that compares the feature amount of the image of the identified subject with the feature amount of each state of the plurality of subjects and estimates the state of the identified subject;
Setting means for selecting a shooting condition from data in which shooting conditions are associated for each state of each subject based on the identified subject and the estimated subject state, and setting the selected shooting condition in the shooting apparatus A photographing auxiliary device comprising:   The feature amount of the image is at least one of color information, density information, spatial frequency information, and texture information, and the state of the subject is scratch, dirt, rubbing, or peeling. The photographing auxiliary device according to 1.   The image processing apparatus according to claim 1, further comprising a storage unit configured to store feature values of the images of the plurality of subjects, feature amounts for the states of the plurality of subjects, and data associated with shooting conditions for the states of the subjects. The photographing assisting device according to 1 or 2.   The photographing assisting device is connected to an external storage device that stores feature amounts of the images of the plurality of subjects, feature amounts for the states of the plurality of subjects, and data associated with photographing conditions for the states of the subjects. The photographing assisting device according to claim 1 or 2, wherein the photographing assisting device is provided.   5. The imaging condition according to claim 1, wherein the imaging condition includes setting information at the time of imaging of the imaging apparatus, information indicating an imaging method, and information indicating a setting for capturing change with time of the subject. The photographing auxiliary device according to 1. A photographing device for photographing a subject;
A feature amount calculating means for acquiring an image of the subject from the photographing apparatus and calculating a feature amount of the image;
Subject identification means for comparing the calculated feature amount of the image and the feature amounts of the images of a plurality of subjects to identify the subject corresponding to the acquired image;
State estimation means for comparing the feature quantity of the image of the identified subject and the feature quantity for each state of the plurality of subjects to estimate the state of the identified subject, and the identified subject and the estimation A photographing auxiliary device having setting means for selecting a photographing condition from data in which a photographing condition is associated with each subject state based on the selected subject state and setting the selected photographing condition in the photographing device; A photographing system comprising:   The feature amount of the image is at least one of color information, density information, spatial frequency information, and texture information, and the state of the subject is scratch, dirt, rubbing, or peeling. The shooting system described in 1.   The image processing apparatus according to claim 1, further comprising a storage unit configured to store feature values of the images of the plurality of subjects, feature amounts for the states of the plurality of subjects, and data associated with shooting conditions for the states of the subjects. The imaging system according to 6 or 7.   The photographing assisting device is connected to an external storage device that stores feature amounts of the images of the plurality of subjects, feature amounts for the states of the plurality of subjects, and data associated with photographing conditions for the states of the subjects. The imaging system according to claim 6 or 7, wherein   10. The imaging condition according to claim 6, wherein the imaging condition includes setting information at the time of imaging of the imaging apparatus, information indicating a shooting method, and information indicating a setting for capturing a change with time of the subject. The shooting system described in 1.   The display device is connected to the photographing assisting device, and the setting unit displays the photographing condition set in the photographing device on the display unit. The imaging system according to item.   2. The display device according to claim 1, wherein when there is no shooting condition that can be set for the subject, the setting unit displays information indicating that there is no shooting condition that can be set for the subject. 11. The photographing system according to 11. Computer
A feature amount calculating means for acquiring an image of a subject and calculating a feature amount of the image;
Subject identification means for comparing the calculated feature amount of the image and the feature amounts of the images of a plurality of subjects to identify the subject corresponding to the acquired image;
A state estimation unit that compares the feature amount of the image of the identified subject with the feature amount of each state of the plurality of subjects and estimates the state of the identified subject;
Based on the identified subject and the estimated subject state, a setting unit that selects a photographing condition from data in which a photographing condition is associated with each subject state and sets the selected photographing condition in the photographing device. A program characterized by functioning as

Images