JP2015154220A - Lighting control device - Google Patents

Abstract

An illumination control device that enables finer adjustment of light and darkness as illumination at the time of photographing is provided. A communication unit 206 is connected to an imaging device 202 and an image projection device 203 and has a function of communicating image data. The communication unit 206 receives image data and imaging information captured by the imaging device, and the image data and Analyzing means 207 for analyzing image data from shooting information and outputting the analysis result, image generating means 208 for generating image data for projection from the image data and shooting information and analysis result, and projection apparatus for projecting image data And transmitting means 209 for transmitting to. [Selection] Figure 2

Description

  The present invention relates to a lighting control device that controls a lighting device, and more particularly to a lighting control device that controls a lighting device including a projector.

  Conventionally, when photographing in a studio or the like, an illumination device such as a halogen lamp has been used. FIG. 10 shows a state of such photographing, and is a case where a person 1002 as a subject on the photographing set 1001 is photographed with a camera 1003. In the figure, 1004 and 1005 are used as lighting devices. An illumination control device that controls the illuminance of the illumination device is also generally known.

  On the other hand, it is known that an image is projected onto a screen by a projector, and further, the projected image is photographed by a camera and color unevenness of the screen is corrected from the image (see Patent Document 1). Furthermore, there is known a method of improving the contrast by taking a projected image with a camera and projecting it with a projector (see Patent Document 2).

JP 2004-158941 A Special table 2001-522544 gazette

  However, in the conventional lighting device, although the overall brightness can be adjusted, the details of the subject cannot be adjusted. For example, as shown in FIG. 10, when shooting is performed using lighting devices 1004 and 1005 in a studio, even if the brightness of the illumination is adjusted, the background 1006 of the shooting set 1001 is displayed as shown in FIG. In some cases, the shadow 1007 of the subject person 1002 remains. Also, as shown in FIG. 12, a shadow 1201 may remain on the nose of a person's face. Furthermore, when a shadow is supplemented with a plurality of lights, there is a problem that the contrast of the entire subject is lowered.

  In Patent Document 1 and the like, the purpose is to correct screen color unevenness and the like, and it does not adjust the illuminance to the subject. Similarly, Patent Document 2 improves the contrast by projecting an image of a specific subject as it is, but it is not suitable for a wide space including a subject and a background like a studio.

  Accordingly, an object of the present invention is to provide an illumination control device that enables finer adjustment of brightness and darkness as illumination at the time of photographing.

In order to achieve the above object, the present invention provides:
A lighting control device for controlling lighting,
It has a function of communicating with image data by connecting to a photographing device and an image projection device,
Communication means for receiving image data and photographing information photographed by the photographing device;
Analyzing means for analyzing image data and outputting an analysis result from the image data and the photographing information;
Image generation means for generating image data for projection from the image data, the photographing information, and the analysis result;
Transmitting means for transmitting the projection image data to the projection apparatus.

  ADVANTAGE OF THE INVENTION According to this invention, the illumination control apparatus which enabled the finer brightness adjustment as illumination at the time of imaging | photography can be provided.

Shooting in the first embodiment Configuration diagram of the first embodiment Configuration diagram of the image generation unit of the first embodiment (A) Image taken with normal illumination, (b) Image extracted from correction area, (c) Histogram of image, (d) Correction image, (e) Correction result (A) a face image photographed with normal illumination, (b) an image obtained by extracting a face area, (c) an image excluding images not to be corrected, (d) a histogram of the excluded images, (e) a corrected image, (F) Corrected shooting result Shooting in the second embodiment Configuration diagram of the second embodiment Configuration diagram of image generation unit of second embodiment (A) Image taken with normal illumination, (b) Deformed image, (c) Extracted image, (d) Corrected image, (e) Projected corrected image viewed from camera side, (f) Corrected image Conventional shooting Conventional captured image Conventional face image

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[Example 1]
Hereinafter, an illumination control apparatus using a projector as an illumination apparatus according to a first embodiment of the present invention will be described with reference to FIGS. In this embodiment, the shadow portion of the subject is corrected so that no shadow is generated in the captured image. That is, a case will be described in which a correction image is projected from a projector and a shadow portion of a subject is corrected by an illumination control device.

  FIG. 1 shows a state of photographing according to the present embodiment. In the figure, reference numeral 101 denotes a shooting set, in which a person 102 as a subject is shot with a camera 103. Reference numerals 104 and 105 denote illumination devices that irradiate the person 102. The figure shows a state in which the shadow 107 of the person 102 remains on the background 106, and this shadow is corrected by this embodiment described later. Reference numeral 108 denotes a projector according to this embodiment, which is placed near the camera 103 and projects a corrected image onto the person 102 together with the lighting devices 104 and 105. Reference numeral 109 denotes an illumination control device according to this embodiment, to which a camera 103, illumination devices 104 and 105, and a projector 108 are connected.

  FIG. 2 is a diagram showing the configuration of the illumination control device 109 according to the present embodiment and the connection relationship between the surroundings. In the figure, reference numeral 201 denotes a lighting control apparatus according to the present embodiment, and its main functions are shown in blocks. The lighting control device 201 is connected to a camera 202, a projector 203, and lighting devices 204 and 205. The camera 202 corresponds to the camera 903 in FIG. 1, the projector 203 corresponds to the projector 108 in FIG. 1, and the lighting devices 204 and 205 correspond to the lighting devices 104 and 105 in FIG. 1, respectively.

  Next, main functions of the illumination control device 201 will be described. The receiving unit 206 receives image data and camera information from the camera 202. The image analysis unit 207 analyzes the image data received by the reception unit 206. The image creation unit 208 creates a corrected image to be projected by the projector 202 from image data or the like. As shown in FIG. 3, the image creation unit 208 includes a correction area determination unit 302 and a luminous intensity adjustment unit 303. The transmission unit 209 transmits the corrected image to the projector 202. The illumination adjustment unit 210 adjusts the light amount of the illumination devices 204 and 205. The output unit 211 outputs light amount information to the lighting devices 204 and 205.

  Next, an operation until a corrected image is created by the illumination control device 201 and projected from the projector 203 will be described.

  First, the illumination control device 201 uses the illumination adjustment unit 210 to adjust the illumination devices 204 and 205 to a light amount corresponding to normal illumination. Next, the camera 202 takes a picture while illuminating the subject with the lighting devices 204 and 205. As a result of the shooting, the receiving unit 206 receives image data and camera information from the camera 202 via the receiving unit 206. As shown in FIG. 4A, the image data photographed at this time is in a state where a shadow 107 of the person is captured together with the person 102 in the image. Further, as shown in FIG. 5A, a nose shadow is generated on the face portion of the person 102. The camera information includes the focal length of the photographing lens, the AE photometric value, the distance information about the subject, and the like.

  Next, the image analysis unit 207 analyzes the image of the image data and extracts a shadow area to be corrected. This can be done by using, for example, a histogram of luminance values of the image data shown in FIG. In FIG. 4B, the peaks of the histogram are at 401 and 402. In this case, it is considered that the luminance value of the shaded area is a value around 402. Therefore, a value near 402 is set as a threshold value 403, and image data having a luminance value equal to or lower than the threshold value is determined to be a shadow image as an analysis result. In addition to the histogram, camera information can be used for the analysis by the image analysis unit 207. In addition, when the correction target image has a feature, the image can be analyzed more easily. For example, when the correction target is the face image shown in FIG. 5A, the face position can be detected by the face detection function, so that only the face image portion can be focused. The case where the face image is extracted from the contour information is the state shown in FIG. Further, when images such as eyes and mouth are excluded as images not to be corrected, a face portion as shown in FIG. 5C remains.

  Therefore, a shadow area to be corrected may be extracted from the remaining face portion. In this case, since the image of the luminance value histogram of the remaining face portion is limited, as shown in FIG. 5D, a peak 501 indicating a region not to be corrected among the remaining face portion and The peak 502 indicating the region corresponding to the shadow of the nose to be corrected can be clearly separated. Therefore, with the value in between as a threshold value 503, it is determined that image data having a luminance value less than or equal to this threshold value is an image of a nose shadow and is used as an analysis result. The image analysis unit 207 sends these analysis results to the image creation unit 208.

  Next, the image creation unit 208 creates a corrected image. The correction image is an image projected from the projector 203 onto the subject, and is created so that the area (correction area) projected onto the shadow portion to be corrected becomes the correction illuminance value. The corrected illuminance value has a light amount that compensates for the difference between the shadow portion and the luminance value of the peripheral portion. That is, by projecting an image having a corrected illuminance value on the shadow portion, the light amount of the shadow portion is made equal to the light amount of the peripheral portion, and a shadow is prevented from appearing in the captured image.

  FIG. 3 is a diagram showing the configuration of the image creation unit 208. In FIG. 3, the image creation unit 301 includes a correction area determination unit 302 and a luminous intensity adjustment unit 303. In the image creation unit 301, the correction region determination unit determines the correction region of the correction image, the light amount adjustment unit determines the luminance value of the correction region, and the correction image 307 is generated.

  First, the correction area determination unit 302 receives the image data 305 from the reception unit 206 and the analysis information 306 from the image analysis unit 207. As described above, the analysis information is, for example, a threshold value of the luminance value of the image. The correction area determination unit 302 extracts an image below this threshold value from the image data 305. For example, by applying the threshold value 403 to the image data in FIG. 4A, the shadow area to be corrected is extracted as shown in FIG. The black portion in FIG. 4C corresponds to the shadow portion area to be corrected.

  Next, from the extraction result, the brightness adjustment unit 303 determines the brightness value (corrected brightness value) of the correction area. The light intensity adjustment unit 303 receives camera information from the reception unit 206 together with the extraction result. The light intensity adjustment unit 303 corrects the correction luminance value for the correction area of the correction image from the focal length of the photographing lens, the AE metering value, the distance information about the subject, the maximum illuminance of the projector, and the like included in the camera information. Is calculated. The corrected luminance value is set so that the corrected area becomes the corrected illuminance value when the corrected image is projected from the projector. When there are a plurality of correction areas, for example, when correcting the shadow of FIG. 4A and the shadow of the nose of FIG. 5B at the same time, the respective corrected luminance values are adjusted from the distance information about each subject. Further, when the maximum illuminance of the projector is low, the light amount of the illumination device is also adjusted. The correction brightness value is determined so that the shadow portion to be corrected can be corrected by combining the illumination by the lighting device and the projection image from the projector. The image creation unit 301 sends the illumination amount 108 to the illumination adjustment unit 210 when the light amount of the illumination device is adjusted.

  Next, the light amount adjustment unit 303 creates a corrected image 307 from the extracted image data. In other words, an image is created in which the luminance value of the correction area of the correction image is the correction luminance value and the other area is a black image. For example, an image as shown in FIG. 4D is created from an image from which correction areas have been extracted as shown in FIG. In the image of FIG. 4C, when the correction area is a black image (value is 0) and the other area is a white image (value is 1), black and white are reversed (0 is 1 and 1 is 0). ), A corrected image 307 is created by multiplying the corrected luminance values. When correcting the shadow of the nose (image in FIG. 5A), the corrected image 307 is a corrected image 307 having the shape of the shadow of the nose portion as shown in FIG. As described above, a corrected image is created by the image creation unit 208.

  The generated corrected image is sent to the projector 203 through the transmission unit 209. Here, the illumination control device 201 uses the illumination adjustment unit 210 to adjust the illumination devices 204 and 205 to the set light amount. At the same time, the corrected image is projected from the projector 203. In other words, the illumination control device 201 illuminates the subject with the illumination devices 204 and 205, projects a corrected image with the projector 203, and performs imaging with the camera 202. An example of an image shot in this way is shown in FIG. It can be seen that the shadow portion of the subject has been canceled by adding the corrected image (FIG. 4D) from the projector, compared to the image taken with only the illumination device (FIG. 4A). . Note that in the example of the face portion, an image in which the shadow of the nose portion is canceled as shown in FIG.

  As described above, according to the present embodiment, the shadow control part can be corrected by projecting the correction image from the projector by the illumination control device. That is, it is possible to adjust the brightness more finely as illumination at the time of photographing.

  In the present embodiment, an example in which only the threshold value is sent from the image analysis unit 207 to the image creation unit 208 as an analysis result is shown. However, the image data of the extraction result corresponding to FIG. It is also possible to send the message.

  Further, in the present embodiment, the illumination adjustment unit is configured to adjust the illumination. However, when the light amount of the illumination device is fixed, the shadow of the subject of the present invention is not included even if the illumination adjustment unit is not included. It is possible to correct the part. Moreover, the lighting device does not need to be plural, and may be a single lighting device.

  Furthermore, in the present embodiment, the case where the shadow is corrected brightly is shown. However, when the target to be corrected is a high-luminance part of the subject, the light amount of the illumination device is reduced so that the part other than the target to be corrected is irradiated. A corrected image may be created. In this case, it can be realized with the configuration of the present embodiment, except that the extraction conditions for correction are different.

  Furthermore, in the configuration of the present embodiment, the illumination control device 201 and the camera 202 and the projector 203 are described as independent devices. However, an equivalent function is provided in the camera 202 or the projector 203, and It is possible to obtain an equivalent effect.

[Example 2]
Correction is performed in consideration of the positional relationship of the projector. Using the angle information in addition to the distance (angle detection method: specified with a fixed projector, measured by projecting a calibration image), a corrected image is created.

  Hereinafter, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, the camera and the projector are close to each other, but in this embodiment, the positions of the camera and the projector are greatly different. In the following, the same symbols are used for devices having the same contents as in the first embodiment.

  FIG. 6 shows a state of photographing according to the present embodiment. In the figure, reference numeral 601 denotes a camera according to this embodiment, and reference numeral 602 denotes a projector according to this embodiment. The projector 602 has the same function as the projector 108 in FIG. 1, but the installation location is far away from the camera 601. Reference numeral 603 denotes an illumination control device according to the present embodiment, which is the same as the first embodiment in that the camera 601, the illumination devices 104 and 105, and the projector 602 are connected.

  FIG. 7 is a diagram showing the configuration of the illumination control device 603 according to the present embodiment and the connection relations around it. In the figure, reference numeral 701 denotes an illumination control device according to this embodiment. The illumination control device includes a position analysis unit 702 with respect to the illumination control device of the first embodiment. The position analysis unit 702 creates deformation information for the corrected image from the positional relationship between the camera 202 and the projector 203, as will be described later. The image creation unit 703 adds the deformation information from the position analysis unit 702 to create a corrected image. As shown in FIG. 8, the image creation unit 703 includes an image deformation unit 802 in addition to the configuration of the first embodiment.

  Next, the operation from when the corrected image is created by the illumination control device 701 to when it is projected from the projector 203 will be described focusing on differences from the first embodiment.

  First, the point that the camera 202 shoots with normal illumination is the same as in the first embodiment. The image data photographed at this time is the same as that shown in FIG. 4A as shown in FIG. An image obtained by viewing the subject from the projector 203 has different positions of the camera 202 and the projector 203, and thus the positional relationship between the subject and the shadowed background looks different.

  In the illumination control device 701 of the present embodiment, in addition to the first embodiment, the position analysis unit 702 analyzes the positional relationship from the relative position information of the camera 202 and the projector 203, and provides deformation information for deforming the correction image. calculate. Here, the relative position information of the camera 202 and the projector 203 indicates a relative relationship between the camera 601 and the projector 602 in FIG. In other words, it indicates at which position the camera 601 is located and the position at which the projector 602 is located as viewed from the photographing set. Since the relative position information is constant when the camera 601 and the projector 602 are fixed and photographed, the relative position information can be obtained by measuring the distance and angle from the photographing set. Further, the camera 601 and the projector 602 are equipped with position measuring means such as GPS, and the position measurement result can be sent to the illumination control device 603. Alternatively, a certain pattern such as a lattice pattern is projected from the projector 602, the image is captured by the camera 601, the captured image is sent to the lighting control device, and analyzed by the position analysis unit 702. it can.

  The deformation information for deforming the corrected image is, for example, calculated based on the shift amount with respect to the subject and the background or the distortion amount due to the angle, and is necessary for creating the corrected image from the captured image. It includes various deformation information.

  Next, the operation of the image creation unit 703 will be described with reference to FIG. In FIG. 8, reference numeral 801 denotes an image creation unit according to this embodiment, which includes an image deformation unit 802 in addition to the image creation unit 301 of the first embodiment. In the image creation unit 703, the image data 305 from the reception unit 206 is transformed by the image transformation unit 302, and then a corrected image 805 is created as in the first embodiment.

  The image deformation unit 302 deforms the image data 305 according to the deformation information 804. As described above, the deformation information is information on the deformation corresponding to the shift amount and the distortion amount due to the angle with respect to the subject and the background. As an example, FIG. 9B shows a modification when the image data in FIG. 9A is input. In FIG. 9B, with respect to the image data of FIG. 9A, the positional relationship between the subject and the shaded background is shifted according to the shift amount, and the image of the subject and the background is further distorted. It is deformed accordingly. For this image, a correction image 805 is created by the correction amount determination unit 302 and the luminous intensity adjustment unit 803 as in the first embodiment. The light intensity adjustment unit 803 may finely adjust the light amount adjustment value for the subject and the background depending on the content of the deformation information.

  As a result, an example of the corrected image 805 created by the image creation unit 801 is shown in FIG. FIG. 9E shows the state of the image viewed by the camera 202 when the corrected image of FIG. 9D is projected from the projector 203. FIG. That is, when only the projection image is projected and photographed, the correction area of the correction image overlaps with the shadow area in the normal photographing as shown in FIG. Accordingly, the shadow portion of the image is corrected, and image data in which the shadow portion of the subject is canceled is obtained as shown in FIG.

  As described above, according to the present embodiment, even in the case where the positions of the camera and the projector are greatly different, the shadow portion of the subject can be corrected as in the first embodiment. That is, it is possible to adjust the brightness more finely as illumination at the time of photographing.

  As shown in the first embodiment, this embodiment can be modified to a different configuration without changing the operation of the main function.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

101 Shooting set 102 People 103 Camera
104,105 Lighting device 106 Background 107 Shadow

Claims (7)

A lighting control device for controlling lighting,
It has a function of communicating with image data by connecting to a photographing device and an image projection device,
Communication means for receiving image data and photographing information photographed by the photographing device;
Analyzing means for analyzing image data and outputting an analysis result from the image data and the photographing information;
Image generation means for generating image data for projection from the image data, the photographing information, and the analysis result;
An illumination control apparatus comprising: a transmission unit configured to transmit the projection image data to the projection apparatus. The illumination control apparatus according to claim 1, wherein the projection image data has luminance information only in a specific area, and other values are 0 values. The illumination control apparatus according to claim 2, wherein the camera information includes distance information with respect to a subject, and has means for adjusting a value of the luminance information from the distance information. The illumination control apparatus according to claim 1, wherein the image analysis unit extracts and analyzes image features from the image data. Position analysis means for obtaining a deformation amount for deforming the image data from relative position information between the photographing apparatus and the projection apparatus, and the image generation means deforms the image data based on the deformation amount. The illumination control device according to claim 1, further comprising means. 6. A photographing apparatus having the function of the illumination control apparatus according to claim 1. An image projection apparatus having the function of the illumination control apparatus according to claim 1.