JP2017011451A - Detection apparatus, detection method, and program - Google Patents

Abstract

An object image is detected with higher accuracy. An imaging apparatus includes a first imaging unit, a second imaging unit, and an AF processing unit. The first imaging unit 16 acquires a visible light image. The second imaging unit 17 is a range including the imaging range acquired by the first imaging unit 16 and acquires a thermal image by imaging light in a wavelength region different from that of the first imaging unit 16. The AF processing unit 52 detects a face detection area that is a first area that can include a predetermined subject image from the visible light image. In addition, the AF processing unit 52 detects a face detection equivalent region that is a second region that can include a predetermined subject image from the thermal image. In addition, the AF processing unit 52 specifies a predetermined subject image area from the face detection area which is the first area and the face detection equivalent area R2 which is the second area. [Selection] Figure 4

Description

  The present invention relates to a detection device, a detection method, and a program.

  Conventionally, a digital camera equipped with a face detection function can acquire an image focused on the face by performing AF on the area detected by the face detection function. Since the face detection function using a template that is generally used detects an area that includes a face, it may include an area that is not a face (such as the background). There is a strong tendency for the area ratio to increase, and when the face detection area is set as the AF evaluation area by the contrast method, there is a problem that the focus is shifted from the face due to the influence of the contrast of the non-face area. In Japanese Patent Laid-Open No. 2004-260, this problem is sought to be solved by devising how to place AF evaluation areas and evaluation priorities using face orientation information for face-detected areas.

JP 2013-195777 A

  However, the technique described in Patent Document 1 is not necessarily an effective solution because there is a need to acquire face orientation information or there is no effect when the face orientation is front. . This problem is not limited to AF, and can occur in AE and AWB as well.

  The present invention has been made in view of such a situation, and an object thereof is to detect a subject image with higher accuracy.

In order to achieve the above object, a detection apparatus according to one embodiment of the present invention includes:
First acquisition means for acquiring a first captured image;
Second acquisition means for acquiring a second captured image by capturing light in a wavelength range different from that of the first acquisition means, the image acquisition range being acquired by the first acquisition means. When,
First detection means for detecting a first region that may include a predetermined subject image from the first captured image;
Second detection means for detecting a second region that may include the predetermined subject image from the second captured image;
Specifying means for specifying an area of the predetermined subject image from the first area and the second area;
It is characterized by providing.

  According to the present invention, a subject image can be detected with higher accuracy.

It is a block diagram which shows the hardware constitutions of the imaging device which concerns on one Embodiment of the detection apparatus of this invention. It is a schematic diagram for demonstrating the production | generation of AF evaluation area | region in this embodiment. It is a schematic diagram for demonstrating the production | generation of AF evaluation area | region in this embodiment. It is a functional block diagram which shows the functional structure for performing an imaging | photography process among the functional structures of the imaging device of FIG. 5 is a flowchart for describing a flow of imaging processing executed by the imaging apparatus of FIG. 1 having the functional configuration of FIG. 4. It is a flowchart explaining the flow of AF process among imaging | photography processes. It is a schematic diagram for demonstrating the specific example of AF evaluation area | region when a some face is detected.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram illustrating a hardware configuration of an imaging apparatus according to an embodiment of the detection apparatus of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  The imaging device 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, a first imaging unit 16, 2 includes an imaging unit 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. The input / output interface 15 is connected to the first imaging unit 16, the second imaging unit 17, the input unit 18, the output unit 19, the storage unit 20, the communication unit 21, and the drive 22.

  Although not shown, the first imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit includes a lens that collects light, such as a focus lens and a zoom lens, in order to capture a subject image.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the first imaging unit 16.
The first imaging unit 16 uses visible light as an imaging target, and the output signal of the first imaging unit 16 is hereinafter referred to as a “visible light image”. Visible light image data is appropriately supplied to the CPU 11 and an image processing unit (not shown).

The second imaging unit 17 can acquire a thermal image obtained by imaging far-infrared light using far-infrared light as an imaging target, while the first imaging unit 16 uses visible light as an imaging target. Configured as a simple infrared image sensor. The second imaging unit 17 is arranged in the vicinity of the first imaging unit 16 and is configured to be able to capture at least a part of the angle of view of the first imaging unit 16.
Note that the light that can be imaged by the first imaging unit 16 or the second imaging unit 17 is not limited to visible light or far-infrared light, but is at least electromagnetic waves, mainly visible light, up to infrared rays and ultraviolet rays. Includes X-rays, gamma rays, etc. with shorter wavelengths, or microwaves with longer wavelengths.

  The input unit 18 is configured with various buttons and the like, and inputs various types of information according to user instruction operations.

  The output unit 19 includes a display, a speaker, and the like, and outputs images and sounds.

  The storage unit 20 is configured by a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.

  The communication unit 21 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 22. The program read from the removable medium 31 by the drive 22 is installed in the storage unit 20 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20.

  In the imaging apparatus 1 configured as described above, when performing contrast AF (AutoFocus), an area including a face detected by the face detection function as an AF target area (in this embodiment, a rectangular face detection). Frame), a face and a portion other than the face are specified from an image other than the visible light image (a thermal image in the present embodiment), and the portion other than the face is excluded from the AF evaluation target, and AF within the region is performed. And a function capable of detecting a subject image of a human face with higher accuracy. Since the face detection function can be implemented by a known technique, detailed description thereof is omitted.

In face detection, since a region including a face is detected by a rectangular face detection frame, the face detection region includes a face portion and a portion other than the face (background, etc.). If the face detection area is used as the AF evaluation area as it is, the evaluation value in the AF evaluation is affected by a high contrast condition such as a tree, a building, or a point light source in a non-face area of the face detection area or a backlight situation. May fall, and the face portion may not be the target of focus. In particular, in the case of a profile, since there are many parts other than the face, the influence of the contrast of the part other than the face becomes large.
However, in this embodiment, since the temperature differs between the face and other than the face, portions other than the face specified from the temperature side are excluded from the evaluation target. In other words, the thermal image area corresponding to the face detection frame is divided by temperature, and a portion having a temperature different from the temperature of the human body is masked as a portion other than the face so that it is not an evaluation target. Only the part with a face is evaluated. As a result, the face that is the subject image can be detected with higher accuracy.

  2 and 3 are schematic diagrams for explaining generation of a target area (hereinafter referred to as “AF evaluation area”) in which AF evaluation is performed in the present embodiment. FIG. 2 shows an example in which the face of a person who is the subject image is facing the front, and FIG. 3 shows an example in which the face of the person who is the subject image is facing sideways. Yes.

  As shown in FIGS. 2 and 3, the AF evaluation area is generated by first obtaining a visible light image IMG1 output from the first imaging unit 16 and a thermal image IMG2 output from the second imaging unit 17. To do.

  Face detection is performed on the obtained visible light image IMG1, and a face detection region R1 is set in the visible light image IMG1. In the present embodiment, the face detection region R1 is set by the face detection frame of the face detection function. When the face of the person who is the subject image is facing the front, as shown in FIG. 2, the face detection region R1 is set slightly wider than the outline of the face from the eyebrows to the chin. When the face is facing sideways, as shown in FIG. 3, the face detection frame is set as the face detection region R1 from the eyebrows to the chin and the ears slightly from the sides to the chin. It has become.

  In contrast, in the thermal image IMG2, the face detection equivalent region R2 is set at a position (same position) corresponding to the face detection region R1 set in the visible light image IMG1.

  Then, the set face detection area R1 and face detection equivalent area R2 are cut out from the visible light image IMG1 and the thermal image IMG2.

Further, the cut-out face detection region R1 and the face detection equivalent region R2 are compared, and a portion (hereinafter referred to as “non-face equivalent portion”) r12 of the face detection region R1 other than the face is specified.
In the present embodiment, the non-face-corresponding portion r12 in the face detection region R1 is specified, for example, in the region divided by the boundary having a temperature difference in the face detection-corresponding region R2, which is a temperature range close to the human body (Hereinafter referred to as “face portion”) r21 is determined, and a region other than r21 is determined as a portion other than the face (hereinafter referred to as “non-face portion”) r22 in the face detection equivalent region R2. Then, the portion corresponding to the face detection region R1 of the non-face portion r22 is specified as the non-face equivalent portion r12.

Thereafter, the non-face equivalent portion r12 in the specified face detection region R1 is masked to generate an AF evaluation region. The portion other than the masked non-face equivalent portion r12 is a portion with a face (hereinafter referred to as “face equivalent portion”) r11.
In the generated AF evaluation area, the non-face equivalent portion r12 that is not a face is masked, so that it is not affected by a high-contrast subject image or the like originally present in the non-face equivalent portion r12. Since the AF can be evaluated, a subject image that is a human face can be detected with higher accuracy. Also, by using the method of the present embodiment, AF evaluation can be performed with high accuracy without using information on the orientation of the face.

In the present embodiment, the visible light image is mainly determined based on information from the subordinate thermal image, and the non-face equivalent portion r12 of the face detection region R1 is determined. However, the present invention is not limited to this.
For example, the case where the determination is made only with the visible light image or the case where the determination is made using the thermal image may be made based on a predetermined condition (for example, imaging conditions, temperature, etc.).
In this case, for example, normally visible light is mainly used (only a visible light image may be used), but it is determined based on the imaging conditions, and there is a possibility that the accuracy of face detection by visible light is low due to low backlight and brightness. In this case, the infrared light is mainly used (a thermal image is used), and the non-face-corresponding portion r12 of the face detection region R1 can be determined based on information from the secondary visible light image.
Usually, infrared light is mainly used (thermal image is used), but it is discriminated by temperature. If the temperature is high and close to body temperature, there is a possibility that the detection accuracy may decrease when using infrared light. Can be configured to be main (only a visible light image may be used).

FIG. 4 is a functional block diagram showing a functional configuration for executing the photographing process among the functional configurations of the imaging apparatus 1 as described above.
The imaging process refers to a series of processes in which an accurate AF evaluation is performed using the acquired visible light image and thermal image, and a focus position is set by AF to perform imaging.

  When executing the shooting process, as shown in FIG. 4, the imaging control unit 51, the AF processing unit 52, and the shooting processing unit 53 function in the CPU 11.

An image data storage unit 71 is set in one area of the storage unit 20.
The image data storage unit 71 stores visible light image data.

The imaging control unit 51 controls the first imaging unit 16 and the second imaging unit 17 to execute imaging. As a result, a visible light image is output from the first imaging unit 16 and a thermal image is output from the second imaging unit 17.
Further, the imaging control unit 51 sets a shooting mode by a shooting mode setting operation in the input unit 18.
Further, the imaging control unit 51 determines a half-press / full-press operation of the shutter button in the input unit 18.
Further, the imaging control unit 51 performs control to move the focus lens of the first imaging unit 16 to the focus position detected by the AF processing unit 52.

  The AF processing unit 52 executes AF processing. When the AF processing by the AF processing unit 52 is executed, an AF evaluation area is set, and a focus position where the contrast value in the AF evaluation area reaches a peak is detected.

  Specifically, the AF processing unit 52 performs face detection processing on the visible light image acquired from the first imaging unit 16. When face detection is performed as a result of the face detection process, a face detection region R1 is set in the visible light image as shown in FIGS. The AF processing unit 52 sets a previously designated AF evaluation area when no face is detected.

  In addition, the AF processing unit 52 performs condition determination. Condition determination is performed based on imaging conditions from a visible light image or the like and temperature conditions from a thermal image. At this time, if the backlight or luminance is low or the temperature is not close to the body temperature, the AF evaluation area is set using a thermal image. If the temperature is close to the body temperature, the AF evaluation area is set using only the visible light image. In the present embodiment, the visible light image is basically determined based on information from the thermal image, and the non-face equivalent portion r12 of the face detection region R1 is determined. In addition, for example, normally visible light is mainly used (only a visible light image may be used), but it is determined by imaging conditions, and there is a possibility that the detection accuracy by visible light may decrease due to low backlighting and brightness. It can be configured such that infrared light is the main (using a thermal image). Usually, infrared light is mainly used (thermal image is used), but it is discriminated by temperature. If the temperature is high and close to body temperature, there is a possibility that the detection accuracy may decrease when using infrared light. Can be configured to be main (only a visible light image may be used).

  Further, as shown in FIG. 2 or FIG. 3, the AF processing unit 52 synthesizes the non-face portion r22 of the face detection equivalent region R2 in the thermal image IMG2 with the face detection region R1 of the visible light image IMG1 to display the visible light image. The non-face equivalent portion r12 that is a portion other than the face in the face detection region R1 of the IMG1 is masked so as not to be an AF evaluation target. Then, the AF processing unit 52 sets the masked face detection area R1 as an AF evaluation area.

  Further, the AF processing unit 52 searches for the contrast value of the set AF evaluation area, and detects a focus position where the contrast value of the set AF evaluation area reaches a peak.

  The imaging processing unit 53 executes pre-imaging processing for setting, for example, AE (Automatic Exposure) and AWB (Auto White Balance), and post-imaging processing for performing image correction such as facial beauty processing.

FIG. 5 is a flowchart for explaining the flow of imaging processing executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.
The photographing process is started by an operation for starting the photographing process on the input unit 18 by the user.

  In step S <b> 11, the imaging control unit 51 sets the shooting mode by a shooting mode setting operation via the input unit 18 from the user.

In step S <b> 12, the imaging control unit 51 determines whether or not the shutter button is half-pressed in the input unit 18. By half-pressing the shutter button, the imaging control unit 51 controls the first imaging unit 16 to capture an AF image.
If the shutter button is half-pressed, YES is determined in step S12, and the process proceeds to step S13.
On the other hand, if the shutter button is not half-pressed, NO is determined in step S12, and the process returns to step S11.

  In step S13, the imaging control unit 51 and the AF processing unit 52 execute AF processing. As a result of the AF process, the focus position in AF is set. The flow of AF processing will be described later.

  In step S <b> 14, the imaging processing unit 53 executes pre-imaging processing for setting AE, AWB, and the like, for example.

In step S <b> 15, the imaging control unit 51 determines whether or not the shutter button is fully pressed in the input unit 18.
If the shutter button is fully pressed, YES is determined in step S15, and the process proceeds to step S16.
On the other hand, if the shutter button is not fully pressed, NO is determined in step S15, and the process returns to step S11.

  In step S16, the imaging control unit 51 executes imaging processing. As a result of the imaging process, imaging is performed with the set AF or the like, and a visible light image is output from the first imaging unit 16.

  In step S <b> 17, the imaging processing unit 53 executes post-imaging processing that performs image correction such as facial beauty processing, for example. As a result of the post-shooting process, a visible light image that has undergone the post-shooting process is stored in the image data storage unit 71. Thereafter, the process returns to step S11.

  FIG. 6 is a flowchart for explaining the flow of the AF process in the photographing process.

  In step S <b> 31, the AF processing unit 52 performs face detection processing on the visible light image acquired from the first imaging unit 16. When face detection is performed as a result of the face detection process, a face detection region R1 is set in the visible light image.

In step S <b> 32, the AF processing unit 52 determines whether a face has been detected from the visible light image acquired from the first imaging unit 16.
If no face is detected, NO is determined in step S32, and the process proceeds to step S33.
On the other hand, if a face is detected, YES is determined in step S32, and the process proceeds to step S34.

  In step S33, since the face is not detected, the AF processing unit 52 sets a previously designated AF evaluation area. Thereafter, the process proceeds to step S40.

  In step S <b> 34, the imaging control unit 51 controls the imaging of the second imaging unit 17 and acquires a thermal image.

In step S35, the AF processing unit 52 performs condition determination. When the imaging condition from the visible light image or the temperature condition from the thermal image is determined, and the backlight or brightness is low or the temperature is not close to the body temperature, it is determined in step S35 as [Combined thermal image]. The process proceeds to step S37. The processing after step S37 will be described later.
On the other hand, when the temperature is close to the body temperature, it is determined that only the visible light image is used in step S35, and the process proceeds to step S36.

  In step S36, the AF processing unit 52 sets the face detection area R1 of the visible light image as the AF evaluation area.

  In step S37, as shown in FIGS. 2 and 3, the AF processing unit 52 synthesizes the non-face portion r22 of the face detection equivalent region R2 in the thermal image IMG2 with the face detection region R1 of the visible light image.

  In step S38, as shown in FIGS. 2 and 3, the AF processing unit 52 masks the non-face equivalent portion r12 other than the face in the visible light image IMG1 so as not to be an AF evaluation target.

  In step S39, as shown in FIGS. 2 and 3, the AF processing unit 52 sets the face equivalent portion r11 of the masked face detection region R1 as an AF evaluation region.

  In step S40, the AF processing unit 52 searches for the contrast value of the set AF evaluation area.

In step S41, the AF processing unit 52 determines whether or not a focus position where the contrast value of the set AF evaluation area reaches a peak is detected.
If the focus position at which the contrast value reaches a peak is detected, YES is determined in the step S41, and the process proceeds to a step S42.
On the other hand, if the focus position at which the contrast value reaches a peak is not detected, NO is determined in step S41, and the process returns to step S40.

In step S42, the imaging control unit 51 performs control to move the focus lens of the first imaging unit 16 to the detected focus position. Thereafter, the AF process ends.
In the above-described embodiment, the case where only the visible light image IMG1 is used and the case where the visible light image IMG1 is the main and the thermal image IMG2 is the subordinate have been described. A case where only the IMG2 is used or a case where the thermal image IMG2 is the main and the visible light image IMG1 is the subordinate may be used for predetermined discrimination.

<Other embodiments>
In the present embodiment, even when there is a target whose face is detected within the angle of view (for example, a photograph showing a human face or an image including a human face), a plurality of faces are detected. A person's temperature is specified from the thermal image, and the face detection area including the specified person's temperature is assumed to be a person's face, and the face detection area can be configured as an AF evaluation area. With this configuration, it is possible to reliably detect a human face.
Furthermore, if the method of the first embodiment (AF process) is used to generate an AF evaluation area by masking a non-face area for a face detection area that is supposed to include a human face, the human face Can be detected with higher accuracy.

FIG. 7 is a schematic diagram for explaining a specific example of the AF evaluation area when a plurality of faces are detected.
In the example of FIG. 7, when there are a person and a photograph including the human face within the field angle range, the human face is set as the AF evaluation area.
In this example, when the face detection function is used for the visible light image, the human face and the face of the photograph are detected. However, in the thermal image, only the person has the temperature of the human body. Without performing the detection, the AF evaluation area is specified with the human side of the human body temperature as a detection target.

The imaging device 1 configured as described above includes the first imaging unit 16, the second imaging unit 17, and the AF processing unit 52.
The first imaging unit 16 acquires a visible light image IMG1.
The second imaging unit 17 is a range including the imaging range acquired by the first imaging unit 16 and acquires the thermal image IMG2 by imaging light in a wavelength region different from that of the first imaging unit 16.
The AF processing unit 52 detects a face detection region R1, which is a first region that can include a predetermined subject image (in this embodiment, a human face) from the visible light image IMG1.
Further, the AF processing unit 52 detects a face detection equivalent region R2 that is a second region that can include a predetermined subject image from the thermal image IMG2.
Further, the AF processing unit 52 specifies a predetermined subject image area from the face detection area R1 that is the first area and the face detection equivalent area R2 that is the second area.
As a result, in the imaging apparatus 1, a predetermined subject image area is divided into a face detection area R1 that is the first area of the visible light image IMG1 and a face detection equivalent area R2 that is the second area of the thermal image IMG2. Therefore, the subject image can be detected with higher accuracy.

The AF processing unit 52 uses a region in the face detection region R1 that is the first region in the visible light image IMG1 and that includes the face detection equivalent region R2 that is the second region as a predetermined subject image region. Identify.
Thereby, in the imaging device 1, an area within the face detection area R1 that is the first area and that includes the face detection equivalent area R2 that is the second area is specified as the area of the predetermined subject image. Therefore, the subject image can be detected with higher accuracy.

The area of the predetermined subject image specified by the AF processing unit 52 is narrower than the face detection area R1 that is the first area.
Thereby, in the imaging device 1, since a predetermined subject image is reliably included, the subject image can be detected with higher accuracy.

In the imaging device 1, the face detection region R1 that is the first region is plural.
The AF processing unit 52 predetermines a region that is included in the face detection region R1 that is the plurality of first regions in the visible light image IMG1 and that includes the face detection equivalent region R2 that is the second region. The subject image area is specified.
Thereby, in the imaging device 1, even if there are a plurality of face detection areas R1 as the first area, the second area detected from the viewpoint of heat different from the face detection area R1 as the first area. Since the face detection equivalent region R2 is specified, the subject image can be reliably detected.

The number of specified subject image areas to be identified is smaller than the number of face detection areas R1 which are the first areas.
Thereby, in the imaging device 1, a true subject image can be detected with higher accuracy from the face detection region R1, which is the first region.

One of the first imaging unit 16 and the second imaging unit 17 acquires a visible light image IMG1 by imaging visible light, and the other acquires a thermal image IMG2 by imaging infrared light. To do.
Thereby, in the imaging device 1, a subject image can be detected with higher accuracy with a simple configuration.

The AF processing unit 52 acquires a visible light image IMG1 by imaging visible light with either the first imaging unit 16 or the second imaging unit 17 based on a predetermined condition, and on the other hand, receives infrared light. It is determined whether or not the thermal image IMG2 is acquired by imaging.
As a result, the imaging apparatus 1 can detect the subject image with higher accuracy in order to determine conditions more suitable for detection and select acquisition of the visible light image IMG1 / thermal image IMG2.

The AF processing unit 52 determines based on the imaging condition as a predetermined condition.
Thereby, in the imaging device 1, it is possible to determine when the detection accuracy is lowered in the visible light image IMG1, and it is possible to detect the subject image with higher accuracy.

The second imaging unit 17 detects a face detection equivalent region R2 that is a second region with respect to a region corresponding to the face detection region R1 that is the first region in the thermal image IMG2.
Thereby, in the imaging device 1, in order to detect the face detection equivalent region R2 that is the second region with respect to the region corresponding to the face detection region R1 that is the first region in the thermal image IMG2, A subject image can be detected with higher accuracy.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, not only a combination of visible light and infrared light, but also a combination of visible light and ultraviolet light, a combination of infrared light and ultraviolet light, or the like may be used.

  Further, in the above-described embodiment, the present invention can be used for AE, AWB, face processing, etc. in addition to AF.

  In the above-described embodiment, the human face is detected. However, instead of detecting a human face, a face such as a photograph or an image obtained by photographing a human face instead of a human is detected. You may comprise. In this case, it is possible to configure so as to exclude the subject image obtained by detecting the temperature of the human body and the face from the detection target.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having a photographing processing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 4 is merely an example, and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional block is used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in this. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 20 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
First acquisition means for acquiring a first captured image;
Second acquisition means for acquiring a second captured image by capturing light in a wavelength range different from that of the first acquisition means, the image acquisition range being acquired by the first acquisition means. When,
First detection means for detecting a first region that may include a predetermined subject image from the first captured image;
Second detection means for detecting a second region that may include the predetermined subject image from the second captured image;
Specifying means for specifying an area of the predetermined subject image from the first area and the second area;
A detection apparatus comprising:
[Appendix 2]
The specifying unit specifies an area in the first area in the first captured image that includes the second area as an area of the predetermined subject image.
The detection device according to supplementary note 1, wherein:
[Appendix 3]
An area of the predetermined subject image specified by the specifying means is narrower than the first area;
The detection device according to supplementary note 1, wherein:
[Appendix 4]
The first region is plural,
The specifying unit specifies any one of the plurality of first regions in the first captured image, the region including the second region as a region of the predetermined subject image.
The detection device according to any one of appendices 1 to 3, wherein
[Appendix 5]
The number of areas of the predetermined subject image identified is less than the number of the first areas;
The detection device according to supplementary note 4, wherein
[Appendix 6]
One of the first acquisition unit and the second acquisition unit acquires the first captured image by capturing visible light, and the other acquires the first captured image by capturing infrared light. Obtaining a second captured image;
The detection device according to any one of supplementary notes 1 to 5, wherein:
[Appendix 7]
Based on a predetermined condition, either the first acquisition unit or the second acquisition unit acquires the first captured image by imaging visible light, and the other side captures infrared light. And a determination means for determining whether to acquire the second captured image.
The detection device according to appendix 6, wherein:
[Appendix 8]
The determining means determines based on an imaging condition as the predetermined condition;
The detection device according to appendix 7, characterized in that.
[Appendix 9]
The second acquisition means detects the second region with respect to a region corresponding to the first region in the second captured image;
The detection device according to any one of appendices 1 to 8, characterized in that:
[Appendix 10]
The predetermined subject image is a human face;
The detection device according to any one of appendices 1 to 9, characterized in that:
[Appendix 11]
A first acquisition process for acquiring a first captured image;
A second acquisition process in which a second captured image is acquired by imaging light in a wavelength range different from that of the first acquisition process, which includes an imaging range acquired by the first acquisition process. When,
A first detection process for detecting a first region that may include a predetermined subject image from the first captured image;
A second detection process for detecting a second region that may include the predetermined subject image from the second captured image;
A specifying process for specifying a region of the predetermined subject image from the first region and the second region;
A detection method comprising:
[Appendix 12]
On the computer,
A first acquisition function for acquiring a first captured image;
A second acquisition function for acquiring a second captured image by imaging light in a wavelength range different from that of the first acquisition function, the imaging range being acquired by the first acquisition function. When,
A first detection function for detecting a first region that may include a predetermined subject image from the first captured image;
A second detection function for detecting a second region that may include the predetermined subject image from the second captured image;
A specifying function for specifying an area of the predetermined subject image from the first area and the second area;
A program characterized by realizing.

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input-output interface, 16 ... 1st imaging part, 17. Second imaging unit 18 ... Input unit 19 ... Output unit 20 ... Storage unit 21 ... Communication unit 22 ... Drive 31 ... Removable media 51 ..Imaging control unit, 52... AF processing unit, 53... Imaging processing unit, 71.

Claims (12)

First acquisition means for acquiring a first captured image;
Second acquisition means for acquiring a second captured image by capturing light in a wavelength range different from that of the first acquisition means, the image acquisition range being acquired by the first acquisition means. When,
First detection means for detecting a first region that may include a predetermined subject image from the first captured image;
Second detection means for detecting a second region that may include the predetermined subject image from the second captured image;
Specifying means for specifying an area of the predetermined subject image from the first area and the second area;
A detection apparatus comprising: The specifying unit specifies an area in the first area in the first captured image that includes the second area as an area of the predetermined subject image.
The detection apparatus according to claim 1. An area of the predetermined subject image specified by the specifying means is narrower than the first area;
The detection apparatus according to claim 1. The first region is plural,
The specifying unit specifies any one of the plurality of first regions in the first captured image, the region including the second region as a region of the predetermined subject image.
The detection device according to any one of claims 1 to 3, wherein The number of areas of the predetermined subject image identified is less than the number of the first areas;
The detection device according to claim 4. One of the first acquisition unit and the second acquisition unit acquires the first captured image by capturing visible light, and the other acquires the first captured image by capturing infrared light. Obtaining a second captured image;
The detection apparatus according to claim 1, wherein the detection apparatus includes: Based on a predetermined condition, either the first acquisition unit or the second acquisition unit acquires the first captured image by imaging visible light, and the other side captures infrared light. And a determination means for determining whether to acquire the second captured image.
The detection apparatus according to claim 6. The determining means determines based on an imaging condition as the predetermined condition;
The detection device according to claim 7. The second acquisition means detects the second region with respect to a region corresponding to the first region in the second captured image;
The detection apparatus according to claim 1, wherein the detection apparatus includes: The predetermined subject image is a human face;
The detection device according to claim 1, wherein A first acquisition process for acquiring a first captured image;
A second acquisition process in which a second captured image is acquired by imaging light in a wavelength range different from that of the first acquisition process, which includes an imaging range acquired by the first acquisition process. When,
A first detection process for detecting a first region that may include a predetermined subject image from the first captured image;
A second detection process for detecting a second region that may include the predetermined subject image from the second captured image;
A specifying process for specifying a region of the predetermined subject image from the first region and the second region;
A detection method comprising: On the computer,
A first acquisition function for acquiring a first captured image;
A second acquisition function for acquiring a second captured image by imaging light in a wavelength range different from that of the first acquisition function, the imaging range being acquired by the first acquisition function. When,
A first detection function for detecting a first region that may include a predetermined subject image from the first captured image;
A second detection function for detecting a second region that may include the predetermined subject image from the second captured image;
A specifying function for specifying an area of the predetermined subject image from the first area and the second area;
A program characterized by realizing.

Images