JP2011071897A - Imaging apparatus - Google Patents

Abstract

An object of the present invention is to provide an imaging device capable of acquiring an image in which a facial expression of each person can be understood when photographing a human face.
An imaging apparatus includes a control unit that controls an imaging device so that imaging is performed at least once during an interval period in which self-timer imaging is performed, and imaging for self-timer imaging is performed after the interval period elapses. . A face detection unit that performs face detection for specifying a face area in an image obtained by imaging with an image sensor during the interval period is provided. For each of the face areas specified by the face detection section, an image processing section that cuts out a close-up image of an area including one face area as a still image is provided.
[Selection] Figure 5

Description

  The present invention relates to an imaging apparatus that performs imaging by close-up of an area including a face area specified by a face detection function before self-timer imaging.

  2. Description of the Related Art Conventionally, there has been proposed an image pickup apparatus capable of shooting using a self-timer function (self-timer shooting) when taking a group photo of a plurality of persons including a photographer. For example, Patent Document 1 discloses an imaging apparatus that captures a moving image during a standby time until self-timer imaging is performed.

JP 2005-94339 A

  However, when photographing a plurality of human faces, the size of one face may be reduced, making it difficult to understand the facial expression.

  Accordingly, an object of the present invention is to provide an imaging device capable of acquiring an image in which each facial expression can be understood when photographing a human face.

  An image pickup apparatus according to the present invention performs control at least once during an interval period in which self-timer shooting is performed, and controls the image sensor so as to perform image pickup for self-timer shooting after the interval period has elapsed. An area including one face area for each of a face detection unit for performing face detection for specifying a face area in an image obtained by imaging with an image sensor during an interval period and a face area specified by the face detection unit An image processing unit that cuts out the close-up image as a still image.

  In the whole image obtained by shooting the subject including multiple face areas, one face area may become small and the expression may be difficult to understand, but close-up shooting before imaging for self-timer shooting is possible. It is possible to obtain a close-up image and obtain an image having a face area that is large enough to recognize a facial expression by capturing an image for the purpose of cutting out an area including each face area.

  Preferably, the image processing unit synthesizes a close-up image around the entire image obtained by imaging for self-timer imaging.

  This makes it possible to obtain a composite image that combines the whole image and the face of a person included in the whole image using the close-up image. Note that a close-up image for obtaining a composite image is obtained by imaging during an interval period before imaging for self-timer imaging, and therefore does not delay the timing of self-timer imaging.

  More preferably, the image recording apparatus further includes a recording medium for recording the close-up image, and the close-up image is recorded with the same recording size as the whole image obtained by the self-timer shooting and a data compression rate at the time of image recording being increased. .

  Since a close-up image is used after being cut out from a part of the image obtained by close-up shooting, it is used for enlargement so that the recording size and image quality (data compression at the time of image recording) Rate) is recorded at the same level as the whole image obtained by the self-timer shooting.

  More preferably, the control unit controls the image sensor so that imaging is performed at regular intervals after imaging for obtaining a close-up image during the interval period, and obtained by imaging at regular intervals. Based on the image, the face detection unit identifies the face area, and all the faces in the face area specified by the face detection part are in a smiling state, or all the faces in the face area specified by the face detection unit When the eyes are open, imaging for self-timer imaging is performed even during the interval period.

  By adjusting the timing at which self-timer shooting is performed based on the smile and the degree of opening of the eyes, it is possible to obtain an entire image in which everyone on the subject is smiling or with eyes open.

  Preferably, the control unit controls the image sensor so that imaging is performed at regular intervals after imaging for obtaining a close-up image during the interval period, and is obtained by imaging at regular intervals. Based on the captured image, the face detection unit identifies the face area, and all faces in the face area specified by the face detection part are in a smiling state, or the total face area specified by the face detection unit Even after the interval period elapses until all eyes are opened, imaging for self-timer imaging is waited.

  As described above, according to the present invention, it is possible to provide an imaging apparatus capable of acquiring an image in which each facial expression can be understood when photographing a person's face.

It is a block diagram of the imaging device in this embodiment. It is a figure which shows the example of a live view display of the state which detected five face areas. It is a figure which shows the close-up image example which cut out and extended the area | region containing one face area | region. It is a figure which shows the example of a whole image containing five face areas. It is a figure which shows the example of a synthesized image which synthesize | combined the whole image and the close-up image. It is a flowchart which shows the procedure which acquires a close-up image and a synthesized image. It is a flowchart which shows the procedure which adjusts the start timing of self-timer imaging | photography. It is a figure which shows the example of the whole image obtained by performing self-timer imaging | photography with all the eyes opened.

  Hereinafter, the present embodiment will be described with reference to the drawings. The imaging apparatus 10 according to the present embodiment includes an imaging element 11, a focusing lens 12, an image processing unit 13 including a face detection unit, a release button 14, a display unit 15, a recording medium 16, a camera control unit 17, and an operation unit 18. It is a digital camera (see FIG. 1). The face detection unit may be built in the image processing unit 13 or may be provided outside the image processing unit 13.

  Reflected light from the subject enters through the lens including the focusing lens 12 and is imaged by the image sensor 11. The image processing unit 13 performs predetermined image processing on the image signal obtained by imaging to generate image data, and displays an image corresponding to the image data on the display unit 15. By performing such an operation for each frame, a through image is displayed on the display unit 15 (live view display). The camera control unit 17 controls each unit of the imaging apparatus 10 such as the image processing unit 13. Further, the image processing unit 13 specifies a face area in an image corresponding to the image data generated based on the image signal obtained by imaging, whether the face of the specified face area is a smile, and eyes Determine whether or not is closed.

  When the release button 14 is half-pressed, the image processing unit 13 calculates exposure conditions (aperture value, exposure time, etc.) and focus control based on a luminance signal obtained from an image signal obtained by imaging. Do. In the focus control, the image processing unit 13 sequentially generates contrast data based on the luminance signal while moving the focusing lens 12 in the optical axis direction of the lens, and determines that the focus is achieved when the contrast data shows the maximum value. Then, the focusing lens 12 is stopped at the position determined to be in focus (focus position).

  When the release button 14 is fully pressed, the image processing unit 13 captures an image under exposure conditions such as an aperture value determined when the shutter release button is half-pressed or a focusing position of the focusing lens 12, and applies a predetermined value to an image signal obtained by the imaging. The image processing is performed to generate image data, a still image based on the image data is displayed on the display unit 15, and an image file including the image data is recorded on the recording medium 16.

  The operation unit 18 sets on / off of a self-timer function for delaying imaging corresponding to the full-pressing operation of the release button 14 (imaging for self-timer imaging) by a predetermined interval period (such as 12 seconds), and an entire image described later. This is used for various operation settings such as whether to synthesize a close-up image.

  When the user uses the operation unit 18 to turn on the self-timer function of the imaging apparatus 10, the camera control unit 17 performs close-up shooting until the self-timer shooting is performed. Specifically, the face area is specified by the face detection function of the image processing unit 13 based on the through image (see the dotted line frame in FIG. 2). The image sensor 11 is controlled so as to perform imaging once or more during the interval period. Such photographing is performed under the exposure condition calculated when the release button 14 is half-pressed. Based on the information of the identified face area, the face detection unit of the image processing unit 13 is controlled so as to identify the face area from the image obtained by such shooting. The image processing unit 13 is controlled so as to cut out an image (close-up image) of an area including the face area as a still image. An image file including the image data obtained by cutting is recorded on the recording medium 16 (see FIG. 3). When a plurality of face areas are specified, the face area is cut out for each area, image data of the cut out area is created, and an image file is recorded. Therefore, when only n face areas are specified and shooting for obtaining a close-up image is performed m times, n × m image files are recorded (n and m are natural numbers).

  The close-up image is stretched and displayed on the display unit 15 to be used for confirming the expression of each face, and is synthesized around the entire image obtained by self-timer shooting described later. Used to get.

  The size of the area including the face area is set so that the face area is at the center and is a certain size of the face area. Self-timer shooting is performed after the close-up shooting and when a predetermined interval period elapses after the release button 14 is fully pressed (see FIG. 4).

  In addition, since a close-up image is used after being cut out from a part of an image obtained by close-up shooting, it is used for enlargement, so that the recording size and image quality (when recording an image) The data compression rate is preferably recorded at the same level as the whole image obtained by the self-timer shooting.

  Further, in order to track the face area, after the release button 14 is fully pressed and until close-up shooting is performed, an imaging operation for displaying a through image is performed for each frame, and face detection is continuously performed. It is desirable to be done.

  Furthermore, when the user selects a mode for combining a close-up image with the entire image using the operation unit 18, the image processing unit 13 closes the entire image obtained by self-timer shooting. Image data obtained by combining close-up images obtained by shooting is generated, and an image file including the image data is recorded on the recording medium 16 (see FIG. 5).

  When only n face areas are specified and m close-up images have been shot, n × m images are synthesized around the entire image. FIG. 5 shows a state where n = 5 and m = 1. For each identified face area, the image processing unit 13 selects one piece of image data including a smiling face or a face with open eyes, and synthesizes it around the entire image. May be.

  Next, a procedure for obtaining a close-up image or a composite image will be described with reference to the flowchart of FIG. When the power supply of the imaging device 10 is turned on, an imaging operation for displaying a through image (an imaging operation not linked to the operation of the release button 14) is started. In step S11, the image processing unit 13 detects a face area in an image obtained by imaging for displaying a through image, and the camera control unit 17 determines whether the image processing unit 13 has identified n face areas. Judge whether or not. If specified, the process proceeds to step S12. If not specified, step S11 is repeated. The imaging operation and the face area detection for displaying the through image are performed until the close-up shooting in step S15, and the face detection result is updated for each frame.

  In step S12, the camera control unit 17 determines whether or not the release button 14 is fully pressed in a state where the self-timer function of the imaging device 10 is turned on by the user. If so, the process proceeds to step S13. If not, step S12 is repeated.

  In step S13, the camera control unit 17 starts counting down the interval period. In step S <b> 14, the camera control unit 17 calculates the number m of shootings performed to acquire a close-up image during the countdown of the interval period. The number of shots m may be set in advance.

  In step S15, the camera control unit 17 controls each unit and performs close-up shooting for the number m determined in step S14. Further, the camera control unit 17 controls the image processing unit 13 to cut out image data of regions including n face regions (close-up images) as m still images from m close-up images. It is generated and recorded on the recording medium 16. In step S16, the camera control unit 17 determines whether or not the countdown for the interval period has ended. If completed, the process proceeds to step S17. If not completed, step S16 is repeated.

  In step S <b> 17, the camera control unit 17 controls each unit, performs self-timer shooting, and acquires an entire image. In step S18, the camera control unit 17 determines whether or not the user has selected a mode for combining the close-up image with the entire image. If it is selected, the process proceeds to step S19. If it is not selected, the process proceeds to step S20.

  In step S19, the camera control unit 17 controls the image processing unit 13 to read the close-up image recorded on the recording medium 16, and synthesizes it around the entire image obtained in step S18. An image file including image data corresponding to the composite image is recorded on the recording medium 16. Further, the camera control unit 17 displays the composite image on the display unit 15. In this case, not only the composite image but also an image file including image data corresponding to the entire image may be recorded on the recording medium 16.

  In step S20, the camera control unit 17 controls the image processing unit 13 to record the image file including the image data corresponding to the entire image obtained in step S18 on the recording medium 16. The camera control unit 17 displays the entire image on the display unit 15.

  In the whole image obtained by photographing a subject including a plurality of face areas, there is a possibility that one face area becomes small and the expression becomes difficult to understand, but like this embodiment, before self-timer shooting, It is possible to obtain a close-up image by obtaining a close-up image and cutting out an area including each face area, and an image having a face area large enough to recognize a facial expression.

  Further, it is possible to obtain a composite image that combines the entire image and the face of a person included in the entire image using the close-up image. Note that the close-up image for obtaining the composite image is obtained by imaging in the interval period before the self-timer photographing, so that the timing of the self-timer photographing is not delayed.

  In the present embodiment, the interval period of the self-timer shooting may be set in advance, but depending on whether the face detected on the subject is smiling or whether the eyes are closed by the face detection function, The interval period may be shortened or lengthened.

  Specifically, in the face detection performed by the image processing unit 13, tracking of the face area is performed, and when all the faces of the specified face area are smiling or the eyes are not closed, the interval is set. Even if it is shorter than the period, the self-timer shooting is performed, or even if the interval period elapses, it waits without performing the self-timer shooting until such a state is reached.

  Next, the procedure for adjusting the interval period and performing self-timer shooting based on the face detection result will be described with reference to the flowchart of FIG. When the power supply of the imaging device 10 is turned on, an imaging operation for displaying a through image (an imaging operation not linked to the operation of the release button 14) is started. In step S31, the image processing unit 13 detects a face area in an image obtained by imaging for displaying a through image, and the camera control unit 17 determines whether the image processing unit 13 has identified n face areas. Judge whether or not. If specified, the process proceeds to step S32. If not specified, step S31 is repeated. The imaging operation and the face area detection for displaying the through image are performed until the self-timer photographing in step S35, and the face detection result is updated every frame.

  In step S <b> 32, the camera control unit 17 determines whether or not the release button 14 is fully pressed in a state where the self-timer function of the imaging apparatus 10 is turned on by the user. If so, the process proceeds to step S33. If not, step S32 is repeated.

  In step S33, the camera control unit 17 controls the image processing unit 13 to determine whether all the faces in the n face areas identified in step S31 are smiling. If all smiles, the process proceeds to step S35, and if not, the process proceeds to step S34.

  In step S <b> 34, the camera control unit 17 controls the image processing unit 13 to determine whether or not all the eyes of the n face areas identified in step S <b> 31 are open (not closed). . If all eyes are open, the process proceeds to step S35, and if not, the process returns to step S33.

  In step S35, the camera control unit 17 controls each unit to perform self-timer shooting, acquire an entire image, and record an image file including image data corresponding to the entire image on the recording medium 16 (see FIG. 8). ). The camera control unit 17 displays the entire image on the display unit 15.

  Note that a mode for performing close-up shooting in step S15 shown in the flowchart of FIG. 6 may be added between step S32 and step S33, and timing adjustment for self-timer shooting may be performed after the close-up shooting is completed. Further, after step S35, a form of combining the close-up image with the entire image may be added to step S19.

  Further, the procedures of steps S33 and S34 are performed during close-up shooting in step S15 of the flowchart of FIG. 6, and whether the faces in the n face areas are all smiling (step S33 is Yes) or n faces. When all the face eyes in the region are open (Yes in step S34), the close-up shooting may be terminated and the self-timer shooting in step S17 may be performed.

  By adjusting the timing at which self-timer shooting is performed based on the smile and the degree of opening of the eyes, it is possible to obtain an entire image in which everyone on the subject is smiling or with eyes open.

DESCRIPTION OF SYMBOLS 10 Image pick-up device 11 Image pick-up element 12 Focusing lens 13 Image processing part 14 Release button 15 Display part 16 Recording medium 17 Camera control part 18 Operation part

Claims (5)

A controller that controls the image sensor so as to perform imaging for the self-timer imaging after the interval period has been taken, during the interval period in which self-timer imaging is performed;
A face detection unit for performing face detection for identifying a face region in an image obtained by imaging with the imaging element during the interval period;
An image processing apparatus comprising: an image processing unit that cuts out a close-up image of a region including one face region as a still image for each of the face regions specified by the face detection unit.   The imaging apparatus according to claim 2, wherein the image processing unit synthesizes the close-up image around a whole image obtained by imaging for the self-timer imaging. A recording medium for recording the close-up image;
The imaging according to claim 1, wherein the close-up image is recorded with the same recording size as that of the entire image obtained by the self-timer photographing and a data compression rate at the time of image recording being increased. apparatus. The control unit controls the imaging element so as to perform imaging every predetermined time after imaging for obtaining the close-up image during the interval period,
Based on the image obtained by the imaging at regular intervals, the face detection unit identifies a face area,
When all faces of the face area specified by the face detection unit are in a smiling state or when all eyes of the face area specified by the face detection unit are in an open state, the interval period The imaging apparatus according to any one of claims 1 to 3, wherein imaging for the self-timer imaging is performed even in the middle. The control unit controls the imaging element so as to perform imaging every predetermined time after imaging for obtaining the close-up image during the interval period,
Based on the image obtained by the imaging at regular intervals, the face detection unit identifies a face area,
The interval period is until all faces in the face area specified by the face detection unit are in a smiling state or all eyes in the face area specified by the face detection unit are in an open state. The imaging apparatus according to any one of claims 1 to 3, wherein imaging for the self-timer imaging is on standby even after elapses.

Images