JP2008311885A - Digital camera, camera phone - Google Patents

Abstract

Since continuous shooting in the prior art is performed in the order of focus positions stored in an apparatus, a user cannot confirm the order of shooting before shooting.
In an imaging apparatus (0200) according to the present invention, a control unit (0204) controls an imaging unit (0202) based on an imaging order determined by a user in an imaging order determination unit (0203), and a plurality of subjects. Since continuous shooting is performed while focusing on the subject, continuous shooting of the subject can be performed in an appropriate shooting order.
[Selection] Figure 2

Description

  The present invention relates to an imaging technique in a digital camera, a mobile phone with a camera, and the like.

Many digital cameras capable of continuous shooting have been developed in recent years, and many of these digital cameras capable of continuous shooting have a feature in how to focus a subject. For example, in Patent Document 1, a plurality of focus position distance data can be stored before shooting, and continuous shooting can be performed at different focus positions based on the stored plurality of distance data. In Patent Document 2, as in Patent Document 1, continuous shooting is performed while changing the focus position, and only a good image in focus on the subject is selected and stored.
JP-A-7-131698 JP 2004-135029 A

  However, since continuous shooting in the prior art is continuously shot in the order of the default focus positions stored in advance in the apparatus, there are many images in which the subject is not in focus at all, and the shooting process is very wasteful. It was. In addition, searching for a focused image from a plurality of images including images that are not in focus is cumbersome, and is particularly provided in digital cameras, mobile phones with digital cameras, and the like. When the liquid crystal display is small or the difference in the captured image depending on the focus position is small, check which subject is in focus in each of the multiple similar images taken after shooting. It was very difficult. Accordingly, an object of the present invention is to provide an imaging apparatus that efficiently images only a subject that is desired to be focused and imaged.

To solve the above problem,
(1) In the first invention, an imaging condition acquisition unit that acquires imaging conditions suitable for each subject for a plurality of subjects in the imaging region, and an imaging unit that continuously images each subject based on the imaging conditions An imaging apparatus comprising: an imaging order determination unit that determines an imaging order for imaging each subject in the imaging unit; and a control unit that controls an imaging operation in the imaging unit according to the determined imaging order To do.
(2) In the second invention, there is provided the imaging apparatus according to the first invention, wherein the imaging unit includes an imaging condition re-acquisition unit that acquires an imaging condition again immediately before imaging.
(3) In the third invention, the imaging order determining unit includes a focus distance dependency determining unit that determines an imaging order according to a focus distance between the imaging apparatus and each subject. The imaging device described in 1. is provided.
(4) In the fourth invention, the face area recognition unit for recognizing the face area of the subject in the imaging area, and the imaging order determination unit determine the imaging order in descending order of the recognized face area in the imaging area. There is provided an imaging apparatus according to any one of the first to third inventions, characterized in that the imaging apparatus has dependency determination means.
(5) In the fifth invention, a face image information holding unit that holds face image information, a subject face image information acquisition unit that acquires subject face image information that is face image information of a subject in an imaging region, and the held The face image information comparing unit that compares the face image information with the acquired subject face image information, and the imaging order determining unit are configured to obtain the acquired subject face image information and the held face image according to the comparison result. And a face image information dependence determining unit that places the imaging order of the person higher than other subjects when there is a subject determined to be the same person as the information. To 4th invention is provided.
(6) In the sixth invention, the face image information holding unit has a response frequency that is at least one of the number of times the face image information and the photograph of the person identified by the face image information are taken, the number of mails, and the number of calls The response frequency information holding unit that holds the response frequency information to be shown and the imaging order determination unit, according to the comparison result, the acquired subject face image information and the held face image information are the same person When there are a plurality of determined subjects, there is provided an imaging apparatus according to a fifth aspect of the present invention, comprising response frequency information dependence determining means for determining an imaging order in descending order of the response frequency.
(7) In the seventh invention, the face image information holding unit holds mail address holding means that holds face image information and an email address in association with each other, and holds the acquired subject face image information according to the comparison result. When there is a subject whose face image information is determined to be the same person, a captured image transmission unit that transmits a captured image to a mail address associated with the face image information after the person is imaged by the imaging unit And an imaging device according to the fifth or sixth invention.
(8) In the eighth invention, an imaging condition acquisition step for acquiring imaging conditions suitable for each subject for a plurality of subjects in the imaging region, and an imaging order determination for determining an imaging order for imaging each subject by the imaging device A control step for controlling an imaging operation in an imaging device in accordance with the determined imaging order, and an imaging step for continuously imaging each subject based on the imaging conditions by control in the control step; An imaging method comprising:

  In the imaging apparatus of the present invention configured as described above, the subject to be continuously focused is selected and the imaging order is determined, and imaging is performed in the determined imaging order. It is possible to efficiently perform imaging processing in an optimal order by focusing only on a subject to be captured without acquiring a useless image that is not in focus.

  The best mode for carrying out the present invention will be described in detail with reference to the drawings. In addition, this invention is not limited to these embodiment at all, and can be implemented with various aspects in the range which does not deviate from the summary. In addition, the relationship between the following embodiment and a claim is as follows. The first embodiment will mainly describe claims 1, 2, 8 and the like. The second embodiment will mainly describe claim 3 and the third embodiment will mainly describe claim 4 and the like. The fourth embodiment will mainly describe claims 5, 6, 7 and the like.

  << Embodiment 1 >> (Concept of Embodiment 1) Embodiment 1 will be described. FIG. 1 illustrates an outline when a mobile phone is used as the imaging apparatus. As shown in FIG. 1, when there are a plurality of subjects (0107), the imaging apparatus (0100) determines which subject is in focus and images the plurality of subjects in any order. The present invention relates to an imaging apparatus that determines an imaging order of each subject to be imaged. Note that the determined imaging order (0102) is displayed on the subject (0103) displayed on the display (0101) or the like of the imaging apparatus so as to indicate which subject is captured in what imaging order. It may be possible to confirm.

  (Configuration of Embodiment 1) FIG. 2 is a functional block diagram of an image pickup apparatus according to this embodiment. The “imaging device” (0200) according to the present embodiment includes an “imaging condition acquisition unit” (0201), an “imaging unit” (0202), an “imaging order determination unit” (0203), and a “control unit” ( 0204). Further, the imaging unit may include “imaging condition re-acquisition means” (0205).

  (Description of Configuration of First Embodiment) The “imaging device” (0200) includes at least an imaging condition acquisition unit (0201), an imaging unit (0202), an imaging order determination unit (0203), and a control unit (0204). The apparatus is not limited to these configurations and functions. For example, in addition to these configurations, the imaging condition reacquisition unit (0205) may be provided, or the configurations described in the second and subsequent embodiments may be provided. The imaging apparatus corresponds to an electronic device including a CCD camera, such as a digital camera, a mobile phone with a camera, a PDA with a camera, a notebook computer with a camera, or the like.

  The “imaging condition acquisition unit” (0201) is configured to acquire imaging conditions suitable for the subject for a plurality of subjects in the imaging region. An “imaging area” refers to an area to be imaged. In a digital camera or a mobile phone with a camera, a range displayed on a display that is normally used as a viewfinder corresponds to the imaging area. The “imaging condition” includes a focus position, an aperture, a shutter speed, presence / absence of a flash, and the like. The “imaging condition suitable for the subject” is an imaging condition suitable for photographing each subject. These may be set manually, or may be set automatically using functions such as AF (AutoFocus) and AE (Automatic Exposure).

  When recognizing that there are a plurality of subjects (not necessarily humans) in the imaging region, the imaging condition acquisition unit acquires the optimum conditions of the plurality of subjects using AF, AE, or the like. When manually setting the focus position or the like, the focus position is set by displaying a frame indicating the focus position on the display and moving the frame. In addition, an aperture, a shutter speed, and the like at the focus position are sequentially set. The imaging conditions set in this way are stored in a storage area or the like.

  The “imaging unit” (0202) is configured to continuously image each subject based on the imaging conditions. The imaging unit is composed of a CCD camera or the like. When the imaging unit accepts an imaging instruction by pressing the shutter by the user, setting a shutter by a timer, or the like, the imaging unit continuously focuses and images each subject in the imaging order set based on the control by the control unit. In principle, the imaging unit images each subject under the imaging conditions acquired by the imaging condition acquisition unit. When the imaging unit has “imaging condition re-acquisition means” (0205), AF, It is also possible to acquire an imaging condition again using the AE function and perform imaging. The imaging condition re-acquisition means may acquire the imaging conditions for all the subjects again, or may acquire the imaging conditions for each subject again. When the imaging condition re-acquisition means is provided, even if the subject moves between the acquisition of the imaging condition by the imaging condition acquisition unit and the actual imaging, the subject is moved again. It is possible to acquire optimal imaging conditions combined. Also, there is no need to re-acquire the imaging conditions for all subjects.For example, for subjects with little movement such as landscapes, there is little need to acquire the imaging conditions again. It is desirable to be able to set whether or not to do so.

  The “imaging order determination unit” (0203) is configured to determine an imaging order in which each subject is imaged by the imaging unit. The “imaging order” is an order in which imaging is performed with each subject in focus during continuous shooting by the imaging unit. The imaging order may be set manually or may be set automatically.

  3 to 5 are specific examples of a method for manually determining the imaging order. FIG. 3 shows a cursor (0301) in a state where a plurality of subjects are displayed in the imaging region (FIG. 3A) (FIG. 3B), and determines the imaging order of the subjects by operating the cursor. Show the state. The cursor can be moved by using a cross key of a digital camera or a mobile phone. In the structure of the mobile phone illustrated in FIG. 1, the cursor can be operated using the cross key (0104) of the mobile phone. First, the cursor is placed on the subject to be imaged by focusing first among a plurality of subjects. By pressing a key (such as 0105 shown in FIG. 1) corresponding to the “decision key” with the cursor positioned on the subject, the subject to be focused first can be selected (FIG. 1). 3 (c)). Similarly, the imaging order of the subject to be imaged with the second to fourth focus is determined (FIG. 3D). At this time, the imaging order can be clearly indicated to the user by displaying the determined order on the display. The imaging condition acquisition unit may acquire the imaging conditions when determining the imaging order. In this case, the focus position may be set to the position where the determination key on the subject is pressed, or the area where the face of the selected subject exists is automatically recognized by the AF function, and the area may be set as the focus position. . 3C and 3D, the area where the face of the selected subject exists is recognized and the center of the face area is set as the focus position. However, since the tree numbered <4> in FIG. 3D (circle number in the figure) is not a person, a relatively bright point or the like is not a face area but a focus position. Also, as shown in FIGS. 3C and 3D, the imaging order is displayed over the place where the enter key is pressed or the face area of the subject, so that the user can confirm the imaging order and the focus position. It is also possible to improve convenience.

  In the above specific example, when the display is a touch panel, it is possible to select a subject by an operation on the touch panel.

  FIG. 4 is one example of a method for determining the imaging order using a camera-equipped mobile phone or the like. FIG. 4 shows a state in which the imaging area is divided into 12 parts and displayed on the display (FIG. 4A). Each of the 12 divided areas corresponds to 12 keys of the “ten-key (0-9), *, #” of the mobile phone, and the imaging order can be determined in the order of pressing these keys. . For example, in the structure of the mobile phone shown in FIG. 1, 12 keys (0106) 0 to 9, *, and # correspond to the 12-divided imaging area shown in FIG. For example, when the user first depresses the “5” key of the mobile phone, the second divided area from the left and the second divided area from the top are selected and blinked (FIG. 4B). Then, by depressing a key corresponding to the enter key, the subject in the area is determined as the subject to be imaged with the first focus. Note that the divided area selected by the cross key or the like during selection of the divided area (while blinking) may be finely adjusted in the vertical and horizontal directions. Similarly, by depressing the numeric keys in the order of “4”, “6”, “1”, it is possible to select the second to fourth divided areas and determine the subject to be imaged and its order. (FIG. 4 (c)). Note that when acquiring the imaging conditions together with the determination of the imaging order, the focus on the face of the subject may be blurred if the center point of the divided area is the focus position. For this reason, it is desirable that the position of the face of the subject included in the divided area is automatically recognized by the AF function or the like, and the area where the face exists is set as the focus position (FIG. 4D).

  FIG. 5 is one specific example of a method for determining the imaging order in a multipoint ranging type single-lens digital camera or the like. FIG. 5A illustrates a case where a multipoint ranging type single-lens digital camera or the like superimposes a plurality of focus areas (0501) on the display, and the position of any focus area in this state is illustrated. The shooting order of subjects can be determined by selecting in order. FIG. 5B shows a state in which one of a plurality of focus areas is selected in order and the imaging order of the subjects 1 to 4 is determined. In addition, when acquiring the imaging conditions together with the determination of the imaging order, the focus on the face of the subject may be blurred if the point where the focus area exists is the focus position. Therefore, it is desirable that the position of the face of the subject near the focus area is automatically recognized by the AF function or the like, and the area where the face exists is set as the focus position (FIG. 5C).

  When the imaging order is determined as described above, the determined imaging order is stored in the storage area as in-focus information in association with the imaging condition. FIG. 6A illustrates in-focus information stored in a table shape. The in-focus information is information that is stored in association with the imaging order, display position, distance, aperture, shutter speed, presence / absence of flash, and the like. The display position represents the display position of the subject on the display in XY coordinates, and represents the center point of the focus area. For this reason, each imaging condition is set so that each subject is focused around the coordinates of the display position. FIG. 6B illustrates the relationship between coordinate axes and coordinates. The distance indicates a focus distance from the digital camera to the subject. The focus distance can be measured by a known measurement technique.

  The “control unit” (0204) is configured to control the imaging operation in the imaging unit in accordance with the determined imaging order. When the pressing of the shutter button of the digital camera is detected, the control unit refers to the imaging order of the subject in the imaging area and the imaging condition of each subject from the in-focus information stored in the storage area, and the imaging order is the first. Various settings of the digital camera are performed under the imaging conditions of the subject. Then, the control unit outputs an imaging instruction to the imaging unit, and imaging of a plurality of subjects is executed under imaging conditions suitable for the first subject. When imaging under conditions suitable for the first subject is executed, various settings of the digital camera are subsequently performed under the imaging conditions for the second subject, and an imaging instruction is output to the imaging unit to output the second subject. Imaging of a plurality of subjects is executed under imaging conditions suitable for the subject. By performing this process for all the subjects for which the imaging order is set, the imaging unit continuously focuses on each subject and images are captured under the optimum conditions.

  (Hardware Configuration of Embodiment 1) FIG. 7 shows the hardware configuration of the image pickup apparatus of this embodiment. Each unit, which is a component of the imaging apparatus, includes hardware and software that can be executed on the hardware. As hardware, a CPU (0701) that performs arithmetic processing, a volatile memory (0702) for temporarily recording software and each data, a non-volatile memory (0703) for recording each data such as software, An image pickup device (0704) including an image pickup element for taking an image and a lens aperture shutter, an I / O device (0705) for inputting and outputting data, a system bus (0706) for connecting them, and the like. The I / O device is connected to a cross key, a touch panel, a display for displaying an imaging area as a viewfinder, and the like as necessary. The software includes an imaging order determination program for determining the imaging order, a control program for controlling the imaging operation in accordance with the imaging order, and the like. These programs are stored at predetermined addresses A1 and A2 of the nonvolatile memory, and are expanded to predetermined addresses a1 and a2 of the volatile memory as necessary, and operate by arithmetic processing by the CPU (0701). . In addition to the above programs, in-focus information and captured image files are recorded in the nonvolatile memory and volatile memory.

  The imaging condition acquisition unit and the imaging unit that constitute the imaging apparatus include an imaging device, the imaging order determination unit includes a CPU and each memory and an imaging order determination program, and the control unit includes the CPU, each memory, and a control program. Become. Hereinafter, the processing of the imaging apparatus will be specifically described.

  (Specific Example of Embodiment 1) A specific processing flow of the imaging apparatus will be described with reference to FIG. In this imaging apparatus, first, a general imaging mode and a continuous imaging mode are selected (S0801). When a general imaging mode is selected (S0802; NO), the process for performing continuous shooting is terminated to perform general imaging without continuous shooting.

  When the continuous imaging mode is selected, the CPU displays the subject to be imaged in the imaging area of the display (S0803), and stores the imaging order determination program stored in the nonvolatile memory in the work area of the volatile memory. Expand and launch. When the imaging order determination program is activated, it becomes possible to accept a subject to be focused and an imaging order for each subject using an input device such as a cross key or a touch panel. In this state, the position of the subject and the imaging order of each subject are determined by the method shown in FIGS. Further, the focus position of each subject may be determined together with the imaging order. First, the imaging order = 1 is set (S0804), and when the subject is selected as the first imaging target (S0805), the imaging order determination program stores the imaging order and the display position of the subject (S0806). . Then, the imaging device performs AF and AE at the subject position on the subject (S0807, S0808), and stores imaging conditions such as AF and AE information in the nonvolatile memory as in-focus information together with the imaging order (S0809). At this time, information other than AF and AE information, for example, information such as shutter speed and presence / absence of flash may be stored. If there is an input of a subject to be imaged after the second (S0810; YES), the imaging sequence is incremented by 1 (S0811), and the imaging sequence and imaging conditions are sequentially stored for other subjects by the same processing. Is done. When these processes are completed, the in-focus information as shown in FIG. 6A is stored in the nonvolatile memory. It should be noted that the completion of the process of selecting the subject to be imaged can be explicitly terminated by providing a “determine key” twice or by selecting an “end key”.

  When the selection of the subject is completed (S0810; NO) and the imaging order is determined, the process proceeds to the imaging process. At this time, when the imaging apparatus includes an imaging condition reacquisition unit, it is possible to set whether or not to acquire the imaging condition immediately before imaging. When the imaging condition is reacquired (S0812; YES), a reacquisition execution flag that is a flag indicating whether or not the reacquisition is executed is set (S0813). The reacquisition execution flag is temporarily stored in the volatile memory.

  When the shutter switch is turned on in the state where the above processing is completed (S0814), the CPU loads and starts the control program stored in the nonvolatile memory in the work area of the volatile memory. The control program refers to the in-focus information stored in the non-volatile memory, reads the display position of the subject whose imaging order is No. 1 (S0815), and sets the focus of the imaging device so that the subject is in focus At the same time, the aperture is set (S0816). When the imaging apparatus includes an imaging condition reacquisition unit and the reacquisition execution flag = 1 (S0817; YES), AF, AE, etc. are performed again at the position of the first subject to acquire the imaging conditions again. (S0818, S0819). When the setting of the imaging device is completed, the shutter is driven (S0820), exposed (S0821), and imaging is performed. When imaging is performed, an image file is read from the imaging device (S0822) and stored in the nonvolatile memory (S0823). When the image file is stored in the non-volatile memory, the process proceeds to the imaging operation for the next subject, and the control program performs the same processing for the second subject (S0824; YES). When all the selected subjects are photographed and the image file is stored (S0824; NO), the continuous photographing ends. At this time, in order to clearly indicate the imaging order, an image file in which information such as the focus position of the subject and the imaging order is superimposed on the first image may be stored separately from the continuously captured image file. Good (S0825). It is desirable to store the captured image file with a file name that allows the user to intuitively recognize that the file name is a continuously captured image file, unlike an image file when the file name is normally captured. For example, a file name is formed by combining the same identifier and an identifier indicating a serial number, such as “AAA — 01.jpg” and “AAA — 02.jpg”. Also, before storing the image file in the non-volatile memory, the user selects a necessary image file at the stage of temporarily storing it in the volatile memory, and the unnecessary image file is volatilized without being saved in the non-volatile memory. It may be deleted from the memory.

  Since the captured image is stored in accordance with the set imaging order, the user can know in what order and which subject is focused before imaging. For this reason, an image file in focus after imaging can be immediately transmitted to a person who is the subject and passed. For this reason, when an image file is transmitted and passed to a person who is the subject after imaging, the image is continuously picked up from images continuously captured based on the imaging order determined by the user or the imaging order displayed on the display. You can instantly find an image that is in focus for that person.

  Note that the specific examples of the hardware configuration and processing described above are merely examples, and the present invention may be implemented with other similar hardware configurations.

  (Effect of Embodiment 1) In the imaging apparatus of the present embodiment having the above-described configuration, an imaging order is determined by selecting subjects to be continuously focused, and imaging is performed in the determined imaging order. Therefore, it is possible to efficiently perform imaging processing in an optimal order by focusing only on the subject to be imaged without acquiring a useless image in which no subject is in focus.

  << Embodiment 2 >> (Concept of Embodiment 2) Embodiment 2 will be described. In the second embodiment, an imaging apparatus that is based on the imaging apparatus of the first embodiment and that is characterized in that the imaging order is determined by the focus distance of the subject will be described.

  (Configuration of Second Embodiment) FIG. 9 is a functional block diagram of an image pickup apparatus according to this embodiment. The “imaging device” (0900) according to the present embodiment includes an “imaging condition acquisition unit” (0901), an “imaging unit” (0902), an “imaging order determination unit” (0903), and a “control unit” ( 0904), and the imaging order determining unit includes “focus distance dependency determining means” (0905).

  (Explanation of Configuration of Embodiment 2) “Focus distance dependency determining means” (0905) is configured to determine the imaging order according to the imaging apparatus and the focus distance of each subject. FIG. 10 is a specific example of a method for determining the imaging order according to the focus distance. First, in a state where a plurality of subjects are displayed in the imaging area (FIG. 10A), the cursor is displayed, and the cursor is moved to the subject to be imaged by focusing on the plurality of subjects by operating the cursor. Multiple subjects are selected (FIG. 10B). That is, the numbers displayed in FIG. 10B indicate the selection order of subjects. At this time, the focus position for focus adjustment is set to the position where the determination key on the subject is pressed, and the focus distance from the imaging device to each subject is measured using the AF function or the like. The focus position may be determined by automatically recognizing an area where the subject's face is present by the AF function. Furthermore, other imaging conditions such as an aperture value other than the focus distance may be acquired. This is shown in a table form in FIG. When the focus distance corresponding to each subject is acquired as shown in FIG. 11, the focus distance dependency determining means determines the imaging order in the order of closer or farther focus distance. For example, when the imaging order is determined in order of increasing focus distance, in the table shown in FIG. 11, since the focus distance of the second selected subject is the shortest, the imaging order of the subject is first. Become. Similarly, the imaging order of a subject that is imaged under other imaging conditions is determined according to the focus distance. FIG. 10C shows a state in which the imaging order determined by the focus distance-dependent imaging means is displayed with a numeral. As described above, it is desirable that the determined imaging order is displayed before imaging.

  Note that the focus distance may be in the order of closeness or the order of distantness. When the imaging conditions are determined by setting the focus distance to the closest or farther order, the moving time of the focusing lens can be shortened during continuous shooting, and the imaging device can be controlled more efficiently.

  In addition, a subject with a shorter focus distance than a subject with a longer focus distance has a larger movement distance on the imaging region when the same movement distance is moved. That is, even if the subject with a short focus distance moves slightly, the display position and the focus position on the imaging area change greatly, but the change in the movement of the object on the imaging area becomes smaller as the focus position becomes farther. In other words, when imaging using the imaging conditions acquired by the imaging condition acquisition unit, it is desirable to shoot an object with a shorter focus distance earlier. For this reason, in the focus distance dependency determining means, it is more preferable to determine the imaging order in the order of increasing focus distance than in the order of increasing distance.

  The imaging order can be determined immediately even if each subject is being selected, once the focus position of each subject is determined. In this case, the imaging order may be appropriately displayed according to the focus position acquired when the subject is selected. For example, as shown in FIG. 12, when one subject is selected and the focus position is acquired by the AF function, the imaging order is inevitably if the first selected subject is in a state where no other subject is selected. First. For this reason, on the display displaying the imaging region, the numeral 1 indicating the imaging order is displayed in the vicinity of the subject (or the position where the enter key is pressed for selection, the same applies hereinafter) (FIG. 12A )). Next, when another subject is selected, the focus position is acquired by the AF function for the second selected subject. Then, the second acquired focus distance is compared with the first acquired focus distance, and if the focus distance of the second subject is closer, the subject on which the number 1 is selected second on the display And the number 2 is displayed in the vicinity of the first selected subject (FIG. 12B). On the other hand, if the second acquired focus distance is longer, the number 2 is displayed in the vicinity of the second subject on the display (FIG. 12C). In this way, when the focus distance is measured and the imaging order is displayed during the journey of selecting the subject, the user can confirm the imaging order corresponding to the focus distance simultaneously with the selection.

  If the position where a plurality of subjects exist can be automatically detected by the AF function of the imaging device or the like, the detection of the subject and the determination of the imaging order in which each subject is focused can be automatically performed. Is possible. However, for example, it is provided with means for notifying the user in advance by displaying on the display that the imaging order is determined according to a predetermined rule such that the imaging order is determined in order of increasing focus distance, or determined according to the predetermined rule. It is desirable to display the imaging order on the display as described above.

  In the above-described subject selection, as described in the first embodiment, the touch panel may be used instead of the cursor, or the imaging area is divided into 12 and the “ten keys (0 to 9) of the mobile phone are divided. , *, # ”May be selected using twelve keys, or multipoint ranging may be used for selection. The method for determining the imaging order after selecting the subject to be focused is the same as in the case of the cursor.

  (Hardware Configuration of Embodiment 2) FIG. 13 shows the hardware configuration of the image pickup apparatus of this embodiment. Each unit, which is a component of the imaging apparatus, includes hardware and software that can be executed on the hardware. As hardware, a CPU (1301) that performs arithmetic processing, a volatile memory (1302) for temporarily recording software and each data, a non-volatile memory (1303) for recording each data such as software, An image pickup device (1304) including an image pickup element for taking an image and a lens aperture shutter, an I / O device (1305) for inputting and outputting data, a system bus (1306) for connecting them, and the like. The I / O device is connected to a cross key, a touch panel, a display for displaying an imaging area as a finder, or the like as necessary. The software includes an imaging order determination program for determining the imaging order, a control program for controlling the imaging operation in accordance with the imaging order, and the like. However, the imaging order determination program according to the first embodiment is different from the imaging order determination program according to the first embodiment in that a focus distance dependency determination function for determining an imaging order according to the focus distance between the imaging apparatus and each subject is added. Is different. These programs are stored at predetermined addresses A1 and A2 of the non-volatile memory, and are expanded to predetermined addresses a1 and a2 of the volatile memory as necessary, and operate by arithmetic processing by the CPU (1301). . In addition to the above programs, in-focus information and captured image files are recorded in the nonvolatile memory and volatile memory.

  The imaging condition acquisition unit and the imaging unit constituting the imaging apparatus include an imaging device, the imaging order determination unit and the focus distance dependency determination unit include a CPU, each memory, an imaging order determination program, and the like. Consists of memory and control program. Hereinafter, the processing of the imaging apparatus will be specifically described.

  (Specific Example of Embodiment 2) A specific processing flow of the imaging apparatus will be described with reference to FIG. In the present imaging apparatus, the processes from selecting a plurality of subjects and attaching a reacquisition execution flag (S1401 to S1413) are the same as the processes in the specific example of the first embodiment. Then, when rearranging the imaging order according to the focus distance using the focus distance dependency determination function of the imaging order determination program, is the rearrangement in order of the focus position of the subject (S1427) or the focus? Selection such as whether to rearrange in order of increasing position (S1428) is accepted (S1426). When an instruction to rearrange the images in order from the closest focus distance is received, the focus distance information is read from the in-focus information in the nonvolatile memory, and the imaging order is determined in the order from the closest focus distance. Similarly, when an instruction to rearrange in order of increasing focus distance is received, the focus distance information is read from the in-focus information of the nonvolatile memory, and the imaging order is determined in order of increasing focus distance. When rearrangement is not performed according to the focus distance, the imaging order is determined in the order in which the subject is selected, as in the first embodiment. Subsequent processes (S1414 to S1425) are the same as those in the first embodiment, and thus description thereof is omitted.

  When the imaging order is determined according to the focus distance, the moving time of the focusing lens can be shortened during continuous shooting, and the imaging device can be controlled more efficiently. In addition, when the imaging order is determined in order of increasing focus distance, it is possible to capture images from a close subject having a large influence of movement, and therefore, it is possible to suppress the shift of the focus position due to the movement of the subject as much as possible. In addition, since the captured images are stored in the imaging order corresponding to the focus distance of the subject, the user knows in what order the subject at which distance is focused and imaged before imaging. be able to. For this reason, when an image file in focus is transmitted to the person who is the subject after imaging, the image is continuously captured based on the focus distance or the imaging order displayed on the display according to the focus distance. It is possible to immediately find an image in which the person is in focus from among the images.

  Note that the specific examples of the hardware configuration and processing described above are merely examples, and the present invention may be implemented with other similar hardware configurations.

  (Effects of Second Embodiment) In addition to the effects of the first embodiment, the image pickup apparatus having the above-described configuration can rearrange the imaging order according to the focus distance of the subject. For this reason, the moving time of the focusing lens can be shortened during continuous shooting, and the imaging device can be controlled more efficiently. In addition, it is possible to minimize the shift of the focus position due to the movement of the subject.

  << Embodiment 3 >> (Concept of Embodiment 3) Embodiment 3 will be described. In the third embodiment, an imaging apparatus having a feature in that the imaging order is determined based on the size of the face area of the subject, based on the imaging apparatus of the first or second embodiment.

  (Configuration of Third Embodiment) FIG. 15 is a functional block diagram of an image pickup apparatus according to the present embodiment. The “imaging device” (1500) according to the present embodiment includes an “imaging condition acquisition unit” (1501), an “imaging unit” (1502), an “imaging order determination unit” (1503), and a “control unit” ( 1504) and a “face area recognizing unit” (1505), and the imaging order determining unit includes “face area dependence determining means” (1506). Moreover, it is good also as having each structure described in Embodiment 2. FIG.

  (Description of Configuration of Embodiment 3) The “face area recognition unit” (1505) is configured to recognize the face area of the subject in the imaging area. The “face area” is an area occupied by the face of the subject on the shooting area. The face area is obtained as a human face by obtaining information such as the contour shape of the face, the distance between each part of the eyes, nose, mouth, ears, and skin color information from the image on the display displayed as the imaging area. It is a recognized area.

  The “face area dependence determining unit” (1506) is a unit that the imaging order determining unit (1503) has, and determines the imaging order in descending order of the face areas recognized by the face area recognition unit in the imaging area. In the imaging area, the face area that occupies the imaging area generally increases as the subject is closer to the imaging apparatus. For this reason, by determining the imaging order in descending order of the face area, it is possible to focus on images in order from the closest subject, so that the imaging order is determined in the order from the closest focus distance in the second embodiment. The effect can be expected. That is, the moving time of the focusing lens can be shortened during continuous shooting, and the imaging device can be controlled more efficiently, and the shift of the focus position due to the movement of the subject can be suppressed as much as possible. In the case of simultaneously capturing images of children and adults, the size of the face area does not necessarily increase in order of increasing distance from the imaging device. However, even in such a case, since the size of the face area of each subject in the imaging area can be visually confirmed using a display or the like during imaging, it is possible to intuitively confirm the imaging order during imaging. it can. Further, by displaying the imaging order determined by the face area on the display, the imaging order can be more reliably notified to the user.

  FIG. 16 shows one specific example in the case where the imaging order is determined based on the size of the face area, and the determined imaging order is displayed on the display. First, using the method described in the first or second embodiment, a subject to be focused and selected is selected. The subject may be automatically recognized regardless of the user's selection. At this time, as shown in FIG. 16A, the order in which the subjects are selected may be displayed. The range occupied by the face area of each subject on the display is displayed in a frame according to the selection of the subject. When the selection of the subject is completed, the imaging order is determined in accordance with the size occupied by the face area using the face area dependence determining means either automatically or in accordance with an instruction from the user. The size of the face area can be calculated by measuring the number of pixels in the range recognized as the face area, or by measuring the area occupied by the frame indicating the face area. The numbers in FIG. 16B indicate the imaging order determined in descending order of the calculated face area of the subject. Thereby, the user can confirm the order of subjects to be imaged by focusing on the size of the face area occupied in the imaging area displayed on the display before imaging. Note that the determined imaging order is desirably displayed on the display. By displaying the imaging order, the user can be more accurately notified of the imaging order.

  (Hardware Configuration of Embodiment 3) FIG. 17 shows the hardware configuration of the image pickup apparatus of this embodiment. Each unit, which is a component of the imaging apparatus, includes hardware and software that can be executed on the hardware. As hardware, a CPU (1701) that performs arithmetic processing, a volatile memory (1702) for temporarily recording software and each data, a non-volatile memory (1703) for recording each data such as software, An image pickup device (1704) including an image pickup element for picking up an image and a lens aperture shutter, an I / O device (1705) for inputting and outputting data, a system bus (1706) for connecting them, and the like. The I / O device is connected to a cross key, a touch panel, a display for displaying an imaging area as a finder, or the like as necessary. The software includes an imaging order determination program for determining the imaging order, a control program for controlling the imaging operation according to the imaging order, a face area recognition program for recognizing the size of the face area, and the like. However, the imaging order determination program according to the present embodiment is provided with a face area dependency determination function that determines the imaging order according to the size of the face area in the imaging area. It is different from the program. These programs are stored at predetermined addresses A1, A2, and A3 of the nonvolatile memory, and are expanded to predetermined addresses a1, a2, and a3 of the volatile memory as necessary, and are calculated by the CPU (1701). It works by processing. In addition to the above programs, in-focus information and captured image files are recorded in the nonvolatile memory and volatile memory.

  The imaging condition acquisition unit and the imaging unit constituting the imaging apparatus include an imaging device, the imaging order determination unit and the focus distance dependency determination unit include a CPU, each memory, an imaging order determination program, and the like. The face area recognition unit includes a CPU, each memory and a face area recognition program. Hereinafter, the processing of the imaging apparatus will be specifically described.

  (Specific Example of Embodiment 3) A specific processing flow of the imaging apparatus will be described with reference to FIG. In the present imaging apparatus, the processing up to the processing of selecting a plurality of subjects and attaching a reacquisition execution flag (S1801 to S1813) is the same as the processing in the specific example of the first embodiment. However, after the selection of the subject (S1805), the size of the face area recognized by the face area recognition program is stored together with the imaging order and the position of the subject. When rearrangement of the imaging order according to the size of the face area is performed using the face area dependence determination function of the imaging order determination program (S1826; YES), the imaging order is arranged in descending order of the face area. The order is changed and the imaging order is determined (S1827). When the rearrangement is not performed according to the size of the face area (S1826; NO), as in the first embodiment, the imaging order is determined in the order in which the subject is selected. Subsequent processes (S1814 to S1825) are the same as those in the first embodiment, and thus description thereof is omitted.

  When the imaging order is determined according to the size of the face area, the captured images are stored in the order of imaging in descending order of the face area of the subject. The user can know whether or not images are captured before imaging. For this reason, when sending an image file to the person who is the subject after imaging, for example, based on the size of the face area or the imaging order displayed on the display according to the size of the face area, An image in which the person is in focus can be found immediately from images that have been continuously captured.

  Note that the specific examples of the hardware configuration and processing described above are merely examples, and the present invention may be implemented with other similar hardware configurations.

  (Effect of Embodiment 3) In addition to the effects of the first embodiment, the imaging apparatus of the present embodiment having the above-described configuration can rearrange the imaging order according to the size of the face area of the subject. For this reason, the moving time of the focusing lens can be shortened during continuous shooting, and the imaging device can be controlled more efficiently and the shift of the focus position due to the movement of the subject can be suppressed as much as possible. Furthermore, the order in which the subject is imaged becomes easier to understand, and the convenience for the user is improved.

  << Embodiment 4 >> (Concept of Embodiment 4) Embodiment 4 will be described. In the fourth embodiment, an imaging apparatus having a feature in that the imaging order is determined based on the acquired face image information of the subject based on any of the imaging apparatuses of the first to third embodiments.

  (Configuration of Embodiment 4) FIG. 19 is a functional block diagram of an image pickup apparatus according to this embodiment. The “imaging device” (1900) according to the present embodiment includes an “imaging condition acquisition unit” (1901), an “imaging unit” (1902), an “imaging order determination unit” (1903), and a “control unit” ( 1904), a “face image information holding unit” (1905), a “subject face image information acquisition unit” (1906), and a “face image information comparison unit” (1907). The image information dependence determining means ”(1908) is included. In addition to the above configuration, the face image information holding unit may include “response frequency information holding unit” (1909), and the imaging order determination unit may include “response frequency information dependency determining unit” (1910). Further, the face image information holding unit may include a “mail address holding unit” (1911) and a “captured image transmission unit” (1912) in addition to the above configuration. Moreover, it is good also as having each structure described in Embodiment 2 or 3.

  (Description of Configuration of Embodiment 4) The “face image information holding unit” (1905) is configured to hold face image information. The face image information is information including an image file displaying a face. For example, when the imaging device is a digital camera, among the images stored in the memory as images taken in the past, the image file displaying the face corresponds to this, and the imaging device is a mobile phone Corresponds to a face image file stored in an address book of a mobile phone. As the face image information, facial feature points such as eyes, nose, mouth and face outline may be extracted and held together with the image file.

  The “subject face image information acquisition unit” (1906) is configured to acquire subject face image information that is face image information of a subject in the imaging region. The subject face image information acquisition unit recognizes the face area of the subject in the imaging area, and acquires subject face image information by acquiring an image displayed in the recognized face area. In the subject face image information acquisition unit, the user may select the subject from which the face image information is to be acquired. Alternatively, the subject face image information may be acquired by automatically detecting a human face with the imaging device. .

  The “face image information comparison unit” (1907) is configured to compare the face image information held in the face image information holding unit with the subject face image information acquired by the subject face image information acquisition unit. Has been. When the subject face image information is acquired by the subject face image information acquisition unit, the face image information comparison unit first extracts the subject's eye, nose, mouth, face outline, etc. as feature points from the acquired subject face image information. . Then, the extracted feature points are compared with the face image information held in the face image information holding unit, and the image of the person represented by the subject face image information from the matching / mismatching of the feature points is stored in the face image information. It is determined whether or not it matches the person in the image held in the section. Note that face authentication technology is already disclosed in Japanese Patent Application Laid-Open No. 2004-320286. As a result of the comparison, if a predetermined ratio or more of the feature points match, a comparison result indicating that the compared two are the same person is output. Note that the comparison technique for determining whether or not they are the same person in the present embodiment does not apply to security or the like, and therefore does not necessarily require strict identity. For this reason, the comparison result allows an error to the extent that similar persons such as parents and siblings are regarded as the same person.

  The “face image information dependency determining means” (1908) is included in the imaging order determining unit, and determines that the acquired subject face image information and the held face image information are the same person according to the comparison result. When there is a photographed subject, this means is a means for placing the person in the image capturing order higher than other subjects.

  FIG. 20 shows a specific example when the face image information dependence determining means is used. For the sake of explanation, the numbers A, B, and C are given to each subject in the figure. First, the imaging apparatus recognizes the face image displayed in the imaging area by the subject face image information acquisition unit, and represents the area where the face of the person is displayed as a face frame. At this time, assuming that the face images are recognized in the order of A, B, and C for the sake of convenience, when the recognized order is superimposed on the subject, the order of A, B, and C is displayed as shown in FIG. The numbers 1, 2, and 3 are displayed. The focus area is the face area of the subject. In this state, the imaging order of the subject may be selected by using a numeric key of a mobile phone (for example, when the numeric “2” key is pressed, the subject B is first in the imaging order). Is selected) includes face image information dependence determining means, the processing is performed as follows.

  First, the subject image information acquisition unit acquires subject face image information of the selected subjects A, B, and C, and the face image information comparison unit stores the acquired image in the face image information holding unit. Compare with image information. If it is determined that the subject face image information of the subjects B and C is the same person as compared with the face image information held in the face image information holding unit, the subject B. The imaging order of C is set higher than the subject A. In this case, the imaging order of the subjects B and C is set higher than the subject A, the order between the subjects B and C is set as the recognized order, and the imaging order is determined in the order of the subjects B, C, and A. FIG. 20B shows a case where the imaging order determined by the face image information dependency determining means is displayed on the imaging area with a numeral.

  The “response frequency information holding unit” (1909) is included in the face image information holding unit, and is any one of the number of times of taking the face image information and the photograph of the person identified by the face image information, the number of mails, and the number of calls. This is means for associating and holding response frequency information indicating the above response frequency. The “number of times a photograph of a person identified by face image information is taken” can be represented by the number of times the face image information held by the face image information holding unit is matched. For example, when a person D is photographed for the first time, a characteristic part is extracted from the face image of the person D and is stored as face image information in the face image information holding unit. Set. Then, when the feature points extracted in the same manner from the photographed image coincide with the face image information of the person D, the counter of the number of photographing times of the person D is incremented by 1, and is set to 2. In this way, the number of times of photographing can be counted by comparing the feature points at every photographing. In addition, the number of images (number of image files) in which the person D is captured from the currently held captured images may be counted instead of the number of times of capturing. The “number of times of mail” can be expressed by the number of times of sending / receiving e-mails, the number of times of using a mail service using a mobile phone, or the like. The mail service using a mobile phone is a message exchange service that is exchanged between limited carriers such as user terminals of each carrier. In order to count the number of mails, it is necessary that at least the imaging device has a transmission / reception function such as an electronic mail. The “number of calls” can be expressed by the number of incoming and outgoing calls. When counting the number of calls, at least the imaging device needs to have a telephone function. FIG. 21A shows a state in which these response frequency information and face image information are held in association with each other in a table form. Each information is identified with an ID.

  The “response frequency information dependence determining unit” (1910) is included in the imaging order determining unit, and in accordance with the comparison result in the face image information comparing unit, the acquired subject face image information and held face image information When there are a plurality of subjects that are determined to be the same person, the imaging order is determined in descending order of the response frequency. “Determine the imaging order in the order of frequency of response” means that the response frequency information stored in the response frequency information storage means is simple if the number of times the photo is taken, the number of emails, or the number of calls is one. The imaging order is determined in descending order of the number of times. In addition, when there are two or more of the number of times a photograph is taken, the number of emails, and the number of calls, priority may be given to the response frequency information. For example, first, the imaging order is determined based on the number of times a photograph is taken, and when there are a plurality of persons with the same number of photographs, the imaging order is determined based on the number of emails. In addition, the number of times obtained by simply summing each number of times may be used, or the number of times obtained by weighting each number may be used.

  A method for determining the imaging order according to the response frequency information will be described with reference to FIGS. As shown in FIG. 20 (a), when subjects A, B, and C are selected as subjects to be focused and imaged, according to the comparison result with the face image information using the face image information dependence determining means. Although it has already been described that the imaging order of the subjects B and C is made higher, the response frequency information dependence determining means can further determine the imaging order between the subjects B and C. The acquired subject face image information of the subject B and the subject C matches the face image information represented by “F-001” and “F-021” held in the face image information holding unit, respectively. When the comparison unit obtains a comparison result that each person is the same person, as shown in FIG. 21A, the subjects B and C correspond to ID “003” and ID “028” of the response frequency information, respectively. I understand that And as shown in FIG.21 (b), an ID column is provided in focusing information, and corresponding ID is input. The response frequency information dependence determining means refers to the response frequency information held in the response frequency information holding means based on the ID in the face image information ID column. In this case, if the imaging order is determined in descending order of the total number of response times, the subject C represented by “ID: 028” is obtained when the response frequency information shown in FIG. Since the total number of response times is higher than that of the subject B represented by “ID: 003”, the imaging order of the subject C is set higher. As a result, the finally determined imaging order is the order of subjects C, B, and A. At this time, it is desirable that the determined imaging order is displayed in the vicinity of the subject in the imaging area as shown in FIG.

  The “mail address holding means” (1911) is a means that the face image information holding unit has and holds the face image information and the mail address in association with each other. “Mail address” means not only mail addresses that can be communicated using the Internet, but also short mail service addresses that can be used between specific carriers, and infrared communication and Bluetooth (registered trademark) communication between mobile terminals. In addition, identification information between terminals is also included. When the face image information holding unit has the mail address holding means, the face image information and the mail address are held in association with each other as shown in FIG. At this time, not only the mail address but also a name and a telephone number registered together with the mail address may be held. The mail address holding means corresponds to an address book function provided in a mobile phone or the like. In addition, as shown in FIG. 20D, when the face image information and the subject face image information match, the registered address and mail address associated with the face image information are referred to by referring to the mail address holding means. You may make it superimpose on a to-be-photographed object.

  The “captured image transmission unit” (1912) is held in the subject face image information acquired by the subject face image information acquisition unit and the face image information holding unit according to the comparison result in the face image information comparison unit. When there is a subject determined to be the same person as the face image information, the image pickup unit transmits the picked-up image to the mail address associated with the face image information after picking up the person Has been. When there is an object whose face image information and face image information are determined to be the same person by the face image information comparison unit, the captured image transmission unit, as shown in FIG. The mail address associated with the image information is acquired with reference to the mail address holding means. Then, the mail function is activated, and the mail address acquired by attaching the image file focused on the person is transmitted as the destination. As a result, it is possible to reduce the trouble of the user starting the mail function after image capturing and transmitting the image file to the person, and the convenience is improved.

  (Hardware Configuration of Embodiment 4) FIG. 22 shows the hardware configuration of the image pickup apparatus of this embodiment. Each unit, which is a component of the imaging apparatus, includes hardware and software that can be executed on the hardware. As hardware, a CPU (2201) that performs arithmetic processing, a volatile memory (2202) for temporarily recording software and each data, a non-volatile memory (2203) for recording each data such as software, An image pickup device (2204) including an image pickup element for taking an image and a lens aperture shutter, an I / O device (2205) for inputting and outputting data, and a system bus (2206) for connecting them are included. The I / O device is connected to a cross key, a touch panel, a display for displaying an imaging area as a finder, or the like as necessary. The software includes an imaging order determination program for determining an imaging order, a control program for controlling an imaging operation according to the imaging order, a subject image acquisition program for acquiring subject face image information, and a face for comparing face image information. An image information comparison program. However, the imaging order determination program of the present embodiment is the same as the imaging order determination program of Embodiments 1 to 3 in that a face image information dependency determination function for determining the imaging order according to the comparison result of face image information is added. Is different. The imaging order determination program may have a response frequency information dependency determination function. Moreover, you may have a mail transmission program. These programs are stored at predetermined addresses A1, A2, A3, A4, A5, etc. of the non-volatile memory. If necessary, they are stored at predetermined addresses a1, a2, a3, a4, a5, etc. of the volatile memory. It is expanded and operates by arithmetic processing by the CPU. In addition to the above programs, in-focus information and captured image files are recorded in the nonvolatile memory and volatile memory.

  The imaging condition acquisition unit and the imaging unit constituting the imaging apparatus include an imaging device, the imaging order determination unit and the focus distance dependency determination unit include a CPU, each memory, an imaging order determination program, and the like. The face image information holding unit is composed of a nonvolatile memory, the subject face image information acquisition unit is a CPU, a display connected to each memory and I / O device, and a subject face image information acquisition program. The face image information comparison unit includes a CPU, each memory, and a face image information comparison program, and the captured image transmission unit includes a CPU, each memory, a mail transmission program, a network device connected to the I / O device, and the like. . Hereinafter, the processing of the imaging apparatus will be specifically described.

  (Specific Example of Embodiment 4) A specific processing flow of the imaging apparatus will be described with reference to FIG. In this imaging apparatus, first, a general imaging mode and a face recognition continuous imaging mode are selected (S2301). When the general imaging mode is selected (S2302; NO), the processing for performing continuous shooting is terminated to perform general imaging without performing face recognition continuous shooting.

  When the face recognition continuous imaging mode is selected, the CPU displays the subject to be imaged in the imaging area of the display (S2303) and obtains the imaging order determination program and subject face image information stored in the nonvolatile memory. The program, the subject image acquisition program, and the face image information comparison program are expanded and started in the work area of the volatile memory. When the imaging order determination program is activated, the input device such as a cross key or a touch panel can be used to determine the subject to be focused and accept the imaging order of each subject. In this state, the position of the subject and the imaging order of each subject are determined. Further, the focus position of each subject may be determined together with the imaging order. First, the imaging order = 1 is set (S2304), and when the user selects the first subject to be imaged (S2305), the imaging order determination program stores the imaging order and the display position of the subject (S2306). . Then, the imaging device performs AF and AE at the subject position on the subject (S2307, S2308), and stores the imaging conditions such as AF and AE information in the nonvolatile memory together with the imaging order as in-focus information (S2309).

  In addition, the subject face image information acquisition program extracts facial feature point portions from the face portion images of each subject displayed on the display (S2310), and temporarily stores them in the volatile memory as subject face image information. To remember. When the subject face image information is stored at a predetermined address in the volatile memory, the face image information comparison program reads the face image information stored at the predetermined address in the nonvolatile memory and stores it in the volatile memory. The face image information that is the same person as the subject face image information is searched based on whether or not the face image information is stored in the nonvolatile memory based on the feature points of the face, and is the same as the face image information stored in the nonvolatile memory It is determined whether or not the person is a person (S2311). When the determination result that the person is the same person is obtained, as shown in FIG. 21B, the ID of the face image information that is determined to be the same person is input in the ID column of the in-focus information. For the selection of the second and subsequent subjects, the person matching flag is stored in the in-focus information together with the imaging conditions by the same process. At this time, the provisional imaging order is determined in the selected order. When the selection of the subject is completed, when the imaging order is determined according to the face image information (S2314; YES), the imaging order determination program inputs an ID into the ID column of the in-focus information by the face image information dependency determination function. The imaging order of the subject that has been selected is set higher (S2316).

  Further, a case where the imaging order determination program has a response frequency information determination function will be described. In order to use the response frequency information determination function, any one of the number of times the photograph of the person identified by the face image information holding unit and the face image information stored in the nonvolatile memory is taken, the number of mails, and the number of calls Response frequency information indicating one or more response frequencies must be stored in association with each other. The response frequency information determination function is used when an ID is input in the ID column of the in-focus information of a plurality of subjects. When using the response frequency information determination function (S2317; YES), the response frequency information associated with the face image information to which the ID is input is read from the nonvolatile memory, and the imaging order is determined in order from the subject with the highest response frequency. (S2318). It is desirable to display the determined imaging order on the display. The user can visually confirm the displayed imaging order before imaging. Since the subsequent processing (S2319 to S2327) until imaging is performed is the same as that in any one of the first to third embodiments, description thereof is omitted. In this specific example, processing related to the reacquisition execution flag is not described in order to simplify the processing flow, but processing related to the reacquisition execution flag may be added to this specific example.

  In the image after imaging, the imaging order of the subject in which the face image information is held is higher. At this time, by displaying the imaging order on the display before imaging, the user can know in which order the subject is focused and captured before imaging. In addition, since the subject holding the face image information is likely to be intimate with the user of the imaging device, continuous shooting was performed by setting the imaging order of the image focused on such a person at the top. An intimate person image can be efficiently searched from the subsequent images more efficiently.

  In addition to the above configuration, when the mail transmission program is included, the following processing is performed after continuous shooting. When the continuous shooting is completed, the mail transmission program stored at a predetermined address in the non-volatile memory is expanded and started in the work area of the volatile memory. In the mail transmission program, first, it is checked whether or not an ID is input in the ID column of the in-focus information, that is, whether or not there is a person whose face is authenticated. If there is no person whose face has been authenticated, the mail transmission program ends as it is. When there is a person whose face has been authenticated and an e-mail is to be sent (S2328; YES), the image file after imaging is specified from the ID and the imaging order, and this is temporarily stored in the volatile memory. In addition, when the mail address included in the face image information of the subject specified by the ID is searched and the mail address is included in the face image information, the image file stored in the volatile memory is stored. Is sent as an attached file to the mail address (S2329).

  If you have a mail transmission program, you can automatically send an in-focus image to the subject's party, so the user activates the mail function after imaging and sends the image file to the person Time and effort are reduced, and convenience is improved.

  Note that the specific examples of the hardware configuration and processing described above are merely examples, and the present invention may be implemented with other similar hardware configurations.

  (Effect of Embodiment 4) In addition to the effects of the first embodiment, the imaging apparatus of the present embodiment having the above-described configuration can rearrange the imaging order according to face image information. For this reason, it is possible to more efficiently find an image in which the subject is captured, and the convenience for the user is improved. Furthermore, when the mail transmission program is provided, the trouble of transmitting the captured image file is reduced, and the convenience is further improved.

  <Embodiment> An embodiment in the case where a camera-equipped mobile phone is used as an image pickup apparatus will be described below with reference to FIGS.

  FIG. 24A shows the main panel side in the state in which the folding cellular phone is opened, and FIG. 24B shows the sub panel side. The mobile phone includes a cursor key (2401), an enter key (2402), ten keys and *, # key (2403), main panel (2404), speaker (2405), sub camera (2406), main camera (2407), flash (2408), sub-panel (2409), and the like. In a camera-equipped mobile phone, a CCD element is used for a main camera, and it is possible to acquire imaging conditions and execute imaging via the main camera. Images acquired via the main camera are displayed on the main panel. On the main panel, an imaging area is displayed, and a cursor display and menu display for performing various operations are performed. Then, operations such as selection of a subject to be imaged, determination of an imaging order, and an imaging execution instruction can be performed with a cursor key, a determination key, a numeric keypad, and the like.

  FIG. 25 is a functional block diagram of a camera-equipped mobile phone. A camera-equipped mobile phone is roughly divided into an imaging unit (2501), a control unit (2502), an input / output unit (2503), and a memory unit (2504). The imaging unit includes a photographic lens (2505), an aperture (2506), a shutter (2507) related to imaging conditions, an AF drive circuit (2508), an aperture drive circuit (2509), and a shutter drive circuit (2510) that perform these settings. An image pickup device (2511) that picks up an image under the set image pickup conditions, a video signal processing unit (2512) that processes an electrical signal from the image pickup device as a video signal, a focus position, an aperture amount, etc. It comprises an AF sensor (2513), an AE sensor (2514) for acquiring imaging conditions, a flash (2515), a flash control circuit (2516) for controlling the presence / absence and timing of the flash, and the like. The control unit includes a feature point extraction unit (2517) that extracts a feature point of a person from a captured image acquired by the imaging unit, and a character generation unit (2519) that generates characters such as frames and numbers to be displayed over the subject. ), A subject designation unit (2520) for designating a subject to be displayed with the generated character superimposed, and an image synthesis unit (2518) for synthesizing the image acquired by the imaging unit and the character image. The input / output unit includes a wireless unit (2521) that performs wireless communication, a communication control unit (2522) that controls communication, and a display processing unit (2523) that processes an image controlled by the control unit for display display. A display unit (2524) for displaying an image processed by the display processing unit, an audio processing unit (2525) for processing audio output from a speaker and audio input from a microphone, and processed audio Is output from the speaker, an audio input unit (2527) for inputting audio to the audio processing unit with a microphone or the like, and an operation unit (2528) for performing various operations for inputting to the control unit. ). The memory unit includes a program memory (2529) that stores various application programs, and a general-purpose memory (2530) that stores captured images, in-focus information, address book, history information, and feature point information. The imaging unit can acquire imaging conditions or execute imaging. The control unit accepts the generation of an image to be displayed for performing various operations for determining the imaging order, the instructions by the various operations, and the program stored in the program memory and the in-focus information / address book / stored in the general-purpose memory. Selection of subjects to be imaged using history information and determination of imaging sequence, comparison and authentication of feature points of subjects' faces extracted using a face authentication program stored in the program memory, and readout of in-focus information Various imaging conditions in the unit can be controlled. The input / output unit can input an instruction corresponding to the displayed imaging area, an imaging instruction by pressing the shutter, and the like.

Conceptual diagram of Embodiment 1 Functional block diagram of Embodiment 1 FIG. 6 is a diagram for explaining a method for determining an imaging order of subjects (1). FIG. 2 is a diagram for explaining a method for determining the imaging order of subjects (2) FIG. 3 is a diagram for explaining a method for determining the imaging order of subjects (3) Figure (1) exemplifying in-focus information The figure which illustrates the hardware constitutions of Embodiment 1. The figure which illustrates the flow of processing of Embodiment 1. Functional block diagram of Embodiment 2 FIG. 1 is a diagram for explaining a method for determining an imaging order of a subject according to a focus distance (1). Figure (2) exemplifying in-focus information FIG. 2 is a diagram for explaining a method for determining an imaging order of a subject according to a focus distance (2). The figure which illustrates the hardware constitutions of Embodiment 2. The figure which illustrates the flow of processing of Embodiment 2. Functional block diagram of Embodiment 3 The figure explaining the method of determining the imaging sequence of a subject according to a face area The figure which illustrates the hardware constitutions of Embodiment 3. The figure which illustrates the flow of processing of Embodiment 3. Functional block diagram of Embodiment 4 The figure explaining the method of determining the imaging sequence of a subject according to face authentication A diagram illustrating in-focus information, response frequency information, e-mail address, etc. The figure which illustrates the hardware constitutions of Embodiment 4. The figure which illustrates the flow of processing of Embodiment 4. The figure which illustrates the structure of the mobile phone with a camera Functional block diagram of camera phone

Explanation of symbols

0200 Imaging device 0201 Imaging condition acquisition unit 0202 Imaging unit 0203 Imaging order determination unit 0204 Control unit 0205 Imaging condition reacquisition unit 0905 Focus distance dependency determination unit 1505 Face area recognition unit 1506 Face region dependency determination unit 1905 Face image information holding unit 1906 Subject Face image information acquisition unit 1907 Face image information comparison unit 1908 Face image information dependency determination unit 1909 Response frequency information holding unit 1910 Response frequency information dependency determination unit 1911 Mail address holding unit 1912 Captured image transmission unit

Claims (8)

An imaging condition acquisition unit that acquires imaging conditions suitable for each subject for a plurality of subjects in the imaging region;
An imaging unit that continuously images each subject based on the imaging conditions;
An imaging order determining unit that determines an imaging order for imaging each subject in the imaging unit;
A control unit that controls an imaging operation in the imaging unit according to the determined imaging order;
An imaging apparatus comprising: The imaging apparatus according to claim 1, wherein the imaging unit includes an imaging condition re-acquisition unit that acquires an imaging condition again immediately before imaging. The imaging apparatus according to claim 1, wherein the imaging order determination unit includes a focus distance dependency determining unit that determines an imaging order according to a focus distance between the imaging apparatus and each subject. A face area recognition unit for recognizing the face area of the subject in the imaging area;
The imaging order determining unit is a face area dependence determining unit that determines the imaging order in descending order of the recognized face area in the imaging area;
The imaging apparatus according to claim 1, wherein the imaging apparatus includes: A face image information holding unit for holding face image information;
A subject face image information acquisition unit that acquires subject face image information that is face image information of a subject in the imaging region;
A face image information comparison unit that compares the held face image information with the acquired subject face image information;
If there is a subject for which the acquired subject face image information and the held face image information are the same person according to the comparison result, the imaging order determination unit determines the imaging order of the person. A face image information dependency determining means that ranks higher than other subjects;
5. The imaging apparatus according to claim 1, wherein the imaging apparatus includes: The face image information holding unit holds, in association with each other, face image information and response frequency information indicating a response frequency of one or more of the number of times a photograph of a person identified by the face image information is taken, the number of mails, and the number of calls. Response frequency information holding means,
The imaging order determination unit has a high response frequency when there are a plurality of subjects for which it is determined that the acquired subject face image information and the held face image information are the same person according to the comparison result. Response frequency information dependence determining means for sequentially determining the imaging order;
The imaging device according to claim 5 having. The face image information holding unit includes a mail address holding unit that holds face image information and a mail address in association with each other,
If there is a subject for which the acquired subject face image information and the held face image information are the same person according to the comparison result, the face image information is included in the face image information after the person is imaged by the imaging unit. A captured image transmission unit that transmits a captured image to an associated email address;
The imaging apparatus according to claim 5 or 6, comprising: An imaging condition acquisition step of acquiring imaging conditions suitable for each subject for a plurality of subjects in the imaging region;
An imaging order determining step for determining an imaging order for imaging each subject by the imaging device;
A control step of controlling an imaging operation in the imaging device in accordance with the determined imaging order;
An imaging step of continuously imaging each subject based on the imaging conditions by control in the control step;
An imaging method comprising:

Images