JP2010041527A - Photographing support method, system, program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing support system retrieving and reading a photographic image photographed and stored in the past and its photographic conditions, and carrying out present photographing, based on them. <P>SOLUTION: A portable telephone terminal 10 equipped with a camera photographing part 20 having a photographing function is provided with a photographic situation analysis engine 30 for storing the past photographic image and photographic information configured of its photographic conditions in association in a photographic history database 31, and for retrieving the photographic information by a photographic history activation part 32. Thus, using the photographic situation analysis engine 30 enables new photographing based on the photographic conditions of the past photographic data. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a photographing support system using a camera, and more particularly to a photographing support system using a camera of a mobile phone terminal with a camera function.

Several reports have been made in the past as an example of providing a system that performs camera shooting under the same shooting conditions as those performed in the past.
For example, work can be performed by storing shooting information including the shooting model and processing time of the image used by the user and selecting an appropriate processing procedure from the stored processing pattern group when a shooting image with the same conditions is input. An example of shortening the time has been reported (see Patent Document 1). However, this example is merely an image data processing method, and not control of shooting conditions.

In addition, an example has been reported in which a server that distributes shooting information related to shooting conditions to a shooting device is provided so that even a user who is not familiar with the handling of digital cameras can take excellent images under those conditions ( Patent Document 2). However, this example assumes that the photographing apparatus is connected to a server via the Internet.
Furthermore, an example in which an image subjected to favorite image processing is recorded by feeding back a representative correction value of photographing conditions from a personal computer that has accumulated past image processing history to an electronic camera (see Patent Document 3), storage An example has been reported in which an optimum setting is obtained from the average value of similar photographing conditions and the user learns the optimum setting from a change in the state of a photographed image before and after the setting of the photographing apparatus (see Patent Document 4). However, both of these require an external device such as a personal computer, and cannot be dealt with immediately at the time of shooting.

In addition, there is an example (see Patent Document 5) in which it is determined whether the conditions are the same based on the face detection information and the shooting conditions, and in the case of the same conditions, the distance measurement operation is shortened to reduce the release time lag. However, this example is used only for continuous shooting of the same scene.
Furthermore, an example has been reported (see Patent Document 6) in which shooting conditions based on the shooting performance of the user are stored in the system controller of the electronic camera, and shooting that is personalized based on the shooting conditions is realized. . However, the electronic camera in this example is a special one equipped with a mode setting dial and the like, and is not a mobile phone terminal.

The conventional examples described in the above publications provide a system that enables reduction of processing time at the time of shooting, changes in processing procedures, and camera shooting under the same shooting conditions via a server or cable.
However, as described above, these conventional techniques have a problem that server cooperation is required, an external device is required, and even a mobile phone terminal cannot be used offline.
In addition, as a background, when general users do camera shooting, the conditions are often not unified, and even with the same scene photo, the image quality correction processing and the size of the person in the human shot image are various, There was a problem that it took time and effort to set the shooting conditions.

JP 2007-219728 A JP 2007-036716 A JP 2002-262174 A JP 2002-209140 A JP 2006-208558 A JP 2001-186406 A

  In order to solve the above-described problems, the present invention stores a photographed image and its photographing conditions that have been photographed and stored in the past, and retrieves and reads them as necessary, and can perform current photographing based on them. The objective is to realize a shooting support system.

  In order to solve the above problems, a shooting support method according to the present invention is a shooting support method in a mobile phone terminal having a digital camera function, and includes a shooting support selection step of selecting shooting support, and shooting conditions as necessary. A shooting condition designating step for designating a specific condition, a search display step for retrieving and displaying shooting information including a past shot image and the shooting condition, and the past displayed by correcting the current subject position A subject position correcting step for performing an auxiliary operation for matching the photographed image and the current subject image, and a photographing execution step for performing photographing and storing the photographed image and photographing conditions thereof.

  In the shooting support selection step, it is selected whether or not shooting support is performed. In the photographing condition designation step, specific conditions in the photographing conditions are designated as necessary. In the search and display step, shooting information consisting of past shot images and shooting conditions is searched and displayed. In the subject position correcting step, an auxiliary operation is performed to match the past photographed image displayed by correcting the current subject position with the current subject image. In the shooting execution step, shooting is executed and a shot image and its shooting conditions are stored.

In order to solve the above-mentioned problem, the photographing support system according to the present invention can store photographing information including past photographed images and photographing conditions in a mobile phone terminal having a camera photographing unit, and can retrieve the photographing information. The photographing condition analyzing means is provided, and the photographing condition analyzing means is used to enable photographing based on the photographing conditions of past photographing information.
A mobile phone terminal having a camera photographing unit is provided with photographing condition analysis means for storing photographing information including past photographed images and photographing conditions, and enabling the photographing information to be retrieved. It is possible to shoot based on the shooting conditions of the shooting information.

  Furthermore, in order to solve the above-described problem, a shooting support program according to the present invention is a shooting support program executed by a computer included in a mobile phone terminal having a digital camera function, and provides shooting support to the mobile phone terminal. A shooting support selection step to select, a shooting condition specifying step to specify a specific condition in the shooting conditions as necessary, and a search display step to search and display shooting information consisting of past shot images and shooting conditions A subject position correcting step for performing an auxiliary operation for matching the past photographed image displayed by correcting the current subject position with the current subject image, and a photographed image and its photographing conditions. It is characterized in that a photographing execution step to be stored is executed.

  A computer included in a mobile phone terminal having a digital camera function executes a program to specify a shooting support selection step for selecting shooting support and specific conditions in the shooting conditions as necessary, by executing the program. A shooting condition specifying step, a search display step for searching and displaying shooting information including a past shot image and the shooting conditions, and the past shot image and the current subject displayed by correcting the current subject position A subject position correcting step for performing an auxiliary operation for matching the image and a photographing execution step for executing photographing and storing the photographed image and photographing conditions thereof are executed.

Since the present invention is configured and functions as described above, a shooting support system and shooting support capable of searching and reading a shot image stored in the past and its shooting conditions and performing current shooting based on the retrieved image and the shooting conditions. A method and a shooting support program can be provided.
Thereby, even a beginner can easily shoot under the same conditions as the past. At this time, even if the past shooting conditions are forgotten, they can be easily reproduced. In addition, it is possible to capture the time-series change over time.

Next, the best mode for carrying out the invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a photographing support system including a mobile phone terminal according to an embodiment of the present invention.
The mobile phone terminal 10 displays a character, a symbol, and an image with a control unit (CPU) 11 that controls a telephone function, a mail function, an Internet (World Wide web) connection function, other terminal functions, and each part and each part. Display unit 12, operation unit 13 including a numeric keypad, scroll key, determination key and function key for operating the terminal itself, a wireless communication unit 14 connected to a network via a base station (not shown), and a communication unit Means (microphone), receiving means (speaker), voice signal processing unit 15 for modulating / demodulating a voice signal passing through them, and various information such as telephone directory information, sent / received mail information, incoming / outgoing call information and contents, application programs, and portable radio terminals A storage unit 16 for storing settings, and a camera photographing unit 20 for capturing images and storing captured images; It is constituted by a shooting situation analysis engine 30.

The camera photographing unit 20 is a part that performs camera photographing in response to a user operation from the operation unit 13, and includes a photographing condition setting function 21 that sets a focusing photographing condition including a photographing distance and a zoom amount, and a person A person photographing condition detection function 22 that executes detection of a person photographing condition comprising the number of faces, the smile level of a person, and the size of the face to be photographed in cooperation with the photographing state analysis engine 30 in photographing, A scene classification function 23 for classifying a scene such as a person (portrait), party, close-up, sports, night view, twilight, cooking, underwater, and the like, and a captured image storage function 24 for capturing an image and storing the image.
With these functions, shooting conditions can be set automatically to enable shooting, or manually set in-focus shooting conditions, person shooting conditions, shooting scenes, etc. can be detected and shot. The data and these shooting condition data can be passed to the shooting situation analysis engine 30 for storage.

The shooting situation analysis engine 30 includes a shooting history database 31 that stores past shot images and shooting conditions as shooting information, a shooting information storage function that extracts shooting conditions during shooting and stores them in the shooting history database 31; A shooting history utilization unit 32 having a shooting information search function for searching for and displaying shooting conditions corresponding to shooting conditions from the shooting information stored in the shooting history database 31 or automatically setting the shooting conditions is used. Accordingly, it is determined whether or not to search for shooting conditions, and when searching, a shooting rule database 33 for storing shooting rules for setting the method, date and time information at the time of shooting, face information during shooting, etc. The corresponding shooting rule is read from the shooting rule database 33 according to the change in the condition, and the shooting history utilization unit 32 holds the shooting condition. Or it is set, and a shooting action control unit 34 for instructing to advise the user to display.
The photographing situation analysis engine 30 can be configured by a CPU, a storage unit, and a program executed by the CPU. In the present embodiment, the CPU executes a program stored in the storage unit 16 to perform processing as described later.

  The shooting history database 31 is detected from the shooting image by the person shooting condition detection function 22 and the focusing condition including the shooting distance and zoom amount set by the shooting condition setting function 21 in cooperation with the camera shooting unit 20 at the time of shooting. The shooting history utilization unit 32 sets shooting conditions including a person shooting condition including the number of faces of a person, a smile level, and a face detection size, and a scene classification obtained by classifying a shot image with the scene classification function, according to the type of condition. Are weighted and stored together with the captured video.

The shooting history utilization unit 32, in cooperation with the camera shooting unit 20, specifies a function for extracting the characteristics of the shooting conditions at the time of shooting and an action request such as a predetermined search request instructed from the shooting action control unit 34. A function of reading out shooting information of the shooting conditions is provided.
The shooting condition feature extraction function is based on the image configuration, shooting season and date / time, shooting distance, shooting scene, face number and detection position for face-to-face shooting, face size expressed in number of vertical and horizontal pixels, smile level, etc. Particularly characteristic features are weighted and stored in the shooting history database 31 as shooting information as shooting conditions with shooting images.

  In the shooting information reading function, according to an instruction from the shooting action control unit 34, shooting conditions suitable for shooting on the spot are taken into consideration from the shooting history database 31 based on the past shooting date and time, face detection conditions, and the like. The shooting information is read out, the shooting conditions and, if necessary, the past shot images are displayed, and feedback and advice are given to the user, or the past shooting conditions are set.

The shooting rule database 33 stores shooting rules for executing analysis and search for supporting shooting, and determines whether or not to perform shooting condition analysis and search according to shooting conditions and user instructions. When analysis and search are performed, shooting rules for reading shooting conditions from the shooting history database 31 and specifying an analysis order are read and used.
The shooting behavior control unit 34 shoots according to a change in conditions such as face information in a person shooting target when the shooting date / time changes, such as when a new shooting starts, or when the shooting target or shooting scene changes. A corresponding shooting rule is read from the rule database 33. Then, in accordance with this shooting rule, the shooting history utilization unit 32 is instructed to hold, set, or display shooting conditions to advise the user.

FIG. 2 is a flowchart showing the flow of the processing operation of the system in this embodiment, and mainly shows the processing performed by the shooting situation analysis engine 30 by executing the program stored in the storage unit 16.
Although the details will be described later, the program is a shooting support program executed by a computer built in a mobile phone terminal having a digital camera function, and includes a shooting support selection program for selecting shooting support, and shooting as necessary. A shooting condition specifying program for specifying a specific condition in the condition, a search display program for searching and displaying shooting information including a past shot image and the shooting condition, and the current subject position corrected and displayed A subject position correcting program for performing an auxiliary operation for matching a past photographed image with a current subject image, and a photographing execution program for performing photographing and storing the photographed image and its photographing conditions.

Hereinafter, the operation of the present embodiment will be described with reference to the flowcharts of FIGS. 1 and 2.
Now, for example, it is assumed that a user photographs a person to be photographed with the camera-equipped mobile phone terminal 10 of the present embodiment.
In step S101, it is determined whether or not the shooting is free shooting that does not have to be particularly concerned about conditions in which shooting is performed easily in the auto shooting mode or the like (shooting support selection step). In the case of free shooting, without starting the system, the process proceeds to step S110 to perform shooting in the auto shooting mode, and the shot video is stored in step S111 and the process ends.
If the user wants to photograph this person at the same position as the previously photographed photograph, and wants to make a change, growth record, and commemorative photograph of the same person, the system is started in step S102 and past photographs are taken. We will use history.

In the camera-equipped mobile phone terminal 10 according to the present embodiment, the shooting history utilization unit 32 of the shooting state analysis engine 30 performs weighting on the shooting condition characteristics of the shooting in cooperation with the person shooting condition detection function 22 of the camera shooting unit 20 during shooting. Then, it is stored in the shooting history database 31 together with the shot image.
As a feature to be extracted, if the subject is a person,
1) Number of detected human faces, face size, smile 2) Shooting distance from camera to subject, autofocus data, zoom amount data 3) Shooting mode classification result in scene classification function 23 (in this case) ,person)
It is.

For example, it is assumed that the user has taken a commemorative photo of his family in the past, January X.
At this time, the shooting history utilization unit 32 of the shooting situation analysis engine 30 has shooting modes “person”, season “January”, face detection number “4”, face detection size “40 × 40 pixels”, face ID (identification code unique to each face: a code that performs a function such as a name for identifying each person) “1-4”, smile degree “90 points”, shooting distance “5 m”, etc. are counted Are stored in the photographing history database 31 together with the photographed image “photo001.jpg”.

Assume that the user performs a commemorative photo of the family of the same member in January X + 1 following last year.
The user activates the camera photographing unit 20 of the camera-equipped mobile phone terminal 10, and performs the face detection setting for four people on the current screen during the activation (step S103: photographing condition specifying step).
Then, the shooting history utilization unit 32 retrieves shooting information from the shooting history database 31 under the conditions of “January” when the camera is activated and the number of face detections “4”, and the shot image “photo001” that matches those conditions. .Jpg "is read out and displayed on the display unit 12 of the camera-equipped mobile phone terminal 10, and" Would you like to shoot with the same shooting settings as this image? " Step S104: Search display step).

At this time, each condition item of the shooting condition is weighted and compared for each condition item in consideration of the weight given to each condition item, and the comparison result of each condition item is comprehensively determined and shot. Search and extract those that approximate the condition. As a result, even when there is no completely matching shooting condition, the comparison result of each condition item is comprehensively determined in consideration of the weighting, and it is possible to search for and extract the one that approximates the shooting condition. .
Here, a necessary condition may be input instead of using the current screen.

  When the user accepts the recommendation (step S105), the photographing distance from the photographing position to the subject when the photographed image “photo001.jpg” is photographed, the four face detection positions, and the face detection size frame are displayed on the photographing screen. It is displayed with a dotted line, and the face ID and smile level are also described for each frame. The current face detection frame is displayed as a solid line, and the user is advised so that the dotted line and the solid line overlap each other. The user receives advice and instructs the user to move the shooting position or to have the member who is the subject move (step S106: subject position correcting step).

Here, the dotted line frame and the solid line frame overlap, and when the smile level in each face detection frame reaches a predetermined value (for example, “90 points”), the shutter is automatically released, so the camera can be photographed under the same conditions as the previous time. Is possible, and photographing is performed (step S108: photographing execution step).
In this way, the user can save the trouble of manually setting the camera photographing unit 20, continue taking the camera under the same conditions based on the past camera photographing history, and regularly (time-series) ) Can be photographed in the same atmosphere and the change can be seen.
The photographed image and the photographing condition are associated with each other and stored in the photographing history database 31 (step S109).

  If it is determined in step S102 that the past shooting history is not used, or if the shooting history searched in step S105 is not used, the shooting conditions are uniquely set in step S107, and the process proceeds to step S108 to perform shooting. . If the shooting history searched in step S105 is not preferable, some shooting conditions may be reset, and the shooting information may be searched again from the shooting history database 31 as a condition.

  As described above, according to the present embodiment, the mobile phone terminal 10 including the camera photographing unit 20 having a photographing function is associated with the photographed history database 31 by associating the past photographed image with the photographing information including the photographing conditions. And a shooting situation analysis engine 30 that allows the shooting history utilization unit 32 to search for the shooting information. The shooting situation analysis engine 30 is used to create a new image based on the same shooting conditions as the previous shooting data. Makes it possible to shoot.

  Therefore, it is possible to provide a shooting support system, a shooting support method, and a shooting support program capable of searching and reading shot images stored in the past and shooting conditions, and performing current shooting based on the searched shooting conditions. become. Thereby, even a beginner can easily shoot under the same conditions as the past. At this time, even if the past shooting conditions are forgotten, they can be easily reproduced. In addition, it is possible to capture the time-series change over time.

The present invention is not limited to the above-described embodiment, and may be configured as follows.
In the above description, each step of the processing operation of this system has been described as being executed by each element constituting the camera-equipped mobile phone terminal 10 of the present embodiment, but provided in the control unit 11 of the mobile phone terminal 10. Each process can be implemented by software using a CPU. Even if it does in this way, the function of the present invention can be realized similarly, and the same effect is acquired.
Further, in the above description, the case of photographing a person has been described as an example. However, it is also possible to photograph a scene of the same place as the past or a passage of time such as a building.
Furthermore, the photographing information can be transferred to an external server or an external storage medium and stored, and data can be input / output from these external devices to the mobile phone terminal as necessary.

  It is possible to take pictures corresponding to temporal changes from the past to the future using a mobile phone terminal, and can be widely used in the fields of information communication equipment, electronic cameras, and the like.

It is a block diagram which shows the structure of the imaging | photography assistance system of this invention. It is a flowchart explaining operation | movement of the imaging | photography assistance system of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Cellular phone terminal 11 Control part 12 Display part 13 Operation part 14 Wireless communication part 15 Audio | voice signal processing part 16 Memory | storage part 20 Camera photographing part 21 Shooting condition setting function 22 Person photographing condition detection function 23 Scene classification function 24 Captured image storage function 30 Shooting situation analysis engine 31 Shooting history database 32 Shooting history utilization unit 33 Shooting rule database 34 Shooting behavior control unit

Claims (6)

A shooting support method for a mobile phone terminal having a digital camera function,
A shooting support selection process for selecting shooting support;
A shooting condition specifying step for specifying a specific condition in the shooting conditions as required,
A search and display process for searching and displaying shooting information including past shot images and shooting conditions;
A subject position correcting step for performing an auxiliary operation for matching the past photographed image displayed by correcting the current subject position with the current subject image;
A shooting support method comprising: a shooting execution step of executing shooting and storing a shot image and shooting conditions thereof. A mobile phone terminal having a camera photographing unit is provided with photographing condition analysis means for storing photographing information including past photographed images and photographing conditions thereof, and making the photographing information searchable.
An imaging support system characterized in that imaging based on imaging conditions of past imaging information is possible using this imaging situation analysis means. The photographing situation analyzing means includes
A shooting history database that stores past shot images and shooting conditions as shooting information;
A shooting information storage function for extracting shooting conditions at the time of shooting and storing them in the shooting history database, and shooting conditions corresponding to shooting conditions are retrieved from the shooting information stored in the shooting history database and displayed or automatically set. Shooting history utilization unit with shooting information search function,
A shooting rule database that determines whether or not to search for shooting conditions according to shooting conditions, and stores shooting rules that set the method when searching,
Shooting behavior control that reads out corresponding shooting rules from the shooting rule database in accordance with changes in shooting conditions, and instructs the history utilization unit to hold, set, or display shooting conditions to advise the user The photographing support system according to claim 2, further comprising: a unit.   The user can set conditions for the shooting information search function of the history utilization unit, and can search for shooting information by weighting certain characteristics according to the conditions. Shooting support system. The camera photographing unit
A shooting / image storage function unit for shooting and storing a subject;
A shooting condition setting function unit for setting a specified shooting distance and zoom amount;
A human photographing condition detection function unit for executing a human photographing condition including face number detection, smile level detection, and face size detection from a subject screen to be photographed in cooperation with the photographing state analysis unit;
The photographing support system according to any one of claims 2 to 4, further comprising a scene classification function unit that classifies a photographing scene from a subject screen to be photographed. A shooting support program executed by a mobile phone terminal having a digital camera function, the mobile phone terminal,
A shooting support selection process for selecting shooting support;
A shooting condition specifying step for specifying a specific condition in the shooting conditions as required,
A search and display process for searching and displaying shooting information including past shot images and shooting conditions;
A subject position correcting step for performing an auxiliary operation for matching the past photographed image displayed by correcting the current subject position with the current subject image;
A program for executing photographing and executing a photographing execution step of storing a photographed image and photographing conditions thereof.

Images