JP2010200056A - Recording and reproducing apparatus - Google Patents

Abstract

【Task】
When shooting according to the guidance that assists shooting, it is not known whether the information necessary for the scene is recorded, and as a result, important items may be missed.
[Solution]
Determine whether the person or object recognized by analyzing the scene being shot matches the necessary conditions included in the supplementary information, and use the importance associated with the necessary conditions to complete the video for the user Show the condition that is not enough.
[Selection] Figure 1

Description

  The present invention relates to a recording / reproducing apparatus for recording / reproducing video information on a recording medium.

  As background art in this technical field, for example, there is JP-A-2005-45574. This publication provides “[Problem] A technique for digest editing moving image data. [Solution] A plurality of guidance files are stored in a guidance file storage area in a guidance file used for a guidance function. At each event, information about priority or importance is added for each scene based on the importance of the scene in the event. In the guidance file storage area, a default value is determined for each event, but the user can change the priority. "

JP2005-45574

  In recent years, video cameras that record video and audio information on a large-capacity recording medium such as an HDD have become popular. In addition to HDDs, there are also video cameras equipped with recording means for recording media such as BD (Blu-ray Disc), DVD (Digital Versatile Disc), and SD cards. It was possible to shoot high-quality video over time.

  In addition, improvements such as the face recognition function enable autofocus on the subject and appropriate exposure adjustment, making it easy to shoot beautiful images. Further, a technique has been devised for reproducing a scene in which a face is recorded by skipping a scene in which a face is recorded by determining that the scene in which the face is recorded is important during reproduction.

  However, it is difficult to shoot like a professional photographer by combining a person, a building, a background, or the like that is a point in a scene that the user wants to record, and there are cases where a point is not shot.

  In view of this, a technique has been devised in which a guidance file is prepared as to what kind of scene should be photographed for each event and the photographing is advanced as instructed by the user.

  When shooting according to the guidance that assists shooting, it is not known whether the video that the user is shooting is exactly as the guidance. For this reason, there are cases where it is difficult to understand what the photographer was trying to take, or missed shots.

  In order to solve the above-mentioned problem, for example, it is determined whether or not it matches the content of the shooting scene based on the shooting assistance information prepared for each scene of the event. In addition, as a result of the determination, if there is a missing item, it is transmitted to the user.

  According to the present invention, for example, it is possible to know whether or not an image according to the guidance can be taken during shooting, and it is possible to prevent missed shooting.

  Further, for example, a part where a video image according to the guidance can be taken is considered to be an important part as compared with other parts, so that it can be used as a candidate part for digest reproduction or dubbing.

  Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

Recording / playback device Shooting assistance information (1) Shooting assistance information (2) Matching judgment sequence with auxiliary shooting information Event selection screen Scene selection screen Composition example screen Shooting screen (1) Shooting screen (2) Shooting screen (3) Importance transition Transition of recording time and importance

  An example of an embodiment suitable for carrying out the present invention will be described. However, the present invention is not limited to this embodiment.

  FIG. 1 is a diagram showing an example of a recording / reproducing apparatus 100 having an overall configuration according to an embodiment of the present invention.

  A system control unit 101 includes a CPU (Central Processing Unit), a recognition processing unit 201, an internal memory 202, and the like, and controls the entire system. Reference numeral 105 denotes an imaging device, and 106 denotes a camera signal processing unit that images a subject, converts imaging information from an optical signal to an electrical signal, and converts an analog electrical signal to a digital signal. Reference numeral 102 denotes a video input / output terminal which inputs and outputs digital video signals compressed and expanded by the video compression / decompression unit 108. Reference numeral 103 denotes an audio input / output terminal which inputs and outputs digital audio signals compressed and expanded by the audio compression / decompression unit 109. A multiplexing / separating unit 107 multiplexes video compression data and audio compression data output from the video compression / decompression unit 108 and the audio compression / decompression unit 109 to generate stream data, or converts the stream data into video compression data. Separated into audio compression data, each data is input to the video compression / decompression unit 108 and the audio compression / decompression unit 109. Reference numeral 112 denotes an external recording medium control driver unit. When recording AV data, the stream data and various information files generated by the multiplexing / demultiplexing unit 107 via the system control unit 101 are stored in a predetermined format in the HDD 113 or the BD / DVD 114, Alternatively, stream data and various information files recorded on each external recording medium are read out when writing to the SD card 115 or reproducing AV data.

  Here, the video compression / decompression unit 108, the audio compression / decompression unit 109, the multiplexing / demultiplexing unit 107, and the external recording medium control driver unit 112 may be configured to execute hardware operations as a circuit, or may be configured as a system control unit. 101 may be stored as a program and processing may be executed in software. The HDD 113, the BD / DVD 114, or the SD card 115 mainly records files obtained by digitally compressing AV data such as video information and audio information, management information of the AV data, and the like. Reference numeral 110 denotes a communication unit, which performs communication processing with another device such as an information processing apparatus via a communication input / output terminal 111. Reference numeral 116 denotes a monitor unit that is played back from a GUI (Graphical User Interface) such as a menu of the recording / reproducing apparatus 100, video information input by the image sensor 105 during recording, or an external recording medium such as an HDD during playback. Display video information. The power supply unit 104 supplies power for driving the recording / reproducing apparatus such as a battery for driving the apparatus and an AC power supply.

  FIG. 2 and FIG. 3 describe photographing assistance information for providing guidance that assists photographing in the present embodiment.

  FIG. 2 shows a scene to be photographed in one event. For example, in an event called “entrance ceremony”, scenes such as “first attendance at school”, “in front of school entrance”, “entrance” are photographed.

  FIG. 3 shows necessary conditions to be photographed in one scene and their importance. For example, in the event of “entrance ceremony”, the scene “in front of the school gate” is shown. In this scene, it is desirable that parents and children are shown in front of the signboard “○ × Elementary School Entrance Ceremony” at the school gate. Therefore, it is necessary that the letters “entrance ceremony” and the child, father, and mother are reflected. Importance is set for each condition. These may be preset conditions and importance levels, or may be conditions and importance levels specified by the user.

  Here, the necessary condition (for display) indicates character data used to indicate what conditions are necessary for the user. The necessary condition (recognition information) refers to information for comparison with a video.

  Further, this photographing auxiliary information is stored in the internal memory 202, and is read out and used by the system control unit 101. Therefore, it may be stored in advance in the internal memory 202, or may be acquired from the outside via the communication unit 110 and stored in the internal memory. Further, it may be stored in the internal memory via an external recording medium such as an HDD.

FIG. 4 shows a processing flow using the photographing auxiliary information in the present embodiment.
In step 401, it is determined whether there is an unmatched necessary condition. If there are unmatched necessary conditions, the process proceeds to step 402; In step 402, video recognition processing is performed. This refers to various recognition processes such as character recognition, face recognition, person recognition, and object recognition.

  In step 403, it is determined whether or not the recognition result in step 402 matches the necessary condition. If they match, the process proceeds to step 404, and if they do not match, the process proceeds to step 405.

  In step 404, the importance associated with the necessary condition matched in step 403 is added to the importance of the corresponding scene. Also, the necessary conditions that did not match in step 405 are held in the internal memory. In step 406, it is determined whether or not there is a change from the importance value when the previous match determination process is performed. If there is a change, the process proceeds to step 407, and if there is no change, the process proceeds to step 408. In step 407, the scene information is updated. In step 408, the importance of the scene and the necessary conditions that did not match are transmitted to the user via the monitor unit 116.

  FIG. 5 shows an example of the event selection screen. Select an event at the start of event shooting. In this example, “entrance ceremony” is selected. Practically, it is good to set once and hold it, and set it again when changing the event.

  FIG. 6 shows an example of the scene selection screen. Select a scene when you start shooting the scene. In this example, “School Gate” is selected. Here, an example of the composition of a scene is shown.

  FIG. 7 shows a composition example and photographing conditions. This is an example of what kind of video should be taken after selection on the selection screen of FIG. As a condition, in addition to “child”, “signboard for entrance ceremony”, “dad” and “mother” are displayed.

  8, 9, and 10 show examples of information displayed on the monitor unit 116 during shooting.

  In FIG. 8, only the signboard “○ × Elementary School Entrance Ceremony” is photographed. Here, in this recording / reproducing apparatus, in step 402, the character “◯ × elementary school entrance ceremony” is recognized. In step 403, since it matches the necessary condition “entrance ceremony”, the process proceeds to step 404, and 20 importance values associated with “entrance ceremony” are added to the importance of the scene. In this scene, there was nothing that matched the other conditions, so the monitor unit displays a score of “20 points” with the importance value score. In addition, a message (“Children, dads, and mothers should be shown together”) that prompts them to shoot something equivalent to other conditions is displayed.

  FIG. 9 shows a child in addition to FIG. Here, in the present recording / reproducing apparatus, the character “entrance ceremony” is recognized in the same manner as the above processing, and the importance value of 20 points is held. In step 402, “child” is recognized. In step 403, since it matches the necessary condition “child”, the process proceeds to step 404, where the importance of 50 points associated with “child” is added to the importance of the scene, and the importance becomes 70 points in total. Since there was nothing that matched other conditions, the score of “70 points” is displayed on the monitor unit with the importance value as the score. In addition, a message prompting the user to take a picture corresponding to another condition is displayed.

  In FIG. 10, in addition to FIG. 9, a father and a mother are shown. As in FIG. 9, in addition to the 70 points for recognizing “entrance ceremony” and “children”, “adult (male)” is recognized, and an importance value of 15 points is added as “dad”. Furthermore, “adult (female)” is recognized, and an importance value of 15 points is added as “mother”. As a result, 100 images are obtained. The monitor unit displays a message indicating that a good video has been taken with a score of “100 points” with the importance value as a score.

  By displaying the message indicating the score and the necessary conditions in this way, it is possible to prevent missing necessary items and to enjoy shooting.

  In addition, the scene information is updated as described in step 407 at the place where the importance has changed. This scene information is information in which a recording time position indicating a scene position is associated with an importance value. Specifically, the importance file for these pieces of information may be created, or a chapter useful for jumping to a specific location during reproduction may be created.

  FIG. 11 shows an example of the importance file. Stores the scene position and importance value from the start of recording at the place where importance changes. Here, the importance level is 20 points at the “00:00:20” point, and the importance level is 70 points at the “00:00:40” point.

  FIG. 12 shows the transition of the recording time and the importance corresponding to the importance file of FIG. The degree of importance increases by satisfying the requirements of the shooting assistance information. Conversely, the importance decreases when the necessary conditions are no longer met.

  Here, it can be said that the part of importance 100 points is the most important part in this scene. Therefore, at the time of reproduction, digest reproduction is realized in which the system control unit 101 refers to the importance file and reproduces only the importance 100 points.

  Further, even during dubbing, the system control unit 101 can refer to the importance file and dubb only the portion with the importance of 100 points.

  Here, the 100 point portion is regarded as an important portion. However, this score may be equal to or more than a predetermined score, or may be the maximum score in the scene. Moreover, the number of points specified by the user or more may be used.

  For example, in a video camera, it is possible to assist the user's shooting, prevent forgetting to take a person or object as a point, and create better content.

  Although the present invention has been described along examples, the present invention is not limited to these examples. For example, it is possible to replace not only a video camera but also a digital camera or a camera-equipped mobile phone.

DESCRIPTION OF SYMBOLS 100 ... Recording / reproducing apparatus 101 ... System control part 102 ... Video input / output terminal 103 ... Audio input / output terminal 104 ... Power supply part 105 ... Image sensor 106 ... Camera signal processing part 107: multiplexing / separating unit 108: audio compression / decompression unit 109 ... video compression / decompression unit 110 ... communication unit 111 ... communication input / output terminal 112 ... external recording medium control driver unit 113 ..HDD
114 ... BD / DVD
115 ... SD card 116 ... monitor unit 201 ... recognition processing unit 202 ... internal memory

Claims (8)

In a recording / reproducing apparatus for recording / reproducing video / audio information on a recording medium,
Each shooting scene has shooting auxiliary information consisting of a plurality of necessary conditions having a predefined importance value,
Video recognition means for determining whether or not the video / audio information matches a necessary condition of the auxiliary photographing information;
A recording / reproducing apparatus comprising: means for displaying conditions necessary for a photographing scene based on the photographing auxiliary information. In a recording / reproducing apparatus for recording / reproducing video / audio information on a recording medium,
Each shooting scene has shooting auxiliary information consisting of a plurality of necessary conditions having a predefined importance value,
Video recognition means for determining whether or not the video / audio information matches a necessary condition of the auxiliary photographing information;
A recording / reproducing apparatus comprising: means for displaying a score of the video / audio information based on a result of determination by the video recognition means. The recording / reproducing apparatus according to claim 1 or 2,
Of the video / audio information, a location that newly satisfies a plurality of necessary conditions having a predefined importance value, or a location that no longer satisfies a plurality of necessary conditions having a predefined importance value. And recording / reproducing apparatus characterized by holding information for associating with The recording / reproducing apparatus according to claim 3,
Of the video and audio information, comprising means for searching for a change location of the result of the discrimination of the video recognition means,
A recording / reproducing apparatus comprising means for reproducing based on a search result of the search means. The recording / reproducing apparatus according to claim 3,
Of the video and audio information, comprising means for searching for a change location of the result of the discrimination of the video recognition means,
A recording / reproducing apparatus comprising: means for dubbing to a recording medium based on a search result of the search means. Imaging means for imaging a subject;
Recognition processing means for subject recognition processing for the video signal output from the imaging means;
Discriminating means for discriminating correspondence between a subject recognized by the recognition processing means and photographing auxiliary information including necessary conditions defined for each photographing scene;
Notification means for notifying the user that the subject that has been recognized by the recognition processing means satisfies more of the necessary conditions of the photographing auxiliary information according to the result of the determination by the determination means;
An imaging apparatus comprising: In claim 6,
The shooting assistance information has a plurality of necessary conditions for one shooting scene,
The determining means determines each of the plurality of necessary conditions,
The notifying means notifies the user of the necessary conditions determined not to be satisfied by the determining means among the plurality of necessary conditions;
An imaging apparatus characterized by the above. In claim 7,
The notification means is changed so that it is determined that the necessary condition determined not to be satisfied by the determining means among the plurality of necessary conditions is changed, or the necessary condition determined to be satisfied by the determining means If the change is made so that it is determined that is not satisfied, the change is notified to the user,
An imaging apparatus characterized by the above.

Images