JP2010098636A - Animation playback apparatus, and animation editing apparatus - Google Patents

Abstract

A conventional moving image playback / editing apparatus is difficult to extract a portion that suits a user's preference.
A moving image reproducing apparatus that reproduces a moving image recorded on a recording medium, a sound collecting unit that collects sound, a sound analyzing unit that analyzes sound by the sound collecting unit, and a moving image An audio recording unit 105 that records the analysis result of the audio analysis unit 104 together with the reproduction position at the time of reproduction; a priority calculation unit 107 that calculates a priority for each reproduction position of the moving image based on the analysis result in the audio recording unit 105; By providing the playback unit 109 that plays back a moving image based on the priority order, it is possible to easily play back and edit only the scene that the user is interested in.
[Selection] Figure 1

Description

  The present invention relates to a moving image reproducing apparatus and a moving image editing apparatus capable of extracting and reproducing a specific portion based on a predetermined condition.

  In recent years, an apparatus for recording a video signal as a file on a recording medium such as an optical disk or a semiconductor memory has become common. As the capacity of recording media increases, the number of recordable moving image data also increases. In order to extract a portion desired by a user from moving image data that has been seen in the past, conventionally, it has been mainly extracted from a large amount of moving image data while repeating fast-forwarding and playback. However, this method repeats operations similar to those seen in the past, and is a very inefficient method.

In order to solve such a problem, Patent Document 1 discloses an operation history holding unit that holds a history of operations performed by a user at the time of reproduction, and a location that the user prefers from operation history data stored in the operation history holding unit. Has proposed a moving image playback / editing apparatus provided with a history calculation means capable of calculating. According to this apparatus, the operation performed by the user during reproduction is recorded together with the reproduction position of the moving image data, the importance of the moving image data is evaluated based on the operation result, and the moving image data is determined according to the importance. Can be automatically detected and displayed at a location that the user is likely to like.
JP-A-5-054085

  As described above, the conventional video playback / editing apparatus only records the history of operations performed by the user at the time of playback, has it performed slow playback to search for editing points for cutting unnecessary parts, There is a problem in that a part that is not important to the user is erroneously extracted because the user's intention of performing the playback operation, such as whether or not the slow playback is performed so that it is an important scene, can be viewed carefully.

  Therefore, the present invention also records voice data such as laughter and cheer that the user uttered at the moment when the playback operation is performed during playback of moving image data, and uses the result of analyzing the voice data to make it more user-preferred. It is an object of the present invention to provide a moving image reproducing apparatus and a moving image editing apparatus that can extract a portion that meets the above.

  In order to achieve the above object, a moving image reproducing apparatus of the present invention is a moving image reproducing device that reproduces a moving image recorded on a recording medium, a sound collecting unit that collects sound, and a sound collected by the sound collecting unit. A sound analysis unit for analyzing, a sound recording unit for recording an analysis result of the sound analysis unit together with a reproduction position at the time of reproduction of the moving image, and a priority for each reproduction position of the moving image based on the analysis result in the sound recording unit. A priority calculating unit for calculating, and a reproducing unit for reproducing the moving image based on the priority.

  With such a configuration, it is possible to record and analyze voice data emitted by the user, and therefore, by using the analysis result of the voice data, it is possible to automatically extract a portion more suited to the user's preference.

  As described above, according to the moving image reproducing apparatus of the present invention, it is possible to record and analyze audio data emitted by the user, and therefore, it is possible to automatically extract a portion more suited to the user's preference.

The best mode for carrying out the present invention will be described below with reference to the drawings.
(Embodiment 1)
FIG. 1 is a block diagram showing the configuration of the moving image playback / editing apparatus according to the first embodiment of the present invention. In FIG. 1, 101 is an operation unit for performing various operations including fast-forwarding, slow playback and normal playback, 102 is an operation history unit for recording an operation history by the operation unit 101 for each moving image, 103 is a microphone for collecting sound, 104 Is an audio analysis unit that analyzes audio from the microphone 103, 105 is an audio recording unit that records the analysis result of the audio analysis unit 104 for each moving image during reproduction, and 106 is a point for each operation type and a point for each audio analysis result The stored point storage unit 107 is a priority for calculating the priority order corresponding to the playback time of each moving image based on the operation history in the operation history unit 102, the analysis record in the audio recording unit 105, and the points in the point storage unit 106. The rank calculation unit 108 is a recording medium on which moving image data is recorded, and 109 is a moving image recorded on the recording medium 108. A moving image reproducing unit for reproducing data based on the priority order, 110 a moving image editing unit for editing moving image data recorded on the recording medium 108, and 111 for displaying an input from the moving image reproducing unit 109 Display device.

  The operation of the moving image playback / editing apparatus of the present invention configured as described above will be described with reference to FIGS. First, recording of audio information and recording of a reproduction operation history will be described with reference to FIG. When reproduction of moving image data is started (S201), it is determined whether or not sound is input from the microphone 103 (S202). If it is determined that sound is input (Yes in S202), the sound is analyzed by the sound analysis unit 104 (S203), and the analysis result is recorded together with the current reproduction position of the moving image data on the recording medium 108. The information is recorded in the unit 105 (S204). When it is determined that there is no audio input from the microphone (No in S202), and after recording in the audio recording unit 105, it is determined whether a reproduction-related operation is input from the operation unit 101 (S205). If no reproduction-related operation is input (No in S205), the process returns to S202 again, and the presence / absence of voice input is determined again. When a reproduction-related operation is input (Yes in S205), the reproduction operation information is recorded in the operation history unit 102 together with the current reproduction position of the moving image data on the recording medium 108 (S206). It is determined whether the reproduction-related operation is a reproduction stop operation (S207). If the reproduction-related operation is a reproduction stop operation, reproduction is stopped (S208). In cases other than the reproduction stop operation, the reproduction is continued, so the process returns to S202 again to determine again whether or not there is an audio input. When the reproduction is started in this way, the input from the microphone 103 and the input of the reproduction-related operation from the operation unit 101 are always detected until the reproduction is stopped, and the audio information and reproduction are performed according to the detection result. Operation history information can be recorded.

  In the present embodiment, the determination as to whether or not there is a playback-related operation input in S203 is performed prior to the determination as to whether or not there is a voice input in S202, but this order is reversed. Even at the same time, it may change dynamically according to the priority selected by the user. If only the voice is important, the determination as to whether or not there is a reproduction-related operation in S202 may be skipped, and only whether or not there is a voice input may be recorded.

  Further, in the present embodiment, the determination of whether or not there is an input of the reproduction-related operation in S203 is limited to the reproduction-related operation, but not only the reproduction operation but also the editing operation may be targeted. For example, during playback of moving image data, it is conceivable that a pause is executed at a scene in which the user is interested and the moving image data at that moment is cut out as a photograph. At this time, the user is performing an editing operation of cutting out from the moving image data as a photo, but it is a sign of a strong will that the user is interested, and by raising the point of this point, more It becomes easy to identify a part of interest of the user.

  Next, how to assign priorities based on recorded audio information and reproduction operation history information will be described with reference to FIG. First, when prioritization is started (S301), audio information is acquired from the audio recording unit 105 (S302). Subsequently, the reproduction operation history information is acquired from the operation history unit (S303). A point with respect to the position of the moving image data recorded on the recording medium 108 is calculated from the audio information and the reproduction operation history information from the stored information in the point storage unit 106 (S304). The priority order is calculated based on the calculated points (S305), and the prioritization ends (S306).

  In the present embodiment, the playback history is acquired in S303 prior to the acquisition of audio information in S302. However, the user can select the reverse or simultaneous order. It may change dynamically depending on the priority. Further, when only the sound is regarded as important, the acquisition of the reproduction history information in S302 may be skipped, the points may be calculated only by the sound, and the priority order may be calculated.

  The prioritizing process is performed when the user selects a video and executes a process of selecting and playing a part with a high priority, or when executing a process of selecting and editing a part with a high priority. Is called. Alternatively, the reproduction process shown in FIG. 2 may be executed immediately after the reproduction is stopped.

  A method for calculating the priority order based on the points of S304 and S305 will be described with reference to FIG. First, regarding the reproduction operation, points are prepared for each reproduction operation, and those points are stored in the point storage unit 106. For example, there are 1 point for fast forward, 5 points for normal playback, 10 points for slow playback, and the like. In this way, points are added to the playback position of the moving image data in accordance with the playback operation. Similarly, a voice situation such as cheer and laughter when the user is viewing moving image data is recorded and analyzed, and the score stored in the point storage unit 106 is assigned according to the analyzed voice. For example, 0 points for quiet, 5 points for cheering, 10 points for cheering and laughing at the same time. The final point corresponding to the reproduction position of the moving image data is determined based on the point obtained by the reproduction operation and the point obtained by analyzing the voice situation of the user.

  In the example of the playback operation of FIG. 4 in the present embodiment, a high point is given to the slowly played back, but the point when an operation other than normal playback is performed may be increased, Conversely, the normal playback point may be increased.

Next, playback (hereinafter, digest playback) processing using the calculated priority will be described with reference to the flowchart of FIG. The user starts digest playback using the operation unit 101 (S501). In response to the inquiry displayed on the display device 111, the user inputs the priority order of moving images selected during digest playback or the playback time during digest playback (S502). When the priority is input, a position higher than the input priority is extracted from the moving image data. When the playback time is input, the position is designated in the descending order of priority in the moving image data. The moving image data until reaching the playback time is extracted (S503).
The moving image reproduction unit 109 reproduces the extracted moving image data (S504).

  The extracted moving image data may be played back in time order regardless of the priority order, or may be played back in order of priority order.

  The same applies to the editing process using the calculated priority order. When editing, the user inputs the priority order or editing time of the selected moving image. When the priority order is input, a position higher than the priority order input in the moving image data is extracted, and when the editing time is input, the position is designated in the order of higher priority in the moving image data. Moving image data until the editing time is reached is extracted. The moving image editing unit 110 records the extracted moving image data on the recording medium 108.

  In this way, a priority according to the position of the moving image data on the recording medium 108 is obtained, and by performing reproduction or editing using this priority, it is possible to easily reproduce only the scene in which the user is interested. In addition, editing according to the priority can be easily performed, such as deleting a portion having a low priority.

  In this embodiment, the priority order is determined using both the audio information and the reproduction operation history information, but the priority order may be determined using only the audio information.

(Embodiment 2)
In the first embodiment, not only the history of operations related to playback, but also the audio information generated when the user views the video is simultaneously used to determine the priority order, and the video that is played and edited based on the priority order The playback editing apparatus has been described. However, by incorporating not only the reproduction history information and audio information generated when the user views, but also the situation viewed by the user, prioritization can be made more in line with the user's interest. Therefore, an apparatus for further recording the situation viewed by the user and assigning priorities according to the user's interest using the situation will be described with reference to FIG.

  FIG. 6 is a block diagram showing a configuration of the moving image recording / playback editing apparatus according to the second embodiment of the present invention. In FIG. 6, 101 to 111 have the same configuration as in FIG. 1, 601 is a camera that captures a user's movement as a moving image, 602 is a moving image analysis unit that analyzes the moving image by the camera 601, and 603 is a moving image analysis for each moving image during playback. The moving image recording unit records the analysis result of the unit 602.

  The operation of the moving picture recording / playback / editing apparatus configured as described above will be described focusing on the difference from the first embodiment. First, recording of audio information and recording of a reproduction operation history are as shown in FIG. 2 and are the same as in the first embodiment. In addition to this, since moving image information is also recorded, this will be described. When playback of moving image data is started, moving image data is input from the camera 601. The input moving image data is analyzed by the moving image analysis unit 602 and the analysis result is recorded in the moving image recording unit 603 together with the current reproduction position of the moving image data on the recording medium 108. The moving image analysis unit 602 analyzes the user's facial expression, gesture, and the like, and assigns the score stored in the point storage unit 106 according to the analysis result. For example, 0 points when the user's facial expression is quietly viewed without change, 5 points when the user's facial expression becomes a laughing face, and 10 points when the user jumps up while laughing.

  By analyzing the moving image data obtained by photographing the user at the time of reproduction, it becomes possible to more accurately extract what interest the user shows in the moving image data being reproduced. By using the moving image information recorded in this way together with the audio information and the reproduction operation history information, it is possible to perform prioritization more in line with the user's interest, Editing can be performed.

  According to the moving image reproduction / editing apparatus of the present invention, since operation history information and audio information can be used for reproduction and editing in accordance with the user's interest, a digital video camera or IC capable of reproduction and audio recording can be used. It is useful in a wide range such as a recorder.

1 is a block diagram showing the configuration of a video playback / editing apparatus according to Embodiment 1 of the present invention; The flowchart which shows the reproduction | regeneration log | history of the moving image reproduction edit apparatus in Embodiment 1 of this invention, and the recording operation of audio | voice information The flowchart which shows the operation | movement of prioritization of the moving image reproduction | regeneration edit device in Embodiment 1 of this invention. The figure which shows the outline | summary of the point provision based on the reproduction | regeneration log | history and audio | voice information in Embodiment 1 of this invention. The flowchart which shows the operation | movement of digest reproduction in Embodiment 1 of this invention. Block diagram showing a configuration of a moving image playback / editing apparatus according to Embodiment 2 of the present invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Operation part 102 Operation log | history part 103 Microphone 104 Audio | voice analysis part 105 Audio | voice recording part 106 Point memory | storage part 107 Priority order calculation part 108 Recording medium 109 Movie reproducing part 110 Movie editing part 111 Display apparatus 601 Camera 602 Movie analysis part 603 Movie recording part

Claims (6)

A video playback device for playing back a video recorded on a recording medium,
A sound collection unit for collecting sound;
A voice analysis unit for analyzing voice by the sound collection unit;
An audio recording unit that records an analysis result of the audio analysis unit together with a reproduction position at the time of reproduction of the moving image;
A priority calculation unit for calculating a priority for each reproduction position of the video based on the analysis result in the audio recording unit;
A playback unit for playing back the video based on the priority order;
A video playback device comprising: An operation unit that accepts operation instructions including fast-forwarding and slow-play,
An operation history unit that records an operation history by the operation unit together with a reproduction position at the time of reproduction of the video,
The moving image playback apparatus according to claim 1, wherein the priority order calculating unit calculates a priority order for each playback position of the moving image based on an analysis result in the audio recording unit and the operation history. An imaging unit for imaging a subject;
A video analysis unit for analyzing a video by the imaging unit;
A moving image recording unit that records an analysis result by the moving image analysis unit together with a reproduction position at the time of reproducing the moving image,
The moving image playback apparatus according to claim 1, wherein the priority order calculating unit calculates a priority order for each playback position of the moving image based on an analysis result in the audio recording unit and an analysis result in the moving image recording unit. A video editing device for editing a video recorded on a recording medium,
A sound collection unit for collecting sound;
A voice analysis unit for analyzing voice by the sound collection unit;
An audio recording unit that records an analysis result of the audio analysis unit together with a reproduction position at the time of reproduction of the moving image;
A priority calculation unit for calculating a priority for each reproduction position of the video based on the analysis result in the audio recording unit;
An editing unit for editing the video based on the priority order;
Video editing device with An operation unit that accepts operation instructions including fast-forwarding and slow-play,
An operation history unit that records an operation history by the operation unit together with a reproduction position at the time of reproduction of the video,
5. The moving image editing apparatus according to claim 4, wherein the priority calculation unit calculates a priority for each reproduction position of the moving image based on an analysis result in the audio recording unit and the operation history. An imaging unit for imaging a subject;
A video analysis unit for analyzing a video by the imaging unit;
A moving image recording unit that records an analysis result by the moving image analysis unit together with a reproduction position at the time of reproducing the moving image,
5. The moving image editing apparatus according to claim 4, wherein the priority calculation unit calculates a priority for each reproduction position of a moving image based on an analysis result in the audio recording unit and an analysis result in the moving image recording unit.

Images