JP2018074360A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To edit a still image before generating the still image from the moving image. When marker information is instructed during recording of a moving image, marker information relating to a frame corresponding to the marker information is generated. After stopping the recording of the moving image, a still image is generated and recorded from a frame corresponding to the marker information in the recorded moving image based on the marker information. If there is an editing instruction for the still image of the frame corresponding to the marker information before generating the still image, the marker information is updated according to the editing contents by the editing instruction, and the editing is performed based on the updated marker information. A still image that has been subjected to processing corresponding to the contents of editing by an instruction is generated. [Selection] Figure 1

Description

  The present invention relates to an imaging apparatus.

  2. Description of the Related Art Conventionally, an imaging device that captures a moving image or a still image and records it on a memory card or the like is known. In addition, there is an apparatus that captures and records a still image while recording a moving image when an instruction to shoot a still image is given during recording of the moving image.

  Furthermore, if there is an instruction during video recording, the elapsed time at the time of the still image recording instruction is recorded, and after the video recording ends, the screen corresponding to this elapsed time is taken out from the video and A configuration for recording as an image has also been proposed (see Patent Document 1).

JP 2012-182730 A

  However, in Patent Document 1, editing processing cannot be performed on a still image until the still image is extracted from the moving image. Therefore, an operation such as adding a rating to a still image cannot be performed immediately after shooting.

  Therefore, an object of the present invention is to provide an apparatus capable of editing a still image before generating the still image from the moving image.

  Imaging means, recording means for recording moving image data obtained by the imaging means on a recording medium, operating means for receiving an instruction from a user, and indication of marker information from the operating means during recording of the moving image data And generating means for generating marker information relating to a frame corresponding to the indication of the marker information in the moving image data being recorded, an image processing means, and after stopping the recording of the moving image data, based on the marker information Controlling the image processing means to generate still image data from a frame corresponding to the marker information in the moving image data recorded on the recording medium, and the still image data generated by the image processing means Control means for controlling the recording means to record on a recording medium, the control means comprising the image processing means If there is an editing instruction for a still image of a frame corresponding to the marker information before generating the still image data, the marker information is updated according to the content of editing by the editing instruction, and the updated On the basis of the marker information, the image processing means is controlled to generate the still image data that has been subjected to processing corresponding to the content of editing by the editing instruction.

  Before a still image is generated from a moving image, it is possible to edit the still image.

It is a figure which shows the structure of an imaging device. It is a flowchart which shows recording operation. It is a flowchart which shows reproduction | regeneration operation | movement. It is a flowchart which shows the operation | movement of cutting out a still image. It is a figure which shows the example of marker information. It is a flowchart which shows reproduction | regeneration operation | movement. It is a figure which shows the example of marker information.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. The technical scope of the present invention is determined by the claims, and is not limited by the following individual embodiments. In addition, not all combinations of features described in the embodiments are essential to the present invention.

  FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus 100 according to the first embodiment of the present invention. In FIG. 1, an imaging unit 101 captures a subject and outputs moving image data or still image data. The image processing unit 102 performs predetermined processing on the moving image signal and the still image signal from the imaging unit 101 or the reproduced moving image data and still image data. Further, the image processing unit 102 generates still image data based on the marker information. Further, the image processing unit 102 performs an editing process indicated by the marker information on the still image.

  The memory 103 stores a moving image signal and a still image signal during recording or reproduction. The display control unit 104 displays the captured moving image or still image, the reproduced moving image or still image, and other necessary information on the display unit 105. The display unit 105 is a display device including a liquid crystal panel and the like.

  The encoding processing unit 106 compresses the moving image data and still image data by performing a known encoding process. In addition, the reproduced moving image or still image is decoded. The control unit 107 controls each unit of the imaging apparatus 100 according to an instruction from the operation unit 108. The operation unit 108 includes a power switch, a mode switching switch, and the like, and receives instructions from the user. In addition, the operation unit 108 switches for instructing start and stop of moving image recording, a switch for instructing recording of a still image, a switch for instructing a marker of a still image during recording of the moving image, and instructing to cut out a still image from the moving image Includes switches and switches for instructing editing.

  The recording / reproducing unit 109 records and reproduces moving image data and still image data on the recording medium 110. The recording medium 110 is a random access recording medium such as a memory card. The output unit 111 outputs the reproduced moving image or still image to the outside. The bus 112 transfers image data and other necessary information between the units.

  Next, the operation of the imaging apparatus 100 will be described. The imaging apparatus 100 has a shooting mode, a playback mode, and a cutout mode, and the user switches between these modes by operating the operation unit 108. First, the shooting mode will be described.

  When the user sets the shooting mode, the control unit 107 sets the imaging apparatus 100 to a shooting standby state. In the shooting standby state, the moving image obtained by the imaging unit 101 is displayed on the display unit 105 as a live view image. When there is a still image recording instruction from the operation unit 108 in the shooting standby state, the control unit 107 instructs the imaging unit 101 to output still image data of one screen corresponding to the still image recording instruction. The still image data output from the imaging unit 101 is subjected to still image encoding processing by the encoding processing unit 106, and is recorded on the recording medium 110 as a still image file by the recording / reproducing unit 109.

  Also, in the shooting standby state, when there is an instruction to start moving image recording from the operation unit 108, the moving image data from the imaging unit 101 is encoded by the encoding processing unit 106 and recorded on the recording medium 110 by the recording / reproducing unit 109. Is done. When there is an instruction to stop recording a moving image, the control unit 107 stops recording the moving image.

  In the present embodiment, the marker information can be added to a frame that the user wants to extract later as a still image by operating the operation unit 108 while recording a moving image. A process at the time of shooting a moving image related to the addition of the marker information will be described.

  FIG. 2 is a flowchart for explaining processing at the time of recording a moving image. The processing in FIG. 2 is realized by the control unit 107 controlling each unit. As described above, when there is an instruction to start recording a moving image in the shooting standby state, the processing in FIG. 2 is disclosed. First, the control unit 107 controls to record the moving image data obtained by the imaging unit 101 on the recording medium 110 (S201).

  Next, the control unit 107 determines whether or not there has been an instruction to add a marker from the operation unit 108 (S202). When the addition of the marker is instructed, the control unit 107 acquires frame number information indicating the number of frames from the start of recording (S203), and generates marker information including the frame number (S204). The marker information includes items such as a protection state, a rotation state, a rating, a trimming position, and a resize position, as shown in FIG. In addition, the control unit 107 temporarily stores the generated marker information in the memory 103. Then, after the recording of the moving image is stopped, it is recorded on the recording medium 110 as additional information of the moving image file including the moving image data. The marker information may be stored and recorded in the header of the moving image file, or may be held in the memory 103.

  Further, in the present embodiment, each marker information shown in FIG. 5A is generated every time there is a marker addition instruction. However, one marker information corresponding to a plurality of marker addition instructions is generated. It is good also as a structure recorded collectively.

  Next, the control unit 107 determines whether or not an instruction to stop moving image recording has been given from the operation unit 108. If there is no instruction to stop recording, the control unit 107 returns to S202 and continues recording the moving image. Further, when there is an instruction to stop moving image recording, the control unit 107 controls to stop moving image recording (S206).

  Next, processing in the playback mode will be described. In the present embodiment, in the playback mode, in addition to moving image data and still image data recorded on the recording medium 110, a representative image of a still image of a frame corresponding to marker information generated during recording of a moving image is displayed. Then, editing such as rotation and trimming can be performed on the still image of the frame corresponding to the marker information.

  FIG. 3 is a flowchart showing frame display and editing processing corresponding to marker information in the playback mode. The processing in FIG. 3 is performed by the control unit 107 controlling each unit.

  First, the control unit 107 confirms marker information corresponding to each moving image file recorded on the recording medium 110 (S301). When there is a moving image file including marker information (S302), the marker information is read from the recording medium 110, and the frame number included in the marker information is acquired (S303). Next, the control unit 107 controls the recording / playback unit 109 and the encoding processing unit 106 to read out and decode the frame of the frame number included in the marker information from the corresponding moving image file, and display the reduced image. (S304). At this time, when a plurality of marker information is recorded for one moving image file, a still image corresponding to a frame based on each marker information is displayed on the display unit 105.

  Then, the control unit 107 determines whether or not there is a next moving image file on the recording medium 110. If there is still a moving image file, the control unit 107 returns to S301 (S305). When the confirmation of the marker information and the processing of the frame corresponding to the marker information are completed for all the moving image files, it is determined whether or not there is an instruction to edit the displayed still image from the operation unit 108 (S306). Here, the contents of the editing process include, for example, processes such as trimming, rotation, rating addition, and protection addition.

  When there is an editing instruction, the control unit 107 updates the corresponding marker information in accordance with the editing content based on the editing instruction (S307). The control unit 107 stores the marker information read from the recording medium 110 in the memory 103 when acquiring the frame number of the marker information in S303. Then, the marker information stored in the memory 103 is updated according to the editing content and recorded in the recording medium 110.

  When there is an instruction to add protection to the frame corresponding to the marker information shown in FIG. 5A, the protection state is updated as shown in FIG. 5B. Also, when an image rotation instruction of 180 degrees is given to the frame corresponding to the marker information shown in FIG. 5A, the rotation state is updated to 180 degree rotation as shown in FIG. 5C. When there is an instruction to add a rating to the frame corresponding to the marker information shown in FIG. 5A, the rating value is updated as shown in FIG.

  Next, the control unit 107 determines whether or not there is an instruction to change from the playback mode to another mode (S308), and if there is an instruction to change to another mode, the process ends.

  Next, the cut-out mode process will be described. In the present embodiment, after the recording of the moving image data is stopped, a frame corresponding to the marker information is automatically cut out from the moving image to which the marker information is added based on the marker information, and recorded as a still image. FIG. 4 is a flowchart for explaining processing in the cut-out mode. The processing in FIG. 4 is realized by the control unit 107 controlling each unit.

  After the user operates the operation unit 108 to set the cut-out mode and then instructs to cut out a still image, the processing in FIG. 4 starts. First, the control unit 107 selects a moving image file to which marker information is added from among moving image files recorded on the recording medium 110 (S401), reads the marker information, and stores it in the memory 103. Then, the frame number of the marker information is acquired (S402), and the frame corresponding to the marker information is read out from the moving image data recorded on the recording medium 110 and decoded (S403). Here, the frame number indicated by the marker information is a frame in the moving image data for which a still image recording instruction was issued during recording of the moving image.

  Next, the control unit 107 controls the image processing unit 103 so as to perform editing processing corresponding to the editing content described in the marker information on the still image data of the decoded frame. Then, the edited still image data is encoded by the encoding processing unit 106 and recorded on the recording medium 110 by the recording / reproducing unit 109 (S404).

  For example, if the protected state is present, the generated still image file is recorded with the protect attribute added. If the rotation state is 180 degrees, the rotation information is recorded in the header of the generated still image file. If the rating information is 3, the rating information in the header of the generated still image file is set to 3 and recorded.

  As described above, when the clipping and recording of the still image is completed based on the marker information, the control unit 107 deletes the marker information from the recording medium 110 (S405). Next, the control unit 107 determines whether another marker information is added to the same moving image file (S406). If another marker information has been added, the process returns to S402 and the same processing is repeated for the next marker information. If another marker information is not added, the control unit 107 determines whether another moving image file to which the marker information is added is recorded on the recording medium 110, and there is another moving image file. In this case, the process returns to S401 and is repeated (S407). In addition, when the processing for all marker information is completed, the cutout processing is ended.

  As described above, according to the present embodiment, the still image can be edited before the still image is generated with the marker information added.

  In the present embodiment, in the cut-out mode, the marker information is automatically deleted from the recording medium 110 after the still image has been cut out and recorded. However, the marker information indicates that the marker information has been cut out without being deleted. You may make it add.

  Next, a second embodiment will be described. Also in the second embodiment, the basic processing in the imaging apparatus is the same as that in the first embodiment. In the second embodiment, in the playback mode, the user can specify that a still image after editing is newly saved when editing a frame corresponding to marker information.

  FIG. 6 is a flowchart showing frame display and editing processing corresponding to marker information in the playback mode in the second embodiment. The processing in FIG. 6 is performed by the control unit 107 controlling each unit.

  First, the control unit 107 confirms marker information corresponding to each moving image file recorded on the recording medium 110 (S601). When there is a moving image file including marker information (S602), the marker information is read from the recording medium 110, and the frame number included in the marker information is acquired (S603). Next, the control unit 107 controls the recording / playback unit 109 and the encoding processing unit 106 to read out and decode the frame of the frame number included in the marker information from the corresponding moving image file, and display the reduced image. (S604). At this time, when a plurality of marker information is recorded for one moving image file, a still image corresponding to a frame based on each marker information is displayed on the display unit 105.

  Then, the control unit 107 determines whether or not there is a next moving image file on the recording medium 110. If there is still a moving image file, the control unit 107 returns to S301 (S605). When the confirmation of the marker information and the processing of the frame corresponding to the marker information are completed for all the moving image files, it is determined whether or not there is an instruction to edit the displayed still image from the operation unit 108 (S606). Here, the contents of the editing process include, for example, processes such as trimming, rotation, rating addition, and protection addition.

  After the editing process, the control unit 107 determines whether or not there is an instruction to newly save the edited still image from the operation unit 108 (S607). When there is an instruction to newly save, the control unit 107 copies the marker information stored in the memory 103 in the memory 103, and updates the copied marker information according to the designated editing content. New marker information is generated. At this time, the frame number indicated by the newly generated marker information is the same as the frame number of the original marker information. Then, the newly generated marker information is added to the moving image data and recorded on the recording medium 110 separately from the original marker information before being updated (S608).

  For example, when a trimming process is performed on a frame corresponding to the marker information in FIG. 7A and a new storage instruction is given, the original marker information is copied to update the trimming position, and a new FIG. c) Marker information is generated and recorded. Further, as shown in FIG. 7B, the original marker information in FIG. 7A is stored as it is.

  On the other hand, when there is no instruction for new saving, the control unit 107 updates the corresponding marker information in accordance with the designated editing content (S609). Then, the updated marker information is read from the memory 103 and recorded on the recording medium 110. Next, the control unit 107 determines whether or not there is an instruction to change from the playback mode to another mode (S610), and when there is an instruction to change to another mode, the process ends.

  As described above, when there is an instruction to newly save after editing, marker information updated according to the editing content is newly generated, added to the moving image file, and recorded. In the cutout mode, in addition to the still image based on the original marker information, a still image based on the marker information recorded by the new storage instruction is cut out and generated from the moving image data.

  As described above, according to the second embodiment, even when a marker is added and an image is not yet cut out, the image can be edited and newly saved.

Claims (5)

Imaging means;
Recording means for recording the moving image data obtained by the imaging means on a recording medium;
An operation means for receiving an instruction from the user;
Generating means for generating marker information relating to a frame corresponding to the addition instruction in the moving image data being recorded in response to an instruction to add a marker from the operation means during recording of the moving image data;
Image processing means;
After stopping the recording of the moving image data, the image processing means is controlled to generate still image data from a frame corresponding to the marker information in the moving image data recorded on the recording medium based on the marker information. And control means for controlling the recording means so as to record the still image data generated by the image processing means on the recording medium,
The control means, when generating an edit instruction for a still image of a frame corresponding to the marker information before generating the still image data by the image processing means, according to the content of editing by the edit instruction Updating the marker information, and controlling the image processing means so as to generate the still image data subjected to the processing corresponding to the content of the editing by the editing instruction based on the updated marker information. An imaging device.   The imaging apparatus according to claim 1, wherein the control unit controls the recording unit to record the still image data generated based on the marker information on the recording medium. The recording means adds the marker information generated by the generating means to the moving image data and records it on the recording medium,
The imaging apparatus according to claim 2, wherein the control unit updates the marker information recorded on the recording medium when there is an editing instruction for a still image of a frame corresponding to the marker information. .   The control means controls the image processing means to generate still image data corresponding to the marker information in response to an instruction to cut out a still image from the operation means after the recording of the moving image data is stopped. The imaging apparatus according to claim 1, wherein the imaging apparatus is controlled. The recording means adds the marker information generated by the generating means to the moving image data and records it on the recording medium,
When the control unit is instructed to newly save a still image after editing with respect to a still image of a frame corresponding to the marker information, the control unit newly updates the marker information according to the content of editing by the editing instruction. The imaging apparatus according to claim 1, wherein marker information is generated, and the newly generated marker information is recorded on the recording medium separately from the marker information before being updated.

Images