JP2018196070A - Image processing apparatus and program - Google Patents

Abstract

When development parameter setting mode information is a manual mode, development parameter correction is easily performed while maintaining a photographer's setting intention.
Development parameter acquisition means for acquiring development parameters set for each frame of RAW moving image data, setting mode information acquisition means for acquiring setting mode information of development parameters, and correction processing for the development parameters When the setting mode information is the manual mode, the correction unit executes the correction process only for the frame section in which the development parameter continues the same value.
[Selection] Figure 1

Description

  The present invention relates to an image processing apparatus and program, and in particular, when development parameter setting mode information is a manual mode, develops a RAW moving image to which correction processing is applied only in a frame section in which the development parameter continues the same value. The present invention relates to an image processing apparatus and a program.

  In recent years, image processing apparatuses have been continuously improved in performance with the development of electronic technology and computer technology. In particular, against the background of the performance improvement of personal computers, the performance improvement of image processing software utilizing the performance has been remarkable, and various image processing proposals have been made. The improvement in performance of the imaging and recording apparatus so-called digital camera is also remarkable. In particular, the amount of information that can be recorded per unit time is increasing.

  In recent years, when taking a picture with a digital camera, the signal of the image sensor (sensor) is recorded as it is as a RAW image, and development processing is performed on the RAW image by applying development parameters in a post-process after shooting. Many proposals for obtaining images for viewing have been made.

  Since RAW image data records the sensor signal as it is, the data capacity may be relatively large. In some cases, the amount of data processing when performing development processing in a later process is relatively large. For this reason, the proposal for recording as a RAW image is widespread particularly with respect to still images. On the other hand, with the improvement in performance of personal computers, image processing software, and digital cameras, there have recently been widespread proposals for recording moving images as RAW images.

  Shooting and editing using RAW moving images have been widely used for so-called production-related applications such as movies and commercial messages (CMs). In the future, with further improvements in performance and cost reduction of necessary equipment such as personal computers, image processing software, and digital cameras, shooting and editing using RAW moving images will also be widespread for so-called news media applications such as news gathering. It is expected to be.

  There is a demand for news-related applications, in particular, that a single event can be taken quickly and without failure, and a viewing image can be provided to the viewer quickly. Therefore, when shooting moving images, there are cases where a plurality of subjects are sequentially shot while continuing to shoot a series of moving images so as not to miss a shooting opportunity.

  At that time, when the development parameter is automatically set in accordance with the change of the subject, the automatic setting value may cause a follow-up delay. In that case, the proposal which correct | amends so that tracking delay may be eliminated is made (patent document 1).

Japanese Patent No. 5988759

  However, the above conventional example has the following problems.

  When the development parameters are set manually, so-called manual, it may be difficult to easily perform development parameter correction that sufficiently reflects the setting intention of the photographer.

  Automatic setting of development parameters is convenient for inexperienced photographers. On the other hand, in the case of a photographer who is accustomed, it may be more convenient for the photographer to manually set the development parameters at the time of photographing. In this case, the photographer changes the setting of the development parameter appropriately by manual operation according to the change state of the subject and the video expression intended by the photographer while continuing to capture a series of moving images. The development parameter settings that have been manually changed during shooting reflect the photographer's intention regarding video expression.

  The present invention has been made in view of the above points. Even when the development parameters are set manually, the object is to easily perform development parameter correction that sufficiently reflects the setting intention.

In order to achieve the above object, the first invention according to the present application is:
Development parameter acquisition means for acquiring development parameters for development set for each frame of RAW moving image data, setting mode information acquisition means for acquiring setting mode information of the development parameters, and correction for the development parameters Correction means for performing processing, and when the setting mode information is a manual mode, the correction means executes the correction processing only for a frame section in which development parameters continue to have the same value. When is in the auto mode, the correction process is executed for all the frame sections.

  A second invention according to the present application is a development parameter acquisition step for acquiring development parameters for development set for each frame of RAW moving image data, and setting mode information acquisition for acquiring setting mode information of the development parameters. And a correction step for performing correction processing on the development parameter, and the correction step is performed only for a frame section in which the development parameter continues the same value when the setting mode information is a manual mode. A correction process is executed. When the setting mode information is an auto mode, the correction process is executed for all frame sections.

  According to the present invention, even when the development parameters are set manually, so-called manual, it is possible to easily perform development parameter correction that sufficiently reflects the setting intention. In particular, as described above, it is possible to perform correction only for a certain setting intention by executing the correction process only for the frame section in which the development parameters continue to have the same value. For example, it is possible to make a simple correction while reflecting the intention only for a certain subject and the development parameter reflecting the intention of the video expression for the particular subject.

It is a hardware block diagram of the image processing apparatus in 1st Embodiment. 1 is a system configuration diagram of an image processing apparatus according to a first embodiment. It is a figure explaining the user interface screen of the image processing apparatus in 1st Embodiment. It is a figure explaining the structure of the moving image clip in 1st Embodiment. It is a figure explaining the file structure of the image data file in 1st Embodiment. It is a figure explaining the time change of the development parameter in a 1st embodiment. 6 is a flowchart illustrating a procedure for developing parameter correction in the first embodiment. It is a figure explaining the correction process of the development parameter in 1st Embodiment. It is a figure explaining the user interface screen of the image processing apparatus in 2nd Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<First Embodiment>
FIG. 1 is a hardware configuration diagram showing a configuration of an image processing apparatus 100 according to the first embodiment of the present invention.

  The system control microcomputer 101 includes, for example, a CPU (MPU), a memory (DRAM, SRAM), etc., executes various processes (programs) to control each block of the image processing apparatus 100, and data between the blocks. Control transmission and reception. The system control microcomputer 101 controls each block of the image processing apparatus 100 according to an operation signal from the operation unit 102 that receives an operation from the user.

  The operation unit 102 includes a power button, a keyboard, a mouse, a pointing device, a touch panel, and the like. When these keyboard and mouse are operated by the user, an operation signal is transmitted to the system control microcomputer 101.

  The bus 103 is a general-purpose bus for sending various data, control signals, instruction signals, and the like to each block of the image processing apparatus 100.

  The memory 104 is, for example, a RAM (Random Access Memory) or a flash memory, and includes both a volatile memory and a nonvolatile memory that temporarily store image signals and audio signals, setting information of the image processing apparatus 100, and the like.

  The recording medium 105 is a recording medium built in the image processing apparatus 100. The recording medium 105 can record various data handled by the image processing apparatus. Examples of the recording medium 105 include a hard disk, SSD, optical disk, flash memory, and the like. In the present embodiment, a hard disk device will be described as an example.

  The external recording medium connection unit 106 is a connection unit for connecting an external recording medium to the image processing apparatus 100. The external recording medium can record various data handled by the image processing apparatus. Examples of the external recording medium include a hard disk, SSD, optical disk, flash memory, and the like. In the present embodiment, a flash memory device that can be mounted on the image processing apparatus 100 called a so-called memory card will be described as an example of the external recording medium.

  The communication unit 107 is a communication unit for the image processing apparatus 100 to communicate with an external image processing apparatus. Similar to the image processing apparatus 100, the external image processing apparatus can perform image processing. Examples of the external image processing device include a smartphone, a tablet computer, and a personal computer. Furthermore, a digital video camera, a digital still camera, etc. including an imaging unit and an image recording unit are also included. In this embodiment, a digital video camera will be described as an example.

  The display unit 108 is built in the image processing apparatus 100. It displays image data recorded on an external recording medium connected via the recording medium 105 or the external recording medium connection unit 106, and GUIs such as various menus. As the display unit 108, for example, a liquid crystal display, an organic EL display, or the like can be used.

  The audio output unit 109 is built in the image processing apparatus 100. For example, it includes a speaker and its drive unit, and outputs sound based on the sound signal recorded on the recording medium 105 or an external recording medium.

  The video external output unit 110 is an output unit for connecting an external video display device to the image processing device 100. Image data recorded on an external recording medium connected via the recording medium 105 or the external recording medium connection unit 106 and GUIs such as various menus are displayed on the external video display device. Examples of the external video display device include a television and a monitor. In the present embodiment, a monitor will be described as an example.

  The audio external output unit 111 is an output unit for connecting an external audio output device to the image processing apparatus 100. Sound is output based on the sound signal recorded on the recording medium 105 or an external recording medium. Examples of the external audio output device include speakers and headphones. In this embodiment, a speaker will be described as an example.

  FIG. 2 is a system configuration diagram showing an example in which the image processing apparatus 100 is used in combination with a digital video camera according to the first embodiment of the present invention.

  FIG. 2A is a system configuration diagram illustrating an example in which the image processing apparatus 100 is used in combination with a digital video camera via a memory card.

  The digital video camera 201 uses an imaging unit including a lens 202 to convert light collected through the lens 202 into an electrical signal using a photoelectric conversion element, and further performs signal processing to generate image data. The auto manual mode changeover switch 203 is a switch for setting the development parameter to either the full auto mode or the manual mode. The gain changeover switch 211 is a switch for changing an amplification factor when an image signal amplification process is performed in a signal processing unit (not shown) that performs signal processing. The gain changeover switch 211 can be switched in three stages of H, M, and L. Each stage has a different amplification factor. When the gain changeover switch 211 is set to H, the gain is set to 12 dB. When the gain changeover switch 211 is set to M, the amplification factor is set to 6 dB. When the gain changeover switch 211 is set to L, the amplification factor is set to 0 dB.

  The card slot 204 is detachable from the memory card 205. When recording image data obtained as a result of imaging with the digital video camera 201, the image data is recorded on the memory card 205 by attaching the memory card 205 to the card slot 204. Further, when it is desired to use the image data in another apparatus, for example, the image processing apparatus 100, the memory card 205 on which the image data has been recorded is removed from the card slot 204.

  Similar to the digital video camera 201, the image processing apparatus 100 includes a card slot 206, and a memory card 205 can be attached and detached. The card slot 206 is a part of the external recording medium connection unit 106. As a result, the memory card 205 that has been imaged by the digital video camera 201 and recorded image data can be inserted into the card slot 206 of the image processing apparatus 100. Thereby, the image data created by the digital video camera 201 can be used by the image processing apparatus 100.

  The image processing apparatus 100 also includes a keyboard 208 and a track pad 207 as part of the operation unit 102. The keyboard 208 can input characters and symbols. The track pad 207 can be used as a pointing device like a mouse or the like. The panel 209 is a part of the display unit 108 and displays image data recorded on an external recording medium connected via the recording medium 105 or the external recording medium connection unit 106 and GUIs such as various menus.

  As described above, the image data generated by the digital video camera 201 can be used by the image processing apparatus 100 via the memory card 205.

  In addition to using the memory card 205 in order to use the image data generated by the digital video camera 201 in the image processing apparatus 100, there is another method.

  FIG. 2B is a system configuration diagram illustrating an example in which the image processing apparatus 100 is used in combination with a digital video camera via a communication cable. The difference from FIG. 2A is that the image processing apparatus 100 acquires image data via the communication cable 210 instead of the memory card.

  The communication cable 210 is connected to the communication unit 107 of the image processing apparatus 100. In the present embodiment, a USB standard will be described as an example of a communication standard when the digital video camera 201 communicates with the image processing apparatus 100 via the communication cable 201. When the communication unit 108 of the image processing apparatus 100 is connected via the communication cable 210, the digital video camera 201 enters a mass storage class operation state. As a result, the image processing apparatus 100 can use the image data recorded on the memory card 205 that is mounted in the card slot 204 of the digital video camera 201. For example, the image data recorded on the memory card 205 mounted in the card slot 204 of the digital video camera 201 can be copied to the recording medium 105 of the image processing apparatus 100.

  FIG. 3 is an interface screen displayed on the panel 209 of the image processing apparatus 100 according to the first embodiment of the present invention.

  The interface screen 301 is displayed on the entire screen of the panel 209. When the panel 209 can display a plurality of windows, the interface screen 301 may be displayed as one of the windows.

  A menu 302 is a menu for selecting and executing a function executable by the image processing apparatus. When the menu 302 is selected on the track pad 207, the details of the menu are displayed as a so-called pull-down menu. Furthermore, a desired function can be executed by selecting a menu to be executed from the detailed menu. As menu items, as a large item, a file menu related to file operations, an edit menu related to editing operations, a display menu related to display operations, a tool menu related to settings, etc., and an instruction manual are displayed. There is a help menu.

  The media list 311 is a list showing a list of media recognized by the image processing apparatus 100. Recognized media types include media 312 and virtual media 314. The medium 312 is displayed when the installation of the memory card 205 is recognized in the card slot 206 of the image processing apparatus 100. The medium 312 is displayed when the installation of the memory card 205 connected to the card slot 204 of the digital video camera 201 connected in the mass storage class operation state is recognized via the communication 210. It may also be displayed when the external recording medium is recognized by other means. The virtual media 314 is used when the image processing apparatus 100 regards a folder of a specific hierarchy as a virtual medium when various types of data are recorded in the recording medium 105 of the image processing apparatus 100 in a hierarchical structure. Is. A media name 313 can also be displayed on the media 312. Although only one medium 312 is displayed in FIG. 3, when the image processing apparatus 100 recognizes a plurality of media 312, a plurality of media 312 can be displayed. At this time, the plurality of media 312 can be identified by setting different names in the media names 313 corresponding to the respective media.

  In addition, the virtual media name 314 can be displayed together with the virtual media 314. Although only one virtual medium 314 is displayed in FIG. 3, when the image processing apparatus 100 recognizes a plurality of virtual media 314, a plurality of virtual media 314 can be displayed. At that time, the plurality of virtual media 314 can be identified by setting different names for the virtual media names 313 corresponding to the respective virtual media. The media selection frame 316 shows the selected media 312 or virtual media 314. It is also possible to select multiple media 312 or virtual media 314. The media selection frame 316 can be operated with the track pad 207 or the keyboard 208. When operating with the keyboard 208, the position of the media selection frame 316 is changed by operating an arrow key included in the keyboard 208. For example, in FIG. 3, by operating the up arrow key while the virtual media 314 is selected, the media list 311 can be changed to a state in which the media 312 that is one up is selected.

  The virtual media creation button 317 is a button for creating the virtual media 314. By pressing a virtual media creation button 317, a virtual media 314 is created under a folder of a preset hierarchy of the recording medium 105. At that time, the virtual media name 315 can be set in a subwindow display (not shown).

  The virtual media delete button 318 is a button for deleting the virtual media 314. When the virtual media deletion button 318 is pressed while the virtual media 314 is selected in the media selection frame 316, the selected virtual media 314 is deleted.

  The backup button 319 executes image data backup based on a user operation. When the backup button 319 is pressed while the medium 312 is selected in the medium selection frame 316, the following operation is performed. First, a new virtual medium 314 is created. Next, the image data recorded on the medium 312 is copied to the newly created virtual medium 314. The backup button 319 can create a virtual medium, copy image data, and perform backup that requires the above two operations with one operation of pressing the backup button 319. Thereby, the user's work is made efficient and the convenience is improved.

  The auto backup operation mode display unit 320 is a display area for displaying the state of the auto backup operation mode. Auto-backup is a function that executes the same function as when the backup button 319 is pressed without pressing the backup button 319 when the connection of the medium 312 is recognized.

  Depending on the usage situation of the user, there are cases where auto-backup is desired and not desired. The case where it is desired to use the auto backup is, for example, a case where it is desired to efficiently perform a backup operation on the image data shot by the digital video camera 201 and recorded on the memory card 205. “Efficient” means that the operation procedure executed by the user is simplified. Specifically, it indicates that the pressing operation of the backup button 319 can be omitted. Especially for business use, it is a cooperative work by a plurality of workers, and inexperienced workers often participate. In particular, in the case of business use, work failure is directly linked to monetary loss, so work failure may be treated as the most avoidable thing. In such a case, even if it is a single effort to press a button, the operator can benefit from avoiding work failures by simplifying the operation procedure. Furthermore, in the case of business use in particular, a cameraman who operates the camera, a backup worker in charge of data backup, an editor who uses the data after backup for editing, etc. form a team and work together. Among them, there are cases where a flow of a plurality of operations performed in cooperation by a plurality of members is performed as a so-called routine operation. When such a routine work is repeated, the operator can benefit from avoiding a work failure by simplifying the operation procedure, even though it is a simple operation of pressing a button.

  On the other hand, you may not want to use auto backup. This is the case when the above routine operation is completed and it is simply desired to confirm the contents of the image data recorded on the memory card 205. In such a case, the auto backup function can be stopped. A sub dialog (not shown) is displayed on the menu 302, and the image processing apparatus 100 is set on the sub dialog. In such a manner, the auto backup function can be stopped by setting the auto backup function to non-execution.

  The clip list list 331 is a list that displays a list of image data recorded in the media 312 or virtual media 314 selected in the media list list 311. Here, the image data is referred to as a clip. The thumbnail image 332 is a representative image for one clip. Similarly, the thumbnail image 333 and the thumbnail image 334 are representative images for one clip. That is, FIG. 3 shows that three clips are displayed in the clip list list. At the same time, it indicates that three clips are recorded in the media 312 or the virtual media 314 selected in the media list 311.

  The clip list list 331 also displays a clip name and metadata information corresponding to each clip. The clip name 335 displays the clip name of the clip corresponding to the thumbnail image 332. The clip name 335 may display metadata recorded in association with the clip name. Similarly, the clip name 336 displays the clip name and metadata corresponding to the thumbnail image 333, and the clip name 337 displays the clip name and metadata corresponding to the thumbnail image 334.

  The icon 338 is an icon display of metadata attached to the clip specified by the thumbnail image 332. Similarly, the icons 339 and 340 are icons that display metadata associated with clips specified by the thumbnail image 333 and the thumbnail image 334, respectively.

  The clip selection frame 341 is a selection frame indicating which clip has been selected for one or more clips displayed in the clip list list 331. FIG. 3 shows that the clip specified by the thumbnail image 334, the clip name 337, and the icon 340 is selected.

  When the clip list thumbnail large mode display button 342 is pressed, the clip list list 331 is displayed in the thumbnail large mode. The large thumbnail mode is a mode for displaying a larger thumbnail image than the small thumbnail mode. By pressing the clip list thumbnail small mode display button 343, the clip list list 331 is displayed in the thumbnail small mode. FIG. 3 shows a state in which the thumbnail small mode is displayed. By pressing a thumbnail mode display button with clip list information 344, the clip list list 331 is displayed in thumbnail mode with information. The thumbnail mode with information is a mode in which metadata display items are increased as compared with the large thumbnail mode and the small thumbnail mode. By pressing a clip list detailed display mode display button 345, the clip list list 331 is displayed in the detailed display mode. The detailed display mode is a mode in which thumbnail images are not displayed and clip names and metadata are displayed as a list.

  A simple search item setting unit 346, a simple search condition setting unit 347, an all search button 348, a narrow search button 349, and an all display button 350 are a setting unit and buttons related to the simple search function. The simple search is a function for displaying only clips matching the search condition in the clip list list by setting the search condition for the clip displayed in the clip list list 331 and executing the search. It is.

  The simple search item setting unit 346 sets items as search conditions for simple search. Specifically, the metadata item to be used as a search key among the metadata items recorded in association with the clip is set. For example, clip name, shooting date / time, status (OK mark, etc.), clip title (arbitrary character string), photographer (arbitrary character string), shooting location (arbitrary character string), photographing content (arbitrary character string) Etc. can be set.

  The simple search condition setting unit 347 is a setting unit that further sets the number of metadata values as search conditions according to the metadata item selected and set by the simple search item setting unit 346. Specifically, when the simple search item setting unit 346 selects a clip name, clip title, photographer, shooting location, and shooting content, an arbitrary character string can be set as a search condition. For example, in the clip list 331, it is assumed that there are three clips “AA0001”, “AB0001”, and “AC0001” as clip names. When the clip name is set by the simple search item setting unit 346, the character string “AA” is set by the simple search condition setting unit 347, so that only the clip “AA0001” is clipped as a result of executing the simple search. Display in the list.

  The all search button 348 is a button for executing a search from a state where the simple search is not performed. That is, even when the clip list list 331 is displayed in a state where the simple search has been executed, by pressing the all search button 348, a new search can be executed without reflecting the previous simple search results.

  On the other hand, the search refinement button 349 is a button for further refinement search from the state where the clip list list 331 has been subjected to the simple search and only the clips matching the simple search condition are displayed. For example, it is assumed that the clip names “AA0001”, “AA0002”, and “AB0001” are displayed in the clip list list 331 in a state where the simple search is not performed. Assume that clips with clip names “AA0001” and “AA0002” are displayed as a result of performing a simple search using the clip name as a search item and “AA” as a search condition. From this state, further, “0001” is set as a search condition to perform a narrow search. Then, only the clip name “AA0001” is displayed without displaying the clip name “AB0001”.

  The all display button 350 is a button for canceling the simple search execution result and displaying all the clips recorded in the media 312 or virtual media 314 selected in the media selection list 311 in the clip list list 331. is there.

  The preview image 361 is an area for displaying a playback image of the clip displayed in the clip list list 331. The time code 362 displays a time code corresponding to the frame image displayed in the preview image 361. For example, when the time code is 12 hours 34 minutes 56 seconds 12 frames, “12: 34: 56: 12” is displayed. The duration 363 displays the time length of the clip displayed in the clip list list 331. For example, when the clip length is 1 hour 23 minutes 45 seconds 21 frames, “01: 23: 45: 21” is displayed.

  A slider bar 364 and a slider bar operation unit 365 indicate the current playback position with respect to the clip time length. Specifically, the current clip playback time position is displayed based on the position of the slider bar operation unit 365 with respect to the slider bar 364. Further, the frame image displayed on the preview image 361 can be changed by operating and moving the slider bar operation unit 365 with the track pad 207.

  The play button 366 is a button that performs a toggle operation. By pressing the playback button 366 on the track pad 207, normal playback (normal speed 1x playback) can be performed on the preview image 361. During normal playback, the playback button 366 displays a stop button (not shown), and the playback of the preview image 361 can be stopped by pressing the button again.

  The button for returning one frame 367 changes the playback position of only one frame with respect to the preview image 361 in the playback stop state in the time axis past direction. The button 368 that advances one frame changes the playback position in the time axis future direction for only one frame with respect to the preview image 361 in the playback stop state.

  A start button 369 changes the frame image displayed in the preview image 361 to a frame image corresponding to the start time code. The end button 370 changes the frame image displayed in the preview image 361 to a frame image corresponding to the end time code.

  When a mark list button 381 is pressed, a mark list dialog (not shown) is displayed. In the mark list dialog, one or more shot marks and event marks are displayed in a list. A shot mark is metadata for a frame image corresponding to a specific time code given by a button operation or the like in the digital video camera 201. The event mark is a mark that is automatically given according to the state of the digital video camera 201. For example, when face recognition is performed during shooting by the digital video camera 201, metadata is assigned to the frame image corresponding to the time code at that time.

  A shot mark can be given by the digital video camera 201, and at the same time, a shot mark button 388 can be given to a frame image at the time of pressing.

  The shot mark display 382 indicates the position on the slider bar 364 where the shot mark is recorded. The previous shot mark button 384 changes the frame image to be displayed in the preview image 361 at the position where the shot mark display 382 exists in the time axis past direction from the slider bar operation unit 365. The next shot mark button 385 changes the frame image to be displayed on the preview image 361 at the position when the shot mark display 382 exists in the time axis future direction from the slider bar operation unit 365. In FIG. 3, the preview image 361 is changed from the frame image corresponding to the current position of the slider bar operation unit 365 to the frame image corresponding to the position of the shot mark display 382 by pressing the button 385 to the next shot mark. it can.

  The event mark display 383 indicates the position where the event mark is recorded on the slider bar 364. The previous event mark button 386 changes the frame image displayed on the preview image 361 at the position when the event mark display 383 exists in the time axis past direction from the slider bar operation unit 365. When the event mark display 383 exists in the time axis future direction from the slider bar operation unit 365, the next event mark button 387 changes the frame image displayed on the preview image 361 at that position. In FIG. 3, the preview image 361 is changed from the frame image corresponding to the current position of the slider bar operation unit 365 to the frame image corresponding to the position of the event mark display 383 by pressing the button 387 to the next event mark. it can.

  The audio slider bar 371 and the audio slider bar operation unit 372 are setting units that set the volume of audio to be reproduced by the audio output unit 109 or the audio external output unit 111 of the image processing apparatus 100. By pressing the mute button 373, it is possible to turn off the sound regardless of the position of the sound slider bar operation unit. By pressing the channel 1 button 374, only the channel 1 button can be set to output no sound. By pressing the channel 2 button 375, only the channel 2 button can be set to output no sound.

  By pressing the LUT button 389, a preset LUT (Lookup-Table) can be applied to the gamma characteristic of the display image displayed on the preview image 361. For example, an LUT for converting a Log gamma characteristic to a BT709 gamma characteristic is applied to a clip shot with the Log gamma characteristic. As a result, an image converted into the BT709 gamma characteristic can be displayed on the preview image 361.

  Reference numeral 390 denotes a white balance adjustment slider bar. Reference numeral 391 denotes a white balance adjustment slider bar operation unit. Reference numeral 392 denotes an exposure adjustment slider bar. Reference numeral 393 denotes an exposure adjustment slider bar operation unit.

  FIG. 4 is a diagram for explaining the structure of a moving image clip according to the first embodiment of the present invention.

  Reference numeral 400 denotes the entire moving image clip. The resolution of the moving image clip 400 is, for example, 4096 pixels in the horizontal direction and 2160 pixels in the vertical direction. The frame rate of the moving image data 400 is, for example, 120 fps.

  401, 402, 403, 404, 405, 406, 407, 408, 409, 410, 411, 412, 413, 414, 415, 416, and 417 are image data files each corresponding to one frame of image data. It is shown that.

  The moving image clip 400 can be generated by performing imaging and recording using the digital video camera 201. A series of moving images from the start of recording operation to the end of recording operation by operating the digital video camera 201 is recorded as one moving image clip 400. The moving image clip 400 can be used as a moving image, and a data file corresponding to image data of a specific frame can be taken out and used as a still image. For example, only the image data file 407 can be extracted from the moving image data 400 and used as a still image.

  When one frame of image data is captured and recorded in a data file format that stores data as one data file, it is possible to extract image data of a specific frame by extracting only the specific data file. In this case, it is not necessary to use editing application software, and it can be realized by using only file management software. In that case, the moving image data 400 is a set of 17 image data files.

  FIG. 5 is a diagram for explaining the file structure of an image data file according to the first embodiment of the present invention.

  Reference numeral 501 denotes an image data file. Reference numeral 502 denotes image data. Reference numeral 503 denotes header metadata. The image data file 501 includes image data 502 and header metadata 503.

  Reference numeral 504 denotes development parameter setting mode metadata. Reference numeral 505 denotes development parameter exposure metadata. The header metadata 503 includes development parameter setting mode metadata 504 and development parameter exposure metadata 505.

  The value of the development parameter setting mode metadata 504 records the setting state of the auto manual mode changeover switch 203 when the digital video camera 201 captures and records the image data 502. When the setting state of the auto manual mode changeover switch 203 is “auto”, the value of the development parameter setting mode metadata 504 is “auto”. When the setting state of the auto manual mode changeover switch 203 is “manual”, the value of the development parameter setting mode metadata 504 is “manual”.

  The value of the development parameter exposure metadata 505 records the setting state of the gain changeover switch 211 when the digital video camera 201 captures and records the image data 502. When the setting state of the gain changeover switch 211 is “H”, the value of the development parameter exposure metadata 505 is “H”. When the setting state of the gain changeover switch 211 is “M”, the value of the development parameter exposure metadata 505 is “M”. When the setting state of the gain changeover switch 211 is “L”, the value of the development parameter exposure metadata 505 is “L”.

  FIG. 6 is a diagram illustrating development parameters according to the first embodiment of the present invention.

  Reference numeral 600 denotes the entire graph. This graph 600 shows how the value of the development parameter exposure metadata changes with time in the moving image clip 600. Reference numeral 601 denotes the horizontal axis of the graph 600. The horizontal axis 601 indicates time. Reference numeral 602 denotes a vertical axis of the graph 600. A vertical axis 602 indicates an amplification factor in the amplification process of the video signal performed by the digital video camera 201.

  Reference numeral 603 denotes a time interval A. Reference numeral 604 denotes a time interval B. Reference numeral 605 denotes a time interval C. Reference numeral 606 denotes a development parameter exposure value set in the time interval A603. In this case, “H” is set as the amplification factor. Reference numeral 607 denotes a development parameter exposure value set in the time section B604. In this case, “L” is set as the amplification factor. Reference numeral 608 denotes a development parameter exposure value set in the time interval C605. In this case, “M” is set as the amplification factor.

  FIG. 7 is a flowchart for explaining the development parameter correction procedure executed by the system control microcomputer 114 of the imaging recording / reproducing apparatus 100 according to the first embodiment of the present invention.

  S701 indicates the start of processing. In step S702, the frame being displayed is set as a correction target. The frame being displayed is a preview image 361 that displays a frame image selected from the moving image data 400 according to the operation of the slider bar operation unit 365. In step S703, the development parameter exposure metadata is corrected.

  In S704, the process proceeds by one frame. In S705, it is determined whether a frame exists. If no frame exists, the process proceeds to S709. If a frame exists, the process proceeds to S706. In step S706, the development parameter setting mode metadata is determined. If the development parameter setting mode metadata 504 is auto, the process proceeds to S708. If the development parameter setting mode metadata 504 is manual, the process proceeds to S707. In step S707, the development parameter exposure metadata is determined. In step S <b> 704, it is determined whether the development parameter exposure metadata 505 of the frame selected as a result of proceeding by one frame is the same value as the development parameter exposure metadata 505 of the frame displayed in the preview image 361. If the values are the same, the process proceeds to S708. If they are not the same value, the process proceeds to S709.

  In step S708, the development parameter exposure metadata is corrected. In step S704, correction is performed on the development parameter exposure metadata 505 corresponding to the frame selected as a result of one frame advance.

  In step S709, the currently displayed frame is set as a correction target. The frame being displayed is a preview image 361 that displays a frame image selected from the moving image data 400 according to the operation of the slider bar operation unit 365.

  In S710, the process returns by one frame. In S711, it is determined whether or not a frame exists. If no frame exists, the process proceeds to S715. If a frame exists, the process proceeds to S712. In S712, development parameter setting mode metadata is determined. If the development parameter setting mode metadata 504 is auto, the process proceeds to S714. If the development parameter setting mode metadata 504 is manual, the process proceeds to S713. In step S713, development parameter exposure metadata is determined. It is determined whether or not the development parameter exposure metadata 505 of the frame selected as a result of returning one frame in S710 is the same value as the development parameter exposure metadata 505 of the frame displayed in the preview image 361. If the values are the same, the process proceeds to S714. If they are not the same value, the process proceeds to S715.

  In S714, the development parameter exposure metadata is corrected. In step S710, the development parameter exposure metadata 505 corresponding to the frame selected as a result of returning one frame is corrected.

  S715 indicates the end of the process.

  FIG. 8 is a diagram for explaining development parameter correction according to the first embodiment of the present invention. The contents of the correction process performed in S703, S708, and S714 will be described.

  Only the differences with respect to FIG. 6 will be described. Reference numeral 801 denotes an amplification factor before correction. Since it is before correction, it is shown by a dotted line. Reference numeral 802 denotes a corrected amplification factor. Since it is after correction, it is shown by a solid line. The correction amount is determined according to the operation amount of the exposure adjustment slider bar 393. In this case, according to the operation amount of the exposure adjustment slider bar 393, the amplification factor is determined to be reduced by 6 dB, and correction is performed. In the case of FIG. 6, the development parameters are determined manually. Therefore, as a result of executing the correction process according to the flowchart of FIG. 7, the correction is executed only for the time section B604.

  As described above, according to this embodiment, even when the development parameters are set manually, so-called manual, development parameter correction that sufficiently reflects the setting intention can be easily performed.

  In particular, as described above, it is possible to perform correction only for a certain setting intention by executing the correction process only for the frame section in which the development parameters continue to have the same value. For example, it is possible to make a simple correction while reflecting the intention only for a certain subject and the development parameter reflecting the intention of the video expression for the particular subject.

  Furthermore, since the development parameter information and the development parameter setting mode information are information given manually by the photographer at the time of shooting a moving image, it is possible to further perform a correction process reflecting the intention of the photographer.

  Further, the correction processing is executed only for the frame section including the frame that is being displayed by the image processing apparatus, so that the operator can perform the correction process while checking the frame image included in the frame section to be corrected. It becomes possible to execute. This further improves convenience.

Although the present embodiment is applied to exposure correction, the present embodiment may be applied to development parameters other than exposure. For example, it may be applied to white balance correction.
There is a demand for news-related applications, in particular, that a single event can be taken quickly and without failure, and a viewing image can be provided to the viewer quickly. Among them, there is a request to provide viewers with higher quality viewing images. Especially when shooting in the news media, there is a case where shooting failure may occur because it is necessary to quickly shoot a single event. Shooting failures are, for example, white balance setting mistakes, exposure setting mistakes, and the like. By capturing and recording as a RAW image, it may be possible to more effectively correct such shooting failures in the editing process. As such, RAW images are useful for news-related applications. In the present embodiment, it is proposed to perform the correction more simply. That is, by applying this embodiment, there is an effect of more effectively using the RAW image.

<Second Embodiment>
Hereinafter, the second embodiment will be described only with respect to differences from the first embodiment.

  FIG. 9 is an interface screen displayed on the panel 209 of the image processing apparatus 100 according to the second embodiment of the present invention. Only the differences with respect to FIG. 3 will be described.

  Reference numeral 901 denotes a development parameter graph display unit. The development parameter graph display unit 901 displays changes in development parameter exposure metadata included in the moving image data 400 over time. Specifically, the development parameter exposure metadata value 606 set in the time interval A603, the development parameter exposure metadata value 802 set in the time interval B604, and the time interval C605 described in FIG. The development parameter exposure metadata value 608 that has been set is displayed.

  Since the development parameter exposure metadata value 802 corresponds to the frame displayed in the preview image 361, the graph display is displayed with a thicker line, for example, by changing the display color, or the like. May be taken.

  As described above, according to the present embodiment, with the change in the development parameter with time, the frame section to be corrected becomes easier to understand, particularly when manually set, so the convenience is further improved.

  In the present embodiment, the imaging recording / reproducing apparatus has been described, but it may be implemented as a moving image processing program executed by a personal computer or the like.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined.

100 image processing apparatus, 101 system control microcomputer, 102 operation unit,
103 bus, 104 memory, 105 recording medium, 106 external recording medium connection unit,
107 communication unit, 108 display unit, 109 audio output unit, 110 video external output unit,
111 Audio external output section

Claims (9)

Development parameter acquisition means for acquiring development parameters for development set for each frame of RAW moving image data;
Setting mode information acquisition means for acquiring setting mode information of the development parameters;
Correction means for performing correction processing on the development parameters,
The correction means executes the correction processing only for a frame section in which the development parameter continues the same value when the setting mode information is a manual mode. When the setting mode information is an auto mode, An image processing apparatus that executes the correction processing on a frame section. The image processing apparatus according to claim 1, wherein the development parameter is set by an imaging recording apparatus when the RAW moving image data is captured and recorded. The image processing apparatus according to claim 1, wherein the setting mode information is set by an imaging recording apparatus when the RAW moving image data is captured and recorded. The image processing apparatus includes an image display unit that displays an image of a specific frame, and the correction unit executes the correction process only for a frame section including a frame displayed on the image display unit. The image processing apparatus according to claim 1, wherein: 5. The image processing apparatus according to claim 1, further comprising a development parameter display unit configured to display a graph indicating a time change of the development parameter. The image processing apparatus according to claim 5, wherein the development parameter display unit displays only a frame section in which the correction process is performed in an identifiable manner. The image processing apparatus according to claim 1, wherein the development parameter is a white balance adjustment value. The image processing apparatus according to claim 1, wherein the development parameter is an exposure adjustment value. A development parameter acquisition step of acquiring development parameters for development set for each frame of RAW moving image data;
A setting mode information acquisition step of acquiring setting mode information of the development parameter;
A correction step of performing correction processing on the development parameters,
When the setting mode information is in the manual mode, the correction process executes the correction processing only for a frame section in which the development parameter continues the same value. An image processing program for executing the correction processing on a frame section.