JP2013162190A - High dynamic range moving image photographing auxiliary device - Google Patents

Abstract

Provided is a function for confirming a preview image of a high dynamic range composition result before starting shooting in a situation where a high dynamic range video is created from videos shot using a plurality of digital cameras. To provide a function to automatically determine the high dynamic range setting for digital cameras.
In a situation where a computer and a plurality of digital cameras are connected and a material image for creating a high dynamic range image or a moving image is taken, a live view image obtained from each digital camera is synthesized with a high dynamic range. When the photographer determines the exposure range, exposure compensation setting, etc., by displaying the preview, it is easier to set the high dynamic range for multiple digital cameras at once. The material image can be taken.
[Selection] Figure 1

Description

  The present invention relates to a device for remotely controlling a plurality of cameras and assisting simultaneous setting and display on the plurality of cameras, particularly when shooting a material moving image necessary for a high dynamic range moving image.

  Conventionally, when creating a high dynamic range video, multiple digital cameras were used to simultaneously shoot the video with different exposure settings, and the frames of the videos from the multiple cameras that were shot were combined to create a high dynamic range video. Create During the shooting preparation process, the exposure setting of multiple digital cameras may be set to appropriate, under or over, and still images may be shot, and shooting may be performed while predicting the final video by high dynamic range composition. .

  Connect the computer and digital camera via USB or wirelessly, magnify the live view displayed on the back LCD screen of the digital camera on the computer display, and shoot using the remote live view shooting method of shooting by remote control There is a case.

  In remote shooting with remote control, multiple digital cameras can also be controlled. The camera starts a still image and video shooting start command to the digital camera and transfers the images and video from the digital camera to the computer. You can check the results taken by the computer.

  Performs remote shooting to control multiple digital cameras of moving images, acquires moving image files acquired from each digital camera, and generates high dynamic range moving images by editing high dynamic range composition from each moving image file To do.

  For example, Patent Document 1 discloses high dynamic range shooting control in a plurality of imaging devices.

Japanese Patent Laid-Open No. 7-131718

  However, when preparing to shoot a high dynamic range movie using the conventional technology disclosed in the above-mentioned patent document, it is necessary for the photographer to determine the exposure for a plurality of digital cameras. The person must determine the exposure state of each camera with each digital camera and determine the exposure while predicting the situation when the high dynamic range moving image is completed.

  In addition, in order to create a high dynamic range movie, it is necessary to perform high dynamic range composition processing for each frame of the same time of video shot from multiple digital cameras, which is very laborious to create. .

  Therefore, the process of synthesizing a high dynamic range movie is a process after the completion of shooting.If high dynamic range synthesis is performed over time and effort, and it is determined that adjustment is insufficient after the result, re-shooting is not performed from the beginning. The work load must be very high.

Therefore, an object of the present invention is to connect a plurality of digital cameras and a computer, acquire a remote live view image of each digital camera, combine a plurality of live view images with a high dynamic range, and complete a high dynamic range video. Reducing the workload of the photographer by displaying a preview,
By providing a set of parameters for high dynamic range operation shooting for multiple digital cameras connected to a computer in a single operation, it is possible to make settings more easily and provide a method for reducing the burden on the photographer. is there.

  In order to achieve the above object, the present invention connects a computer 1 and a plurality of imaging devices (2a, 2b, 2c), displays a screen for displaying information relating to remote imaging, and each of the plurality of imaging devices. A live view display screen (301, 302, 303), and a screen (311) for displaying a result of high dynamic range composition of live view images obtained from a plurality of imaging devices.

    According to the present invention, when shooting a material video for creating a high dynamic range video, a completed preview of the high dynamic range video can be confirmed before shooting, and a plurality of digital cameras connected to a computer can be confirmed. On the other hand, it is possible to provide a method capable of easily setting for shooting a material video for a high dynamic range video.

1 is a system configuration diagram showing an embodiment of a digital camera according to the present invention. 1 is a block diagram illustrating a configuration of a digital camera according to the present invention. a) A view showing a live view display of a plurality of digital cameras, a preview display of a high dynamic range, an image shift amount display, and a focus control mode. b) It is a figure which shows the synthetic | combination ratio at the time of high dynamic range preview image generation. It is a figure which shows the screen for a high dynamic range setting. It is a flowchart which shows the control procedure of the control method of the digital camera which concerns on this invention.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a system configuration diagram according to an embodiment of the present invention.

  Example 1 showing the embodiment of the present invention will be described below.

  FIG. 1 shows a schematic diagram of a plurality of digital cameras 2 a to 2 c connected to a computer 1 via a network 3.

  In FIG. 1, cameras 2 a to 2 c are digital cameras, digital video cameras, or the like having a function capable of communicating via a network 3. In the present embodiment, there are three units, but the number is not limited to this, and two or more units may be used.

  The network 3 is a general purpose network such as a local area network (LAN) or a dedicated line, and is a communication line that can be used for communication purposes.

  The display device 5 is a display device having a CRT, an LCD, or the like, and may be realized by a computer display capable of communicating image data captured by the cameras 2 a to 2 c through the network 3.

  The input operation device 4 is a device for a photographer to operate the computer 1 and the display device 5, and may be realized by a keyboard, buttons, a mouse, a remote controller, or the like. It may be realized as an integral unit. The input operation device 4 may be realized by a computer keyboard.

  The computer 1 and the digital cameras 2a to 2c may be communicably connected via the network 3, and the computer 1, the display device 5, and the input device 4 may be connected. The computer 1, the digital cameras 2 a to 2 c, the display device 5, and the input operation device 4 may be communicably connected via the network 3.

  Note that the method of the operation signal output from the input operation device 4 to the camera control device 1 or the display device 5 may be any of a wired communication method, a wireless communication method, and an optical communication method, and is not limited.

  Next, FIG. 2 shows an internal configuration of the digital camera 2.

  The image sensor 23 is a sensor such as a CCD or a CMOS, and the light imaged on the image sensor 23 is converted into an amount of electric charge corresponding to the amount of incident light in each pixel in the image sensor 23.

  The signal generated by the timing generator 32 drives the image sensor 23, transmits the charge accumulated in the sensor, and is sequentially converted into a voltage signal.

  The converted voltage signal is sampled by a correlated double sampling 30 (hereinafter referred to as CDS) and converted to a digital signal by an A / D converter 31.

  The image data converted into the digital signal is input to the IC 33, first enters the WB circuit 33 a for calculating data for white balance with respect to the data, and is temporarily stored in the memory 1 of 35.

  The data stored in the memory 1 of 35 is input again to the IC 33 and subjected to three image processes.

  First, image data converted into a digital signal is converted into lossless compressed RAW data in a lossless compression circuit 33d that performs lossless compression (reversible compression) as it is, and sent to the CPU bus 34.

  In addition, the image data converted into digital signals is downsampled by reducing the bandwidth by averaging the RAW data within the block or applying a low-pass filter as shown in Fig. 7, for example, and the original image size is reduced. In order to be converted into a smaller thumbnail image, the RAW thumbnail circuit 33 c performs thinning processing and sends it to the CPU bus 34.

  Finally, in order to create an image for jpeg compression, image processing is performed in the image processing circuit 33b, and YcbCr output as a result is raster-block converted, and jpeg compression is performed in the jpeg compression circuit 33e. It is sent to the CPU bus 34.

  Immediately after the power is turned on, the CPU 36 initializes the digital camera 2 and starts communication with the interchangeable lens according to the program in the memory 2 of 37.

  In addition, the CPU stores the image data output to the CPU bus 34 as the captured image data once in the memory 1 of 35 and finally writes it in the external memory 39 via the interface circuit 38.

  A switch 40 connected to the CPU 36 is a release switch. When the switch 40 is pressed, the above-described photographing operation is performed, and an image is written in the external memory 39.

  At the time of live view display, image data formed and photographed on the image sensor 23 is stored in the memory 2 of 37, and live view display is performed on the rear display installed in the digital camera 2. Live view display updates the captured images at regular intervals, replacing the confirmation of the subject to be photographed through the optical viewfinder.

  Next, a high dynamic range preview display and digital camera control method in a plurality of digital cameras 2a to 2c connected to the computer 1 via the external interface 3 of the digital camera will be described.

The connection form of the external interface of the digital cameras 2a to 2c and the network 3 of the computer 1 may be anything as long as it can exchange data, such as USB or wireless connection. In this embodiment, the remote live view display image and the high dynamic range The preview display is displayed on the display device 5 connected to the computer 1.

  FIG. 3 a shows an operation / display panel 310 that displays a remote live view on the display device 5 connected to the computer 1. A plurality of digital cameras 2 a to 2 c connected to the computer 1 start a live view, a live view image is sent from the digital camera to the computer 1, and a live view is displayed on a live view display screen 311 installed on the operation / display panel 310. Display is made (remote live view shooting method).

  In this embodiment, the operation / display panel 310 shows a display form when three digital cameras are connected to the computer 1 via the network 3. Depending on the number of digital cameras connected to the computer 1 via the network 3, live view screens corresponding to the number of connected devices are displayed on the operation / display panel of the operation / display panel 301.

  The photographer can determine a digital camera as a master among the plurality of digital cameras 2a to 2c, and the live view screen 302 of the digital camera as the master displays a frame line thicker than other live view screens. It is displayed separately from the digital camera. Digital cameras other than the master are slaves, and are displayed separately from the live view screen of the master digital camera.

  The display member 315 of the operation / display panel 310 detects the attention point of the digital camera as the master, and calculates the shift amount by comparing with the attention point of the image of the digital camera as the slave. The calculated result is displayed on the display member 315.

  Reference numeral 311 denotes a preview screen obtained by synthesizing live view images of a plurality of digital cameras 2a to 2c with a high dynamic range.

  In this embodiment, when three digital cameras are connected to the computer 1 via the network 3, the live view image has a low luminance range, a medium luminance range, and a high luminance range in the range from 0 to the maximum luminance. The three digital cameras are divided into three ranges, each of which has a digital camera No. 1 (No. 1 camera) for low-luminance range shooting, a digital camera No. 2 (No. 2 camera) for medium-luminance range shooting, and a high-luminance range shooting. As a digital camera No. 3 (No. 3 camera), a live view image is synthesized with a high dynamic range and a preview image is displayed. The ratio of the luminance range in each digital camera can be changed by the photographer.

  FIG. 3B is a graph showing the composition ratio of the live view images of the respective digital cameras when generating the high dynamic range composition preview image displayed on the high dynamic range preview screen 316 on the operation / display panel 301. . FIG. 3b shows an example in which the exposure range to be photographed is set to ± 3 EV. The horizontal method represents luminance, the vertical direction represents gain, and the a line in the graph of FIG. 3b represents the exposure of the first camera with the exposure correction amount set to +3 EV. The composition ratio is represented, the b line represents the composition ratio of the second camera set to the appropriate exposure, and the c line represents the composition ratio of the third camera with the exposure correction amount set to -3EV. In the present embodiment, an example of high dynamic range composition as shown in the graph is shown, but the high dynamic range composition method may use another technique such as a composition method that makes a more pictorial picture.

  In addition, an autofocus operation member 312 for performing autofocus of the digital camera by remote operation is provided, and an autofocus ON button, which is provided on the operation member 312, is operated to perform autofocus, and an autofocus OFF button Operate to interrupt auto focus. A manual focus operation member 314 having an operation button 313 for sending a plurality of focus pulse amounts to the camera is installed in order for the photographer to manually perform focus feed in the infinite direction and the closest direction. When performing autofocus, an autofocus command is issued simultaneously to a plurality of digital cameras 2 a to 2 c connected to the computer 1 via the network 3. During auto-focusing, a change in field angle and blurring occur in the live view image, so the state is determined and the high dynamic range preview screen 311 and the image shift amount display member 315 are not updated. Further, as a condition for not updating the display, it is also effective in a setting state such as manual focus or click white balance setting.

  Note that the setting of high dynamic range composition activates the high dynamic range setting dialog 410 shown in FIG. 4 when the photographer operates the high dynamic range setting button 316.

  A process for making a setting for creating a high dynamic range moving image for a plurality of digital cameras connected to the computer 1 via the network 3 is performed on the high dynamic range setting screen 410 shown in FIG. Performed by the photographer.

  Each set value for the high dynamic range determined by the photographer is automatically determined based on the number of digital cameras connected to the computer 1 and the range of the set values, and the exposure amount is set for a plurality of cameras. Made.

  The setting items on the high dynamic range setting screen 410 include an exposure range setting member 411, an exposure correction amount setting member 412, a light / dark priority setting member 415, an OK button 417 for determining the setting, and a CANCEL button 418 for canceling the setting. The

  In the exposure range setting member 411, the photographer operates the set amount operation member (slider) 412 to set the exposure range from proper exposure to under / over in the high dynamic range shooting. For example, in a situation where three digital cameras are connected to the computer 1 via the network 3, if the exposure range is determined to be +3 EV, the first digital camera is changed from the appropriate exposure amount to the exposure correction amount +3 EV. And the exposure correction amount is set to −3 EV from the appropriate exposure of the third digital camera, and each digital camera is set from the computer 1 via the network 3.

  In the exposure correction amount setting member 413, the photographer operates the setting amount operation member (slider) 414 to set the exposure correction amount in high dynamic range shooting. For example, in a situation where three digital cameras are connected to the computer 1 via the network 3, when the exposure range of the high dynamic range setting is set to +3 EV and the exposure correction amount is determined to be -1 EV, From the computer 1, the exposure compensation amount from the appropriate exposure amount to + 2EV, the second digital camera from the proper exposure to exposure compensation amount -1EV, from the appropriate exposure of the third digital camera to -4EV, from the computer 1 Settings are made for each digital camera via the network 3.

  The brightness / darkness priority setting member 415 is used by the photographer to set a priority amount as to whether to give priority to shooting details in a bright luminance area in high dynamic range shooting or to give priority to shooting details in a dark portion. Slider) 416 is set. For example, in a situation where three digital cameras are connected to the computer 1 via the network 3, when the priority of light / dark priority is determined to the 1EV dark part side, the exposure range is set to + 3EV and the appropriate exposure is set. In the high dynamic range setting, the first digital camera is set to +3 EV from the appropriate exposure amount, the second digital camera is set to the proper exposure, the exposure correction amount of the third digital camera is set to -2 EV, and the network from the computer 1 3 is set for each digital camera.

  Note that the setting range of each setting member shown in FIG. 4 of the present embodiment is merely an example, and the range and the exposure increment are not limited, and the exposure correction setting of the digital camera connected to the computer 1 is not limited. In addition, the maximum setting range can be expanded.

  The setting value updated in the high dynamic range setting screen 410 is determined by operating the OK button 417 on the high dynamic range setting screen 410, the setting value updated by operating the CANCEL button 418 is discarded, and the high dynamic range setting dialog is closed. .

  FIG. 5 is a flowchart of the high dynamic range preview display control of the present invention. This program is executed by a computer.

  The plurality of digital cameras 2 a to 2 c are connected to the computer 1 via the interface 3. The computer 1 can communicate with the digital cameras 2 a to 2 c via the network 3 to obtain information inside the digital camera 2.

  In step S101, the digital cameras 2a to 2c and the computer 1 are both turned on and energized to be operable.

  In step S102, the current setting information of the computer 1 is notified from the computer 1 to the digital cameras 2a to 2c, and the digital cameras 2a to 2c receive the setting state of the computer 1.

  In step S <b> 102, the current camera setting information is notified from the digital cameras 2 a to 2 c to the computer 1, and the computer 1 receives the state of the digital camera 2. The setting information received from the digital cameras 2a to 2c in step S102 is information such as an exposure correction amount setting state, white balance setting information, and a live view state.

  The setting information of the digital camera is obtained when the camera state is changed by the photographer, or when the setting of the digital camera 2a to 2c is changed from the computer 1 to the computer from the digital camera 2a to 2c via the network 3, respectively. 1 is notified of the update.

  In step S103, the computer 1 notifies the start of the remote live view to the digital cameras 2a to 2c, the digital cameras 2a to 2c start the live view, and the computer 1 transmits live view images from the digital cameras 2a to 2c at regular intervals. In step 104, the process enters a standby state so that it can be received. If it is determined in step 104 whether or not a live view image has been received and a live view image has been received, the image is displayed on the display device 5 in step 105 for each digital camera on the display / setting panel 310. The live view display on the live view display screen 301 is updated.

  In step S106, it is determined whether or not the computer has received each live view image from a plurality of digital cameras connected to the computer 1 via the network 3. If the answer is affirmative (YES), step S107 is performed. If the answer is negative (NO), the process proceeds to step S110.

  In step S107, live view images acquired from a plurality of digital cameras are synthesized with a high dynamic range at the synthesis ratio shown in FIG. 3b to generate a high dynamic range image, and a high dynamic range image on the display / operation panel 310 is generated. The high dynamic range image displayed on the preview screen 311 is updated.

  In step S108, the live view image (master live view image) of the digital camera determined by the photographer as the master and the photographer as the slave for the plurality of live view images acquired from the digital camera connected to the computer 1 via the network 3. The camera and the determined live view image (slave live view image) are compared, and a difference between the attention point of the master live view image and the attention point of the slave live view image is detected.

  In step S109, the display of the displacement amount detection result is updated, and the process proceeds to step S110.

In step S110, it is determined that the live view end operation on the digital camera 2 side or the photographer has performed the remote live view end operation on the computer 1, and if the answer is affirmative (YES), the process proceeds to step S111. If the answer is no (NO), the process returns to step S104 to determine the acquisition of the live view image.
In step S111, the operation / display panel 301 is closed, the digital cameras 2a to 2b connected to the computer 1 via the network 3 are notified of the end of the live view, and the remote live view is ended. If communication is disconnected in step S112, the power is turned off in step S113 and the process is terminated.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined.

  Also, when a software program that realizes the functions of the above-described embodiments is supplied from a recording medium directly to a system or apparatus having a computer that can execute the program using wired / wireless communication, and the program is executed Are also included in the present invention.

  Accordingly, the program code itself supplied and installed in the computer in order to implement the functional processing of the present invention by the computer also realizes the present invention. That is, the computer program itself for realizing the functional processing of the present invention is also included in the present invention.

  In this case, the program may be in any form as long as it has a program function, such as an object code, a program executed by an interpreter, or script data supplied to the OS.

  The recording medium for supplying the program may be, for example, a magnetic recording medium such as a hard disk or a magnetic tape, an optical / magneto-optical storage medium, or a nonvolatile semiconductor memory.

  As a program supply method, a computer program that forms the present invention is stored in a server on a computer network, and a connected client computer downloads and programs the computer program.

23 Image sensor 33 Image processing IC
37 Memory 38 for storing optical correction data 38 External storage means, Interface 39 for connecting a computer and a digital camera 39 External storage means

Claims (5)

A computer 1 and a plurality of imaging devices (2a, 2b, 2c) are connected, a screen for displaying information related to remote imaging, and a screen for displaying a live view for each of the plurality of imaging devices (301, 302, 303). And a screen (311) for displaying a result of high dynamic range synthesis of live view images obtained from a plurality of imaging devices,
A means (301, 302, 303) for displaying a live view and a means (311) for displaying a result of high dynamic range composition (FIG. 3b) of live view images obtained from a plurality of imaging devices are provided. When the person sets the high dynamic range by one operation, the apparatus has means (FIG. 4) capable of changing the shooting setting in accordance with the setting of the high dynamic range for a plurality of imaging devices. Shooting assistance device.   The photographing auxiliary device according to claim 1, wherein each live view image obtained from a plurality of image pickup devices (2a, 2b, 2c) is combined with a high dynamic range and displayed as a preview (FIG. 5).   For multiple imaging devices (2a, 2b, 2c), the exposure compensation setting amount is automatically calculated and the settings of individual imaging devices can be changed so that images and videos with a high dynamic range can be created after shooting. The photographing assisting device according to claim 1, wherein the photographing assisting device is possible.   Attention is paid to each live view image obtained from the plurality of imaging devices (2a, 2b, 2c), having means (315) for calculating and displaying the deviation amount of the live view images obtained from the plurality of imaging devices. The photographing assisting device according to claim 1, wherein the photographing assisting device has a function of comparing points to calculate and display an image shift amount. It has means (312) for starting and ending autofocus, and means (313) for manually adjusting the focus, and determines the change state of the live view image such as autofocus and automatically changes the display of the high dynamic range preview image. The photographing assisting device according to claim 1, wherein the photographing assisting device has a function to perform the function.