JP2009171362A - Imaging device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a photographing apparatus capable of correcting camera shake using a zoom image and a wide angle image.
An imaging apparatus 10 according to the present invention includes a unit for detecting a specific subject, a first imaging unit 13 that performs zoom imaging of the subject and outputs a first video signal, and a first imaging of the subject. A second photographing unit 11 that captures a wider range than the first unit and outputs a second video signal; and an output unit 1 that clips a specific subject included in the first video signal and outputs a first clipping image.
4, the output unit 12 that clips the specific subject included in the second video signal and outputs the second clipping image, and until the angle of view is the same as that of the first clipping image. A processing unit 15 for zooming the two clipping images, a first clipping image,
A difference between zoomed images is fitted.
[Selection] Figure 2

Description

The present invention relates to a photographing apparatus. The present invention also relates to an imaging device including a plurality of imaging units. The present invention also relates to an imaging apparatus capable of performing camera shake correction using a plurality of videos taken by a plurality of imaging units.

In recent years, photographing apparatuses such as video cameras that can easily photograph a subject have become widespread.
Patent Document 1 discloses a technique related to a video camera in which two types of camera units each having a zoom lens and a wide-angle lens are housed in one camera case. Then, for the purpose of enabling a single video camera to capture the zoomed-up subject image and its peripheral image, a first video camera case 1 having a zoom lens 2a is provided.
The camera unit 2 and the second camera unit 3 including the wide-angle lens 3a are housed, and the zoom image captured by the first camera unit 2 and the wide-angle image captured by the second camera unit 3 are stored in one monitor. A technique for simultaneously displaying images is disclosed. It is also disclosed that a wide-angle image is displayed at one corner of the zoom image.

However, this Patent Document 1 aims to display a wide-angle image at one corner of the zoom image and display the zoom image and the wide-angle image at the same time. However, camera shake correction can be performed using the zoom image and the wide-angle image. The technology to do was not disclosed. For this reason, it cannot be said that the disclosure is sufficient in terms of application to products.
JP 2001-268409 A

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an object thereof is to provide a photographing apparatus that enables camera shake correction using a zoom image and a wide-angle image. In addition, this invention
It is an object of the present invention to provide a photographing apparatus that improves user convenience by enabling camera shake correction.

An imaging apparatus according to the present invention includes a subject detection unit that detects a specific subject, a first imaging unit that performs zoom imaging of the detected subject and outputs a first video signal, and the first imaging unit. And a second imaging unit for imaging the detected subject in a wider range than the first imaging unit and outputting a second video signal; and the output first video signal A first clipping image output unit that outputs the first clipping image by clipping the specific subject included in the second clip, and a second clipping unit that clips the specific subject included in the output second video signal. A second clipping image output unit that outputs a clipping image of the second and a zoom process for zooming the second clipping image until the angle of view is approximately the same as that of the first clipping image Difference detection means for obtaining a difference between the first clipping image and the zoomed second clipping image, fitting the first clipping image and the obtained difference, and the difference is fitted. And fitting means for outputting video data including the image.

The photographing method according to the present invention includes a step of detecting a specific subject, a step of zooming the detected subject and outputting a first video signal, and a step of detecting the detected subject in a wider range than the zoom photographing. And outputting a second video signal, clipping the specific subject included in the output first video signal and outputting a first clipping image, and the output Clipping the specific subject included in the second video signal to output a second clipping image, and until the angle of view is approximately the same as the first clipping image. Zooming a clipping image, and obtaining a difference between the first clipping image and the zoomed second clipping image The was first fitting the determined difference and clipping images, the difference is configured with a step of outputting the image data including the fitted image.

According to the configuration described above, it is possible to provide an imaging device that enables camera shake correction using a zoom image and a wide-angle image. In addition, according to the present invention, it is possible to provide a photographing apparatus with improved user convenience by enabling camera shake correction.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a diagram illustrating a video image in which a subject is removed from a recording screen when zoom shooting is performed using a conventional video camera.
Reference numeral 1 denotes a recorded image recorded on a recording medium. Conventionally, using a video camera, for example, taking a picture while tracing a high-speed moving object with an enlargement zoom depends on the skill of the photographer (user) to take a picture while tracing. There was a problem that the whole could not be recorded and partly protruded. In addition, since the photographer (user) takes a picture, there is a problem that the horizontal position or the like moves up and down, and camera shake is likely to occur.

In general, when zoom shooting is performed, the fluctuation is larger than that during non-zoom shooting. For this reason, there is a problem that a subject intended to be imaged does not fit in the recording area and protrudes even with a small amount of camera shake.

Examples of the technology for correcting camera shake include an electronic camera shake correction and an image sensor in which the image sensor is made larger than the area actually recorded and the recording area is changed to compensate for the camera shake generated during shooting. Various image stabilization techniques, such as an image sensor shift method in which a sensor is applied to the optical axis while correcting the position according to camera shake, or a lens unit swing method in which the lens unit is adjusted to the optical axis while moving, have been proposed. However, even in these techniques, the camera shake correction limit is reached immediately.

FIG. 2 is a block diagram showing the configuration of the photographing apparatus according to the embodiment of the present invention.
Reference numeral 10 denotes an imaging device, reference numeral 11 denotes a second imaging unit, reference numeral 12 denotes a second clipping image output unit, reference numeral 13 denotes a first imaging unit, reference numeral 14 denotes a first clipping image output unit, and reference numeral 15 denotes a zoom. Processing unit, 16 is a fitting processing unit, 17 is a filter processing unit, 18
Is a command input unit (user operation unit), 19 is a central control unit, 20 is a recording control unit, 21 is a recording medium (recording medium), 22 is a display control unit, and 23 is a display device.

The first video input device 13 is video input means for video video shooting equipped with a zoomable lens. Here, the second video input device 11 is video input means for performing wide range shooting without zooming in particular. Position detection clipping unit 1 and position detection clipping unit 2
Detects the subject and performs image clipping (clipping) to create a position where the image does not shake due to camera shake from the balance between the top, bottom, left and right.

The digital zoom processing unit 15 performs digital processing to zoom to the same size as the angle of view displayed on the finder in order to perform the fitting process on the image clipped from the non-enlarged image output from the second image input device 11. Do. The fitting processing unit 16
The optical zooming video obtained from the first video input device 13 and the digital zooming video obtained from the second video input device 11 are combined to output a video for recording and display.

The filter processing unit 17 performs video correction processing such as color correction, which is mounted on the photographing apparatus (video camera) 10.
The central control unit 19 is a main processing device of the photographing apparatus (video camera) 10. Here, the entire photographing apparatus (video camera) 10 is controlled.
The recording control unit 20 performs recording control on a recording medium, reading of data for display, and the like according to instructions from the central control unit 19.
The recording medium 21 receives and records data from the recording control unit 20 and transmits recorded data in response to a request from the recording control unit 20. The command input device 18
It consists of buttons and a touch panel, and commands are input from the user. The display control unit 22 displays display data and video according to an instruction from the central control unit 19.

That is, the imaging device 10 captures an object using both the first imaging unit 13 and the second imaging unit 11, converts it into video data as will be described later, and stores it in the storage medium 21.

The photographing apparatus 10 includes subject detection means (not shown) that detects a specific subject. The subject detection means can employ, for example, a moving object detection using an infrared sensor and an automatic tracking function used in an intrusion detection / tracking system.

Then, the first photographing unit 13 performs zoom photographing on the detected subject and outputs a first video signal. In the embodiment of the present invention, a second photographing unit 11 is further provided, and the detected subject is photographed in a wider range than the first photographing unit 13 and a second video signal is output.

The first clipping image output unit 14 detects the detected subject included in the first video signal (
Clip a specific subject) and output a first clipping image.
The second clipping image output unit 12 clips a specific subject included in the second video signal and outputs a second clipping image.
The zoom processing unit 15 zooms and outputs the second clipping image until the angle of view is approximately the same as the first clipping image.
As will be described later, the central control unit 19 obtains a difference between the first clipping image and the zoomed second clipping image. The fitting processing means 16 fits the obtained difference with the first clipping image, and outputs video data including the image with the fitted difference.

FIG. 3 is a view showing a recorded image of the photographing apparatus according to the embodiment of the present invention.
FIG. 3B is an enlarged image by the first photographing unit (first input means) 13.
As in the conventional video camera system, the enlarged image output from the first photographing unit (first input means) 13 is partially cut off.
FIG. 3A is a non-enlarged image by the second imaging unit (first input means) 11.
In the non-enlarged video obtained from the second imaging unit (first input means) 11, a wide-area video up to the subject and the surrounding video is output.
The first clipping image output unit (position detection clipping unit 1) 14 detects that the subject of the enlarged image is taken in the upper right direction here, and clips the upper right part.

The second clipping image output unit (the position detection clipping unit 2) 12 detects the position of the subject from the non-enlarged video and performs clipping with a size that matches the display angle of view.
The zoom processing unit 15 performs digital zoom processing, and the fitting processing unit 16 performs fitting between the digital zoom image and the optical zoom image, so that an image subjected to the fitting processing can be obtained. FIG. 3C shows an image or finder image after the fitting process.

In addition, when the above-mentioned enlarged image protrudes so that the subject is not photographed, it can be applied to all the images using a digital zoom image.
FIG. 4 is a diagram showing an appearance of the photographing apparatus according to the embodiment of the present invention.
In FIG. 4A, a portion including the upper main lens is configured as the first imaging unit (first input unit) 13. Further, as the second photographing unit (first input means) 11, a part including a sub lens provided under the main lens is configured.

In FIG. 4B, a portion including the main lens is configured as the first imaging unit (first input unit) 13. Further, as the second imaging unit (first input means) 11, a part including a sub lens provided on the back surface of the liquid crystal display unit 23 is configured.

FIG. 5 is a flowchart for explaining the operation of the photographing apparatus according to the embodiment of the present invention.
Reference sign S100 is a start step here. Then, it progresses to the step which attached | subjected code | symbol S101.
Reference S101 is a step of detecting a specific subject as described above. Then, it progresses to the step which attached | subjected code | symbol S102.
Reference numeral S <b> 102 is a step in which the first photographing device 13 performs zoom photographing of a specific subject. Then, it progresses to the step which attached | subjected code | symbol S103.
Reference numeral S <b> 103 is a step of photographing a specific subject with the second photographing device 11 in a wider range than the first photographing device 13 simultaneously with photographing with the first photographing device 13. Then, it progresses to the step which attached | subjected code | symbol S104.

Reference S104 is a step of clipping a specific subject imaged by the first imaging device 13 and outputting a first clipping image. Then, it progresses to the step which attached | subjected code | symbol S105.

Reference numeral S <b> 105 is a step of clipping a specific subject photographed by the second photographing apparatus 11 and outputting a second clipping image. Then, it progresses to the step which attached | subjected code | symbol S106.

A step S106 is a step of digitally processing the second clipping image and zooming to the same angle of view as the first clipping image. Then, it progresses to the step which attached | subjected code | symbol S107.

Reference S107 is a step of comparing the first clipping image with the zoomed second clipping image to obtain a difference. Then, it progresses to the step which attached | subjected code | symbol S108.

Reference S108 is a step of determining whether there is a difference. When it is determined that there is a difference, the process proceeds to the step denoted by reference numeral S109 (Yes). If it is determined that there is no difference, the process proceeds to the step marked with reference S101, and the above process is repeated (No).

Reference numeral S109 is a step of processing the lines and colors so that the difference can be displayed. continue,
It progresses to the step which attached | subjected code | symbol S110.
Reference numeral S110 is a step of fitting the first clipping image and the obtained difference. Then, it progresses to the step which attached | subjected code | symbol S111.
Reference numeral S111 is a step of outputting the fitting-processed image so as to be displayed near the center of the video. Then, it progresses to the step which attached | subjected code | symbol S112.
Reference numeral S <b> 112 is a step in which the output fitting image is displayed on the display unit 23 and / or recorded on the recording medium 21. Then, it progresses to the step which attached | subjected code | symbol S113.

Reference numeral 113 denotes an end step, and the processing here ends.
That is, in the embodiment of the present invention, the image capturing apparatus 10 capable of capturing both the optical zoom shooting moving image and the non-zoom shooting moving image has been described as an example. As an example of the photographing apparatus 10, the present invention can be applied to a movie camera using an HDD.

If some or all of the subject protrudes from the optical zoom screen area during zoom shooting, and the subject cannot be displayed or recorded correctly, clipping is performed from the non-zoomed movie and a digitally zoomed image is used. Fit into optical zoom image
Alternatively, it is possible to perform camera shake correction using a digital zoom image.

It is also possible to detect the subject from the captured image and extract the subject near the center of the coordinates of the displayed or recorded video. Further, in order to indicate to the user that the finder display video has been digitally zoomed, the finder monitor can make display distinctions such as line and color classification so that the zooming correction unit can be identified.

By configuring as described above, in the embodiment of the present invention, there is an effect that it is possible to provide a photographing apparatus that enables camera shake correction using a zoom image and a wide-angle image. In addition, the present invention has an effect that it is possible to provide a photographing apparatus with improved user convenience by enabling camera shake correction.

Further, in the embodiment of the present invention, the camera shake correction range can be made larger than that of the conventional technology even though it is not necessary to enlarge the image pickup device for camera shake correction. There is an effect that a subject image can be obtained. In particular, there is no need to increase the size of the image sensor for camera shake correction, which has the effect of reducing costs.

It should be noted that the present invention is not limited to the above-described embodiment as it is, and in the implementation stage, the constituent elements can be variously modified and embodied without departing from the spirit of the invention.

The figure which shows the appearance of the image | video as which the subject remove | deviated from the recording screen when zoom imaging | photography was performed using the conventional video camera. The block diagram which shows the structure of the imaging device based on Embodiment of this invention. The figure which shows the recording image | video of the imaging device based on embodiment of this invention. The figure which shows the external appearance of the imaging device based on Embodiment of this invention. The flowchart explaining operation | movement of the imaging device based on embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Recording image or display image, 10 ... Imaging device, 11 ... 2nd imaging | photography part, 12 ... 2nd clipping image output part, 13 ... 1st imaging | photography part, 14 ... 1st clipping image output part, 1
DESCRIPTION OF SYMBOLS 5 ... Zoom processing part, 16 ... Fitting processing part, 17 ... Filter processing part, 18 ... Command input part (user operation part), 19 ... Central control part, 20 ... Recording control part, 21 ... Recording medium (recording medium), 22 ... display control unit, 23 ... display device.

Claims (5)

In a photographing device that photographs a subject, converts it into video data, and stores it in a storage medium.
Subject detection means for detecting a specific subject;
A first photographing unit for photographing the detected subject in a zoom and outputting a first video signal;
A second imaging unit further provided for the first imaging unit, which captures the detected subject in a wider range than the first imaging unit, and outputs a second video signal;
A first clipping image output unit that clips the specific subject included in the output first video signal and outputs a first clipping image;
A second clipping image output unit that outputs the second clipping image by clipping the specific subject included in the output second video signal;
A zoom processing unit that zooms the second clipping image until the angle of view is approximately the same as the first clipping image;
Difference detection means for obtaining a difference between the first clipping image and the zoomed second clipping image;
An imaging apparatus comprising: fitting means for fitting the first clipping image and the obtained difference and outputting video data including the image fitted with the difference. The imaging apparatus according to claim 1, wherein the video data is output so that an image to which the difference is fitted is displayed near a center of a displayed image. The imaging apparatus according to claim 1, wherein the video data is output so that the fitted difference is distinguishable. 4. The photographing apparatus according to claim 1, wherein at least one of displaying the output video data on a display device or recording on the recording medium is performed. 5. Detecting a specific subject;
Zooming the detected subject and outputting a first video signal;
Photographing the detected subject in a wider range than the zoom photographing, and outputting a second video signal;
Clipping the specific subject included in the output first video signal to output a first clipping image;
Clipping the specific subject included in the output second video signal to output a second clipping image;
Zooming the second clipping image until the angle of view is about the same size as the first clipping image;
Obtaining a difference between the first clipping image and the zoomed second clipping image;
An imaging method comprising: fitting the first clipping image and the obtained difference, and outputting video data including the image fitted with the difference.

Images