JP2010028273A - Imaging apparatus, display control method, and program - Google Patents

Abstract

An imaging apparatus, a display control method, and a program capable of optimal screen display according to a user's usage state are provided.
First, a through image and an OSD are displayed in an overlapping manner (steps S12 and S14). The current frame and the previous frame are compared, and if the entire image is moving in the horizontal direction or the vertical direction, or if it is moving, the degree of correlation is calculated (step S16). When the horizontal or vertical correlation is equal to or greater than a predetermined threshold (YES in steps S18 and S20), panning or tilting is being performed, that is, framing is being performed, which is unnecessary for the user. The OSD which is the correct display is deleted, and only the through image is displayed (step S22). When the correlation degree in the horizontal direction or the vertical direction is not equal to or greater than the predetermined threshold (NO in step S20), it is a shooting state in which neither panning nor tilting is performed, and the through image and the OSD are displayed in an overlapping manner.
[Selection] Figure 3

Description

  The present invention relates to an imaging apparatus, a display control method, and a program, and more particularly to an imaging apparatus, a display control method, and a program that display an image captured by an imaging element in real time (display a through image).

  In Patent Document 1, when a pan operation or a tilt operation is performed, a moving amount of an image by the pan operation or the tilt operation, or when a pan operation or a tilt operation amount exceeds a set value, a warning is displayed at the same time as the image. An imaging device that reduces the imaging of images that are difficult to see by displaying is described.

In Patent Document 2, the size of the subject's motion is detected based on the difference between the image data of the previous frame and the current frame, and the frame rate of the through image is switched according to the size of the motion, thereby framing the subject. An imaging device that can reduce power consumption without causing any trouble is described.
JP 2006-237927 A JP 2005-311699 A

  However, in the invention described in Patent Document 1, only a movement amount or a warning is displayed, and information necessary for shooting cannot be displayed according to the shooting situation, so that the effect of assisting shooting is weak. There is a problem.

  In the invention described in Patent Document 2, since the frame rate is switched according to the movement of the subject, the frame rate is lowered in the case of a panning shot in which the subject is stopped but the image is moving. Therefore, there is a problem that the framing of the subject is hindered.

  The present invention has been made in view of such circumstances, and an object thereof is to provide an imaging apparatus, a display control method, and a program that are capable of optimal screen display according to the use situation of a photographer.

  In order to achieve the object, the imaging apparatus according to claim 1 includes an imaging unit that continuously captures subject images, and a display unit that continuously displays the subject images continuously captured by the imaging unit. Detecting means for detecting whether or not the photographer is framing to determine the composition; and when the detection means detects that framing is being performed, only the subject image captured by the imaging means is Displayed on the display means, and if the detection means does not detect that framing is being performed, the subject image picked up by the image pickup means and on-screen display information (OSD information) are synthesized and displayed. Display control means for displaying on the means.

  According to the imaging device of the first aspect, when it is detected that framing is being performed, that is, when the photographer has determined the composition, the subject image (the moving image or the through image) captured by the imaging unit. ) Only on the display means, and if it is not detected that framing is being performed, that is, if the photographer has determined the composition, the through image and the OSD information are combined and displayed on the display means. . Accordingly, during framing, that is, when the photographer is not photographing, the OSD display, which is an unnecessary display, is automatically deleted by the photographer, so that framing can be easily performed. Further, since necessary information is displayed at the time of photographing, photographing assistance for the photographer can be appropriately performed.

  The image pickup apparatus according to claim 2 is the image pickup apparatus according to claim 1, wherein the detection means stops when the image pickup apparatus is stopped or a subject image continuously picked up by the image pickup means stops. It is characterized by detecting the case of being framing.

  According to the imaging apparatus of the second aspect, when the imaging apparatus or the continuously captured subject image is stopped, it is detected that framing is being performed. Thereby, it is possible to reliably detect whether or not framing is being performed.

  According to a third aspect of the present invention, in the imaging device according to the first or second aspect, the degree of correlation between two subject images before and after the subject images continuously captured by the imaging unit is calculated. Correlation calculation means is provided, and the detection means detects whether or not framing is being performed based on the degree of correlation calculated by the correlation calculation means.

  According to the imaging apparatus of the third aspect, the correlation degree between the two subject images before and after the current frame and the previous frame is calculated, and whether or not framing is being performed is detected based on the correlation degree. Thereby, it is possible to detect whether or not framing is being performed without using special parts.

  An imaging apparatus according to a fourth aspect of the present invention is the imaging apparatus according to the first or second aspect, further comprising an angular velocity sensor that detects an angular velocity of the imaging device, and the detection unit is based on the angular velocity detected by the angular velocity sensor. It is characterized by detecting whether or not framing is in progress.

  According to the imaging device of the fourth aspect, it is detected whether framing is being performed based on the vertical or horizontal angular velocity detected by the angular velocity sensor. Thereby, it can be reliably detected whether or not framing is being performed.

  The imaging apparatus according to claim 5 is a frame rate control means for controlling a frame rate of a subject image continuously captured by the imaging means in the imaging apparatus according to any one of claims 1 to 4. And a frame rate control means for setting a higher frame rate when the detection means detects that framing is being performed than when the detection means does not detect framing. And

  According to the imaging device of the fifth aspect, when it is detected that framing is being performed, a through image is captured and displayed at a higher frame rate than when framing is not detected. Thereby, the quality of the through image displayed during framing can be improved.

  The image pickup apparatus according to claim 6 is continuously picked up by the image pickup apparatus or the image pickup means in the image pickup apparatus according to claim 5 when the framing is detected by the detection means. A moving speed calculating means for calculating a moving speed of the subject image is provided, wherein the frame rate control means changes a frame rate setting based on the moving speed calculated by the moving speed calculating means.

  According to the imaging apparatus of the sixth aspect, the frame rate setting is changed based on the moving speed of the imaging apparatus or the subject image. For example, when the movement speed of the subject image is high, the frame rate is increased in accordance with the movement speed of the subject image, and when the movement speed of the subject image is slow, the movement speed of the subject image is slow, so the frame rate is decreased. To do. In addition, when the moving speed of the imaging device is fast, it means that the moving speed of the subject image is fast.Therefore, the frame rate is increased, and when the moving speed of the imaging device is slow, the moving speed of the subject image is slow. This means that the frame rate is lowered. Thereby, the quality of the through image can be further improved.

  An imaging apparatus according to a seventh aspect is the imaging apparatus according to any one of the first to sixth aspects, further comprising: a panning detection means for detecting a panning shot based on a subject image continuously captured by the imaging means. And the display control means combines the subject image and the OSD information and displays on the display means when the panning detection means detects that the panning is being performed. When the panning detection means detects that no panning is being performed, only the subject image is displayed on the display means.

  According to the image pickup apparatus of the seventh aspect, the panning is detected, and when the panning is detected, the through image and the OSD information are combined and displayed. If no panning is performed, the OSD information is erased and only the through image is displayed. Thus, when panning, i.e., shooting, is being performed, OSD information, i.e., information necessary for shooting, is displayed, so that shooting assistance for the photographer can be appropriately performed.

  The image pickup apparatus according to claim 8 is a frame rate control means for controlling a frame rate of a subject image continuously picked up by the image pickup means in the image pickup apparatus according to claim 7, wherein the panning detection is performed. A frame rate control means for setting a frame rate higher than the case where the panning is not detected by the panning detection means when the panning is detected by the means; It is characterized by having.

  According to the image pickup apparatus of the eighth aspect, when it is detected that the panning is being performed, a higher frame rate is set than when the panning is not being performed. Thereby, the image quality of the through image in the case of panning where the image is likely to be blurred can be improved.

  The display control method according to claim 9, wherein the photographer determines a composition, a step of continuously capturing a subject image, a step of continuously displaying the continuously captured subject image on a display unit, and a composition A step of detecting whether or not framing is being performed, and if it is detected that framing is being performed, only the imaged subject image is displayed on the display means, and it is not detected that framing is being performed In this case, the method includes the step of combining the captured subject image and on-screen display information (OSD information) and displaying the synthesized image on the display means.

  According to a tenth aspect of the present invention, there is provided a program for causing a computing device to execute the display control method according to the ninth aspect.

  According to the present invention, it is possible to display an optimal screen according to the use situation of the photographer.

  DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The best mode for carrying out an imaging apparatus, a display control method, and a program to which the present invention is applied will be described in detail below with reference to the accompanying drawings.

<First Embodiment>
In the first embodiment of the present invention, when one moving subject is detected in a captured subject image, a through image is displayed at an optimum frame rate according to the subject's motion. is there.

  FIG. 1 is a block diagram illustrating a schematic electrical configuration inside the digital camera 1 of the imaging apparatus according to the first embodiment.

  As shown in FIG. 1, the digital camera 1 mainly includes a CPU 110, an operation unit 111, a lens unit 112, an image sensor 114, an A / D converter 116, an image input control unit 118, an image processing unit 120, and a memory I / F. (Interface) 122, memory 124, display circuit 126, display unit 128, media I / F (interface) 130, recording medium 132, DMA controller 134, microphone 136, A / D converter 138, audio input unit 140, audio I / F (interface) 142, audio output unit 144, pan / tilt detection unit 146, OSD (on-screen display) generation unit 148, and the like.

  The CPU 110 performs overall control of the entire digital camera 1 according to a predetermined control program based on an operation signal input from the operation unit 111.

  The CPU 110 includes a memory area. The memory area stores a control program executed by the CPU 110 and various data necessary for control, various setting information regarding the operation of the digital camera 1 such as photographer setting information. The memory area is used as a calculation work area of the CPU 110 and also as a temporary storage area for image data and the like.

  The CPU 110 includes an AF (automatic focus) detection circuit, and the AF detection circuit is a high-pass filter that passes only a high-frequency component of the G signal, an absolute value processing unit, and a predetermined focus area (for example, the center of the screen). An AF area detection unit that extracts signals and an integration unit that integrates absolute value data in the AF area are configured. During the AF control, the CPU 110 sequentially moves the focus lens from a closest position to a lens position corresponding to infinity, and at the same time, the high-frequency component of the image signal based on the image signal of the AF area captured via the image sensor 114 for each lens position. The integrated evaluation value is acquired, a lens position where the evaluation value reaches a peak is obtained, and contrast AF is performed to move the focus lens in the lens unit 112 to the lens position.

  The CPU 110 also includes an AE (automatic exposure) detection circuit, and the AE detection circuit calculates a physical quantity necessary for AE control and AWB (automatic white balance) control from the input image signal. For example, as a physical quantity required for AE control, one screen is divided into a plurality of areas (for example, 16 × 16), and an integrated value of R, G, and B image signals is calculated for each divided area.

  The operation unit 111 includes a shutter button, a power / mode switch, a zoom button, and the like.

  The shutter button is composed of a two-stage stroke type switch composed of a so-called “half press” and “full press”. When the shutter button is “half-pressed”, the digital camera 1 activates AE / AF, and “full-press” to execute shooting.

  The power / mode switch has both a function as a power switch for turning on / off the power of the digital camera 1 and a function as a mode switch for setting the mode of the digital camera 1. ”And“ shooting position ”are slidably arranged. The digital camera 1 is turned on by sliding the power / mode switch to the “reproduction position” or “photographing position”, and turned off by setting it to the “OFF position”. Then, the power / mode switch is slid and set to “playback position” to set “playback mode”, and set to “shooting position” to set “shooting mode”.

  The zoom button functions as zoom instruction means for instructing zooming, and includes a zoom tele button for instructing zooming to the telephoto side and a zoom wide button for instructing zooming to the wide angle side. When the zoom tele button and the zoom wide button are operated in the shooting mode, the CPU 110 moves the zoom lens in the lens unit 112 and changes the focal length.

  The lens unit 112 includes a zoom lens, a focus lens, a diaphragm, and the like, and forms a subject image on the image sensor.

  The image sensor 114 has a large number of photodiodes (light receiving elements) through, for example, red (R), green (G), and blue (B) color filters arranged in a predetermined arrangement structure (Bayer, G stripe, etc.). Is two-dimensionally arranged on the light receiving surface, and electronically captures an image of the subject formed by the lens unit 112. The image sensor 114 is driven by a timing generator (TG) that outputs a timing signal in response to a command from the CPU 110.

  The A / D converter 116 includes an analog processing unit. The analog processing unit samples and holds R, G, and B signals for each pixel with respect to the image signal output from the image sensor 114 (correlated double sampling processing). At the same time, it amplifies, converts analog R, G, B signals into digital R, G, B signals and outputs them.

  The image input control unit 118 outputs the digital R, G, and B signals output from the A / D converter 116 to the image processing unit 120.

  The image processing unit 120 includes a synchronization circuit (a processing circuit that converts a color signal into a simultaneous expression by interpolating a spatial shift of the color signal associated with a color filter array of a single CCD), a white balance correction circuit, and a gamma correction circuit. , A contour correction circuit, a luminance / color difference signal generation circuit, etc., and according to a command from the CPU 110, the input image signal is subjected to necessary signal processing to obtain luminance data (Y data) and color difference data (Cr, Cb data). Image data (YUV data) consisting of:

  In addition, the image processing unit 120 performs compression processing in a predetermined format on the input image data in accordance with a command from the CPU 110 to generate compressed image data. Further, in accordance with a command from the CPU 110, the input compressed image data is subjected to a decompression process in a predetermined format to generate uncompressed image data.

  Further, the image processing unit 120 calculates the degree of correlation between the current frame image and the previous frame image. For example, the image processing unit 120 calculates the movement amount when the entire current frame image is moving in the horizontal direction or the vertical direction with respect to the previous frame image as the degree of correlation in the horizontal direction or the vertical direction. The calculated degree of correlation is output from the image processing unit 120 to the pan / tilt detection unit 146.

  The memory I / F 122 outputs the digital R, G, and B signals output from the image processing unit 120 to the memory 124. The imaging signal stored in the memory 124 is sent to the display circuit 126, the media I / F 130, etc. via the bus.

  The display circuit 126 controls display on the display unit 128 in accordance with a command from the CPU 110. That is, in accordance with a command from the CPU 110, the input image signal is converted into a video signal (for example, an NTSC signal, a PAL signal, or a SCAM signal) for display on the display unit 128 and output to the display unit 128. In response to this, predetermined character and graphic information synthesized by the CPU 110 is output to the display unit 128.

  The display unit 128 includes a liquid crystal display capable of color display. The display unit 128 is used as an image display panel for displaying a photographed image in the playback mode, and is used as a photographer interface display panel when performing various setting operations. In the photographing mode, a through image is displayed as necessary, and is used as an electronic viewfinder for checking the angle of view.

  The media I / F 130 controls reading / writing of data with respect to the recording medium 132 loaded in the media slot according to a command from the CPU 110.

  The DMA controller 134 reads data in the recording medium 132 in accordance with a command from the CPU 110 and transfers an image to the memory 124 via the bus. Conversely, data in the memory 124 is read and transferred to the recording medium 132 via the bus.

  The microphone 136 converts the collected sound into an electrical signal and outputs it to the A / D converter 138.

  The A / D converter 138 converts the audio signal input from the microphone 136 into a digital signal (A / D conversion) and outputs the digital signal to the audio input unit 140.

  The audio input unit 140 performs necessary signal processing on the input digital signal, and converts it into audio data in a predetermined format. The audio data processed by the audio input unit 140 is output from the audio output unit 144 via the bus and audio I / F 142.

  The pan / tilt detection unit 146 determines whether the digital camera 1 has been moved horizontally (panned) or vertically moved (tilted) based on the degree of correlation output from the image processing unit 120, that is, the photographer has performed a panning or tilting operation. Determine whether or not. For example, the pan / tilt detection unit 146 determines that the pan operation is being performed by the photographer when the horizontal correlation is equal to or greater than a predetermined threshold, and the vertical correlation is equal to or greater than the predetermined threshold. If it is, it is determined that a tilt operation is performed by the photographer. That is, the pan / tilt detection unit 146 determines that framing is performed in which the photographer determines the composition.

  The OSD generation unit 148 stores character and symbol information (OSD information) such as shutter speed, aperture value, remaining number of shootable images, white balance mode, sensitivity, shooting date / time, shooting mode, warning message, and graphical photographer interface (GUI). A signal for display is output to the display circuit 126. The signal output from the OSD generation unit 148 is mixed with the image signal from the image processing unit 120 as necessary and supplied to the display unit 128. As a result, as shown in FIG. 2, OSD information necessary at the time of photographing is combined with the through image and displayed (OSD display).

  Next, the operation of the digital camera 1 of the present embodiment configured as described above will be described.

  FIG. 3 is a flowchart showing a processing flow of the digital camera 1 in the shooting preparation stage.

  First, the CPU 110 determines whether or not the digital camera 1 is set to the shooting mode (step S10). The shooting mode is set by setting the power / mode switch to the shooting position. When the digital camera 1 is set to the shooting mode, the lens unit 112 is extended to enter a shooting standby state.

  If the digital camera 1 is not set to the shooting mode (NO in step S10), the process ends. If the digital camera 1 is set to the shooting mode (YES in step S10), the following processing is performed. The through image is displayed on the display unit 128 by the method (step S12).

  Under the photographing mode, the subject light that has passed through the lens unit forms an image on the light receiving surface of the image sensor 114 through a diaphragm (not shown). The subject light that has passed through the lens unit is received by each photodiode and converted into a signal charge in an amount corresponding to the amount of incident light.

  The signal charge accumulated in each photodiode is sequentially read out as a voltage signal (image signal) corresponding to the signal charge based on a drive pulse given from a timing generator (not shown), and is then read out by the A / D converter 116. It is converted into digital R, G, and B signals and added to the image processing unit 120 via the image input control unit 118.

  The CPU 110 issues a command to the timing generator and drives the image sensor 114 at a predetermined frame rate to continuously capture images, and the image signal is continuously processed by the image processing unit 120 to obtain a through image. The image data is continuously generated. The image data is sequentially added from the image processing unit 120 to the display circuit 126, converted into a display signal format, and output to the display unit 128. Thereby, a through image is displayed on the display unit 128.

  At the same time, the display circuit 126 generates OSD data based on the signal output from the OSD generation unit 148, mixes it with the image signal output from the image processing unit 120, and outputs it to the display unit 128. Accordingly, the OSD is displayed on the display unit 128 so as to overlap the through image (step S14).

  The image processing unit 120 continuously generates image data for through images, and at the same time, the current frame (last generated image data) and the previous frame (image data generated immediately before the current frame). And the degree of correlation is calculated (step S16).

  The pan / tilt detection unit 146 determines whether the entire image has moved in the horizontal direction based on the correlation calculated in step S16, that is, whether the horizontal correlation is greater than or equal to a predetermined threshold. (Step S18).

  If the horizontal correlation is greater than or equal to the predetermined threshold (YES in step S18), the pan / tilt detection unit 146 determines that pan operation is being performed, that is, framing, and the determination result is It outputs to CPU110. The CPU 110 instructs the OSD generation unit 148 to erase the OSD display, the OSD generation unit stops outputting the signal to the display circuit 126, and the display circuit 126 displays only the image signal output from the image processing unit 120. It outputs to 128. As a result, the OSD display is erased from the display unit 128, and only the through image is displayed on the display unit 128 (step S22).

  If the horizontal correlation level is not equal to or greater than the predetermined threshold (NO in step S18), the pan / tilt detection unit 146 determines whether the entire image has moved in the vertical direction, that is, the vertical correlation level is a predetermined level. It is determined whether or not the threshold value is exceeded (step S20).

  If the vertical correlation is greater than or equal to a predetermined threshold (YES in step S20), the pan / tilt detection unit 146 determines that the tilt operation is being performed, that is, that framing is being performed, and determines the determination result. It outputs to CPU110. The CPU 110 instructs the OSD generation unit 148 to erase the OSD display, the OSD generation unit stops outputting the signal to the display circuit 126, and the display circuit 126 displays only the image signal output from the image processing unit 120. It outputs to 128. As a result, the OSD is erased from the display unit 128, and only the through image is displayed (step S22).

  Accordingly, it is possible to prevent the OSD display from being performed when a panning or tilting operation is performed. When the photographer is performing panning or tilting operation, it is when framing for photographing is being performed, and since photographing is not performed immediately, information on photographing such as a shutter speed is not necessary. Therefore, by erasing the OSD display that is unnecessary for the photographer, it is possible to facilitate the photographer's framing operation.

  If the correlation degree in the vertical direction is not equal to or greater than the predetermined threshold value (NO in step S20), the pan / tilt detection unit 146 determines that neither pan operation nor tilt operation is performed, and the determination result is sent to the CPU 110. Output. In this case, the CPU 110 outputs no instruction to the OSD generation unit 148 and ends the process. Therefore, when neither the pan operation nor the tilt operation is performed, the display on the display unit 128 is not changed, that is, the display unit 128 displays a through image and an OSD display. As described above, in a normal shooting preparation state, information necessary for shooting can be displayed.

  Thereby, the process in the shooting preparation stage is completed. The photographer determines the angle of view while confirming the through image and the OSD display displayed on the display unit 128, and performs a photographing operation.

  Shooting is performed by pressing the shutter button. When the shutter button is half-pressed, an S1 ON signal is input to the CPU 110.

  The CPU 110 calculates a focus evaluation value (AF evaluation value) at a plurality of AF detection points while moving the focus lens in the lens unit 112 based on the calculated integrated value data, and the lens having the maximum evaluation value. The position is determined as the focus position. Then, the focus lens is moved to the obtained in-focus position.

  The CPU 110 detects the brightness of the subject (subject brightness) based on the calculated integrated value, and calculates an exposure value (shooting EV value) suitable for shooting. Then, an aperture value and a shutter speed are determined from the obtained shooting EV value and a predetermined program diagram, and the electronic shutter of the image sensor 114 is controlled according to the determined value (so-called electronic shutter) to obtain an appropriate exposure amount.

  Further, the CPU 110 calculates an average integrated value for each color of the R, G, and B signals for each divided area during automatic white balance adjustment, and provides the calculation result to the CPU 110.

  The CPU 110 obtains the ratio of R / G and B / G for each divided area from the obtained R accumulated value, B accumulated value, and G accumulated value, and R of the obtained R / G and B / G values. The light source type is discriminated based on the distribution in the color space of / G and B / G. Then, according to the white balance adjustment value suitable for the discriminated light source type, for example, the value of each ratio is approximately 1 (that is, the RGB integration ratio is R: G: B≈1: 1: 1 on one screen). As described above, the gain value (white balance correction value) for the R, G, and B signals of the white balance adjustment circuit is controlled to correct the signal of each color channel.

  As described above, AE / AF processing and AWB processing are performed by half-pressing the shutter button. During this time, the photographer operates the zoom button as necessary to zoom the lens unit 112 to adjust the angle of view, and the CPU 110 continues to perform the AE / AF process and the AWB process.

  Thereafter, when the shutter button is fully pressed, an S2ON signal is input to the CPU 110, and the CPU 110 starts photographing and recording processing. The image sensor 114 is exposed with the shutter speed and aperture value determined based on the shutter photometry result.

  The image signal output from the image sensor 114 is taken into the image processing unit 120 via the A / D converter 116 and the image input control unit 118, converted into a luminance / color difference signal by the image processing unit 120, and then stored in the memory. 124.

  The image data stored in the memory 124 is added to the image processing unit 120, compressed in accordance with a predetermined compression format (for example, JPEG format), then stored in the memory 124, and stored in a predetermined image recording format (for example, Exif format). The image file is recorded on the recording medium 132 via the media I / F 130.

  According to the present embodiment, when it is considered that OSD display is not necessary for the photographer, such as during framing, the display unnecessary for the photographer can be automatically deleted. Thereby, a photographer's framing operation can be made easy.

  Further, according to the present embodiment, OSD display can be automatically performed when it is considered that OSD display is necessary for the photographer, such as when framing is not being performed. Thereby, photographing can be assisted, and as a result, an image in accordance with the photographer's desire can be photographed.

  In this embodiment, the degree of correlation is calculated by comparing the image data of the current frame with the image data of the previous frame, but the image data to be compared is not limited to continuous image data of the current frame and the previous frame, The image data of the previous frame may be compared with the image data of the previous two frames, or by comparing the image data of the current frame with the two pieces of image data acquired before and after such as image data of several frames before, The degree of correlation can be calculated.

  It should be noted that during through-image shooting and playback, that is, until S1 is turned ON, if the processing in steps S16 to S22 is repeated, the OSD display can be switched ON / OFF according to the situation at that time. More effective.

  Note that this embodiment can be applied not only to shooting and playback of through images, but also to shooting of moving images.

<Second Embodiment>
In the first embodiment of the present invention, the image processing unit calculates the degree of correlation between the current frame image and the previous frame image, and the pan / tilt detection unit performs a pan or tilt operation based on the result. In other words, the method for determining whether the pan / tilt detector is framing is not limited to this.

  In the second embodiment of the present invention, it is determined whether framing is being performed using an angular velocity sensor. Hereinafter, the digital camera 2 according to the second embodiment of the present invention will be described. In addition, about the part same as 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  FIG. 4 is a block diagram showing a schematic electrical configuration inside the digital camera 2 of the imaging apparatus according to the second embodiment.

  As shown in FIG. 4, the digital camera 2 mainly includes a CPU 110, an operation unit 111, a lens unit 112, an image sensor 114, an A / D converter 116, an image input control unit 118, an image processing unit 120, and a memory I / F. (Interface) 122, memory 124, display circuit 126, display unit 128, media I / F (interface) 130, recording medium 132, DMA controller 134, microphone 136, A / D converter 138, audio input unit 140, audio I / F (interface) 142, audio output unit 144, OSD (on-screen display) generation unit 148, angular velocity sensor 150, pan and tilt detection unit 152, and the like.

  The angular velocity sensor 150 is, for example, a gyro sensor, and detects the angular velocity in the vertical direction and the horizontal direction of the digital camera 2. The detection result is output to the pan / tilt detector 152.

  The pan / tilt detector 152 determines whether horizontal movement (pan operation) or vertical movement (tilt) has been performed based on the vertical and horizontal angular velocities output from the angular velocity sensor 150. For example, the pan / tilt detection unit 152 determines that the pan operation is being performed when the angular velocity in the horizontal direction is equal to or greater than a predetermined threshold, and when the angular velocity in the vertical direction is equal to or greater than the predetermined threshold, It is determined that the tilt is being performed. In other words, the pan / tilt detection unit 152 determines that framing is performed in which the photographer determines the composition.

  Next, the operation of the digital camera 2 of the present embodiment configured as described above will be described.

  FIG. 5 is a flowchart showing a processing flow of the digital camera 2 in the shooting preparation stage.

  First, the CPU 110 determines whether or not the digital camera 1 is set to the shooting mode (step S10). If the digital camera 1 is not set to the shooting mode (NO in step S10), the process is terminated. If the digital camera 1 is set to the shooting mode (YES in step S10), the display unit 128 is set. A through image is displayed on the screen (step S12).

  At the same time, the display circuit 126 generates OSD data based on the signal output from the OSD generation unit 148, mixes it with the image signal output from the image processing unit 120, and outputs it to the display unit 128. Accordingly, the OSD is displayed on the display unit 128 so as to overlap the through image (step S14).

  The pan / tilt detector 152 determines whether a pan operation is being performed based on the angular velocity information output from the angular velocity sensor 150 (step S24).

  When the pan / tilt detection unit 152 determines that a pan operation is being performed, ie, framing is being performed (YES in step S24), the pan / tilt detection unit 152 outputs the determination result to the CPU 110 to generate an OSD. The unit 148 is instructed to erase the OSD display. The OSD generation unit 148 stops outputting the signal to the display circuit 126, and the display circuit 126 outputs only the image signal output from the image processing unit 120 to the display unit 128. As a result, the OSD is deleted from the display unit 128, and only the through image is displayed (step S28).

  When the pan / tilt detection unit 152 determines that no pan operation has been performed (NO in step S24), the pan / tilt detection unit 152 performs tilt based on the angular velocity information output from the angular velocity sensor 150. It is determined whether or not it is being performed (step S26).

  If the pan / tilt detection unit 152 determines that a tilt operation is being performed, ie, framing is being performed (YES in step S26), the pan / tilt detection unit 152 outputs the determination result to the CPU 110 to generate an OSD. The unit 148 is instructed to erase the OSD display. The OSD generation unit 148 stops outputting the signal to the display circuit 126, and the display circuit 126 outputs only the image signal output from the image processing unit 120 to the display unit 128. As a result, the OSD is deleted from the display unit 128, and only the through image is displayed (step S28).

  Accordingly, it is possible to prevent the OSD display from being performed when a panning or tilting operation is performed. When the photographer is performing panning or tilting operation, it is when framing for photographing is being performed, and since photographing is not performed immediately, information on photographing such as a shutter speed is not necessary. Therefore, by erasing the OSD display that is unnecessary for the photographer, it is possible to facilitate the photographer's framing operation.

  When the pan / tilt detection unit 152 determines that no tilt is performed (NO in step S26), the pan / tilt detection unit 146 is neither performing pan operation nor tilt operation, that is, during framing. The determination result is not output to the CPU 110. In this case, the CPU 110 outputs no instruction to the OSD generation unit 148 and ends the process. Therefore, when neither the pan operation nor the tilt operation is performed, the OSD is displayed on the display unit 128 so as to be superimposed on the through image. In this way, during normal shooting, various information for shooting can be displayed.

  Thereby, the process in the shooting preparation stage is completed. The photographer determines the angle of view while confirming the through image and OSD displayed on the display unit 128, and performs photographing. Since the photographing and recording processing is the same as that of the first embodiment, description thereof is omitted.

  According to the present embodiment, by using the angular velocity sensor, it is possible to reliably determine whether or not framing is being performed.

  In this embodiment, the angular velocity sensor 150 detects the vertical and horizontal angular velocities of the digital camera 2, but the angular velocity sensor for detecting the vertical angular velocity and the angular velocity sensor for detecting the angular velocity in the horizontal direction Two or more angular velocity sensors may be used. In addition to the angular velocity sensor, various sensors that can detect pan operation and tilt operation can be used.

  It should be noted that during through-image shooting and playback, that is, until S1 is turned ON, if the processing in steps S24 to S28 is repeated, the OSD display can be switched ON / OFF according to the situation at that time. More effective.

  Note that this embodiment can be applied not only to shooting and playback of through images, but also to shooting of moving images.

<Third Embodiment>
The first and second embodiments of the present invention are unnecessary for the photographer because panning or tilting operation is being performed and framing is not performed immediately. Although the OSD display is automatically erased to facilitate the photographer's framing operation, the method for facilitating the photographer's framing operation is not limited to this.

  In the third embodiment of the present invention, the framing operation of the photographer is facilitated by switching the frame rate in accordance with the presence / absence of a pan operation or a tilt operation. Hereinafter, a digital camera 3 according to a third embodiment of the present invention will be described. In addition, about the part same as 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  FIG. 6 is a block diagram showing a schematic electrical configuration inside the digital camera 3 of the image pickup apparatus according to the third embodiment.

  As shown in FIG. 6, the digital camera 3 mainly includes a CPU 110, an operation unit 111, a lens unit 112, an image sensor 114, an A / D converter 116, an image input control unit 118, an image processing unit 120, and a memory I / F. (Interface) 122, memory 124, display circuit 126, display unit 128, media I / F (interface) 130, recording medium 132, DMA controller 134, microphone 136, A / D converter 138, audio input unit 140, audio I / F (interface) 142, audio output unit 144, pan / tilt detection unit 146, OSD (on-screen display) generation unit 148, frame rate control unit 154, and the like.

  The frame rate control unit 154 controls the frame rate of the through image in accordance with a command from the CPU 110. The frame rate control unit 154 stores the frame rate in advance in association with a plurality of frame rate movement amounts so that the frame rate can be selected according to the movement amount of the image by the pan operation and the tilt operation. Information on the frame rate set by the frame rate control unit 154 is output to the CPU 110 and the display circuit 126.

  Next, the operation of the digital camera 3 of the present embodiment configured as described above will be described.

  FIG. 7 is a flowchart showing a processing flow of the digital camera 3 in the shooting preparation stage.

  First, the CPU 110 determines whether or not the digital camera 1 is set to the shooting mode (step S10). If the digital camera 1 is not set to the shooting mode (NO in step S10), the process is terminated. If the digital camera 1 is set to the shooting mode (YES in step S10), the display unit 128 is set. A through image is displayed on the screen (step S12).

  At the same time, the display circuit 126 generates OSD data based on the signal output from the OSD generation unit 148, mixes it with the image signal output from the image processing unit 120, and outputs it to the display unit 128. Accordingly, the OSD is displayed on the display unit 128 so as to overlap the through image (step S14).

  The image processing unit 120 continuously generates image data for through images, and at the same time, the current frame (last generated image data) and the previous frame (image data generated immediately before the current frame). And the degree of correlation is calculated (step S16).

  The pan / tilt detection unit 146 determines whether the entire image has moved in the horizontal direction based on the correlation calculated in step S16, that is, whether the horizontal correlation is greater than or equal to a predetermined threshold. (Step S18).

  If the correlation degree in the horizontal direction is equal to or greater than the predetermined threshold (YES in step S18), the process proceeds to a step (step S30) for determining a movement amount, which will be described in detail later.

  If the horizontal correlation level is not equal to or greater than the predetermined threshold (NO in step S18), the pan / tilt detection unit 146 determines whether the entire image has moved in the vertical direction, that is, the vertical correlation level is a predetermined level. It is determined whether or not the threshold value is exceeded (step S20).

  If the correlation degree in the vertical direction is equal to or greater than the predetermined threshold (YES in step S20), the process proceeds to the step of determining the movement amount (step S30).

  In the step of determining the amount of movement (step S30), the CPU 110 moves the correlation inputted from the pan / tilt detector 146, that is, the entire current frame image in the horizontal direction or the vertical direction with respect to the previous frame image. It is determined whether or not the movement amount at that time is greater than a predetermined threshold (step S30).

  If the degree of correlation is greater than the predetermined threshold (YES in step S30), the pan / tilt detection unit 146 is performing pan operation and tilt operation, that is, framing, and the amount of movement of the image is thereby It is determined that the value is larger, and the determination result is output to the CPU 110. The CPU 110 outputs the result to the frame rate control unit 154, and the frame rate control unit 154 sets the frame rate of the through image to a frame rate when the movement amount is large, that is, a high frame rate (for example, 60 f / s). , Output to the CPU 110 and the display circuit 126.

  The CPU 110 drives the image sensor 114 at a frame rate when the movement amount set by the frame rate control unit 154 is large, and periodically captures an image signal from the image sensor 114. The image processing unit 120 generates a luminance / color difference signal from the captured image signal, and the display circuit 126 converts the luminance / color difference signal into a signal format for display and outputs the signal to the display unit 128. As a result, the through image is captured and displayed at the frame rate when the movement amount is large (step S32).

  If the degree of correlation is not greater than the predetermined threshold (NO in step S30), the pan / tilt detection unit 146 is performing pan operation or tilt operation, that is, framing is performed, but image movement is thereby performed. It is determined that the amount is small, and the determination result is output to the CPU 110. The CPU 110 outputs the result to the frame rate control unit 154, and the frame rate control unit 154 sets the frame rate of the through image to a frame rate when the moving amount is small, that is, a standard frame rate (for example, 30 f / s). And output to the CPU 110 and the display circuit 126.

  The CPU 110 drives the image sensor 114 at a frame rate when the movement amount set by the frame rate control unit 154 is small, and periodically captures an image signal from the image sensor 114. The image processing unit 120 generates a luminance / color difference signal from the captured image signal, and the display circuit 126 converts the luminance / color difference signal into a signal format for display and outputs the signal to the display unit 128. As a result, the through image is captured and displayed at the frame rate when the movement amount is small (step S34).

  Accordingly, when it is determined that framing is being performed, the frame rate of the through image can be set to an optimum frame rate corresponding to the moving speed of the screen. Therefore, the photographer's framing operation can be facilitated.

  If the correlation degree in the vertical direction is not equal to or greater than the predetermined threshold (NO in step S20), the pan / tilt detection unit 146 determines that neither pan operation nor tilt operation is performed, that is, framing is not being performed. The determination result is output to the CPU 110. In this case, the CPU 110 outputs a result that neither pan operation nor tilt operation is performed to the frame rate control unit 154, and the frame rate control unit 154 performs pan operation and tilt operation on the frame rate of the through image. Is set to a low frame rate (for example, 15 f / s), and is output to the CPU 110 and the display circuit 126.

  The CPU 110 drives the image sensor 114 at a frame rate when the movement amount set by the frame rate control unit 154 is small, and periodically captures an image signal from the image sensor 114. The image processing unit 120 generates a luminance / color difference signal from the captured image signal, and the display circuit 126 converts the luminance / color difference signal into a signal format for display and outputs the signal to the display unit 128. As a result, a through image is captured and displayed at a frame rate when neither pan operation nor tilt operation is performed (step S36).

  Thereby, the process in the shooting preparation stage is completed. The photographer determines the angle of view while confirming the through image and OSD displayed on the display unit 128, and performs photographing. Since the photographing and recording processing is the same as that of the first embodiment, description thereof is omitted.

  According to the present embodiment, the through image can be displayed at an appropriate frame rate corresponding to the moving amount of the screen by switching the through image acquisition and display frame rate based on the moving amount of the screen. Conventionally, even during framing, there is a problem that depending on the moving amount (moving speed) of the screen, the display of the screen flows and it is difficult to perform framing. On the other hand, in the present embodiment, since the frame rate is set according to the moving amount of the screen, such a problem can be solved by improving the quality of the through image.

  Further, according to the present embodiment, it is possible to reduce power consumption without hindering the framing operation of the photographer. In general, since the frame rate has a correlation with the power consumption, many systems are adopted that reduce the frame rate when the photographing operation is not started or in the power saving mode. In such a system, the frame rate is lowered even when framing is not being performed, so that display of the screen flows and framing becomes difficult. On the other hand, in this embodiment, such a problem can be solved by reducing the frame rate only when framing is not being performed.

  In the present embodiment, when the pan operation and the tilt operation are performed, the frame rate is set in two stages according to the moving amount of the image (steps S32 to S36). The frame rate may be set.

  In this embodiment, the frame rate is changed based on the moving amount of the image. However, the angular rate of the digital camera 3 may be detected by an angular velocity sensor or the like, and the frame rate may be changed based on the angular velocity. For example, the angular velocity and the moving amount of the image are considered to have a predetermined relationship with the subject distance as a parameter. Therefore, the angular velocity, the subject distance, and the frame rate are associated with each other, the angular velocity and the subject distance are acquired, and the frame rate corresponding to the angular velocity is set. In short, any method may be used as long as the frame rate can be set according to the moving amount of the image.

  Further, in the present embodiment, the processing is ended when the frame rate is set, but the processing in steps S16 to S36 may be repeated during through image shooting and reproduction, that is, until S1 is turned on. As a result, the frame rate can be automatically lowered when the movement of the entire screen slows or stops, and the frame rate can be increased when the movement of the entire screen becomes faster.

  It should be noted that this embodiment is more effective when implemented in combination with the first embodiment or the second embodiment.

<Fourth embodiment>
In the first embodiment and the second embodiment of the present invention, when panning or tilting operation is performed, that is, during framing, it is not a state in which shooting is performed immediately. Although the unnecessary OSD display is automatically deleted to facilitate the photographer's framing operation, the method for facilitating the photographer's framing operation is not limited to this.

  The fourth embodiment of the present invention is a mode that facilitates the framing operation of the photographer by switching the OSD display according to the presence or absence of panning and tilting operations and the presence or absence of panning. The digital camera 4 according to the fourth embodiment of the present invention will be described below. In addition, about the part same as 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  FIG. 8 is a block diagram showing a schematic electrical configuration inside the digital camera 4 of the imaging apparatus according to the fourth embodiment.

  As shown in FIG. 8, the digital camera 4 mainly includes a CPU 110, an operation unit 111, a lens unit 112, an image sensor 114, an A / D converter 116, an image input control unit 118, an image processing unit 120, and a memory I / F. (Interface) 122, memory 124, display circuit 126, display unit 128, media I / F (interface) 130, recording medium 132, DMA controller 134, microphone 136, A / D converter 138, audio input unit 140, audio I / F (interface) 142, audio output unit 144, pan / tilt detection unit 146, OSD (on-screen display) generation unit 148, panning detection unit 156, and the like.

  The image processing unit 120 detects the main subject from the current frame image and the previous frame image. For example, the image processing unit 120 may extract feature points from a predetermined area in the center of the screen, and if there is a corresponding feature point, the image processing unit 120 may use it as a main subject, detect a face, and detect the detected face. The main subject may be used, or a predetermined area itself in the center of the screen may be used as the main subject. Then, the image processing unit 120 separates the current frame image and the previous frame image into a main subject and other areas, and each area of the current frame image is in a horizontal direction with respect to each area of the previous frame image. Alternatively, it is detected whether it is moving in the vertical direction, and if it is moving, the amount of movement is calculated. The detected result and the calculated movement amount are output from the image processing unit 120 to the panning detection unit 156.

  The panning detection unit 156 determines whether the photographer is performing panning based on the result output from the image processing unit 120. For example, when the main subject does not move and only the other area moves in the horizontal direction or the vertical direction, or the horizontal direction and the vertical direction, the panning detection unit 156 performs the panning shot by the photographer. Judge that

  Next, the operation of the digital camera 4 of the present embodiment configured as described above will be described.

  FIG. 9 is a flowchart showing a processing flow of the digital camera 4 in the shooting preparation stage.

  First, the CPU 110 determines whether or not the digital camera 1 is set to the shooting mode (step S10). If the digital camera 1 is not set to the shooting mode (NO in step S10), the process is terminated. If the digital camera 1 is set to the shooting mode (YES in step S10), the display unit 128 is set. A through image is displayed on the screen (step S12).

  At the same time, the display circuit 126 generates OSD data based on the signal output from the OSD generation unit 148, mixes it with the image signal output from the image processing unit 120, and outputs it to the display unit 128. Accordingly, the OSD is displayed on the display unit 128 so as to overlap the through image (step S14).

  The image processing unit 120 continuously generates image data for through images, and at the same time, the current frame (last generated image data) and the previous frame (image data generated immediately before the current frame). And the degree of correlation is calculated (step S16).

  The pan / tilt detection unit 146 determines whether the entire image has moved in the horizontal direction based on the correlation calculated in step S16, that is, whether the horizontal correlation is greater than or equal to a predetermined threshold. (Step S18).

  If the correlation degree in the horizontal direction is equal to or greater than the predetermined threshold (YES in step S18), the process proceeds to a step (step S38) for determining panning to be described in detail later.

  If the horizontal correlation level is not equal to or greater than the predetermined threshold (NO in step S18), the pan / tilt detection unit 146 determines whether the entire image has moved in the vertical direction, that is, the vertical correlation level is a predetermined level. It is determined whether or not the threshold value is exceeded (step S20).

  When the correlation degree in the vertical direction is equal to or greater than a predetermined threshold (YES in step S20), the process proceeds to a step of determining panning (step S38).

  In the step of determining panning (step S38), the panning detection unit 156 determines whether panning is being performed based on the result output from the image processing unit 120.

  When the entire screen is moved in the horizontal direction or the vertical direction but the main subject is stopped, that is, when panning is being performed (YES in step S38), the panning detection unit 156 performs panning. The CPU 110 outputs a determination result that the process is performed. In this case, the CPU 110 outputs no instruction to the OSD generation unit 148 and ends the process. In other words, a through image display and an OSD display are performed on the display unit 128. Thus, when panning is being performed, that is, when shooting is being performed instead of framing, various information for shooting can be displayed.

  The entire screen is moved in the horizontal direction or the vertical direction, and the main subject is also moved in the horizontal direction or the vertical direction in the same manner as other areas, that is, when no panning is performed (YES in step S38). ), The panning detection unit 156 outputs a determination result that the panning is not performed to the CPU 110. The CPU 110 instructs the OSD generation unit 148 to erase the OSD display, the OSD generation unit stops outputting the signal to the display circuit 126, and the display circuit 126 displays only the image signal output from the image processing unit 120. To the unit 128. Accordingly, when panning is not performed, that is, when panning or tilting operation is performed, framing is being performed, and shooting is not performed immediately. Is deleted and only the through image is displayed (step S40).

  If the correlation degree in the vertical direction is not equal to or greater than the predetermined threshold (NO in step S20), the pan / tilt detection unit 146 determines that neither pan operation nor tilt operation is performed, that is, framing is not being performed. The determination result is output to the CPU 110. In this case, the CPU 110 outputs no instruction to the OSD generation unit 148 and ends the process. Therefore, when neither the pan operation nor the tilt operation is performed, the OSD is displayed on the display unit 128 so as to be superimposed on the through image. In this way, during normal shooting, various information for shooting can be displayed.

  Thereby, the process in the shooting preparation stage is completed. The photographer determines the angle of view while confirming the through image and OSD displayed on the display unit 128, and performs a photographing operation.

  According to this embodiment, even if the screen is moving in the horizontal direction or the vertical direction, the OSD display is not erased when the main subject is observed and determined to be a panning shot. You can shoot while viewing the necessary shooting information.

  In this embodiment, the pan operation and the tilt operation are determined based on the degree of correlation calculated by the image processing unit 120. However, as in the second embodiment, an angular velocity sensor is provided, and the detection result The pan operation and tilt operation may be determined based on the above.

  It should be noted that during through-image shooting and playback, that is, until S1 is turned on, if the processing of steps S16 to S42 is repeated, ON / OFF of the OSD display can be switched according to the situation at that time. More effective.

  Note that this embodiment can be applied not only to shooting and playback of through images, but also to shooting of moving images.

<Fifth embodiment>
The fourth embodiment of the present invention is a mode in which an OSD display necessary for a photographer is displayed because a shot is being taken when a panning shot is performed and scattered. The method for facilitating the operation is not limited to this.

  In the fifth embodiment of the present invention, the frame rate is switched according to the presence or absence of panning. The digital camera 5 according to the fifth embodiment of the present invention will be described below. In addition, about the part same as 3rd Embodiment and 4th Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  FIG. 10 is a block diagram illustrating an electrical schematic configuration inside the digital camera 4 of the imaging apparatus according to the fifth embodiment.

  As shown in FIG. 10, the digital camera 5 mainly includes a CPU 110, an operation unit 111, a lens unit 112, an image sensor 114, an A / D converter 116, an image input control unit 118, an image processing unit 120, and a memory I / F. (Interface) 122, memory 124, display circuit 126, display unit 128, media I / F (interface) 130, recording medium 132, DMA controller 134, microphone 136, A / D converter 138, audio input unit 140, audio I / F (interface) 142, audio output unit 144, pan / tilt detection unit 146, OSD (on-screen display) generation unit 148, frame rate control unit 154, panning detection unit 156, and the like.

  Next, the operation of the digital camera 4 of the present embodiment configured as described above will be described.

  FIG. 11 is a flowchart showing a processing flow of the digital camera 5 in the shooting preparation stage.

  First, the CPU 110 determines whether or not the digital camera 1 is set to the shooting mode (step S10). If the digital camera 1 is not set to the shooting mode (NO in step S10), the process is terminated. If the digital camera 1 is set to the shooting mode (YES in step S10), the display unit 128 is set. A through image is displayed on the screen (step S12).

  At the same time, the display circuit 126 generates OSD data based on the signal output from the OSD generation unit 148, mixes it with the image signal output from the image processing unit 120, and outputs it to the display unit 128. Accordingly, the OSD is displayed on the display unit 128 so as to overlap the through image (step S14).

  The image processing unit 120 continuously generates image data for through images, and at the same time, the current frame (last generated image data) and the previous frame (image data generated immediately before the current frame). And the degree of correlation is calculated (step S16).

  The pan / tilt detection unit 146 determines whether the entire image has moved in the horizontal direction based on the correlation calculated in step S16, that is, whether the horizontal correlation is greater than or equal to a predetermined threshold. (Step S18).

  If the horizontal correlation is greater than or equal to the predetermined threshold (YES in step S18), the process proceeds to a step of determining panning (step S38).

  If the horizontal correlation level is not equal to or greater than the predetermined threshold (NO in step S18), the pan / tilt detection unit 146 determines whether the entire image has moved in the vertical direction, that is, the vertical correlation level is a predetermined level. It is determined whether or not the threshold value is exceeded (step S20).

  When the correlation degree in the vertical direction is equal to or greater than a predetermined threshold (YES in step S20), the process proceeds to a step of determining panning (step S38).

  In the step of determining panning (step S38), the panning detection unit 156 determines whether panning is being performed based on the result output from the image processing unit 120.

  When the entire screen is moved in the horizontal direction or the vertical direction but the main subject is stopped, that is, when panning is being performed (YES in step S38), the panning detection unit 156 performs panning. The CPU 110 outputs a determination result that the process is performed. In this case, the CPU 110 outputs a determination result that the panning is being performed to the frame rate control unit 154, and the frame rate control unit 154 uses the frame rate of the through image as a panning frame rate, that is, a high frame. The rate is set (for example, 60 f / s) and output to the CPU 110 and the display circuit 126.

  The CPU 110 drives the image sensor 114 at the frame rate for panning set by the frame rate control unit 154 and periodically captures image signals from the image sensor 114. The image processing unit 120 generates a luminance / color difference signal from the captured image signal, and the display circuit 126 converts the luminance / color difference signal into a signal format for display and outputs the signal to the display unit 128. As a result, a through image is captured and displayed at the frame rate for panning (step S44).

  As a result, when panning is being performed, that is, when shooting is being performed instead of framing, the frame rate can be increased and the quality of the through image can be improved.

  When the entire screen is moving in the horizontal or vertical direction, and the main subject is moving in the horizontal or vertical direction as well as other areas, that is, no panning is being performed and framing is in progress In step S38 (YES in step S38), the panning detection unit 156 outputs a determination result that the panning is not performed to the CPU 110. In this case, the CPU 110 outputs a determination result that the panning is not performed to the frame rate control unit 154, and the frame rate control unit 154 determines the frame rate of the through image, that is, the standard frame rate (for example, 30f). / S) and output to the CPU 110 and the display circuit 126.

  The CPU 110 drives the image sensor 114 at a normal frame rate set by the frame rate control unit 154 and periodically captures image signals from the image sensor 114. The image processing unit 120 generates a luminance / color difference signal from the captured image signal, and the display circuit 126 converts the luminance / color difference signal into a signal format for display and outputs the signal to the display unit 128. As a result, a through image is captured and displayed at a normal frame rate (step S46).

  If the correlation degree in the vertical direction is not equal to or greater than the predetermined threshold value (NO in step S20), the pan / tilt detection unit 146 determines that neither pan operation nor tilt operation is performed, and the determination result is sent to the CPU 110. Output. In this case, the CPU 110 outputs a result that neither pan operation nor tilt operation is performed to the frame rate control unit 154, and the frame rate control unit 154 performs pan operation and tilt operation on the frame rate of the through image. Is set to a low frame rate (for example, 15 f / s), and is output to the CPU 110 and the display circuit 126.

  The CPU 110 drives the image sensor 114 at a frame rate when the movement amount set by the frame rate control unit 154 is small, and periodically captures an image signal from the image sensor 114. The image processing unit 120 generates a luminance / color difference signal from the captured image signal, and the display circuit 126 converts the luminance / color difference signal into a signal format for display and outputs the signal to the display unit 128. As a result, a through image is captured and displayed at a frame rate when neither pan operation nor tilt operation is performed (step S36).

  Thereby, the process in the shooting preparation stage is completed. The photographer determines the angle of view while confirming the through image and the OSD display displayed on the display unit 128, and performs a photographing operation.

  According to the present embodiment, the through image can be displayed at a high frame rate suitable for the panning by switching the acquisition and display frame rate of the through image based on the presence or absence of the panning. In the case of panning, there is a problem in that if the frame rate is low and the image is blurred, it is not possible to determine shooting and miss a photo opportunity. On the other hand, in the present embodiment, in the case of panning, such a problem can be solved by increasing the frame rate and improving the quality of the through image.

  Further, according to the present embodiment, it is possible to reduce power consumption without hindering the framing operation of the photographer. In general, since the frame rate has a correlation with the power consumption, many systems are adopted that reduce the frame rate when the photographing operation is not started or in the power saving mode. In such a system, even when panning is being performed, the frame rate is low, so that the display on the screen flows and judgment of photographing cannot be made. On the other hand, in the present embodiment, such a problem can be solved by reducing the frame rate only when no panning is performed.

  In the present embodiment, the processing is terminated when the frame rate is set. However, the processing in steps S16 to S46 may be repeated during through-image shooting and reproduction, that is, until S1 is turned on. As a result, the frame rate can be automatically lowered when the movement of the entire screen slows or stops, and the frame rate can be increased when the movement of the entire screen becomes faster.

  It should be noted that this embodiment is more effective when implemented in combination with the fourth embodiment.

  Note that the application of the present invention is not limited to a digital camera, and can be similarly applied to an imaging apparatus such as a mobile phone with a camera or a video camera. It can also be provided as a program applied to a device such as a digital camera.

1 is a block diagram showing an electrical configuration of a digital camera 1 to which the present invention is applied. It is an example of a display of the OSD of the digital camera 1. 4 is a flowchart showing a flow of shooting preparation processing of the digital camera 1. 1 is a block diagram showing an electrical configuration of a digital camera 2 to which the present invention is applied. 4 is a flowchart showing a flow of shooting preparation processing of the digital camera 2. It is a block diagram which shows the electric constitution of the digital camera 3 to which this invention was applied. 6 is a flowchart showing a flow of shooting preparation processing of the digital camera 3; It is a block diagram which shows the electric constitution of the digital camera 4 to which this invention was applied. 4 is a flowchart showing a flow of shooting preparation processing of the digital camera 4. It is a block diagram which shows the electric constitution of the digital camera 5 to which this invention was applied. 4 is a flowchart showing a flow of shooting preparation processing of the digital camera 5;

Explanation of symbols

1, 2, 3, 4, 5: Digital camera, 110: CPU, 111: Operation unit, 112: Lens unit, 114: Image sensor, 116: A / D converter, 118: Image input control unit, 120: Image Processing unit 122: Memory I / F 124: Memory 126: Display circuit 128: Display unit 130: Media I / F 132: Recording medium 134: DMA controller 136: Microphone 138: A / D Converter: 140: audio input unit, 142: audio I / F, 144: audio output unit, 146, 152: pan, tilt detection unit, 148: OSD generation unit, 150: angular velocity sensor, 154: frame rate control unit, 156: Panning detection unit

Claims (10)

Imaging means for continuously capturing subject images;
Display means for continuously displaying subject images continuously picked up by the image pickup means;
Detection means for detecting whether the photographer is framing to determine the composition;
When it is detected by the detection means that framing is being performed, only the subject image picked up by the image pickup means is displayed on the display means, and when framing is not detected by the detection means Display control means for combining the subject image picked up by the image pickup means and on-screen display information (OSD information) and displaying on the display means;
An imaging apparatus comprising:   2. The detection unit according to claim 1, wherein the detection unit detects a case where the imaging apparatus is stopped or a case where a subject image continuously captured by the imaging unit is stopped as framing. Imaging device. Correlation calculating means for calculating the degree of correlation between the two subject images before and after the subject images successively captured by the imaging means;
The imaging apparatus according to claim 1, wherein the detection unit detects whether framing is being performed based on the degree of correlation calculated by the correlation calculation unit. An angular velocity sensor for detecting the angular velocity of the imaging device;
The imaging device according to claim 1, wherein the detection unit detects whether framing is being performed based on an angular velocity detected by the angular velocity sensor.   Frame rate control means for controlling the frame rate of a subject image continuously picked up by the image pickup means, and when the detection means detects that framing is being performed, the detection means 5. The image pickup apparatus according to claim 1, further comprising a frame rate control means for setting a higher frame rate than when no presence is detected. A moving speed calculating means for calculating a moving speed of a subject image continuously captured by the imaging device or the imaging means when it is detected by the detecting means that framing is being performed;
The imaging apparatus according to claim 5, wherein the frame rate control unit changes a frame rate setting based on the moving speed calculated by the moving speed calculating unit. A panning detection means for detecting a panning based on a subject image continuously captured by the imaging means;
When the panning detection unit detects that the panning is being performed, the display control unit combines the subject image and the OSD information and displays the synthesized image on the display unit. The imaging apparatus according to any one of claims 1 to 6, wherein when the detection unit detects that the panning is not performed, only the subject image is displayed on the display unit.   Frame rate control means for controlling the frame rate of a subject image continuously picked up by the image pickup means, and when the panning detection means detects that the panning is being performed, the panning 8. The image pickup apparatus according to claim 7, further comprising a frame rate control unit configured to set a higher frame rate than when the shooting detection unit does not detect that the panning is being performed. Continuously capturing a subject image;
Continuously displaying the continuously captured subject images on a display means;
Detecting whether the photographer is framing to determine composition;
When the framing is detected, only the captured subject image is displayed on the display means. When the framing is not detected, the captured subject image is displayed. Combining on-screen display information (OSD information) and displaying on the display means;
A display control method comprising:   A program for causing an arithmetic device to execute the display control method according to claim 9.

Images