JP2009218911A - Mobile terminal with camera including camera shake correcting function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent a photographed image from being deteriorated by unnecessary camera shake correction. <P>SOLUTION: When a shutter button is pressed in a camera shake correction program execution state (step S4), within an exposure time, a plurality of image data items are acquired (step S5) and it is determined whether vibration of a mobile terminal body within the exposure time exceeds a preset threshold or not (step S6). If it is determined that the vibration exceeds the preset threshold (step 6:Yes), prescribed camera shake correction processing is performed upon the acquired plurality of image data items and image synthesis is performed to produce one photographed image (step S7). If it is determined that the vibration is less than or equal to the preset threshold in the step S6 (step S6:No), without performing camera shake correction processing upon the acquired plurality of image data items, image synthesis is performed as it is to obtain one photographed image (step S9). <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a camera-equipped mobile terminal having a camera shake correction function by image composition processing.

  In recent years, digital cameras are generally equipped with an anti-shake function, but recently, mobile terminals such as camera-equipped mobile phones have also been equipped with an anti-shake function (Patent Documents). 1-2).

  As a camera shake prevention function, the camera shakes when the photographer holds the camera during shooting to prevent camera shake. The processing method (structure) is the opposite direction to the camera shake. The lens is moved (lens shift method) or the image pickup device composed of CCD or CMOS is moved (CCD / CMOS shift method), and a method of mechanically absorbing blur at the time of shooting and one shooting By taking multiple frame images and detecting the correlation between the frame images, the amount of movement due to camera shake is detected, and based on this detection result, multiple frame images are combined while shifting, and image blur due to camera shake is detected by software. There is a method of correcting by processing (for example, see Patent Documents 3 to 6).

  The method of mechanically absorbing blur at the time of photographing is complicated in mechanical structure, difficult to reduce in size, and causes an increase in cost. In the case of a camera-equipped mobile terminal, a communication function other than the photographing function must be installed in the device, and since it is also an important factor that the device is small, means for preventing camera shake with a mechanical structure It is difficult to reduce the size by mounting.

  On the other hand, a method for correcting image blur due to camera shake by software processing is to shoot a plurality of images by one shooting and synthesize a plurality of images based on image feature points by software processing. Since this is a method for outputting an image with less blurring, there is no particular need for a mechanism for controlling the optical drive unit for camera shake correction, the device can be miniaturized, and is suitable for application to a portable terminal with a camera. is there.

JP 2006-333310 A JP 2007-180990 A JP 2000-066952 A JP 2003-032540 A JP 2004-266648 A JP 2007-006045 A

  This camera shake correction function acquires a plurality of frame images in one shooting, performs a predetermined camera shake correction process on the plurality of frame images, and synthesizes a plurality of frame images after processing to produce one frame image. Therefore, when camera shake occurs, it is possible to obtain a shot image in which camera shake is corrected.

  On the other hand, when a captured image without camera shake is obtained, when this camera shake correction process is executed, the captured image may be deteriorated due to an error in the composition process, resulting in a slightly blurred outline. In addition, when performing the camera shake correction process, it is necessary to perform a correlation process between a plurality of frame images, and there is a problem that the power consumption increases accordingly.

  The camera-equipped mobile terminal having the camera shake correction function is provided with a switch for switching the camera shake correction function to ON or OFF, and the user does not have the camera shake correction function when, for example, self-timer shooting is performed. Can be turned off.

  However, when taking a picture with this camera-equipped mobile terminal with the camera shake prevention function set to ON, for example, even if the camera is not shaken during photography, the camera-shake correction function of this camera-equipped mobile terminal In this case, a plurality of frame images are shot in one shot, a predetermined camera shake correction process is performed, and a process of combining a plurality of images to obtain a single shot image is executed.

  Then, even though a captured image that has not been shaken originally is obtained, an image synthesis process for correcting camera shake is performed unnecessarily, which may cause deterioration of the captured image and an unnecessary increase in power consumption. . In addition, in order to prevent this, it is necessary to perform an ON / OFF switching operation of the camera shake correction function in consideration of the shooting situation every time shooting is performed, which causes a problem that the operation is troublesome.

  An object of the present invention is to provide a camera-equipped mobile terminal having a camera shake correction function that can solve the above-described problems.

  The portable terminal with a camera having the camera shake correction function of the present invention acquires a plurality of frame images by one shooting, performs a predetermined camera shake correction process on the acquired plurality of frame images, and performs a plurality of processed images. In a camera-equipped mobile terminal having a camera shake correction function that performs a process of generating a single photographed image by synthesizing the frame images, the vibration detection unit that detects the shake of the mobile terminal body and the camera shake correction function are operated. When the vibration detected by the vibration detection unit when acquiring the plurality of frame images at the time of photographing is less than a predetermined threshold value, the acquired plurality of frame images are synthesized as they are without performing the predetermined camera shake correction processing. And a means for executing processing for obtaining one photographed image.

  In addition, the program of the present invention provides a computer provided in a camera-equipped mobile terminal having a camera shake correction function, means for acquiring a plurality of frame images in one shooting, and shooting for acquiring the plurality of frame images. When the vibration detected by the vibration detection unit of the mobile terminal is greater than or equal to a predetermined threshold value, a predetermined camera shake correction process is performed on the acquired plurality of frame images, and the plurality of frame images after the processing are processed. When the vibration detected by the vibration detection unit of the portable terminal during the shooting for acquiring the plurality of frame images is less than a predetermined threshold, It is characterized by functioning as means for generating a single photographed image by synthesizing the acquired plurality of frame images as they are without performing camera shake correction processing.

  According to the present invention, when vibration detected by the vibration detection unit at the time of acquisition of the plurality of frame images at the time of shooting with the image stabilization function activated is less than a predetermined threshold, the predetermined image stabilization processing is not performed. Since a plurality of acquired frame images are combined as they are into a single photographed image, deterioration of the photographed image and unnecessary increase in power consumption due to unnecessary image stabilization and image composition processing are performed. Can be prevented.

  In addition, even when the camera shake correction function is turned on, it is possible to prevent the image from being deteriorated by performing unnecessary camera shake correction, so it is not necessary to consider whether or not camera shake occurs during shooting. Therefore, the operation becomes easier.

  FIG. 1 is a functional block diagram of a camera-equipped mobile terminal having a camera shake correction function according to the first embodiment of the present invention.

  The mobile terminal 10 according to the present embodiment includes a wireless unit 101 that performs wireless communication with a base station (not shown), a control unit 102 that is a CPU that controls each unit of the terminal, a display unit 103 such as an LCD that displays various types of information, and the like. , Including a numeric keypad, a cursor key, and the like, an operation unit 104 that receives an operation input from a user, a camera 105 that includes a lens and an image sensor, and a memory that stores a terminal control program, various setting information, captured image information, and the like 106 and a vibration detection unit 107 that detects the shaking of the terminal body.

  FIG. 2 shows the contents of the program stored in the memory 106. The memory 106 stores a control program 201 for performing execution control of various operations of the mobile terminal 10. As a program particularly related to the present invention, a camera control program 202, a captured image camera shake correction program 203, and the like. Is remembered. The control unit 102 and the memory 106 function as a computer for executing these programs stored in the memory 106.

  FIG. 3 shows image shooting processing (processing of the camera control program 202 and the camera shake correction program 203) in the mobile terminal 10 of the present embodiment. This process is executed by the control unit 102. The operation of this embodiment will be described below with reference to FIGS.

  First, when a camera activation operation is performed by the user, execution of the camera control program 202 is started (step S1), and it is determined whether or not the camera shake correction function is set to ON (step S2). When is set to OFF (step S2, No), the process shifts to shooting in the normal shooting mode (step S10).

  When the camera shake correction function is set to ON (step S2, Yes), it is determined whether or not the exposure time for shooting is longer than a predetermined value (step S3), and the exposure time becomes less than the predetermined value. If it is present (step S2, No), the process proceeds to shooting in the normal shooting mode (step S10). Usually, camera shake hardly occurs when shooting is possible with an exposure time of 1/60 seconds or less. Therefore, if the predetermined value is set to 1/60 seconds, when the exposure time at the time of shooting is 1/60 seconds or less, even if the camera shake correction function is set to ON, the shooting is automatically performed in the normal shooting mode. It becomes possible to switch to. Note that the value of the exposure time at which the camera shake correction function is started can also be set in advance by the user.

  When the exposure time for shooting is longer than the predetermined value (step S3, Yes), the camera shake correction program 203 is executed (step S4). When the shutter button is pressed in this state, a plurality of pieces of image data are acquired within this exposure time (step S5), and the vibration of the mobile terminal main body within this exposure time output from the vibration detection unit 107 is previously detected. It is determined whether or not the set threshold value is exceeded (step S6).

  If it is determined in step S6 that the vibration exceeds a preset threshold value (step S6, Yes), a predetermined camera shake correction process is performed on the acquired plurality of image data, and then image synthesis is performed. Then, one shot image is generated (step S7). On the other hand, if it is determined in step S6 that the vibration is equal to or less than the preset threshold value (step S6, No), the image synthesis is performed as it is without performing the camera shake correction process on the plurality of acquired image data. Go to one shot image (step S9).

  The captured image obtained in step S7, step S9, or step S10 is stored in the memory 106 (step S8) and displayed on the display unit 103 as necessary.

  According to the present embodiment, when the camera shake correction program 203 is executed, when the shutter button is pressed, it is determined whether camera shake has occurred during acquisition of a plurality of pieces of image data within the exposure time, If there is no camera shake, the camera shake correction process is not performed on the acquired multiple pieces of image data, and the acquired multiple pieces of image data are combined as they are, so there is no camera shake. Nevertheless, it is possible to suppress degradation of the captured image caused by the camera shake correction process, and to reduce the power consumption accompanying the complicated camera shake correction process.

  Further, according to the present embodiment, even when the camera shake correction function is set to ON, normal shooting that does not automatically use the camera shake correction function when the exposure time for shooting is a predetermined value or less. Since the mode is switched, it is possible to reduce power consumption associated with the deterioration of the captured image and the camera shake correction due to the careless operation of the camera shake correction function.

  FIG. 4 is a functional block diagram of a camera-equipped mobile terminal having a camera shake correction function according to the second embodiment of the present invention.

  The camera-equipped mobile terminal 20 having the camera shake correction function according to the present embodiment has a mobile phone function, and includes a vibration notification function (vibration notification unit 108) as a notification function for incoming calls and the like. Other configurations are the same as those of the embodiment shown in FIG.

  The camera-equipped mobile terminal 20 having the camera shake correction function according to the present embodiment is characterized in that the operation of the vibration notification unit 108 is temporarily stopped during shooting. That is, if the vibration notification unit 108 operates during shooting, it is impossible to specify camera shake caused by the photographer. Furthermore, since vibration of the vibration notification unit 108 generates vibration that cannot be absorbed even by the camera shake correction process, incoming notification by the vibration notification unit 108 is invalidated during shooting.

  FIG. 5 is a processing flowchart of image capturing in the second embodiment shown in FIG.

  In the image photographing process of this embodiment, in addition to the process in the first embodiment shown in FIG. 3, a vibration notification process pause process (step S11) and a vibration notification process return process (step S12) are added. Since it is the same as that of 1st Embodiment except the point which has it, only operation | movement of the characteristic part of this embodiment is demonstrated below.

  First, when a camera activation operation is performed by the user, execution of the camera control program 202 is started (step S1). Next, it is determined whether or not the vibration notification unit 108 is set in the startable state. If the vibration notification unit 108 is set in the startable state, the vibration notification unit 108 sets the start and stop state. (Step S11).

  Therefore, even if an incoming call is received during camera shooting, the vibration notification unit 108 is not activated, and the captured image is not affected by the vibration of the vibration notification unit 108. The photographing operation after step S11 is the same as that of the first embodiment shown in FIG.

  After the camera shooting is completed and the captured image obtained in step S7, step S9, or step S10 is stored in the memory 106 (step S8), the return operation of the vibration notification unit 108 activation state stop process is performed (step S8). S12). That is, if the vibration notification unit 108 is set in the startable state at the time when the execution of the camera control program 202 is started (step S1), the vibration notification unit 108 is returned to the startable state.

It is a functional block diagram of the portable terminal with a camera which has the camera-shake correction function which shows the 1st Embodiment of this invention. It is a figure which shows the content of the program memorize | stored in the memory with which the portable terminal with a camera of this embodiment is provided. It is a process flowchart of the imaging | photography in the portable terminal of this embodiment. It is a functional block diagram of the portable terminal with a camera which has the camera-shake correction function which shows the 2nd Embodiment of this invention. It is a processing flowchart of the image shooting in the portable terminal of the embodiment shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10,20 Mobile terminal 101 Radio | wireless part 102 Control part 103 Display part 104 Operation part 105 Camera 106 Memory 107 Vibration detection part 108 Vibration alerting | reporting part

Claims (5)

A plurality of frame images are acquired by one shooting, a predetermined camera shake correction process is performed on the acquired plurality of frame images, and a plurality of frame images after processing are combined to generate one shot image. In a camera-equipped mobile terminal having a camera shake correction function for performing
When the vibration detected by the vibration detection unit during shooting for acquiring the plurality of frame images is less than a predetermined threshold, the predetermined camera shake correction process A camera-equipped mobile terminal having a camera shake correction function, comprising: a unit that performs a process of combining the obtained plurality of frame images as they are without performing the process to obtain one photographed image.   A switch for controlling ON / OFF of the operation of the camera shake correction function is provided. When the switch is ON, a shooting mode by the camera shake correction function is set, and when the switch is OFF, the camera shake correction is performed. 2. The camera-equipped mobile terminal having a camera shake correction function according to claim 1, wherein a normal shooting mode that does not use the function is set.   In the shooting mode in which the camera shake correction function operation is set, the camera includes a means for switching to a normal shooting mode not using the camera shake correction function when an exposure time for the shooting is a predetermined value or less. A camera-equipped mobile terminal having the camera shake correction function according to claim 1.   The mobile terminal is a mobile phone having an incoming call notification means for notifying an incoming call by vibration, and has means for stopping the incoming call notification by the vibration when the camera photographing mode is set. Item 4. A camera-equipped mobile terminal having the camera shake correction function according to any one of Items 1 to 3. Means for acquiring a plurality of frame images by one shooting of a computer provided in a camera-equipped portable terminal having a camera shake correction function, and vibration detection of the portable terminal during shooting for acquiring the plurality of frame images When the vibration detected by the unit is equal to or greater than a predetermined threshold value, a predetermined camera shake correction process is performed on the acquired plurality of frame images, and a plurality of frame images after the processing are combined to produce one captured image And when the vibration detected by the vibration detection unit of the mobile terminal during photographing for acquiring the plurality of frame images is less than a predetermined threshold, the predetermined image stabilization processing is not performed. A program for functioning as a means for synthesizing a plurality of acquired frame images as they are to generate one captured image.

Images