JP2014007558A - Imaging apparatus and program - Google Patents

Abstract

When a mechanical shutter is repeatedly driven to take an image, the useful life of the mechanical shutter is shortened.
An imaging device includes an imaging device, a mechanical shutter, an imaging control unit that causes the imaging device to repeatedly perform imaging at a predetermined time interval, a detection unit that detects a relative movement of a subject with respect to the imaging device, When repeatedly capturing images at predetermined time intervals by exposure control using the electronic shutter function, the shutter is switched from exposure control using the electronic shutter function to exposure control using the mechanical shutter according to the detected relative movement of the subject. Images of a plurality of image data obtained by repeatedly taking images at predetermined time intervals by exposure control by the control unit, electronic shutter function and mechanical shutter are reproduced at a time interval shorter than the predetermined time interval. A moving image generating unit that generates moving image data.
[Selection] Figure 3

Description

  The present invention relates to an imaging apparatus and a program.

A technique for driving a mechanical shutter immediately after driving an electronic shutter when a 3 V power signal is input to a motor driver when the electronic shutter is driven is known (see, for example, Patent Document 1).
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP 2006-5787 A

  For example, when an imaging operation is repeatedly performed for a long time as in time-lapse photography, if the mechanical shutter is driven in each imaging operation, the useful life of the mechanical shutter is shortened.

  In the first aspect of the present invention, an imaging device includes an imaging device whose exposure is controlled by sequential scanning using an electronic shutter function, and a mechanical shutter that controls exposure by opening and closing an optical path of subject light incident on the imaging device. An imaging control section that causes the imaging device to repeatedly capture images at a predetermined time interval, a detection section that detects relative movement of the subject with respect to the imaging device, and a time interval that is predetermined by exposure control using an electronic shutter function. When repeatedly capturing images, a shutter control unit that switches from exposure control using an electronic shutter function to exposure control using a mechanical shutter according to the relative movement of the subject with respect to the imaging device detected by the detection unit, an electronic shutter function, and It is possible to repeatedly capture images at predetermined time intervals by exposure control using a mechanical shutter. Images of a plurality of image data obtained by the, and a moving image generation unit for generating a moving image data reproduced at short time intervals than the predetermined time interval.

  In the second aspect of the present invention, the program includes an imaging control step in which an imaging element whose exposure is controlled by sequential scanning using an electronic shutter function repeatedly captures images at a predetermined time interval, and a relative of the subject to the imaging device. An electronic shutter function according to the relative movement of the subject with respect to the imaging device detected in the detection step, when detecting repeatedly at a predetermined time interval by exposure control by the electronic shutter function The exposure control by switching to the exposure control by the mechanical shutter that controls the exposure by opening and closing the optical path of the subject light incident on the image sensor, and the shutter control step for imaging and the exposure control by the electronic shutter function and the mechanical shutter in advance. To repeatedly capture images at a set time interval Images of a plurality of image data obtained Ri is, to execute the moving image generation step of generating a moving image data reproduced at short time intervals than the predetermined time interval to the computer.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

1 shows an example of a system configuration of an imaging apparatus 10. An example of operation | movement in time-lapse photography mode is shown typically. An example of an imaging operation when exposure control is performed by driving the mechanical shutter 143 is shown. An example of an imaging operation when performing dark exposure will be described. 2 shows a processing flow from the start to the end of the imaging apparatus 10. An example of the flow of the imaging operation in time-lapse photography mode is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows an example of the system configuration of the imaging apparatus 10. The imaging device 10 is an interchangeable lens camera as an example. This figure shows a block configuration of the imaging apparatus 10 with the lens unit 120 attached.

  The lens unit 120 includes a lens mount having a lens mount contact 121. The camera body 130 includes a camera mount having a camera mount contact 131. When the lens mount and the camera mount are engaged and the lens unit 120 and the camera body 130 are integrated, the lens mount contact 121 and the camera mount contact 131 are connected. The lens MPU 123 is connected to the camera MPU 140 via the lens mount contact 121 and the camera mount contact 131, and controls the lens unit 120 in cooperation with each other while communicating with each other.

  The lens unit 120 includes a lens group 122, a lens driving unit 124, and a lens MPU 123. The subject light passes through the lens group 122 as an optical system of the lens unit 120 along the optical axis and enters the camera body 130. The main mirror 145 can take an oblique state where the main mirror 145 is obliquely provided in the subject light flux centered on the optical axis of the lens group 122 and a retreat state where the main mirror 145 is retracted from the subject light flux.

  When the main mirror 145 is in an oblique state, the main mirror 145 reflects a part of the subject light flux that has passed through the lens group 122. Specifically, the region near the optical axis of the main mirror 145 in the oblique state is formed as a half mirror. Part of the subject luminous flux incident on the region near the optical axis is transmitted and the other part is reflected. The subject luminous flux reflected by the main mirror 145 is guided to the finder unit 147 and observed by the user. The user can check the composition and the like through the finder unit 147. The finder unit 147 may include a display device that presents various types of information including information indicating the setting state of the imaging operation to the user, along with the subject image based on the subject luminous flux.

  Part of the subject luminous flux that has passed through the region near the optical axis of the main mirror 145 is reflected by the sub mirror 146 and guided to the AF unit 142. The AF unit 142 includes a plurality of photoelectric conversion element arrays that receive a subject light beam. The photoelectric conversion element array outputs a signal with a phase match when in a focused state, and outputs a signal with a phase shift when in a front pin state or a rear pin state. The amount of phase shift corresponds to the amount of shift from the focus state. The AF unit 142 detects a phase difference by performing a correlation operation on the output of the photoelectric conversion element array, and outputs a phase difference signal indicating the phase difference to the camera MPU 140.

  The focus state of the lens group 122 is adjusted using the phase difference signal from the AF unit 142 under the control of the camera MPU 140 and the like. For example, the target position of the focus lens included in the lens group 122 is determined by the camera MPU 140 based on the focus state detected from the phase difference signal, and the position of the focus lens is controlled by the control of the lens MPU 123 toward the determined target position. Is done. Specifically, the lens MPU 123 controls the lens driving unit 124 including a focus lens motor as an example, and moves the focus lens constituting the lens group 122. As described above, when the main mirror 145 is down and in the inclined state, the focus state of the lens group 122 is detected by the phase difference detection method, and the focus adjustment is performed. The AF unit 142 is provided with photoelectric conversion element arrays at a plurality of positions respectively corresponding to the plurality of regions in order to adjust the focus state in each of the plurality of regions in the subject image.

  The photometric element 144 receives a part of the light beam guided to the optical viewfinder. The luminance information of the subject detected by the photoelectric conversion element included in the photometric element 144 is output to the camera MPU 140. The camera MPU 140 calculates an AE evaluation value based on the luminance information acquired from the photometric element 144 and uses it for exposure control.

  When the main mirror 145 retracts from the subject light beam, the sub mirror 146 retracts from the subject light beam in conjunction with the main mirror 145. A mechanical shutter 143 is provided on the lens group 122 side of the image sensor 132. The mechanical shutter 143 functions as a focal plane shutter. When the main mirror 145 is in the retracted state and the mechanical shutter 143 is in the open state, the subject luminous flux transmitted through the lens group 122 is incident on the light receiving surface of the image sensor 132. The mechanical shutter 143 controls exposure by opening and closing an optical path of subject light incident on the image sensor 132.

  The imaging element 132 functions as an imaging unit. The image sensor 132 has an electronic shutter function. The exposure of the image sensor 132 can be controlled by sequential scanning using an electronic shutter function. The image sensor 132 captures an image of the subject using the subject light flux that has passed through the lens group 122. The image sensor 132 includes a solid-state image sensor such as a CMOS sensor, for example. The imaging element 132 has a plurality of photoelectric conversion elements that receive the subject light flux, and outputs an analog signal corresponding to the amount of accumulated charge generated by each of the plurality of photoelectric conversion elements to the analog processing unit 133. The analog processing unit 133 performs analog processing such as sensitivity correction processing and OB clamping processing on the analog signal output from the image sensor 132 and outputs the analog signal to the A / D converter 134. The A / D converter 134 converts the analog signal output from the analog processing unit 133 into a digital signal representing image data and outputs the digital signal. The image sensor 132, the analog processing unit 133, and the A / D converter 134 are driven by a driving unit 148 that receives an instruction from the camera MPU 140.

  Image data output as a digital signal from the A / D converter 134 is input to the ASIC 135. The ASIC 135 is an integrated circuit in which circuits related to the image processing function are integrated into one. The ASIC 135 uses at least a part of the memory area of the RAM 136 as an example of a volatile memory as a buffer area for temporarily storing image data, and performs various image processing on the image data stored in the RAM 136. Apply. Examples of the image processing by the ASIC 135 include defective pixel correction, white balance correction, color interpolation processing, color correction, gamma correction, contour enhancement processing, and image data compression processing. When the image sensor 132 continuously captures images, sequentially output image data is sequentially stored in the buffer area. A plurality of image data obtained by continuously capturing images by the image sensor 132 is sequentially stored in the buffer area as image data of continuous still images or image data of each image constituting the moving image. The RAM 136 also functions as a frame memory that temporarily stores frames when the ASIC 135 processes moving image data.

  Examples of image processing in the ASIC 135 include processing for generating image data for recording, processing for generating image data for display, and image data processing for automatic focus adjustment (AF). Further, the image processing in the ASIC 135 includes processing for detecting the contrast amount for AF processing and the like. Specifically, the ASIC 135 detects the contrast amount from the image data and supplies it to the camera MPU 140. For example, the ASIC 135 detects the contrast amount from each of a plurality of image data obtained by imaging with the focus lens positioned at different positions in the optical axis direction. The camera MPU 140 adjusts the focus state of the lens group 122 based on the detected contrast amount and the position of the focus lens. For example, the camera MPU 140 determines the target position of the focus lens so as to increase the amount of contrast, and causes the lens MPU 123 to control the position of the focus lens toward the determined target position. As described above, when the main mirror 145 is up and in the retracted state, the focus state of the lens group 122 is detected by the contrast detection method, and the focus adjustment is performed. As described above, the camera MPU 140 performs the focus adjustment of the lens group 122 in cooperation with the ASIC 135 and the lens MPU 123.

  When recording the image data output from the A / D converter 134, the ASIC 135 converts the image data into a standardized image format. For example, the ASIC 135 performs a compression process for generating still image data obtained by encoding still image data in an encoding format compliant with a standard such as JPEG. Further, the ASIC 135 converts a plurality of frames into QuickTime, H.264, and the like. H.264, MPEG2, Motion JPEG, etc. A compression process for generating moving image data encoded by an encoding method compliant with a standard such as JPEG is performed. The ASIC 135 outputs and records the generated image data such as still image data and moving image data to an external memory 180 as an example of a nonvolatile recording medium. For example, the ASIC 135 records in the external memory 180 as a still image file and a moving image file. An example of the external memory 180 is a semiconductor memory such as a flash memory. Specifically, as the external memory 180, various memory cards such as an SD memory card, a CF storage card, and an XQD memory card can be exemplified. The image data stored in the RAM 136 is transferred to the external memory 180 through the recording medium IF 150. The image data recorded in the external memory 180 is transferred to the RAM 136 through the recording medium IF 150 and stored in the RAM 136. Examples of the recording medium IF 150 include a card controller that controls access to the above-described memory card.

  The ASIC 135 generates display image data in parallel with the generation of recording image data. For example, the ASIC 135 generates display image data to be displayed on the display unit 138 during a so-called live view operation. Further, at the time of image reproduction, the ASIC 135 generates image data for display from the image data read from the external memory 180. The generated image data for display is converted into an analog signal under the control of the display control unit 137 and displayed on the display unit 138 such as a liquid crystal display. In addition to image display based on image data obtained by imaging, various menu items related to various settings of the imaging device 10 are also displayed under the control of the ASIC 135 and the display control unit 137 without performing image display based on the image data. Part 138 is displayed.

  The external device IF 152 is responsible for communication with the external device. The image data recorded in the external memory 180 is transferred to the external device through the external device IF 152. The external device IF 152 may communicate with the external device by USB communication. The external device IF 152 may include a USB device controller.

  The GPS unit 158 as an example of the position detection device receives a signal from a GPS satellite and outputs a signal indicating the position information of the GPS unit 158 to the ASIC 135. Examples of position information include latitude, longitude, and altitude information. The ASIC 135 causes the external memory 180 to record an image file including image data and position information.

  The imaging apparatus 10 is controlled directly or indirectly by the camera MPU 140 and the ASIC 135 including the control described above. Constants, parameters such as variables, programs, and the like necessary for the operation of the imaging apparatus 10 are stored in the system memory 139. The system memory 139 is an electrically erasable / storable nonvolatile memory, and is configured by, for example, a flash ROM, an EEPROM, or the like. The system memory 139 stores parameters, programs, and the like so that they are not lost even when the imaging apparatus 10 is not operating. Parameters, programs, and the like stored in the system memory 139 are expanded in the RAM 136 and used for controlling the imaging apparatus 10. The ASIC 135, the RAM 136, the system memory 139, the display control unit 137, the camera MPU 140, the external device IF 152, and the GPS unit 158 in the camera main body 130 are connected to each other via a connection interface 149 such as a bus and exchange various data.

  The operation input unit 141 receives an operation from the user. The operation input unit 141 includes a release button. In addition, the operation input unit 141 includes various operation members such as a playback button, a live view switch, a moving image button, and a power switch. Further, the operation input unit 141 may include an input member that is integrated with the display unit 138 as a touch panel or the like. The camera MPU 140 detects that the operation input unit 141 has been operated, and executes an operation corresponding to the operation. For example, the camera MPU 140 controls each unit of the imaging device 10 so as to execute an imaging operation when a release button is pressed. In addition, the camera MPU 140 controls each unit of the imaging device 10 to perform an operation according to the menu item displayed on the display unit 138 and the operation content when an input member mounted as a touch panel is operated.

  Each part of the camera body 130, each part of the lens unit 120, and the external memory 180 are supplied with power from the power supply 190 via the power supply circuit 192. Examples of the power source 190 include a secondary battery such as a lithium ion battery that can be attached to and detached from the camera body 130, a system power source, and the like. The secondary battery is an example of a battery, and the battery includes a non-rechargeable battery that cannot be substantially charged. The camera MPU 140 controls the power supply from the power supply 190 to each unit of the imaging apparatus 10 by controlling the power supply circuit 192.

  FIG. 2 schematically shows an example of the operation in the time-lapse shooting mode. The imaging device 10 has a moving image mode and a time-lapse shooting mode as imaging modes. In both the moving image mode and the time-lapse shooting mode, moving image data is generated and recorded in the external memory 180. The outline of the operation in the time-lapse shooting mode will be described with reference to FIG.

  When the imaging mode is set to the time-lapse shooting mode, the camera MPU 140 causes the image sensor 132 to capture images at predetermined time intervals. Specifically, the camera MPU 140 repeats the still image capturing operation for a predetermined duration. In the example of this figure, the still image capturing operation is repeated over an hour at intervals of 10 seconds. Each image data of the images 200-1 to 200 -N obtained by each imaging operation is sequentially recorded in the external memory 180. The ASIC 135 generates one moving image data 250 from the image data of the images 200-1 to 200-N recorded in the external memory 180.

  Time-lapse photography is suitably used in a scene where, for example, a phenomenon that changes relatively slowly is recorded as still image data in a state where the position and imaging direction of the imaging device 10 are fixed. In time-lapse photography, the imaging device 10 converts the image data of a plurality of still images obtained by imaging into a moving image. For example, moving image data in which a display rate higher than a still image capturing rate is defined as the specified display rate is generated. This animation enables the user to observe the change in the event in a short time.

  Here, the difference between the moving image mode and the time-lapse shooting mode will be briefly described. In the time-lapse shooting mode, moving image data in which a reproduction time is defined to be shorter than a duration time during which imaging is continued is generated. On the other hand, when the number of frames acquired per second is set to 30 frames, for example, in the moving image mode, the generated moving image data is reproduced at a standard display rate of 30 frames per second even during reproduction. That is, in the moving image mode, the time axis at the time of imaging and the time axis at the time of reproduction substantially coincide. In the moving image mode, imaging is performed in synchronism with the real time of display. On the other hand, in the time-lapse shooting mode, for example, one frame of still image is captured at intervals of 10 seconds to generate moving image data. For example, moving image data of 360 frames is generated by time-lapse photography for 1 hour. However, the moving image data is reproduced at a display rate of 30 frames per second as a standard at the time of reproduction. Therefore, the reproduction of the moving image data is completed in about 12 seconds. That is, in the time-lapse shooting mode, the time axis at the time of imaging is compressed at the time of reproduction. In other words, according to the time-lapse shooting mode, it can be said that the imaging interval when capturing each still image is longer than the imaging interval in the normal moving image mode. Note that the duration of imaging in time-lapse photography indicates the time from the first still image imaging operation to the last still image imaging operation. That is, the time lapse duration includes a time during which a still image is not exposed by the image sensor 132 while a still image is captured.

  FIG. 3 shows an example of an imaging operation when exposure control is performed by driving the mechanical shutter 143. In the description of the present embodiment, image data used for generating moving image data may be referred to as main image data, and a still image captured to generate main image data may be referred to as a main image.

The camera MPU 140 uses the electronic shutter function to open a plurality of images with the mechanical shutter 143 in the open state after the time t _m−1 that is the imaging timing of the main image and before the time t _m that is the imaging timing of the next main image. The imaging operation is performed once. Note that an image captured by the imaging operation may be referred to as a preliminary image. Further, it is assumed that the main image at time t _m−1 is captured by the electronic shutter function.

  The ASIC 135 analyzes the image data of the plurality of preliminary images and detects the relative movement of the subject with respect to the imaging device 10. Specifically, the ASIC 135 analyzes image data of a plurality of preliminary images and detects a temporal change of the subject. For example, the ASIC 135 calculates a difference amount between a plurality of preliminary images from the preliminary image data. The ASIC 135 determines that the subject has a temporal change when the difference amount exceeds a predetermined value. Further, the ASIC 135 extracts objects of the same subject from the plurality of preliminary image data, and calculates the amount of movement of the object over the period when the plurality of preliminary images are captured. When the movement amount exceeds a predetermined value, the ASIC 135 determines that there is a temporal change in the subject.

  If it is determined that there is a temporal change in the subject, the camera MPU 140 closes the mechanical shutter 143 and starts resetting the accumulated charge of each pixel line of the image sensor 132. When the resetting of all the pixel lines is completed, the mechanical shutter 143 is opened. Then, the mechanical shutter 143 is closed at a timing when a predetermined exposure time has elapsed after the mechanical shutter 143 is opened. Then, the ASIC 135 reads image data from the image sensor 132 and generates image data of the main image 200-m. The image data of the main image 200-m is used for generating moving image data together with other main image data including the main image 200-m-. Note that the exposure time for capturing the main image may be determined by the camera MPU 140 based on the brightness evaluation value calculated from at least one of the plurality of preliminary images. The brightness evaluation value may be calculated by the ASIC 135.

  In the example of this figure, the case where the movement of the subject is detected and the mechanical shutter 143 is driven to perform the imaging operation has been described. When the movement of the subject is not detected, the camera MPU 140 drives the image sensor 132 by sequential exposure using the electronic shutter function while keeping the mechanical shutter 143 open.

  As described above, the camera MPU 140 causes the image sensor 132 to repeatedly capture images at predetermined time intervals. The ASIC 135 detects the relative movement of the subject with respect to the imaging device when the imaging is repeatedly performed at predetermined time intervals. Specifically, the camera MPU 140 allows a plurality of images to be captured by the image sensor 132 at a time interval shorter than a predetermined time interval while leaving the optical path of the subject light open to the mechanical shutter 143 before each imaging timing for repeated imaging. The preliminary image is taken. The ASIC 135 detects a change in the subject based on the image data of a plurality of preliminary images. The camera MPU 140 switches the exposure control by the electronic shutter function to the exposure control by the mechanical shutter 143 in accordance with the relative movement of the subject with respect to the imaging device 10 detected by the ASIC 135, and causes the camera MPU 140 to capture images. For example, when the relative movement of the subject with respect to the imaging apparatus 10 is detected, the camera MPU 140 causes the imaging device 132 to capture an image by exposure control by the mechanical shutter 143 instead of exposure control by the electronic shutter function. Then, the ASIC 135 has images of a plurality of image data obtained by repeatedly capturing images at predetermined time intervals by exposure control by the electronic shutter function and the mechanical shutter 143 at a time interval shorter than the predetermined time interval. Generate video data to be played back.

  The ASIC 135 detects the magnitude of change of the subject based on the image data of a plurality of preliminary images, and the camera MPU 140 detects the length of time required for sequential scanning by the electronic shutter function and the magnitude of change detected by the ASIC 135 unit. Based on the above, it may be determined whether or not imaging is performed by exposure control by the mechanical shutter 143. For example, the camera MPU 140 causes the mechanical shutter 143 to take an image when the ratio of the magnitude of the change detected by the ASIC 135 to the time length required for sequential scanning by the electronic shutter function is larger than a predetermined value. It's okay. The time length required for the sequential scanning may be, for example, the time required to reset the accumulated charges of all the pixel lines. Therefore, the ratio of the magnitude of the change of the subject to the time length required for the sequential scanning corresponds to the so-called rolling distortion. Therefore, it is possible to determine whether or not to perform exposure control by the mechanical shutter 143 in consideration of the magnitude of rolling distortion.

  FIG. 4 shows an example of an imaging operation when performing dark exposure. As described above, the camera MPU 140 determines the exposure time when the main image is captured at the time tn based on the brightness evaluation value calculated from the image data of the preliminary image. The camera MPU 140 causes the image sensor 132 to perform a dark exposure operation when the determined exposure time is longer than a predetermined time. Specifically, the camera MPU 140 reads the dark exposure image 400 by closing the mechanical shutter 143 and resetting and reading the accumulated charge of the image sensor 132. The ASIC 135 generates image data of a difference image obtained by subtracting the dark exposure image 400 from the main image 200-n as main image data after dark current correction, and records it in the external memory 180. The main image data after dark current correction is used for generating moving image data together with other main image data including the image data of the main image 200-n-1.

  As described above, the camera MPU 140 determines whether or not dark current correction is necessary for at least one image obtained by repeated imaging, and if it determines that dark current correction is necessary, the camera MPU 140 is previously set. A dark exposure operation is performed by accumulating charges in the image sensor 132 after being closed for a predetermined time. Then, when it is determined that dark current correction is necessary, the ASIC 135 uses the image data obtained by the dark exposure operation to apply dark current to the image data of the image determined to require dark current correction. Make corrections. Specifically, when it is determined that dark current correction is necessary, the camera MPU 140 captures an image that is a target of dark current correction and before a predetermined time interval elapses. A dark exposure operation is performed. Note that, as illustrated in this figure, the image that is subject to dark current correction may be an image that is captured by exposure control using the electronic shutter function. In some cases, the number of times the mechanical shutter 143 is driven can be reduced by capturing an image subjected to dark current correction by exposure control using an electronic shutter function. However, the image subjected to dark current correction may be an image captured by exposure control using the mechanical shutter 143. For example, when the last main image is captured by the electronic shutter, the mechanical shutter 143 may be kept open and the main image to be dark current corrected may be captured by exposure control of the electronic shutter. On the other hand, when the last main image is captured by the exposure control of the mechanical shutter 143, the main image to be dark current corrected may be captured by the exposure control by the mechanical shutter 143.

  FIG. 5 shows a processing flow from the start to the end of the imaging apparatus 10. This flow is started, for example, when a power switch as a part of the operation input unit 141 is switched to the ON position. This flow is executed by controlling each part of the imaging apparatus 10 mainly by the camera MPU 140.

  In step S500, the camera MPU 140 starts up an operating system (OS). Specifically, parameters for controlling the imaging device 10, activation code, OS, and the like are expanded from the system memory 139 to the RAM 136, and the camera MPU 140 executes the activation code and shifts to control by the OS. In step S <b> 502, the camera MPU 140 performs initial setting of the imaging device 10. For example, the camera MPU 140 sets the operation condition of the imaging apparatus 10 based on the state of the imaging mode dial or the like as a part of the operation input unit 141 according to the developed parameters, programs, and the like. Examples of the operating conditions include a shooting mode, an imaging condition, a recording condition, and the like. Examples of the shooting mode include a continuous shooting mode and a single shooting mode. Examples of imaging conditions include exposure time, aperture value, imaging sensitivity, and the like. Examples of the recording conditions include the number of recording pixels.

  Subsequently, in step S504, the camera MPU 140 causes the display unit 138 to display the content set in the initial setting. For example, the camera MPU 140 causes the display unit 138 to display information such as an imaging mode, an imaging condition, and a recording condition in various formats such as icon display.

  Subsequently, in step S506, the camera MPU 140 determines the type of event that has occurred. Various events are generated by operations on the operation input unit 141. Here, a setting event generated by an operation instructing a setting operation, a reproduction event generated by an operation instructing a reproduction operation, and an imaging event generated in response to an operation instructing an imaging operation will be described.

  A setting event occurs when an operation of a setting button as a part of the operation input unit 141 is detected. When a setting event occurs, the camera MPU 140 performs the setting process corresponding to the instruction content (step S510). In this setting process, the operating conditions of the imaging device 10 are set according to the instruction content. For example, when an instruction to change the imaging mode to the time-lapse shooting mode is given, the operation setting of each part of the imaging device 10 is set to the time-lapse shooting mode. In addition, the imaging interval of the main image in time-lapse photography and the duration of time-lapse photography are set. When the operation setting is changed, the parameter variable is changed according to the changed operation setting.

  A playback event occurs when an operation of a playback button as a part of the operation input unit 141 is detected. When a playback event occurs, the camera MPU 140 executes the instructed playback process based on a user operation on the operation input unit 141 (step S512). The reproduction processing includes processing for displaying a list of images based on image data such as still images and moving images recorded in the external memory 180, processing for accepting selection of image data, and display on the display unit 138 based on image data selected by the user. The process etc. which display an image can be illustrated.

  An imaging event occurs when an operation of a release button, a live view button, or a moving image recording button as a part of the operation input unit 141 is detected. When an imaging event occurs, the camera MPU 140 performs an imaging process according to an instruction (step S514).

  When the processes of step S510, step S512, and step S514 are completed, it is determined whether or not to turn off the power (step S522). For example, when there is no event to be processed and no new event has occurred for a predetermined period after the imaging apparatus 10 starts operating, it is determined that the power is turned off. It is also determined that the power is turned off when the power switch is set to the OFF position. If it is determined not to turn off the power, the process proceeds to step S506. If it is determined that the power is to be turned off, necessary processing is performed before the power is turned off (step S524). As this process, a process of storing information such as a changed parameter variable in the system memory 139 can be exemplified. When the process of step S524 is completed, this flow ends.

  FIG. 6 shows an example of the flow of the imaging operation in the time lapse photography mode. This flow can be applied to a part of the processing in step S514. This flow is executed by controlling each part of the imaging apparatus 10 mainly by the camera MPU 140. This flow is started when pressing of the release button is detected in a state where the imaging mode is set to the time-lapse shooting mode.

  In step S602, when the mechanical shutter 143 is closed, the camera MPU 140 opens the mechanical shutter 143. Subsequently, the camera MPU 140 performs a preliminary image capturing operation (step S604). The ASIC 135 analyzes the image data of a plurality of preliminary images and determines whether there is a change in the subject (step S606).

  If it is determined in step S606 that there is no change in the subject, the camera MPU 140 causes the electronic shutter function to sequentially perform exposure (step S608). Subsequently, in step S610, the ASIC 135 reads the main image data (step S610). Subsequently, the camera MPU 140 determines whether or not dark exposure is necessary (step S622).

  If it is determined in step S622 that dark exposure is necessary, the camera MPU 140 closes the mechanical shutter 143 when the mechanical shutter 143 is open (step S624), and resets the accumulated charge for each pixel line. Reading is performed (step S626). Then, the ASIC 135 performs the dark current correction process read in step S626 on the image data read in step S610 (step S628). Then, the ASIC 135 records the main image data subjected to the dark current correction in the external memory 180 (step S630). If it is determined in step S622 that dark exposure is not necessary, the process proceeds to step S630, and the main image data is recorded in the external memory 180.

  In step S632, the camera MPU 140 determines whether or not to finish the time-lapse shooting. For example, if it is determined that a time equal to or longer than the set duration has elapsed since the start of the repetitive imaging operation for time-lapse photography, it is determined that time-lapse photography is to be terminated. If it is determined that the time-lapse shooting is to be ended, moving image data is generated from the main image data (step S634), and the time-lapse shooting operation is ended. If it is determined in step S632 that the time-lapse shooting is not to be ended, after waiting for a time until the next preliminary image capturing operation is started (step S636), the process proceeds to step S602.

  When the movement of the subject is detected in step S606, the camera MPU 140 closes the mechanical shutter 143 (step S642), and starts resetting the accumulated charge for each pixel line (step S644). When each pixel line is reset, the mechanical shutter 143 is opened (step S646), and when the exposure time has elapsed, the mechanical shutter 143 is closed (step S648). Subsequently, in the ASIC 135, the camera MPU 140 reads the main image data from the image sensor 132 (step S650), and shifts the processing to step S622.

  According to the imaging apparatus 10 described above, the number of times the mechanical shutter 143 is driven can be reduced in an imaging mode in which a large number of imaging operations are performed at once. For example, the mechanical shutter 143 is driven only when rolling distortion is expected or when the subject situation requires dark current correction. For this reason, compared with the case where this control is not performed, the mechanical shutter 143 is not driven wastefully. Therefore, the possibility that the mechanical shutter 143 breaks down can be reduced, and as a result, the useful life of the mechanical shutter 143 can be extended. When the rolling distortion is expected to be small, exposure control is performed with the electronic shutter function, so that a natural time-lapse moving image can be provided without the rolling distortion becoming noticeable.

  In the above description, it is assumed that a change in the subject is detected based on the preliminary image. However, a sensor that detects the movement of the imaging apparatus 10 itself may be provided in the imaging apparatus 10, and the amount of movement of the imaging apparatus 10 itself may be detected as the relative movement of the subject with respect to the imaging apparatus 10. Examples of the sensor include a gyro sensor.

  In the above description, the processing described as the operation of the camera MPU 140 is realized by the camera MPU 140 controlling each hardware included in the imaging apparatus 10 according to a program. In the above description, the processing realized by the ASIC 135 can be realized by a processor. For example, the processing described as the operation of the ASIC 135 is realized by the processor controlling each hardware included in the imaging apparatus 10 according to the program. That is, the processing described in relation to the imaging device 10 of the present embodiment is performed by the processor operating according to the program to control each hardware, so that each hardware including the processor, the memory, and the like cooperates with the program. It can be realized by operating. That is, the process can be realized by a so-called computer device. The computer device may load a program for controlling the execution of the above-described process, operate according to the read program, and execute the process. The computer device can load the program from a computer-readable recording medium storing the program.

  In the present embodiment, the imaging apparatus 10 with the lens unit 120 attached is taken up as an example of the imaging apparatus. However, the imaging device is a concept including the camera body 130 to which the lens unit 120 is not attached. As an imaging device, in addition to a single-lens reflex camera that is an example of an interchangeable lens camera, a compact digital camera that is an example of a non-interchangeable camera, a mirrorless camera, a video camera, a mobile phone with an imaging function, imaging Various electronic devices having an imaging function, such as a portable information terminal with a function and an entertainment device such as a game machine with an imaging function, can be applied.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

  DESCRIPTION OF SYMBOLS 10 Imaging device, 120 Lens unit, 121 Lens mount contact, 122 Lens group, 123 Lens MPU, 124 Lens drive part, 130 Camera body, 131 Camera mount contact, 132 Image sensor, 133 Analog processing part, 134 A / D converter , 135 ASIC, 136 RAM, 137 display control unit, 138 display unit, 139 system memory, 140 camera MPU, 141 operation input unit, 142 AF unit, 143 mechanical shutter, 144 photometric element, 145 main mirror, 146 sub mirror, 147 finder , 148 drive unit, 149 connection interface, 150 recording medium IF, 152 external device IF, 158 GPS unit, 180 external memory, 190 power supply, 192 power supply circuit, 200 images, 50 moving image data, 400 image

Claims (7)

An imaging device,
An image sensor whose exposure is controlled by sequential scanning with an electronic shutter function;
A mechanical shutter that controls exposure by opening and closing an optical path of subject light incident on the image sensor; and
An imaging control unit that causes the imaging device to repeatedly capture images at predetermined time intervals;
A detection unit for detecting a relative movement of a subject with respect to the imaging device;
In the case of repeatedly capturing images at the predetermined time interval by exposure control by the electronic shutter function, exposure control by the electronic shutter function is performed according to the relative movement of the subject with respect to the imaging device detected by the detection unit. A shutter control unit for switching to exposure control by the mechanical shutter and imaging,
Images of a plurality of image data obtained by repeatedly capturing images at the predetermined time interval by exposure control by the electronic shutter function and the mechanical shutter are reproduced at a time interval shorter than the predetermined time interval. An imaging apparatus comprising: a moving image generation unit that generates moving image data. The imaging control unit may include a plurality of imaging elements at a time interval shorter than the predetermined time interval, with the optical path of the subject light being opened to the mechanical shutter, before each imaging timing for repeated imaging. Take a preliminary image,
The imaging device according to claim 1, wherein the detection unit detects a change in a subject based on image data of the plurality of preliminary images. The detection unit detects a magnitude of change of the subject based on image data of the plurality of preliminary images,
The said shutter control part judges whether it is made to image by exposure control by the said mechanical shutter based on the time length required for the sequential scanning by the said electronic shutter function, and the magnitude | size of the change which the said detection part detected. 2. The imaging device according to 2. The shutter control unit further determines whether or not dark current correction is necessary for at least one image obtained by repeated imaging, and determines that the mechanical shutter is predetermined when dark current correction is necessary. It is closed only for a given time and the charge is accumulated in the image sensor, so that a dark exposure operation is performed,
The imaging device
When it is determined that the dark current correction is necessary, the image data obtained by the dark exposure operation is used to perform dark current correction on the image data of the image that is determined to require the dark current correction. The imaging device according to claim 1, further comprising a correction processing unit to be applied. When it is determined that the dark current correction is necessary, the shutter control unit captures an image that is a target of the dark current correction, and before the predetermined time interval elapses, The imaging apparatus according to claim 4, wherein the dark exposure operation is performed. The imaging apparatus according to claim 4, wherein the image to be subjected to dark current correction is captured by exposure control using the electronic shutter function. An imaging control step of repeatedly capturing images at predetermined time intervals on an imaging device whose exposure is controlled by sequential scanning with an electronic shutter function;
A detection step of detecting a relative movement of the subject with respect to the imaging device;
In the case of repeatedly capturing images at the predetermined time interval by exposure control by the electronic shutter function, exposure control by the electronic shutter function is performed according to the relative movement of the subject with respect to the imaging device detected in the detection step. A shutter control step for switching to exposure control by a mechanical shutter for controlling exposure by opening and closing an optical path of subject light incident on the imaging element,
Images of a plurality of image data obtained by repeatedly capturing images at the predetermined time interval by exposure control by the electronic shutter function and the mechanical shutter are reproduced at a time interval shorter than the predetermined time interval. A program for causing a computer to execute a moving image generation step for generating moving image data.

Images