JP2020010269A - Image processing device, imaging device, image processing method, program, and storage medium - Google Patents

Abstract

To provide an image processing apparatus capable of effectively suppressing image deterioration due to a focus operation with a simple configuration.SOLUTION: An image processing apparatus (130) includes: a focus control means (131) for controlling a focus lens (151); and magnification correcting means (134) for correcting a magnification of an image acquired via the focus lens (151). The magnification correcting means (134) is configured to correct the magnification on the basis of a subject distance information so that a change in the magnification of the image accompanying a movement of the focus lens (151) is reduced.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing device and an imaging device that correct a change in an angle of view due to a focus operation.

  Generally, an imaging device changes a focal length during a focus operation. For this reason, the angle of view (magnification of an image, that is, image magnification) fluctuates according to the subject distance. Therefore, for example, Patent Document 1 discloses an automatic focusing lens system that corrects the focal length of the entire system by changing another lens group according to a change in the distance between the lens groups due to a focus operation. It has been disclosed. Patent Literature 2 discloses an image processing apparatus that controls a wobbling operation during a focus operation to suppress a change in image magnification.

Japanese Patent No. 2503442 Japanese Patent No. 5705096

  However, in the automatic focusing lens system disclosed in Patent Literature 1, since the lens barrel becomes large, it is difficult to reduce the weight and size of the imaging device. In the image processing device disclosed in Patent Literature 2, it is difficult to secure a sufficient wobbling stroke, and thus it is difficult to focus on a subject when the defocus amount is large.

  Therefore, an object of the present invention is to provide an image processing device, an imaging device, an image processing method, a program, and a storage medium that can effectively suppress image degradation due to a focus operation with a simple configuration. I do.

  An image processing apparatus as one aspect of the present invention includes a focus control unit that controls a focus lens, and a magnification correction unit that corrects a magnification of an image acquired via the focus lens, wherein the magnification correction unit includes: And correcting the magnification based on subject distance information of the image such that a change in magnification of the image accompanying movement of the focus lens is reduced.

  An imaging device according to another aspect of the present invention includes the image processing device and an imaging device that photoelectrically converts an optical image formed via an imaging optical system.

  An image processing method as another aspect of the present invention includes a step of controlling a focus lens and a step of correcting a magnification of an image obtained through the focus lens, and a step of correcting the magnification of the image And correcting the magnification based on subject distance information of the image such that a change in magnification of the image accompanying movement of the focus lens is reduced.

  A program according to another aspect of the present invention causes a computer to execute the image processing method.

  A storage medium according to another aspect of the present invention stores the program.

  Other objects and features of the present invention will be described in the following embodiments.

  According to the present invention, it is possible to provide an image processing device, an imaging device, an image processing method, a program, and a storage medium that can effectively suppress image degradation due to a focus operation with a simple configuration. .

It is a block diagram of an imaging system in this embodiment. 9 is a flowchart of a process of correcting a change in image magnification due to focus in the embodiment. FIG. 5 is an explanatory diagram of a method for calculating a correction value in the embodiment. FIG. 9 is an explanatory diagram of an effect of a process of correcting a change in image magnification due to focus in the embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  First, the configuration of the imaging system according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram of an imaging system (camera-lens system) 10. The imaging system 10 of the present embodiment includes an imaging device (camera body) 100 and a lens device (interchangeable lens) 150 that can be attached to and detached from the imaging device 100 via a lens mount unit 180. However, the present embodiment is not limited to this, and can also be applied to an imaging device configured integrally with the lens device.

  First, the configuration of the imaging device 100 will be described. 101 is a shutter. Reference numeral 102 denotes an image sensor. The imaging element 102 has, for example, a CCD sensor or a CMOS sensor, and photoelectrically converts an optical image (subject image) formed via the lens device 150 to output image data (analog signal). The image sensor 102 may have a plurality of focus detection pixels.

  103 is an image generation unit. The image generation unit 103 converts an analog signal output from the image sensor 102 into a digital signal to generate an image. The image generated by the image generation unit 103 is input to the memory control unit 105 and the image processing unit 140. 104 is a timing generator. The timing generator 104 supplies a clock signal and a synchronization signal to each of the image sensor 102, the image generator 103, the memory controller 105, the system controller 130, and the image processor 140.

  105 is a memory control unit. The memory control unit 105 controls the image generation unit 103, the timing generation unit 104, the image display unit 106, the memory 107, the recording unit 108, and the image processing unit 140. Output data (image) from the image generation unit 103 is written to the memory 107 and the recording unit 108 via the image processing unit 140 and the memory control unit 105.

  Reference numeral 106 denotes an image display unit. The image display unit 106 is configured using an LCD or the like. In the case of an electronic viewfinder (EVF), image data captured using an external display device or an image sensor 102 (not shown) is sequentially displayed to realize an EVF function. During image reproduction, the image display unit 106 displays an image recorded in the memory 107 and the recording unit 108.

  107 is a memory. The memory 107 stores captured still images and moving images, and is also used as a work area of the system control unit 130. Reference numeral 108 denotes a recording unit. The recording unit 108 is configured by a nonvolatile memory that is removable from the inside of the imaging device 100 or from the imaging device 100, and stores a captured still image or moving image.

  110 is a shutter control unit. The shutter control unit 110 controls the shutter 101 in cooperation with the mirror control unit 111 based on a control signal from the system control unit 130. The mirror control unit 111 controls the main mirror 112 based on a control signal from the system control unit 130. The main mirror 112 switches the light beam incident from the lens device 150 between the finder side and the image sensor side. The main mirror 112 is arranged to reflect a light beam so as to always guide the light beam to a finder section (optical finder 114). On the other hand, when photographing is performed, the main mirror 112 jumps upward to guide the light flux to the image sensor 102 and escapes from the optical path. The main mirror 112 is a half mirror so that a central portion thereof can transmit a part of light, and transmits a part of the light flux so as to be incident on a focus detection sensor (not shown) for performing focus detection. May be.

  Reference numeral 113 denotes a pentaprism. The pentaprism 113 guides a light beam incident from the lens device 150 to the optical finder 114. The optical finder 114 is configured by a focus plate (not shown), an eyepiece lens, and the like.

  Reference numeral 115 denotes a shutter switch (switch SW1). The switch SW1 instructs the system control unit 130 to start an operation such as an AF process, an AE process, or an AWB process. Reference numeral 116 denotes a shutter switch (switch SW2). The switch SW2 instructs the system control unit 130 to start exposure. Upon receiving the exposure start instruction, the system control unit 130 controls the lens device 150 via the image sensor 102, the memory control unit 105, the shutter control unit 110, the mirror control unit 111, and the I / F (interface) 120. Then, the image data is recorded in the recording unit 108.

  117 is a camera operation unit. The camera operation unit 117 includes various buttons, a touch panel, a power on / off button, and the like, and outputs an instruction received by a user operation to the system control unit 130. The system control unit 130 performs various functions mounted on the imaging apparatus 100, for example, switching of an operation mode such as an AF mode and an AE mode, according to a user operation via the camera operation unit 117.

  Reference numeral 118 denotes a camera power control unit. The camera power controller 118 manages an external battery and a built-in battery. When the battery is removed or when the remaining battery power is exhausted, the camera power control unit 118 performs an emergency shutdown process of camera control (control of the imaging device 100). At this time, the system control unit 130 cuts off the power supply to the lens device 150. The I / F 120 implements communication using an electric signal between the system control unit 130 in the imaging device 100 and the lens control unit 160 in the lens device 150 via the connector 190, so that the lens device 150 Send and receive information and control commands.

  The system control unit (image processing apparatus) 130 includes an image sensor 102, a memory control unit 105, a shutter control unit 110, a mirror control unit 111, according to signals from the switches SW 1 and SW 2, the memory control unit 105, and the camera operation unit 117. It controls the lens device 150 and the like. As described above, the system control unit 130 controls the entire imaging device 100 based on various control signals. In the present embodiment, the system control unit 130 includes an AF control unit (focus control unit) 131, an AE control unit 132, a lens communication control unit 133, and an image magnification correction control unit (magnification correction unit) 134.

  The AF control unit 131 controls the AF process of the imaging device 100. In the AF processing, a focus lens driving amount is calculated from lens information such as a focus position and a focal length obtained from the lens device 150 via the I / F 120 and an input AF evaluation value in accordance with the AF mode. The focus lens drive amount is input to the lens device 150 via the lens communication control unit 133 and the I / F 120. For example, in the case of the phase difference AF mode (AF using the phase difference detection method), the optical image of the subject is obtained by being incident on a focusing state determination unit (not shown) via the main mirror 112 and a focus detection sub-mirror (not shown). The focus lens driving amount is calculated from the phase difference AF evaluation value and the like. Further, in the case of the contrast AF mode (AF using the contrast detection method), the focus lens driving amount is calculated from the contrast AF evaluation value calculated by the image processing unit 140. In the case of the imaging plane phase difference AF mode (AF using the imaging plane phase difference detection method), the focus lens driving amount is calculated from the imaging plane phase difference AF evaluation values output from the plurality of focus detection pixels of the imaging element 102. Further, the AF control unit 131 switches an AF frame position for calculating an evaluation value according to an AF evaluation mode such as a one-point AF mode, a multi-point AF mode, and a face detection AF mode.

  The AE control unit 132 controls the AE process of the imaging device 100. In the AE processing, according to the AE mode, AE control amounts (aperture control amount, shutter control amount, etc.) are obtained from lens information such as the open F-number and focal length obtained from the lens device 150 via the I / F 120 and the input AE evaluation value. , Exposure sensitivity, etc.). The aperture control amount is input to the lens device 150 via the lens communication control unit 133 and the I / F 120. The shutter control amount is input to the shutter control unit 110, and the exposure sensitivity is input to the image sensor 102. For example, in the finder shooting mode, an AE control amount is calculated from an AE evaluation value obtained by causing an optical image of a subject to enter a brightness determination unit (not shown) via the main mirror 112 and the pentaprism 113. In the case of the live view shooting mode, the AE control amount is calculated from the AE evaluation value calculated by the image processing unit 140. The AE control unit 132 switches an AE frame position for calculating an evaluation value and a weighting amount in accordance with a photometry mode such as an evaluation photometry mode, an average photometry mode, and a face detection photometry mode.

  The lens communication control unit 133 manages communication processing between the imaging device 100 and the lens device 150. When the lens communication control unit 133 detects that the lens device 150 is attached to the imaging device 100 via the I / F 120, the lens communication control unit 133 starts communication between the imaging device 100 and the lens device 150. In addition, the lens communication control unit 133 receives lens information (such as a lens ID) at an arbitrary timing, and transmits camera information (information regarding the imaging device 100) and a driving command. For example, in the case of the finder shooting mode, communication with the lens device 150 is performed at an arbitrary timing under the control of the system control unit 130. At this time, in the case of the live view shooting mode, communication may be performed at a timing based on the imaging synchronization signal output from the timing generation unit 104 other than the arbitrary timing. When communication is performed at a timing based on an imaging synchronization signal, when an imaging synchronization signal is input from the timing generation unit 104, lens information (focus lens position, focus lens state, aperture state, focal length, and the like) is collectively received. .

  The image magnification correction control unit 134 controls the position information of the focus lens 151 when the possible subject distance within the movable range of the focus lens 151 is infinity, the current position information of the focus lens 151, and the length of the current back focus. Is received through the I / F 120. The image magnification correction control unit 134 calculates the distance of the currently focused object based on the received current position information of the focus lens 151 and based on the position information when the object distance is infinity. From Newton's formula, the subject distance (the sum of the focal length from the front principal point position of the shooting lens and the distance from the focal position to the subject) and the back focus (the focal distance from the back principal point position of the shooting lens and the image from the focal position) The ratio of the sum of the distances to the surface) is equal to the image magnification of the subject. That is, if the position information of the focus lens and the information of the back focus are acquired for each subject, the image magnification for each subject can be obtained. Based on the calculated image magnification, a correction magnification (correction value) of the image magnification is calculated, and a correction magnification (correction value) of the image magnification for each subject is set in the resizer 141 of the image processing unit 140.

  The distance information control unit (distance information calculation unit) 200 of the image processing unit 140 acquires the subject distance information for each subject, and assigns the subject distance information to each subject. The subject distance information for each subject can be obtained by a phase difference method, Depth From Defocus (DFD) method, or the like. The distance information control unit 200 calculates a change in the image magnification due to a change in the focusing distance based on the subject distance information acquired for each subject, using an expression shown in FIG. Then, the resizer 141 uses the amount of change in image magnification calculated by the distance information control unit 200 when resizing each subject. Information such as numerical values required for calculation can be obtained from each unit, or may be stored in an information storage unit (not shown).

  The image processing unit 140 performs predetermined pixel complementation processing and color conversion processing on the digital image signal from the image generation unit 103 or the data from the memory control unit 105 to generate image data. Further, the image processing unit 140 performs a predetermined calculation process using the digital image signal.

  Next, the configuration of the lens device 150 will be described. The lens device 150 has an imaging optical system including a focus lens 151, a zoom lens 152, an aperture 153, and an anti-vibration control lens 154. Although FIG. 1 shows one lens as each lens, a lens group including a plurality of lenses may be used. The light beam incident via the imaging optical system is guided to the imaging device 102 and forms an optical image on the imaging device 102.

  The focus lens 151 moves in the direction (optical axis direction) along the optical axis OA to change the focus (focus state) of the imaging optical system. The zoom lens 152 moves in the optical axis direction to change the focal length of the imaging optical system. The aperture 153 has a variable aperture diameter (aperture value: F value), and changes the light amount according to the aperture diameter. The image stabilizing control lens 154 reduces image blur due to camera shake such as camera shake by moving in a direction orthogonal to the optical axis OA (optical axis orthogonal direction).

  The focus control section 155 is controlled by the lens control section 160 or the lens operation section 161, and drives the focus lens 151. Further, the focus control unit 155 outputs focus information such as the position of the focus lens 151 to the lens control unit 160. The zoom control unit 156 is controlled by the lens control unit 160 or the lens operation unit 161 to drive the zoom lens 152. The zoom control unit 156 outputs zoom information such as a focal length to the lens control unit 160. The aperture control unit 157 is controlled by the lens control unit 160 or the lens operation unit 161, and drives the aperture 153. The aperture control unit 157 outputs aperture information such as an aperture value to the lens control unit 160.

  The angular velocity detector 158 is controlled by the lens controller 160, detects the angular velocity (Yaw, Pitch) of the lens, and outputs the detected angular velocity to the lens controller 160. The image stabilization control unit 159 is controlled by the lens control unit 160, and drives the image stabilization control lens 154. The image stabilization control unit 159 outputs image stabilization information such as an image stabilizable range to the lens control unit 160.

  The lens control unit 160 controls the focus control unit 155, the zoom control unit 156, the aperture control unit 157, the angular velocity detection unit 158, the image stabilization control unit 159, and the like according to an input from the lens operation unit 161 or the I / F 170. Thus, the entire lens device 150 is controlled. In addition, the lens control unit 160 transmits information input from each control unit, detection unit, and the like to the imaging device 100 via the I / F 170 in accordance with the lens information acquisition command received by the I / F 170. Further, the lens control unit 160 calculates the focal length of the imaging optical system and the back focus using the focus information and the zoom information from the focus control unit 155 and the zoom control unit 156. The maximum focal length that can be set within the movable range of the focus lens 151 and the focal length change rate at the current position of the focus lens 151 are calculated. Then, the lens control unit 160 transmits the calculation results to the imaging device 100 via the I / F 170. At this time, based on a request from the imaging device 100, the lens control unit 160 may transmit a calculation result of the maximum focal length and the focal length variation rate as a response.

  The lens operation unit 161 includes a focus operation ring, a zoom operation ring, an AF / MF switch, an IS on / off switch, and outputs an instruction received by a user operation to the lens control unit 160. The lens control unit 160 transmits the contents of the user operation to the imaging device 100 via the I / F 170 based on the instruction input from the lens operation unit 161. The system control unit 130 of the imaging device 100 receives the contents of the user operation via the I / F 120 and switches the operation mode of various functions mounted on the lens device 150.

  The I / F 170 implements communication using electrical communication between the system control unit 130 of the imaging device 100 and the lens control unit 160 of the lens device 150 via the connector 190, so that information on the lens device 150 Sends and receives control commands.

  Next, with reference to FIG. 2, a description will be given of a process of correcting a change in image magnification due to focus (image processing method) according to the present embodiment. FIG. 2 is a flowchart illustrating the image processing method. Each step in FIG. 2 is mainly executed by the system control unit 130 and the image processing unit 140.

  First, when the system control unit 130 starts a photographing operation of the imaging apparatus 100, in step S12, the image processing unit 140 acquires a photographed image from the image generation unit 103, and sets a distance (subject area) of a subject (subject area) of the captured image. Distance). Subsequently, in step S13, the image processing unit 140 (distance information control unit 200) calculates distance information (subject distance information) for each subject by a phase difference method, a DFD method, or the like (not shown). At this time, the image processing unit 140 can calculate distance information for each subject based on the amount of movement of the focus lens 151. Alternatively, the distance information control unit 200 may measure the subject distance by a phase difference method or a DFD method.

  Subsequently, in step S14, the system control unit 130 (image processing unit 140) associates the distance information for each subject acquired in step S13 for each subject. The resolution of the subject distance at this time is determined based on, for example, the focal length of the imaging optical system, the aperture value, and the minimum circle of confusion. Therefore, the optical information acquired from the imaging optical system includes position information of the focus lens 151, position information of the zoom lens 152, position information of the diaphragm 153, and information on a range (movable range) that can be taken as position information of the focus lens. It is preferable to include

  Subsequently, in step S15, the system control unit 130 (the AF control unit 131) drives the focus lens 151 via the focus control unit 155 in response to an operation performed by the user via the lens operation unit 161, and the subject A (the (1 subject area). Subsequently, in step 16, the system control unit 130 (the AF control unit 131) focuses on the subject B (second subject area) located at a different distance (subject distance) from the subject A focused in step S15. The focus lens 151 is driven so as to cause the focus lens 151 to rotate. Step S16 shows an operation in a case where the in-focus subject is changed without performing the zoom operation by the user, that is, in a state where the zoom magnification is fixed.

  Subsequently, in step S17, the system control unit 130 (image magnification correction control unit 134) compares the distance (subject distance) of the subject A focused in step 15 and the distance (subject distance) of the subject B focused in step 16. (Distance difference) is calculated. This difference in object distance (distance difference) corresponds to a distance def between an object plane and a def plane in FIG. 3 described later.

  Subsequently, in step S18, the system control unit 130 (image magnification correction control unit 134) calculates an expression shown in FIG. 3 described below based on the distance difference calculated in step S17 and the data acquired from each unit. Then, the correction value of the image magnification for each subject distance is calculated. Subsequently, in step S19, the system control unit 130 (the image magnification correction control unit 134) resizes the subject A and another subject located at the same distance as the subject A using the correction value of the image magnification at the distance to the subject A. (Change the magnification). That is, when the system controller 130 focuses on the subject B, the system controller 130 multiplies the defocused image of the subject A by the correction value of the magnification calculated in step S18. Thereby, the system control unit 130 can correct the change in the image magnification of the subject A due to the change in the subject distance to be focused in step S16.

  Subsequently, in step S20, the system control unit 130 (image magnification correction control unit 134) calculates a correction value of the image magnification in accordance with the change of the focusing distance from the subject A to the subject B in the captured image. The correction value of the image magnification is calculated for each subject distance (object distance) of the subject by using an equation in FIG. Then, the system control unit 130 resizes the image by applying a correction value corresponding to each subject distance. That is, the system control unit 130 changes the magnification for each subject having a different subject distance in the same manner as described above.

Next, a method of calculating a correction value of the image magnification according to the present embodiment will be described with reference to FIG. FIG. 3 is an explanatory diagram of a method of calculating a correction value, and shows an optical arrangement for explaining an image magnification for subjects having different subject distances. Usually, the object height and the image height are in a conjugate relationship, and the image magnification is represented by the ratio between the object height and the image height. When the in-focus position is the object distance X _obj1 of the object A, the image magnification of the defocus image of the object B located at a position further infinity than that is ₁ β _def . In this case, the image magnification ₁ beta _def defocus image of the object B is the object height ₁ Y _{Pr_def} defocused images, the image height of the defocus image to ₁ Y _'pr, following formula (1) Is represented as

₁ β _def = ₁ Y ′ _pr / ₁ Y _{pr_def} (1)
Then, for example, if the focus position is changed to the object distance X _obj2 object B, the image magnification of the focused image of the object B is ₂ beta. Table as in this case, the image magnification ₂ beta of-focus image, object height and _{2 Y} pr focusing image of the object _B, and the image height of the focus image and _{2 Y 'pr,} the following equation (2) Is done.

_{2 β = 2 Y 'pr /} 2 Y pr ··· (2)
The correction value β for correcting the image magnification due to the change in the focusing distance is expressed by the following equation (3).

_{β = 1 β def / 2 β} ··· (3)
Since the correction value β changes for each subject distance, the correction value β is calculated according to the subject distance when the focusing distance changes based on the initial focusing distance. Here, assuming that the distance difference calculated in step S17 is Def, the following equations (4) and (5) are established from Newton's formula.

₁ β _def = BF ₁ / (X _obj1 + Def) (4)
₂ β = BF ₂ / X _obj2 (5)
From the equations (3) to (5), the following equation (6) can be derived.

β = {BF ₁ / (X _obj1 + Def)} / (BF ₂ / X _obj2 ) (6)
Therefore, if there is a back focus value of the imaging optical system obtained from the subject distance of each subject and the focus position, β for correcting the image magnification can be calculated.

  Then, by resizing the image for each subject distance (changing the image magnification), the magnification between the focused image and the unfocused image due to the change in the focal distance is kept substantially constant, and the image quality does not deteriorate. Absent. At this time, by performing magnification correction on the basis of a subject having a large image magnification correction value, it is possible to prevent an image having a long subject distance, such as a background, from being reduced and an area having no data from occurring on the screen. it can.

  Further, such a process of correcting a change in image magnification due to focus can also be applied to the case of reproducing a captured image. For example, when observing images on a monitor or the like during photographing, by performing this process on each image, the user can visually check the effect given to the photographed image at the time of photographing.

  Further, even in continuous photographing such as multiple exposure, the process of correcting the change in image magnification due to this focus can be applied. For example, when performing HDR shooting, a plurality of images with different exposures are shot. At this time, if the focus changes, the image magnification changes. As a result, when the images are superimposed, they do not overlap. On the other hand, by performing the image magnification correction of the present embodiment, it is possible to realize high-accuracy superimposition of images without changing the size of each subject image.

  Next, with reference to FIG. 4, an effect of the image magnification fluctuation correction processing due to the focus of the imaging system 10 will be described. FIG. 4 is an explanatory diagram showing the effect of the image magnification fluctuation correction process due to focus, and shows an image diagram of an image of three bills having different subject distances.

  FIG. 4A is an image diagram focusing on a “frontmost” tag arranged closest to the imaging system 10. FIG. 4B is an image diagram focusing on the “middle” tag arranged near the imaging system 10 next to FIG. 4A. FIG. 4C is an image diagram focusing on the “latest” tag arranged farthest from the imaging system 10. These three images are captured images having a fixed focal length (with a constant focal length), which are obtained using a single focus lens.

  However, for example, when focusing on the “front” tag, FIG. 4 (b) in which the focusing distance has changed and the “center” tag is in focus and the “front” tag is focused on Compared to FIG. 4A, the size of the "front" bill is different. In the present embodiment, the effect is easy to understand by making the depth of field shallow. For example, when shooting with a wide-angle lens having a deep depth of field, the user only needs to change the focus position and the user can use the wide-angle lens. Even though the focal length of the camera has not been changed, the image in front of the camera appears largely in focus. As a result, an image is obtained as if the image was taken with zooming in spite of performing the focusing operation. According to the present embodiment, such a change in the image magnification can be prevented by calculating and correcting the correction amount of the image magnification using the equation in FIG. 3 for each subject distance. This process is referred to as a process of correcting a change in image magnification due to focus.

(Other embodiments)
The present invention supplies a program for realizing one or more functions of the above-described embodiments to a system or an apparatus via a network or a storage medium, and one or more processors in a computer of the system or the apparatus read and execute the program. It can also be realized by the following processing. Further, it can be realized by a circuit (for example, an ASIC) that realizes one or more functions.

  In the present embodiment, the imaging device can correct the image magnification variation at each subject distance caused by driving the focus lens with respect to the captured image. Therefore, according to the present embodiment, an image processing apparatus, an imaging apparatus, an image processing method, a program, and a storage medium that can effectively suppress image degradation due to a focus operation with a simple configuration are provided. It is possible.

  As described above, the preferred embodiments of the present invention have been described, but the present invention is not limited to these embodiments, and various modifications and changes can be made within the scope of the gist.

130 System control unit (image processing device)
131 AF control unit (focus control means)
134 Image magnification correction control unit (magnification correction means)
151 Focus lens

Claims (13)

Focus control means for controlling the focus lens;
Magnification correction means for correcting the magnification of the image obtained via the focus lens,
The image processing apparatus according to claim 1, wherein the magnification correction unit corrects the magnification based on subject distance information of the image such that a change in magnification of the image accompanying movement of the focus lens is reduced.   The image processing apparatus according to claim 1, wherein the magnification correction unit corrects the magnification for each subject area in the image. The subject area includes a first subject area that is a first subject distance, and a second subject area that is a second subject distance different from the first subject distance,
The image processing apparatus according to claim 2, wherein the magnification correction unit corrects the magnification of the second subject area based on a magnification of the first subject area.   The image processing apparatus according to claim 3, wherein the magnification of the first subject area is a maximum magnification.   The magnification correction means corrects the magnification based on a distance difference between a first subject area and a second subject area in the image, which is calculated based on the subject distance information. Item 5. The image processing device according to any one of Items 1 to 4. The magnification correction means,
Calculating a correction value based on the distance difference,
2. The method according to claim 1, wherein when the focus control unit controls the focus lens to focus on the second object area, the magnification of the first object area is corrected using the correction value. 6. The image processing device according to 5.   The image processing apparatus according to claim 1, wherein the magnification correction unit corrects the magnification based on information indicating a current state of an imaging optical system including the focus lens. apparatus.   The method according to claim 7, wherein the information indicating a current state of the imaging optical system includes information on a position of the focus lens, a position of a zoom lens, a position of an aperture, and a movable range of the focus lens. The image processing apparatus according to any one of the preceding claims.   9. The image processing apparatus according to claim 1, wherein the magnification correction unit corrects a change in the magnification that occurs when the focus lens moves while a zoom magnification is fixed. 10. . An image processing apparatus according to claim 1,
An image pickup device, comprising: an image pickup device that photoelectrically converts an optical image formed via an image pickup optical system. Controlling the focus lens;
Correcting the magnification of the image obtained through the focus lens,
In the step of correcting the magnification of the image, the magnification is corrected based on subject distance information of the image such that a change in the magnification of the image accompanying movement of the focus lens is reduced. Method.   A program for causing a computer to execute the image processing method according to claim 11.   A storage medium storing the program according to claim 12.