JP5691440B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus.

  2. Description of the Related Art Conventionally, a camera in which focus detection pixels are incorporated and arranged in each of two imaging elements is known (for example, Patent Document 1).

JP 2010-026011 A

  However, since the image signal at the position where the focus detection pixels are arranged is generated by prediction based on the output from the imaging pixels arranged around the focus detection pixels, the image quality is determined when accurate prediction cannot be performed. There is a problem that decreases.

An image pickup apparatus according to a first aspect of the invention receives a light beam from a photographing optical system and outputs a first image signal having information on a first color of a subject image formed by the photographing optical system. a first imaging pixel receives light flux from the photographing optical system, the first imaging device and the focus detection pixel outputting a focus detection signal for detecting a focusing state of the photographing optical system is sequence A second imaging pixel that receives a light beam from the photographing optical system and outputs a second image signal having information on a second color of the subject image formed by the photographing optical system; and the subject a second imaging device and the third image pickup pixels for outputting a third image signal containing information about a third color image is sequence, information about the first color at the position where the focus detection pixels are arranged the fourth image signal with the focus When the second imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the detection pixel, the second image signal of the second imaging pixel at the corresponding position and the second of the corresponding position. Based on the second image signal of the second imaging pixel arranged around the imaging pixel and the first image signal of the first imaging pixel arranged around the focus detection pixel, generated by interpolation processing, When the third imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the focus detection pixel, the third image signal of the third imaging pixel at the corresponding position and the third image signal of the corresponding position. Interpolation generated by interpolation processing based on the third image signal of the third imaging pixel arranged around the three imaging pixels and the first image signal of the first imaging pixel arranged around the focus detection pixel Means.
An image pickup apparatus according to a sixth aspect of the invention receives a light beam from a photographing optical system and outputs a first image signal having information on a first color of a subject image formed by the photographing optical system. A first imaging pixel and a focus detection pixel that receives a light beam from the photographing optical system and outputs a focus detection signal for detecting a focus adjustment state of the photographing optical system are arranged in the same plane. An imaging element; a second imaging pixel that receives a light beam from the imaging optical system and outputs a second image signal having information on a second color of the subject image formed by the imaging optical system; A second image sensor in which third imaging pixels that output a third image signal having information relating to the third color of the subject image are arranged on the same plane, and a fourth image at a position where the focus detection pixels are arranged. Signal from the second image sensor Interpolation means generated by interpolation processing based on one of the output second image signal and third image signal and the first image signal, and the interpolation means is arranged around the focus detection pixel. A first corresponding position on the second image sensor corresponding to the first image signal output from the first image sensor pixels arranged in the first image signal, the focus detection pixels, and the first image pixels arranged in the surroundings. Based on one of the second image signal output from the second imaging pixel arranged in the first imaging pixel and the third image signal from the third imaging pixel arranged in the first corresponding position. The fourth image signal having information related to the color of the first image signal is generated by the interpolation process, and the interpolation means outputs the first image signal output from the plurality of first imaging pixels arranged around the focus detection pixel. And the above Based on one and the difference of the plurality of the arranged in corresponding positions the second imaging pixel and a plurality of the third image pickup pixel, generates said fourth image signal containing information about the first color And
An image pickup apparatus according to a seventh aspect of the invention receives a light beam from a photographing optical system and outputs a first image signal having information on a first color of a subject image formed by the photographing optical system. A first imaging pixel and a focus detection pixel that receives a light beam from the photographing optical system and outputs a focus detection signal for detecting a focus adjustment state of the photographing optical system are arranged in the same plane. An imaging element; a second imaging pixel that receives a light beam from the imaging optical system and outputs a second image signal having information on a second color of the subject image formed by the imaging optical system; A second image sensor in which third imaging pixels that output a third image signal having information relating to the third color of the subject image are arranged on the same plane, and a fourth image at a position where the focus detection pixels are arranged. Signal from the second image sensor Interpolation means generated by interpolation processing based on one of the output second image signal and third image signal and the first image signal, and the interpolation means is arranged around the focus detection pixel. A first corresponding position on the second image sensor corresponding to the first image signal output from the first image sensor pixels arranged in the first image signal, the focus detection pixels, and the first image pixels arranged in the surroundings. Based on one of the second image signal output from the second imaging pixel arranged in the first imaging pixel and the third image signal from the third imaging pixel arranged in the first corresponding position. The fourth image signal having information on the color of the image is generated by the interpolation process, and the second imaging pixels are arranged on the second imaging element based on the first image signal and the third image signal. Said in the position 3rd imaging pixels are arranged on the 2nd image sensor based on the 1st generating means which generates the 5th image signal which has the information about 3 colors, and the 1st image signal and the 2nd image signal And a second generation means for generating a sixth image signal having information on the second color at the position .
An imaging apparatus according to an eighth aspect of the present invention receives a light beam from a photographing optical system and outputs a first image signal having information on a first color of a subject image formed by the photographing optical system. A first imaging pixel and a focus detection pixel that receives a light beam from the photographing optical system and outputs a focus detection signal for detecting a focus adjustment state of the photographing optical system are arranged in the same plane. An imaging element; a second imaging pixel that receives a light beam from the imaging optical system and outputs a second image signal having information on a second color of the subject image formed by the imaging optical system; A second image sensor in which third imaging pixels that output a third image signal having information relating to the third color of the subject image are arranged on the same plane, and a fourth image at a position where the focus detection pixels are arranged. Signal from the second image sensor Interpolation means generated by interpolation processing based on one of the output second image signal and third image signal and the first image signal, and the interpolation means is arranged around the focus detection pixel. A first corresponding position on the second image sensor corresponding to the first image signal output from the first image sensor pixels arranged in the first image signal, the focus detection pixels, and the first image pixels arranged in the surroundings. Based on one of the second image signal output from the second imaging pixel arranged in the first imaging pixel and the third image signal from the third imaging pixel arranged in the first corresponding position. The fourth image signal having information related to the color of the first image signal is generated by the interpolation process, and the interpolation means outputs the first image signal output from the plurality of first imaging pixels arranged around the focus detection pixel. And the above Based on the ratio between the second image signal from the plurality of second imaging pixels and the third image signal from the plurality of third imaging pixels arranged at the corresponding position, information on the first color is obtained. The fourth image signal is generated, and the third color at the position where the second imaging pixels are arranged on the second imaging element based on the first image signal and the third image signal Based on first generation means for generating a fifth image signal having information, and on the first image signal and the second image signal, the third image pickup pixel is positioned on the second image pickup element. And second generation means for generating a sixth image signal having information on the second color .

  According to the present invention, on the first image sensor based on the first image signal output from the first image sensor and one of the second image signal and the third image signal output from the second image sensor. A fourth image signal at the position of the arranged focus detection pixels can be generated.

The figure which shows the structure of the digital camera by embodiment of this invention The figure which shows an example of arrangement | positioning of the focus detection area set to the imaging | photography screen of an interchangeable lens Front view of the first image sensor The figure which shows the structure of the pixel for imaging The figure which shows the structure of the pixel for focus detection Front view of the second image sensor Diagram showing transmittance characteristics of wavelength selective half mirror Diagram showing reflectance characteristics of wavelength selective half mirror The figure which shows the transmittance | permeability characteristic of the color filter arrange | positioned at a blue B pixel The figure which shows the transmittance | permeability characteristic of the color filter by which red R pixel is arrange | positioned Diagram showing transmittance characteristics of infrared cut filter The figure explaining the defect correction process of a 1st image sensor The figure explaining the defect correction process in a modification The figure which shows the example of an arrangement | sequence of the pixel for focus detection in a modification.

-First embodiment-
FIG. 1 shows the configuration of the first embodiment. The digital camera 201 according to the first embodiment includes an interchangeable lens 202 and a camera body 203, and the interchangeable lens 202 is attached to the camera body 203 via a mount unit 204.

  The interchangeable lens 202 includes a lens drive control device 206, a zooming lens 208, a lens 209, a focusing lens 210, a diaphragm 211, and the like. The lens drive control device 206 is composed of peripheral components such as a microcomputer and a memory. The lens drive control device 206 controls the driving of the focusing lens 210 and the aperture 211, detects the state of the zooming lens 208, the focusing lens 210 and the aperture 211, and communicates with the body drive control device 214, which will be described later, to transmit lens information and camera information. Receive and so on.

  The camera body 203 includes a body drive control device 214, a liquid crystal display element driving circuit 215, a liquid crystal display element 216, a memory card 219, a first image sensor 220, a second image sensor 221, a wavelength selective half mirror 222, and the like. The wavelength-selective half mirror 222 is constituted by a pellicle mirror, for example, and transmits the green G component of the light beam coming from the interchangeable lens 202 and reflects the other components. An infrared cut filter 224 is provided on the light incident side of the wavelength selective half mirror 222.

  The first image sensor 220 is a solid-state image sensor that receives the green G component light beam that has passed through the wavelength-selective half mirror 222, and is disposed on the planned imaging plane (imaging plane) of the interchangeable lens 202. The second image sensor 221 is a solid-state image sensor that receives a light beam of a component other than the green G reflected by the wavelength selective half mirror 222, and is disposed on another scheduled imaging surface (imaging surface) of the interchangeable lens 202. . In FIG. 1, “A” of the first image sensor 220 and the second image sensor 221 corresponds to the “heaven” side of the object scene, and “B” corresponds to the “ground” side of the object field. Note that the imaging surface (scheduled imaging surface) of the first imaging element 220 and the imaging surface (scheduled imaging surface) of the second imaging element 221 are in a conjugate relationship with each other. The first image sensor 220 and the second image sensor 221 are configured by a CCD, a CMOS, or the like.

  The body drive control device 214 includes a microcomputer and peripheral components such as a memory. The body drive controller 214 reads and corrects image signals from the first image sensor 220 and the second image sensor 221 and communicates with the lens drive controller 206 (receives lens information and transmits camera information such as a defocus amount). ), Detection of the focus adjustment state (defocus amount) of the interchangeable lens 202, and operation control of the entire camera. The body drive control device 214 and the lens drive control device 206 communicate via an electrical contact 213 provided on the mount unit 204 to exchange various information such as lens information, defocus amount, aperture information, and the like.

  In the camera of this embodiment, an EVF (Electric View Finder) is configured by the liquid crystal display element driving circuit 215 and the liquid crystal display element 216, and images captured by the first image sensor 220 and the second image sensor 221 are displayed on the liquid crystal display element 216. The image is displayed and made visible to the photographer through the eyepiece lens 217. The captured image is recorded in the memory card 219.

  The first imaging element 220 and the second imaging element 221 are two-dimensionally arranged with imaging pixels on the same plane. The subject image formed on the first image sensor 220 by the light beam that has passed through the interchangeable lens 202 and has passed through the wavelength selective half mirror 222 is photoelectrically converted by the first image sensor 220 and output to the body drive controller 214. The The subject image formed on the second image sensor 221 by the light beam transmitted through the interchangeable lens 202 and reflected by the wavelength selective half mirror 222 is output to the body drive control device 214 that has been photoelectrically converted by the second image sensor 221. Is done. On the first image sensor 220, focus detection pixels are incorporated and arranged in a portion corresponding to the focus detection position. Details of the focus detection pixels will be described later.

  The body drive control device 214 calculates a defocus amount at the focus detection position based on the output of the focus detection pixel, and sends this defocus amount to the lens drive control device 206. In addition, the body drive control device 214 stores an image signal generated by performing defect correction processing, which will be described later, on the memory card 219 based on the output of the imaging pixel, and sends the image signal to the liquid crystal display element drive circuit 215. The image signal is displayed on the liquid crystal display element 216. Further, the body drive control device 214 sends aperture control information to the lens drive control device 206 to control the size of the aperture opening.

  The lens drive control device 206 updates the lens information according to the focusing state, zooming state, aperture setting state, aperture opening F value, and the like. Specifically, the lens drive control device 206 monitors the positions of the zooming lens 208 and the focusing lens 210 and the aperture position of the aperture 211, calculates lens information according to the monitor information, or provides a look that is prepared in advance. Select lens information according to monitor information from the up table. Further, the lens drive control device 206 calculates a lens drive amount based on the received defocus amount. The lens drive control device 206 drives the focusing lens 210 to the focal point by a drive source such as a motor (not shown) based on the calculated lens drive amount, and the diaphragm 211 is not shown based on the received aperture control information. It is driven by a drive source such as a motor.

  FIG. 2 shows the arrangement of focus detection areas set on the imaging screen of the interchangeable lens 202 shown in FIG. In the figure, A corresponds to the celestial side of the object scene, and B corresponds to the ground side of the object field. In this embodiment, as shown in the figure, an example is shown in which focus detection areas 100a to 100i are set at a total of nine locations in the central portion and the peripheral portion of the photographing screen 100 of the interchangeable lens 202. Each of the focus detection areas 100a to 100i has a shape extending in the horizontal direction of the object scene. The shape of the focus detection area is not limited to the one extending in the horizontal direction, but may be one extending in the vertical direction, or may be a cross shape orthogonal to the horizontal direction and the vertical direction. Further, the number and arrangement of the focus detection areas are not limited to this embodiment.

  FIG. 3A is a front view of the first image sensor 220, in which “A” corresponds to the celestial side of the object scene, and “B” corresponds to the ground side of the object field. FIG. 3B is an enlarged view of the “P1” portion of the first image sensor 220 indicated by a broken line in FIG. 3A, and shows the arrangement of the imaging pixels 310. FIG. 3C is an enlarged view of the “Q1” portion of the first image sensor 220 indicated by a one-dot chain line in FIG. 3A, and shows an arrangement of the imaging pixels 310 and the focus detection pixels 313 and 314. FIG. 3C shows the focus detection pixel array 220d of the Q1 portion, but the same applies to the other focus detection pixel arrays 220a to 220c and 220e to 220i.

  The first imaging element 220 has two-dimensional imaging pixels 310 as shown in FIG. 3B on the entire imaging surface corresponding to the imaging screen 100 shown in FIG. 2 of the interchangeable lens 202 (see FIG. 1). Arranged. Further, as shown in FIG. 3C, focus detection pixel arrays 220a to 220i are arranged along the horizontal direction of the object scene at positions corresponding to nine focus detection areas 100a to 100i in the photographing screen 100. Is done. Note that “G” shown in FIG. 3 represents an imaging pixel 310 (green G pixel 310G) or focus detection pixels 313 and 314 having a color filter that transmits a green G color component, as will be described later. ing.

  4A is a front view of the imaging pixel 310, and FIG. 4B is a cross-sectional view of the imaging pixel 310. The imaging pixel 310 (green G pixel 310G) includes a microlens 310a, a photoelectric conversion element 310b, an aperture-310c, and a color filter 310g. The photoelectric conversion element 310 b is formed on the semiconductor circuit substrate 29. An aperture-310c and a micro lens 310a are arranged in front of the photoelectric conversion element 310b, and the shape of the photoelectric conversion element 310b defined by the aperture-310c is projected forward by the micro lens 310a. The color filter 310g has a characteristic of transmitting the green G color component included in the light flux from the subject, and is installed between the microlens 310a and the aperture-310c.

  The focus detection pixel arrays 220a to 220i include a pair of focus detection pixels 313 and 314 as shown in FIG. In the focus detection pixel arrays 220a to 220i, a pair of focus detection pixels 313 and 314 and an imaging pixel 310 (green G pixel 310G) include a focus detection pixel 313, a green G pixel 310G, and a focus detection pixel. 314 and the green G pixel 310G are arranged on a straight line in this order.

  5A is a front view of the focus detection pixels 313 and 314, and FIG. 5B is a cross-sectional view of the focus detection pixels 313 and 314. The focus detection pixel 313 includes a micro lens 313a, a photoelectric conversion element 313b, an aperture 313c, and a color filter 313g. The photoelectric conversion element 313 b is formed on the semiconductor circuit substrate 29. An aperture 313c and a micro lens 313a are disposed in front of the photoelectric conversion element 313b, and the shape of the photoelectric conversion element 313b defined by the aperture 313c is projected forward by the micro lens 313a. The color filter 313g has a characteristic of transmitting the green G color component included in the light flux from the subject, and is installed between the microlens 313a and the aperture 313c.

  The focus detection pixel 314 includes a microlens 314a, a photoelectric conversion element 314b, an aperture 314c, and a color filter 314g. The photoelectric conversion element 314 b is formed on the semiconductor circuit substrate 29. An aperture 314c and a micro lens 314a are disposed in front of the photoelectric conversion element 314b, and the shape of the photoelectric conversion element 314b defined by the aperture 314c is projected forward by the micro lens 314a. The color filter 314g has a characteristic of transmitting the green G color component included in the light flux from the subject, and is installed between the microlens 314a and the aperture 314c. Apertures 313c and 314c of the focus detection pixels 313 and 314 are both formed to have a rectangular opening, and are arranged on the object with respect to the center (optical axis) of the microlens 10. That is, the size of the opening defined by the apertures 313c and 314c is formed to be approximately half of the size of the opening by the aperture 310c provided in the imaging pixel 310, respectively. In other words, the focus detection pixels 313 and 314 have a pupil division structure.

  As described above, the first image sensor 220 receives the light beam of the green G component transmitted through the wavelength selective half mirror 222. FIG. 7 shows the transmittance characteristics of the wavelength selective half mirror 222, and FIG. 8 shows the reflectance characteristics thereof. The wavelength selective half mirror 222 has a characteristic of transmitting a G (green color light) component and reflecting other color components.

  Next, the second image sensor 221 will be described. FIG. 6A is a front view of the second image sensor 221. In the figure, “A” corresponds to the celestial side of the object scene, and “B” corresponds to the ground side of the object field. FIG. 6B is an enlarged view of the “P2” portion of the second image sensor 221 indicated by the alternate long and short dash line in FIG. 6A, and shows an array of imaging pixels. The P2 portion of the second image sensor 221 corresponds to the P1 portion of the first image sensor 220 shown in FIG. 3B, that is, the P1 portion and the P2 portion are regions for photographing the same portion of the subject. . FIG. 6C is an enlarged view of the “Q2” portion of the second imaging element 221 indicated by a two-dot chain line in FIG. 6A, and shows an arrangement of imaging pixels. The Q2 portion of the second image sensor 221 is a region corresponding to the Q1 portion shown in FIG.

  The second imaging element 221 has two imaging pixels 310 on the same plane as shown in FIG. 6B on the entire imaging surface of the interchangeable lens 202 (see FIG. 1) corresponding to the imaging screen 100 shown in FIG. Dimensional array. The imaging pixel 310 of the second imaging element 221 has the same configuration as the imaging pixel 310 of the first imaging element 220 described above shown in FIG. 4, but is installed between the microlens 310a and the photoelectric conversion element 310b. Different color filters are used. As shown in FIG. 6B, the second image sensor 221 includes an imaging pixel 310 (blue B pixel 310B) including a color filter that transmits a blue B component and a color filter that transmits a red R component. The imaging pixels 310 (red R pixels 310R) are arranged in a checkered pattern. That is, the blue B pixel 310B and the red R pixel 310R are alternately arranged on the second image sensor 221 in the horizontal direction and the vertical direction. The arrangement of the blue B pixel 310B and the red R pixel 310R is not limited to the checkered pattern, and for example, the blue B pixel 310B and the red R pixel 310R may be arranged in a straight line in the horizontal direction.

  FIG. 9 shows the transmittance characteristics of the color filter that transmits the blue B component, and FIG. 10 shows the transmittance characteristics of the color filter that transmits the red R component. As described above, the second image sensor 221 receives light other than the green G component reflected by the wavelength selective half mirror 222. The blue B pixel 310B of the second image sensor 221 receives blue B component light in the light beam reflected by the wavelength selective half mirror 222, and the red R pixel 310R receives red R component light.

  FIG. 11 shows the transmittance characteristics of the infrared cut filter 224 arranged on the light incident side of the wavelength selective half mirror 222. As described above, in the imaging apparatus according to the embodiment, the wavelength-selective half mirror 222 transmits the light beam of the green G component and reflects the light beam other than the green G component. Then, the transmitted light of the wavelength selective half mirror 222 is received by the first image sensor 220, and the blue B component and the red R component of the reflected light are received by the second image sensor 221. As a result, it is possible to receive twice the amount of light as compared with the case where light from a subject is received by a single image sensor in which RGB pixels are arranged in a Bayer array.

  Next, an interpolation method, that is, a defect correction method according to an embodiment, in which an image output at the arrangement position of the focus detection pixels 313 and 314 is obtained by interpolation based on the pixel output of the imaging pixel 310 will be described. If focus detection pixels 313 and 314 are arranged instead of the image pickup pixel 310, an image output of the image pickup result cannot be obtained at the focus detection pixel position, so that the pixel becomes a defective pixel. Therefore, the image output at the focus detection pixel position is obtained by interpolation based on the outputs of the imaging pixels 310 arranged in the first imaging element 220 and the second imaging element 221, that is, defect correction is performed.

  In the following description, the pixel output from the green G pixel 310G of the first image sensor 220 is G (i, j), the pixel output from the blue B pixel 310B of the second image sensor 221 is B (i, j), The pixel output from the red R pixel 310R is R (i, j). In addition, i is a positive integer representing the vertical direction (column) of the first image sensor 220 and the second image sensor 221, and j is the horizontal direction (row) of the first image sensor 220 and the second image sensor 221. It is a positive integer.

  The defect correction processing by the body drive control device 214 will be described with reference to FIG. FIG. 12A is an enlarged view showing a region R1 surrounded by a two-dot chain line in the Q1 portion of the first image sensor 220 shown in FIG. FIG. 12B is a diagram showing a region R2 surrounded by a two-dot chain line in the Q2 portion of the second image sensor 221 shown in FIG. The region R1 and the region R2 form a positional relationship corresponding to each other, that is, a light beam corresponding to the same part of the subject light beam incident through the interchangeable lens 202. In the following description, the imaging pixel 310 disposed in the second imaging element 221 corresponding to the focus detection pixel 313 is referred to as a corresponding pixel 310CO.

The body drive control device 214 calculates a pixel output (expected output) G ′ (i, j) that is expected when the focus detection pixel 313 arranged in FIG. 1).
G ′ (i, j) = B (i, j) × Gsum / Bsum
Gsum = G (i−1, j−1) + G (i−1, j + 1) + G (i + 1, j−1) + G (i + 1, j + 1)
Bsum = B (i-1, j-1) + B (i-1, j + 1) + B (i + 1, j-1) + B (i + 1, j + 1)
... (1)

  As shown in the above equation (1), the body drive control device 214 outputs the pixel outputs G (i−1, j−1), G (i−1, j + 1), G (i + 1, j−1), G (i + 1, j + 1), and pixel outputs B (i−1, j−1), B (i−1, j + 1), B (i, j), B ( The predicted output G ′ (i, j) is calculated using i + 1, j−1) and B (i + 1, j + 1). Expression (1) is an average of pixel outputs from the four green G pixels 310G arranged around the focus detection pixel 313 of the first image sensor 220 and the corresponding pixel 310CO (blue B) on the second image sensor 221. An example is shown in which the expected output G ′ (i, j) is calculated using a proportional relationship with the average of the pixel outputs from the pixel 310B) and four blue B pixels 310B arranged in the vicinity thereof. The four blue B pixels 310B are arranged at positions corresponding to the four green G pixels 310G arranged around the focus detection pixels 313 of the first image sensor 220 (hereinafter, peripheral corresponding pixels 310COP). Called). Furthermore, the body drive control device 214 also calculates the defect correction processing for the focus detection pixels 314 in the same manner as the above-described defect correction processing, that is, by using Expression (1). In the above description, the case where the corresponding pixel 310CO is the blue B pixel 310B is shown. However, in the case of the red R pixel 310R, the pixel output of Expression (1) is changed from B (i, j) to R (i, j ), The expected output G ′ (i, j) can be calculated.

  The body drive control device 214 uses the outputs from the two types of focus detection pixels 313 and 314 provided in the focus detection pixel arrays 220a to 220i on the second image sensor 221 to perform the defocus amount by a known method. Is calculated. The focus detection pixels 313 and 314 receive light beams respectively passing through different distance measuring pupils of the interchangeable lens 202 corresponding to the focus detection pixels 313 and 314, respectively. The body drive control device 214 collects the outputs from the focus detection pixels 313 and 314 into output groups corresponding to different distance measurement pupils so that the focus detection light fluxes passing through the distance measurement pupils are arranged in the focus detection pixel array. Information on the light intensity distribution of the pair of images formed on the top is obtained. The body drive control device 214 performs a known image shift detection calculation process (correlation calculation process, phase difference detection process) on this information, thereby performing image shift amounts of a pair of images using a so-called pupil division type phase difference detection method. Is detected. Further, the body drive control device 214 performs a conversion operation according to the center-of-gravity interval of the pair of distance measuring pupils on the image shift amount, thereby performing a current imaging plane (a microlens on the planned imaging plane) on the planned imaging plane. The deviation (defocus amount) of the imaging plane at the focus detection position corresponding to the array position is calculated.

According to the first embodiment described above, the following operational effects can be obtained.
(1) The first imaging element 220 receives the light beam from the interchangeable lens 202 and outputs a pixel output G having information on the green G color of the subject image formed by the interchangeable lens 202. (Green G pixel 310G) and focus detection pixels 313 and 314 that receive the light flux from the interchangeable lens 202 and output a focus detection signal for detecting the focus adjustment state of the interchangeable lens 202 are on the same plane. It was arranged. The second imaging element 221 receives the light beam from the interchangeable lens 202 and outputs a pixel output B (blue B pixel) that outputs pixel output B having information on the blue B color of the subject image formed by the interchangeable lens 202. 310B) and an imaging pixel 310 (red R pixel 310R) that outputs a pixel output R having information related to the red R color of the subject image are arranged on the same plane. Then, the body drive control device 214 generates an expected output G ′ at the positions of the focus detection pixels 313 and 314 based on one of the pixel output B and the pixel output R and the pixel output G by interpolation processing. I made it.

  In the conventional technique, the predicted output of the focus detection pixels 313 and 314 arranged in the first image sensor 220 is generated using the pixel output of the image pixel 310 arranged in the first image sensor 220. When the pixel output cannot be obtained like the focus detection pixel 313 shown in FIG. 12A, the predicted output G ′ is calculated using the peripheral pixel output G. For this reason, if the information included in the light flux actually incident on the focus detection pixel 313 and the expected output G ′ calculated using the peripheral pixel output G are significantly different, a false color or the like occurs and the image quality deteriorates. Was. However, according to the present embodiment, when calculating the expected output at the position where the focus detection pixels 313 in FIG. 12A are arranged, as shown in FIG. The pixel output from is used. That is, since the output of the corresponding pixel 310CO of the focus detection pixel 313 disposed on the second image sensor 221 is also used, the accuracy in calculating the predicted output is improved, and the focus detection pixel 313 is actually used. The information contained in the light flux incident on the light and the expected output G ′ are not significantly different. As a result, it is possible to generate a high-quality image in which the occurrence of false colors or the like is suppressed.

(2) The body drive controller 214 outputs the pixel output G output from the green G pixel 310G arranged around the focus detection pixels 313 and 314, the focus detection pixels 313 and 314, and the green arranged around the pixel G Based on the corresponding pixel 310CO corresponding to the G pixel 310G and the pixel output B or the pixel output R output from the peripheral corresponding pixel 310COP, an expected output G ′ having information on the green G color is generated by interpolation processing. did. At this time, the body drive control device 214 outputs the pixel output G output from the plurality of green G pixels 310G arranged around the focus detection pixels 313 and 314 and the pixel output B output from the peripheral corresponding pixel 310COP or Based on the proportional relationship with the pixel output R, a predicted output G ′ having information on the green G color is generated. Therefore, the predicted output is calculated using the pixel outputs from the plurality of imaging pixels 310 around the focus detection pixels 313 and 314, the corresponding pixel 310CO, and the peripheral corresponding pixel 310COP. This will improve the image quality.

The first embodiment described above can be modified as follows.
(1) The body drive control device 214 uses the following formula (2) instead of calculating the expected output G ′ (i, j) using the formula (1) based on the average proportional relationship. It may be calculated. Expression (2) is the pixel output G (i, j) of the four green G pixels 310G arranged around the focus detection pixel 313, the blue B pixel 310B as the corresponding pixel 310CO, and the surroundings. It shows that the expected output G ′ (i, j) is calculated using the average of the ratios of the four blue B pixels 310B, which are the peripheral corresponding pixels 310COP, with the pixel output B (i, j). Although the case where the corresponding pixel 310CO is the blue B pixel 310B is shown, in the case of the red R pixel 310R, the pixel output of Expression (2) is replaced by B (i, j) to R (i, j). Pixel output G ′ (i, j) can be calculated.
G ′ (i, j) = B (i, j) × 4 × {G (i−1, j−1) / B (i−1, j−1) + G (i−1, j + 1) / B ( i−1, j + 1) + G (i + 1, j−1) / B (i + 1, j−1) + G (i + 1, j + 1) / B (i + 1, j + 1)}
... (2)

(2) The body drive control device 214 may perform the defect correction processing using the pixel output output from the imaging pixels 310 arranged according to the characteristics of the subject. For example, it is assumed that a subject S having an oblique shape is photographed from the lower part to the upper part of the photographing screen as shown in FIG. In this case, the body drive control device 214 uses the pixel output G (i, j) output from the four green G pixels 310G and uses the following equation (3) to form an oblique shape (feature) of the subject S. Extraction, that is, similarity of pixel output is determined.
D = | G (i−1, j−1) −G (i + 1, j + 1) | − | G (i−1, j + 1) −G (i + 1, j−1) |
... (3)

The body drive control device 214 compares the magnitude relationship between the value D indicating similarity calculated by the equation (3) and the predetermined threshold value δ, and the predicted output G ′ ( i, j) is calculated.
--When D> δ--
The body drive control device 214 determines that the similarity in the direction between the pixel outputs G (i−1, j + 1) and G (i + 1, j−1) is large. Then, the body drive control device 214 calculates the expected output G ′ (i, j) of the focus detection pixel 313 using the following equation (4). Equation (4) indicates that the expected output G ′ (i, j) is calculated based on the average proportional relationship of the pixel outputs determined to have high similarity.
G ′ (i, j) = B (i, j) × {G (i + 1, j−1) + G (i−1, j + 1)} / {B (i + 1, j−1) + B (i−1, j + 1) )} (4)

Note that the body drive control device 214 uses the formula (5) based on the average ratio of the pixel outputs determined to have high similarity instead of the formula (4) as the predicted output G ′ (i, j). May be calculated.
G ′ (i, j) = B (i, j) × 2 × {G (i−1, j + 1) / B (i−1, j + 1) + G (i−1, j + 1) / B (i + 1, j−) 1)} (5)

--When D <-δ--
The body drive control device 214 determines that the similarity between the pixel outputs G (i−1, j−1) and G (i + 1, j + 1) is large. Then, the body drive control device 214 calculates the expected output G ′ (i, j) of the focus detection pixel 313 using the following equation (6) based on the average proportional relationship of the pixel outputs in the direction of high similarity. calculate.
G ′ (i, j) = B (i, j) × {G (i−1, j−1) + G (i + 1, j + 1)} / {B (i−1, j−1) + B (i + 1, j + 1) )} (6)

Note that the body drive control device 214 uses the equation (7) based on the average of the ratios of the pixel outputs determined to have high similarity instead of the equation (6) as the predicted output G ′ (i, j). May be calculated.
G ′ (i, j) = B (i, j) × 2 × {G (i−1, j−1) / B (i−1, j−1) + G (i + 1, j + 1) / B (i + 1, j + 1)} (7)

--When D <| δ |
The body drive control device 214 determines that the subject around the focus detection pixel 313 is substantially uniform, that is, the remarkable feature as shown in FIG. 13 is not extracted. In this case, the body drive control device 214 calculates the expected output G ′ (i, j) by the equation (1) used in the description of the embodiment or the equation (2) used in the modification.

  Although the case where the corresponding pixel 310CO is the blue B pixel 310B is shown, in the case of the red R pixel 310R, the pixel outputs of the expressions (4) to (7) are replaced from B (i, j) to R (i, j). Thus, the pixel output G ′ (i, j) can be calculated.

(3) The body drive control device 214 replaces the pixel output difference instead of calculating the expected output G ′ (i, j) based on the proportional relationship of the pixel output shown in the equations (1) and (2). The predicted output G ′ (i, j) may be calculated based on In this case, the body drive control device 214 may calculate the expected output G ′ (i, j) using, for example, the following equation (8). Although the case where the corresponding pixel 310CO is the blue B pixel 310B is shown, in the case of the red R pixel 310R, the pixel output of Expression (8) is changed from B (i, j) to R (i, j). Pixel output G ′ (i, j) can be calculated.
G ′ (i, j) = B (i, j) + [{G (i−1, j−1) −B (i−1, j−1)} + {G (i−1, j + 1) − B (i-1, j + 1)} + {G (i + 1, j-1) -B (i + 1, j-1)} + {G (i + 1, j + 1) -B (i + 1, j + 1)}] / 4
... (8)

(4) The body drive control device 214 converts the pixel outputs G (i, j) and B (i, j) from the imaging pixel 310 using a predetermined function (for example, γ conversion or Log conversion). ), The predicted output G ′ (i, j) may be calculated using the above-described equations (1) to (8).

-Second Embodiment-
Second Embodiment A digital camera will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and different points will be mainly described. Points that are not particularly described are the same as those in the first embodiment. In the present embodiment, the first embodiment is that a defect correction process is performed on the pixel output from the second image sensor after the defect correction process for the focus detection pixel arrangement position of the first image sensor. And different.

  As shown in FIG. 6, in the second image sensor 221, blue B pixels 310B and red R pixels 310R are arranged in a checkered pattern. For this reason, the position where the blue B pixel 310B is arranged is a missing pixel for the red R pixel 310R. The body drive controller 214 of the second embodiment includes a pixel output G (i, j) from the green G pixel 310G of the first image sensor 220 and a pixel output R of the red R pixel 310R of the second image sensor 221. (I, j) is used to calculate the predicted pixel output (predicted output) R ′ (i, j) when the red R pixel 310R is disposed at the position where the blue B pixel 310B is disposed. . Furthermore, the position where the red R pixel 310R is disposed is a missing pixel for the blue B pixel 310B. The body drive control device 214 outputs the pixel output G (i, j) from the green G pixel 310G of the first image sensor 220 and the pixel output B (i, j) of the red B pixel 310B of the second image sensor 221. The pixel output (predicted output) B ′ (i, j) predicted when the blue B pixel 310B is arranged at the position where the red R pixel 310R is arranged is calculated.

  The body drive control device 214 uses the predicted output R ′ (i, j) of the red R pixel 310R at the position where the blue B pixel 310B shown in FIG. 6 is arranged as the pixel output G of the first image sensor 220 shown in FIG. The pixel output R (i, j) is calculated from (i, j) and the red R pixel 310R of the second image sensor 221. The red R pixel 310R is arranged around the blue B pixel 310B on the second image sensor 220, and the green G pixel 310G on the first image sensor 220 is a corresponding pixel 310CO and a red R pixel of the blue B pixel 310B. This is the peripheral corresponding pixel 310COP of 310R. In this case, the body drive control device 214 replaces the pixel output G (i, j) shown in Expression (1) with the pixel output R (i, j) and the pixel output B (i, j) as the pixel output G (i , j), the predicted output R ′ (i, j) is calculated.

  However, as illustrated in FIG. 12, the corresponding pixel 310 </ b> CO of the blue B pixel 310 </ b> B that outputs the pixel output B (i, j) is the focus detection pixel 313 disposed in the first image sensor 220. In such a case, the body drive control device 214 may replace the pixel output B (i, j) of Expression (1) with the expected output G ′ (i, j) calculated according to the first embodiment. . Note that the body drive control device 214 may calculate the predicted output R ′ (i, j) by performing the above-described replacement for the equations (2) to (8).

  The body drive control device 214 uses the predicted output B ′ (i, j) of the blue B pixel 310B at the position where the red R pixel 310R shown in FIG. 6 is arranged as the pixel output G of the first image sensor 220 shown in FIG. (i, j) and the pixel output B (i, j) from the blue B pixel 310B of the second image sensor 221 are used for calculation. The blue B pixel 310B is arranged on the second image sensor 220 around the red R pixel 310R, and the green G pixel 310G on the first image sensor 220 is a corresponding pixel 310CO and a blue B pixel of the red R pixel 310R. This is the peripheral corresponding pixel 310COP of 310B. In this case, the body drive control device 214 replaces the pixel output G (i, j) shown in Expression (1) with the pixel output B (i, j), and converts the pixel output B (i, j) to the pixel output G (i , j), the predicted output B ′ (i, j) is calculated.

  When the corresponding pixel 310CO of the red R pixel 310R that outputs the pixel output R (i, j) is the focus detection pixel 313 or 314 arranged in the first image sensor 220, the body drive control device 214 The pixel output B (i, j) in the equation (1) may be replaced with the expected output G ′ (i, j) calculated according to the first embodiment. Note that the body drive control device 214 may calculate the predicted output B ′ (i, j) by performing the above-described replacement for the equations (2) to (8).

According to the second embodiment described above, in addition to the functions and effects obtained by the first embodiment, the following functions and effects can be obtained.
(1) Based on the pixel output G and the pixel output B, the body drive control device 214 predicts the output B ′ having information regarding the blue B color at the position where the red R pixel 310R is arranged on the second image sensor 221. Was generated. Further, the body drive control device 214 generates a predicted output R ′ having information on the red R color at the position where the blue B pixel 310B is arranged on the second image sensor 221 based on the pixel output G and the pixel output R. Generated. Therefore, when calculating the predicted output of the missing pixel on the second image sensor 221, the output from the first image sensor 220 is also used, so that the accuracy when calculating the predicted output is improved and the focus detection is performed. Information included in the light flux actually incident on the pixel 313 is not greatly different from the predicted output. As a result, it is possible to generate a high-quality image in which the occurrence of false colors or the like is suppressed.

(2) The body drive control device 214 is configured as follows when generating the predicted output B ′. That is, the body drive control device 214 outputs the pixel output B output from the blue B pixel 310B arranged around the red R pixel 310R on the second image sensor 221 and the corresponding pixel 310CO and blue B of the red R pixel 310R. A predicted output B ′ is generated based on the pixel output G output from the green G pixel 310G which is the peripheral corresponding pixel 310COP of the pixel 310B. Further, the body drive control device 214 is configured to generate the predicted output R ′ as follows. That is, the body drive control device 214 outputs the pixel output R output from the red R pixel 310R arranged around the blue B pixel 310B on the second image sensor 221 and the corresponding pixel 310CO and red R of the blue B pixel 310B. A predicted output R ′ is generated based on the pixel output G output from the green G pixel 310G which is the peripheral corresponding pixel 310COP of the pixel 310R. Therefore, the prediction output is calculated using the pixel outputs from the plurality of imaging pixels 310 around the missing pixel, the corresponding pixel 310CO, and the peripheral corresponding pixel 310COP. Contributes to higher image quality.

(3) When the corresponding pixel 310CO of the red R pixel 310R or the peripheral corresponding pixel 310COP of the blue B pixel 310B is the focus detection pixel 313, 314, the body drive control device 214 outputs the pixel outputs G and B and the expected output The predicted output B ′ is generated using G ′. Further, when the corresponding pixel 310CO of the blue B pixel 310B or the peripheral corresponding pixel 310COP of the red R pixel 310R is the focus detection pixels 313 and 314, the body drive control device 214 outputs the pixel outputs G and R and the expected output G. 'Is used to generate a predicted output R'. Therefore, even when the corresponding pixel 310CO corresponding to the missing pixel and the peripheral corresponding pixel 310COP are the focus detection pixels 313 and 314, the predicted output can be calculated without reducing the accuracy, thereby preventing the image quality from being deteriorated.

The digital cameras according to the first and second embodiments described above can be modified as follows.
(1) As shown in FIG. 14, the focus detection pixels 313 and 314 may be alternately arranged in the horizontal direction. Also in this case, the body drive control device 214 can perform the defect correction process and the missing correction process in the same manner using the equations (1) to (8).

(2) Instead of the wavelength-selective half mirror 222 that transmits a G-wavelength component beam and reflects a wavelength-component beam other than the G-wavelength component, it reflects a G-wavelength component beam, You may permeate | transmit the light beam of a wavelength component. That is, it is only necessary that one of the light beams on the transmission side and the reflection side is a light beam having a large G wavelength component. In this case, the first image sensor 220 may be disposed on the reflection side of the wavelength selective half mirror 222 and the second image sensor 221 may be disposed on the transmission side.

(3) Instead of the wavelength selective half mirror 222, a half mirror that does not have wavelength dependency may be provided. In this case, the focus detection pixels 313 and 314 are not provided with a color filter. As a result, the focus detection pixels 313 and 314 receive a light beam including all of RGB, so that the degree of freedom in designing spectral characteristics increases.

(4) The imaging pixel 310 and the focus detection pixels 313 and 314 included in the first imaging element 220 transmit a light beam having a Ye (yellow) wavelength component instead of a color filter that transmits the G wavelength component. A color filter may be provided. Alternatively, the image pickup pixel 310 and the focus detection pixels 313 and 314 may have flat spectral characteristics without providing a color filter. In other words, the imaging pixel 310 and the focus detection pixels 313 and 314 need only be capable of receiving a light beam containing a large amount of the G wavelength component.

  In addition, the present invention is not limited to the above-described embodiment as long as the characteristics of the present invention are not impaired, and other forms conceivable within the scope of the technical idea of the present invention are also within the scope of the present invention. included. The embodiments and modifications used in the description may be configured by appropriately combining them.

214 body drive control device, 220 first image sensor,
221 second imaging element, 310 imaging pixels,
310G green G pixel, 310B blue B pixel,
310R Red R pixel, 313, 314 Focus detection pixel

Claims (12)

A first imaging pixel that receives a light beam from the imaging optical system and outputs a first image signal having information on a first color of a subject image formed by the imaging optical system; receiving light beam, a first image sensor, wherein the focus detection pixel outputting a focus detection signal for detecting the focusing state of the photographic optical system is sequence,
A second imaging pixel that receives a light beam from the photographing optical system and outputs a second image signal having information on a second color of the subject image formed by the photographing optical system; a second imaging device and the third image pickup pixels for outputting a third image signal containing information about the third color is sequence,
The fourth image signal, the second image pickup pixel in the corresponding position of the second imaging element corresponding to the position of the focus detection pixels arranged with information about the first color at the position where the focus detection pixels are arranged The second image signal of the second imaging pixel at the corresponding position, the second image signal of the second imaging pixel disposed around the second imaging pixel at the corresponding position, and the focus detection pixel. Is generated by interpolation processing based on the first image signal of the first imaging pixel arranged around the first imaging pixel, and the third imaging pixel is located at a corresponding position of the second imaging element corresponding to the position of the focus detection pixel. When arranged, the third image signal of the third imaging pixel at the corresponding position, the third image signal of the third imaging pixel arranged around the third imaging pixel at the corresponding position, and the focus detection the first imaging pixels disposed around the pixel Based on the image signal, the image pickup apparatus characterized by comprising an interpolation means for generating by interpolation. The imaging device according to claim 1,
When the second imaging pixel is arranged at a corresponding position of the second imaging element corresponding to the position of the focus detection pixel, a second imaging pixel arranged around the second imaging pixel at the corresponding position; The first imaging pixels arranged around the focus detection pixels are arranged at positions corresponding to each other,
When the third imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the focus detection pixel, the third imaging pixel arranged around the third imaging pixel at the corresponding position; The imaging device, wherein the imaging device is arranged at a position corresponding to the first imaging pixel arranged around the focus detection pixel . The imaging device according to claim 1 or 2,
When the second imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the focus detection pixel, the interpolation means and the second image signal of the second imaging pixel at the corresponding position The addition value of the second image signal of the second imaging pixel arranged around the second imaging pixel at the corresponding position and the addition of the first image signal of the first imaging pixel arranged around the focus detection pixel Based on the value, the interpolation processing is performed,
When the third imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the focus detection pixel, the interpolation means and the third image signal of the third imaging pixel at the corresponding position The addition value of the third image signal of the third imaging pixel arranged around the third imaging pixel at the corresponding position and the addition of the first image signal of the first imaging pixel arranged around the focus detection pixel An image pickup apparatus that performs the interpolation processing based on a value . The imaging device according to claim 1 or 2,
When the second imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the focus detection pixel, the interpolation means and the second image signal of the second imaging pixel at the corresponding position , mutually corresponding positions for the first image signal of the first imaging pixels disposed around the focus detection pixels and the second image signal of the second imaging pixels disposed around the second imaging pixel of the corresponding position Performing the interpolation processing based on the ratio of the first and second image signals of the first and second imaging pixels,
When the third imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the focus detection pixel, the interpolation means and the third image signal of the third imaging pixel at the corresponding position Positions corresponding to each other with respect to the third image signal of the third imaging pixel arranged around the third imaging pixel at the corresponding position and the first image signal of the first imaging pixel arranged around the focus detection pixel. An imaging apparatus that performs the interpolation processing based on a ratio of the first and third image signals of the first and third imaging pixels . The imaging device according to claim 1 or 2 ,
When the second imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the focus detection pixel, the interpolation means and the second image signal of the second imaging pixel at the corresponding position Positions corresponding to each other with respect to the second image signal of the second imaging pixel disposed around the second imaging pixel at the corresponding position and the first image signal of the first imaging pixel disposed around the focus detection pixel. Performing the interpolation processing based on the difference between the first and second image signals of the first and second imaging pixels,
When the third imaging pixel is arranged at the corresponding position of the second imaging element corresponding to the position of the focus detection pixel, the interpolation means and the third image signal of the third imaging pixel at the corresponding position Positions corresponding to each other with respect to the third image signal of the third imaging pixel arranged around the third imaging pixel at the corresponding position and the first image signal of the first imaging pixel arranged around the focus detection pixel. An imaging apparatus that performs the interpolation processing based on a difference between the first and third image signals of the first and third imaging pixels . A first imaging pixel that receives a light beam from the imaging optical system and outputs a first image signal having information on a first color of a subject image formed by the imaging optical system; A first image sensor in which focus detection pixels that receive a light beam and output a focus detection signal for detecting a focus adjustment state of the photographing optical system are arranged in the same plane;
A second imaging pixel that receives a light beam from the photographing optical system and outputs a second image signal having information on a second color of the subject image formed by the photographing optical system; A second imaging element in which third imaging pixels that output a third image signal having information about the third color are arranged in the same plane;
Based on one of the second image signal and the third image signal output from the second image sensor, and the first image signal at a position where the focus detection pixels are arranged, Interpolating means generated by interpolation processing,
The interpolation means corresponds to the first image signal output from the first imaging pixels arranged around the focus detection pixels, the focus detection pixels and the first imaging pixels arranged around the focus detection pixels, The second image signal output from the second imaging pixel arranged at the first corresponding position on the second imaging element and the third image from the third imaging pixel arranged at the first corresponding position. Generating the fourth image signal having information on the first color by the interpolation processing based on one of the signals;
The interpolation means includes the first image signals output from the plurality of first imaging pixels arranged around the focus detection pixel, the plurality of second imaging pixels arranged at the first corresponding position, and An image pickup apparatus that generates the fourth image signal having information on the first color based on a difference from one of the plurality of third image pickup pixels . A first imaging pixel that receives a light beam from the imaging optical system and outputs a first image signal having information on a first color of a subject image formed by the imaging optical system; A first image sensor in which focus detection pixels that receive a light beam and output a focus detection signal for detecting a focus adjustment state of the photographing optical system are arranged in the same plane;
A second imaging pixel that receives a light beam from the photographing optical system and outputs a second image signal having information on a second color of the subject image formed by the photographing optical system; A second imaging element in which third imaging pixels that output a third image signal having information about the third color are arranged in the same plane;
Based on one of the second image signal and the third image signal output from the second image sensor, and the first image signal at a position where the focus detection pixels are arranged, Interpolating means generated by interpolation processing,
The interpolation means corresponds to the first image signal output from the first imaging pixels arranged around the focus detection pixels, the focus detection pixels and the first imaging pixels arranged around the focus detection pixels, The second image signal output from the second imaging pixel arranged at the first corresponding position on the second imaging element and the third image from the third imaging pixel arranged at the first corresponding position. Generating the fourth image signal having information on the first color by the interpolation processing based on one of the signals;
Based on the first image signal and the third image signal, a fifth image signal having information on the third color at a position where the second imaging pixels are arranged on the second imaging element is generated. First generation means;
Based on the first image signal and the second image signal, a sixth image signal having information on the second color at a position where the third imaging pixels are arranged on the second imaging element is generated. An imaging apparatus comprising: a second generation unit . A first imaging pixel that receives a light beam from the imaging optical system and outputs a first image signal having information on a first color of a subject image formed by the imaging optical system; A first image sensor in which focus detection pixels that receive a light beam and output a focus detection signal for detecting a focus adjustment state of the photographing optical system are arranged in the same plane;
A second imaging pixel that receives a light beam from the photographing optical system and outputs a second image signal having information on a second color of the subject image formed by the photographing optical system; A second imaging element in which third imaging pixels that output a third image signal having information about the third color are arranged in the same plane;
Based on one of the second image signal and the third image signal output from the second image sensor, and the first image signal at a position where the focus detection pixels are arranged, Interpolating means generated by interpolation processing,
The interpolation means corresponds to the first image signal output from the first imaging pixels arranged around the focus detection pixels, the focus detection pixels and the first imaging pixels arranged around the focus detection pixels, The second image signal output from the second imaging pixel arranged at the first corresponding position on the second imaging element and the third image from the third imaging pixel arranged at the first corresponding position. Generating the fourth image signal having information on the first color by the interpolation processing based on one of the signals;
The interpolation means includes the first image signal output from the plurality of first imaging pixels arranged around the focus detection pixel and the plurality of second imaging pixels arranged at the first corresponding position. Generating the fourth image signal having information on the first color based on a ratio between the second image signal and one of the third image signals from the plurality of third imaging pixels.
Based on the first image signal and the third image signal, a fifth image signal having information on the third color at a position where the second imaging pixels are arranged on the second imaging element is generated. First generation means;
Based on the first image signal and the second image signal, a sixth image signal having information on the second color at a position where the third imaging pixels are arranged on the second imaging element is generated. An imaging apparatus comprising: a second generation unit . The imaging device according to claim 6 ,
Based on the first image signal and the third image signal, a fifth image signal having information on the third color at a position where the second imaging pixels are arranged on the second imaging element is generated. First generation means;
Based on the first image signal and the second image signal, a sixth image signal having information on the second color at a position where the third imaging pixels are arranged on the second imaging element is generated. An imaging apparatus comprising: a second generation unit. In the imaging device according to any one of claims 7 to 9 ,
The first generation means outputs the third image signal output from a peripheral third imaging pixel arranged around the second imaging pixel on the second imaging element, the second imaging pixel, and the peripheral imaging Based on the first image signal output from the first imaging pixel arranged at the second corresponding position on the first imaging element corresponding to the position at which three imaging pixels are arranged, the fifth image Generate a signal,
The second generation means includes the second image signal output from a peripheral second imaging pixel arranged around the third imaging pixel on the second imaging element, the third imaging pixel, and the peripheral image. The sixth image based on the first image signal output from the first imaging pixel arranged at the third corresponding position on the first imaging element corresponding to the position at which two imaging pixels are arranged. An imaging apparatus comprising: generating a signal. The imaging device according to claim 10 .
When the focus detection pixels are arranged at the second corresponding position, the first generation unit uses the first image signal, the third image signal, and the fourth image signal to perform the first image signal. If the focus detection pixels are arranged at the third corresponding position, the second generation means generates the first image signal, the second image signal, and the fourth image. An image pickup apparatus that generates the sixth image signal using a signal. In the imaging device according to any one of claims 1 to 11 ,
The image pickup apparatus, wherein the second image pickup pixel and the third image pickup pixel are alternately arranged in a row direction and a column direction on the second image pickup element.

Images