GB2580845A - Image sensor and image capturing apparatus - Google Patents
Image sensor and image capturing apparatus Download PDFInfo
- Publication number
- GB2580845A GB2580845A GB2006560.3A GB202006560A GB2580845A GB 2580845 A GB2580845 A GB 2580845A GB 202006560 A GB202006560 A GB 202006560A GB 2580845 A GB2580845 A GB 2580845A
- Authority
- GB
- United Kingdom
- Prior art keywords
- image
- image sensor
- pupil
- pixel
- focus detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 210000001747 pupil Anatomy 0.000 abstract description 162
- 238000003384 imaging method Methods 0.000 abstract description 67
- 230000003287 optical effect Effects 0.000 abstract description 59
- 238000006243 chemical reaction Methods 0.000 abstract description 32
- 238000009826 distribution Methods 0.000 abstract description 18
- 230000004907 flux Effects 0.000 abstract description 10
- 239000011159 matrix material Substances 0.000 abstract 1
- 238000001514 detection method Methods 0.000 description 75
- 230000014509 gene expression Effects 0.000 description 15
- 238000012986 modification Methods 0.000 description 11
- 230000004048 modification Effects 0.000 description 11
- 238000000034 method Methods 0.000 description 10
- 230000003595 spectral effect Effects 0.000 description 7
- 230000035945 sensitivity Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000005484 gravity Effects 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000010304 firing Methods 0.000 description 2
- 101100129500 Caenorhabditis elegans max-2 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 229910021538 borax Inorganic materials 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- MJIHNNLFOKEZEW-UHFFFAOYSA-N lansoprazole Chemical compound CC1=C(OCC(F)(F)F)C=CN=C1CS(=O)C1=NC2=CC=CC=C2N1 MJIHNNLFOKEZEW-UHFFFAOYSA-N 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000004328 sodium tetraborate Substances 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 229910052724 xenon Inorganic materials 0.000 description 1
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/34—Systems for automatic generation of focusing signals using different areas in a pupil plane
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/36—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
- G02B7/365—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals by analysis of the spatial frequency components of the image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/702—SSIS architectures characterised by non-identical, non-equidistant or non-planar pixel layout
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
- H04N25/704—Pixels specially adapted for focusing, e.g. phase difference pixel sets
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Automatic Focus Adjustment (AREA)
- Studio Devices (AREA)
- Focusing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Structure And Mechanism Of Cameras (AREA)
- Color Television Image Signal Generators (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
An image capturing apparatus comprises an image sensor (107, Figure 1) including plural pixels (200, Figure 1) arrayed in a matrix. Each pixel has plural photoelectric conversion (image detector) units (301, 302) receiving light fluxes through different partial pupil regions (501, 502) of an imaging optical system (101-105, Figure 1). With respect to a change in exit pupil distance caused by a zoom lens, a focus lens or a diaphragm, at least, an entrance pupil distance Zs of the image sensor, a minimum exit pupil distance Lmin of the imaging optical system, and a maximum exit pupil distance Lmax of the imaging optical system satisfy: 4L min Lmax <Zs< 4LminLmax Lmin +3Lmax 3Lmin +Lmax. Also disclosed are image sensing systems wherein entrance pupil distance Zs and a maximum image height R of the image sensor satisfy: 2.33R < Zs < 6.99R; or, maximum image height and entrance pupil distance of the image sensor is such that a deviation amount between the image sensor entrance pupil and an optical system exit pupil with respect to each of the plural photoelectric conversion units falls within a range where a decrease in pupil intensity distribution is a half or less than at centre image height.
Description
TITLE OF THE INVENTION
IMAGE SENSOR AND IMAGE CAPTURING APPARATUS
BACKGROUND OF THE INVENTION 5 Field of the Invention [0001] The present invention relates to an image sensor and an image capturing apparatus.
Description of the Related Art
[0002] As a focus detection method performed by an image capturing apparatus, an on-imaging surface phase difference method is used in which focus detection by a phase difference method is performed using focus detection pixels formed in an image sensor.
[0003] U.S. Patent No. 4,410,804 discloses an image capturing apparatus using a two-dimensional image sensor in which one microlens and a plurality of photoelectric conversion units are formed in each pixel. The plurality of photoelectric conversion units are configured to receive light components that have passed through different regions of the exit pupil of an imaging lens via one microlens, thereby dividing the pupil.
A correlation amount is calculated from focus detection signals output from pixels (focus detection pixels) each including a plurality of -1 - photoelectric conversion units, and an image shift amount is obtained from the correlation amount, thereby performing focus detection by the phase difference method. Further, Japanese Patent Laid-Open No. 2001-083407 discloses generating an image signal by adding focus detection signals output from a plurality of photoelectric conversion units for each pixel.
[0004] Japanese Patent Laid-Open No. 2000-156823 discloses an image capturing apparatus in which pairs of focus detection pixels are partially arranged in a two-dimensional image sensor formed from a plurality of imaging pixels. The pairs of focus detection pixels are configured to receive light components from different regions of the exit pupil of an imaging lens via a light shielding layer having openings, thereby dividing the pupil. An image signal is acquired by imaging pixels arranged on most parts of the two-dimensional image sensor. A correlation amount is calculated from focus detection signals of the partially arranged focus detection pixels, and an image shift amount is obtained from the calculated correlation amount, thereby performing focus detection by the phase difference method, as disclosed.
[0005] In focus detection using the on-imaging surface phase difference method, the defocus direction and the defocus amount can simultaneously be detected by focus detection pixels formed in an image sensor. It is therefore possible to perform focus control at a high speed.
[0006] However, in the on-imaging surface phase difference method, there is a problem in that, when a variation range of an incident angle of light from an imaging lens (imaging optical system) on an image sensor at a peripheral portion is large, a pupil deviation between an entrance pupil of a sensor and an exit pupil of the imaging lens is large, and the base line length is not secured, and consequently there is a case in which the focus detection quality by the on-imaging surface phase difference method deteriorates.
SUMMARY OF THE INVENTION
[0007] The present invention has been made in consideration of the above situation, and realizes focus detection by the on-imaging surface phase difference method under a wide range of conditions in a case where a variation range of an incident angle of light from an imaging optical system on an image sensor at a peripheral portion is large. [0008] According to the present invention, provided is an image capturing apparatus comprising: an image sensor including a plurality of pixels arrayed in a column direction and a row direction, each of the pixels having a plurality of photoelectric conversion units for receiving light fluxes that have passed through different partial pupil regions of an imaging optical system, wherein an entrance pupil distance Zs of the image sensor, a minimum exit pupil distance Lmin of the imaging optical system, and a maximum exit pupil distance L" of the imaging optical system satisfy a condition of: 4Lini"Lina, Z, < Lnun + 31. IMIX 3/.null +1,11lat [0009] Further, according to the present invention, provided is an image sensor comprising a plurality of pixels arrayed in a column direction and a row direction, each of the pixels having a plurality of photoelectric conversion units for receiving light fluxes that have passed through different partial pupil regions of an imaging optical system, wherein an entrance pupil distance Z, of the image sensor and a maximum image height R of the image sensor satisfy the condition of: 2.33R < Z, <6.99R.
[0010] Furthermore, according to the present invention, provided is image sensor comprising a plurality of pixels arrayed in a column direction and a row direction, each of the pixels having a plurality of photoelectric conversion units for receiving light fluxes that have passed through different partial pupil regions of an imaging optical system, wherein a maximum image height and an entrance pupil distance of the image sensor is determined such that a deviation amount between the entrance pupil of the image sensor and an exit pupil of the imaging optical system with respect to each of the plurality of photoelectric conversion units falls within a predetermined range.
[0011] Further, according to the present invention, provided is an image capturing apparatus that is connectable to a detachable imaging optical system comprising the image sensor as described above.
[0012] Further, according to the present invention, provided is an image capturing apparatus comprising: an imaging optical system; and the image sensor as described above. [0013] Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings). -5 -
BRIEF DESCRIPTION OF THE DRAWINGS [0014] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention, and together with the description, serve to explain the principles of the invention.
[0015] Fig. 1 is a schematic block diagram of an image capturing apparatus according to an embodiment of the present invention; [0016] Fig. 2 is a schematic view of a pixel array according to the embodiment; [0017] Figs. 3A and 3B are a schematic plan view and a schematic sectional view, respectively, of a pixel according to the embodiment; [0018] Fig. 4 is a schematic explanatory view of a pixel structure and pupil division according to the embodiment; [0019] Fig. 5 is a schematic explanatory view of an image sensor and pupil division according to 20 the embodiment; [0020] Fig. 6 is a schematic explanatory view for explaining correspondence between an entrance pupil of an image sensor and a pupil shift amount between the entrance pupil and an exit pupil of an imaging optical system according to the embodiment; [0021] Fig. 7 is a schematic view of a pixel -6 -array according to a modification; [0022] Figs. 8A and 8B are a schematic plan view and a schematic sectional view, respectively, of a pixel according to the modification; [0023] Figs. 9A and 9B are diagrams showing an example of light intensity distribution within a pixel according to the embodiment; and [0024] Fig. 10 is a diagram showing an example of pupil intensity distribution according to the 10 embodiment.
DESCRIPTION OF THE EMBODIMENTS
[0025] Exemplary embodiments of the present invention will be described in detail in accordance with the accompanying drawings. Each of the embodiments of the present invention described below can be implemented solely or as a combination of a plurality of the embodiments or features thereof where necessary or where the combination of elements or features from individual embodiments in a single embodiment is beneficial.
[0026][Overall Arrangement] Fig. 1 is a diagram showing a brief configuration of a camera as an example of an image capturing apparatus having an image sensor -7 -according to an embodiment of the present invention. In Fig. 1, a first lens group 101 is disposed on the front end of an imaging optical system, and supported so as to be movable forward and backward along an optical axis. An aperture-shutter 102 adjusts the diameter of its opening, thereby adjusting the amount of light during image sensing, and also has a function to adjust the exposure time during still image sensing. The aperture-shutter 102 and a second lens group 103 move together forward and backward along the optical axis, and, in conjunction with the movement forward and backward of the first lens group 101, provide a magnification change effect (a zoom function).
[0027] A third lens group 105 (focus lens) carries out focus adjustment by moving forward and backward along the optical axis. A low-pass optical filter 106 is an optical element for the purpose of reducing false color and moire of a sensed image. An image sensor 107 is composed of a two-dimensional CMOS photo sensor and the surrounding circuitry, and disposed on an imaging plane of the imaging optical system.
[0028] A zoom actuator 111 carries out a magnification-change operation by rotation of a cam barrel, not shown, to move the first lens -8 -group 101 through the second lens group 103 forward and backward along the optical axis. An aperture-shutter actuator 112 controls the diameter of the opening of the aperture-shutter 102 and adjusts the amount of light for image sensing, and also controls the exposure time during still image sensing. A focus actuator 114 moves the third lens group 105 forward and backward along the optical axis to adjust the focus.
[0029] An electronic flash 115 for illuminating an object is used during image sensing. A flash illumination device that uses a Xenon tube is preferable, but an illumination device comprised of a continuous-flash LED may also be used. An AF auxiliary flash unit 116 projects an image of a mask having a predetermined opening pattern onto an object field through a projective lens to improve focus detection capability with respect to dark objects and low-contrast objects.
[0030] The CPU 121 controls the camera main unit in various ways within the image capturing apparatus. The CPU 121 may, for example, have a calculation unit, ROM, RAM, A/D converter, D/A converter, communication interface circuitry, and so forth. In addition, the CPU 121, based on predetermined programs stored in the ROM, drives the various circuits that the camera has, and executes a set of operations of AF, image sensing, image processing, and recording.
[0031] An electronic flash control circuit 122 controls firing of the electronic flash 115 in synchrony with an image sensing operation. An auxiliary flash drive circuit 123 controls firing of the AF auxiliary flash unit 116 in synchrony with a focus detection operation. An image sensor drive circuit 124 controls the image sensing operation of the image sensor 107 as well as A/Dconverts acquired image signals and transmits the converted image signals to the CPU 121. An image processing circuit 125 performs such processing as y conversion, color interpolation, JPEG compression and the like on the images acquired by the image sensor 107.
[0032] A focus drive circuit 126 controls the drive of the focus actuator 114 based on the focus detection result to drive the third lens group 105 reciprocally in the optical axis direction, thereby performing focus adjustment. An aperture-shutter drive circuit 128 controls the drive of the aperture-shutter actuator 112, thereby driving the opening of the aperture-shutter 102. A zoom drive circuit 129 drives the zoom actuator 111 in accordance with the zoom operation of the user.
-10 - [0033] A display device 131, such as an LCD, displays information relating to the image sensing mode of the camera, preview images before image sensing, confirmation images after image sensing, focus state display images during focus detection, and the like. An operating switch group 132 is composed of a power switch, a release (image sensing trigger) switch, a zoom operation switch, an image sensing mode selection switch, and the like. A detachable flash memory 133 records captured images.
[0034] [Image Sensor] Fig. 2 shows the outline of an array of the imaging pixels and the focus detection pixels of the image sensor 107 according to the embodiment. The pixels are arrayed in a column direction and a row direction. Fig. 2 illustrates the pixel (imaging pixel) array within the range of 4 columns x 4 rows and the focus detection pixel array within the range of 8 columns x 4 rows in the two-dimensional CMOS sensor (image sensor) according to this embodiment.
[0035] A pixel group 200 includes pixels of 2 columns x 2 rows. A pixel 200R having an R (red) 25 spectral sensitivity is arranged at the upper left position, pixels 200G having a G (green) spectral sensitivity are arranged at the upper right and lower left positions, and a pixel 200B having a B (blue) spectral sensitivity is arranged at the lower right position. Each pixel is formed from a first focus detection pixel 201 and a second focus detection pixel 202 arrayed in 2 columns x 1 row.
[0036] A number of arrays of 4 (columns) x 4 (rows) pixels (8 (columns) x 4 (rows) focus detection pixels) shown in Fig. 2 are arranged on a plane to capture an image (focus detection signal). In the embodiment, the image sensor will be described assuming that the horizontal size H is 36 mm, and the vertical size V is 24 mm, a period P of pixels is 4.8 p.m, the number N of pixels is 7,500 columns in horizontal direction x 5,000 rows in vertical direction = 37,500,000, a column-direction period PAF of focus detection pixels is 2.4 him, and the number NAF of focus detection pixels is 15,000 columns in horizontal direction x 5,000 rows in vertical direction = 75,000,000.
[0037] Fig. 3A is a plan view of one pixel 200G of the image sensor 107 shown in Fig. 2 when viewed from the light receiving surface side (+z side) of the image sensor 107, and Fig. 3B is a sectional view showing the a -a section in Fig. 3A viewed from the -y side. As shown in Figs. 3A and 3B, in the pixel 200G according to this -12 -embodiment, a microlens 305 for condensing incident light is formed on the light receiving side of each pixel. The pixel is divided by NH (here, divided by two) in the x direction and divided by NV (here, divided by one, or not divided) in the y direction to form photoelectric conversion units 301 and 302. The photoelectric conversion units 301 and 302 correspond to the first focus detection pixel 201 and the second focus detection pixel 202, respectively.
[0038] Each of the photoelectric conversion units 301 and 302 may be formed as a pin structure photodiode including an intrinsic layer between a p-type layer and an n-type layer or a p-n junction photodiode without an intrinsic layer, as needed.
[0039] In each pixel, a color filter 306 is formed between the microlens 305 and the photoelectric conversion units 301 and 302. The spectral transmittance of the color filter may be changed between the focus detection pixels, as needed, or the color filter may be omitted.
[0040] Light that has entered the pixel 200G shown in Figs. 3A and 3B is condensed by the microlens 305, spectrally split by the color filter 306, and received by the photoelectric conversion units 301 and 302. In the photoelectric conversion units 301 and 302, electron-hole pairs -13 -are produced in accordance with the received light amount and separated in the depletion layer. Electrons having negative charges are accumulated in the n-type layers (not shown). On the other 5 hand, holes are discharged externally from the image sensor 107 through the p-type layers connected to a constant voltage source (not shown). The electrons accumulated in the n-type layers (not shown) of the photoelectric conversion units 301 and 302 are transferred to electrostatic capacitances (FDs) through transfer gates, converted into voltage signals, and output. Note that the focus position of the microlens 305 changes in accordance with its shape (curvature, for example), material (index of refraction, for example), and positional relationship with respect to corresponding photoelectric conversion units, and so on. By setting these parameters, it is possible to set the focus position of the microlens 305.
[0041] The pixels 200R and 200B shown in Fig. 2 also have the similar structure as the pixel 200G, and output voltage signals corresponding to the light spectrally split by the color filter 306, in a similar manner as the pixel 200G.
[0042] The correspondence between pupil division and the pixel structure according to this -1 4 -embodiment shown in Figs. 3A and 3B will be described with reference to Fig. 4. Fig. 4 illustrates a sectional view showing the a -a section of the pixel structure according to the embodiment shown in Fig. 3A viewed from the +y side and the exit pupil plane of an imaging optical system. Note that in Fig. 4, to obtain correspondence with the coordinate axes of the exit pupil plane, the x-and y-axes of the sectional view are reversed with respect to those of Figs. 3A and 3B.
[0043] A first partial pupil region 501 off the first focus detection pixel 201 represents a pupil region that is almost conjugate with the light receiving surface of the photoelectric conversion unit 301 having a center of gravity decentered in the -x direction via the microlens 305, and light beams that have passed through the first partial pupil region 501 are received by the first focus detection pixel 201. The first partial pupil region 501 of the first focus detection pixel 201 has a center of gravity decentered to the +x side on the pupil plane.
[0044] A second partial pupil region 502 of the second focus detection pixel 202 represents a pupil region that is almost conjugate with the light receiving surface of the photoelectric -15 -conversion unit 302 having a center of gravity decentered in the +x direction via the microlens 305, and light beams that have passed through the second partial pupil region SO2 are received by the second focus detection pixel 202. The second partial pupil region 502 of the second focus detection pixel 202 has a center of gravity decentered to the -x side on the pupil plane. [0045] Light beams that have passed through a pupil region 500 are received by the whole pixel 200G including the photoelectric conversion units 301 and 302 (first focus detection pixel 201 and the second focus detection pixel 202). Reference numeral 400 denotes an opening of the aperture-shutter 102.
[0046] Fig. 5 is a schematic view showing the correspondence between the image sensor and pupil division according to the embodiment. It is configured so that, at a sensor entrance pupil distance Z, the first partial pupil region 501 corresponding to a light receiving region of the first focus detection pixel 201 of each pixel arranged at each position on the surface of the image sensor 107 substantially matches. Similarly, it is configured so that the second partial pupil region 502 corresponding to a light receiving region of the second focus detection pixel 202 of -16 -each pixel substantially matches. In other words, it is configured so that a pupil division position between the first partial pupil region 501 and the second partial pupil region SO2 for each pixel of the image sensor 107 substantially matches at the sensor entrance pupil distance Zs. The first partial pupil region 501 and the second partial pupil region 502 are referred to as "sensor entrance pupil", hereinafter. A pair of light fluxes that have passed through the different partial pupil regions of an imaging optical system, namely, the first partial pupil region 501 and the second partial pupil region 502 are incident on each pixel of the image sensor 107 at different incident angles, and received by the first focus detection pixel 201 and the second focus detection pixel 202 which are divided to 2 x 1. The present embodiment shows a case where the pupil region is divided into two in the horizontal direction.
However, the pupil region may be divided in the vertical direction as needed.
[0047] Figs. 9A and OR show light intensity distributions in a case where light is incident on a microlens formed in each pixel. Fig. 9A shows a light intensity distribution of a cross section of the microlens that is parallel to the optical axis of the microlens. Fig. 9B shows a light intensity -17 -distribution of a cross section of the microlens that is perpendicular to the optical axis of the microlens at a focus position of the microlens. Incident light is converged by the microlens to the focus position. However, due to diffraction caused by the fluctuation of light, it is not possible to make the diameter of a concentration spot of light smaller than the diffraction limit A, and must have a finite size. The size of the light receiving surface of a photoelectric conversion unit is about 1 to 2 1.1m, whereas the size cf the concentration spot of the microlens is about Therefore, the first partial pupil region 501 and the second partial pupil region 502 in Fig. 4 which are conjugate with the light receiving surface of the photoelectric conversion unit with respect to the microlens are not pupil divided precisely due to diffraction blur, and receive light in accordance with light receiving rate distribution (pupil intensity distribution) that depends on an incident angle of light.
[0048] Fig. 10 shows an example of the light receiving rate distribution (pupil intensity distribution) that depends on an incident angle of light. The abscissa indicates an incident angle of light A (can be converted to pupil coordinates), and the ordinate indicates a light receiving rate.
-1 8 -A curve P11(0) shown by a broken line in Fig. 10 illustrates a pupil intensity distribution of the first partial pupil region 501 in Fig. 4 along the X axis, and a curve P12(0) shown by a dot-dash line illustrates a pupil intensity distribution of the second partial pupil region along the X axis. Further, a curve P1(0) (= PI1(0) + PI2(0)) shown by a solid line illustrates a pupil intensity distribution of the total pupil region 500 of the first partial pupil region 501 and the second partial pupil region 502 in Fig. 4 along the X axis. As shown in Fig. 10, it will be understood that the pupil is divided gradually.
[0049] The embodiment shows an example in which the pupil region is divided into two in the horizontal direction. however, the pupil region may be divided in the vertical direction as needed.
[0050] It should be noted that, in the aforesaid example, a plurality of image sensing pixels each formed with the first focus detection pixel and the second focus detection pixel are arrayed, however, the present invention is not limited to this. The image sensing pixels, the first focus detection pixels and the second focus detection pixels may be formed independently, and the first focus detection pixels and the second focus detection pixels may be partially provided among -19 -an array of the image sensing pixels.
[0051] In this embodiment, the first focus detection signal is formed by collecting signals corresponding to received light from the first focus detection pixels 201 of the respective pixels of the image sensor, the second focus detection signal is formed by collecting signals corresponding to received light from the second focus detection pixels 202 of the respective pixels of the image sensor, and perform focus detection using the first and second focus detection signals. Further, by adding the signals from the first focus detection pixels 201 and the second focus detection pixels 202 for each pixel of the image sensor 107, an image signal (a captured image) with the resolution corresponding to the number of the effective pixels N is generated.
[0052][Pupil Deviation] Fig. 6 is a schematic explanatory view of corresponding relationship of a pupil deviation between the entrance pupil of the image sensor 107 of this embodiment (referred to as "sensor entrance pupil", hereinafter) and the exit pupil of the imaging optical system (referred to as "imaging lens exit pupil", hereinafter). In Fig. 6, let the entrance pupil distance of the image -20 -sensor 107 (referred to as "sensor entrance pupil distance", hereinafter) be Zs, the maximum image height of the image sensor 107 be R, the minimum exit pupil distance of the imaging optical system be Lmin, and the maximum exit pupil distance of the imaging optical system be Lr". The maximum image height R of the image sensor 107 is R2 = (0.5 x H) 2 (0.5 x V) 2, with the horizontal size of the image sensor 107 being H, and the vertical size of the image sensor 107 being V. The exit pupil distance of the imaging optical system changes between the minimum exit pupil distance Lmis and the maximum exit pupil distance Lm, in accordance with the exchange of the imaging lens in a case of lens exchangeable camera, changes in a zoom ratio, focus state, and aperture of the imaging lens. Further, in this embodiment, the image height is an amount determined independent of the image height of the imaging lens, and used as a position from the center of the image sensor 107 or the position from the center of a sensed image. Therefore, although calculation of the maximum image height R has been explained using the horizontal size H and the vertical size V, these sizes do not necessarily coincide with the size of the image sensor 107. For example, the maximum image height R may be the maximum image height of -21 -an image to be displayed on the display device 131, in which case, the maximum image height R may be smaller than the size of the image sensor 107 by an amount of a margin used for image processing and image stabilization. Further, the maximum image height R may be the maximum image height of an image portion to be stored as image data. In this case, the image portion substantially coincides with an area in which calculation for the focus detection is performed.
[0053] At the sensor entrance pupil distance Z" the first partial pupil region 501 which is a light receiving region (entrance pupil) of the first focus detection pixel 201 of each pixel of the image sensor 107 and the second partial pupil region 502 which is a light receiving region of the second focus detection pixel 202 intersect substantially on the optical axis. Considering the overlapping of the first partial pupil region 501 and the second partial pupil region 502, which are the sensor entrance pupil, and the imaging lens exit pupil at the sensor entrance pupil distance Z, a pupil deviation amount between the sensor entrance pupil and the imaging lens exit pupil with the minimum exit pupil distance Lm_n is Pl.
Similarly, a pupil deviation amount between the sensor entrance pupil and the imaging lens exit -22 -pupil with the maximum exit pupil distance Lmax is P2. If either of the pupil deviation amount P1 or the pupil deviation amount P2 between the sensor entrance pupil and the imaging lens exit pupil is large, the base-line length is not secured, and there is case in which the focus detection performance by the phase difference AF deteriorates.
[0054] Accordingly, in the present embodiment, it is configured such that the sensor entrance pupil distance Z, satisfies the following condition so that the pupil deviation amounts P1 and P2 are restrained.
[0055] First, let an incident angle of light on a pixel located at the maximum image height P. of the image sensor 107 from the sensor entrance pupil distance Zs on the optical axis be 05, an incident angle of light on the same pixel from the minimum exit pupil distance Lm_n on the optical axis be Om, and an incident angle of light on the same pixel from the maximum exit pupil distance Lima, on the optical axis be Omni. In order to restrain the pupil deviation amounts El and P2 to secure the base-line length, in this embodiment, the angle 0, is set within a range that satisfies the following expression (1) which defines a neighboring range of an average incident angle.
-23 -Borax + 436/min <0.<30maxd-qmn...(1) [0056] Further, 0, On,", and Ornin can be approximated by the following expressions (2).
Os -tangs = Zs Oms-atanOm,-(x Lorin 8,1111, =tang 8 - 111,, -1 Lanz By substituting the expression (2) to the expression (1), the following expression (3) that shows the condition that the sensor entrance pupil distance Z3 should satisfy is obtained.
41.,","Lmas 4L"nu,' < Z < . . . (3) Lmin 3Ltilax 3Lnlin Lmax [0057] Therefore, in this embodiment, in order to restrain the pupil deviation amounts P1 and P2 and secure the base-line length, it is configured so that the entrance pupil distance Z, of the image sensor 107 satisfies the expression (3) with the minimum exit pupil distance Lfln and the maximum exit pupil distance L, of the imaging optical system.
[0058] In a case of a lens exchangeable camera, lenses with various optical conditions, from the wide angle lenses to telephoto lenses may be attached. In this case, as a condition for the maximum exit pupil distance T2,,, of the imaging -24 -optical system, it is desired to set Lmda = Do in order to cope with the telecentric optical lens. Further, as a condition for the minimum exit pupil distance Lif" of the imaging optical system, it is desired to restrain a marginal illumination decrease expressed by the cosine fourth law with respect to the center image height to equal or less than 1/2 (half). Therefore, under the condition of cos4(Omax) = 1/2, it is desired that the maximum incident angle Omax of light that incidents on the pixel located at the maximum image height R of the image sensor 107 from the minimum exit pupil distance Lmia on the optical axis is Om, = 32.8° = 0.572[rad]. Accordingly, from the expression (2), with the maximum image height R of the image sensor 107, it is desired that minimum exit pupil distance Lm" is Timm, -R/0.572.
[0059] By substituting Lm_n = R/0.572 and Lmax = 00 in the expression (3), the following condition expression (4) for the sensor entrance pupil distance Z, is obtained.
2.33R < Z, < 6.99R... (4) In this embodiment, since the horizontal size H of the image sensor 107 is 36mm, the vertical size V of the same is 24mm, and the maximum image height R of the same is 21.63mm, the condition expression -25 - (4) for the sensor entrance pupil distance Zs is 50.4mm < Zs < 151.2mm.
[0060] Further, the condition of the minimum exit pupil distance Lmin of the imaging optical system may be determined on the basis of the pupil intensity distribution of the pupil region 500 which is a combined area of the first partial pupil region 501 and the second partial pupil region 502 of the image sensor 107. Here, the pupil intensity distribution of the pupil region 500 at the central image height is denoted by PIO (0) , and the pupil intensity distribution of the pupil region 500 at the maximum image height R is denoted by PIR(0) . As the condition of the minimum exit pupil distance Litin of the imaging optical system, it is desirable to restrain a decrease in the pupil intensity distribution PIR (0=0max pia) at the incident angle Or. [ rad] at the maximum image height R to 1/2 (half) or less than the pupil intensity distribution PIO (0=0) at the incident angle 0 [ rad] at the central image height. Therefore, it is desirable to determine the incident angle IL, p=R of light from the minimum exit pupil distance Lm±,, on the optical axis based on the condition of PIR (0=0sasx pm) = 0.5 x PIO (0=0) , and determine the minimum exit pupil distance Tirain = R/Ornsx pip from the expression (2) . -26 - [0061] By substituting Lmm= R/0" p7R and Lam, = to the expression (3), the condition expression (5) of the sensor entrance pupil distance Zs is obtained. (5)
R
4 <Zs<4 3 °Imp( PIR °max PM [0062] As described above, the image sensor of the embodiment has a configuration in which a plurality of pixels are arrayed, wherein each pixel has a plurality of photoelectric conversion units for receiving light fluxes that have passed through different partial pupil regions of the imaging optical system, and in which the sensor entrance pupil distance Zs satisfies the expression (3) with respect to the minimum exit pupil 15 distance L.mm, of the imaging optical system and the maximum exit pupil distance of the imaging optical system.
[0063] Further, the image sensor of the embodiment has a configuration in which a plurality of pixels are arrayed, wherein each pixel has a plurality of photoelectric conversion units for receiving light fluxes that have passed through different partial pupil regions of the imaging optical system, and in which the sensor entrance pupil distance Zs satisfies the expression (4) with respect to the maximum image height R of -27 -the image sensor.
[0064] With the configuration as described above, the focus detection by the on-imaging surface phase difference method is possible over a wide range of conditions in a case where a changing range of the incident angle of light from the imaging optical system on a pixel at a peripheral image height of the image sensor is large. [0065]<Modification> In the first embodiment as described above, each pixel of the image sensor 107 is divided by 2 in the x direction, and by 1 (or not divided) in the y direction. However, the present invention is not limited to this, an image sensor 107 comprises pixels that are divided by different numbers and different ways from the pixels shown in Fig. 2.
[0066] Fig. 7 shows the outline of the imaging pixels and the array of focus detection pixels of the image sensor 107 according to the modification.
Fig. 7 illustrates the pixel (imaging pixel) array within the range of 4 columns x 4 rows and the focus detection pixel array within the range of 8 columns x 8 rows in the two-dimensional CMOS sensor (image sensor) according to the modification.
[0067] In this modification, a pixel group 700 shown in Fig.7 includes pixels of 2 columns x 2 -28 -rows. A pixel 700R having an R (red) spectral sensitivity is arranged at the upper left position, pixels 700G having a G (green) spectral sensitivity are arranged at the upper right and lower left positions, and a pixel 700B having a B (blue) spectral sensitivity is arranged at the lower right position. Each pixel is formed from a first focus detection pixel 701 to a fourth focus detection pixel 704 arrayed in 2 columns x 2 rows.
[0068] A number of arrays of 4 (columns) x 4 (rows) pixels (8 (columns) x 8 (rows) focus detection pixels) shown in Fig. 7 are arranged on a plane to capture an image (focus detection signal). In the modification, the image sensor will be described assuming that the horizontal size H is 36 mm, vertical size V is 24 mm, a period P of pixels is 4.8 Rm, the number N of pixels is 7,500 columns in horizontal direction x 5,000 rows in vertical direction = 37,500,000, a column-direction period PSUB of focus detection pixels is 2.4 lam, and the number NSUB of focus detection pixels is 15,000 columns in horizontal direction x 10,000 rows in vertical direction = 150,000,000.
[0069] Fig. 8A is a plan view of one pixel 700G of the image sensor 107 shown in Fig. 7 when viewed from the light receiving surface side (+z -29 -side) of the image sensor 107, and Fig. 8B is a sectional view showing the a -a section in Fig. 8A viewed from the -y side. As shown in Figs. 8A and 8B, in the pixel 700G according to the modification, a microlens 305 for condensing incident light is formed on the light receiving side of each pixel. The pixel is divided by NH (here, divided by two) in the x direction and divided by NV (here, divided by two) in the y direction to form first to fourth photoelectric conversion units 801 to 804. The first to fourth photoelectric conversion units 801 to 804 correspond to the first focus detection pixel 701 to the fourth focus detection pixel 704, respectively.
[0070] In the modification, by adding signals from the first focus detection pixel 701 to the fourth focus detection pixel 704 for each pixel of the image sensor 107, an image signal (a captured image) with the resolution corresponding to the number of the effective pixels N is generated. Except for this, the modification is similar to the above embodiment.
[0071] With the configuration as described above, the focus detection by the on-imaging surface phase difference method is possible over a wide range of conditions in a case where a chancing -30 -range of the incident angle of light from the imaging optical system on a pixel at a peripheral image height of the image sensor is large.
[0072] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to 10 encompass all such modifications and equivalent structures and functions.
[0073] This application is a divisional application of GB application number 1700961.4 (the "parent application"). The claims as ordinally filed in the parent application are included below as statements and form part of this divisional application.
STATEMENTS
1. An image capturing apparatus comprising: an image sensor including a plurality of pixels arrayed in a column direction and a row direction, each of the pixels having a plurality 25 of photoelectric conversion units for receiving light fluxes that have passed through different partial pupil regions of an imaging optical system, -31 -wherein an entrance pupil distance Zs of the image sensor, a minimum exit pupil distance Lmi2 of the imaging optical system, and a maximum exit pupil distance isms:, of the imaging optical system satisfy a condition of: 4L,thill,max <7S < min-cax [*min + 3 1max 31. +max 2. An image sensor comprising a plurality of pixels arrayed in a column direction and a row direction, each of the pixels having a plurality of photoelectric conversion units for receiving light fluxes that have passed through different partial pupil regions of an imaging optical system, wherein an entrance pupil distance Zs of the image sensor and a maximum image height R of the image sensor satisfy the condition of: 2.33R < Zs <6.99R.
3. An image sensor comprising a plurality of pixels arrayed in a column direction and a row direction, each of the pixels having a plurality of photoelectric conversion units for receiving light fluxes that have passed through different partial pupil regions of an imaging optical system, wherein a maximum image height and an entrance pupil -32 -distance of the image sensor is determined such that a deviation amount between the entrance pupil of the image sensor and an exit pupil of the imaging optical system with respect to each of the plurality of photoelectric conversion units falls within a predetermined range.
4. An image capturing apparatus that is connectable to a detachable imaging optical system comprising:
the image sensor as described in statements 2 or 3.
5. An image capturing apparatus comprising: an imaging optical system; and
the image sensor as described in statements 2 or 3.
-33 -
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB2015313.6A GB2584811B (en) | 2016-01-29 | 2017-01-20 | Image sensor and image capturing apparatus |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2016016173 | 2016-01-29 | ||
| JP2016234423A JP6584383B2 (en) | 2016-01-29 | 2016-12-01 | Imaging device and imaging apparatus |
| GB1700961.4A GB2548462B (en) | 2016-01-29 | 2017-01-20 | Image sensor and image capturing apparatus |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| GB202006560D0 GB202006560D0 (en) | 2020-06-17 |
| GB2580845A true GB2580845A (en) | 2020-07-29 |
| GB2580845B GB2580845B (en) | 2020-12-09 |
Family
ID=59565217
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| GB2006560.3A Active GB2580845B (en) | 2016-01-29 | 2017-01-20 | Image sensor and image capturing apparatus |
| GB2015313.6A Active GB2584811B (en) | 2016-01-29 | 2017-01-20 | Image sensor and image capturing apparatus |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| GB2015313.6A Active GB2584811B (en) | 2016-01-29 | 2017-01-20 | Image sensor and image capturing apparatus |
Country Status (2)
| Country | Link |
|---|---|
| JP (4) | JP6584383B2 (en) |
| GB (2) | GB2580845B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2548462B (en) | 2016-01-29 | 2020-06-17 | Canon Kk | Image sensor and image capturing apparatus |
| JP6584383B2 (en) * | 2016-01-29 | 2019-10-02 | キヤノン株式会社 | Imaging device and imaging apparatus |
| US10924655B2 (en) | 2017-11-06 | 2021-02-16 | Canon Kabushiki Kaisha | Image-capturing apparatus and control method thereof |
| JP7051613B2 (en) * | 2017-11-06 | 2022-04-11 | キヤノン株式会社 | Image pickup device and its control method |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4410804A (en) * | 1981-07-13 | 1983-10-18 | Honeywell Inc. | Two dimensional image panel with range measurement capability |
| US20140071322A1 (en) * | 2012-09-11 | 2014-03-13 | Canon Kabushiki Kaisha | Image pickup apparatus with image pickup device and control method for image pickup apparatus |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4983271B2 (en) * | 2007-01-19 | 2012-07-25 | 株式会社ニコン | Imaging device |
| JP4935544B2 (en) * | 2007-07-06 | 2012-05-23 | 株式会社ニコン | Imaging device |
| JP5256675B2 (en) * | 2007-09-21 | 2013-08-07 | 株式会社ニコン | Imaging device |
| JP5067148B2 (en) * | 2007-12-13 | 2012-11-07 | 株式会社ニコン | Imaging device, focus detection device, and imaging device |
| JP5050928B2 (en) * | 2008-02-28 | 2012-10-17 | ソニー株式会社 | Imaging device and imaging device |
| JP2010175955A (en) * | 2009-01-30 | 2010-08-12 | Panasonic Corp | Zoom lens system, interchangeable lens apparatus, and camera system |
| JP2012182332A (en) * | 2011-03-02 | 2012-09-20 | Sony Corp | Imaging element and imaging device |
| JP5895355B2 (en) * | 2011-04-25 | 2016-03-30 | 株式会社ニコン | Imaging device |
| JP5968096B2 (en) * | 2012-06-14 | 2016-08-10 | キヤノン株式会社 | Zoom lens and optical apparatus having the same |
| JP5963565B2 (en) * | 2012-06-21 | 2016-08-03 | キヤノン株式会社 | Zoom lens and imaging apparatus having the same |
| JP2015210285A (en) * | 2014-04-23 | 2015-11-24 | キヤノン株式会社 | Imaging device, manufacturing method of the same, program thereof and recording medium |
| JP2015225310A (en) * | 2014-05-29 | 2015-12-14 | キヤノン株式会社 | Imaging apparatus, control method therefor, program, and storage medium |
| JP6584383B2 (en) * | 2016-01-29 | 2019-10-02 | キヤノン株式会社 | Imaging device and imaging apparatus |
-
2016
- 2016-12-01 JP JP2016234423A patent/JP6584383B2/en active Active
-
2017
- 2017-01-20 GB GB2006560.3A patent/GB2580845B/en active Active
- 2017-01-20 GB GB2015313.6A patent/GB2584811B/en active Active
-
2019
- 2019-09-03 JP JP2019160641A patent/JP2019215578A/en active Pending
-
2021
- 2021-03-11 JP JP2021039525A patent/JP7100735B2/en active Active
-
2022
- 2022-07-04 JP JP2022107855A patent/JP2022132320A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4410804A (en) * | 1981-07-13 | 1983-10-18 | Honeywell Inc. | Two dimensional image panel with range measurement capability |
| US20140071322A1 (en) * | 2012-09-11 | 2014-03-13 | Canon Kabushiki Kaisha | Image pickup apparatus with image pickup device and control method for image pickup apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| GB2584811B (en) | 2021-03-10 |
| JP2021106389A (en) | 2021-07-26 |
| GB2580845B (en) | 2020-12-09 |
| JP7100735B2 (en) | 2022-07-13 |
| JP2019215578A (en) | 2019-12-19 |
| GB202006560D0 (en) | 2020-06-17 |
| GB202015313D0 (en) | 2020-11-11 |
| JP2022132320A (en) | 2022-09-08 |
| GB2584811A (en) | 2020-12-16 |
| JP2017139740A (en) | 2017-08-10 |
| JP6584383B2 (en) | 2019-10-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11422335B2 (en) | Image sensor and image capturing apparatus | |
| JP5967950B2 (en) | Imaging device and imaging apparatus | |
| JP6288909B2 (en) | Imaging device and imaging apparatus | |
| US8416336B2 (en) | Image sensor and image-capturing device | |
| JP5744599B2 (en) | Imaging device and imaging apparatus | |
| US9357121B2 (en) | Image capturing apparatus and control method thereof | |
| JP7100735B2 (en) | Image sensor and image sensor | |
| US20140071322A1 (en) | Image pickup apparatus with image pickup device and control method for image pickup apparatus | |
| US10326926B2 (en) | Focus detection apparatus and method, and image capturing apparatus | |
| KR20170015158A (en) | Control apparatus, image pickup apparatus, and control method | |
| US12261184B2 (en) | Image sensor and image capturing apparatus | |
| JP2018107460A (en) | Imaging device and imaging apparatus | |
| JP2016048738A (en) | Imaging device and imaging apparatus |