[go: up one dir, main page]

WO2022007449A1 - Circuit de pixels de capteur d'image, capteur d'image et caméra de profondeur - Google Patents

Circuit de pixels de capteur d'image, capteur d'image et caméra de profondeur Download PDF

Info

Publication number
WO2022007449A1
WO2022007449A1 PCT/CN2021/085005 CN2021085005W WO2022007449A1 WO 2022007449 A1 WO2022007449 A1 WO 2022007449A1 CN 2021085005 W CN2021085005 W CN 2021085005W WO 2022007449 A1 WO2022007449 A1 WO 2022007449A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
charge
image sensor
charge storage
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/085005
Other languages
English (en)
Chinese (zh)
Inventor
王飞
马成
王兆民
王欣洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Aoxin Micro Vision Technology Co Ltd
Original Assignee
Shenzhen Aoxin Micro Vision Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Aoxin Micro Vision Technology Co Ltd filed Critical Shenzhen Aoxin Micro Vision Technology Co Ltd
Publication of WO2022007449A1 publication Critical patent/WO2022007449A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/57—Control of the dynamic range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/62—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels

Definitions

  • the present application relates to the technical field of image sensors, and in particular, to an image sensor pixel circuit, an image sensor and a depth camera.
  • TOF ranging technology is a technology that achieves precise ranging by measuring the round-trip flight time of light pulses between the transmitting/receiving device and the target object.
  • TOF technology the technology of directly measuring the time of flight of light is called d-TOF (direct-TOF); the emitted light signal is periodically modulated, and the phase delay of the reflected light signal relative to the emitted light signal is measured.
  • i-TOF Indirect-TOF
  • i-TOF Indirect-TOF
  • continuous wave Continuous Wave, CW
  • pulse modulation Pulse Modulated, PM
  • CW modulation usually uses sine wave modulation, and the demodulation end detects the waveform phase change after being reflected by the target object.
  • This measurement method first binds the light flight distance information and the phase information of the light intensity change, and then converts the phase information. For the light intensity information detectable by the photodetector, the measurement of the time of flight of light is realized indirectly.
  • PW modulation measures distance directly by calculating the ratio of the number of electrons collected by different taps based on the time difference between transmitting and receiving the pulsed beam.
  • the transmitter emits short pulse beams.
  • the interference of the background light is reduced to a certain extent, which can improve the measurement accuracy; on the other hand, due to the lower duty cycle, the laser power consumption can be reduced.
  • the transmitter needs to generate high-frequency and high-intensity pulses, which requires high laser drive performance, and cannot use multi-frequency modulation like the CW modulation method.
  • a laser pulse with a wider pulse width is required, and the accuracy will also be reduced. as the pulse width decreases.
  • Chinese Patent Application Publication No. 201910385779.6 provides a time-of-flight depth camera and a distance measurement method for single-frequency modulation and demodulation, which extends the measurement distance with the same pulse width compared to the existing PM-iTOF measurement scheme;
  • the CW-iTOF measurement scheme only needs one exposure to output the signal volume of three taps to obtain one frame of depth information, thus significantly reducing the overall measurement power consumption and increasing the measurement frame rate.
  • Chinese Patent Application Publication No. 201910386369.3 provides a time-of-flight depth camera and a distance measurement method for multi-frequency modulation and demodulation, which gets rid of the existing PM-iTOF measurement scheme in which the pulse width is proportional to the measurement distance and power consumption.
  • the contradiction is negatively correlated with the measurement accuracy; the expansion of the measurement distance is no longer limited by the pulse width, so that the lower measurement power consumption and higher measurement accuracy can still be maintained under the condition of a longer measurement distance.
  • the taps receiving equal signals may have different sensitivities from each other in each unit pixel, which is prone to errors in distance information. Therefore, it is necessary to propose a technical solution to solve the above problems.
  • the purpose of the present application is to provide an image sensor pixel circuit, an image sensor and a depth camera to solve at least one of the above background technical problems.
  • An embodiment of the present application provides an image sensor pixel circuit, including: a charge generation unit for converting an incident optical signal into an electrical signal, which includes a photodiode and a plurality of exposure control transistors; a charge storage unit, connected to the charge a generating unit configured to store the electrical signal; a charge transfer unit, connected to the charge storage unit, configured to transfer the electrical signal to a readout unit; a readout unit configured to transfer the charge storage unit
  • the electrical signal of the photodiode is transmitted as a pixel signal and the signal of the pixel is read; wherein, the signal generated by the photodiode obtains a plurality of electrical signals through the plurality of exposure control transistors, and the plurality of exposure control transistors alternately The charges accumulated by the photodiodes are stored in the corresponding charge storage cells.
  • the plurality of exposure control transistors are first, second, and third exposure control transistors, and the first, second, and third exposure control transistors are obtained through the first, second, and third exposure control transistors, respectively.
  • an electrical signal the charge storage unit includes first, second, and third charge storage units, which are respectively connected with the first, second, and third exposure control transistors to store the first, second, and third electric signal.
  • the charge transfer unit includes first, second, and third charge transfer units, which are respectively connected to the first, second, and third charge storage units to transfer the charges stored in each charge storage unit. to the readout unit.
  • the readout unit includes first, second, and third readout units, which are respectively connected to the first, second, and third transmission units to read the first, second, and third transmission units. The charge stored by the third charge storage unit.
  • the first, second and third charge transfer units are connected to the same readout unit;
  • the readout unit includes a reset transistor, a source follower transistor, a selection transistor and a floating diffusion node; the The stored charges of the first, second, and third charge storage units are sequentially transferred to the same floating diffusion node through the first, second, and third charge transfer units in a time-sharing manner.
  • an anti-overflow transistor is further included, and the source of the anti-overflow transistor is connected to the charge generation unit, so as to prevent electrons of the charge generation unit from overflowing to the charge storage unit after exposure is completed.
  • the readout unit includes a reset transistor, a source follower transistor, a select transistor and a floating diffusion node; wherein the floating diffusion node is connected to the source of the charge transfer unit and the reset transistor, respectively pole, the reset transistor is configured to reset the voltage of the floating diffusion node according to a reset control signal.
  • the readout unit further includes a conversion gain control transistor and a double conversion gain capacitor; wherein the conversion gain control transistor is connected between the reset transistor and the floating diffusion node, and the The double conversion gain capacitor is connected to the drain of the conversion gain control transistor, and the conversion gain control is realized by controlling the gate voltage of the conversion gain control transistor.
  • An embodiment of the present application further provides an image sensor, including: a row decoder/driver, a column decoder, a pixel column unit, and a pixel array; wherein the pixel array includes a plurality of pixels, and the pixels include an image sensor a pixel circuit; the image sensor pixel circuit includes: a charge generation unit for converting an incident optical signal into an electrical signal, which includes a photodiode and a plurality of exposure control transistors; a charge storage unit, connected to the charge generation unit, is configured to store the electrical signal; a charge transfer unit, connected to the charge storage unit, is configured to transfer the electrical signal to a readout unit; a readout unit is configured to transfer the electrical signal of the charge storage unit The signal is transmitted and read as the pixel; wherein, the signal generated by the photodiode obtains a plurality of electrical signals through the plurality of exposure control transistors, and the plurality of exposure control transistors alternately connect the photoelectric The charges accumulated by the diodes are stored in the
  • the embodiment of the present application also provides a depth camera, including an emission module, a collection module, and a control and processor; wherein the emission module includes a light source and a light source driver; the collection module includes an image sensor; the The control and processor are respectively connected with the launch module and the acquisition module, and synchronize the trigger signals of the launch module and the acquisition module to calculate that the light beam is emitted by the launch module and sent by the acquisition module.
  • the image sensor includes: a row decoder/driver, a column decoder, a pixel column unit, and a pixel array; wherein the pixel array includes a plurality of pixels, and the pixels include an image sensor a pixel circuit, the image sensor pixel circuit includes: a charge generation unit for converting an incident optical signal into an electrical signal, which includes a photodiode and a plurality of exposure control transistors; a charge storage unit, connected to the charge generation unit, is configured to store the electrical signal; a charge transfer unit, connected to the charge storage unit, is configured to transfer the electrical signal to a readout unit; a readout unit is configured to transfer the electrical signal of the charge storage unit The signal is transmitted and read as the pixel; wherein, the signal generated by the photodiode obtains a plurality of electrical signals through the plurality of exposure control transistors, and the plurality of exposure control transistors alternately connect the photoelectric The charges accumulated by the diodes are stored in the corresponding charge storage
  • An embodiment of the present application provides an image sensor pixel circuit, including: a charge generation unit for converting an incident optical signal into an electrical signal, which includes a photodiode and a plurality of exposure control transistors; a charge storage unit, connected to the charge a generating unit configured to store the electrical signal; a charge transfer unit, connected to the charge storage unit, configured to transfer the electrical signal to a readout unit; a readout unit configured to transfer the charge storage unit
  • the electrical signal of the photodiode is transmitted as a pixel signal and the signal of the pixel is read; wherein, the signal generated by the photodiode obtains a plurality of electrical signals through the plurality of exposure control transistors, and the plurality of exposure control transistors alternately
  • the charges accumulated by the photodiodes are stored in the corresponding charge storage units, and the charges accumulated by the photodiodes during the exposure process are transferred to different charge storage units for storage through exposure control transistors with different taps, and after the exposure ends
  • the stored charge
  • FIG. 1 is a schematic diagram of a TOF depth camera according to an embodiment of the present application.
  • FIG. 2 is Figure 2 in the accompanying drawings of Chinese Patent Application Publication No. 201910385779.6;
  • FIG 3 is Figure 3 in the accompanying drawings of Chinese Patent Application Publication No. 201910386369.3;
  • FIG. 4 is a partial diagram of an image sensor according to an embodiment of the present application.
  • FIG. 5 is a block diagram of a pixel circuit of an image sensor according to an embodiment of the present application.
  • FIG. 6 is a circuit diagram of a pixel circuit of an image sensor according to an embodiment of the present application.
  • FIG. 7 is a circuit diagram of a pixel circuit of an image sensor according to another embodiment of the present application.
  • FIG. 8 is a circuit diagram of a pixel circuit of an image sensor according to still another embodiment of the present application.
  • connection can be used for both the fixing function and the circuit connection function.
  • first and second are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature defined as “first”, “second” may expressly or implicitly include one or more of that feature. In the description of the embodiments of the present application, “plurality” means two or more, unless otherwise expressly and specifically defined.
  • FIG. 1 is a schematic structural diagram of a TOF depth camera 10 .
  • the TOF depth camera 10 includes an emission module 11 , an acquisition module 12 and a control and processor 13 .
  • the emission module 11 provides the emission beam 30 to the target space to illuminate the object 20 in the space, at least part of the emission beam 30 is reflected by the object 20 to form a reflected beam 40, and at least part of the reflected beam 40 is collected by the acquisition module 12;
  • the processor 13 is respectively connected with the emission module 11 and the collection module 12, and synchronizes the trigger signals of the emission module 11 and the collection module 12 to calculate the time required for the light beam to be emitted by the emission module 11 and received by the collection module 12, That is, the flight time t between the emitted light beam 30 and the reflected light beam 40, and further, the distance D of the corresponding point on the object can be calculated by the following formula:
  • c is the speed of light
  • t is the flight time between the emitted beam and the reflected beam.
  • the emission module 11 includes a light source, a light source driver (not shown in the figure), and the like.
  • the light source can be a light source such as a light emitting diode (LED), an edge emitting laser (EEL), a vertical cavity surface emitting laser (VCSEL), etc., or a light source array composed of multiple light sources, and the light beam emitted by the light source can be visible light, infrared light, ultraviolet light, etc.
  • the acquisition module 12 includes an image sensor 121, a lens unit, a filter (not shown), and the like.
  • the lens unit receives at least part of the light beams reflected back by the object and guides the at least part of the light beams to the image sensor 121, and the filter is a narrow-band filter matching the wavelength of the light source, used to suppress background light noise in the remaining wavelength bands or Stray light.
  • the image sensor 121 may be an image sensor array composed of a charge coupled element (CCD), a complementary metal oxide semiconductor (CMOS), an avalanche diode (AD), a single photon avalanche diode (SPAD), etc.
  • the size of the image sensor array represents the depth The resolution of the camera, such as 320 ⁇ 240, etc.
  • a readout circuit (not shown in the figure) composed of one or more of a signal amplifier, a time-to-digital converter (TDC), an analog-to-digital converter (ADC) and other devices. ).
  • TDC time-to-digital converter
  • ADC analog-to-digital converter
  • the image sensor 121 includes at least one pixel, and each pixel includes a plurality of taps (for storing and reading or discharging charge signals generated by incident photons under the control of the corresponding electrodes), such as including 2 taps, to use for reading charge signal data.
  • a plurality of taps for storing and reading or discharging charge signals generated by incident photons under the control of the corresponding electrodes, such as including 2 taps, to use for reading charge signal data.
  • the control and processor 13 can be an independent dedicated circuit, such as a dedicated SOC chip, FPGA chip, ASIC chip, etc. composed of CPU, memory, bus, etc., or a general-purpose processing circuit, such as when the TOF depth camera is integrated into a In smart terminals such as mobile phones, televisions, and computers, the processing circuit of the terminal can be used as at least a part of the control and processor 13 .
  • control and processor 13 is used to provide a modulation signal (emission signal) required when the light source emits laser light, and the light source emits a pulsed beam to the object to be measured under the control of the modulation signal; in addition, the control and processor 13
  • the demodulation signal (collection signal) of the taps in each pixel of the image sensor 121 is also provided. Under the control of the demodulation signal, the tap collects the charge signal generated by the pulsed beam including the reflected back of the object to be tested, and calculates the phase based on the charge signal. difference to obtain the distance of object 20.
  • the reflected pulse beam reflected back by the object to be tested there will also be some background light, interference light and other light beams.
  • the modulation and demodulation method, control, processing and other functions performed by the control and processor 13 may adopt the solutions described in Chinese Patent Application Publication Nos. 201910385779.6 and 201910386369.3. It can be understood that, for the convenience of description, the PM-iTOF modulation and demodulation method is used as an example for description in the embodiments of the present application, but is not limited to PM-iTOF modulation and demodulation.
  • Fig. 2 in Chinese Patent Application Publication No. 201910385779.6, the embodiment of Fig. 2 exemplarily shows the laser emission signal (modulated signal), received signal and collected signal (decoded signal) within two frame periods T
  • the timing diagram of the modulation signal The meaning of each signal is: Sp represents the pulse emission signal of the light source, each pulse emission signal represents a pulse beam; Sr represents the reflected light signal of the pulsed light reflected back by the object, and each reflected light signal represents the reflected light from the object to be measured.
  • each pulse acquisition signal represents that the tap collects the charge signal (electron) generated by the pixel in the time period corresponding to the signal.
  • the entire frame period T is divided into two time periods Ta and Tb, where Ta represents the time period during which each tap of the pixel performs charge collection and storage, and Tb represents the time period during which the charge signal is read out.
  • Ta each tap collects electrons generated on the pixel during its pulse period as the reflected light signal is reflected back to the pixel by the object.
  • the first tap, the second tap, and the third tap perform charge collection and storage in sequence, respectively, to obtain the charge amounts q1, q2, and q3, so as to complete one pulse period Tp.
  • two pulse periods Tp are included in a single frame period, and a total of two laser pulse signals are emitted.
  • each tap collects and reads out the total charge amount corresponding to the charge amount of the optical signal collected twice.
  • the pulse period Tp or the number of times the laser pulse signal is emitted can be K times, and K is not less than 1, and can also be as high as tens of thousands of times, or even higher. The specific number is based on actual In addition, the number of pulses in different frame periods can also be different.
  • the total charge collected and read out by each tap in the Tb time period is the sum of the charges corresponding to the optical signals collected multiple times by each tap in the entire frame period T, and the total charge of each tap in a single frame period can be It is expressed as follows:
  • the total charge amount in a single frame period of the first tap, the second tap, and the third tap can be obtained as Q1, Q2 and Q3.
  • the measurement range is limited to a single pulse width time, that is, it is assumed that the reflected light signal is collected by the first tap and the second tap, and the third tap is used to collect the ambient light signal.
  • the control and processor can calculate the total light flight distance of the pulsed light signal from emission to reflection to the pixel according to the following formula:
  • c is the speed of light
  • Th is the pulse width of the single exposure laser
  • Q1, Q2, Q3 are the total charge of the three taps respectively.
  • the first tap and the second tap will collect ambient light signals in addition to the reflected light signals, and according to formula (2), it can be seen that when all the returned laser light falls on Second tap, so the maximum distance that can be detected If the returned laser falls between the second tap and the third tap exposure enable signal, or between the third tap and the first tap of the next cycle, the measurement range is exceeded and an erroneous result is obtained , if you need to measure longer distances, you must increase the pulse width of the laser, but this will reduce the measurement accuracy.
  • the tap for collecting background light can not be fixed.
  • the reflected light signal can not only fall into the first tap and the second tap. It can also be allowed to fall between the second tap and the third tap enable, or even allow it to fall between the third tap and the first tap in the next pulse period Tp (for at least two pulse periods) above Tp).
  • Tp for at least two pulse periods
  • the control and processor 13 judges the three total charge amounts Q1, Q2 and Q3 obtained to determine the obtained amount of charge.
  • the control and processor 13 judges the three total charge amounts Q1, Q2 and Q3 obtained to determine the obtained amount of charge.
  • the multi-frequency spreading method in the CW modulation method is borrowed, which can meet the measurement of longer distances.
  • the embodiment of FIG. 3 describes a method for multi-frequency modulation and demodulation, that is, different modulation and demodulation frequencies are used in adjacent frames.
  • two adjacent frame periods and two modulation frequencies are used as examples for description.
  • Th2 the accumulated charges of the three taps per pulse are q11, q12, q21, q22, q31, and q32 respectively.
  • control and processor 13 uses the modulation and demodulation method shown in FIG. 2 to measure the distance in each frame period respectively, The measurement distance in each frame period is calculated by the above judgment method, and then the final distance can be obtained by using the least common multiple method.
  • the long-distance measurement target distance can reach 6.75m.
  • the embodiment of the present application proposes an image sensor including multi-tap pixels, which can implement the above-mentioned modulation and demodulation method, thereby realizing long-distance and high-precision measurement of the TOF depth camera.
  • FIG. 4 is a partial schematic layout diagram of an image sensor according to an embodiment of the present application.
  • the image sensor 121 shown in FIG. 4 receives a part of the reflected light 40 reflected by the object 20, and calculates the charge signals Q1, Q2 and Q3 accumulated by the three taps according to the reflected light. According to the charge amount, the three possibilities described above can be used.
  • the distance of the object is calculated by a linear expression; it can be understood that the embodiment of the present application uses three taps as an example for description, but is not limited to three taps.
  • pixel array 42 in image sensor 121 in FIG. 4 is shown as 9 pixels arranged in a 3 ⁇ 3 array; in practice, pixel arrays may contain thousands or numbers in multiple rows and columns megapixel. In particular embodiments, each pixel in pixel array 42 may have the same configuration, so each pixel is represented by the same reference numeral "41" as shown in FIG. 4 .
  • the image sensor 121 in the embodiment of FIG. 4 may also include a row decoder/driver 47 , a column decoder 53 and a pixel column unit 54 .
  • the pixel column unit 54 includes circuitry for correlated double sampling (CDS) and column-specific analog-to-digital converters (ADCs) used in 3D imaging devices.
  • CDS correlated double sampling
  • ADCs column-specific analog-to-digital converters
  • each column in a pixel may have one ADC.
  • row decoder/driver 47, column decoder 53 and pixel column unit 54 may be part of control and processor 13 shown in FIG. In the embodiment of FIG.
  • row decoder/driver 47 is shown as providing 8 different signals as input to each pixel 41 in a row of pixels to control the pixels in pixel array 42 and thereby enable the generation of column specific PIXOUT ( pixel output signal) 50, 51, 52.
  • the arrows numbered 44, 45, 46 in FIG. 4 show that a specific signal is input to each pixel 41 in the corresponding row.
  • These signals include: overflow prevention signal (DRN), reset signal (RST), charge storage signal (SG), three-tap exposure control signals (MG1, MG2, MG3) and row select signal (SEL).
  • a row select (SEL) signal is used to select the appropriate row of pixels.
  • Row decoder/driver 47 may decode via row address/control input 47 to enable it to select the appropriate row using the SEL signal and provide corresponding RST, TG and other signals to the row selected for decoding.
  • the RST signal may be applied to pixels in selected rows to reset the pixels to a predetermined high voltage level.
  • the DRN signal releases the electrons collected by the photodiode (PD) to the power supply after exposure, preventing the collected electrons from overflowing into the three-tap charge storage section.
  • the pixel column unit 54 may receive the PIXOUT signals 50, 51, 52 from the pixels in the row and process these signals to calculate the amount of charge Q1, Q2 and Q3 from which the distance of the object is calculated. Column selection allows sequential reception of pixel output from each pixel in the row selected by the corresponding SEL signal. Control and processor 13 may provide appropriate row address inputs to select rows of pixels and may also provide appropriate column address inputs to column decoder 53 to enable pixel column unit 54 to receive outputs from individual pixels in the selected row (PIXOUT).
  • FIG. 5 is a schematic block diagram of a pixel circuit of an image sensor according to an embodiment of the present application.
  • a three-tap pixel is used as an example for description in the embodiment of the present application.
  • each pixel 41 in pixel array 42 may have the pixel configuration in FIG. 5 .
  • the image sensor pixel circuit 100 includes a charge generation unit 60 , a charge storage unit 70 , a charge transfer unit 80 and a readout unit 90 .
  • the charge generation unit 60 is used for converting the incident optical signal into an electrical signal, and includes a photodiode (PD) and a plurality of exposure control transistors, and the plurality of exposure control transistors alternately store the charges accumulated by the photodiodes to corresponding charges storage unit.
  • the electrical signal generates the first electrical signal according to the first exposure control transistor (MG1), generates the second electrical signal according to the second exposure control transistor (MG2), and generates the second electrical signal according to the third exposure control transistor (MG3) A third electrical signal is generated.
  • MG1, MG2 and MG3 alternately store the charges accumulated by the photodiodes to the corresponding charge storage units.
  • the charge storage unit 70 is connected to the charge generation unit and is configured to store the electrical signal.
  • the charge storage unit includes a first charge storage unit SG1, a second charge storage unit SG2, and a third charge storage unit SG3, which are connected with the first exposure transistor MG1, the second exposure transistor MG2, and the third exposure transistor respectively.
  • MG3 is connected and configured to store the first electrical signal, the second electrical signal and the third electrical signal, respectively.
  • the charge storage unit may be a capacitor, a PN junction or others, which are not limited herein.
  • the charge transfer unit 80 is connected to the charge storage unit and is configured to transfer the electrical signal to the readout unit.
  • the charge transfer unit 80 includes a first charge transfer unit TG1, a second charge transfer unit TG2, and a third charge transfer unit TG3, so as to connect the first charge storage unit SG1 and the second charge storage unit SG2 respectively and a third charge storage unit SG3 for transferring the charges stored in the charge storage unit to the readout unit.
  • the charge transfer unit may be an electron transfer transistor.
  • the readout unit 90 is configured to transmit the electrical signal of the charge storage unit as a pixel and to read the signal of the pixel. Specifically, in the embodiment of the present application, the readout unit 90 is configured to transmit the charges stored in the first charge storage unit SG1 , the second charge storage unit SG2 and the third charge storage unit SG3 as pixels and read the pixels signal of.
  • the image sensor pixel circuit 100 further includes an overflow prevention transistor (DRN), and the source of the overflow prevention transistor is connected to the charge generation unit, and is configured to prevent electrons from the charge generation unit from overflowing to the charge storage unit.
  • DRN overflow prevention transistor
  • the source of the overflow prevention transistor is connected to the photodiode, so as to prevent the photodiode from collecting electrons and overflowing to the charge storage unit after exposure.
  • the readout cell 90 includes a reset transistor (RST), a source follower transistor (SF), a select transistor (SEL), and a floating diffusion node (FD).
  • the floating diffusion node is respectively connected to the charge transfer unit and the source of the reset transistor, and the reset transistor is configured to reset the voltage of the floating diffusion node according to the reset control signal.
  • the readout unit 90 includes a first readout unit 901 , a second readout unit 902 and a third readout unit 903 .
  • the first readout unit 901 is connected to the first charge transfer unit
  • the second readout unit 902 is connected to the second charge transfer unit
  • the third readout unit 903 is connected to the third charge transfer unit, so as to read the first charge transfer unit respectively.
  • the first readout unit 901 is taken as an example for description below.
  • the drain of the reset transistor (RST) of the first readout unit 901 is connected to a voltage source, and the voltage of the floating diffusion node (FD) is reset according to the reset control signal.
  • the charge transfer unit transfers the electrons stored in the first charge storage unit to the floating diffusion node FD, and the gate of the source follower transistor (SF) of the first readout unit is connected to the floating diffusion node (FD), and the drain thereof is connected.
  • the voltage source, the source follower transistor amplifies the voltage signal of the floating diffusion node as the output of PIXOUT1, and transmits it to the ADC unit to be converted into an appropriate digital signal. It can be understood that the structures and transmission modes of the second readout unit, the third readout unit and the first readout unit are the same, and details are not described herein again.
  • each readout unit has a separate floating diffusion node FD
  • the parasitic capacitance value on the floating diffusion node FD is small, and a large conversion gain can be achieved. However, this will increase the number of transistors in a single pixel, thereby reducing the fill factor.
  • the charge stored in the memory cell is transferred to the corresponding floating diffusion node FD. The amount of charge is theoretically the same, but due to process production deviations, such as the gain deviation of the source follower (SF), the gain error between multiple time windows will increase, making subsequent calibration more difficult.
  • process production deviations such as the gain deviation of the source follower (SF)
  • FIG. 7 The first charge transfer unit, the second charge transfer unit and the third charge transfer unit are connected to the same readout unit.
  • a reset transistor (RST), a source follower transistor (SF), a select transistor (SEL) and a floating diffusion node (FD) are shared as part of the readout cell.
  • the stored charges of the first charge storage unit, the second charge storage unit and the third charge storage unit in the circuit shown in FIG. 7 are sequentially transferred to the first charge transfer unit, the second charge transfer unit and the third charge transfer unit in a time-sharing manner
  • the same floating diffusion node, and the voltage at the floating diffusion node FD is output through the PIXOUT of the same readout circuit, and then transmitted to the ADC unit in turn. It can be understood that the voltage acquisition method at the floating diffusion node FD is the same as the voltage acquisition method of the floating diffusion node FD in the first readout unit in the embodiment shown in FIG. 6 , and details are not described herein again.
  • the number of transistors in the pixel is greatly reduced, the fill factor of the pixel is improved, and the Process deviation brings gain error in depth, reducing subsequent correction work.
  • the readout unit further includes a conversion gain control transistor (LG) and a double conversion gain capacitor (CLG), the conversion gain control transistor is connected between the reset transistor and the floating diffusion node, and the double conversion gain capacitor is connected between the fixed level and the conversion gain control transistor. drain, so that the conversion gain control is achieved by controlling the gate voltage of the conversion gain control transistor.
  • LG conversion gain control transistor
  • CLG double conversion gain capacitor
  • the capacitance of the double conversion gain can be realized by MIM, MOM, MOS capacitance, parasitic capacitance, and the like.
  • the conversion gain control transistor is turned off, and the integral capacitance of the floating diffusion node is the parasitic capacitance brought by the reset transistor (RST), the source follower transistor (SF), the select transistor (SEL), and the floating diffusion node to the liner. It is composed of the bottom junction capacitance, and the capacitance value is relatively small, so that a high conversion gain can be achieved; after obtaining the image frame with high conversion gain of each of the three taps, the gain control transistor is enabled, and the integral capacitance of the floating diffusion node is now floating. On the basis of the original, a double conversion gain capacitor CLG is added, and the value of the integral capacitor becomes larger, which reduces the conversion gain of the pixel. The three taps obtain their respective image frames with low conversion gain in turn. For fusion, 3D depth information with high dynamic range can be achieved.
  • readout unit 90 also includes a correlated double sampling (CDS) circuit (not shown) in which the output of a pixel can be measured twice: once under known conditions, and the other Once under unknown conditions, the value measured under known conditions can be subtracted from the value measured under unknown conditions to generate a value with a known relationship to the measured physical quantity, representing the photoelectrons of a particular portion of the pixel receiving light charge.
  • CDS correlated double sampling
  • noise can be reduced by removing the pixel's reference voltage, such as the reset pixel voltage, from the pixel's signal voltage at the end of each integration period.
  • the pixels in the pixel array 42 are the pixels described in any one of the embodiments of FIG. 5 to FIG. 8 .
  • the image sensor 121 included in the acquisition module is the image sensor described in the solution of the embodiment of FIG. 4 , and details are not repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

Est divulgué dans la présente demande un circuit de pixels de capteur d'image, comprenant : une unité de génération de charge utilisée pour convertir un signal optique incident en un signal électrique et comprenant une photodiode et une pluralité de transistors de contrôle de l'exposition ; une unité de stockage de charge connectée à l'unité de génération de charge et conçue pour stocker le signal électrique ; une unité de transfert de charge connectée à l'unité de stockage de charge et conçue pour transférer le signal électrique à une unité de lecture ; et l'unité de lecture étant conçue pour transférer le signal électrique de l'unité de stockage de charge en tant que pixel et lire un signal du pixel, une pluralité de signaux électriques étant respectivement obtenus au moyen de la pluralité de transistors de contrôle de l'exposition à partir d'un signal généré par la photodiode et les charges accumulées par la photodiode étant stockées en alternance dans des unités de stockage de charge correspondantes au moyen de la pluralité de transistors de contrôle de l'exposition. La structure de pixel de la présente demande peut prendre en charge un mode d'exposition globale et le bruit peut être réduit, de façon à obtenir une mesure de précision élevée et longue distance.
PCT/CN2021/085005 2020-07-09 2021-04-01 Circuit de pixels de capteur d'image, capteur d'image et caméra de profondeur Ceased WO2022007449A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010659009.9A CN111885316B (zh) 2020-07-09 2020-07-09 一种图像传感器像素电路、图像传感器及深度相机
CN202010659009.9 2020-07-09

Publications (1)

Publication Number Publication Date
WO2022007449A1 true WO2022007449A1 (fr) 2022-01-13

Family

ID=73150530

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/085005 Ceased WO2022007449A1 (fr) 2020-07-09 2021-04-01 Circuit de pixels de capteur d'image, capteur d'image et caméra de profondeur

Country Status (2)

Country Link
CN (1) CN111885316B (fr)
WO (1) WO2022007449A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114630062A (zh) * 2022-03-10 2022-06-14 杭州指数星空智能设备制造有限责任公司 一种提高tof传感器动态范围的方法
CN116156298A (zh) * 2023-04-11 2023-05-23 安徽医科大学 基于感存算一体化的内窥镜高清视频处理系统及方法

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111885316B (zh) * 2020-07-09 2022-07-29 深圳奥辰光电科技有限公司 一种图像传感器像素电路、图像传感器及深度相机
CN112615995B (zh) * 2020-12-28 2022-07-01 维沃移动通信有限公司 像素电路、图像传感器、摄像模组和电子设备
CN115308756B (zh) * 2021-05-07 2025-02-11 宁波飞芯电子科技有限公司 一种像素电路，图像传感器及探测装置
CN113359144A (zh) * 2021-07-23 2021-09-07 思特威(上海)电子科技股份有限公司 飞行时间传感器像素电路及其配置方法
JP2024546634A (ja) * 2021-12-09 2024-12-26 ソニーセミコンダクタソリューションズ株式会社 飛行時間型センサおよび電子デバイス
CN120380743A (zh) * 2023-02-27 2025-07-25 华为技术有限公司 成像设备、用于驱动成像设备的方法和电子设备

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101877769A (zh) * 2009-04-30 2010-11-03 美商豪威科技股份有限公司 具有全域快门的图像传感器
CN102346250A (zh) * 2010-06-09 2012-02-08 汤姆森特许公司 飞行时间成像器
CN102822693A (zh) * 2010-01-06 2012-12-12 美萨影像股份公司 具有分隔像素和存储阵列的解调传感器
CN104067607A (zh) * 2012-01-13 2014-09-24 全视科技有限公司 共享飞行时间像素
JP2017112420A (ja) * 2015-12-14 2017-06-22 株式会社ニコン 撮像素子および撮像装置
WO2019118786A1 (fr) * 2017-12-13 2019-06-20 Magic Leap, Inc. Circuit de pixels à obturateur global et procédé pour des applications de vision artificielle
CN111034177A (zh) * 2017-09-14 2020-04-17 松下知识产权经营株式会社 固体摄像装置以及具备该固体摄像装置的摄像装置
CN111885316A (zh) * 2020-07-09 2020-11-03 深圳奥辰光电科技有限公司 一种图像传感器像素电路、图像传感器及深度相机

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9549158B2 (en) * 2012-04-18 2017-01-17 Brightway Vision Ltd. Controllable single pixel sensors
US10750097B2 (en) * 2017-08-14 2020-08-18 Facebooke Technologies, Llc Varying exposure time of pixels in photo sensor using motion prediction
CN110412607B (zh) * 2018-04-28 2021-12-03 思特威(上海)电子科技股份有限公司 具有高动态范围的tof像素电路及测距系统
CN110557582B (zh) * 2018-06-19 2021-09-17 思特威(上海)电子科技股份有限公司 基于tof的3d成像图像传感器像素电路及测距系统

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101877769A (zh) * 2009-04-30 2010-11-03 美商豪威科技股份有限公司 具有全域快门的图像传感器
CN102822693A (zh) * 2010-01-06 2012-12-12 美萨影像股份公司 具有分隔像素和存储阵列的解调传感器
CN102346250A (zh) * 2010-06-09 2012-02-08 汤姆森特许公司 飞行时间成像器
CN104067607A (zh) * 2012-01-13 2014-09-24 全视科技有限公司 共享飞行时间像素
JP2017112420A (ja) * 2015-12-14 2017-06-22 株式会社ニコン 撮像素子および撮像装置
CN111034177A (zh) * 2017-09-14 2020-04-17 松下知识产权经营株式会社 固体摄像装置以及具备该固体摄像装置的摄像装置
WO2019118786A1 (fr) * 2017-12-13 2019-06-20 Magic Leap, Inc. Circuit de pixels à obturateur global et procédé pour des applications de vision artificielle
CN111885316A (zh) * 2020-07-09 2020-11-03 深圳奥辰光电科技有限公司 一种图像传感器像素电路、图像传感器及深度相机

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114630062A (zh) * 2022-03-10 2022-06-14 杭州指数星空智能设备制造有限责任公司 一种提高tof传感器动态范围的方法
CN114630062B (zh) * 2022-03-10 2024-03-12 杭州指数星空智能设备制造有限责任公司 一种提高tof传感器动态范围的方法
CN116156298A (zh) * 2023-04-11 2023-05-23 安徽医科大学 基于感存算一体化的内窥镜高清视频处理系统及方法

Also Published As

Publication number Publication date
CN111885316B (zh) 2022-07-29
CN111885316A (zh) 2020-11-03

Similar Documents

Publication Publication Date Title
CN111885316B (zh) 一种图像传感器像素电路、图像传感器及深度相机
TWI524762B (zh) 共用飛行時間像素
CN110596722B (zh) 直方图可调的飞行时间距离测量系统及测量方法
CN110596721B (zh) 双重共享tdc电路的飞行时间距离测量系统及测量方法
US11240445B2 (en) Single-chip RGB-D camera
TWI544232B (zh) 用於飛行時間成像系統之校準電路與方法
CN107300705B (zh) 基于载波调制的激光雷达测距系统及测距方法
WO2021051479A1 (fr) Procédé et système de mesure de temps de vol fondée sur une interpolation
US9140795B2 (en) Time of flight sensor with subframe compression and method
TW202112122A (zh) 距離影像攝像裝置及距離影像攝像方法
US20010024271A1 (en) Distance measurement apparatus and distance measuring
US20130140433A1 (en) Sensor Pixel Array and Separated Array of Storage and Accumulation with Parallel Acquisition and Readout
WO2021051481A1 (fr) Procédé de mesure de distance par temps de vol par traçage d'un histogramme dynamique et système de mesure associé
WO2021051480A1 (fr) Procédé de mesure de distance de temps de vol basé sur un dessin d'histogramme dynamique et système de mesure
CN111885324B (zh) 一种图像传感器、采集模组及tof深度相机
US12181610B2 (en) CMOS image sensor for direct time of flight measurement
CN111885321B (zh) 一种锗硅图像传感器、采集模组及tof深度相机
WO2020223981A1 (fr) Caméra de profondeur de temps de vol et procédé de mesure de distance de modulation et de démodulation multifréquence
CN114300492A (zh) 采集场景的深度图像的设备
CN115308756B (zh) 一种像素电路，图像传感器及探测装置
CN111048540A (zh) 一种门控式像素单元以及3d图像传感器
Kuo et al. A Half-Pulse 2-Tap Indirect Time-of-Flight Ranging Method with Sub-Frame Operation for Depth Precision Enhancement and Motion Artifact Suppression
CN111885325A (zh) 一种图像传感器、采集模组及深度相机
Park et al. A Fully Digital Indirect Time-of-Flight Image Sensor with Multi-Frame Integration and Time-gated Single-Photon Counting Method
CN116939387A (zh) 一种可进行二维或三维兼容成像的像素结构及成像方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21838866

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21838866

Country of ref document: EP

Kind code of ref document: A1