[go: up one dir, main page]

CN105009565B - Method for generating images and line sensor camera - Google Patents

Method for generating images and line sensor camera Download PDF

Info

Publication number
CN105009565B
CN105009565B CN201480010899.3A CN201480010899A CN105009565B CN 105009565 B CN105009565 B CN 105009565B CN 201480010899 A CN201480010899 A CN 201480010899A CN 105009565 B CN105009565 B CN 105009565B
Authority
CN
China
Prior art keywords
mode
camera
sensor
duration
period
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201480010899.3A
Other languages
Chinese (zh)
Other versions
CN105009565A (en
Inventor
P·默纳-罗克兹
S·特耶塞耶雷
P·佩利
H·菲永
C·美拉德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
E2v Semiconductor Co
Teledyne e2v Semiconductors SAS
Original Assignee
E2v Semiconductor Co
e2v Semiconductors SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by E2v Semiconductor Co, e2v Semiconductors SAS filed Critical E2v Semiconductor Co
Publication of CN105009565A publication Critical patent/CN105009565A/en
Application granted granted Critical
Publication of CN105009565B publication Critical patent/CN105009565B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/76Circuitry for compensating brightness variation in the scene by influencing the image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/701Line sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/768Addressed sensors, e.g. MOS or CMOS sensors for time delay and integration [TDI]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/7795Circuitry for generating timing or clock signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Studio Devices (AREA)
  • Facsimile Scanning Arrangements (AREA)
  • Image Input (AREA)

Abstract

The invention relates to a linear sensor camera, intended to be viewed by scanningA scene is observed, which is swept across the camera. A sensor (IMS) provides, for each image point observed, an output level (Ss) representative of the illuminance of this point for a possible varying effective accumulation duration Ti, said camera comprising: a synchronization input means for receiving relative scan rate information items; for establishing an image line reading cycle period TLThe image line reading cycle period TLInversely proportional to the relative scan rate; and receiving a desired cumulative duration value TiDThe apparatus of (1). The method is characterized in that in at least a first operating mode, in which the camera provides an illuminance measurement level (Sc) for each image point, the accumulated duration Ti that is active is equal to the reading period TLThe illuminance measurement level (Sc) is multiplied by the desired integration duration TiDAnd row read cycle period TLThe output level of the sensor of the ratio (c) is proportional. The application comprises the following steps: and (5) industrial control.

Description

产生图像的方法和线性传感器照相机Method for generating images and line sensor camera

技术领域technical field

本发明涉及线性传感器照相机,其旨在通过扫描来观察场景,该场景参照照相机而相对运动。这些照相机尤其旨在用于检查物体,例如检查传输带上的行李,或者检查用于控制工业生产的物体。The present invention relates to a line sensor camera, which is intended to observe a scene by scanning, which is in relative motion with reference to the camera. These cameras are especially intended for inspecting objects, for example luggage on conveyor belts, or inspecting objects for controlling industrial production.

背景技术Background technique

传感器可以包括单行像素或者多行像素,并且在后者的情况下,其可以采用所谓的TDI(“时间延迟积分(Time Delay Integration)”)模式来工作,以增加信噪比,在TDI模式中,各种行的像素连续地看到同一个图像行,并且在它们看到相同的图像行的瞬间由各种行而光产生的电荷被叠加在一起。The sensor can comprise a single row of pixels or multiple rows of pixels, and in the latter case it can be operated in a so-called TDI ("Time Delay Integration") mode to increase the signal-to-noise ratio, in TDI mode , the pixels of various rows continuously see the same image row, and the charges light-generated by the various rows are superimposed at the instant they see the same image row.

将理解的是,在TDI传感器的情况下,运动的速度优选地与图像行的捕捉频率同步是非常重要的。如果情况并非如此,则未看到相同图像行的信号也将被叠加在一起。这是为什么提供了这样的照相机,其用于处理接收关于相对运动的速度的信息项的输入,并且这个信息项用于限定对于像素的行进行读取的周期性。It will be appreciated that in the case of a TDI sensor it is very important that the speed of the motion is preferably synchronized with the frequency of capture of the image lines. If this is not the case, signals that do not see the same image line will also be superimposed. This is why a camera is provided for processing that receives an input of an item of information about the velocity of the relative movement, and this item of information is used to define the periodicity with which the reading is performed for rows of pixels.

即使传感器不在TDI模式下工作,并且即使其仅具有一行像素,将图像行的捕捉周期参照相对运动的速度进行同步也是重要的。如果情况并非如此,则重构的图像将在运动的方向上变得扁平或者伸长。此外,在图像拍摄期间的速度波动将引起重构图像不可控制的变形。在这种情况下,照相机接收关于相对运动的速度的信息项,该信息项限定了行读取的周期性。Even if the sensor is not operating in TDI mode, and even if it has only one row of pixels, it is important to synchronize the capture period of the image rows with reference to the speed of the relative motion. If this is not the case, the reconstructed image will be flattened or stretched in the direction of motion. Furthermore, velocity fluctuations during image capture will cause uncontrollable deformations of the reconstructed image. In this case, the camera receives an item of information about the velocity of the relative movement, which item of information defines the periodicity of the line readout.

此外,对于给定的照明条件,由传感器产生的信号电平实质上依赖于累积时间,在累积时间期间,像素将光产生的电荷在读取这些电荷之前进行累积。如果以读取时段TL来周期性地读取电荷,则累积时间Ti仍受限于TL的值;实际上,可以在时段TL的持续时间中对电荷进行累积,但是在这个周期结束时,需要读取它们并且以新的读取为目的来重新预置像素。在CCD传感器的情况下,通过将电荷传输至读取寄存器(或者用于TDI传感器的像素的其它行)来进行重新预置;在具有有源像素的传感器的情况下,通过将像素的电荷存储节点清空来进行重新预置。Furthermore, for a given lighting condition, the signal level produced by the sensor is substantially dependent on the accumulation time during which the photogenerated charges are accumulated by the pixel prior to being read out. If the charge is read periodically with a read period TL , the accumulation time Ti is still limited by the value of TL ; in fact, the charge can be accumulated for the duration of the period TL , but at the end of this period , they need to be read and the pixels reset for a new read. In the case of a CCD sensor, resetting is done by transferring charge to a readout register (or other row of pixels for a TDI sensor); in the case of a sensor with active pixels, by storing the charge of the pixel Nodes are cleared for re-provisioning.

如果运动的速度较快,则读取时段TL将较短,并且因此累积时间将较短。在这种情况下,优选地是将在读取时段TL的整个期间对电荷进行累积。相反地,如果运动的速度较慢,则优选地是,照相机包括用于调整累积时间以使得仅在读取时段的部分期间对电荷进行累积的装置,否则就会存在使像素饱和的风险。If the speed of motion is faster, the read period TL will be shorter, and thus the accumulation time will be shorter. In this case, it is preferable that charges will be accumulated throughout the read period TL . Conversely, if the speed of motion is slow, it is preferred that the camera includes means for adjusting the accumulation time so that charge is only accumulated during part of the readout period, otherwise there is a risk of saturating the pixels.

在利用了用于控制累积持续时间的装置的情况下,即使速度变化,也可以在图像的稳定亮度方面达到峰值,这是因为其足以独立于读取时段而提供固定的累积持续时间,固定的累积持续时间由经过传感器的图像的运动速度来确定。但是在行读取时段TL期间对光进行累积的情况下,电子图像的亮度水平与这个持续时间TL成正比地变化。因此,电子图像的亮度水平根据从一个图像至另一个图像,甚至在成像的过程中运动的速度波动而变化。这在图像拍摄期间速度变化很多的情况下特别不方便。In the case where the means for controlling the accumulation duration is utilized, even if the speed changes, it is possible to achieve a peak in the stable brightness of the image because it is sufficient to provide a fixed accumulation duration independently of the reading period, fixed The duration of accumulation is determined by the speed of motion of the image past the sensor. But in case the light is accumulated during the row readout period TL , the brightness level of the electronic image varies proportionally to this duration TL . Thus, the brightness level of an electronic image varies according to fluctuations in speed from one image to another, even during the imaging process. This is particularly inconvenient when the speed changes a lot during image capture.

运动速度的变化可能源自运动系统不受控制的波动。它们还可能源自有意的变化,例如,在期望检查物体的情况下,从几乎零的运动速度开始、之后加速、稳定、然后制动。在后者的情况下,其可能需要以恒定的累积持续时间来工作,从而不经受产生的这种电子图像的全局亮度变化。因此,这需要利用具有累积时间控制的照相机来工作。但是利用累积时间控制的照相机在快速时敏感性方面的效率较低,具体地是因为其没有利用整个的读取时段时间来累积光产生的电荷。实际上,在这种情况下,对于固定的行读取时段(TL),累积时间可能不大于TL-TM,其中,TM为将进一步解释的停滞时间。Variations in movement speed may result from uncontrolled fluctuations in the movement system. They can also result from deliberate changes, for example starting from almost zero velocity of motion, followed by acceleration, stabilization, and then braking in the event that an object is desired to be inspected. In the latter case, it may need to work with a constant accumulation duration, so as not to suffer from global brightness variations of such electronic images produced. Therefore, this needs to work with a camera with cumulative time control. But cameras controlled with accumulation time are less efficient in terms of fast time sensitivity, specifically because they do not use the entire readout period time to accumulate the photogenerated charge. In fact, in this case, for a fixed row read period (T L ), the cumulative time may not be greater than T L −TM , where TM is the dead time as will be explained further.

发明内容Contents of the invention

为了即使在照明和运动的可变条件下,尤其在图像的捕捉期间运动的可变条件下也能便于获得良好的图像,根据本发明提出了通过照相机来产生图像的方法,所述照相机包括线性图像传感器,所述线性图像传感器参照要观察的图像而相对运动,所述传感器针对每个观察到的图像点,提供表示该点在有效的累积持续时间Ti(其可能变化)内的照度的输出电平,所述照相机包括:同步输入装置,其用于接收关于相对运动的速度的信息项;用于建立图像行读取周期时段TL的装置,所述图像行读取周期时段TL与相对运动的速度成反比;用于接收期望的累积持续时间TiD的值。所述方法的特征在于,其包括分别的两种工作模式。In order to facilitate the acquisition of good images even under variable conditions of illumination and motion, especially during the capture of the image, it is proposed according to the invention to generate an image by means of a camera comprising a linear an image sensor, said linear image sensor moving relative to the image to be observed, said sensor providing, for each observed image point, an output representing the illuminance at that point for an effective accumulation duration Ti (which may vary) level, said camera comprising: synchronization input means for receiving an item of information about the velocity of the relative motion; means for establishing an image line readout cycle period T L which is related to The speed of relative motion is inversely proportional; used to receive the value of the desired cumulative duration Ti D. The method is characterized in that it comprises two separate operating modes.

-第一工作模式,其中有效的累积持续时间Ti等于读取周期时段TL,并且其中,照相机针对每个图像点提供了照度测量电平,所述照度测量电平与乘以了期望的累积持续时间TiD与行读取时段TL的比值的传感器的输出电平成正比。- a first mode of operation in which the effective accumulation duration Ti is equal to the read cycle period TL and in which the camera provides for each image point an illuminance measurement level multiplied by the desired accumulation The duration Ti D is proportional to the output level of the sensor to the ratio of the row read period TL .

-以及第二工作模式,其具有小于读取周期时段TL的累积持续时间,并且其中,照相机针对每行提供了照度测量电平,所述照度测量电平与未对期望的累积持续时间TiD与行读取时段TL的比值进行加权的传感器的输出电平成正比。- and a second mode of operation which has an accumulation duration which is less than the read cycle period TL and in which the camera provides for each row an illuminance measurement level which is not related to the desired accumulation duration Ti D is proportional to the output level of the sensor weighted by the ratio of the row read period TL .

根据相对运动的速度来进行第一模式与第二模式之间的选择,只要读取周期时段低于阈值,则利用第一模式,在超过这个阈值的情况下,则利用第二模式。The selection between the first mode and the second mode is made according to the speed of the relative movement, the first mode being utilized as long as the read cycle period is below a threshold and the second mode being utilized in case this threshold is exceeded.

因而,假设由运动速度约束的读取时段TL在快照期间变化,并且针对特定行变得不同于期望的累积持续时间TiD,则照相机将针对这些行提供加权了比值TiD/TL的矫正信号(signal rectifié);矫正电平进行补偿,实际上,实际的累积持续时间不再为TiD,而是TL。例如,TL变为小于TiD,并且由照相机提供的矫正电平变得高于通过传感器提供的实际电平;因此,照相机利用持续时间TiD来仿真快照,尽管这个持续时间实际上不用于这些行。相反地,例如如果假设期望的累积持续时间TiD等于环境允许的最小读取时段(该环境对应于设想应用中运动的最大速度),并且假设运动的速度变慢,则实际的累积持续时间将增加而超过期望的持续时间;然后照相机将提供矫正电平,其加权了比值TiD/TL,且低于由传感器提供的实际值。Thus, assuming that the read period T L bounded by the speed of motion changes during the snapshot and becomes different from the desired accumulation duration Ti D for certain rows, the camera will provide a weighted ratio Ti D /T L for these rows Correction signal (signal rectifié); correction level to compensate, in fact, the actual accumulation duration is no longer Ti D , but T L . For example, T L becomes smaller than Ti D , and the correction level provided by the camera becomes higher than the actual level provided by the sensor; thus, the camera uses the duration Ti D to emulate a snapshot, although this duration is not actually used for these lines. Conversely, if, for example, it is assumed that the desired accumulation duration Ti is equal to the minimum reading period allowed by the environment (the environment corresponds to the maximum speed of motion in the envisaged application), and the speed of motion is assumed to slow down, the actual accumulation duration will be Increased beyond the desired duration; the camera will then provide a correction level that weights the ratio Ti D /T L and is lower than the actual value provided by the sensor.

这涉及累积持续时间等于读取周期时段的情况,通过补偿由于运动速度变化而导致的电平变化,使得整体的亮度水平变得一致。期望的累积持续时间TiD的值将不用于进行有效的累积持续时间的调整,因为累积持续时间等于读取周期的持续时间,但是其仅用于建立乘法因子TiD/TL,该因子补偿速度波动,并且对于表示图像的电子信号提供一致性。This involves the case where the accumulation duration is equal to the period of the read cycle, so that the overall brightness level becomes consistent by compensating for level changes due to changes in motion speed. The value of the desired accumulation duration Ti D will not be used to make an effective accumulation duration adjustment, since the accumulation duration is equal to the duration of the read cycle, but it is only used to establish the multiplicative factor Ti D /T L , which compensates for Velocity fluctuates and provides consistency to the electronic signal representing the image.

然后,本发明适用于传感器以TDI模式工作的照相机,也就是说在与读取周期同步的运动的过程中,对看到同一个图像点的两个或多个像素中的信号求和。The invention is then applicable to cameras in which the sensor operates in TDI mode, that is to say summing the signals in two or more pixels seeing the same image point during a movement synchronized with the reading cycle.

在第二工作模式中,具有小于读取周期时段TL的累积持续时间,排序装置建立了等于期望的累积持续时间TiD的有效的累积持续时间。因此,存在不具有有效的累积持续时间(其等于周期时段)控制的第一模式、以及具有有效的累积持续时间(其等于期望的持续时间)控制的第二模式。In a second mode of operation, with an accumulation duration smaller than the read cycle period TL , the sequencing device establishes an effective accumulation duration equal to the desired accumulation duration Ti D. Thus, there is a first mode without effective control of the accumulation duration (which is equal to the cycle period), and a second mode with active control of the accumulation duration (which is equal to the desired duration).

在具有CMOS有源像素的传感器中,其中每个像素包括光电二极管、电荷存储节点、用于重新预置存储节点的晶体管、电荷传输晶体管、以及用于读取存储节点的电位的晶体管,读取时段TL由传输脉冲的周期性来限定,其保证在读取电荷之前电荷从光电二极管至存储节点的传输。如果进行了有效的累积持续时间的调整,则通过在两个周期性传输脉冲之间建立额外的电荷传输脉冲来实现,这个脉冲以这个额外的脉冲清空存储节点的电荷的方式而建立在存储节点的电位通过重新预置晶体管来进行重新预置的时刻处。在具有用于重新预置光电二极管的电位的额外晶体管的像素中,通过用于重新预置光电二极管的电位的脉冲来控制这个二极管,从而进行有效的累积持续时间的调整,有效的累积持续时间通过将这个重新预置脉冲的结束与之后的传输脉冲的结束分开的时间来进行限定。In a sensor with CMOS active pixels, where each pixel includes a photodiode, a charge storage node, a transistor for resetting the storage node, a charge transfer transistor, and a transistor for reading the potential of the storage node, the read The period TL is defined by the periodicity of the transfer pulse, which ensures the transfer of charge from the photodiode to the storage node before it is read. If effective accumulation duration adjustments are made, this is achieved by establishing an additional charge transfer pulse between two periodic transfer pulses, which is established at the storage node in such a way that this additional pulse empties the charge from the storage node The potential at the moment is re-preset by re-presetting the transistor. In pixels with an additional transistor for resetting the potential of the photodiode, this diode is controlled by a pulse for resetting the potential of the photodiode, so that an adjustment of the effective accumulation duration, effective accumulation duration Defined by the time separating the end of this reset pulse from the end of the following transmit pulse.

对于具有这两种工作模式的照相机,优选地提供了:只要读取周期时段低于阈值,则照相机以第一模式工作,在超过这个阈值时,照相机以第二模式工作。该阈值取决于运动的速度(其针对给定期望的累积持续时间)。For a camera with these two modes of operation it is preferably provided that the camera operates in the first mode as long as the read cycle period is below a threshold and in the second mode when this threshold is exceeded. This threshold depends on the speed of motion (which is for a given desired accumulation duration).

对于从不具有累积持续时间控制的模式切换至具有累积持续时间控制的模式的运动速度阈值为传感器读取周期时段的阈值,这是因为运动速度和周期持续时间相关。读取周期持续时间阈值TLS被选择为等于期望的累积持续时间TiD和值TM之和,其中TM为估计的停滞时间的持续时间,在停滞时间期间,在传感器以累积时间控制模式工作的情况下电荷不能在像素行中累积。这个估计的停滞时间的持续时间与传感器的构造相关。The motion speed threshold for switching from a mode without cumulative duration control to a mode with cumulative duration control is the threshold for the sensor read cycle period because motion speed and cycle duration are related. The read cycle duration threshold T LS is chosen to be equal to the sum of the desired accumulation duration Ti D and the value T M , where T M is the duration of the estimated dead time during which the sensor is in the accumulation time control mode charge cannot accumulate in the pixel row under working conditions. The duration of this estimated dead time is dependent on the configuration of the sensor.

在具体的实施方案中,在不具有累积持续时间控制的情况下照相机可以在TDI模式下工作,但是在具有累积持续时间控制的情况下照相机不能在TDI模式下工作。在这种情况下,需要区分TDI模式下的累积持续时间与非TDI模式下的累积持续时间,因为它们不具有相同的意义,这是由于具有N行的TDI模式给出比同一累积持续时间高N倍的信号电平。如将进一步解释的,用于从不具有累积持续时间控制(而利用TDI)的模式切换至具有累积持续时间控制(而不利用TDI)的阈值为值TLS=TiD+TM,但是关于这样的条件,在期望的累积持续时间TiD被视为在具有累积持续时间控制的模式下的持续时间,而不是在不具有控制而利用TDI的模式下的期望的累积持续时间T’iD。具有TiD=NxT'iD,并且读取周期持续时间阈值TLS为NxT'iD+TMIn a specific embodiment, the camera can operate in TDI mode without cumulative duration control, but cannot operate in TDI mode with cumulative duration control. In this case, a distinction needs to be made between the accumulation duration in TDI mode and the accumulation duration in non-TDI mode, because they do not have the same meaning, due to the fact that TDI mode with N rows gives higher than the same accumulation duration N times the signal level. As will be further explained, the threshold for switching from a mode without cumulative duration control (with TDI) to with cumulative duration control (without TDI) is the value T LS =Ti D +T M , but with respect to Such a condition that the desired accumulation duration Ti D is considered as the duration in the mode with accumulation duration control, rather than the desired accumulation duration T' iD in the mode without control but with TDI. With Ti D =NxT'i D , and the read cycle duration threshold T LS is NxT'i D +T M .

优选地,在两种工作模式下,提供了如下的传感器的输出电平,其进一步乘以了大于1的安全系数Ks,旨在避免传感器的数字输出饱和的风险;这种饱和可能特别发生在改变控制模式的阈值的邻域中不具有累积持续时间控制的模式下。优选地,系数Ks至少等于(TLmin+TM)/TLmin,其中,TLmin为最小读取时段,低于这个时段传感器不能工作,TM为在累积时间控制模式下传感器的停滞时间的持续时间。这个系数Ks的意义和选择将进一步解释。对于作为具有两行的TDI电荷求和传感器工作的传感器,系数Ks乘以2,对于具有N行的TDI传感器,系数Ks乘以N,其在不具有累积持续时间控制的模式下,利用TDI求和来工作,而在具有累积持续时间控制的情况下,不利用TDI求和来工作。如果具有累积持续时间控制的模式为利用TDI求和的模式,则系数Ks至少等于(NxTLmin+TM)/TLminPreferably, in both operating modes, an output level of the sensor is provided which is further multiplied by a safety factor Ks greater than 1, aimed at avoiding the risk of saturation of the digital output of the sensor; such saturation may occur especially in Change the threshold of the control mode in the neighborhood of the control mode that does not have the cumulative duration. Preferably, the coefficient Ks is at least equal to (T Lmin +T M )/T Lmin , where T Lmin is the minimum reading period below which the sensor cannot operate, and T M is the dead time of the sensor in cumulative time control mode duration. The meaning and choice of this coefficient Ks will be explained further. The factor Ks is multiplied by 2 for a sensor operating as a TDI charge-summing sensor with two lines, and by N for a TDI sensor with N lines, which in mode without accumulation duration control utilizes TDI summing sum to work, and not with TDI summation with cumulative duration control. If the mode with cumulative duration control is the mode with TDI summation, the coefficient Ks is at least equal to (NxT Lmin +T M )/T Lmin .

除了用于产生图像的方法(其已经概括地进行了阐述)之外,本发明的主题还为照相机本身,其可以获得这些图像。因此,本发明提出了一种扫描照相机,所述扫描照相机包括具有至少一行像素的线性图像传感器,能够在有效的累积持续时间Ti(其可能变化)内产生表示图像点的照度的传感器的输出电平,所述照相机包括:同步输入装置,其用于接收关于相对运动的速度的信息项;用于建立图像行读取周期时段TL(其与相对运动的速度成反比)的装置;以及用于接收期望的累积持续时间TiD的值的装置;排序装置,其能够建立至少一个第一工作模式,其中,有效的累积持续时间Ti等于读取周期时段TL;所述照相机的特征在于:排序装置被设计为建立第二种工作模式,其具有的累积持续时间等于期望的累积持续时间,并且小于读取时段TL;其特征在于,所述照相机包括:In addition to the method for generating the images, which has already been explained in general terms, the subject of the invention is also the camera itself, which makes it possible to obtain these images. Therefore, the present invention proposes a scanning camera comprising a linear image sensor with at least one row of pixels capable of producing an output voltage of the sensor representing the illuminance of an image point within an effective accumulation duration Ti (which may vary). Flat, said camera comprises: synchronous input means, it is used to receive the information item about the speed of relative motion; Be used for establishing the means of image line reading cycle period TL (it is inversely proportional to the speed of relative motion); Means for receiving the value of the desired accumulation duration Ti D ; sequencing means capable of establishing at least one first mode of operation in which the effective accumulation duration Ti is equal to the reading cycle period TL ; said camera is characterized in that: The sequencing device is designed to establish a second mode of operation with an accumulation duration equal to the desired accumulation duration and less than the reading period TL ; characterized in that said camera comprises:

-乘法装置,其用于在第一模式下,针对图像的每行来提供照度测量电平(其与乘以了期望的累积持续时间TiD与行读取时段TL的比值的传感器的输出电平成正比),并且在第二模式下,提供未加权这个比值的照度测量电平。- multiplication means for providing, in the first mode, for each row of the image the illuminance measurement level (which is multiplied by the output of the sensor multiplied by the ratio of the desired accumulation duration Ti D to the row read period T L proportional to the level), and in the second mode, provides the illuminance measurement level unweighted by this ratio.

-以及用于根据相对运动的速度来将照相机自动地从第一模式切换至第二模式,并且自动地从第二模式切换至第一模式的装置。- and means for automatically switching the camera from the first mode to the second mode, and from the second mode to the first mode, depending on the speed of the relative movement.

附图说明Description of drawings

通过阅读以下的并参照所附附图给出的具体描述,本发明的其他特性和优点将变得明显,在所附附图中:Other features and advantages of the present invention will become apparent by reading the following detailed description given with reference to the accompanying drawings in which:

-图1表示一个行像素图像传感器;- Figure 1 represents a row pixel image sensor;

-图2表示在用于读取像素的电路之后跟随着用于数字处理由传感器提供的信号的电路;- Figure 2 represents the circuit for digitally processing the signal provided by the sensor following the circuit for reading the pixels;

-图3表示不具有累积持续时间控制的图1中的图像传感器的工作时序图;- Figure 3 represents a timing diagram of the operation of the image sensor of Figure 1 without the control of the accumulation duration;

-图4表示具有累积持续时间控制的图1中的图像传感器的工作时序图;- Figure 4 represents a timing diagram of the operation of the image sensor of Figure 1 with accumulation duration control;

-图5表示具有累积持续时间控制的图1中的图像传感器的另一个工作时序图;- Figure 5 represents another timing diagram of the operation of the image sensor of Figure 1 with accumulation duration control;

图6概括了照相机的两种工作模式和源自每种模式的数字输出信号;Figure 6 summarizes the two modes of operation of the camera and the digital output signals derived from each mode;

-图7表示防止有效的累积持续时间等于读取时段的持续时间的停滞时间TM- Figure 7 represents the dead time TM preventing the effective accumulation duration from being equal to the duration of the reading period;

-图8表示照相机的框图,示出了输入值TiD和TL在照相机的一种工作模式下同时进行控制,而其结果是传感器输出信号的加权或不加权。- Figure 8 represents a block diagram of a camera showing that the input values Ti D and TL are simultaneously controlled in one mode of operation of the camera, with the result being a weighted or unweighted sensor output signal.

具体实施方式Detailed ways

鉴于本发明适用于利用具有TDI求和、或者不具有TDI求和的传感器的照相机,以及甚至适用于具有单行像素的传感器,所以本发明将主要在具有单行的传感器的情况下进行描述。The invention will mainly be described in the context of sensors with a single row, since the invention is applicable to cameras utilizing sensors with or without TDI summing, and even to sensors with a single row of pixels.

本发明应用于CCD技术或者MOS技术的电荷传输无源像素传感器,并且也应用于有源像素传感器。将对于有源像素传感器进行详细地描述。The invention applies to charge-transfer passive pixel sensors of CCD technology or MOS technology, and also to active pixel sensors. The active pixel sensor will be described in detail.

根据本发明的照相机包括输入装置,其用于参照传感器而接收关于图像的相对运动速度的信息项。这个信息项用于与运动同步地采用像素行的读取时段TL。这是一个瞬时速度;所述速度可以实际上在图像的观察期间变化。即使读取时段的持续时间在一行至另一行之间变化,而出于简化起见,使用了表述“读取时段”。The camera according to the invention comprises input means for receiving an item of information about the relative speed of motion of the image with reference to the sensor. This item of information is used to employ the readout period TL of the row of pixels in synchronization with the movement. This is an instantaneous velocity; the velocity may actually vary during the observation of the image. Even though the duration of the read period varies from one row to another, the expression "read period" is used for the sake of simplicity.

参照照相机对于物体的相对运动,运动速度的信息可以例如通过码盘(rouecodeuse)而被传输至照相机,所述码盘由机械系统来驱动。With reference to the relative movement of the camera with respect to the object, information on the speed of movement can be transmitted to the camera, for example via a code wheel driven by a mechanical system.

照相机还包括用于接收关于期望的累积持续时间TiD的信息项的装置。这是用于观察图像行所期望的持续时间。在用户使用照相机的情况下,其根据照度和运动速度条件来调整这个持续时间。例如,对于工业控制应用,运动的标称速度可以通过传输带来施加。如果期望运动地快,则光尽可能地强,否则会在每个周期存在太弱的信号;但是同时需要在大功率灯的消耗和成本两方面来限制成本,并且这样可能限制了运动的速度。The camera also comprises means for receiving an item of information about the desired accumulation duration Ti D . This is the expected duration for viewing image lines. In case the user uses the camera, it adjusts this duration according to the illumination and motion speed conditions. For example, for industrial control applications, the nominal speed of motion can be imposed by a conveyor belt. If fast motion is desired, the light should be as strong as possible, otherwise there would be too weak a signal per cycle; but at the same time cost would need to be limited both in terms of consumption and cost of high power lamps, and this might limit the speed of motion .

如果照相机由计算机来控制,则期望的累积持续时间TiD(其是根据这些条件来选择的)例如通过软件接口而被应用至照相机。针对整个观察图像来调整持续时间。该持续时间对于每行不变。If the camera is controlled by a computer, the desired accumulation duration Ti D , which is selected according to these conditions, is applied to the camera, for example through a software interface. The duration is adjusted for the entire observed image. This duration is constant for each row.

在一个示例中,用户得知传感器不能利用小于某值(例如,10微秒)的读取时段时间来工作。用户将标称周期时间固定为10微秒这个值。并且用户将期望的累积持续时间TiD固定为这个相同的值。如果传感器以具有N行的TDI模式工作,则用户可以将累积持续时间T'iD固定为10微秒,已知实际上,这给出了等同于其累积持续时间TiD=N.T'iD的信号(即,10微秒的N倍),并且后者的值TiD将被视为“期望的累积持续时间”。In one example, the user learns that the sensor cannot function with a read period time less than a certain value (eg, 10 microseconds). The user fixes the nominal cycle time to a value of 10 microseconds. And the user fixes the desired accumulation duration Ti D to this same value. If the sensor works in TDI mode with N lines, the user can fix the accumulation duration T'i D to 10 microseconds, knowing that in practice this gives an accumulation duration equivalent to its accumulation duration Ti D = N.T' A signal of i D (ie N times 10 microseconds), and the latter value Ti D will be considered as the "desired accumulation duration".

图1表示可以实施本发明的具有四个MOS晶体管的有源像素行的基本结构。可选地,像素的第五晶体管由虚线表示。Figure 1 shows the basic structure of an active pixel row with four MOS transistors in which the invention can be implemented. Optionally, the fifth transistor of the pixel is indicated by a dashed line.

每个像素包括:光电二极管PH,其用于将光子转换为电荷;以及电容性的电荷存储节点FD,其用于暂时地存储产生的电荷,以使得随后读取它们。Each pixel comprises a photodiode PH for converting photons into charges and a capacitive charge storage node FD for temporarily storing the generated charges so that they can be read later.

此外,像素包括传输晶体管T1,其将光电二极管连接至存储节点,并且可以允许通过光电二极管累积的电荷传输至存储节点。传输晶体管T1通过导体TG1(其对于行中的所有像素是公共的)来控制。用于重新预置存储节点的晶体管T2可以将存储节点的电位重新预置至参考电位VREFP。这个晶体管通过控制导体RST(其对于行中的所有像素是公共的)来控制。读取晶体管T3具有连接至存储节点的栅极,并且其安装为电压跟随器,以使得可以将与存储节点电位相对应的电位传输至其源极上。其漏极连接至电源电位,所述电源电位可以为电位VREFP、或者不同的电位(优选地大于VREFP)。有源晶体管T4可以将跟随器晶体管T3的源极和与像素相关的所谓的“列导体”COL的导体连接。针对行中的每个像素,存在相应的列导体。有源晶体管T4由导体SEL(其对于行中的所有像素是公共的)来控制。这个晶体管T4及其控制导体对于仅具有一行像素的传感器是可选的。其用于在存在多个行(多个行应彼此独立地读取)的情况下对行进行选择。最后,第五晶体管T5可以可选地设置,以使光电二极管的电位重新预置。In addition, the pixel includes a transfer transistor T1 that connects the photodiode to the storage node and can allow charges accumulated through the photodiode to be transferred to the storage node. The transfer transistor T1 is controlled by a conductor TG1 which is common to all pixels in a row. The transistor T2 for resetting the storage node may reset the potential of the storage node to the reference potential VREFP. This transistor is controlled via a control conductor RST which is common to all pixels in a row. The read transistor T3 has a gate connected to the storage node, and it is installed as a voltage follower so that a potential corresponding to the potential of the storage node can be transferred onto its source. Its drain is connected to a supply potential, which may be the potential VREFP, or a different potential (preferably greater than VREFP). The active transistor T4 may connect the source of the follower transistor T3 to a conductor of the so-called "column conductor" COL associated with the pixel. For each pixel in a row, there is a corresponding column conductor. The active transistor T4 is controlled by a conductor SEL which is common to all pixels in a row. This transistor T4 and its control conductor are optional for sensors with only one row of pixels. It is used to select rows when there are multiple rows that should be read independently of each other. Finally, the fifth transistor T5 can optionally be set to reset the potential of the photodiode.

列导体优选地连接至恒流源,其在晶体管T4导通的情况下,使得晶体管T3作为电压跟随器进行工作。The column conductor is preferably connected to a constant current source, which, with transistor T4 turned on, causes transistor T3 to operate as a voltage follower.

由光电二极管收集并且传输至存储节点FD的电荷修改了这个节点的电位,并且在与像素相关的列导体COL上进行读取。采样和模数转换电路CL连接至列导体之下。各种读取电路连接至多路复用器,其将在每个周期发出的数字信号Ss从传感器的各个像素顺序地传输至数字输出装置。The charge collected by the photodiode and transferred to the storage node FD modifies the potential of this node and is read out on the column conductor COL associated with the pixel. Sampling and analog-to-digital conversion circuitry CL is connected below the column conductors. The various readout circuits are connected to a multiplexer, which sequentially transmits the digital signal Ss issued at each cycle from the individual pixels of the sensor to a digital output device.

在简化的实施方案中,读取电路可以如图2所构成的,两个采样电容器Cr、Cs,两个各自的断路器KR、KS、以及模数转换器ADC,所述模数转换器ADC用于转换在两个电容器中采样的电位电平的差异。电容器Cr用于在由光电二极管产生的电荷传输之前,对存储节点的重新预置电平进行采样;电容Cs用于在电荷传输之后,对存储节点的有用电位电平进行采样。从传感器发出的数字信号Ss可以通过数字处理电路DSP来进行处理。将进一步看出,本发明提出了包括这种数字处理电路,其中传感器的信号乘以值TiD/TL,并且可选地乘以安全系数Ks,从而使等于Ss×TiD/TL或者与Ss×TiD/TL成正比的照相机数字输出信号Sc达到峰值。In a simplified embodiment, the readout circuit can be constituted as in FIG. 2, two sampling capacitors Cr, Cs, two respective circuit breakers KR, KS, and an analog-to-digital converter ADC, the analog-to-digital converter ADC Used to convert the difference in potential levels sampled in the two capacitors. The capacitor Cr is used to sample the reset level of the storage node before the charge generated by the photodiode is transferred; the capacitor Cs is used to sample the useful potential level of the storage node after the charge transfer. The digital signal Ss sent from the sensor can be processed by the digital processing circuit DSP. It will be further seen that the present invention proposes to include such a digital processing circuit in which the signal of the sensor is multiplied by the value Ti D /T L , and optionally by a safety factor Ks, so that it is equal to Ss × Ti D /T L or The digital output signal Sc of the camera, which is proportional to Ss×Ti D / TL , peaks.

在不具有调整累积时间的模式下,图3的时序图表示传感器的工作周期,在该模式下,电荷在读取时段TL的持续时间中被累积。该时序图表示应用至各个导体TG1、RST的控制信号,以及分别应用至断路器KR和KS的信号SHR和SHS。The timing diagram of Fig. 3 represents the duty cycle of the sensor in the mode without adjustment of the accumulation time, in which mode the charge is accumulated for the duration of the read period TL . The timing diagram represents the control signals applied to the respective conductors TG1, RST, and the signals SHR and SHS applied to the circuit breakers KR and KS, respectively.

利用由运动速度限定的周期TL来周期性地建立所有的信号。读取时段在图3中是可见的,并且标记为CYC1、CYC2和CYC3。每个周期顺序地包括以下操作:在任意时刻能够任意进行的周期开始,并且在本示例中,认为开始是通过存储节点重新预置信号RST的开始来限定的:All signals are built up periodically with a period TL defined by the speed of motion. The read periods are visible in Figure 3 and are labeled CYC1, CYC2 and CYC3. Each cycle sequentially includes the following operations: A cycle start that can be done arbitrarily at any time, and in this example is considered to be defined by the start of the storage node reset signal RST:

-发出用于重新预置存储节点电位的高逻辑电平RST,并且因此清空在这个节点中存在的电荷;然后返回至信号RST的零;- Issue a high logic level RST for resetting the potential of the storage node and thus emptying the charge present in this node; then returning to zero of the signal RST;

-然后发出关闭断路器KR的采样脉冲SHR,并且将电容器Cr充电至存在于列导体上的重新预置电位电平;- then a sampling pulse SHR is issued which closes the circuit breaker KR and charges the capacitor Cr to the re-preset potential level present on the column conductor;

-然后发出导通传输晶体管T1的传输脉冲TG1;在前一周期期间由光电二极管累积的电荷(由于前一周期的脉冲TG1结束)被传输至存储节点;- then a transfer pulse TG1 is issued which turns on the transfer transistor T1; the charge accumulated by the photodiode during the previous cycle (due to the end of the pulse TG1 of the previous cycle) is transferred to the storage node;

-然后发出采样脉冲SHS,其关闭断路器KS,并且在传输TG1之后,将电容器Cs充电至表示存储节点电位的电位。- The sampling pulse SHS is then issued, which closes the circuit breaker KS and, after transmission TG1 , charges the capacitor Cs to a potential representing the potential of the storage node.

注意:行SEL,如果存在的话,至少在脉冲SHR和SHS期间被激活(晶体管T4导通)。Note: Row SEL, if present, is active (transistor T4 is on) at least during pulses SHR and SHS.

模数转换CONV1发生在周期结束时,采样SHS之后,并且主要在下一周期期间,因为其花费特定的时间。这使分别针对周期CYC1、CYC2和CYC3的传感器信号电平Ss1、Ss2和Ss3达到峰值。The analog-to-digital conversion CONV1 occurs at the end of the cycle, after sampling the SHS, and mainly during the next cycle because it takes a certain amount of time. This peaks the sensor signal levels Ss1 , Ss2 and Ss3 for cycles CYC1 , CYC2 and CYC3 respectively.

根据本发明,例如在形成数字处理器DSP的部件的数字多路复用器MLT(图2)中,从传感器发出的数字信号Ss被乘以期望的累积时间与读取时段的持续时间的比值TiD/TLAccording to the invention, for example in a digital multiplexer MLT ( FIG. 2 ) forming part of a digital processor DSP, the digital signal Ss emanating from the sensor is multiplied by the desired ratio of the accumulation time to the duration of the reading period Ti D /T L .

因此,照相机包括乘法装置,其设置在每个周期,并且针对每个像素提供照度测量电平Sc,所述照度测量电平Sc与乘以了期望的累积持续时间TiD与行读取时段TL的比值的传感器的输出信号电平Ss成正比。Therefore, the camera comprises multiplication means, which are arranged at each period and provide for each pixel an illuminance measurement level Sc multiplied by the desired accumulation duration Ti D and the row readout period T L is proportional to the ratio of the sensor output signal level Ss.

提供的电平Sc补偿了持续时间TL(其从一个周期至另一个周期可能变化),使得在相同的照明条件下,即使存在速度波动,用户也看不出任何亮度差异。The level Sc provided compensates for the duration TL (which may vary from period to period) so that under the same lighting conditions the user does not see any difference in brightness even if there are speed fluctuations.

在之前所示的实际示例中,具有对应于10微秒的读取时段TLmin的标称运动速度,并具有选择的等于相同值的期望的累积持续时间,照相机信号乘以TLmin/TL,因此,如果实际速度以比值TL/TLmin降低,则在减小的方向上进行补偿。In the practical example shown before, with a nominal speed of motion corresponding to a read period T Lmin of 10 microseconds, and with a chosen desired accumulation duration equal to the same value, the camera signal is multiplied by T Lmin /T L , therefore, if the actual speed decreases with the ratio T L /T Lmin , the compensation is made in the direction of decrease.

不仅对于具有有源像素的照相机可以采用这个原理,而且对于利用CCD技术(具有双栅电平)或者MOS技术(单栅电平)的无源像素的电荷传输照相机,也可以采用这个原理。This principle can be used not only for cameras with active pixels, but also for charge-transfer cameras with passive pixels using CCD technology (with double gate level) or MOS technology (single gate level).

在之前的实施方案中,照相机利用单一工作模式,其中,有效的累积持续时间Ti独立于期望的累积持续时间TiD,因为其等于周期持续时间TL。实际上,光电二极管将从传输脉冲TG1结束起,直到下一个传输脉冲结束为止的电荷累积。之后,全部的光电产生的电荷在存储节点中,并且光电二极管重新开始累积对应于下一周期的电荷。In the previous embodiment, the camera utilizes a single mode of operation, wherein the effective accumulation duration Ti is independent of the desired accumulation duration Ti D since it is equal to the period duration T L . Actually, the photodiode accumulates charges from the end of the transfer pulse TG1 until the end of the next transfer pulse. Afterwards, all of the photogenerated charge is in the storage node, and the photodiode resumes accumulating charge corresponding to the next cycle.

在变体实施方案中,照相机不仅能够根据第一模式(不具有累积持续时间的控制)来工作,而且能够根据第二模式(具有累积持续时间的控制)来工作。而后,不具有控制的模式旨在主要用于较快的运动速度,因为其期望电荷的产生最大化;具有持续时间控制的模式旨在尤其用于较慢的运动速度,因为其期望避免通过过度延长的照度而在传感器的输出处有饱和的风险(饱和可能是像素饱和、模拟读取链饱和、或者模数转换器饱和)。In a variant embodiment, the camera can be operated not only according to a first mode (control without cumulative duration) but also according to a second mode (control with cumulative duration). Then, the mode without control is intended primarily for faster movement speeds, since it is desired to maximize charge generation; the mode with duration control is intended especially for slower movement speeds, since it is desired to avoid passing excessive Prolonged illuminance without the risk of saturation at the output of the sensor (saturation could be pixel saturation, analog read chain saturation, or analog-to-digital converter saturation).

在图1的像素中,可以通过同时将传输电位(导体TG1上的正电平)传输至晶体管T1并且将重新预置电位(导体RST上的正电平)传输至晶体管T2来进行累积持续时间的控制。然后,光电二极管中的电荷通过晶体管T1和晶体管T2被排出至漏极,并且光电二极管被重新预置。有效的累积持续时间仅开始于这个排出结束时,而不在前一传输脉冲的时刻。In the pixel of Figure 1, the accumulation duration can be performed by simultaneously transferring the transfer potential (positive level on conductor TG1) to transistor T1 and the reset potential (positive level on conductor RST) to transistor T2 control. Then, the charge in the photodiode is drained to the drain through the transistor T1 and the transistor T2, and the photodiode is reset. The effective accumulation duration starts only at the end of this ejection, not at the moment of the previous transmission pulse.

图4表示相应的时序图。其与图3的时序图类似,但是导体TG1上的脉冲添加在实际用于向存储节点传输有用电荷的脉冲之间;这个额外的脉冲通过阴影线来标记,以与其它的脉冲进行区分;这个额外的脉冲位于RST的高电平期间,而其它的脉冲位于存储节点的重新预置的瞬间之外。有效的累积时段Ti被限定在阴影线脉冲的结束与其后的非阴影线脉冲的结束之间。Figure 4 shows the corresponding timing diagram. It is similar to the timing diagram of Figure 3, but the pulse on conductor TG1 is added between the pulses actually used to transfer useful charge to the storage node; this additional pulse is marked by hatching to distinguish it from the other pulses; the The extra pulses are during the high period of RST, and the other pulses are outside the reset instant of the storage node. The effective accumulation period Ti is defined between the end of the hatched pulse and the end of the following non-hatched pulse.

或者,如果存在第五晶体管T5,则累积持续时间通过施加正电位电平至其栅极来调整,这样排空了已经在光电二极管中累积的电荷,并且只要其存在则防止电荷的新的累积。这个电平的下降沿位于两个传输脉冲的时段TL之间,并且在时间Ti(其从施加至栅极的电平的下降沿至传输脉冲TG1的下降沿为止)内持续进行电荷的累积。Alternatively, if a fifth transistor T5 is present, the accumulation duration is adjusted by applying a positive potential level to its gate, which empties the charge already accumulated in the photodiode and prevents a new accumulation of charge as long as it exists . The falling edge of this level is located between the period TL of the two transfer pulses, and the accumulation of charges continues during the time Ti (from the falling edge of the level applied to the gate to the falling edge of the transfer pulse TG1) .

图5表示相应的时序图。Figure 5 shows the corresponding timing diagram.

在这个示例中,照相机能够因此根据图3的模式或者图4的模式来工作。因此,其具有用于在图4的情况下产生额外的脉冲TG1,或者在图5的情况下产生晶体管T5的控制信号的装置。这些控制装置接收关于期望的累积持续时间TiD的信息项,并且在时段TL内产生合适的控制时隙(slot),其限定有效累积时间Ti=TiDIn this example, the camera can thus operate according to the mode of FIG. 3 or the mode of FIG. 4 . It therefore has means for generating an additional pulse TG1 in the case of FIG. 4 , or a control signal for transistor T5 in the case of FIG. 5 . These control means receive an item of information about the desired accumulation duration Ti D and generate suitable control slots within the time period T L which define the effective accumulation time Ti=Ti D .

当照相机在第二模式下工作时,传感器输出信号SS不再乘以TiD与TL的比值,因为光的累积确实发生在期望累积时间内。由照相机提供的信号为不加权比值TiD/TL的由传感器提供的信号Ss。When the camera is operating in the second mode, the sensor output signal SS is no longer multiplied by the ratio of Ti D to TL because the accumulation of light does occur within the desired accumulation time. The signal provided by the camera is the signal Ss provided by the sensor unweighted by the ratio Ti D /T L .

图6象征性地概括了在两种模式下的工作方式:Figure 6 symbolically summarizes how it works in the two modes:

-在图的上部,在读取的持续时间中进行累积,并且照相机的输出信号Sc加权了比值TiD/TL- in the upper part of the diagram, the accumulation is carried out over the duration of the reading and the output signal Sc of the camera is weighted by the ratio Ti D /T L ;

-在图的下部,在小于行持续时间的持续时间Ti内进行累积,并且照相机的输出信号Sc不加权比值TiD/TL- In the lower part of the figure, the accumulation takes place over a duration Ti smaller than the line duration, and the output signal Sc of the camera is not weighted by the ratio Ti D /T L .

照相机包括用于排序之前附图的时序图中的信号的程序,并且这个程序根据读取时段TL的值自动地从一个模式切换至另一个模式,以这种方式,用户看不到模式的变化。The camera includes a program for sequencing the signals in the timing diagram of the preceding figure, and this program automatically switches from one mode to another depending on the value of the read period TL , in this way the user cannot see the difference between the modes Variety.

在确定的阈值TLS之下,照相机自动地在第一模式下工作,在这个阈值TLS之上,照相机在第二模式下工作。Below a determined threshold T LS the camera automatically operates in the first mode, above this threshold T LS the camera operates in the second mode.

阈值的值依据传感器的技术特性和在其它地方已经调整的期望的累积持续时间。实际上,在具有累积时间控制的第二模式中,存在停滞时间TM,其用于保留采样和存储节点的电位的读取,在停滞时间TM期间可能使电荷累积。在图4的时序图的情况下,这个停滞时间至少包括如下的持续时间:从用于将有用电荷传输至存储节点的脉冲开始直到采样脉冲SHS结束为止。The value of the threshold depends on the technical characteristics of the sensor and the desired accumulation duration which has been adjusted elsewhere. In fact, in the second mode with accumulation time control, there is a dead time TM , which is used to preserve the reading of the potential of the sampling and storage nodes , during which the charges may be accumulated. In the case of the timing diagram of FIG. 4 , this dead time comprises at least the duration from the start of the pulse for transferring the useful charge to the storage node until the end of the sampling pulse SHS.

图7图示了这个停滞时间TM的存在:重新预置脉冲(阴影线)不能在脉冲SHS结束之前开始,并且累积仅在重新预置脉冲结束时开始,所述重新预置脉冲确定了累计持续时间Ti的开始。因此,停滞时间TM至少从传输脉冲(非阴影线)结束起,直到重新预置脉冲(阴影线)结束为止。在图7中,最大的累积持续时间Timax被表示为指定的持续时间TL:其等于TL-TMFigure 7 illustrates the presence of this dead time TM : the reset pulse (hatched) cannot start before the end of the pulse SHS, and accumulation starts only at the end of the reset pulse, which determines the accumulated The start of duration Ti. Thus, the dead time T M is at least from the end of the transmit pulse (not hatched) until the end of the reset pulse (hatched). In Fig. 7, the maximum cumulative duration Ti max is indicated as a specified duration TL : it is equal to TL - TM .

如果提供至照相机的期望的累积持续时间为TiD,则照相机确定读取时段的阈值,或者对于相同的运动速度阈值的量的多少,对于这个阈值照相机必须改变工作模式。阈值TLS等于TiD+TMIf the desired accumulation duration provided to the camera is Ti D , the camera determines a threshold for the reading period, or for the same motion speed threshold the amount for which the camera has to change the mode of operation. The threshold T LS is equal to Ti D +T M .

对于小于TLS=TiD+TM的TL,即使TL不等于TiD,照相机也利用等于TL的累积时间来工作,而不进行累积时间控制,并且将等于TiD/TL的补偿加权应用至传感器信号。对于大于或等于阈值TLS的TL,照相机在第二模式下工作,并且不应用任何补偿加权。For T L less than T LS =Ti D +T M , even if T L is not equal to Ti D , the camera operates with an accumulation time equal to T L without accumulation time control, and will be equal to Ti D /T L Compensation weighting is applied to the sensor signal. For T L greater than or equal to the threshold T LS , the camera operates in the second mode and does not apply any compensation weighting.

如果传感器是在第一模式下(低于阈值TLS),而不是在第二模式下(高于阈值),以N行的TDI求和来进行工作的传感器,则阈值将也等于TiD+TM,其中TiD为在非TDI模式下估算的期望的累积持续时间;TiD等于N.T'iD,其中T'iD为在TDI模式下的期望的累积持续时间。If the sensor is one that operates in the first mode (below the threshold T LS ), but not in the second mode (above the threshold), with TDI summation of N rows, the threshold will also be equal to Ti D + T M , where Ti D is the estimated expected accumulation duration in non-TDI mode; Ti D is equal to N.T'i D , where T'i D is the expected accumulation duration in TDI mode.

两种模式之间的转换是自动的,照相机具有对于阈值计算所需的信息(TL,TiD,TM),并且被设计为在这个阈值处改变模式,模式的改变一方面包括改变排序时序图,另一方面包括加权或不加权比值TiD/TLThe switchover between the two modes is automatic, the camera has the information needed for the threshold calculation (T L , Ti D , T M ) and is designed to change the mode at this threshold, the change of the mode includes on the one hand changing the ordering Timing diagrams, on the other hand, include weighted or unweighted ratios Ti D /T L .

然而,可能具有如下的风险:用户将传感器数字或模拟增益(其关于期望的累积持续时间)调整至传感器提供的值,对于某些像素,数字信号Ss有些过于接近传感器能够提供的最大值Ssmax。However, there may be a risk that the user adjusts the sensor digital or analog gain (which with respect to the desired accumulation duration) to the value provided by the sensor, and for some pixels the digital signal Ss is somewhat too close to the maximum value Ssmax that the sensor can provide.

如果在具有累积持续时间控制的模式下,数字信号Ss太接近最大值Ssmax,则切换至不具有控制的模式将引起累积持续时间增加,从TiD增加至TiD+TM,因此,对于这些像素的仍很强的信号超过传感器输出信号的最高限度Ssmax。If in the mode with accumulation duration control the digital signal Ss is too close to the maximum value Ssmax, switching to the mode without control will cause the accumulation duration to increase from Ti D to Ti D +T M , so for these The still strong signal of the pixel exceeds the upper limit Ssmax of the sensor output signal.

实际上,在等于TiD的有效的累积持续时间超过阈值TLS时照相机立即工作的情况下,具有读取持续时间TLS=TiD+TM,而不是累积持续时间TiDIn fact, instead of the accumulation duration Ti D , there is a readout duration T LS =Ti D +T M in the case where the camera operates immediately when the effective accumulation duration equal to Ti D exceeds the threshold T LS .

但是在低于阈值时照相机立即工作的情况下,仍具有读取持续时间TLS,则现在具有等于读取持续时间的有效的累积持续时间,因此等于TLS,从而等于TiD+TMBut in case the camera is on immediately below the threshold, still having a read duration T LS , there is now an effective cumulative duration equal to the read duration and thus T LS and thus Ti D +T M .

因此,在从第二模式切换至第一模式时,通过因子(TiD+TM)/TiD而使累积持续时间急速跳变。如果在第二模式下已经接近最大电平Ssmax,则这个跳变使得传感器的数字输出电平饱和。Therefore, when switching from the second mode to the first mode, the accumulation duration jumps sharply by the factor (Ti D +T M )/Ti D. This transition saturates the digital output level of the sensor if already close to the maximum level Ssmax in the second mode.

为了防止这种风险,并且以用户不可见的方式进行,提出了如下的增强方式:其包括引入安全系数Ks至信号处理,数字处理是基于在第一模式或者第二模式下提供的数字电平Sc来产生照相机的数字输出信号。In order to prevent this risk, and to do so in a manner invisible to the user, the following enhancement is proposed: it consists in introducing a safety factor Ks into the signal processing, the digital processing is based on the digital level provided in the first mode or in the second mode Sc to generate the camera's digital output signal.

这个系数Ks旨在迫使照相机提供相对于实际值(其应当提供所考虑的照度)高估的信号,以促使用户不对在信号Ss饱和时具有达到峰值的风险的累积持续时间的设置进行调整。This coefficient Ks is intended to force the camera to provide an overestimated signal relative to the actual value (which should provide the illuminance considered), in order to encourage the user not to adjust the setting of the accumulation duration with the risk of peaking when the signal Ss is saturated.

由传感器提供的信号Sc将乘以大于1的系数Ks,并且照相机将在第一模式(其中,Sc=Ss×TiD/TL)和第二模式(其中,Sc=Ss)下都提供数字输出电平SN=Sc×Ks。The signal Sc provided by the sensor will be multiplied by a factor Ks greater than 1 and the camera will provide digital Output level SN=Sc×Ks.

用户将调整期望的累积时间、照明条件和照相机增益,以具有不饱和的输出信号SN,尽管这个乘法系数表现为大于1,因而如果正确地选择系数Ks,则保证在上游数字处理(其包括从第二模式切换至第一模式)时不存在饱和。The user will adjust the desired integration time, lighting conditions and camera gain to have an unsaturated output signal SN, although this multiplication factor appears to be greater than 1, thus ensuring that the upstream digital processing (which consists of There is no saturation when switching from the second mode to the first mode).

安全系数Ks的选择与在累积持续时间内上述跳变的值直接相关,并且因此,与比值(TiD+TM)/TiD相关。The choice of the safety factor Ks is directly related to the value of the above-mentioned jump in the accumulation duration and, therefore, to the ratio (Ti D +T M )/Ti D.

目前,在读取时间具有允许传感器能够工作的最低可能值的情况下,比值TiD/(TiD+TM)为最不利的。实际上,停滞时间TM为独立于周期时间、对于传感器几乎固定的值。因此,在周期时间最短时,期望累积时间与周期时间的比值为最高,并且需要选择系数Ks,以调整这种最不利的情况。At present, the ratio Ti D /(Ti D + TM ) is the most unfavorable in case the reading time has the lowest possible value that allows the sensor to work. In practice, the dead time T M is an almost fixed value for the sensor, independent of the cycle time. Therefore, the ratio of accumulation time to cycle time is expected to be highest when the cycle time is shortest, and the coefficient Ks needs to be selected to adjust for this most unfavorable case.

如果TLmin为最小读取时段,低于这个时段,传感器可能不再工作,则系数Ks将优选地选择为等于或大于(TLmin+TM)/TLminIf T Lmin is the minimum reading period below which the sensor may no longer work, the coefficient Ks will preferably be chosen to be equal to or greater than (T Lmin +T M )/T Lmin .

通过示例,如果最小的读取持续时间TLmin为10微秒,并且停滞时间为4微秒,则Ks将被选择等于1.4或者大于1.4(如果希望进一步地增加安全裕度)。By way of example, if the minimum read duration T Lmin is 10 microseconds, and the dead time is 4 microseconds, then Ks would be chosen equal to 1.4 or greater than 1.4 (if further increased safety margin is desired).

因此,数字处理器DSP将包括从传感器发出的数字信号Sc乘以这个系数Ks的乘法装置。The digital processor DSP will therefore comprise multiplication means for multiplying the digital signal Sc emanating from the sensor by this coefficient Ks.

图8概括了在根据本发明的照相机可以根据不具有累积持续时间控制的模式和具有累积持续时间控制的模式来工作的情况下,根据本发明的照相机的结构。时钟CLK(其管理读取周期)接收运动速度的信息(其由输入TL来标记)。传感器排序装置SEQ接收由用户限定的、关于期望的累积持续时间TiD的信息项。这些装置控制IMS线性图像传感器,并且根据依赖于周期TL是低于或是高于阈值TLS的一种模式或者另一种模式来进行工作。传感器读取电路CL提供了表示在运动期间像素的照度的数字信号Ss。信号Ss根据排序装置施加第一模式或是第二模式而乘以或者不乘以比值TiD/TL。在照相机中,通常将乘法设想为发生在用于信号的数字处理的处理器中。因此,从这个乘法所得的数字信号Sc或者为Ss或者为Ss×TiD/TL。这个信号Sc本身乘以安全系数Ks,以给出照相机的数字输出信号,SN=Ks×Sc。FIG. 8 summarizes the structure of a camera according to the invention in the case that the camera according to the invention can operate according to a mode without and with accumulation duration control. The clock CLK (which manages the read cycle) receives the information on the speed of movement (which is marked by the input TL ). The sensor sequencing means SEQ receives an item of information defined by the user regarding the desired accumulation duration Ti D . These means control the IMS linear image sensor and operate according to one mode or another depending on whether the period TL is below or above a threshold TLS . The sensor readout circuit CL provides a digital signal Ss representative of the illuminance of the pixel during motion. The signal Ss is multiplied or not multiplied by the ratio Ti D /T L depending on whether the sequencing device applies the first mode or the second mode. In cameras, multiplication is usually envisaged to take place in the processor used for the digital processing of the signal. Thus, the digital signal Sc resulting from this multiplication is either Ss or Ss×Ti D /T L . This signal Sc is itself multiplied by a safety factor Ks to give the digital output signal of the camera, SN=Ks*Sc.

本发明可以特别地利用具有两行像素的TDI传感器来实施,诸如在专利公开文本FR2971621中所描述的。The invention may notably be implemented with a TDI sensor having two rows of pixels, such as described in patent publication FR2971621.

Claims (8)

1. a kind of method for generating image by camera, the camera includes linear imaging sensor, the line Property imaging sensor be in relative motion with reference to the image to be observed, the sensor is provided for the picture point each observed Indicate this may variation effective cumulative duration Ti in illumination output level (Ss), the camera bag Synchronous input unit is included, is used to receive the item of information about speed of related movement;For establishing the image line read cycle period TLDevice, described image row read cycle period TLIt is inversely proportional with speed of related movement;And it is held for receiving desired accumulation The value Ti of continuous timeD, the method is characterized in that the method includes two kinds of operating modes, respectively:
- the first operating mode, wherein effective cumulative duration Ti is equal to read cycle period TL, and wherein, eedle of taking a picture To each picture point, illumination photometry level (SN) is provided, the illumination photometry level (SN) is held with desired accumulation has been multiplied by Continuous time TiDWith row read cycle period TLRatio TiD/TLSensor output level it is directly proportional,
- the second operating mode has and is less than read cycle period TLCumulative duration, wherein collator establishes In the effective cumulative duration of desired cumulative duration, and wherein, the camera is each for often going, being directed to Picture point, provides illumination photometry level, the illumination photometry level with not to desired cumulative duration TiDIt is read with row Period TLRatio TiD/TLThe output level for the sensor being weighted is directly proportional,
The selection between first mode and second mode is carried out according to the speed of relative motion, is less than in the read cycle period First mode is utilized when threshold value, and second mode is utilized when more than this threshold value.
2. according to the method described in claim 1, it is characterized in that, according to the speed of relative motion come execute from first mode to The switching of second mode and from second mode to the switching of first mode, and the switching is happened at read cycle period threshold TLS=TiD+TMIt is interior, wherein TMDuration for the dead time estimated in the second operation mode, during dead time, Imaging sensor cannot accumulate any charge.
3. according to the method described in claim 2, it is characterized in that, under two kinds of operating modes, the output level of sensor is another Outer be multiplied by is equal to or more than (TLmin+TM)/TLminSafety coefficient (Ks), wherein TLminFor the minimum read cycle period, it is less than This period sensor cannot work.
4. a kind of smear camera comprising have the linear imaging sensor of at least one-row pixels, the scanography function The output level (Ss) of sensor is enough generated, the output level indicates in the effective accumulation period time Ti that may change Picture point illumination, the camera includes collator;Synchronous input unit, is used to receive about speed of related movement Item of information;For establishing image line read cycle period TLDevice, described image row read cycle period TLWith relative motion Speed be inversely proportional;And the value Ti for receiving desired cumulative durationDDevice, the collator can establish First operating mode, wherein effective cumulative duration Ti is equal to read cycle period TL, which is characterized in that collator quilt It is designed as establishing the second operating mode, the cumulative duration having is equal to desired cumulative duration, and less than reading Period TL, and it is characterized in that, the camera includes:
Multiplier (MLT) is used in first mode rather than under second mode, and illumination survey is provided for the often row of image Level (SN) is measured, the illumination photometry level (SN) is directed to each picture point, and has been multiplied by desired cumulative duration TiDWith Row reads period TLRatio sensor output level it is directly proportional, and
For according to the speed of relative motion come by camera automatically from first mode switch to second mode and automatically from Second mode switches to the device of first mode.
5. camera according to claim 4, which is characterized in that for camera to be switched to the second mould from first mode The device of formula is designed such that the camera utilizes first mode when read cycle period TL is less than threshold value, more than the threshold Second mode is utilized when value.
6. camera according to claim 5, which is characterized in that be directed to read cycle period threshold TLS=TiD+TMAnd it builds The vertical switching from a pattern to another pattern, wherein TMFor continuing for dead time for estimating in the second operation mode Time, during dead time, imaging sensor cannot accumulate any charge.
7. the camera according to one of claim 4 to 6, which is characterized in that the camera includes further being used for Under two kinds of operating modes, the output level of sensor is multiplied by or is more than (TLmin+TM)/TLminSafety coefficient (Ks) Device, wherein TLminFor the minimum read cycle period, cannot work less than this period sensor, and TMFor in the second work The duration for the dead time estimated under operation mode, imaging sensor cannot tire out any charge during dead time period Product.
8. camera according to claim 5, which is characterized in that the sensor includes N row pixels, and N is more than 1, and The sensor can be worked with time delay integration (TDI) pattern in the first operation mode.
CN201480010899.3A 2013-02-28 2014-02-24 Method for generating images and line sensor camera Expired - Fee Related CN105009565B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FR1351800A FR3002715B1 (en) 2013-02-28 2013-02-28 METHOD FOR PRODUCING IMAGES AND LINEAR SENSOR CAMERA
FR1351800 2013-02-28
PCT/EP2014/053538 WO2014131726A1 (en) 2013-02-28 2014-02-24 Method of producing images and linear-sensor camera

Publications (2)

Publication Number Publication Date
CN105009565A CN105009565A (en) 2015-10-28
CN105009565B true CN105009565B (en) 2018-10-12

Family

ID=49231580

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480010899.3A Expired - Fee Related CN105009565B (en) 2013-02-28 2014-02-24 Method for generating images and line sensor camera

Country Status (7)

Country Link
JP (1) JP6301968B2 (en)
KR (1) KR102094057B1 (en)
CN (1) CN105009565B (en)
FR (1) FR3002715B1 (en)
IL (1) IL240532A0 (en)
TW (1) TWI608736B (en)
WO (1) WO2014131726A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170078573A1 (en) * 2015-11-27 2017-03-16 Mediatek Inc. Adaptive Power Saving For Multi-Frame Processing

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6032864A (en) * 1997-02-04 2000-03-07 Fuji Xerox, Co., Ltd. Image reader
JP2005223563A (en) * 2004-02-05 2005-08-18 Adscience Technologies Co Line sensor image reader
CN102246510A (en) * 2008-12-12 2011-11-16 E2V半导体公司 Image sensor utilizing dual charge transfer for large dynamic range and readout method
WO2012107542A1 (en) * 2011-02-10 2012-08-16 E2V Semiconductors Two-line, shared-pixel linear image sensor

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0666633A (en) * 1992-08-24 1994-03-11 Dainippon Printing Co Ltd Lightness correcting apparatus
JPH09247545A (en) * 1996-03-11 1997-09-19 Matsushita Electric Ind Co Ltd Scanner type electronic camera
JP4020893B2 (en) 2004-07-07 2007-12-12 オリンパス株式会社 Microscope imaging apparatus and biological sample observation system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6032864A (en) * 1997-02-04 2000-03-07 Fuji Xerox, Co., Ltd. Image reader
JP2005223563A (en) * 2004-02-05 2005-08-18 Adscience Technologies Co Line sensor image reader
CN102246510A (en) * 2008-12-12 2011-11-16 E2V半导体公司 Image sensor utilizing dual charge transfer for large dynamic range and readout method
WO2012107542A1 (en) * 2011-02-10 2012-08-16 E2V Semiconductors Two-line, shared-pixel linear image sensor

Also Published As

Publication number Publication date
JP2016508703A (en) 2016-03-22
TW201503693A (en) 2015-01-16
KR20150122662A (en) 2015-11-02
WO2014131726A1 (en) 2014-09-04
KR102094057B1 (en) 2020-03-26
FR3002715B1 (en) 2016-06-03
CN105009565A (en) 2015-10-28
JP6301968B2 (en) 2018-03-28
FR3002715A1 (en) 2014-08-29
IL240532A0 (en) 2015-10-29
TWI608736B (en) 2017-12-11

Similar Documents

Publication Publication Date Title
EP2832090B1 (en) Cmos image sensors implementing full frame digital correlated double sampling with global shutter
CN102970494B (en) Imaging device, imaging method, and electronic device
JP6374690B2 (en) Imaging apparatus, control method therefor, program, and storage medium
US7319423B2 (en) Multi-mode ADC and its application to CMOS image sensors
US8878117B2 (en) Image sensor and image capture apparatus
US20150163422A1 (en) Image Sensor Having Pixels with Different Integration Periods
CN101277375A (en) CMOS solid-state image pickup apparatus
JP5885431B2 (en) Imaging device and imaging apparatus
JP6068488B2 (en) Video sensor with multi-stage digital addition function
KR20210114290A (en) Image Sensor and Photographing Apparatus including the same
KR101747487B1 (en) Two-line, shared-pixel linear image sensor
KR101483356B1 (en) Image sensor
CN105009565B (en) Method for generating images and line sensor camera
US7397503B2 (en) Systems and methods for reducing artifacts caused by illuminant flicker
JP3899859B2 (en) Solid-state imaging device, driving method thereof, and camera system
JP2014060658A (en) Solid-state image pickup device, drive method of solid-state image pickup device and electronic apparatus
KR102106372B1 (en) Imaging device and method for driving thereof
KR101909744B1 (en) A light accumulation image sensor of parallel structure having remove circuit
KR100718994B1 (en) Driving device of CMOS image sensor.
JPS63157580A (en) Solid-state image pickup device
KR20130108032A (en) Image sensor and operating method of same
HK1172762B (en) A method for processing an image captured by an image sensor
HK1172762A1 (en) A method for processing an image captured by an image sensor
HK1172764A (en) Image sensor with charge multiplication output channel and charge sensing output channel
KR20140136287A (en) Imaging device and method for driving thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: French looking leiwo

Applicant after: E2V SEMICONDUCTORS

Address before: French looking leiwo

Applicant before: E2V Semiconductor Co.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20181012

CF01 Termination of patent right due to non-payment of annual fee