[go: up one dir, main page]

EP3198625B1 - Bimode image acquisition device with photocathode - Google Patents

Bimode image acquisition device with photocathode Download PDF

Info

Publication number
EP3198625B1
EP3198625B1 EP15766546.4A EP15766546A EP3198625B1 EP 3198625 B1 EP3198625 B1 EP 3198625B1 EP 15766546 A EP15766546 A EP 15766546A EP 3198625 B1 EP3198625 B1 EP 3198625B1
Authority
EP
European Patent Office
Prior art keywords
zone
sensor
pixels
filters
flux
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP15766546.4A
Other languages
German (de)
French (fr)
Other versions
EP3198625A1 (en
Inventor
Damien LETEXIER
Franck Robert
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Photonis France SAS
Original Assignee
Photonis France SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Photonis France SAS filed Critical Photonis France SAS
Publication of EP3198625A1 publication Critical patent/EP3198625A1/en
Application granted granted Critical
Publication of EP3198625B1 publication Critical patent/EP3198625B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01JELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
    • H01J31/00Cathode ray tubes; Electron beam tubes
    • H01J31/08Cathode ray tubes; Electron beam tubes having a screen on or from which an image or pattern is formed, picked up, converted, or stored
    • H01J31/50Image-conversion or image-amplification tubes, i.e. having optical, X-ray, or analogous input, and optical output
    • H01J31/56Image-conversion or image-amplification tubes, i.e. having optical, X-ray, or analogous input, and optical output for converting or amplifying images in two or more colours
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01JELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
    • H01J31/00Cathode ray tubes; Electron beam tubes
    • H01J31/08Cathode ray tubes; Electron beam tubes having a screen on or from which an image or pattern is formed, picked up, converted, or stored
    • H01J31/50Image-conversion or image-amplification tubes, i.e. having optical, X-ray, or analogous input, and optical output
    • H01J31/508Multistage converters
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01JELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
    • H01J2231/00Cathode ray tubes or electron beam tubes
    • H01J2231/50Imaging and conversion tubes
    • H01J2231/50005Imaging and conversion tubes characterised by form of illumination
    • H01J2231/5001Photons
    • H01J2231/50015Light
    • H01J2231/50026Infrared

Definitions

  • the present invention relates to the field of night vision image acquisition devices, comprising a photocathode adapted to convert a stream of photons into a stream of electrons.
  • the field of the invention is more particularly that of such devices, using matrix color filters.
  • Such a device is for example an image intensifier tube, comprising a photocathode, adapted to convert an incident flux of photons into an initial flow of electrons.
  • This initial flow of electrons propagates inside the intensifier tube, where it is accelerated by a first electrostatic field towards multiplication means.
  • These multiplying means receive said initial flow of electrons, and in response provide a secondary electron flow.
  • Each initial electron incident on an input side of the multiplication means causes the emission of several secondary electrons on the side of the output face of these same means.
  • an intense secondary electron flux is generated from a low initial electron flux, and thus ultimately from very low intensity light radiation.
  • the secondary electron flux is accelerated by a third electrostatic field in the direction of a phosphor screen, which converts the secondary electron flux into a photon flux.
  • the photon flux provided by the phosphor screen corresponds to the flux of photons incident on the photocathode, but in more intense.
  • each photon of the photon flux incident on the photocathode corresponds to several photons of the photon flux supplied by the phosphor screen.
  • the photocathode and the multiplying means are placed in a vacuum tube having an entrance window to let the incident photon flux enter the photocathode.
  • the vacuum tube can be closed by the phosphor screen.
  • the photon flux provided by the phosphor screen corresponds to a monochrome image.
  • the document GB 2,302,444 proposes an intensifier tube of images making it possible to restore a poly-chromatic image.
  • a first primary color filter array is disposed upstream of the photocathode to filter incident photon flux before it reaches the photocathode.
  • a primary color filter is a spectral filter, which does not transmit part of the visible spectrum complementary to this primary color.
  • a primary color filter is a spectral filter that transmits part of the visible spectrum corresponding to this primary color, and possibly part of the infrared spectrum, and even part of the near-UV spectrum (200 to 400 nm) or even UV (10 to 200 nm).
  • the first primary color filter matrix consists of red, green, and blue filters that draw primary color pixels on the primary color filter.
  • photocathode a photon flux incident on a given pixel of the photocathode corresponds to a given primary color.
  • the electron flow supplied in response by the photocathode does not directly contain chromatic information, but corresponds to this given primary color.
  • the photon flux supplied by the phosphor screen corresponds to a white light, a combination of several wavelengths corresponding in particular to red, green and blue.
  • This stream is filtered by a second matrix of primary color filters.
  • This second matrix draws pixels of primary color on the phosphor screen.
  • a flux of photons emitted by a given pixel of the phosphor screen is filtered by a primary color filter.
  • a flux of photons corresponding to a given primary color is obtained.
  • the second matrix is identical to and aligned with the first matrix.
  • the pixels of the phosphor screen are therefore aligned with the pixels of the photocathode.
  • the image supplied at the output of the second matrix is thus composed of pixels of three primary colors, corresponding to an intensified image of the pixelated image at the output of the first matrix.
  • this intensifier tube has high energy losses, detrimental in a field characterized by the need for a strong intensification of a photon flux.
  • An object of the present invention is to provide an image acquisition device for acquiring color images while minimizing the damage caused by energy losses.
  • the photocathode is disposed inside a vacuum chamber, and the matrix of elementary filters is located on an inlet window of said vacuum chamber.
  • the photocathode is placed inside a closed vacuum chamber by a bundle of optical fibers, and each elementary filter of the matrix of elementary filters is deposited on an end of an optical fiber of said bundle.
  • the senor may be an electron-sensitive sensor adapted to receive the electron flux emitted by the photocathode, and the processing means may be adapted to calculate a magnitude representative of an average electron surface flux.
  • the panchromatic filters represent 75% of the elementary filters.
  • the processing means are advantageously adapted to combining a monochrome image and the color image of said zone, the monochrome image of said zone being obtained from the panchromatic pixels of this zone. zoned.
  • the matrix of elementary filters may furthermore comprise infrared filters that do not transmit the visible part of the spectrum, with each infrared filter being associated with at least one pixel of the so-called infrared pixel sensor.
  • the matrix of elementary filters may consist of an image projected by a projection optical system.
  • the figure 1 schematically illustrates the principle of an image acquisition device 100 according to the invention.
  • the device 100 comprises a photocathode 120, operating as described in the introduction, and a matrix 110 of elementary filters 111 located upstream of the photocathode.
  • a GaAs photocathode is used. (gallium arsenide). Any other type of photocathode, in particular sensitive photocathodes, can be used in a widest wavelength spectrum, including the visible (about 400 to 800 nm), and possibly the near infra-red or even the same. infra-red, and / or the near UV (ultraviolet), or even the UV.
  • Each elementary filter 111 filters the incident light at a location of the photocathode 120. Each elementary filter 111 thus defines a pixel on the photocathode 120.
  • the elementary filters 111 are transmission filters of at least two different categories: primary color filters, and transparent (or panchromatic) filters.
  • a primary color elementary filter is defined in the introduction.
  • the elementary filters of the matrix 110 include three types of primary color filters, i.e. filters of three primary colors. This allows an additive or subtractive synthesis of all the colors of the visible spectrum.
  • each type of primary color filter transmits only a portion of the visible spectrum, i.e., a band of the 400-700 nm wavelength range, and the different types of primary color pixels. cover all this gap.
  • each primary color filter can transmit a portion of the near infra-red or even infra-red spectrum and / or a portion of the near UV or UV spectrum.
  • the color filters can be red, green, blue filters, in the case of an additive synthesis, or yellow, magenta, cyan filters, in the case of a subtractive synthesis.
  • Other sets of primary colors may be contemplated by those skilled in the art without departing from the scope of the present invention.
  • panchromatic elementary filters let pass the whole visible spectrum. Where appropriate, they may also transmit at least a portion of the near-infrared and even infrared spectrum and / or at least a portion of the near UV and even UV spectrum.
  • Elementary filters panchromatic can be transparent elements in the visible, or openings (or savings) in the matrix 110. In this second case, the pixels of the photocathode located under these panchromatic elementary filters receive unfiltered light.
  • the different types of primary color filters, and the panchromatic filters, are scattered on the elementary filter matrix.
  • the elementary filters are advantageously arranged in the form of a periodic repeating pattern in two distinct, generally orthogonal directions in the plane of the photocathode 120.
  • Each pattern preferably comprises at least one primary color filter of each type. , and panchromatic filters.
  • elementary filters of square shape have been illustrated, these may have any other geometrical shape, for example a hexagon, a disk, or a surface defined according to constraints relating to the transfer function of the device 100 according to the invention.
  • the matrix of elementary filters according to the invention can be real, or virtual.
  • the matrix of elementary filters is said to be real when it comprises elementary filters having a certain thickness, for example elementary filters made of polymer material or interference filters.
  • the matrix of elementary filters is called virtual when it consists of an image of a second matrix of elementary filters, projected upstream of the photocathode.
  • the second matrix of elementary filters consists of a real matrix of elementary filters. It is located in the object plane of a projection optical system. The image formed in the image plane of this projection optical system corresponds to said matrix of virtual elementary filters.
  • the example of a real elementary filter matrix has been developed.
  • Many variants can be envisaged, by replacing the matrix of real elementary filters by a matrix of virtual elementary filters.
  • the device according to the invention will then comprise the second matrix of elementary filters and the projection optical system, as mentioned above.
  • the proportion of panchromatic elementary filters in the matrix 110 is greater than or equal to 50%.
  • the proportion of panchromatic elementary filters is equal to 75%.
  • the elementary filters of primary color can be divided in equal proportions.
  • the elementary filters of primary color are distributed in unequal proportions.
  • the proportion of a first type of primary color filter does not exceed twice the proportion of the other types of primary color filters.
  • the proportion of panchromatic elementary filters is equal to 75%
  • the proportion of filters of a first primary color is equal to 12.5%
  • the proportion of filters of a second and a third primary color is equal to at 6.25% and 6.25%.
  • Matrix 120 receives an initial photon flux.
  • initial elementary fluxes of photons 101 each associated with an elementary filter 111, are represented.
  • the initial elementary fluxes of photons 101 together form a poly-chromatic image, and may comprise photons located in the visible spectrum, which are close to one another. infrared and even infrared.
  • An elementary filter 111 transmits a filtered elementary flux 102, the filtered elementary streams together forming a flux of photons incident on the photocathode.
  • the photocathode 120 emits a stream of electrons.
  • Each filtered elementary flux 102 corresponds to an elementary electron flux 103.
  • An elementary electron flux 103 is all the more important that the corresponding filtered elementary flux 102 comprises photons.
  • the elementary electron fluxes 103 do not directly convey chromatic information, but depend directly on a number of photons transmitted by a corresponding elementary filter 111.
  • the elementary electron fluxes 103 together form a stream of electrons emitted by the photocathode 120.
  • the device 100 further comprises a digital sensor 130.
  • the sensor 130 can directly receive the stream of electrons emitted by the photocathode 120.
  • this stream of electrons emitted by the photocathode 120 can be converted into a photon flux so that the sensor 130 finally receives a photon flux.
  • the figure 1 being a simple illustration of principle, the sensor 130 is shown directly following the photocathode 120.
  • the sensor 130 may be a photon-sensitive or electron-sensitive sensor, and other elements may be interposed between the photocathode 120 and the sensor 130.
  • the sensor is sensitive to electrons as emitted by the photocathode, or to photons obtained from these electrons.
  • Each elementary filter 111 is associated with at least one pixel 131 of the sensor.
  • each elementary filter 111 is aligned with at least one pixel 131 of the sensor, so that a major part of a stream of electrons or photons, resulting from the photons transmitted by this elementary filter 111, reaches this at least one pixel 131.
  • each elementary filter 111 is associated with exactly one pixel 131 of the sensor.
  • the surface of an elementary filter 111 corresponds to the surface of a pixel 131 of the sensor or to a surface corresponding to the juxtaposition of an integer number of pixels 131 of the sensor.
  • panchromatic pixel can be called a pixel of the sensor associated with a panchromatic elementary filter, and "primary color pixel” a pixel of the sensor associated with an elementary filter. of primary color.
  • the panchromatic pixels detect electrons or photons associated with the spectral band transmitted by the panchromatic filters.
  • Each type of primary color pixel detects electrons or photons associated with the spectral band transmitted by the corresponding primary color filter type.
  • the sensor 130 is connected to processing means 140, that is to say calculation means including a processor or a microprocessor.
  • the processing means 140 receive as input electrical signals supplied by the sensor 130, and corresponding, for each pixel 131, to the stream of photons received and detected by this pixel when the sensor is sensitive to photons, or to the electron flow received. and detected by this pixel when the sensor is sensitive to electrons.
  • the processing means 140 output an image, corresponding to the initial flux of incident photons on the matrix of elementary filters, this flux having been intensified.
  • the processing means 140 are adapted to assign, to each pixel of the sensor, information on a type of elementary filter associated with this pixel. For this purpose, they store information making it possible to connect each pixel of the sensor and a type of elementary filter. This information can be in the form of a deconvolution matrix. Thus, the spectral information that is lost during the passage through the photocathode, is restored by the processing means 140.
  • the processing means 140 are adapted to implement a treatment, as illustrated in FIG. figure 2 .
  • the processing means realize a monochrome image by interpolation of all the panchromatic pixels of the sensor. This image is called “monochrome image of the sensor”. They then implement a segmentation of the sensor in several zones, each zone being homogeneous in terms of the flux of photons or electrons detected by the corresponding panchromatic pixels.
  • the processing means then implement the following steps.
  • a magnitude is estimated F , representative of an average surface flux of photons or electrons received and detected by the panchromatic pixels of an area of the sensor, sensitive respectively to photons or electrons.
  • the useful magnitude may be equal to the average surface flux of photons or electrons. If the sensor 130 is sensitive to photons, the useful magnitude may be an average luminance on the panchromatic pixels of the sensor area. Thus, the useful magnitude may be an average surface flux of photons or electrons detected on a set of so-called panchromatic pixels of the sensor.
  • the useful quantity provides a measurement of the illumination on said sensor zone.
  • Conditions of high illumination are associated for example with a higher illuminance at a first threshold between 450 and 550 ⁇ Lux.
  • Conditions of low illumination are associated for example with a light illumination less than a second threshold of between 400 and 550 ⁇ Lux, the first and the second threshold being equal. If the first and second thresholds are not equal, the first threshold is strictly greater than the second threshold.
  • the useful magnitude is compared F and a threshold value F th . If the usefulness F is greater than the threshold value F th , the sensor zone is in conditions of high illumination. If the usefulness F is below the threshold value F th , the sensor area is in low light conditions.
  • Steps 280 and 281 together form a step to determine whether the sensor zone 130 is in low or high light conditions.
  • a strong illumination corresponds for example to the acquisition of an image of a night scene, illuminated by the moon (night level 1 to 3).
  • a low illumination corresponds for example to the acquisition of an image of a night scene, not illuminated by the moon (night level 4 to 5, or a luminous illumination less than 500 ⁇ Lux).
  • step 282A If the area is under high illumination conditions, a color image of this area is formed using the primary color pixels of this area (step 282A). It is said that the device operates in high illumination mode.
  • an image is formed of each primary color, and the images of each primary color are combined with each other.
  • An image of a primary color is formed by interpolating the pixels of this area associated with said primary color. The interpolation makes it possible to compensate for the small proportion of pixels of the sensor of a given primary color.
  • the interpolation of the pixels of a primary color is to use the values taken by these pixels to estimate the values that would be taken by the neighboring pixels if these were also pixels of this primary color.
  • Primary color images can be optionally processed to sharpen image sharpening .
  • the proportion of panchromatic pixels in the matrix is higher than that of the primary color pixels, the resolution of the primary color images is thus improved.
  • a monochrome image of said zone is formed from the panchromatic pixels of this zone.
  • a monochrome image is formed using the panchromatic pixels of this area (step 282B), and without using the primary color pixels of this area.
  • the monochrome image can be obtained by interpolation of the panchromatic pixels of this zone.
  • the device is said to operate in low illumination mode.
  • the color or monochrome images of the different areas of the sensor are combined to obtain an image of the entire sensor.
  • the image of the entire sensor can be displayed, or stored in memory for further processing.
  • a color image of each zone of strong is formed illumination, then, in the monochrome image of the sensor used for segmentation, the areas corresponding to these zones of high illumination are replaced by the color images of these zones.
  • a linear combination of the monochrome image of the sensor and these color images is performed.
  • the color image and the monochrome image are superimposed.
  • the zones of the sensor are treated separately. Alternatively, it is determined whether the entire sensor is in conditions of low or high illumination, and is treated in the same way the entire sensor. In this case, there is no segmentation of the monochrome image of the sensor, or combination of the images obtained. Steps 280, 281 and 282A or 282B are implemented over the entire surface of the sensor. In other words, the sensor zone as mentioned above corresponds to the entire sensor.
  • the processing means 140 receive as input signals from the sensor, store information for associating each pixel of the sensor with a type of elementary filter, and output a color image, or a monochrome image or a combination of a color image and a monochrome image.
  • the invention thus provides an image acquisition device for acquiring a color image of an area of the sensor, when the illumination of the scene detected on this area allows it.
  • the device provides an image of the area obtained from the panchromatic elementary filters, thus with a minimal energy loss.
  • the device automatically selects one or the other mode of operation.
  • switching from one mode to another operates with hysteresis so as to avoid any switching noise ( chattering ).
  • a first threshold for the useful magnitude is provided for the transition from the high illumination mode to the low illumination mode and a second threshold for the useful magnitude is provided for the inverse transition, the first threshold being chosen lower than the second threshold.
  • the switching from one mode to the other is done progressively through a transition phase.
  • the image acquisition device operates in low illumination mode when the useful magnitude is less than a first threshold and in high illumination mode when it is greater than a second threshold, the second threshold being chosen greater than the first threshold.
  • the image acquisition device performs a linear combination of the image obtained by the treatment in high illumination mode and that obtained by the low light mode treatment, the weighting coefficients being given by the deviations of the useful magnitude with the first and second thresholds respectively.
  • each elementary filter 111 is aligned with at least one pixel 131 of the sensor, so that each pixel of the sensor associated with an elementary filter receives only photons or electrons corresponding to this elementary filter.
  • This disadvantage can be countered by an initial calibration step making it possible to compensate for the misalignment between an elementary filter and a sensor pixel.
  • This calibration aims to compensate for the slight degradation due to the transfer function of the optical elements of the device according to the invention (photocathode and, if appropriate, multiplication means and phosphor screen).
  • the geometric shape of the filters composing the matrix of elementary filters is calibrated so as to compensate for the effect of said spatial spread.
  • the image of an elementary filter is then superimposed perfectly on one or more pixels of the sensor.
  • Interstices between adjacent elementary filters are advantageously opaque, in order to block any radiation likely to reach the photocathode without having passed through an elementary filter.
  • FIGS. 3A and 3B schematically illustrate two variants of a first embodiment of a matrix 110 of elementary filters according to the invention.
  • Primary elementary filters are red (R), green (G) or blue (B) filters.
  • the matrix has 75% panchromatic filters (W).
  • the matrix 110 is generated by a two-dimensional periodic repetition of the 4x4 basic pattern: R W BOY WUT W W W W W BOY WUT W B W W W W W W
  • Variations of this matrix can be obtained by permutation of the filters R, G, B in the pattern (1).
  • the green pixels are twice as many as the red pixels, respectively blue.
  • This imbalance can be corrected by weighting coefficients adapted when combining three primary color images to form a color image.
  • the matrix of the figure 3B corresponds to the matrix of the figure 3A , in which the primary color elementary filters R, G, B are replaced respectively by elementary primary color filters yellow (Ye), magentas (Ma), cyans (Cy). Again, the filters Ye, Ma, Cy can be switched.
  • the filters R, G, B of the pattern (2) are replaced by filters Ye, Ma, Cy.
  • the figure 4 schematically illustrates a first embodiment of a device 400 according to the invention.
  • the figure 4 will only be described for its differences in the figure 1 .
  • the use of a calibration step such that detailed above, is particularly advantageous in this embodiment.
  • the device 400 is based on the so-called intensified CMOS or intensified CCD technology (ICMOS or ICCD, for the English “ Intensified CMOS” or “ Intensified CCD”).
  • the photocathode 420 is disposed inside a vacuum tube 450 of the vacuum tube type of an image intensifier tube according to the prior art and as described in the introduction.
  • a vacuum tube designates a vacuum chamber having more particularly a tube shape.
  • the vacuum tube 450 has an inlet window 451, transparent in particular in the visible, and optionally in the near infrared or even the infrared.
  • the input window allows to let enter, inside the vacuum tube, the flux of photons incident on the photocathode.
  • the entrance window is in particular glass.
  • the input window is preferably a simple plate.
  • the matrix of elementary filters 410 is glued on one face of the inlet window 451, preferably on the inside of the vacuum tube.
  • the photocathode is pressed against the matrix of elementary filters 410.
  • a metal layer (not shown) may be deposited on the input window, around the matrix of elementary filters 410, to form an electrical contact point for the application. an electrostatic field.
  • the phosphor screen emits a stream of photons, called useful flux, which is received by the sensor 430.
  • the sensor 430 is photosensitive. It is in particular a CCD ( Charge-Coupled Device ) sensor, or a CMOS sensor ( Complementary Metal Oxide Semiconductor ).
  • CCD Charge-Coupled Device
  • CMOS Complementary Metal Oxide Semiconductor
  • the processing means 440 operates as described with reference to the figure 2 , the useful quantity being representative of the surface flux of photons detected by the panchromatic pixels of the sensor 430.
  • the sensor 430 may be in direct contact with the phosphor screen, to limit any spatial spread of the photon beam emitted by the phosphor screen.
  • the sensor 430 may be inside the vacuum tube, or outside and against an outlet face of the vacuum tube, formed by the phosphor screen.
  • the sensor 430 may be offset outside the vacuum tube 450.
  • a bundle of optical fibers can connect the phosphor screen and the pixels of the sensor 430, the bundle of optical fibers forming an exit window of the vacuum tube.
  • Such an optical fiber bundle is particularly suitable in the case where the surface of the sensor 430 is smaller than the inside diameter of the vacuum tube.
  • each fiber has a diameter on the phosphor screen side greater than its diameter on the sensor side.
  • the bundle of optical fibers is said to thin, and performs a reduction of the image provided by the phosphor screen.
  • FIGS. 5A and 5B illustrate schematically two variants of a second embodiment of a device 500 according to the invention.
  • the device 500 is based on the electro-bombarded CMOS technology, or EBCMOS for the English " Electron Bombarded CMOS”.
  • the photocathode 520 is disposed inside a vacuum tube 550.
  • the vacuum tube 550 has an inlet window 551, transparent in particular in the visible, and if necessary in the near infrared or even the infrared.
  • the elementary filter matrix 510 is adhered to one face of the input window 551, preferably on the inside of the vacuum tube.
  • the sensor 530 is disposed inside the vacuum tube 550, and directly receives the stream of electrons emitted by the photocathode.
  • the photocathode 520 and the sensor 530 are within a few millimeters of each other, and subjected to a potential difference to create an electrostatic field in the interstice between them. This electrostatic field accelerates the electrons emitted by the photocathode 520 towards the sensor 530.
  • the sensor 530 is sensitive to electrons. It is typically a CMOS sensor, adapted to make it sensitive to electrons.
  • the electron-sensitive sensor is illuminated on the back side (" back side illuminated ").
  • back side illuminated CMOS sensor whose substrate is thinned and passivated (in English, " back - thinned ").
  • the sensor may include a passivation layer, forming an outer layer on the side of the photocathode.
  • the passivation layer is deposited on the thinned substrate.
  • the substrate receives detection diodes, each associated with a pixel of the sensor.
  • the electron-sensitive sensor is illuminated on the front face.
  • CMOS sensor whose front face is treated so as to remove the protective layers covering the diodes.
  • the front face of a standard CMOS sensor is thus made sensitive to electrons.
  • the processing means 540 operate as described with reference to the figure 2 , the useful quantity being representative of the surface flux of electrons detected by the panchromatic pixels of the sensor 530.
  • the Figure 5B illustrates a variant of the device 500 of the Figure 5A , in which the vacuum tube 550 is closed by a beam 552 of optical fibers receiving the matrix of elementary filters.
  • the beam 552 of optical fibers is traversed by photons coming from the scene to be imaged.
  • a first end of the fiber optic bundle 552 closes the vacuum tube.
  • a second end of the beam 552 of optical fibers is in front of the scene to be imaged.
  • the vacuum tube 550 no longer has the input window 551, which is replaced by the optical fiber bundle which allows the vacuum tube of the scene to be imaged to be displaced.
  • Each elementary filter of the matrix 510 is associated with an optical fiber of the beam 552.
  • each elementary filter is directly attached to an optical fiber end, advantageously on the opposite side to the vacuum tube.
  • the matrix of elementary filters 510 is outside the vacuum tube, which simplifies its assembly.
  • each elementary filter is directly attached to an end of optical fiber, the side of the vacuum tube.
  • each elementary filter is directly attached to an end of optical fiber, the side of the vacuum tube.
  • the figure 6 schematically illustrates a second embodiment of a matrix of elementary filters according to the invention.
  • the matrix of elementary filters of the figure 6 differs from the matrices described above, in that it comprises infrared (IR) filters, not transmitting the visible part of the spectrum and allowing the near infrared to pass.
  • Infrared filters let the wavelengths pass in the near infrared, or even in the infrared (wavelengths greater than 700 nm).
  • Infrared filters transmit in particular the spectral band between 700 and 900 nm, or even between 700 and 1100 nm, and even between 700 and 1700 nm.
  • the filter matrix of the figure 6 differs from the matrix of the figure 3A in that in the elementary pattern, one of the two green pixels (G) is replaced by an infrared pixel (IR).
  • the figure 7 schematically illustrates a processing implemented by the processing means according to the invention, when the matrix of elementary filters comprises infrared pixels.
  • Steps 780, 781 and 782B correspond to steps 280, 281 and 282B, respectively, as described with reference to FIG. figure 2 .
  • the processing means measure a quantity, called secondary quantity, representative of the average surface flux of photons or electrons F IR detected by the infrared pixels of this area (step 783).
  • this average surface flux is an average surface flux of photons if the sensor is photosensitive, or an average surface flux of electrons if the sensor is sensitive to electrons.
  • the processing means then make a comparison between this secondary quantity and an infrared threshold F IR th (step 784).
  • step 782A If the secondary size F IR is below the infrared threshold F IR th , a color image of the zone is constructed, as described with reference to the figure 2 about step 282A (step 782A).
  • a false-color image of the zone is created, that is to say an image in which a given color is attributed to the infrared pixels of this zone.
  • the false color image can be constructed by interpolating the infrared pixels of the considered area.
  • the false color image is therefore a monochrome image, of a different color from the monochrome image associated with the panchromatic pixels. Then, we superimpose this image in false color to the monochrome image obtained using the panchromatic pixels of the same area of the sensor.
  • step 782C These steps of constructing a false color image and superposition with the monochrome image together form a step 782C.
  • zone infrared pixels belonging to this zone have an intensity greater than a predetermined infrared threshold and, if so, it is superimposed on the monochrome image of this zone.
  • a single secondary quantity for the same zone is not calculated, but a secondary quantity per infrared pixel of the zone is calculated separately. Only the infrared pixels, for which the corresponding secondary quantity is greater than the infrared threshold, are superimposed on the monochrome image obtained from the panchromatic pixels. Thus, if a sensor zone has a high intensity in the infrared range, it will be easily identifiable in the resulting image.
  • sub-zones of said sensor zone are identified, detecting an average surface flux of pixels or electrons homogeneous in the infrared spectrum, and each sub-zone is then treated separately as detailed above.
  • the comparison with the infrared threshold is done by homogeneous sub-areas of the sensor.
  • a false color image is obtained by interpolation of the infrared pixels of said sub-zone. These false color images are then superimposed on the corresponding locations on the monochrome image of the sensor area.
  • a segmentation is performed on the basis of an image made by interpolation of the infrared pixels.
  • sub-zones of this zone are identified, having a uniform intensity in the infrared spectrum, and it is determined, for each sub-zone thus identified, whether the The average of the infrared intensity in this sub-area is greater than a predetermined infrared threshold and, if so, this sub-area is represented by a false-color image based on the infrared pixels of that sub-area. false-color image of said sub-area then being superimposed with the monochrome image of the area to which it belongs.

Landscapes

  • Color Television Image Signal Generators (AREA)
  • Image-Pickup Tubes, Image-Amplification Tubes, And Storage Tubes (AREA)

Description

DOMAINE TECHNIQUETECHNICAL AREA

La présente invention concerne le domaine des dispositifs d'acquisition d'images à vision nocturne, comprenant une photocathode adaptée à convertir un flux de photons en un flux d'électrons. Le domaine de l'invention est plus particulièrement celui de tels dispositifs, utilisant des filtres matriciels de couleurs.The present invention relates to the field of night vision image acquisition devices, comprising a photocathode adapted to convert a stream of photons into a stream of electrons. The field of the invention is more particularly that of such devices, using matrix color filters.

ÉTAT DE LA TECHNIQUE ANTÉRIEURESTATE OF THE PRIOR ART

On connaît dans l'art antérieur différents dispositifs d'acquisition d'images à vision nocturne, comprenant une photocathode.In the prior art are known various devices for acquiring night vision images, comprising a photocathode.

Un tel dispositif est par exemple un tube intensificateur d'images, comprenant une photocathode, adaptée à convertir un flux incident de photons en un flux initial d'électrons. Ce flux initial d'électrons se propage à l'intérieur du tube intensificateur, où il est accéléré par un premier champ électrostatique en direction de moyens de multiplication.Such a device is for example an image intensifier tube, comprising a photocathode, adapted to convert an incident flux of photons into an initial flow of electrons. This initial flow of electrons propagates inside the intensifier tube, where it is accelerated by a first electrostatic field towards multiplication means.

Ces moyens de multiplication reçoivent ledit flux initial d'électrons, et fournissent en réponse un flux secondaire d'électrons. Chaque électron initial incident sur une face d'entrée des moyens de multiplication, provoque l'émission de plusieurs électrons secondaires du côté de la face de sortie de ces mêmes moyens. On génère ainsi un flux secondaire d'électrons intense, à partir d'un faible flux initial d'électrons, donc in fine à partir d'un rayonnement lumineux de très faible intensité.These multiplying means receive said initial flow of electrons, and in response provide a secondary electron flow. Each initial electron incident on an input side of the multiplication means, causes the emission of several secondary electrons on the side of the output face of these same means. Thus, an intense secondary electron flux is generated from a low initial electron flux, and thus ultimately from very low intensity light radiation.

Le flux secondaire d'électrons est accéléré par un troisième champ électrostatique en direction d'un écran phosphore, qui convertit le flux secondaire d'électrons en un flux de photons. Grâce aux moyens de multiplication, le flux de photons fourni par l'écran phosphore correspond au flux de photons incident sur la photocathode, mais en plus intense. En d'autres termes, à chaque photon du flux de photons incident sur la photocathode correspondent plusieurs photons du flux de photons fourni par l'écran phosphore.The secondary electron flux is accelerated by a third electrostatic field in the direction of a phosphor screen, which converts the secondary electron flux into a photon flux. Thanks to the multiplication means, the photon flux provided by the phosphor screen corresponds to the flux of photons incident on the photocathode, but in more intense. In other words, each photon of the photon flux incident on the photocathode corresponds to several photons of the photon flux supplied by the phosphor screen.

La photocathode et les moyens de multiplication sont placés dans un tube à vide présentant une fenêtre d'entrée pour laisser entrer le flux de photons incident sur la photocathode. Le tube à vide peut être fermé par l'écran phosphore.The photocathode and the multiplying means are placed in a vacuum tube having an entrance window to let the incident photon flux enter the photocathode. The vacuum tube can be closed by the phosphor screen.

Lorsque le flux de photons incident sur la photocathode est converti en un flux initial d'électrons, l'information relative à la longueur d'onde des photons est perdue. Ainsi, le flux de photons fourni par l'écran phosphore correspond à une image monochrome.When the incident photon flux on the photocathode is converted into an initial electron flux, the information relating to the wavelength of the photons is lost. Thus, the photon flux provided by the phosphor screen corresponds to a monochrome image.

Le document GB 2 302 444 propose un tube intensificateur d'images permettant de restituer une image poly-chromatique.The document GB 2,302,444 proposes an intensifier tube of images making it possible to restore a poly-chromatic image.

Une première matrice de filtres de couleur primaire est disposée en amont de la photocathode, pour filtrer un flux incident de photons avant qu'il n'atteigne la photocathode.A first primary color filter array is disposed upstream of the photocathode to filter incident photon flux before it reaches the photocathode.

Un filtre de couleur primaire est un filtre spectral, qui ne transmet pas une partie du spectre visible complémentaire de cette couleur primaire. Ainsi, un filtre de couleur primaire est un filtre spectral qui transmet une partie du spectre visible correspondant à cette couleur primaire, et éventuellement une partie du spectre infrarouge, et même une partie du spectre proche-UV (200 à 400 nm) voire même UV (10 à 200 nm).A primary color filter is a spectral filter, which does not transmit part of the visible spectrum complementary to this primary color. Thus, a primary color filter is a spectral filter that transmits part of the visible spectrum corresponding to this primary color, and possibly part of the infrared spectrum, and even part of the near-UV spectrum (200 to 400 nm) or even UV (10 to 200 nm).

La première matrice de filtres de couleur primaire est constituée de filtres rouge, vert et bleu, qui dessinent des pixels de couleur primaire sur la photocathode. Ainsi, un flux de photons incident sur un pixel donné de la photocathode correspond à une couleur primaire donnée. Le flux d'électrons fourni en réponse par la photocathode ne contient pas directement d'information chromatique, mais correspond à cette couleur primaire donnée.The first primary color filter matrix consists of red, green, and blue filters that draw primary color pixels on the primary color filter. photocathode. Thus, a photon flux incident on a given pixel of the photocathode corresponds to a given primary color. The electron flow supplied in response by the photocathode does not directly contain chromatic information, but corresponds to this given primary color.

En sortie du tube intensificateur, le flux de photons fourni par l'écran phosphore correspond à une lumière blanche, combinaison de plusieurs longueurs d'onde correspondant notamment au rouge, au vert et au bleu. Ce flux est filtré par une deuxième matrice de filtres de couleur primaire. Cette deuxième matrice dessine des pixels de couleur primaire sur l'écran phosphore. Ainsi, un flux de photons émis par un pixel donné de l'écran phosphore est filtré par un filtre de couleur primaire. En sortie de ce filtre de couleur primaire, on obtient un flux de photons correspondant à une couleur primaire donnée. La deuxième matrice est identique à la première matrice, et alignée avec celle-ci. Les pixels de l'écran phosphore sont donc alignés avec les pixels de la photocathode. L'image fournie en sortie de la deuxième matrice est donc composée de pixels de trois couleurs primaires, correspondant à une image intensifiée de l'image pixellisée en sortie de la première matrice.At the output of the intensifier tube, the photon flux supplied by the phosphor screen corresponds to a white light, a combination of several wavelengths corresponding in particular to red, green and blue. This stream is filtered by a second matrix of primary color filters. This second matrix draws pixels of primary color on the phosphor screen. Thus, a flux of photons emitted by a given pixel of the phosphor screen is filtered by a primary color filter. At the output of this primary color filter, a flux of photons corresponding to a given primary color is obtained. The second matrix is identical to and aligned with the first matrix. The pixels of the phosphor screen are therefore aligned with the pixels of the photocathode. The image supplied at the output of the second matrix is thus composed of pixels of three primary colors, corresponding to an intensified image of the pixelated image at the output of the first matrix.

On réalise ainsi un tube intensificateur à vision nocturne offrant une image couleurs. Cependant, du fait de la présence des deux matrices de filtres de couleur primaire, ce tube intensificateur présente de fortes pertes énergétiques, préjudiciables dans un domaine caractérisé par le besoin d'une forte intensification d'un flux de photons.This produces a night vision intensifier tube providing a color image. However, because of the presence of the two matrices of primary color filters, this intensifier tube has high energy losses, detrimental in a field characterized by the need for a strong intensification of a photon flux.

Un objectif de la présente invention est de fournir un dispositif d'acquisition d'images permettant l'acquisition d'images couleurs tout en minimisant le préjudice causé par des pertes énergétiques.An object of the present invention is to provide an image acquisition device for acquiring color images while minimizing the damage caused by energy losses.

EXPOSÉ DE L'INVENTIONSTATEMENT OF THE INVENTION

Cet objectif est atteint avec un dispositif d'acquisition d'images comprenant :

  • une photocathode, adaptée à convertir un flux incident de photons en un flux d'électrons ;
  • un capteur constitué d'une matrice d'éléments, dits pixels ; et
  • des moyens de traitement.
This objective is achieved with an image acquisition device comprising:
  • a photocathode adapted to convert an incident flux of photons into a stream of electrons;
  • a sensor consisting of a matrix of elements, called pixels; and
  • processing means.

Selon l'invention :

  • le dispositif comprend une matrice de filtres élémentaires, chacun associé à au moins un pixel du capteur, ladite matrice étant disposée en amont de la photocathode, de sorte qu'un flux initial de photons traverse ladite matrice avant d'atteindre la photocathode ;
  • la matrice comprend des filtres de couleur primaire, un filtre de couleur primaire ne transmettant pas une partie du spectre visible complémentaire de ladite couleur primaire, et des filtres transmettant l'intégralité du spectre visible, dits filtres panchromatiques ; et
  • les moyens de traitement sont adaptés à :
    • calculer une grandeur, dite grandeur utile, pour déterminer si au moins une zone du capteur est dans des conditions de faible ou de fort éclairement, la grandeur utile étant représentative d'un flux surfacique moyen de photons ou d'électrons détecté sur un ensemble de pixels dits panchromatiques du capteur, chaque pixel panchromatique étant associé à un filtre panchromatique ;
    • uniquement si ladite zone est dans des conditions de fort éclairement, former une image couleur de ladite zone à partir des pixels de cette zone associés à des filtres de couleur primaire.
According to the invention:
  • the device comprises a matrix of elementary filters, each associated with at least one pixel of the sensor, said matrix being arranged upstream of the photocathode, so that an initial photon flux passes through said matrix before reaching the photocathode;
  • the matrix comprises primary color filters, a primary color filter not transmitting a part of the visible spectrum complementary to said primary color, and filters transmitting the entire visible spectrum, called panchromatic filters; and
  • the treatment means are adapted to:
    • calculating a quantity, called useful quantity, to determine if at least one zone of the sensor is in conditions of low or high illumination, the useful quantity being representative of an average surface flux of photons or electrons detected on a set of so-called panchromatic pixels of the sensor, each panchromatic pixel being associated with a panchromatic filter;
    • only if said zone is in conditions of high illumination, forming a color image of said zone from the pixels of this zone associated with primary color filters.

Selon un mode de réalisation avantageux, la photocathode est disposée à l'intérieur d'une chambre à vide, et la matrice de filtres élémentaires est située sur une fenêtre d'entrée de ladite chambre à vide.According to an advantageous embodiment, the photocathode is disposed inside a vacuum chamber, and the matrix of elementary filters is located on an inlet window of said vacuum chamber.

En variante, la photocathode est disposée à l'intérieur d'une chambre à vide fermée par un faisceau de fibres optiques, et chaque filtre élémentaire de la matrice de filtres élémentaires est déposé sur une extrémité d'une fibre optique dudit faisceau.In a variant, the photocathode is placed inside a closed vacuum chamber by a bundle of optical fibers, and each elementary filter of the matrix of elementary filters is deposited on an end of an optical fiber of said bundle.

Le capteur peut être un capteur photosensible, les moyens de traitement peuvent être adaptés à calculer une grandeur représentative d'un flux surfacique moyen de photons, et le dispositif peut comprend en outre :

  • des moyens de multiplication, adaptés à recevoir le flux d'électrons émis par la photocathode, et à fournir en réponse un flux secondaire d'électrons ; et
  • un écran phosphore, adapté à recevoir le flux secondaire d'électrons et à fournir en réponse un flux de photons, dit flux utile de photons, le capteur étant agencé pour recevoir ledit flux utile de photons.
The sensor may be a photosensitive sensor, the processing means may be adapted to calculate a magnitude representative of an average surface flux of photons, and the device may furthermore comprise:
  • multiplication means, adapted to receive the electron flow emitted by the photocathode, and to provide in response a secondary electron flow; and
  • a phosphor screen, adapted to receive the secondary electron flux and to provide in response a photon flux, said useful photon flux, the sensor being arranged to receive said useful photon flux.

En variante, le capteur peut être un capteur sensible aux électrons, adapté à recevoir le flux d'électrons émis par la photocathode, et les moyens de traitement peuvent être adaptés à calculer une grandeur représentative d'un flux surfacique moyen d'électrons.In a variant, the sensor may be an electron-sensitive sensor adapted to receive the electron flux emitted by the photocathode, and the processing means may be adapted to calculate a magnitude representative of an average electron surface flux.

De préférence, les filtres panchromatiques représentent 75% des filtres élémentaires.Preferably, the panchromatic filters represent 75% of the elementary filters.

La matrice de filtres élémentaires est avantageusement générée par la répétition périodique bidimensionnelle du motif suivant : M = R W G W W W W W G W B W W W W W

Figure imgb0001
où R, G, B représentent respectivement des filtres de couleur primaire rouge, vert, bleu, et W représente un filtre panchromatique, le motif étant défini à une permutation près de R, G, B.The matrix of elementary filters is advantageously generated by the two-dimensional periodic repetition of the following pattern: M = R W BOY WUT W W W W W BOY WUT W B W W W W W
Figure imgb0001
where R, G, B represent red, green, blue primary color filters, and W represents a panchromatic filter, the pattern being defined at a permutation near R, G, B.

En variante, la matrice de filtres élémentaires peut être générée par la répétition périodique bidimensionnelle du motif suivant : M = Ye W Ma W W W W W Ma W Cy W W W W W

Figure imgb0002
où Ye, Ma, Cy représentent respectivement des filtres de couleur primaire jaune, magenta et cyan, et W représente un filtre panchromatique, le motif étant défini à une permutation près de Ye, Ma, Cy.As a variant, the matrix of elementary filters can be generated by the two-dimensional periodic repetition of the following pattern: M = Ye W My W W W W W My W Cy W W W W W
Figure imgb0002
where Ye, Ma, Cy respectively represent primary yellow, magenta and cyan primary color filters, and W represents a panchromatic filter, the pattern being defined at a permutation near Ye, Ma, Cy.

De préférence, les moyens de traitement sont adaptés à :

  • déterminer que ladite zone est à faible éclairement, si la grandeur utile est inférieure à un premier seuil ; et
  • déterminer que ladite zone est à fort éclairement, si la grandeur utile est supérieure à un second seuil, le second seuil étant supérieur au premier seuil.
Preferably, the treatment means are adapted to:
  • determining that said zone is at low illumination, if the useful magnitude is less than a first threshold; and
  • determining that said zone is at high illumination, if the useful magnitude is greater than a second threshold, the second threshold being greater than the first threshold.

Si la grandeur utile est comprise entre les premier et second seuils, les moyens de traitement sont avantageusement adaptés à combiner une image monochrome et l'image couleur de ladite zone, l'image monochrome de ladite zone étant obtenue à partir des pixels panchromatiques de cette zone.If the useful magnitude is between the first and second thresholds, the processing means are advantageously adapted to combining a monochrome image and the color image of said zone, the monochrome image of said zone being obtained from the panchromatic pixels of this zone. zoned.

De préférence, les moyens de traitement sont adaptés à :

  • former une image monochrome à partir de l'ensemble des pixels panchromatiques du capteur;
  • segmenter cette image monochrome en régions homogènes ; et
  • pour chaque zone du capteur associée à une région homogène, calculer indépendamment la grandeur utile correspondante pour déterminer si ladite zone est dans des conditions de faible ou de fort éclairement.
Preferably, the treatment means are adapted to:
  • forming a monochrome image from all the panchromatic pixels of the sensor;
  • segment this monochrome image into homogeneous regions; and
  • for each zone of the sensor associated with a homogeneous region, independently calculating the corresponding useful magnitude to determine whether said zone is in low or high illumination conditions.

La matrice de filtres élémentaires peut comprendre en outre des filtres infrarouges ne transmettant pas la partie visible du spectre, à chaque filtre infrarouge étant associé au moins un pixel du capteur dit pixel infrarouge.The matrix of elementary filters may furthermore comprise infrared filters that do not transmit the visible part of the spectrum, with each infrared filter being associated with at least one pixel of the so-called infrared pixel sensor.

Lorsqu'une zone est dans des conditions de faible éclairement, les moyens de traitement sont avantageusement adaptés à :

  • comparer un seuil infrarouge prédéterminé et une grandeur, dite grandeur secondaire, représentative d'un flux surfacique moyen de photons ou d'électrons détecté par les pixels infrarouges de cette zone ;
  • lorsque ladite grandeur secondaire est supérieure au seuil infrarouge prédéterminé, superposer une image monochrome obtenue à partir des pixels panchromatiques de cette zone et une image en fausse couleur obtenue à partir des pixels infrarouges de cette zone.
When a zone is in conditions of low illumination, the processing means are advantageously adapted to:
  • comparing a predetermined infrared threshold and a magnitude, called secondary magnitude, representative of an average surface flux of photons or electrons detected by the infrared pixels of this zone;
  • when said secondary quantity is greater than the predetermined infrared threshold, superimpose a monochrome image obtained from the panchromatic pixels of this zone and a false-color image obtained from the infrared pixels of this zone.

En variante, lorsqu'une zone est dans des conditions de faible éclairement, les moyens de traitement sont avantageusement adaptés à :

  • à partir des pixels infrarouges de cette zone, identifier des sous-zones de cette zone, détectant un flux surfacique moyen de photons ou d'électrons homogène dans le spectre infrarouge ;
  • pour chaque sous-zone ainsi identifiée, comparer un seuil infrarouge prédéterminé et une grandeur, dite grandeur secondaire, représentative d'un flux surfacique moyen de photons ou d'électrons détecté par les pixels infrarouges de cette sous-zone ;
  • lorsque ladite grandeur secondaire est supérieure au seuil infrarouge prédéterminé, superposer une image monochrome obtenue à partir des pixels panchromatiques de cette sous-zone et une image en fausse couleur obtenue à partir des pixels infrarouges de cette sous-zone.
In a variant, when a zone is in conditions of low illumination, the processing means are advantageously adapted to:
  • from the infrared pixels of this zone, identify sub-zones of this zone, detecting an average surface flux of photons or electrons homogeneous in the infrared spectrum;
  • for each sub-zone thus identified, comparing a predetermined infrared threshold and a quantity, called secondary quantity, representative of an average surface flux of photons or electrons detected by the infrared pixels of this sub-zone;
  • when said secondary quantity is greater than the infrared threshold predetermined, superimpose a monochrome image obtained from the panchromatic pixels of this sub-area and a false-color image obtained from the infrared pixels of this sub-area.

La matrice de filtres élémentaires peut consister en une image projetée par un système optique de projection.The matrix of elementary filters may consist of an image projected by a projection optical system.

L'invention concerne également un procédé de formation d'une image, mis en oeuvre dans un dispositif comprenant une photocathode adaptée à convertir un flux incident de photons en un flux d'électrons, et un capteur constitué d'une matrice d'éléments, dits pixels, le procédé comprenant les étapes suivantes :

  • filtrage d'un flux initial de photons, pour fournir ledit flux incident de photons, ce filtrage mettant en oeuvre une matrice de filtres élémentaires comprenant des filtres de couleur primaire, un filtre de couleur primaire ne transmettant pas une partie du spectre visible complémentaire de ladite couleur primaire, et des filtres transmettant l'intégralité du spectre visible, dits filtres panchromatiques ;
  • calcul d'une grandeur, dite grandeur utile, pour déterminer si au moins une zone du capteur est dans des conditions de faible ou de fort éclairement, la grandeur utile étant représentative d'un flux surfacique moyen de photons ou d'électrons détecté sur un ensemble de pixels dits panchromatiques du capteur, chaque pixel panchromatique étant associé à un filtre panchromatique ;
  • uniquement si ladite zone est dans des conditions de fort éclairement, formation d'une image couleur de ladite zone à partir des pixels de cette zone associés à des filtres de couleur primaire.
The invention also relates to a method for forming an image, implemented in a device comprising a photocathode adapted to convert an incident flux of photons into an electron flow, and a sensor constituted by a matrix of elements, said pixels, the method comprising the following steps:
  • filtering an initial photon flux, to provide said incident photon flux, this filtering implementing a matrix of elementary filters comprising primary color filters, a primary color filter not transmitting a part of the complementary visible spectrum of said primary color, and filters transmitting the entire visible spectrum, called panchromatic filters;
  • calculating a quantity, called useful quantity, to determine if at least one zone of the sensor is in conditions of low or high illumination, the useful quantity being representative of an average surface flux of photons or electrons detected on a set of so-called panchromatic pixels of the sensor, each panchromatic pixel being associated with a panchromatic filter;
  • only if said zone is in conditions of high illumination, forming a color image of said zone from the pixels of this zone associated with primary color filters.

BRÈVE DESCRIPTION DES DESSINSBRIEF DESCRIPTION OF THE DRAWINGS

La présente invention sera mieux comprise à la lecture de la description d'exemples de réalisation donnés à titre purement indicatif et nullement limitatif, en faisant référence aux dessins annexés sur lesquels :

  • la figure 1 illustre de manière schématique le principe d'un dispositif selon l'invention ;
  • la figure 2 illustre de manière schématique un premier mode de réalisation d'un traitement mis en oeuvre par les moyens de traitement selon l'invention ;
  • les figures 3A et 3B illustrent de manière schématique deux variantes d'un premier mode de réalisation d'une matrice de filtres élémentaires selon l'invention ;
  • la figure 4 illustre de manière schématique un premier mode de réalisation d'un dispositif selon l'invention ;
  • les figures 5A et 5B illustrent de manière schématique deux variantes d'un deuxième mode de réalisation d'un dispositif selon l'invention ;
  • la figure 6 illustre de manière schématique un deuxième mode de réalisation d'une matrice de filtres élémentaires selon l'invention ; et
  • la figure 7 illustre de manière schématique un deuxième mode de réalisation d'un traitement mis en oeuvre par les moyens de traitement selon l'invention.
The present invention will be better understood on reading the description of exemplary embodiments given purely by way of indication and in no way limiting, with reference to the appended drawings in which:
  • the figure 1 schematically illustrates the principle of a device according to the invention;
  • the figure 2 schematically illustrates a first embodiment of a treatment implemented by the processing means according to the invention;
  • the Figures 3A and 3B illustrate schematically two variants of a first embodiment of a matrix of elementary filters according to the invention;
  • the figure 4 schematically illustrates a first embodiment of a device according to the invention;
  • the Figures 5A and 5B illustrate schematically two variants of a second embodiment of a device according to the invention;
  • the figure 6 schematically illustrates a second embodiment of a matrix of elementary filters according to the invention; and
  • the figure 7 schematically illustrates a second embodiment of a treatment implemented by the processing means according to the invention.

EXPOSÉ DÉTAILLÉ DE MODES DE RÉALISATION PARTICULIERSDETAILED PRESENTATION OF PARTICULAR EMBODIMENTS

La figure 1 illustre de manière schématique le principe d'un dispositif d'acquisition d'images 100 selon l'invention.The figure 1 schematically illustrates the principle of an image acquisition device 100 according to the invention.

Le dispositif 100 comprend une photocathode 120, fonctionnant comme décrit en introduction, ainsi qu'une matrice 110 de filtres élémentaires 111 située en amont de la photocathode. On utilise par exemple une photocathode GaAs (arséniure de gallium). On pourra utiliser tout autre type de photocathode, en particulier des photocathodes sensibles dans un spectre de longueurs d'onde le plus large possible, incluant le visible (environ 400 à 800 nm), et le cas échéant le proche infra-rouge voire même l'infra-rouge, et/ou le proche UV (ultra-violet), voire même l'UV.The device 100 comprises a photocathode 120, operating as described in the introduction, and a matrix 110 of elementary filters 111 located upstream of the photocathode. For example, a GaAs photocathode is used. (gallium arsenide). Any other type of photocathode, in particular sensitive photocathodes, can be used in a widest wavelength spectrum, including the visible (about 400 to 800 nm), and possibly the near infra-red or even the same. infra-red, and / or the near UV (ultraviolet), or even the UV.

Chaque filtre élémentaire 111 filtre la lumière incidente sur un emplacement de la photocathode 120. Chaque filtre élémentaire 111 définit ainsi un pixel sur la photocathode 120.Each elementary filter 111 filters the incident light at a location of the photocathode 120. Each elementary filter 111 thus defines a pixel on the photocathode 120.

Les filtres élémentaires 111 sont des filtres de transmission d'au moins deux catégories différentes : des filtres de couleur primaire, et des filtres transparents (ou panchromatiques).The elementary filters 111 are transmission filters of at least two different categories: primary color filters, and transparent (or panchromatic) filters.

Un filtre élémentaire de couleur primaire est défini en introduction. Les filtres élémentaires de la matrice 110 comprennent trois types de filtres de couleur primaire, c'est-à-dire des filtres de trois couleurs primaires. Cela permet une synthèse additive ou soustractive de toutes les couleurs du spectre visible. En particulier, chaque type de filtre de couleur primaire transmet une partie seulement du spectre visible, c'est-à-dire une bande de l'intervalle de longueur d'onde 400-700 nm, et les différents types de pixels de couleur primaire couvrent ensemble tout cet intervalle. En plus d'une partie du spectre visible, chaque filtre de couleur primaire peut transmettre une partie du spectre proche infra-rouge voire infra-rouge et/ou une partie du spectre proche UV voire UV. Les filtres de couleur peuvent être des filtres rouge, vert, bleu, dans le cas d'une synthèse additive, ou des filtres jaune, magenta, cyan, dans le cas d'une synthèse soustractive. D'autres ensembles de couleurs primaires peuvent être envisagés par l'homme du métier sans sortir du cadre de la présente invention.A primary color elementary filter is defined in the introduction. The elementary filters of the matrix 110 include three types of primary color filters, i.e. filters of three primary colors. This allows an additive or subtractive synthesis of all the colors of the visible spectrum. In particular, each type of primary color filter transmits only a portion of the visible spectrum, i.e., a band of the 400-700 nm wavelength range, and the different types of primary color pixels. cover all this gap. In addition to a portion of the visible spectrum, each primary color filter can transmit a portion of the near infra-red or even infra-red spectrum and / or a portion of the near UV or UV spectrum. The color filters can be red, green, blue filters, in the case of an additive synthesis, or yellow, magenta, cyan filters, in the case of a subtractive synthesis. Other sets of primary colors may be contemplated by those skilled in the art without departing from the scope of the present invention.

Les filtres élémentaires panchromatiques laissent passer l'ensemble du spectre visible. Le cas échéant, ils peuvent également transmettre au moins une partie du spectre proche infrarouge et même infrarouge et/ou au moins une partie du spectre proche UV et même UV. Les filtres élémentaires panchromatiques peuvent être des éléments transparents dans le visible, ou des ouvertures (ou épargnes) dans la matrice 110. Dans ce deuxième cas, les pixels de la photocathode situés sous ces filtres élémentaires panchromatiques reçoivent une lumière non filtrée.The panchromatic elementary filters let pass the whole visible spectrum. Where appropriate, they may also transmit at least a portion of the near-infrared and even infrared spectrum and / or at least a portion of the near UV and even UV spectrum. Elementary filters panchromatic can be transparent elements in the visible, or openings (or savings) in the matrix 110. In this second case, the pixels of the photocathode located under these panchromatic elementary filters receive unfiltered light.

Les différents types de filtres de couleur primaire, et les filtres panchromatiques, sont répartis de façon éparse sur la matrice de filtres élémentaires.The different types of primary color filters, and the panchromatic filters, are scattered on the elementary filter matrix.

Les filtres élémentaires sont avantageusement arrangés sous la forme d'un motif se répétant de manière périodique, selon deux directions distinctes, généralement orthogonales, dans le plan de la photocathode 120. Chaque motif comprend de préférence au moins un filtre de couleur primaire de chaque type, et des filtres panchromatiques.The elementary filters are advantageously arranged in the form of a periodic repeating pattern in two distinct, generally orthogonal directions in the plane of the photocathode 120. Each pattern preferably comprises at least one primary color filter of each type. , and panchromatic filters.

Bien que l'on ait illustré des filtres élémentaires de forme carré, ceux-ci peuvent présenter toute autre forme géométrique, par exemple un hexagone, un disque, ou une surface définie en fonction de contraintes relatives à la fonction de transfert du dispositif 100 selon l'invention.Although elementary filters of square shape have been illustrated, these may have any other geometrical shape, for example a hexagon, a disk, or a surface defined according to constraints relating to the transfer function of the device 100 according to the invention.

La matrice de filtres élémentaires selon l'invention peut être réelle, ou virtuelle.The matrix of elementary filters according to the invention can be real, or virtual.

La matrice de filtres élémentaires est dite réelle lorsqu'elle comprend des filtres élémentaires présentant une certaine épaisseur, par exemple des filtres élémentaires réalisés en matériau polymère ou des filtres interférentiels.The matrix of elementary filters is said to be real when it comprises elementary filters having a certain thickness, for example elementary filters made of polymer material or interference filters.

La matrice de filtres élémentaires est dite virtuelle lorsqu'elle consiste en une image d'une deuxième matrice de filtres élémentaires, projetée en amont de la photocathode. Dans ce cas, la deuxième matrice de filtres élémentaires, consiste en une matrice réelle de filtres élémentaires. Elle est située dans le plan objet d'un système optique de projection. L'image formée dans le plan image de ce système optique de projection correspond à ladite matrice de filtres élémentaires virtuelle. Un avantage de cette variante est que l'on s'affranchit d'éventuelles difficultés de positionnement d'une matrice réelle, à l'emplacement souhaité.The matrix of elementary filters is called virtual when it consists of an image of a second matrix of elementary filters, projected upstream of the photocathode. In this case, the second matrix of elementary filters consists of a real matrix of elementary filters. It is located in the object plane of a projection optical system. The image formed in the image plane of this projection optical system corresponds to said matrix of virtual elementary filters. An advantage of this variant is that we get rid of possible difficulties in positioning an actual matrix at the desired location.

Dans l'ensemble des exemples développés en référence aux figures, on a développé l'exemple d'une matrice de filtres élémentaires réelle. On pourra envisager de nombreuses variantes, en remplaçant la matrice de filtres élémentaires réelle, par une matrice de filtres élémentaires virtuelle. De préférence, le dispositif selon l'invention comprendra alors la deuxième matrice de filtres élémentaires et le système optique de projection, tels que mentionnés ci-dessus.In the set of examples developed with reference to the figures, the example of a real elementary filter matrix has been developed. Many variants can be envisaged, by replacing the matrix of real elementary filters by a matrix of virtual elementary filters. Preferably, the device according to the invention will then comprise the second matrix of elementary filters and the projection optical system, as mentioned above.

De préférence mais de manière non limitative, la proportion de filtres élémentaires panchromatiques dans la matrice 110 est supérieure ou égale à 50%. Avantageusement, la proportion de filtres élémentaires panchromatiques est égale à 75%. Les filtres élémentaires de couleur primaire peuvent être répartis en proportions égales. En variante, les filtres élémentaires de couleur primaire sont répartis en proportions inégales. De préférence, la proportion d'un premier type de filtre de couleur primaire n'excède pas deux fois la proportion des autres types de filtres de couleur primaire. Par exemple, la proportion de filtres élémentaires panchromatiques est égale à 75%, la proportion de filtres d'une première couleur primaire est égale à 12,5%, et la proportion de filtres d'une deuxième et une troisième couleurs primaires est respectivement égale à 6,25% et 6,25%.Preferably, but in a nonlimiting manner, the proportion of panchromatic elementary filters in the matrix 110 is greater than or equal to 50%. Advantageously, the proportion of panchromatic elementary filters is equal to 75%. The elementary filters of primary color can be divided in equal proportions. As a variant, the elementary filters of primary color are distributed in unequal proportions. Preferably, the proportion of a first type of primary color filter does not exceed twice the proportion of the other types of primary color filters. For example, the proportion of panchromatic elementary filters is equal to 75%, the proportion of filters of a first primary color is equal to 12.5%, and the proportion of filters of a second and a third primary color is equal to at 6.25% and 6.25%.

La matrice 120 reçoit un flux initial de photons. A des fins illustratives, on représente des flux élémentaires initiaux de photons 101, associés chacun à un filtre élémentaire 111. Les flux élémentaires initiaux de photons 101 forment ensemble une image poly-chromatique, et peuvent comprendre des photons situés dans le spectre visible, proche infrarouge et même infrarouge.Matrix 120 receives an initial photon flux. For illustrative purposes, initial elementary fluxes of photons 101, each associated with an elementary filter 111, are represented. The initial elementary fluxes of photons 101 together form a poly-chromatic image, and may comprise photons located in the visible spectrum, which are close to one another. infrared and even infrared.

Un filtre élémentaire 111 transmet un flux élémentaire filtré 102, les flux élémentaires filtrés formant ensemble un flux de photons incident sur la photocathode. En réponse à ce flux incident de photons, la photocathode 120 émet un flux d'électrons. A chaque flux élémentaire filtré 102 correspond un flux élémentaire d'électrons 103. Un flux élémentaire d'électrons 103 est d'autant plus important que le flux élémentaire filtré 102 correspondant comporte de photons. Les flux élémentaires d'électrons 103 ne véhiculent pas directement d'information chromatique, mais dépendent directement d'un nombre de photons transmis par un filtre élémentaire 111 correspondant. Les flux élémentaires d'électrons 103 forment ensemble un flux d'électrons émis par la photocathode 120.An elementary filter 111 transmits a filtered elementary flux 102, the filtered elementary streams together forming a flux of photons incident on the photocathode. In response to this incident flux of photons, the photocathode 120 emits a stream of electrons. Each filtered elementary flux 102 corresponds to an elementary electron flux 103. An elementary electron flux 103 is all the more important that the corresponding filtered elementary flux 102 comprises photons. The elementary electron fluxes 103 do not directly convey chromatic information, but depend directly on a number of photons transmitted by a corresponding elementary filter 111. The elementary electron fluxes 103 together form a stream of electrons emitted by the photocathode 120.

Le dispositif 100 selon l'invention comprend en outre un capteur numérique 130. Comme détaillé dans la suite, le capteur 130 peut recevoir directement le flux d'électrons émis par la photocathode 120. En variante, ce flux d'électrons émis par la photocathode 120 peut être converti en un flux de photons de sorte que le capteur 130 reçoit finalement un flux de photons. La figure 1 étant une simple illustration de principe, on a représenté le capteur 130 directement à la suite de la photocathode 120. Le capteur 130 peut être un capteur sensible aux photons ou sensible aux électrons, et d'autres éléments peuvent être intercalés entre la photocathode 120 et le capteur 130.The device 100 according to the invention further comprises a digital sensor 130. As detailed below, the sensor 130 can directly receive the stream of electrons emitted by the photocathode 120. In a variant, this stream of electrons emitted by the photocathode 120 can be converted into a photon flux so that the sensor 130 finally receives a photon flux. The figure 1 being a simple illustration of principle, the sensor 130 is shown directly following the photocathode 120. The sensor 130 may be a photon-sensitive or electron-sensitive sensor, and other elements may be interposed between the photocathode 120 and the sensor 130.

Le capteur est sensible aux électrons tels qu'émis par la photocathode, ou aux photons obtenus à partir de ces électrons.The sensor is sensitive to electrons as emitted by the photocathode, or to photons obtained from these electrons.

De préférence, le capteur est sensible :

  • aux photons situés dans la bande 400-900 nm, voire 400-1100 nm, voire une bande spectrale allant de l'UV au proche infrarouge, par exemple 200-1100 nm ; ou
  • aux électrons provenant de photons situés dans cette bande. Le capteur est formé par une matrice d'éléments, dits pixels 131, sensibles aux photons ou aux électrons.
Preferably, the sensor is sensitive:
  • with photons situated in the band 400-900 nm, or even 400-1100 nm, or even a spectral band going from the UV to the near infrared, for example 200-1100 nm; or
  • electrons from photons in this band. The sensor is formed by a matrix of elements, said pixels 131, sensitive to photons or electrons.

Chaque filtre élémentaire 111 est associé à au moins un pixel 131 du capteur. En d'autres termes, chaque filtre élémentaire 111 est aligné avec au moins un pixel 131 du capteur, de sorte qu'une majeure partie d'un flux d'électrons ou de photons, résultant des photons transmis par ce filtre élémentaire 111, atteigne cet au moins un pixel 131. De préférence, chaque filtre élémentaire 111 est associé à exactement un pixel 131 du capteur. De préférence, la surface d'un filtre élémentaire 111 correspond à la surface d'un pixel 131 du capteur ou à une surface correspondant à la juxtaposition d'un nombre entier de pixels 131 du capteur.Each elementary filter 111 is associated with at least one pixel 131 of the sensor. In other words, each elementary filter 111 is aligned with at least one pixel 131 of the sensor, so that a major part of a stream of electrons or photons, resulting from the photons transmitted by this elementary filter 111, reaches this at least one pixel 131. Preferably, each elementary filter 111 is associated with exactly one pixel 131 of the sensor. Preferably, the surface of an elementary filter 111 corresponds to the surface of a pixel 131 of the sensor or to a surface corresponding to the juxtaposition of an integer number of pixels 131 of the sensor.

Puisque chaque filtre élémentaire 111 est associé à au moins un pixel 131 du capteur, on peut nommer « pixel panchromatique » un pixel du capteur associé à un filtre élémentaire panchromatique, et « pixel de couleur primaire » un pixel du capteur associé à un filtre élémentaire de couleur primaire. Les pixels panchromatiques détectent des électrons ou des photons associés à la bande spectrale transmise par les filtres panchromatiques. Chaque type de pixel de couleur primaire détecte des électrons ou des photons associés à la bande spectrale transmise par le type de filtre de couleur primaire correspondant.Since each elementary filter 111 is associated with at least one pixel 131 of the sensor, the term "panchromatic pixel" can be called a pixel of the sensor associated with a panchromatic elementary filter, and "primary color pixel" a pixel of the sensor associated with an elementary filter. of primary color. The panchromatic pixels detect electrons or photons associated with the spectral band transmitted by the panchromatic filters. Each type of primary color pixel detects electrons or photons associated with the spectral band transmitted by the corresponding primary color filter type.

Le capteur 130 est relié à des moyens de traitement 140, c'est-à-dire des moyens de calcul comprenant notamment un processeur ou un microprocesseur. Les moyens de traitement 140 reçoivent en entrée des signaux électriques fournis par le capteur 130, et correspondant, pour chaque pixel 131, au flux de photons reçu et détecté par ce pixel lorsque le capteur est sensible aux photons, ou au flux d'électrons reçu et détecté par ce pixel lorsque le capteur est sensible aux électrons. Les moyens de traitement 140 fournissent en sortie une image, correspondant aux flux initial de photons incident sur la matrice de filtres élémentaires, ce flux ayant été intensifié.The sensor 130 is connected to processing means 140, that is to say calculation means including a processor or a microprocessor. The processing means 140 receive as input electrical signals supplied by the sensor 130, and corresponding, for each pixel 131, to the stream of photons received and detected by this pixel when the sensor is sensitive to photons, or to the electron flow received. and detected by this pixel when the sensor is sensitive to electrons. The processing means 140 output an image, corresponding to the initial flux of incident photons on the matrix of elementary filters, this flux having been intensified.

Les moyens de traitement 140 sont adaptés à attribuer, à chaque pixel du capteur, une information sur un type de filtre élémentaire associé à ce pixel. Pour cela, ils stockent des informations permettant de relier chaque pixel du capteur et un type de filtre élémentaire. Ces informations peuvent se présenter sous la forme d'une matrice de déconvolution. Ainsi, l'information spectrale qui est perdue lors du passage par la photocathode, est restituée par les moyens de traitement 140.The processing means 140 are adapted to assign, to each pixel of the sensor, information on a type of elementary filter associated with this pixel. For this purpose, they store information making it possible to connect each pixel of the sensor and a type of elementary filter. This information can be in the form of a deconvolution matrix. Thus, the spectral information that is lost during the passage through the photocathode, is restored by the processing means 140.

Les moyens de traitement 140 sont adaptés à mettre en oeuvre un traitement, tel qu'illustré en figure 2.The processing means 140 are adapted to implement a treatment, as illustrated in FIG. figure 2 .

Selon le premier mode de réalisation tel que détaillé dans la suite, les moyens de traitement réalisent une image monochrome par interpolation de l'ensemble des pixels panchromatiques du capteur. On nomme cette image « image monochrome du capteur ». Ils mettent ensuite en oeuvre une segmentation du capteur en plusieurs zones, chaque zone étant homogène en termes de flux de photons ou d'électrons détecté par les pixels panchromatiques correspondants.According to the first embodiment as detailed below, the processing means realize a monochrome image by interpolation of all the panchromatic pixels of the sensor. This image is called "monochrome image of the sensor". They then implement a segmentation of the sensor in several zones, each zone being homogeneous in terms of the flux of photons or electrons detected by the corresponding panchromatic pixels.

Une telle segmentation est par exemple décrite dans l'article de S. Tripathi et al. intitulé « Image Segmentation : a review » publié dans International Journal of Computer Science and Management Research, vol. 1, N° 4, nov. 2012, pp. 838-843 .Such a segmentation is for example described in the article of S. Tripathi et al. entitled "Image Segmentation: A Review" published in International Journal of Computer Science and Management Research, Vol. 1, No. 4, Nov. 2012, pp. 838-843 .

Les moyens de traitement mettent ensuite en oeuvre les étapes suivantes.The processing means then implement the following steps.

Dans une première étape 280, on estime une grandeur F , représentative d'un flux surfacique moyen de photons ou d'électrons reçu et détecté par les pixels panchromatiques d'une zone du capteur, sensible respectivement aux photons ou aux électrons.In a first step 280, a magnitude is estimated F , representative of an average surface flux of photons or electrons received and detected by the panchromatic pixels of an area of the sensor, sensitive respectively to photons or electrons.

Cette grandeur est nommée « grandeur utile ». La grandeur utile peut être égale audit flux surfacique moyen de photons ou d'électrons. Si le capteur 130 est sensible aux photons, la grandeur utile peut être une luminance moyenne sur les pixels panchromatiques de la zone du capteur. Ainsi, la grandeur utile peut être un flux surfacique moyen de photons ou d'électrons détecté sur un ensemble de pixels dits panchromatiques du capteur.This quantity is called "useful size". The useful magnitude may be equal to the average surface flux of photons or electrons. If the sensor 130 is sensitive to photons, the useful magnitude may be an average luminance on the panchromatic pixels of the sensor area. Thus, the useful magnitude may be an average surface flux of photons or electrons detected on a set of so-called panchromatic pixels of the sensor.

On peut donc considérer que la grandeur utile fournit une mesure de l'éclairement sur ladite zone du capteur.It can therefore be considered that the useful quantity provides a measurement of the illumination on said sensor zone.

Des conditions de faible éclairement sont associées à une faible valeur de la grandeur utile (en valeur absolue). Des conditions de fort éclairement sont associées à une valeur élevée de la grandeur utile (en valeur absolue).Low light conditions are associated with a low value of the useful size (in absolute value). Conditions of high illumination are associated with a high value of the useful size (in absolute value).

Des conditions de fort éclairement sont associées par exemple à un éclairement lumineux supérieur à un premier seuil compris entre 450 et 550 µLux. Des conditions de faible éclairement sont associées par exemple à un éclairement lumineux inférieur à un second seuil compris entre 400 et 550 µLux, le premier et le second seuil pouvant être égaux. Si le premier et le second seuil ne sont pas égaux, le premier seuil est strictement supérieur au second seuil.Conditions of high illumination are associated for example with a higher illuminance at a first threshold between 450 and 550 μLux. Conditions of low illumination are associated for example with a light illumination less than a second threshold of between 400 and 550 μLux, the first and the second threshold being equal. If the first and second thresholds are not equal, the first threshold is strictly greater than the second threshold.

Dans une deuxième étape 281, on compare la grandeur utile F et une valeur de seuil Fth. Si la grandeur utile F est supérieure à la valeur de seuil Fth, la zone du capteur se trouve dans des conditions de fort éclairement. Si la grandeur utile F est inférieure à la valeur de seuil Fth , la zone du capteur se trouve dans des conditions de faible éclairement.In a second step 281, the useful magnitude is compared F and a threshold value F th . If the usefulness F is greater than the threshold value F th , the sensor zone is in conditions of high illumination. If the usefulness F is below the threshold value F th , the sensor area is in low light conditions.

Les étapes 280 et 281 forment ensemble une étape pour déterminer si la zone du capteur 130 est dans des conditions de faible ou de fort éclairement.Steps 280 and 281 together form a step to determine whether the sensor zone 130 is in low or high light conditions.

Un fort éclairement correspond par exemple à l'acquisition d'une image d'une scène de nuit, éclairée par la lune (niveau de nuit 1 à 3). Un faible éclairement correspond par exemple à l'acquisition d'une image d'une scène de nuit, non éclairée par la lune (niveau de nuit 4 à 5, soit un éclairement lumineux inférieur à 500 µLux).A strong illumination corresponds for example to the acquisition of an image of a night scene, illuminated by the moon (night level 1 to 3). A low illumination corresponds for example to the acquisition of an image of a night scene, not illuminated by the moon (night level 4 to 5, or a luminous illumination less than 500 μLux).

Si la zone se trouve dans des conditions de fort éclairement, on forme une image couleur de cette zone en utilisant les pixels de couleur primaire de cette zone (étape 282A). On dit que le dispositif fonctionne en mode de fort éclairement.If the area is under high illumination conditions, a color image of this area is formed using the primary color pixels of this area (step 282A). It is said that the device operates in high illumination mode.

En particulier, on forme une image de chaque couleur primaire, et on combine entre elles les images de chaque couleur primaire. On forme une image d'une couleur primaire, par interpolation des pixels de cette zone associés à ladite couleur primaire. L'interpolation permet de palier à la faible proportion de pixels du capteur d'une couleur primaire donnée. L'interpolation des pixels d'une couleur primaire consiste à utiliser les valeurs prises par ces pixels pour estimer les valeurs qui seraient prises par les pixels voisins si ceux-ci étaient également des pixels de cette couleur primaire.In particular, an image is formed of each primary color, and the images of each primary color are combined with each other. An image of a primary color is formed by interpolating the pixels of this area associated with said primary color. The interpolation makes it possible to compensate for the small proportion of pixels of the sensor of a given primary color. The interpolation of the pixels of a primary color is to use the values taken by these pixels to estimate the values that would be taken by the neighboring pixels if these were also pixels of this primary color.

Les images de couleur primaire peuvent faire l'objet d'un traitement optionnel pour améliorer leur netteté (image sharpening). Par exemple, on peut obtenir une image monochrome de la zone en interpolant les pixels panchromatiques de cette zone, et combiner cette image monochrome, le cas échéant après filtrage passe-haut, avec chaque image de couleur primaire de la même zone. La proportion de pixels panchromatiques dans la matrice étant plus élevée que celle des pixels de couleur primaire, la résolution des images de couleur primaire s'en trouve ainsi améliorée.Primary color images can be optionally processed to sharpen image sharpening . For example, one can obtain a monochrome image of the area by interpolating the panchromatic pixels of this area, and combine this monochrome image, where appropriate after high-pass filtering, with each primary color image of the same area. As the proportion of panchromatic pixels in the matrix is higher than that of the primary color pixels, the resolution of the primary color images is thus improved.

Si la zone se trouve dans des conditions de faible éclairement, on forme une image monochrome de ladite zone à partir des pixels panchromatiques de cette zone. En particulier, on forme une image monochrome en utilisant les pixels panchromatiques de cette zone (étape 282B), et sans utiliser les pixels de couleur primaire de cette zone. Là encore, l'image monochrome peut être obtenue par interpolation des pixels panchromatiques de cette zone. On dit que le dispositif fonctionne en mode de faible éclairement.If the zone is in low illumination conditions, a monochrome image of said zone is formed from the panchromatic pixels of this zone. In particular, a monochrome image is formed using the panchromatic pixels of this area (step 282B), and without using the primary color pixels of this area. Here again, the monochrome image can be obtained by interpolation of the panchromatic pixels of this zone. The device is said to operate in low illumination mode.

Il est important de noter que la distinction entre faible éclairement et fort éclairement repose sur une mesure obtenue à partir des pixels panchromatiques du capteur, donc pour la totalité du spectre détecté par un tel capteur c'est-à-dire pour au moins la totalité du spectre visible.It is important to note that the distinction between low illumination and high illumination is based on a measurement obtained from the panchromatic pixels of the sensor, therefore for the entire spectrum detected by such a sensor that is to say for at least all visible spectrum.

On réalise ces étapes pour chaque zone du capteur précédemment identifiée.These steps are performed for each zone of the previously identified sensor.

Ensuite, les images couleur ou monochrome des différentes zones du capteur sont combinées pour obtenir une image de la totalité du capteur. L'image de la totalité du capteur peut être affichée, ou stockée dans une mémoire pour un traitement ultérieur.Then, the color or monochrome images of the different areas of the sensor are combined to obtain an image of the entire sensor. The image of the entire sensor can be displayed, or stored in memory for further processing.

En variante, on forme une image couleur de chaque zone de fort éclairement, puis, dans l'image monochrome du capteur utilisée pour la segmentation, on remplace les zones correspondant à ces zones de fort éclairement par les images couleur de ces zones.Alternatively, a color image of each zone of strong is formed illumination, then, in the monochrome image of the sensor used for segmentation, the areas corresponding to these zones of high illumination are replaced by the color images of these zones.

Selon une autre variante, on effectue une combinaison linéaire de l'image monochrome du capteur et de ces images couleur. Ainsi, dans les régions à fort éclairement, on superpose l'image couleur et l'image monochrome.According to another variant, a linear combination of the monochrome image of the sensor and these color images is performed. Thus, in high-light regions, the color image and the monochrome image are superimposed.

Dans l'exemple qui vient d'être décrit, on traite séparément des zones du capteur. En variante, on détermine si la totalité du capteur est dans des conditions de faible ou de fort éclairement, et on traite de la même façon la totalité du capteur. Dans ce cas, il n'y a pas de segmentation de l'image monochrome du capteur, ni de combinaison des images obtenues. On met en oeuvre les étapes 280, 281 et 282A ou 282B sur la totalité de la surface du capteur. En d'autres termes, la zone du capteur telle que mentionnée précédemment correspond à la totalité du capteur.In the example just described, the zones of the sensor are treated separately. Alternatively, it is determined whether the entire sensor is in conditions of low or high illumination, and is treated in the same way the entire sensor. In this case, there is no segmentation of the monochrome image of the sensor, or combination of the images obtained. Steps 280, 281 and 282A or 282B are implemented over the entire surface of the sensor. In other words, the sensor zone as mentioned above corresponds to the entire sensor.

Ainsi, les moyens de traitement 140 reçoivent en entrée des signaux provenant du capteur, stockent des informations permettant d'associer chaque pixel du capteur avec un type de filtre élémentaire, et fournissent en sortie une image couleur, ou une image monochrome ou une combinaison d'une image couleur et une image monochrome.Thus, the processing means 140 receive as input signals from the sensor, store information for associating each pixel of the sensor with a type of elementary filter, and output a color image, or a monochrome image or a combination of a color image and a monochrome image.

L'invention offre ainsi un dispositif d'acquisition d'images permettant d'acquérir une image couleur d'une zone du capteur, lorsque l'éclairement de la scène détectée sur cette zone le permet. Lorsque cet éclairement devient insuffisant, le dispositif fournit une image de la zone obtenue à partir des filtres élémentaires panchromatiques, donc avec une perte énergétique minimale. Le dispositif sélectionne automatiquement l'un ou l'autre mode de fonctionnement.The invention thus provides an image acquisition device for acquiring a color image of an area of the sensor, when the illumination of the scene detected on this area allows it. When this illumination becomes insufficient, the device provides an image of the area obtained from the panchromatic elementary filters, thus with a minimal energy loss. The device automatically selects one or the other mode of operation.

On remarque qu'aucune deuxième matrice de filtres élémentaires n'est présente sur le capteur 130, puisqu'il suffit de prendre en compte, lors du traitement, le fait que tel ou tel pixel du capteur est associé à tel ou tel filtre élémentaire situé en amont de la photocathode. On réalise ainsi un dispositif d'acquisition d'images présentant une grande efficacité énergétique.Note that no second matrix of elementary filters is present on the sensor 130, since it suffices to take into account, during processing, the fact that a particular sensor pixel is associated with such or such elementary filter located upstream of the photocathode. A device is thus produced image acquisition with high energy efficiency.

Selon une première variante de ce premier mode de réalisation, le basculement d'un mode à l'autre opère avec hystérésis de manière à éviter tout bruit de commutation (chattering). Pour ce faire, un premier seuil pour la grandeur utile est prévu pour la transition du mode fort éclairement vers le mode faible éclairement et un second seuil pour la grandeur utile est prévu pour la transition inverse, le premier seuil étant choisi inférieur au second seuil.According to a first variant of this first embodiment, switching from one mode to another operates with hysteresis so as to avoid any switching noise ( chattering ). To do this, a first threshold for the useful magnitude is provided for the transition from the high illumination mode to the low illumination mode and a second threshold for the useful magnitude is provided for the inverse transition, the first threshold being chosen lower than the second threshold.

Selon une seconde variante du premier mode de réalisation, le basculement d'un mode à l'autre se fait progressivement en passant par une phase de transition. Ainsi, le dispositif d'acquisition d'images fonctionne en mode faible éclairement lorsque la grandeur utile est inférieure à un premier seuil et en mode fort éclairement lorsqu'elle est supérieure à un second seuil, le second seuil étant choisi supérieur au premier seuil. Lorsque la grandeur utile est comprise entre les premier et second seuils, le dispositif d'acquisition d'images effectue une combinaison linéaire de l'image obtenue par le traitement en mode fort éclairement et de celle obtenue par le traitement en mode faible éclairement, les coefficients de pondération étant donnés par les écarts de la grandeur utile avec les premier et second seuils respectivement.According to a second variant of the first embodiment, the switching from one mode to the other is done progressively through a transition phase. Thus, the image acquisition device operates in low illumination mode when the useful magnitude is less than a first threshold and in high illumination mode when it is greater than a second threshold, the second threshold being chosen greater than the first threshold. When the useful magnitude is between the first and second thresholds, the image acquisition device performs a linear combination of the image obtained by the treatment in high illumination mode and that obtained by the low light mode treatment, the weighting coefficients being given by the deviations of the useful magnitude with the first and second thresholds respectively.

Idéalement, chaque filtre élémentaire 111 est aligné avec au moins un pixel 131 du capteur, de sorte que chaque pixel du capteur associé à un filtre élémentaire ne reçoit que des photons ou électrons correspondant à ce filtre élémentaire. Il peut cependant se produire un étalement spatial à la traversée du dispositif selon l'invention, notamment un étalement spatial du flux d'électrons émis par la photocathode. On peut parer à cet inconvénient par une étape initiale de calibration permettant de compenser ensuite les défauts d'alignement entre un filtre élémentaire et un pixel du capteur. Cette calibration vise à compenser la dégradation légère due à la fonction de transfert des éléments optiques du dispositif selon l'invention (photocathode et le cas échéant moyens de multiplication et écran phosphore). Au cours de cette calibration, on éclaire la matrice de filtres élémentaires tour à tour avec différents faisceaux lumineux monochromatiques (correspondant chacun à l'une des couleurs primaires des filtres de couleur primaire), et on mesure le signal reçu par le capteur 130. On en déduit une matrice de déconvolution, qui est stockée par les moyens de traitement 140. En fonctionnement, les moyens de traitement 140 multiplient les signaux transmis par le capteur par cette matrice de déconvolution. Ainsi, après multiplication par la matrice de déconvolution, on a reconstruit les signaux tels qu'ils seraient transmis par le capteur dans des conditions idéales, sans étalement spatial. Chaque filtre de couleur primaire (et le cas échéant chaque filtre infra-rouge, voir plus loin) est de préférence entièrement entouré par des filtres panchromatiques. Ainsi, en cas d'étalement spatial du flux d'électrons émis par la photocathode, la calibration est simplifiée.Ideally, each elementary filter 111 is aligned with at least one pixel 131 of the sensor, so that each pixel of the sensor associated with an elementary filter receives only photons or electrons corresponding to this elementary filter. However, there may be a spatial spreading through the device according to the invention, including a spatial spread of the electron flow emitted by the photocathode. This disadvantage can be countered by an initial calibration step making it possible to compensate for the misalignment between an elementary filter and a sensor pixel. This calibration aims to compensate for the slight degradation due to the transfer function of the optical elements of the device according to the invention (photocathode and, if appropriate, multiplication means and phosphor screen). During this calibration, we illuminate the matrix of elementary filters in turn with different monochromatic light beams (each corresponding to one of the primary colors of the primary color filters), and the signal received by the sensor 130 is measured. A deconvolution matrix, which is stored by the processing means 140. In operation, the processing means 140 multiply the signals transmitted by the sensor by this deconvolution matrix. Thus, after multiplication by the deconvolution matrix, the signals were reconstructed as they would be transmitted by the sensor under ideal conditions, without spatial spreading. Each primary color filter (and optionally each infra-red filter, see below) is preferably entirely surrounded by panchromatic filters. Thus, in the case of spatial spreading of the electron flux emitted by the photocathode, the calibration is simplified.

En variante ou en complément, on calibre la forme géométrique des filtres composant la matrice de filtres élémentaires de façon à compenser l'effet dudit étalement spatial. Après déformation par les éléments optiques du dispositif selon l'invention (photocathode et le cas échéant moyens de multiplication et écran phosphore), l'image d'un filtre élémentaire se superpose alors parfaitement sur un ou plusieurs pixels du capteur.Alternatively or additionally, the geometric shape of the filters composing the matrix of elementary filters is calibrated so as to compensate for the effect of said spatial spread. After deformation by the optical elements of the device according to the invention (photocathode and, if appropriate, multiplication means and phosphor screen), the image of an elementary filter is then superimposed perfectly on one or more pixels of the sensor.

Des interstices entre des filtres élémentaires voisins sont avantageusement opaques, afin de bloquer tout rayonnement susceptible sinon d'atteindre la photocathode sans avoir traversé un filtre élémentaire.Interstices between adjacent elementary filters are advantageously opaque, in order to block any radiation likely to reach the photocathode without having passed through an elementary filter.

Les figures 3A et 3B illustrent de manière schématique deux variantes d'un premier mode de réalisation d'une matrice 110 de filtres élémentaires selon l'invention.The Figures 3A and 3B schematically illustrate two variants of a first embodiment of a matrix 110 of elementary filters according to the invention.

Sur la figure 3A, les filtres élémentaires de couleur primaire sont des filtres rouges (R), verts (G) ou bleus (B). La matrice présente 75% de filtres panchromatiques (W).On the figure 3A Primary elementary filters are red (R), green (G) or blue (B) filters. The matrix has 75% panchromatic filters (W).

La matrice 110 est générée par une répétition périodique bidimensionnelle du motif de base 4x4 : R W G W W W W W G W B W W W W W

Figure imgb0003
The matrix 110 is generated by a two-dimensional periodic repetition of the 4x4 basic pattern: R W BOY WUT W W W W W BOY WUT W B W W W W W
Figure imgb0003

Des variantes de cette matrice peuvent être obtenues par permutation des filtres R, G, B dans le motif (1). Les pixels verts sont deux fois plus nombreux que les pixels rouges, respectivement bleus. Ce déséquilibre peut être corrigé par des coefficients de pondération adaptés lors de la combinaison de trois images de couleur primaire pour former une image couleur.Variations of this matrix can be obtained by permutation of the filters R, G, B in the pattern (1). The green pixels are twice as many as the red pixels, respectively blue. This imbalance can be corrected by weighting coefficients adapted when combining three primary color images to form a color image.

La matrice de la figure 3B correspond à la matrice de la figure 3A, dans laquelle les filtres élémentaires de couleur primaire R, G, B sont remplacés respectivement par des filtres élémentaires de couleur primaire jaunes (Ye), magentas (Ma), cyans (Cy). Là-encore, les filtres Ye, Ma, Cy peuvent être permutés.The matrix of the figure 3B corresponds to the matrix of the figure 3A , in which the primary color elementary filters R, G, B are replaced respectively by elementary primary color filters yellow (Ye), magentas (Ma), cyans (Cy). Again, the filters Ye, Ma, Cy can be switched.

Selon une variante non représentée de la matrice représentée en figure 3A, les filtres panchromatiques représentant 50% des filtres élémentaires, et le motif élémentaire est le suivant : W R W G R W X W W G W B Y W B W

Figure imgb0004
avec X=R, G ou B, Y=R, G ou B, et Y≠X.According to a non-represented variant of the matrix represented in figure 3A , the panchromatic filters representing 50% of the elementary filters, and the elementary pattern is as follows: W R W BOY WUT R W X W W BOY WUT W B Y W B W
Figure imgb0004
with X = R, G or B, Y = R, G or B, and Y ≠ X.

Là-encore, les filtres R, G, B peuvent être permutés.Again, the filters R, G, B can be switched.

En variante, les filtres R, G, B du motif (2) sont remplacés par des filtres Ye, Ma, Cy.Alternatively, the filters R, G, B of the pattern (2) are replaced by filters Ye, Ma, Cy.

La figure 4 illustre de manière schématique un premier mode de réalisation d'un dispositif 400 selon l'invention. La figure 4 ne sera décrite que pour ses différences relativement à la figure 1. Le recours à une étape de calibration telle que détaillée ci-avant, est particulièrement avantageux dans ce mode de réalisation.The figure 4 schematically illustrates a first embodiment of a device 400 according to the invention. The figure 4 will only be described for its differences in the figure 1 . The use of a calibration step such that detailed above, is particularly advantageous in this embodiment.

Le dispositif 400 est basé sur la technologie dite CMOS intensifié ou CCD intensifié (ICMOS ou ICCD, pour l'anglais « Intensified CMOS » ou « Intensified CCD »). The device 400 is based on the so-called intensified CMOS or intensified CCD technology (ICMOS or ICCD, for the English " Intensified CMOS" or " Intensified CCD").

La photocathode 420 est disposée à l'intérieur d'un tube à vide 450, du type du tube à vide d'un tube intensificateur d'image selon l'art antérieur et tel que décrit en introduction. Un tube à vide désigne une chambre à vide présentant plus particulièrement une forme de tube.The photocathode 420 is disposed inside a vacuum tube 450 of the vacuum tube type of an image intensifier tube according to the prior art and as described in the introduction. A vacuum tube designates a vacuum chamber having more particularly a tube shape.

Le tube à vide 450 présente une fenêtre d'entrée 451, transparente en particulier dans le visible, et le cas échéant dans le proche infrarouge voire même l'infrarouge. La fenêtre d'entrée permet de laisser entrer, à l'intérieur du tube à vide, le flux de photons incident sur la photocathode. La fenêtre d'entrée est notamment en verre. La fenêtre d'entrée est de préférence une simple plaque. La matrice de filtres élémentaires 410 est collée sur une face de la fenêtre d'entrée 451, de préférence du côté intérieur du tube à vide. La photocathode est plaquée contre la matrice de filtres élémentaires 410. Une couche métallique (non représentée) peut être déposée sur la fenêtre d'entrée, autour de la matrice de filtres élémentaires 410, afin de former un point de contact électrique pour l'application d'un champ électrostatique.The vacuum tube 450 has an inlet window 451, transparent in particular in the visible, and optionally in the near infrared or even the infrared. The input window allows to let enter, inside the vacuum tube, the flux of photons incident on the photocathode. The entrance window is in particular glass. The input window is preferably a simple plate. The matrix of elementary filters 410 is glued on one face of the inlet window 451, preferably on the inside of the vacuum tube. The photocathode is pressed against the matrix of elementary filters 410. A metal layer (not shown) may be deposited on the input window, around the matrix of elementary filters 410, to form an electrical contact point for the application. an electrostatic field.

En aval de la photocathode 420 se trouvent des moyens de multiplication 461 et un écran phosphore 462 tels que décrits en introduction.Downstream of the photocathode 420 are multiplication means 461 and a phosphor screen 462 as described in the introduction.

L'écran phosphore émet un flux de photons, dit flux utile, qui est reçu par le capteur 430. Le capteur 430 est photosensible. Il s'agit en particulier d'un capteur CCD (Charge-Coupled Device), ou un capteur CMOS (Complementary Metal Oxide Semiconductor). Sur la figure 4, le capteur 430 est représenté à l'intérieur du tube à vide, le tube étant traversé par des connexions électriques entre le capteur 430 et les moyens de traitement 440.The phosphor screen emits a stream of photons, called useful flux, which is received by the sensor 430. The sensor 430 is photosensitive. It is in particular a CCD ( Charge-Coupled Device ) sensor, or a CMOS sensor ( Complementary Metal Oxide Semiconductor ). On the figure 4 , the sensor 430 is shown inside the vacuum tube, the tube being traversed by electrical connections between the sensor 430 and the processing means 440.

Les moyens de traitement 440 fonctionnement comme décrit en référence à la figure 2, la grandeur utile étant représentative du flux surfacique de photons détecté par les pixels panchromatiques du capteur 430.The processing means 440 operates as described with reference to the figure 2 , the useful quantity being representative of the surface flux of photons detected by the panchromatic pixels of the sensor 430.

Le capteur 430 peut être au contact direct de l'écran phosphore, pour limiter un éventuel étalement spatial du faisceau de photons émis par l'écran phosphore. Dans ce cas, le capteur 430 peut être à l'intérieur du tube à vide, ou à l'extérieur et contre une face de sortie du tube à vide, formée par l'écran phosphore.The sensor 430 may be in direct contact with the phosphor screen, to limit any spatial spread of the photon beam emitted by the phosphor screen. In this case, the sensor 430 may be inside the vacuum tube, or outside and against an outlet face of the vacuum tube, formed by the phosphor screen.

Le capteur 430 peut être déporté à l'extérieur du tube à vide 450.The sensor 430 may be offset outside the vacuum tube 450.

En particulier, un faisceau de fibres optiques peut relier l'écran phosphore et les pixels du capteur 430, le faisceau de fibres optiques formant une fenêtre de sortie du tube à vide. Un tel faisceau de fibres optiques est particulièrement adapté dans le cas où la surface du capteur 430 est inférieure au diamètre intérieur du tube à vide. Dans ce cas, chaque fibre présente un diamètre du côté de l'écran phosphore supérieur à son diamètre du côté du capteur. Le faisceau de fibres optiques est dit d'amincissement, et réalise une réduction de l'image fournie par l'écran phosphore.In particular, a bundle of optical fibers can connect the phosphor screen and the pixels of the sensor 430, the bundle of optical fibers forming an exit window of the vacuum tube. Such an optical fiber bundle is particularly suitable in the case where the surface of the sensor 430 is smaller than the inside diameter of the vacuum tube. In this case, each fiber has a diameter on the phosphor screen side greater than its diameter on the sensor side. The bundle of optical fibers is said to thin, and performs a reduction of the image provided by the phosphor screen.

Les figures 5A et 5B illustrent de manière schématique deux variantes d'un deuxième mode de réalisation d'un dispositif 500 selon l'invention.The Figures 5A and 5B illustrate schematically two variants of a second embodiment of a device 500 according to the invention.

La figure 5A ne sera décrite que pour ses différences relativement à la figure 1.The Figure 5A will only be described for its differences in the figure 1 .

Le dispositif 500 est basé sur la technologie dite CMOS électro-bombardé, ou EBCMOS pour l'anglais « Electron Bombarded CMOS ». The device 500 is based on the electro-bombarded CMOS technology, or EBCMOS for the English " Electron Bombarded CMOS".

La photocathode 520 est disposée à l'intérieur d'un tube à vide 550.The photocathode 520 is disposed inside a vacuum tube 550.

Le tube à vide 550 présente une fenêtre d'entrée 551, transparente en particulier dans le visible, et le cas échéant dans le proche infrarouge voire même l'infrarouge.The vacuum tube 550 has an inlet window 551, transparent in particular in the visible, and if necessary in the near infrared or even the infrared.

La matrice de filtres élémentaires 510 est collée sur une face de la fenêtre d'entrée 551, de préférence du côté intérieur du tube à vide.The elementary filter matrix 510 is adhered to one face of the input window 551, preferably on the inside of the vacuum tube.

Le capteur 530 est disposé à l'intérieur du tube à vide 550, et reçoit directement le flux d'électrons émis par la photocathode.The sensor 530 is disposed inside the vacuum tube 550, and directly receives the stream of electrons emitted by the photocathode.

La photocathode 520 et le capteur 530 se trouvent à quelques millimètres l'un de l'autre, et soumis à une différence de potentiel pour créer un champ électrostatique dans l'interstice les séparant. Ce champ électrostatique permet d'accélérer les électrons émis par la photocathode 520, en direction du capteur 530.The photocathode 520 and the sensor 530 are within a few millimeters of each other, and subjected to a potential difference to create an electrostatic field in the interstice between them. This electrostatic field accelerates the electrons emitted by the photocathode 520 towards the sensor 530.

Le capteur 530 est sensible aux électrons. Il s'agit typiquement d'un capteur CMOS, adapté pour le rendre sensible aux électrons.The sensor 530 is sensitive to electrons. It is typically a CMOS sensor, adapted to make it sensitive to electrons.

Selon une première variante, le capteur sensible aux électrons est illuminé en face arrière (« back side illuminated »). Pour cela, on peut utiliser un capteur CMOS dont le substrat est aminci et passivé (en anglais, « back-thinned »). Le capteur peut comprendre une couche de passivation, formant une couche externe du côté de la photocathode. La couche de passivation est déposée sur le substrat aminci. Le substrat reçoit des diodes de détection, associées chacune à un pixel du capteur.According to a first variant, the electron-sensitive sensor is illuminated on the back side (" back side illuminated "). For this, one can use a CMOS sensor whose substrate is thinned and passivated (in English, " back - thinned "). The sensor may include a passivation layer, forming an outer layer on the side of the photocathode. The passivation layer is deposited on the thinned substrate. The substrate receives detection diodes, each associated with a pixel of the sensor.

Selon une deuxième variante, le capteur sensible aux électrons est illuminé en face avant. Pour cela, on peut utiliser un capteur CMOS dont la face avant est traitée de manière à enlever les couches de protection recouvrant les diodes. La face avant d'un capteur CMOS standard est ainsi rendue sensible aux électrons. Les moyens de traitement 540 fonctionnent comme décrit en référence à la figure 2, la grandeur utile étant représentative du flux surfacique d'électrons détecté par les pixels panchromatiques du capteur 530.According to a second variant, the electron-sensitive sensor is illuminated on the front face. For this purpose, it is possible to use a CMOS sensor whose front face is treated so as to remove the protective layers covering the diodes. The front face of a standard CMOS sensor is thus made sensitive to electrons. The processing means 540 operate as described with reference to the figure 2 , the useful quantity being representative of the surface flux of electrons detected by the panchromatic pixels of the sensor 530.

La figure 5B illustre une variante du dispositif 500 de la figure 5A, dans laquelle le tube à vide 550 est fermé par un faisceau 552 de fibres optiques recevant la matrice de filtres élémentaires.The Figure 5B illustrates a variant of the device 500 of the Figure 5A , in which the vacuum tube 550 is closed by a beam 552 of optical fibers receiving the matrix of elementary filters.

Selon cette variante, le faisceau 552 de fibres optiques est traversé par des photons provenant de la scène à imager. Une première extrémité du faisceau 552 de fibres optiques ferme le tube à vide. Une deuxième extrémité du faisceau 552 de fibres optiques se trouve en face de la scène à imager. Le tube à vide 550 ne présente plus la fenêtre d'entrée 551, celle-ci étant remplacée par le faisceau de fibres optiques qui permet de déporter le tube à vide de la scène à imager.According to this variant, the beam 552 of optical fibers is traversed by photons coming from the scene to be imaged. A first end of the fiber optic bundle 552 closes the vacuum tube. A second end of the beam 552 of optical fibers is in front of the scene to be imaged. The vacuum tube 550 no longer has the input window 551, which is replaced by the optical fiber bundle which allows the vacuum tube of the scene to be imaged to be displaced.

Chaque filtre élémentaire de la matrice 510 est associé à une fibre optique du faisceau 552. En particulier, chaque filtre élémentaire est directement accolé sur une extrémité de fibre optique, avantageusement du côté opposé au tube à vide. Dans ce cas, la matrice de filtres élémentaires 510 se trouve à l'extérieur du tube à vide, ce qui simplifie son montage.Each elementary filter of the matrix 510 is associated with an optical fiber of the beam 552. In particular, each elementary filter is directly attached to an optical fiber end, advantageously on the opposite side to the vacuum tube. In this case, the matrix of elementary filters 510 is outside the vacuum tube, which simplifies its assembly.

En variante, chaque filtre élémentaire est directement accolé sur une extrémité de fibre optique, du côté du tube à vide. On peut réaliser de la même façon une variante du dispositif décrit en référence à la figure 4.Alternatively, each elementary filter is directly attached to an end of optical fiber, the side of the vacuum tube. In the same way, a variant of the device described with reference to FIG. figure 4 .

La figure 6 illustre de manière schématique un deuxième mode de réalisation d'une matrice de filtres élémentaires selon l'invention. La matrice de filtres élémentaires de la figure 6 diffère des matrices précédemment décrites, en ce qu'elle comprend des filtres infrarouges (IR), ne transmettant pas la partie visible du spectre et laissant passer le proche infrarouge. Les filtres infrarouges laissent passer les longueurs d'onde dans le proche infrarouge, voire également dans l'infrarouge (longueurs d'onde supérieures à 700 nm). Les filtres infrarouges transmettent notamment la bande spectrale comprise entre 700 et 900 nm, voire entre 700 et 1100 nm, et même entre 700 et 1700 nm.The figure 6 schematically illustrates a second embodiment of a matrix of elementary filters according to the invention. The matrix of elementary filters of the figure 6 differs from the matrices described above, in that it comprises infrared (IR) filters, not transmitting the visible part of the spectrum and allowing the near infrared to pass. Infrared filters let the wavelengths pass in the near infrared, or even in the infrared (wavelengths greater than 700 nm). Infrared filters transmit in particular the spectral band between 700 and 900 nm, or even between 700 and 1100 nm, and even between 700 and 1700 nm.

La matrice de filtre de la figure 6 diffère de la matrice de la figure 3A en ce que dans le motif élémentaire, l'un des deux pixels verts (G) est remplacé par un pixel infrarouge (IR).The filter matrix of the figure 6 differs from the matrix of the figure 3A in that in the elementary pattern, one of the two green pixels (G) is replaced by an infrared pixel (IR).

On peut former de la même façon différentes variantes de la matrice de la figure 6, à partir par exemple de la matrice de la figure 3B et en remplaçant par un pixel infrarouge l'un des deux pixels magenta du motif élémentaire.In the same way, different variants of the matrix of the figure 6 , for example from the matrix of the figure 3B and replacing by an infrared pixel one of the two magenta pixels of the elementary pattern.

Selon d'autres variantes, on reprend le motif élémentaire (2) tel que défini ci-avant, en définissant X=Y=IR.According to other variants, the elementary pattern (2) as defined above is taken up again, defining X = Y = IR.

La figure 7 illustre de manière schématique un traitement mis en oeuvre par les moyens de traitement selon l'invention, lorsque la matrice de filtres élémentaires comprend des pixels infrarouges.The figure 7 schematically illustrates a processing implemented by the processing means according to the invention, when the matrix of elementary filters comprises infrared pixels.

Les étapes 780, 781 et 782B correspondent respectivement aux étapes 280, 281 et 282B telles que décrites en référence à la figure 2.Steps 780, 781 and 782B correspond to steps 280, 281 and 282B, respectively, as described with reference to FIG. figure 2 .

Lorsqu'une zone du capteur se trouve dans des conditions de faible éclairement, les moyens de traitement mesurent une grandeur, dite grandeur secondaire, représentative du flux surfacique moyen de photons ou d'électrons FIR détecté par les pixels infrarouges de cette zone (étape 783). En particulier, ce flux surfacique moyen est un flux surfacique moyen de photons si le capteur est photosensible, ou un flux surfacique moyen d'électrons si le capteur est sensible aux électrons.When a zone of the sensor is in conditions of low illumination, the processing means measure a quantity, called secondary quantity, representative of the average surface flux of photons or electrons F IR detected by the infrared pixels of this area (step 783). In particular, this average surface flux is an average surface flux of photons if the sensor is photosensitive, or an average surface flux of electrons if the sensor is sensitive to electrons.

Les moyens de traitement effectuent ensuite une comparaison entre cette grandeur secondaire, et un seuil infrarouge FIR th (étape 784).The processing means then make a comparison between this secondary quantity and an infrared threshold F IR th (step 784).

Si la grandeur secondaire FIR est inférieure au seuil infrarouge FIR th, on construit une image couleur de la zone, comme décrit en référence à la figure 2 à propos de l'étape 282A (étape 782A).If the secondary size F IR is below the infrared threshold F IR th , a color image of the zone is constructed, as described with reference to the figure 2 about step 282A (step 782A).

Si la grandeur secondaire FIR est supérieure au seuil infrarouge FIR th, on construit une image en fausse couleur de la zone, c'est-à-dire une image dans laquelle on attribue une couleur donnée aux pixels infrarouges de cette zone. L'image en fausse couleur peut être construite par interpolation des pixels infrarouges de la zone considérée. L'image en fausse couleur est donc une image monochrome, d'une couleur différente de l'image monochrome associée aux pixels panchromatiques. Ensuite, on superpose cette image en fausse couleur à l'image monochrome obtenue à l'aide des pixels panchromatiques de la même zone du capteur.If the secondary size F IR is greater than the infrared threshold F IR th , a false-color image of the zone is created, that is to say an image in which a given color is attributed to the infrared pixels of this zone. The false color image can be constructed by interpolating the infrared pixels of the considered area. The false color image is therefore a monochrome image, of a different color from the monochrome image associated with the panchromatic pixels. Then, we superimpose this image in false color to the monochrome image obtained using the panchromatic pixels of the same area of the sensor.

Ces étapes de construction d'une image en fausse couleur et superposition avec l'image monochrome forment ensemble une étape 782C.These steps of constructing a false color image and superposition with the monochrome image together form a step 782C.

Ainsi, pour une zone située dans des conditions de faible éclairement, on obtient soit une image monochrome, soit la superposition d'images telle que définie ci-dessus.Thus, for an area located in low light conditions, one obtains either a monochrome image or the image overlay as defined above.

En résumé, lorsqu'une zone est dans des conditions de faible éclairement, on teste si les pixels infrarouges appartenant à cette zone ont une intensité supérieure à un seuil infrarouge prédéterminé et, dans l'affirmative, on superpose à l'image monochrome de cette zone les pixels infrarouges représentés en fausse couleur. Ce mode de réalisation est particulièrement avantageux pour des applications de détection laser.In summary, when a zone is in low illumination conditions, it is tested whether the infrared pixels belonging to this zone have an intensity greater than a predetermined infrared threshold and, if so, it is superimposed on the monochrome image of this zone. zone infrared pixels shown in false color. This embodiment is particularly advantageous for laser detection applications.

Selon une première variante, on ne calcule pas une grandeur secondaire unique pour une même zone, mais on calcule séparément une grandeur secondaire par pixel infrarouge de la zone. Seuls les pixels infrarouges, pour lesquels la grandeur secondaire correspondante est supérieure au seuil infrarouge, sont superposés à l'image monochrome obtenue à partir des pixels panchromatiques. Ainsi, si une zone du capteur présente une forte intensité dans le domaine infrarouge, celle-ci sera aisément identifiable dans l'image résultante.According to a first variant, a single secondary quantity for the same zone is not calculated, but a secondary quantity per infrared pixel of the zone is calculated separately. Only the infrared pixels, for which the corresponding secondary quantity is greater than the infrared threshold, are superimposed on the monochrome image obtained from the panchromatic pixels. Thus, if a sensor zone has a high intensity in the infrared range, it will be easily identifiable in the resulting image.

Selon une autre variante, on identifie des sous-zones de ladite zone du capteur, détectant un flux surfacique moyen de pixels ou d'électrons homogène dans le spectre infrarouge, et on traite ensuite séparément chaque sous-zone comme détaillé ci-dessus. En d'autres termes, la comparaison avec le seuil infrarouge se fait par sous-zones homogènes du capteur. Pour chaque sous-zone du capteur pour laquelle la grandeur secondaire est supérieure au seuil infrarouge, on obtient une image en fausse couleur par interpolation des pixels infrarouge de ladite sous-zone. Ces images en fausses couleurs sont ensuite superposées aux emplacements correspondants sur l'image monochrome de la zone du capteur. Pour identifier de telles sous-zones, une segmentation est réalisée sur la base d'une image réalisée par interpolation des pixels infrarouges. En résumé, lorsqu'une zone est dans des conditions de faible éclairement, on identifie des sous-zones de cette zone, présentant une intensité homogène dans le spectre infrarouge, et l'on détermine, pour chaque sous-zone ainsi identifiée, si la moyenne de l'intensité infrarouge dans cette sous-zone est supérieure à un seuil infrarouge prédéterminé et, dans l'affirmative, on représente cette sous-zone par une image en fausse couleur sur la base des pixels infrarouges de cette sous-zone, l'image en fausse couleur de ladite sous-zone étant alors représentée en superposition avec l'image monochrome de la zone à laquelle elle appartient.According to another variant, sub-zones of said sensor zone are identified, detecting an average surface flux of pixels or electrons homogeneous in the infrared spectrum, and each sub-zone is then treated separately as detailed above. In other words, the comparison with the infrared threshold is done by homogeneous sub-areas of the sensor. For each sub-area of the sensor for which the secondary magnitude is greater than the infrared threshold, a false color image is obtained by interpolation of the infrared pixels of said sub-zone. These false color images are then superimposed on the corresponding locations on the monochrome image of the sensor area. To identify such sub-areas, a segmentation is performed on the basis of an image made by interpolation of the infrared pixels. In summary, when a zone is in low illumination conditions, sub-zones of this zone are identified, having a uniform intensity in the infrared spectrum, and it is determined, for each sub-zone thus identified, whether the The average of the infrared intensity in this sub-area is greater than a predetermined infrared threshold and, if so, this sub-area is represented by a false-color image based on the infrared pixels of that sub-area. false-color image of said sub-area then being superimposed with the monochrome image of the area to which it belongs.

Les pixels infrarouges du capteur peuvent également être utilisés pour améliorer un rapport signal sur bruit sur une image couleur finale. Pour cela, lorsqu'une zone du capteur se trouve dans des conditions de fort éclairement, on réalise une image infrarouge de cette zone, par interpolation des pixels infrarouges du capteur. On soustrait ensuite cette image infrarouge à l'image couleur de cette zone, obtenue comme détaillé en référence à la figure 2. La soustraction de l'image infrarouge permet d'améliorer le rapport signal sur bruit. Pour éviter des problèmes de saturation, on peut soustraire une image infrarouge pondérée, à chacune des images de couleur primaire. Les coefficients de pondération attribués à l'image infrarouge peuvent être identiques ou non, pour chaque image de couleur primaire. On obtient des images de couleur primaire débruitées, que l'on combine pour former une image couleur débruitée. Ainsi, les moyens de traitement sont adaptés à mettre en oeuvre les étapes suivantes :

  • calculer la grandeur utile, pour déterminer si au moins une zone du capteur est dans des conditions de faible ou de fort éclairement ;
  • uniquement si ladite zone est dans des conditions de fort éclairement, former une image couleur de ladite zone à partir des pixels de cette zone associés à des filtres de couleur primaire, et en retrancher une image infrarouge de ladite zone obtenue à partir des pixels infrarouges de cette zone (par exemple par interpolation desdits pixels infrarouges).
The infrared pixels of the sensor can also be used to improve a signal-to-noise ratio on a final color image. For this, when a zone of the sensor is in conditions of high illumination, an infrared image of this zone is produced by interpolation of the infrared pixels of the sensor. This infrared image is then subtracted from the color image of this area, obtained as detailed with reference to the figure 2 . The subtraction of the infrared image makes it possible to improve the signal-to-noise ratio. To avoid saturation problems, a weighted infrared image can be subtracted from each of the primary color images. The weighting coefficients assigned to the infrared image may be identical or different, for each primary color image. Fragmented primary color images are obtained which are combined to form a denuded color image. Thus, the processing means are adapted to implement the following steps:
  • calculating the useful magnitude, to determine if at least one zone of the sensor is in conditions of low or high illumination;
  • only if said zone is in conditions of high illumination, forming a color image of said zone from the pixels of this zone associated with primary color filters, and subtracting an infrared image from said zone obtained from the infrared pixels of this area (for example by interpolation of said infrared pixels).

Claims (16)

  1. Image acquisition device (100; 400; 500) comprising:
    - a photocathode (120; 420; 520), configured to convert an incident flux of photons into a flux of electrons;
    - a sensor (130; 430; 530) composed of a matrix of elements named pixels; and
    - processing means (140; 440; 540);
    - a matrix (110; 410; 510) of elementary filters, each associated with at least one pixel of the sensor, said matrix being located upstream from the photocathode, such that an initial flux of photons passes through said matrix before reaching the photocathode,
    - the matrix comprising primary colour filters (R, G, B; Ye, Ma, Cy), a primary colour filter not transmitting a part of the visible spectrum complementary to said primary colour, and filters transmitting the entire visible spectrum, named panchromatic filters (W);
    characterized in that the processing means (140; 440; 540) are configured to:
    - calculate a quantity, termed a useful quantity( F ), for determining whether at least one zone of the sensor is under conditions of weak or strong illumination, the useful quantity being representative of a mean surface flux of photons or electrons detected on a set of pixels named panchromatic pixels of the sensor, each panchromatic pixel being associated with a panchromatic filter (W);
    - forming, only if said zone is under conditions of strong illumination, a colour image of said zone on the basis of the pixels in this zone associated with primary colour pixels.
  2. Device (400; 500) according to claim 1, characterised in that the photocathode (420; 520) is located inside a vacuum chamber (450; 550), and in that the matrix of elementary filters (410; 510) is located on an input window (451, 551) of said vacuum chamber.
  3. Device (500) according to claim 1, characterised in that the photocathode (520) is located inside a vacuum chamber (550) closed by a bundle of optical fibres (552), and in that each elementary filter of the matrix of elementary filters (510) is deposited on one end of an optical fibre of said bundle (552).
  4. Device (400) according to any one of claims 1 to 3, characterised in that the sensor (430) is a photosensitive sensor, in that the processing means (440) are configured to calculate a quantity representative of a mean surface flux of photons, and in that the device also comprises:
    - multiplication means (461) configured to receive the flux of electrons emitted by the photocathode, and supply a secondary flux of electrons in response; and
    - a phosphor screen (462), configured to receive the secondary flux of electrons and supply a flux of photons in response, named the useful flux of photons, the sensor (430) being arranged to receive said useful flux of photons.
  5. Device (400) according to any one of claims 1 to 3, characterised in that the sensor (530) is a sensor sensitive to electrons, configured to receive the flux of electrons emitted by the photocathode, and in that the processing means (540) are configured to calculate a quantity representative of a mean surface flux of electrons.
  6. Device (100; 400; 500) according to any one of claims 1 to 5, characterised in that the panchromatic filters represent 75% of the elementary filters.
  7. Device (100; 400; 500) according to claim 6, characterised in that the matrix of elementary filters (110; 410; 510) is generated by the periodic two-dimensional repetition of the following pattern: M = R W G W W W W W G W B W W W W W
    Figure imgb0009
    in which R, G, B represent the primary colour filters red, green and blue respectively and W represents a panchromatic filter, the pattern being defined except for an R, G, B permutation.
  8. Device (100; 400; 500) according to claim 6, characterised in that the matrix of elementary filters (110; 410; 510) is generated by the periodic two-dimensional repetition of the following pattern: M = Ye W Ma W W W W W Ma W Cy W W W W W
    Figure imgb0010
    in which Ye, Ma, Cy represent the primary colour filters yellow, magenta and cyan respectively, and W represents a panchromatic filter, the pattern being defined except for a Ye, Ma, Cy permutation.
  9. Image acquisition device (100; 400; 500) according to one of claims 1 to 8, characterised in that the processing means are configured to:
    - determine that said zone has weak illumination, if the useful quantity ( F ) is less than a first threshold, and
    - determine that said zone has strong illumination, if the useful quantity ( F ) is more than a second threshold, the second threshold being higher than the first threshold.
  10. Device (100; 400; 500) according to claim 9, characterised in that if the useful quantity ( F ) is between the first and second thresholds, the processing means are configured to combine a monochrome image and the colour image of said zone, the monochrome image of said zone being obtained from the panchromatic pixels of this zone.
  11. Image acquisition device (100; 400; 500) according to one of claims 1 to 10, characterised in that the processing means are configured to:
    - form a monochrome image from the complete set of panchromatic pixels of the sensor;
    - segment this monochrome image into homogeneous regions; and
    - for each zone of the sensor associated with a homogeneous region, calculate the corresponding useful quantity independently to determine if said zone is under weak or strong illumination conditions.
  12. Image acquisition device (100; 400; 500) according to one of claims 1 to 11, characterised in that the matrix of elementary filters (110; 410; 510) also includes infrared (IR) filters that do not transmit the visible part of the spectrum, wherein each infrared filter is associated with least one sensor pixel named infrared pixel.
  13. Image acquisition device (100; 400; 500) according to claim 12, characterised in that, when a zone is under weak illumination conditions, the processing means are configured to:
    - compare a predetermined infrared threshold (FIR th ) and a quantity named the secondary quantity ( FIR ), representative of a mean surface flux of photons or electrons detected by the infrared pixels of this zone;
    - when said secondary quantity is higher than the predetermined infrared threshold, superpose a monochrome image obtained from the panchromatic pixels of this zone and a false colour image obtained from the infrared pixels of this zone.
  14. Image acquisition device (100; 400; 500) according to claim 12, characterised in that, when a zone is under weak illumination conditions, the processing means are configured to:
    - using the infrared pixels in this zone, identify sub-zones of this zone, which detect a mean surface flux of photons or electrons homogeneous in the infrared spectrum;
    - for each sub-zone thus identified, compare a predetermined infrared threshold (FIR th ) and a quantity named the secondary quantity ( FIR ), representative of a mean surface flux of photons or electrons detected by the infrared pixels of this sub-zone;
    - when said secondary quantity is higher than the predetermined infrared threshold, superpose a monochrome image obtained from the panchromatic pixels of this sub-zone and a false colour image obtained from the infrared pixels in this sub-zone.
  15. Image acquisition device (100; 400; 500) according to one of the previous claims, characterised in that the matrix (110; 410; 510) of elementary filters consists of an image projected by an optical projection system.
  16. Image formation method, implemented in a device (100; 400; 500) comprising a photocathode (120; 420; 520) configured to convert an incident flux of photons into an flux of electrons, and a sensor (130; 430; 530) composed of a matrix of elements named pixels, comprising the following steps:
    - filter an initial flux of photons to supply said incident flux of photons, this filtering making use of a matrix of elementary filters (110; 410; 510) including primary colour filters (R, G, B; Ye, Ma, Cy), a primary colour filter not transmitting a part of the visible spectrum complementary to said primary colour, and filters transmitting the entire visible spectrum, named panchromatic filters (W);
    characterized in that it comprises the following steps:
    - calculate a quantity, termed a useful quantity( F ), for determining whether at least one zone of the sensor is under conditions of weak or strong illumination, the useful quantity being representative of a mean surface flux of photons or electrons detected on a set of pixels named panchromatic pixels of the sensor, each panchromatic pixel being associated with a panchromatic filter (W);
    - form, only if said zone is under conditions of strong illumination, a colour image of said zone on the basis of the pixels in this zone associated with primary colour filters (R, G, B; Ye, Ma, Cy).
EP15766546.4A 2014-09-22 2015-09-22 Bimode image acquisition device with photocathode Active EP3198625B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1458903A FR3026223B1 (en) 2014-09-22 2014-09-22 APPARATUS FOR ACQUIRING PHOTOCATHODE BIMODE IMAGES.
PCT/EP2015/071789 WO2016046235A1 (en) 2014-09-22 2015-09-22 Bimode image acquisition device with photocathode

Publications (2)

Publication Number Publication Date
EP3198625A1 EP3198625A1 (en) 2017-08-02
EP3198625B1 true EP3198625B1 (en) 2018-12-12

Family

ID=52474002

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15766546.4A Active EP3198625B1 (en) 2014-09-22 2015-09-22 Bimode image acquisition device with photocathode

Country Status (9)

Country Link
US (1) US9972471B2 (en)
EP (1) EP3198625B1 (en)
JP (1) JP6564025B2 (en)
CN (1) CN106716592B (en)
CA (1) CA2961118C (en)
FR (1) FR3026223B1 (en)
IL (1) IL251222B (en)
SG (1) SG11201702126UA (en)
WO (1) WO2016046235A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025153365A1 (en) * 2024-01-18 2025-07-24 Photonis France Colour-image acquisition device and associated colour night-vision system

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3045263B1 (en) * 2015-12-11 2017-12-08 Thales Sa SYSTEM AND METHOD FOR ACQUIRING VISIBLE AND NEAR INFRARED IMAGES USING A SINGLE MATRIX SENSOR
JP2017112401A (en) * 2015-12-14 2017-06-22 ソニー株式会社 Imaging device, apparatus and method for image processing, and program
US10197441B1 (en) * 2018-01-30 2019-02-05 Applied Materials Israel Ltd. Light detector and a method for detecting light
US11268849B2 (en) 2019-04-22 2022-03-08 Applied Materials Israel Ltd. Sensing unit having photon to electron converter and a method
FR3157657A1 (en) * 2023-12-22 2025-06-27 Photonis France COLOR IMAGE INTENSIFIER TUBE AND ASSOCIATED COLOR NIGHT VISION DEVICE
CN118354220B (en) * 2024-04-16 2025-05-13 中国科学院国家空间科学中心 ICMOS-based adaptive multi-mode ultraviolet imaging detection system

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03112041A (en) * 1989-09-27 1991-05-13 Hamamatsu Photonics Kk Color image tube
US5233183A (en) * 1991-07-26 1993-08-03 Itt Corporation Color image intensifier device and method for producing same
GB2273812B (en) * 1992-12-24 1997-01-08 Motorola Inc Image enhancement device
WO1995006388A1 (en) * 1993-08-20 1995-03-02 Intevac, Inc. Life extender and bright light protection for cctv camera system with image intensifier
IL114181A (en) * 1995-06-15 1999-07-14 Orlil Ltd Color image intensifier device and a method for producing the same
CA2234950A1 (en) * 1995-10-31 1997-05-09 Benjamin T. Gravely Imaging system
KR100214885B1 (en) * 1996-02-29 1999-08-02 윤덕용 Flat panel display device using light emitting device and electron multiplier
US5914749A (en) * 1998-03-31 1999-06-22 Intel Corporation Magenta-white-yellow (MWY) color system for digital image sensor applications
US6456793B1 (en) * 2000-08-03 2002-09-24 Eastman Kodak Company Method and apparatus for a color scannerless range imaging system
US20030147002A1 (en) * 2002-02-06 2003-08-07 Eastman Kodak Company Method and apparatus for a color sequential scannerless range imaging system
US6861638B2 (en) * 2002-08-20 2005-03-01 Northrop Grumman Corporation Method and system for generating an image having multiple hues
JP4311988B2 (en) * 2003-06-12 2009-08-12 アキュートロジック株式会社 Color filter for solid-state image sensor and color image pickup apparatus using the same
US7123298B2 (en) * 2003-12-18 2006-10-17 Avago Technologies Sensor Ip Pte. Ltd. Color image sensor with imaging elements imaging on respective regions of sensor elements
JP4678172B2 (en) * 2004-11-22 2011-04-27 株式会社豊田中央研究所 Imaging device
WO2006138599A2 (en) * 2005-06-17 2006-12-28 Infocus Corporation Synchronization of an image producing element and a light color modulator
CN1971927B (en) * 2005-07-21 2012-07-18 索尼株式会社 Physical information acquisition method, physical information acquisition device and semiconductor device
US8139130B2 (en) * 2005-07-28 2012-03-20 Omnivision Technologies, Inc. Image sensor with improved light sensitivity
US7688368B2 (en) * 2006-01-27 2010-03-30 Eastman Kodak Company Image sensor with improved light sensitivity
KR20070115243A (en) * 2006-06-01 2007-12-05 삼성전자주식회사 Image Imaging Apparatus, and Operation Method thereof
US8118226B2 (en) * 2009-02-11 2012-02-21 Datalogic Scanning, Inc. High-resolution optical code imaging using a color imager
CN202696807U (en) * 2012-07-20 2013-01-23 合肥汉翔电子科技有限公司 Microfilter color shimmer imaging mechanism
JP5981820B2 (en) * 2012-09-25 2016-08-31 浜松ホトニクス株式会社 Microchannel plate, microchannel plate manufacturing method, and image intensifier
FR3004882B1 (en) * 2013-04-17 2015-05-15 Photonis France DEVICE FOR ACQUIRING BIMODE IMAGES
US9503623B2 (en) * 2014-06-03 2016-11-22 Applied Minds, Llc Color night vision cameras, systems, and methods thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025153365A1 (en) * 2024-01-18 2025-07-24 Photonis France Colour-image acquisition device and associated colour night-vision system

Also Published As

Publication number Publication date
CA2961118C (en) 2023-03-21
IL251222B (en) 2020-11-30
FR3026223A1 (en) 2016-03-25
US9972471B2 (en) 2018-05-15
SG11201702126UA (en) 2017-04-27
JP2017533544A (en) 2017-11-09
WO2016046235A1 (en) 2016-03-31
US20170287667A1 (en) 2017-10-05
CN106716592B (en) 2019-03-05
FR3026223B1 (en) 2016-12-23
CN106716592A (en) 2017-05-24
EP3198625A1 (en) 2017-08-02
IL251222A0 (en) 2017-05-29
JP6564025B2 (en) 2019-08-21
CA2961118A1 (en) 2016-03-31

Similar Documents

Publication Publication Date Title
EP3198625B1 (en) Bimode image acquisition device with photocathode
CA2909554C (en) Device for acquiring bimodal images
CN102202185B (en) Physical information acquisition device, solid-state imaging device and physical information acquisition method
US20160099272A1 (en) Stacked filter and image sensor containing the same
WO2009092868A1 (en) Device and method for the space-colorimetric measurement of a three-dimensional object
US10609361B2 (en) Imaging systems with depth detection
EP3155660B1 (en) Bispectral matrix sensor and method for manufacturing same
JP2019165447A (en) Solid-state imaging apparatus and imaging system
US20240297198A1 (en) Imaging sensor with near-infrared absorber
FR3040798A1 (en) PLENOPTIC CAMERA
EP4251961A1 (en) Multispectral imager with enlarged spectral domain
EP3884656B1 (en) Device and method for observing a scene comprising a target
FR3026227A1 (en) DEVICE FOR ACQUIRING 3D IMAGES
FR2968777A1 (en) System for acquiring image during conditions e.g. fog, with low level of light, for helmet display system used by pilot of aircraft, has merging unit for merging images from visible and short wave infrared sensors to generate final image
FR3107124A1 (en) Apparatus for observing a star
EP3024011B1 (en) System for collecting low-light images comprising a lens having a phase and/or amplitude filter
FR2845487A1 (en) Light collection system, especially for use with an optical spectrometer system has first and second mirrors that respectively collect the light emitted from the source and focus it on the second mirror and a detector
FR2960065A1 (en) Combined observation and emission device for use in pair of binoculars to point out distant object, has radiative source including sufficient emission power such that image point corresponding to emission direction of source is detected
WO2025153365A1 (en) Colour-image acquisition device and associated colour night-vision system
FR3151729A1 (en) Image capture device and associated system
FR2968877A1 (en) Image sensor for detecting color on surface of substrate semiconductor, has pixels arranged in rows adjacent to each other based on pixel width, where pixels of adjacent rows are being offset relative to each other than half of pixel length
FR3092912A1 (en) PUPILLARY IMAGING SPECTROMETER

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170324

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIN1 Information on inventor provided before grant (corrected)

Inventor name: LETEXIER, DAMIEN

Inventor name: ROBERT, FRANCK

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180703

RIN1 Information on inventor provided before grant (corrected)

Inventor name: LETEXIER, DAMIEN

Inventor name: ROBERT, FRANCK

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1077094

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181215

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015021427

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190312

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190312

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1077094

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190313

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190412

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190412

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015021427

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

26N No opposition filed

Effective date: 20190913

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190922

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190930

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190930

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190922

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150922

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 602015021427

Country of ref document: DE

Representative=s name: LAURENT CHARRAS, FR

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250916

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20250909

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250919

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250929

Year of fee payment: 11