[go: up one dir, main page]

CN101883289A - Parallax reservation and parallax elimination in imaging systems of multiple-lens and multiple-sensor - Google Patents

Parallax reservation and parallax elimination in imaging systems of multiple-lens and multiple-sensor Download PDF

Info

Publication number
CN101883289A
CN101883289A CN2009100836313A CN200910083631A CN101883289A CN 101883289 A CN101883289 A CN 101883289A CN 2009100836313 A CN2009100836313 A CN 2009100836313A CN 200910083631 A CN200910083631 A CN 200910083631A CN 101883289 A CN101883289 A CN 101883289A
Authority
CN
China
Prior art keywords
imaq
treatment system
stating
image
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2009100836313A
Other languages
Chinese (zh)
Inventor
张冬云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN2009100836313A priority Critical patent/CN101883289A/en
Publication of CN101883289A publication Critical patent/CN101883289A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Studio Devices (AREA)

Abstract

The invention relates to parallax reservation and parallax elimination in imaging systems of multiple-lens and multiple-sensor. The invention is an image acquisition and processing system based on an invented multiple-sensor and multiple-lens system. The system can be used for improving an SNR (Signal Noise Ratio), a dynamic range, definition of a signal and parameters of other received image signals. In the invention, limitations of original single lens optical systems and sensors are improved through basic principles of multiple lenses and multiple sensors and some basic arithmetical operations so as to enhance performances.

Description

Parallax keeps and the parallax elimination in many camera lenses and the multi-sensor imaging system
Summary of the invention:
The digital camera that the present invention relates to a plurality of camera lenses and a plurality of transducers produces one or more consecutive images.To such an extent as to concrete is to use a plurality of camera lenses and a plurality of transducer to have geometric layout separately so that produce near the visual effect of approaching human eye fully about digital camera.Parallax can be eliminated or be kept to reach desirable visual effect fully.
Summary:
The present invention is based on the IMAQ and the treatment system [1] of the multisensor poly-lens system of having invented.This system can be used for improving the signal to noise ratio (snr) of signal, and dynamic range and other receive the parameter of picture signal.By the basic principle of many camera lenses and multisensor and the limitation of next improved original single-lens optical system of some basic mathematical computings and transducer, the sum of errors defective is to improve performance in the present invention.
Background:
An image capturing system comprises that camera lens and imageing sensor are optical subsystem and electronics subsystem.About carrying out description at United States Patent (USP) No. 6611289 (approval on August 26th, 2003, inventor Yu et al) in many camera lenses and the multisensor syste.The exercise question of this patent is " digital camera that uses a plurality of sensor cameras and many camera lenses ".Comparing the noise that multisensor receives with the digital camera of a transducer will have pressing result, and the dynamic range and the quality that consequently receive image are improved.
Yet foregoing invention possibly can't be imitated the human visual system fully, because the distance between two camera lenses and the transducer state is 6-7 centimetre as the people not necessarily.This in fact also is current single-lens camera shooting reality and characteristics, has promptly taked parallax free design.This means that image and human eye that single-lens camera produces have certain difference.The most tangible difference is that three-dimensional image information is lost.Some other fine information has also lost as the information that improves signal noise ratio, thus the image strictness that produces be one dimension and quality lower.Picture quality is further improved in the present invention, and a plurality of camera lenses and transducer are that can be arranged in the view data that makes generation under a kind of like this mode be undemanding one dimension.More more details are kept for single-lens and single-sensor camera, make the image of acquisition have more real characteristic near people's vision system.
Brief summary of the invention:
Because novel product development, technology are fast progressive and internet, Email, radio communication etc. have occurred, these new technologies all help to make digital camera and mobile device have camera function and the consumption electronic product that becomes the most popular new class. But the pixel count of picture quality, image and the dynamic range of image await further to improve. Digital camera uses a plurality of imageing sensors and a plurality of camera lens among the present invention, has improved various digital camera images quality, and the significantly increase that can not bring cost.
The present invention has considered existing issue and the needs of digital camera, and has particularly considered how further to satisfy the further requirement of digital camera, to produce high-quality digital picture. The present invention can be with two imageing sensors as example take improved digital camera, each sensor has the camera lens of oneself, one of them imageing sensor be accept be the information of all visible lights to have the black and white of acceptance be monochrome information, and second image sensing utensil is that what to accept is the color image data that the miniature ripple device of information mosaic of all visible lights is caught all visible lights. Native system uses one to embed the Digital Image Processing digital processing chip simultaneously, and image is the view data by one or two color image sensor and black white image sensor, produces high-quality RGB digital picture.
Mentioned the configuration of camera lens and sensor uniqueness in the United States Patent (USP) 6611289, it has many apparent benefits and advantage. At first, the Xie Xiangdu of imageing sensor can take full advantage of. The second, each imageing sensor only is responsible for accepting a kind of color; What thereby just can having cancelled the technology of each pixel of micro color Superimposed Filter of the sort of costliness, follow-up micromirror blade technolgy neither be necessary. Should be noted that this sensor with this miniature selective pseudo-colour filtering still can use, the 3rd, image can comprise all details from the information of black and white (brightness) image capture sensor. These two color image sensors may miss black-and-white detail. In addition; because these imageing sensor resolutions can take full advantage of; be the coloured image at same resolution; this imageing sensor can use the pixel quantity of less; or same number of pixels have a more high-resolution, this can cause the transfer rate height usually, and is highly sensitive; string holds together few, and the same space resolution ratio adopts low clock speed. In addition, the sensor area of image can be littler, therefore can use littler optical lens, and this is particularly conducive to the manufacturing of camera lens, Installation And Calibration.
The present invention is a kind of improved digital camera system.Be embodied in, comprise: 2 imageing sensors, they can be positioned at the relation (6-7 centimetre) of same segment distance to be installed in a common platform, and with near the human visual system, this system has 2 camera lenses, and each is installed in the front of imageing sensor; First imageing sensor can receive all visible color spectrums, can be the transducer of black and white; The 2nd sensor image can be accepted comprehensive visible light chromatogram and have micro color filtering; 2 analog-to-digital conversion circuits have produced data with 2 imageing sensors and have carried out digitlization; They are the corresponding view data of image; Improved digital camera also has corresponding circuit after analog-to-digital conversion circuit image can be stored and store, and carries out Digital Image Processing then and produces living last complete coloured image.
On step of the present invention can partly be embodied in shown in form.Form has represented how to improve each parameter.This form all camera lens pixel object and data in can the comprehensive review All Ranges.But notice how form not explanation improves all parameters at one time simultaneously.This invention will specifically describe and embody as the key diagram of enclosing.
The schematic diagram brief introduction:
In order to understand advantage of the present invention and other functions better, will explain aspect following several row, and be attached to the statement and be labeled on the corresponding key diagram.
Fig. 1: embody the block diagram that digital camera adopts many camera lenses and transducer that improves of the present invention; It shows that also a plurality of imageing sensors are placed in that transducer can have some distances between one the platform camera lens.
Two transducers can receive all visible lights, they can be monochrome be black and white or the miniature chromatic filter transducer of inlaying arranged.If adopted the miniature chromatic filter imageing sensor of inlaying, its design should be able to make the pixel of sensitization receive the spectrum that it is all considered respectively.
Fig. 2: shown that it is the scene of parallax that a representative test has.
Fig. 3: shown the different images of different sensors and last image result.
Fig. 4: described the principle that a plurality of camera lenses and a plurality of sensor camera image data resolution strengthen.
Description of the invention:
Following detailed description concrete details of the present invention is so that further thorough understanding the present invention.Yet it will not describe those tangible and known technologies.Description is to have adopted representative and be common means, the flesh and blood that the technology that promptly having adopted has experience or technical ability is passed on most effectively.In other cases, well-known method, program, assembly and circuit are not elaborated, to avoid unnecessary obscuring.
Fig. 1: described image capturing system.Promptly use a plurality of camera lens and a plurality of transducer.Object 101. Camera lens 102 and 104 corresponding lens camera.Show 103 and 105 in the imageing sensor of this arrangement and the camera lens.At camera body is to describe 107.This imageing sensor is also shown in 108 and 109.The microprocessor 106 of image data transmission is by transmission cable 110,111.Output image data is handled through processor.Processing procedure comprises the detection of imageing sensor and camera lens and proofreaies and correct the last image of generation mutually.
Fig. 2: described the test pattern that a typical case has parallax.The 201st, the object of taking the photograph of arranging with triangular outline.202, the 203rd, first transducer and camera lens.The 205th, another transducer and camera lens.206,207 is images that two camera lenses and transducer are caught.
Fig. 3: the production process of having described to obtain last view data.301 have represented the image that obtains from first transducer and camera lens.302 have represented the image that obtains from second transducer and camera lens.303 have represented the last parallax free image that obtains as dominant eye as first transducer and camera lens.304 have represented the last parallax free image that obtains as dominant eye as second transducer and camera lens.305 have represented the another kind of last result that obtains as dominant eye as first transducer and camera lens.Parallax information is added in the parallax free image and goes in this image.
Fig. 4: the process of having described the image data resolution enhancing of a plurality of camera lenses and a plurality of sensor camera.400 have described to have adopted the two-dimensional space resolution of the single-lens single-sensor of bayer-pattern.401 have described to have adopted the RGB two-dimensional space resolution distance of the single-lens single-sensor of bayer-pattern, and 402 have described to have adopted the two-dimensional space resolution distance at G diagonal angle of the single-lens single-sensor of bayer-pattern.403 have described the folk prescription of monochrome or red sensor to spatial discrimination.405 have described monochromatic or blue folk prescription to spatial resolution.407 have described monochromatic or green folk prescription to spatial resolution.404,406 and 408 have described the folk prescription of corresponding monochrome to the spatial discrimination distance.If 410 have represented to have same pixel count and space length then the folk prescription of single-lens single-sensor is that the folk prescription of a plurality of camera lenses and a plurality of transducers is to half of spatial resolution to spatial resolution.The spatial discrimination distance of considering the minimum diagonal angle of G (green) transducer has only 1.4 times of minimum folk prescriptions to monochrome to spatial resolution, and three-lens and sensor camera two-dimensional space resolution are three times of two-dimensional space resolution of single-lens single-sensor.
Digital photography is one and appears at the most breathtaking technology latter half in 20th century that use suitable hardware and software, almost anyone can use digital photography.Because product introduction, technological progress and price is not short recently reduces, and the most important thing is to have occurred high-speed radiocommunication and the Internet simultaneously, and this helps to make digital camera to become the consumption electronic product of the most very powerful and exceedingly arrogant new class.
The imageing sensor of most of digital cameras uses or the sensitization equipment, perceives scene as charge-coupled device (CCD) or CMOS (Complementary Metal Oxide Semiconductor) (CMOS) technology semiconductor.Sensor devices becomes situ conversion the signal of telecommunication to convert numeral then to, and light for example, this shows the chromatic spectrum that each is independent by the red, green, blue filter.When data are by merging and handle that camera can be determined the concrete color of the picture of each part.Because image is actually the numerical data of a set, it just can download to computer like a cork and handle more artistic effect.
Yet, have under many situations, so owing to the limited camera of performance of digital camera may can't use at all.People's naked eyes still have many advantages by contrast, more self-adaptive processing ability are arranged, higher resolution. bigger dynamic range, owing to the strength of brain, add the self adaptation of eye (transducer), and the defective of human eye can limit greatly and and improve.For example, a pair of myopia can be better than any single eye.Under the situation of low-down optical illumination, the human visual system can become a solid color or automatically near the pattern of monochromatic sensitization, thinks most important information with extraction.The dynamic range of human eye can be as big as a percentage shellfish, and numeral approximately is 16 bits.In the digital camera of typical many optical lens and multiple imageing sensor or sensitive chip, sensitive chip comprises the photoelectric conversion unit array of a bidimensional, i.e. pixel.The colored filter of weave in is to be superimposed upon each pixel selectively.The photoelectric chip has the resolving power of certain all directions usually, and consequent horizontal resolution is that the relative distance decision of the arrangement of being expert at by some continuous pixels is determined by the relative distance of some pixels in the arrangement of row with vertical resolution.Because colored and brightness impression light pixel is alternately arranged, actual image is separated pixel and is reduced.
Though clearly realizing that, we also have many other qualitative factors to limit the performance that digital camera images is gathered.For example, aperture can not be provided with arbitrarily with this parameter will can greatly have influence on picture quality conversely, and this is because the effect of well-known optics diffraction and diffraction.When f-number be set to lower the time, can obtain the diffraction effect of more luminous energy and improvement, but camera lens mass defect may expose more the final image quality is affected.When f-number is set to height, exposure may deficiency and the diffraction effect of camera lens will become the principal element that influences picture quality.
When adopting a plurality of camera lenses and multisensor camera, a transducer disappearance can be compensated with the data of other transducers and correct.In general a transducer can be configured to accept a kind of extreme case, and other transducer can dispose the extreme case of accepting the other end.For example transducer can be configured to accept the image information of high brightness, and other transducer can dispose the image information of accepting low-light level.Last image is the result of these two images of adaptive fusion.A kind of simple fusion method is to enlarge the bit number of each pixel so that all clarity of detail ground is represented.
Figure B2009100836313D0000041
Should be noted that the present invention and step should carry out after obtaining preliminary result images, the data of different sensors have the convergent-divergent of coordinate and strictness that alignment has guaranteed the position is mated.
List of references:
[1] United States Patent (USP) No. 6611289 (on August 26th, 2003 was delivered inventor Yu etc.) " uses a plurality of sensor cameras than manying the digital camera of camera lens ".

Claims (14)

1. the number collection of many camera lenses and multisensor and its a plurality of imageing sensors of treatment system (camera) are installed on the platform also can have certain distance and the shared independent processor of its view data each other towards a direction, this digital camera has an entire spectrum transducer at least, and this digital camera can obtain and handle from its end products of view data of aforesaid a plurality of sensor acquisition single parallax free image, and end product is one or the one group of image that can represent parallax also.
2. IMAQ described in claim 1 and treatment system, two full spectral image sensor data are carried out linearity relatively with relevant, do not have further Nonlinear Processing, just linear process.
3. IMAQ described in claim 1 and treatment system, two full spectral image sensor data are carried out further Nonlinear Processing and non-linear and linear hybrid is handled.
4. IMAQ and the treatment system as stating in the claim 1, different sensors can be configured to operate in the identical or different mode of operation aperture for example different with parameter, speed, distance and the depth of field with camera lens.
5. IMAQ and the treatment system as stating in the claim 1, different sensors can be placed to a relative angle with camera lens, for example 45 degree (or have 135,225, or 315 degree) angle.
6. IMAQ and the treatment system as stating in the claim 1, the relative angle of different sensors and camera lens and position can be adjusted in real time to reach optimal effectiveness.
7. IMAQ and the treatment system as stating in the claim 1, processor can the outer storage chip of application chip come buffer memory and store in the middle of with last result.
8. IMAQ and the treatment system as stating in the claim 1, processor can application system in some imageing sensors as dominant eye and other imageing sensor extracts parallax information as auxilliary eye.
9. IMAQ and the treatment system as stating in the claim 1, processor can application system in some imageing sensors as dominant eye and other imageing sensor is eliminated parallax as auxilliary eye.
10. IMAQ and the treatment system as stating in the claim 1, each imageing sensor all have the Analog to Digital Converter of oneself data transaction of simulation to be become the information of numeral.
11. as IMAQ and the treatment system of stating in the claim 1, processor can be accepted the information of part or all of imageing sensor and handle.
12. as IMAQ and the treatment system of stating in the claim 1, the information before the aperture correction of the imageing sensor that processor adopting is different is arranged the resolution that strengthens image.
13. as IMAQ and the treatment system of stating in the claim 12, the relative position of some or certain several imageing sensor can one the fine setting of direction or both direction to reach the resolution of the highest image.
14. as IMAQ and the treatment system of stating in the claim 13, last result is the whole of treated the image in different resolution that demonstration is the highest or certain is a part of.
CN2009100836313A 2009-05-07 2009-05-07 Parallax reservation and parallax elimination in imaging systems of multiple-lens and multiple-sensor Pending CN101883289A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009100836313A CN101883289A (en) 2009-05-07 2009-05-07 Parallax reservation and parallax elimination in imaging systems of multiple-lens and multiple-sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009100836313A CN101883289A (en) 2009-05-07 2009-05-07 Parallax reservation and parallax elimination in imaging systems of multiple-lens and multiple-sensor

Publications (1)

Publication Number Publication Date
CN101883289A true CN101883289A (en) 2010-11-10

Family

ID=43055161

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009100836313A Pending CN101883289A (en) 2009-05-07 2009-05-07 Parallax reservation and parallax elimination in imaging systems of multiple-lens and multiple-sensor

Country Status (1)

Country Link
CN (1) CN101883289A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102694954A (en) * 2011-03-22 2012-09-26 精工爱普生株式会社 Reading apparatus and reading method
CN103369246A (en) * 2013-07-12 2013-10-23 王辉 Camera resolution conversion device
CN104702833A (en) * 2013-12-04 2015-06-10 联想(北京)有限公司 Information processing method and electronic equipment
CN107340074A (en) * 2017-08-28 2017-11-10 无锡北斗星通信息科技有限公司 A kind of image capture analysis method
CN113225473A (en) * 2020-02-05 2021-08-06 浙江大华技术股份有限公司 Method, apparatus, device and medium for auto-focusing

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6611289B1 (en) * 1999-01-15 2003-08-26 Yanbin Yu Digital cameras using multiple sensors with multiple lenses
CN1472595A (en) * 2002-08-02 2004-02-04 陈世萍 stereoscopic imaging device and operation method thereof
US20050068452A1 (en) * 2003-09-30 2005-03-31 Eran Steinberg Digital camera with built-in lens calibration table
CN201184953Y (en) * 2008-04-07 2009-01-21 刘仁昌 Numeral solid camera

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6611289B1 (en) * 1999-01-15 2003-08-26 Yanbin Yu Digital cameras using multiple sensors with multiple lenses
CN1472595A (en) * 2002-08-02 2004-02-04 陈世萍 stereoscopic imaging device and operation method thereof
US20050068452A1 (en) * 2003-09-30 2005-03-31 Eran Steinberg Digital camera with built-in lens calibration table
CN201184953Y (en) * 2008-04-07 2009-01-21 刘仁昌 Numeral solid camera

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102694954A (en) * 2011-03-22 2012-09-26 精工爱普生株式会社 Reading apparatus and reading method
CN103369246A (en) * 2013-07-12 2013-10-23 王辉 Camera resolution conversion device
CN103369246B (en) * 2013-07-12 2017-02-08 天津慧尊科技发展有限公司 Camera resolution conversion device
CN104702833A (en) * 2013-12-04 2015-06-10 联想(北京)有限公司 Information processing method and electronic equipment
CN104702833B (en) * 2013-12-04 2018-02-27 联想(北京)有限公司 The method and a kind of electronic equipment of a kind of information processing
CN107340074A (en) * 2017-08-28 2017-11-10 无锡北斗星通信息科技有限公司 A kind of image capture analysis method
CN107340074B (en) * 2017-08-28 2018-04-20 深圳市对接平台科技发展有限公司 A kind of image capture analysis method
CN113225473A (en) * 2020-02-05 2021-08-06 浙江大华技术股份有限公司 Method, apparatus, device and medium for auto-focusing
CN113225473B (en) * 2020-02-05 2022-07-08 浙江大华技术股份有限公司 Method, apparatus, device and medium for auto-focusing

Similar Documents

Publication Publication Date Title
JP6817960B2 (en) Methods and equipment for processing light field content
JP5353393B2 (en) Image processing apparatus and image processing method
CN101924947B (en) Image processing device, image processing method, and imaging apparatus
CN100593320C (en) Method for processing noise in image data, noise reduction unit and imaging device
US10027908B2 (en) Image sensor unit and imaging apparatus
US11659289B2 (en) Imaging apparatus and method, and image processing apparatus and method
CN111669483B (en) Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method
CN101662590A (en) Image pickup apparatus and image processing apparatus
CN103595982A (en) Color image collection device based on gray level sensor and color image sensor
CN120264104A (en) Image sensor and image sensing method
EP3846462A1 (en) Image sensor, method for acquiring image data from image sensor, and camera device
CN108200324B (en) A kind of imaging system and imaging method based on zoom lens
CN101883289A (en) Parallax reservation and parallax elimination in imaging systems of multiple-lens and multiple-sensor
CN104410847B (en) A kind of chromatic filter and color image sensor
EP3247107B1 (en) Method and device for obtaining a hdr image by graph signal processing
CN107613177A (en) Camera, imaging method and mobile terminal based on fly's-eye lens
CN108805921B (en) Image acquisition system and method
US20170048513A1 (en) Plenoptic camera comprising a shuffled color filter array
CN105376562A (en) Spatial correction method and system of color linear-array camera
CN101860760A (en) Performance improvement of multi-lens multi-sensor imaging system
JP2024180460A (en) Image processing device, image processing method, and computer program
KR20190100833A (en) Apparatus for generating high dynamic range image
JP7083912B2 (en) Image sensor, image pickup device, image pickup method and program
CN208257976U (en) A kind of compound four monochromatic sensors camera
CN115776617B (en) Pixel structure, image sensor, device, image processing method, and control method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20101110