[go: up one dir, main page]

HK1234932B - Imaging system and method - Google Patents

Imaging system and method Download PDF

Info

Publication number
HK1234932B
HK1234932B HK17108516.9A HK17108516A HK1234932B HK 1234932 B HK1234932 B HK 1234932B HK 17108516 A HK17108516 A HK 17108516A HK 1234932 B HK1234932 B HK 1234932B
Authority
HK
Hong Kong
Prior art keywords
edge
imaging system
adjacent
view
imaging systems
Prior art date
Application number
HK17108516.9A
Other languages
Chinese (zh)
Other versions
HK1234932A1 (en
Inventor
尼亚齐 扎卡里亚
Original Assignee
Circle Optics, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Circle Optics, Inc. filed Critical Circle Optics, Inc.
Publication of HK1234932A1 publication Critical patent/HK1234932A1/en
Publication of HK1234932B publication Critical patent/HK1234932B/en

Links

Description

成像系统和方法Imaging systems and methods

相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS

本申请要求于2014年5月6日提交的美国临时申请号61/989,136的优先权,该申请的主题通过引用以其全文结合在此。This application claims priority to U.S. Provisional Application No. 61/989,136, filed May 6, 2014, the subject matter of which is incorporated herein by reference in its entirety.

技术领域Technical Field

本发明的各个实施例和方面总体上主要涉及光学成像系统、与其相关的方法及其应用;更具体地,涉及全景光学成像系统、与其相关的方法及其应用;并且最具体地,涉及具有零视差或基本上无视差的全景光学成像系统、与其相关的方法及其应用。Various embodiments and aspects of the present invention generally relate generally to optical imaging systems, methods related thereto, and applications thereof; more specifically, to panoramic optical imaging systems, methods related thereto, and applications thereof; and most specifically, to panoramic optical imaging systems with zero parallax or substantially no parallax, methods related thereto, and applications thereof.

背景技术Background Art

目前的无视差360度系统采取反射镜安排来扫描图像,并且受到每秒10 帧(fps)的成像速度的限制。谷歌使用Immersive Media公司所开发的带有折射镜头的360度相机来为其街景视图(Streetview)软件捕捉照片。必须针对视差对这些照片进行后处理和校正,导致花费时间,这降低了谷歌扩展其街景视图主动性的能力。鱼眼镜头提供了广角成像,但以高失真为代价。失真是将较大球形物体映射到较小平坦图像平面的物理结果。Current parallax-free 360-degree systems use an arrangement of mirrors to scan images and are limited to an imaging speed of 10 frames per second (fps). Google uses a 360-degree camera with a refractive lens developed by Immersive Media to capture photos for its Street View software. These photos must be post-processed and corrected for parallax, which is time-consuming and reduces Google's ability to expand its Street View initiative. Fisheye lenses provide wide-angle imaging, but at the cost of high distortion. Distortion is a physical result of mapping a large spherical object onto a small, flat image plane.

一些公司已经开发了光学系统来简化拍摄全景图像的过程。与转动相机以进行多次拍摄相反,用许多相机对场景的不同部分进行成像来同时地捕捉所有这些照片。Immersive Media和Greypoint Imaging开发了以$10,000与$100,000 之间的不同标价可获得的单次拍摄360度相机。这两家公司都开发了软件来自动地校正图像中所产生的伪像(视差)并提供比一个相机(例如,iPhone相机) 所捕捉到的全景图更好的分辨率。然而,软件不是完美的,并且图像中仍然存在许多伪像。举例而言,谷歌让一个人带着Dodeca 360相机(由Immersive Media 提供)围绕大峡谷(Grand Canyon),并且不得不雇佣程序员来针对视差所引起的伪像逐帧校正图像。Several companies have developed optical systems to simplify the process of capturing panoramic images. Instead of rotating the camera to take multiple shots, multiple cameras are used to image different parts of the scene, capturing all of them simultaneously. Immersive Media and Greypoint Imaging have developed single-shot 360-degree cameras, available at price points ranging from $10,000 to $100,000. Both companies have developed software to automatically correct for artifacts (parallax) in the images and provide better resolution than a panorama captured by a single camera (e.g., an iPhone camera). However, the software isn't perfect, and many artifacts still exist in the images. For example, Google had a person carry a Dodeca 360 camera (provided by Immersive Media) around the Grand Canyon and had to hire programmers to correct the images frame by frame for artifacts caused by parallax.

光学系统的视差和主光线Parallax and chief rays in optical systems

视差被定义为“当从不同位置观看(例如通过取景器和相机的镜头)时物体的位置或方向看起来不同的效果”。视差是由于将来自多个相机的图像拼接在一起而导致的,每个图像具有其自己唯一的外界视角。Parallax is defined as “the effect whereby the position or orientation of an object appears different when viewed from different positions (such as through a viewfinder and a camera’s lens).” Parallax results from stitching together images from multiple cameras, each with its own unique perspective of the outside world.

参照图1,光学系统的主光线是开始于物体的边缘、在孔径光阑处与光轴的中心相交、并在检测器处在图像的边缘结束的子午射线。从而,主光线限定了图像的尺寸。1 , the chief ray of an optical system is a meridional ray that starts at the edge of the object, intersects the center of the optical axis at the aperture stop, and ends at the edge of the image at the detector. Thus, the chief ray defines the size of the image.

主光线在由将多个图像拼接在一起所产生的视差中起关键作用。图2图示了并排的两个光学系统(相机)。对于顶部上的镜头单元,正方形、三角形和矩形被映射至图像中的同一点,而对于底部上的镜头单元,它们被映射至三个不同点,如所示的。在顶部成像系统中,它们由同一主光线成像,而对于底部成像系统,它们由三个不同的主光线成像。当组合图3中的两张图像时,将产生视差,并且将导致如图4中所示的图像。Chief rays play a key role in the parallax produced by stitching together multiple images. Figure 2 illustrates two optical systems (cameras) side by side. For the lens unit on the top, the square, triangle, and rectangle are mapped to the same point in the image, while for the lens unit on the bottom, they are mapped to three different points, as shown. In the top imaging system, they are imaged by the same chief ray, while for the bottom imaging system, they are imaged by three different chief rays. When the two images in Figure 3 are combined, parallax will occur, resulting in the image shown in Figure 4.

对可以校正视差的算法的寻找已经持续了很多年。已经提出了很多方案,但即使是使用迄今为止最精细的算法,全景图像中仍然留下了伪像。有时,这可能不是问题,因为可以雇佣软件工程师来逐帧地修复图像;然而,对于一般消费者而言,这种对每张图像进行校正的选项是不可行的。需要一种在使这种系统对于消费者市场可用之前有效地校正视差的更好方案。优选的是在光学上解决减少图像中视差的问题,而不是在计算上。The search for an algorithm that can correct for parallax has been ongoing for many years. Numerous approaches have been proposed, but even with the most sophisticated algorithms to date, artifacts remain in panoramic images. Sometimes, this isn't a problem, as software engineers can be hired to repair the images frame by frame; however, for the average consumer, this option of correcting each image is not feasible. A better approach to effectively correcting parallax is needed before such a system can be made available to the consumer market. It would be preferable to address the problem of reducing parallax in images optically, rather than computationally.

针对单次拍摄全景成像创建的当前设计受到视差的损害,因为它们是从具有重叠视场的成像系统中创建的。图5取自美国专利2,696,758。这幅图图示了目前可用的360度成像系统中视差是怎样产生的。视场重叠,并且出现在底部镜头系统的FOV边缘处的三角形将以顶部的成像系统中的FOV的约0.707倍出现。从而,对于每个相机,该三角形被映射至不同的图像点。在底部,它被映射至全FOV(图像的边缘)。Current designs created for single-shot panoramic imaging suffer from parallax because they are created from imaging systems with overlapping fields of view. Figure 5 is taken from U.S. Patent 2,696,758. This figure illustrates how parallax arises in currently available 360-degree imaging systems. The fields of view overlap, and a triangle appearing at the edge of the FOV of the bottom lens system will appear at approximately 0.707 times the FOV in the top imaging system. Thus, the triangle is mapped to a different image point for each camera. At the bottom, it is mapped to the full FOV (the edge of the image).

因而,发明人已经意识到不存在视差并且通过光学地而非通过后处理软件来消除视差的全景成像系统及相关联方法的优点和益处。这种系统将具有各种应用,包括:提供可缩放方式来对行星街道进行绘图;允许创建城市的和私有机构的两者的虚拟旅行;高帧率视频监控;包括靶机和坦克技术的军事应用;针对以高失真代价提供广角成像的鱼眼镜的替代方案。Thus, the inventors have recognized the advantages and benefits of a panoramic imaging system and associated methods that are parallax-free and eliminate parallax optically rather than through post-processing software. Such a system would have various applications, including: providing a scalable way to map planetary streets; allowing the creation of virtual tours of both cities and private institutions; high frame rate video surveillance; military applications including drones and tank technology; and an alternative to fish-eye lenses that provide wide-angle imaging at the expense of high distortion.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1图示了光学系统的主光线。该主光线限定了物体的高度以及图像的高度。Figure 1 illustrates the chief ray of an optical system. The chief ray defines the height of the object and the height of the image.

图2图示了为什么在使用多个折射成像系统来捕捉场景的图像时会产生视差。在顶部上的镜头单元中,三个物体被映射至同一图像点;在底部镜头单元中,它们被映射至三个单独的图像点。Figure 2 illustrates why parallax occurs when using multiple refractive imaging systems to capture images of a scene. In the top lens unit, three objects are mapped to the same image point; in the bottom lens unit, they are mapped to three separate image points.

图3(左侧)图示了图2中的顶部镜头单元所形成的图像,而右侧的图像是由底部镜头单元所形成的。FIG3 (left) illustrates the image formed by the top lens unit in FIG2, while the image on the right is formed by the bottom lens unit.

图4示出了将图3中的两张图像组合将产生的图像。FIG. 4 shows the image that would result from combining the two images in FIG. 3 .

图5图示了在目前设计的相机中视差是怎样发生的。视场重叠,并且出现在底部镜头系统的FOV边缘处的三角形将以顶部的成像系统中的FOV的约 0.707倍出现。从而,对于每个相机,该三角形被映射至不同的图像点。在底部,它被映射至全FOV(图像的边缘)。Figure 5 illustrates how parallax occurs in currently designed cameras. The fields of view overlap, and a triangle appearing at the edge of the FOV in the bottom lens system will appear at approximately 0.707 times the FOV in the top imaging system. Consequently, this triangle is mapped to a different image point for each camera. In the bottom camera, it is mapped to the full FOV (the edge of the image).

图6图示了没有视差的两个并排的成像系统。每个系统边缘处的主光线被限制为彼此平行。从而,位于沿着这条线的物体被成像至图像平面中的同一点。Figure 6 illustrates two side-by-side imaging systems with no parallax. The principal rays at the edge of each system are constrained to be parallel to each other. Thus, objects located along this line are imaged to the same point in the image plane.

图7图示了对于所示出的这两个成像系统的无视差(NP)点(如下文所定义的)的位置。FIG. 7 illustrates the location of the no-parallax (NP) point (as defined below) for the two imaging systems shown.

图8示出了FOV边缘处的主光线不平行,因而NP点位于不同位置。Figure 8 shows that the principal rays at the edge of the FOV are not parallel, so the NP points are located at different positions.

图9图示了具有位于图像传感器前方的NP点的成像系统。FIG9 illustrates an imaging system with an NP point located in front of the image sensor.

图10图示了两个成像系统,这两个成像系统被对准从而使得每个FOV边缘处的主光线彼此平行。FIG10 illustrates two imaging systems aligned so that the chief rays at the edge of each FOV are parallel to each other.

图11示出了具有在图像平面后方的NP点的成像系统。FIG11 shows an imaging system with an NP point behind the image plane.

图12示出了具有共同定位的NP点的多单元成像系统。FIG12 shows a multi-unit imaging system with co-located NP dots.

图13示出了具有被限制成沿着每个十二面体面的边缘光线的360度镜头系统的3维表示。FIG13 shows a 3-dimensional representation of a 360 degree lens system with edge rays constrained to be along each dodecahedron face.

图14示出了内切于五边形中的圆,图示了如果镜头是圆的而非五边形的话将产生盲点。Figure 14 shows a circle inscribed in a pentagon, illustrating the blind spot that would result if the lens were round rather than pentagonal.

图15示出了每个系统的第一镜头元件,初始地被设计为外接规则五边形。Figure 15 shows the first lens element of each system, initially designed as a circumscribed regular pentagon.

图16:第一镜头元件的直径被限制为1.7013a,其中,a是规则五边形的边长。Figure 16: The diameter of the first lens element is limited to 1.7013a, where a is the side length of a regular pentagon.

图17:从第一镜头元件的中心到十二面体的中心(NP点)的距离是1.1135a,其中,a是五边形的边长。Figure 17: The distance from the center of the first lens element to the center of the dodecahedron (NP point) is 1.1135a, where a is the side length of the pentagon.

图18:从五边形面的顶部到NP点的距离被限制为1.31a,其中,a是规则五边形的边长。在此,NP点是十二面体的中心。Figure 18: The distance from the top of a pentagonal face to the NP is limited to 1.31a, where a is the side length of a regular pentagon. Here, the NP is the center of the dodecahedron.

图19:图示了相对于十二面体的中心施加于第一镜头元件的限制的简图。“a”是十二面体中每个规则五边形的边长。Figure 19: A simplified diagram illustrating the constraints imposed on the first lens element relative to the center of a dodecahedron. "a" is the side length of each regular pentagon in the dodecahedron.

图20:图示了任何元件的最大长度被限制为适配在从十二面体的中心传出的31.717度半角光锥内的简图。Figure 20: A simplified diagram illustrating that the maximum length of any element is constrained to fit within the 31.717 degree half-angle cone of light emanating from the center of the dodecahedron.

图21:十二面体的1/12的三维表示,以及十二面体中心与五边形边的中心之间的角度。Figure 21: A three-dimensional representation of 1/12 of a dodecahedron and the angle between the center of the dodecahedron and the center of the pentagonal edge.

图22:十二面体的1/12的三维表示,以及十二面体中心与五边形边的边缘之间的角度。Figure 22: A three-dimensional representation of 1/12 of a dodecahedron and the angles between the center of the dodecahedron and the edges of the pentagonal sides.

图23:五边形形状镜头元件,示出了到光线1和光线37的高度。Figure 23: Pentagonal shaped lens element showing the height to Ray 1 and Ray 37.

图24:当前镜头设计的Zemax图,示出了模型中的光线1和光线37。Figure 24: Zemax plot of the current lens design, showing ray 1 and ray 37 in the model.

图25:后视的当前镜头设计的三维Zemax图。Figure 25: 3D Zemax plot of the current lens design from the rear view.

图26:侧视的三维Zemax图。Figure 26: 3D Zemax plot from the side view.

发明内容Summary of the Invention

本发明的一方面是一种没有视差的多相机全景成像系统。根据非限制性实施例,该多相机全景成像系统包括被布置为并排阵列的多个分立成像系统,其中,每个分立成像系统的视场与每个相邻的分立成像系统的视场相连结,进一步其中,在这些分立成像系统中任何一个分立成像系统的视场边缘处的主光线模版将基本上平行于在这些分立成像系统中的任何相邻的分立成像系统的视场边缘处的主光线模版,这样使得当从物体空间观看时所有基本上平行的主光线模版看起来会聚至公共点。在各个非限制性实施例中,该多相机全景成像系统可以包括或者进一步由以下特征、限制、特性来表征,或者单独地或者以其各种组合:One aspect of the present invention is a multi-camera panoramic imaging system with no parallax. According to a non-limiting embodiment, the multi-camera panoramic imaging system includes a plurality of discrete imaging systems arranged in a side-by-side array, wherein the field of view of each discrete imaging system is connected to the field of view of each adjacent discrete imaging system, and further wherein the chief ray template at the edge of the field of view of any discrete imaging system in the discrete imaging systems will be substantially parallel to the chief ray template at the edge of the field of view of any adjacent discrete imaging system in the discrete imaging systems, such that all substantially parallel chief ray templates appear to converge to a common point when viewed from object space. In various non-limiting embodiments, the multi-camera panoramic imaging system may include or be further characterized by the following features, limitations, characteristics, either alone or in various combinations thereof:

-包括多个完全相同的分立成像系统;-comprising multiple identical discrete imaging systems;

-其中,该主光线模版的至少50%偏离平行20度或更少;- wherein at least 50% of the main ray template deviates from parallel by 20 degrees or less;

-其中,这些分立成像系统中的每一个分立成像系统包括图像传感器,进一步其中,表观会聚点位于这些分立成像系统中的每一个分立成像系统的图像传感器后方;-其中,这些分立成像系统都不物理地重叠;- wherein each of the separate imaging systems comprises an image sensor, further wherein the apparent convergence point is located behind the image sensor of each of the separate imaging systems; - wherein none of the separate imaging systems physically overlap;

-其中,该系统具有十二面体几何结构,进一步其中,该系统由360度FOV 来表征;- wherein the system has a dodecahedral geometry, further wherein the system is characterized by a 360 degree FOV;

-其中,这些分立成像系统中的每一个分立成像系统的前镜头是单个连续自由形态光学器件的一部分;- wherein the front lens of each of the discrete imaging systems is part of a single continuous freeform optical device;

-其中,每个图像传感器是波前传感器;- wherein each image sensor is a wavefront sensor;

-其中,这些分立成像系统中的每一个分立成像系统具有弯曲图像平面,从而与该成像系统的失真和佩兹伐(Petzval)曲率相匹配。- wherein each of the separate imaging systems has a curved image plane so as to match the distortion and Petzval curvature of the imaging system.

发明的一方面是一种用于形成没有视差的物体图像的方法。根据非限制性实施例,该方法包括:提供全景成像系统,其中,该全景成像系统包括多个分立成像系统,每一个分立成像系统由视场来表征:以及将在这些分立成像系统中的每一个分立成像系统的视场边缘处的主光线模版限制为基本上平行于在这些分立成像系统中紧邻的一个分立成像系统的视场边缘处的主光线模版,这样使得当从物体空间观看时所有平行的主光线模版看起来会聚至公共点,其中,该成像系统是无视差的。在各个非限制性实施例中,该全景成像方法可以包括或者进一步由以下特征、限制、特性、步骤来表征,或者单独地或者以其各种组合:One aspect of the invention is a method for forming an image of an object without parallax. According to a non-limiting embodiment, the method includes: providing a panoramic imaging system, wherein the panoramic imaging system includes a plurality of discrete imaging systems, each discrete imaging system being characterized by a field of view; and constraining a chief ray template at an edge of the field of view of each of the discrete imaging systems to be substantially parallel to a chief ray template at an edge of the field of view of an immediately adjacent one of the discrete imaging systems, such that all parallel chief ray templates appear to converge to a common point when viewed from object space, wherein the imaging system is parallax-free. In various non-limiting embodiments, the panoramic imaging method may include or be further characterized by the following features, limitations, characteristics, steps, either alone or in various combinations thereof:

-进一步包括限制该主光线模版的至少50%偏离平行20度或更少;- further comprising constraining at least 50% of the main ray template to deviate from parallel by 20 degrees or less;

-进一步包括:使用算法对由该成像系统所形成的连续360度图像中的失真像差进行校正。- Further comprising: using an algorithm to correct distortion aberrations in the continuous 360-degree images formed by the imaging system.

发明的一方面是一种用于设计(基本上)无视差的全景成像系统的方法。根据非限制性实施例,该方法包括:确定整体全景成像系统几何结构,其中,该整体全景成像系统包括具有对应视场的多个分立成像系统,这些分立成像系统被布置为并排阵列,这样使得相邻成像系统的视场相连结;将这些分立成像系统设计为使得在这些分立成像系统中的每一个分立成像系统的视场边缘处的主光线模版将基本上平行于在这些分立成像系统中相邻的一个分立成像系统的视场边缘处的主光线模版,这样使得当从物体空间观看时这些基本上平行的主光线模版看起来会聚至公共点。在各个非限制性实施例中,该全景成像方法可以包括或者进一步由以下特征、限制、特性、步骤来表征,或者单独地或者以其各种组合:One aspect of the invention is a method for designing a (substantially) parallax-free panoramic imaging system. According to a non-limiting embodiment, the method includes: determining an overall panoramic imaging system geometry, wherein the overall panoramic imaging system includes a plurality of discrete imaging systems with corresponding fields of view, the discrete imaging systems being arranged in a side-by-side array such that the fields of view of adjacent imaging systems are connected; designing the discrete imaging systems such that a chief ray template at an edge of the field of view of each of the discrete imaging systems will be substantially parallel to a chief ray template at an edge of the field of view of an adjacent one of the discrete imaging systems, such that the substantially parallel chief ray templates appear to converge to a common point when viewed from object space. In various non-limiting embodiments, the panoramic imaging method may include or be further characterized by the following features, limitations, characteristics, steps, either individually or in various combinations thereof:

-其中,该整体全景成像系统包括多个完全相同的分立成像系统;- wherein the overall panoramic imaging system comprises a plurality of identical discrete imaging systems;

-其中,在设计这些分立成像系统时,保证在该多个分立成像系统中的任何分立成像系统之间不存在物理重叠;- wherein, when designing the discrete imaging systems, it is ensured that there is no physical overlap between any discrete imaging systems in the plurality of discrete imaging systems;

-其中,在设计这些分立成像系统时,保证表观会聚点位于每个分立成像系统的对应图像传感器后方。- wherein, when designing these separate imaging systems, it is ensured that the apparent convergence point is located behind the corresponding image sensor of each separate imaging system.

具体实施方式DETAILED DESCRIPTION

对于用于实现最小视差的全景相机而言,成像系统的视场(FOV)必须不重叠。因而,FOV边缘处的主光线必须接近与相邻光学系统边缘处的主光线平行的光学系统。For panoramic cameras to achieve minimal parallax, the fields of view (FOVs) of the imaging systems must not overlap. Thus, the chief rays at the edges of the FOVs must be close to the optical system parallel to the chief rays at the edges of the adjacent optical system.

图6图示了没有视差的两个并排的成像系统。每个系统边缘处的主光线被限制为彼此平行。从而,位于沿着这条线的物体被成像至图像平面中的同一点。这是一种可以用于设计单独镜头元件的方式。视场彼此不重叠,因为混合角处的主光线被限制为彼此平行并会聚至公共点。该公共点将取决于镜头被包覆成的几何结构。换言之,主光线被限制为是平行的,这样使得当从物体空间观看镜头系统时它们看起来在同一点处与光轴相交。事实上,它们在图像传感器处与光轴相交,该图像传感器位于此假想点前方,但从物体空间看向镜头系统,它们看起来在同一点处相交。Figure 6 illustrates two side-by-side imaging systems without parallax. The chief rays at the edge of each system are constrained to be parallel to each other. Thus, objects located along this line are imaged to the same point in the image plane. This is an approach that can be used to design individual lens elements. The fields of view do not overlap because the chief rays at the blend angle are constrained to be parallel to each other and converge to a common point. This common point will depend on the geometry of the lens package. In other words, the chief rays are constrained to be parallel so that they appear to intersect the optical axis at the same point when the lens system is viewed from object space. In reality, they intersect the optical axis at the image sensor, which is located in front of this imaginary point, but from object space looking towards the lens system, they appear to intersect at the same point.

NP点(无视差点)NP point (no parallax point)

为了帮助理解前述概念,我们定义了称为无视差点(NP点)的术语。NP 点是用于理解怎样可以物理地使得FOV边缘处的主光线彼此平行以及它们应该遵守什么规则的抽象。NP点是这样的点:对于无视差的全景成像系统,当从物体空间观看系统时,相邻光学系统边缘处的主光线在该点处与光轴相交。To help understand the aforementioned concepts, we define the term "parallax-free point" (NP point). The NP point is an abstraction used to understand how the principal rays at the edge of the FOV can be physically made parallel to each other and what rules they should obey. The NP point is the point where, for a parallax-free panoramic imaging system, the principal rays at the edge of the adjacent optical system intersect the optical axis when the system is viewed from object space.

根据所具体化的发明,每个成像系统的NP点必须位于同一位置。也就是说,相邻光学系统的光线必须平行。图9示出了具有位于成像传感器前方的NP 点的成像系统。图10图示了两个成像系统,这两个成像系统被对准从而使得每个的FOV边缘处的主光线彼此平行。这个限制意味着,对于这两个系统,NP 点必须在同一位置处。当NP点再图像传感器前方时,不可能在没有镜头元件重叠的情况下对准NP点。这个系统将没有任何视差,但在物理上是不可能实现的。这表明,当设计光学系统时,NP点应该位于成像系统中所有元件后方,从而使得没有元件彼此物理地重叠。According to the embodied invention, the NP point of each imaging system must be located at the same position. That is, the light rays of adjacent optical systems must be parallel. Figure 9 shows an imaging system with an NP point located in front of the imaging sensor. Figure 10 illustrates two imaging systems that are aligned so that the main rays at the edge of the FOV of each are parallel to each other. This restriction means that for both systems, the NP point must be at the same position. When the NP point is in front of the image sensor, it is impossible to align the NP point without overlapping the lens elements. This system will not have any parallax, but it is physically impossible to achieve. This shows that when designing the optical system, the NP point should be located behind all elements in the imaging system so that no elements physically overlap with each other.

图11示出了在其中NP点位于图像平面后方的系统。当情况如此时,可以将多个成像系统安排成使得视场不重叠,如图12中所示。NP点的确切位置将由镜头安排的几何结构来确定。通过任意地选取位置,即任意地选择光线高度和入射角度从而使得主光线看起来在图像平面后方与光轴相交,镜头系统的几何结构可能会需要几百个镜头单元来捕捉全360度图像。必须在考虑了希望对镜头使用的几何结构之后再确定NP点位置。Figure 11 illustrates a system in which the NP is located behind the image plane. When this is the case, multiple imaging systems can be arranged so that the fields of view do not overlap, as shown in Figure 12. The exact location of the NP will be determined by the geometry of the lens arrangement. By arbitrarily selecting the position—that is, arbitrarily choosing the ray height and angle of incidence so that the chief ray appears to intersect the optical axis behind the image plane—the geometry of the lens system may require hundreds of lens elements to capture a full 360-degree image. The NP location must be determined after considering the desired lens geometry.

本发明的实施例涉及一种多相机全景成像系统,其中,相邻成像单元的视场合并以形成整个成像系统的合成视场,如图7的示意图中所图示的。传统的全景成像系统将成像单元放在一起,其方式为使得这些成像单元的对应视场如图8的示意图中所图示那样相重合,这导致在所产生的图像中的视差,并要求校正软件来将图像拼接在一起以消除视差。Embodiments of the present invention relate to a multi-camera panoramic imaging system in which the fields of view of adjacent imaging units are combined to form a composite field of view of the entire imaging system, as illustrated in the schematic diagram of FIG7 . Conventional panoramic imaging systems place imaging units together in such a way that their corresponding fields of view coincide, as illustrated in the schematic diagram of FIG8 , which results in parallax in the resulting images and requires correction software to stitch the images together to eliminate the parallax.

在本示例性实施例中,沿一个成像单元的边缘照射的光线被限制为平行于相邻成像单元的入射光线,从而使得两个成像系统共享同一组边缘射线。如图 13的3维模型中所见,一个成像单元边缘处的光线与相邻成像单元边缘处的那些光线相同。这些光线是被限制成沿着十二面体边的表面的灰色线。在每个五边形形状镜头的边缘处的灰线与进入其附近表面的光线相一致。边缘光线下方半径处的所有光线采用更小的入射角,从而使得这些光线与来自相邻系统的光线不重叠。In this exemplary embodiment, light rays incident along the edge of one imaging unit are constrained to be parallel to the incident rays of the adjacent imaging unit, allowing both imaging systems to share the same set of edge rays. As shown in the 3D model in Figure 13, the light rays at the edge of one imaging unit are identical to those at the edge of the adjacent imaging unit. These rays are the gray lines confined to the surface along the edges of the dodecahedron. The gray lines at the edge of each pentagonal lens correspond to the light rays entering its adjacent surface. All light rays at radii below the edge rays have smaller angles of incidence, preventing them from overlapping with light rays from the adjacent system.

具体化的全景成像系统利用将成像系统设计为具有位于图像传感器后方 NP点的前述技术,并将十二面体几何结构中的多个镜头系统组合从而创建具有最小视差或无视差的360度FOV。The embodied panoramic imaging system utilizes the aforementioned technology of designing the imaging system with an NP point located behind the image sensor, and combines multiple lens systems in a dodecahedron geometry to create a 360-degree FOV with minimal or no parallax.

第一镜头元件将被成形为规则五边形的表面。完整的系统将由12个分立成像单元构成,对于沿着五边形边缘并且被限制为具有满足由十二面体的几何结构所指定的几何结构的入射角的光线,每个成像单元具有公共NP点。The first lens element will be shaped as the surface of a regular pentagon. The complete system will consist of 12 discrete imaging units, each with a common NP for light rays along the edges of the pentagon and constrained to have angles of incidence that satisfy the geometry specified by the geometry of the dodecahedron.

十二面体是具有12个表面的多面体。多面体是由在边缘处结合的多边形集合组成的三维立方体。十二面体的每一侧都是规则五边形(具有相等长度边的五边形)。十二面体具有一些重要的几何性质,为了设计利用该几何结构的镜头系统,必须理解这些几何性质。在简单地讨论第一镜头为什么必须被成形为五边形表面之后,接下来将依次讨论这些性质。The dodecahedron is a polyhedron with 12 faces. A polyhedron is a three-dimensional cube composed of a collection of polygons joined at its edges. Each side of the dodecahedron is a regular pentagon (a pentagon with equal-length sides). The dodecahedron has several important geometric properties that must be understood in order to design lens systems that utilize this geometry. After briefly discussing why the first lens must be formed with pentagonal faces, these properties will be discussed in turn.

通过使用被圆形磨边的镜头作为十二面体几何结构中的第一元件,不可能使用目前的对准边缘光线的技术来捕捉360度视场内的所有信息。第一镜头内切于五边形(图14中的阴影区域)中所产生的丢失区域导致了盲点。由于视场从不重叠,此信息永远不被捕捉到。可以计算出,圆的面积与它所内切于的五边形的面积之比等于π/5或62.83%。这是针对在我们周围360度视场我们可以记录的最大信息量。镜头与五边形之间导致的盲点删除了360度图像中接近 40%的信息。By using a circularly edged lens as the first element in the dodecahedron geometry, it's impossible to capture all the information within the 360-degree field of view using current edge-ray alignment techniques. The missing area created by the first lens inscribed within the pentagon (the shaded area in Figure 14) creates a blind spot. Since the fields of view never overlap, this information is never captured. It can be calculated that the ratio of the area of the circle to the area of the pentagon it inscribes is equal to π/5, or 62.83%. This is the maximum amount of information we can record for the 360-degree field of view around us. The blind spot created between the lens and the pentagon removes nearly 40% of the information in the 360-degree image.

以下说明旨在图示十二面体的几何结构,并且在利用前述NP技术和十二面体几何结构创建镜头系统时是必要的,但对于创建本文所具体化的无视差全景成像系统的目的是不必要的。The following description is intended to illustrate the geometry of the dodecahedron and is necessary when creating a lens system utilizing the aforementioned NP technology and the dodecahedron geometry, but is not necessary for the purpose of creating the parallax-free panoramic imaging system embodied herein.

性质1:外接规则五边形的圆的直径Property 1: The diameter of the circle circumscribing a regular pentagon

对于这12个单独的镜头系统中的每一个,第一镜头将被设计成使得其外接如图15中所示的十二面体的规则五边形中的每一个。外接规则五边形的圆的直径是:For each of these 12 individual lens systems, the first lens will be designed so that it circumscribes each of the regular pentagons of the dodecahedron shown in Figure 15. The diameter of the circle circumscribing the regular pentagon is:

D=a/sin(36°)=1.7013aD=a/sin(36°)=1.7013a

在上述等式中,“a”是规则五边形的边长。每个系统的第一镜头元件将完全地外接每个五边形,并且因此每个系统的第一镜头元件的直径被给出为 1.7013a,如图16中所图示的。In the above equation, "a" is the side length of a regular pentagon. The first lens element of each system will completely circumscribe each pentagon, and therefore the diameter of the first lens element of each system is given as 1.7013a, as illustrated in Figure 16.

性质2:与每个五边形的中心接触的内切球体Property 2: An inscribed sphere touching the center of each pentagon

(与十二面体的面的每一个相切的)内切球体的半径是:The radius of the inscribed sphere (tangent to each of the faces of the dodecahedron) is:

此半径是距十二面体中心(在本设计中该中心将是每个镜头的NP点)和五边形的面的中心(与占据这个五边形的系统中的第一镜头元件的中心(光轴) 一致)的距离。这个点位于每个五边形面的中心处。该NP点与十二面体中心之间的长度被限制为1.1135a,其中,a是五边形边之一的长度,如图17中所图示的。This radius is the distance from the center of the dodecahedron (which will be the NP point for each lens in this design) and the center of the pentagonal face (coinciding with the center (optical axis) of the first lens element in the system occupying this pentagon). This point is located at the center of each pentagonal face. The length between the NP point and the dodecahedron center is limited to 1.1135a, where a is the length of one of the pentagonal sides, as illustrated in Figure 17.

性质3:十二面体的中半径Property 3: Median radius of a dodecahedron

该中半径是连接十二面体中心与每个边中部的点。如下给出了这个长度:The median radius is the point connecting the center of the dodecahedron to the middle of each edge. This length is given by:

这个等式限制了五边形面的顶部与NP点之间的距离,如图18中所图示的。限制This equation limits the distance between the top of the pentagonal face and the NP point, as shown in Figure 18. Limit

十二面体的几何性质限制了将具体化该十二面体的12个镜头的设计。具体地,在上文给出的说明的基础上,我们具有以下四个参数:The geometric properties of the dodecahedron constrain the design of the 12 lenses that will materialize the dodecahedron. Specifically, based on the description given above, we have the following four parameters:

1.第一镜头元件的直径:1.7013a;1. Diameter of the first lens element: 1.7013a;

2.从第一镜头元件到十二面体中心的距离:1.1135a;2. Distance from the first lens element to the center of the dodecahedron: 1.1135a;

3.从第一镜头元件顶部到十二面体中心的距离:1.31a;3. Distance from the top of the first lens element to the center of the dodecahedron: 1.31a;

4.FOV=37.3777度4.FOV=37.3777 degrees

给定前三条限制中任何两条,我们得到镜头的光轴与第一镜头元件的顶部之间的角度是37.3777度(见图19):Given any two of the first three constraints, we get the angle between the optical axis of the lens and the top of the first lens element to be 37.3777 degrees (see Figure 19):

tan-1((1.7013/2)/1.1135)-37.377°。tan -1 ((1.7013/2)/1.1135)-37.377°.

我们希望这个37.37度的角度是镜头的视场。这将保证NP点位于十二面体的中心,该NP点是混合(混合角度是全FOV)的主光线与物体空间中的光轴相交的点。所有其他限制将保证镜头元件位于NP点的前方,并且元件落在 31.717度半角光锥内。We want this 37.37 degree angle to be the field of view of the lens. This will ensure that the NP point is at the center of the dodecahedron, which is the point where the chief rays of the blend (the blend angle is the full FOV) intersect the optical axis in object space. All other restrictions will ensure that the lens elements are located in front of the NP point and that the elements fall within the 31.717 degree half-angle light cone.

其他镜头元件和传感器的直径Diameters of other lens elements and sensors

利用上文所给出的这四条限制,我们知道了第一镜头元件之后的每个镜头元件必须是什么尺寸以便适配至十二面体几何结构中。为了使得前述的镜头元件适配,任何镜头和传感器元件必须适配在开始于十二面体的中心并与第一镜头元件的直径相切的31.717度光锥内部。随着与第一镜头元件的距离增大,前述镜头元件的直径将成比例地减小(见图20)。Using the four constraints given above, we know what size each lens element after the first must be in order to fit within the dodecahedron geometry. In order for the lens elements to fit, any lens and sensor element must fit within a 31.717-degree cone of light that begins at the center of the dodecahedron and is tangent to the diameter of the first lens element. As the distance from the first lens element increases, the diameter of the lens elements decreases proportionally (see Figure 20).

可以发现第一镜头元件之前的任何镜头元件或传感器的最大直径在几何上小于或等于(1.1135a-D)*tan(31.716度),其中,D是这个元件与第一镜头元件的距离。It can be found that the maximum diameter of any lens element or sensor before the first lens element is geometrically less than or equal to (1.1135a-D)*tan(31.716 degrees), where D is the distance of this element from the first lens element.

因而,我们现在具有五条限制,这五条限制将允许此镜头系统与十二面体的几何结构相匹配并允许360度成像:Thus, we now have five constraints that will allow this lens system to fit into the geometry of the dodecahedron and allow 360-degree imaging:

1.第一镜头元件的直径:1.3763a;1. Diameter of the first lens element: 1.3763a;

2.从第一镜头元件到十二面体中心的距离:1.1135a;2. Distance from the first lens element to the center of the dodecahedron: 1.1135a;

3.从第一镜头元件顶部到十二面体中心的距离:1.31a;3. Distance from the top of the first lens element to the center of the dodecahedron: 1.31a;

4.FOV=37.377度;4.FOV=37.377 degrees;

5.5.

其中,是与第一镜头元件被分开距离DL1,Li的任何镜头元件的直径。给定上述五条限制,在所有镜头被设计成使得它们都落在从十二面体中心发出的 31.717度光锥内的情况下,可以构造出无视差的镜头系统。Where is the diameter of any lens element separated from the first lens element by a distance DL1 ,Li . Given the above five constraints, a parallax-free lens system can be constructed if all lenses are designed so that they fall within a 31.717 degree light cone emanating from the center of the dodecahedron.

系统设计System Design

选择这些镜头的几何结构。理想立方体具有以下性质:它们是由许多具有相等几何结构和体积的立方体构成的。对于360度成像的系统,这允许以相同重复的镜头设计来制造合成的成像系统。选择了十二面体几何结构,因为十二面体在其几何结构上是近似球体的。The geometry of these lenses was chosen. Ideal cubes have the property that they are constructed from many cubes of equal geometry and volume. For 360-degree imaging systems, this allows for the creation of a composite imaging system with identical, repeating lens designs. The dodecahedron geometry was chosen because it approximates a sphere in its geometry.

为了使一个成像单元的边缘光线与相邻单元的边缘光线平行,它们必须以相同的角度进入。这两个成像单元所共享的角度是十二面体边缘表面的角度。在边缘表面的中心,相对于十二面体中心的角度是31.717度,如图21中所图示的。在边缘表面的角落,相对于十二面体中心的角度是37.377度,如图22 中所图示的。In order for the edge rays of one imaging element to be parallel to those of the adjacent element, they must enter at the same angle. The angle shared by these two imaging elements is the angle of the edge surface of the dodecahedron. At the center of the edge surface, the angle relative to the center of the dodecahedron is 31.717 degrees, as illustrated in Figure 21. At the corners of the edge surface, the angle relative to the center of the dodecahedron is 37.377 degrees, as illustrated in Figure 22.

为了使沿着相邻成像单元的光线相匹配,成像单元的第一镜头被切为五边形,从而与十二面体的表面相匹配。在边缘的中心处,沿表面照射的光线以 31.717度的入射角进入。在边缘的角落,进入光线的入射角是37.377。在沿着镜头边缘的所有点处,使进入光线的入射角度与十二面体表面的几何结构相匹配。To align light rays along adjacent imaging units, the first lens of each imaging unit is cut into a pentagonal shape to match the surface of a dodecahedron. At the center of the edge, light rays incident along the surface enter at an angle of incidence of 31.717 degrees. At the corners of the edge, the angle of incidence of the incoming light rays is 37.377 degrees. At all points along the lens edge, the angle of incidence of the incoming light rays matches the geometry of the dodecahedron surface.

已知从十二面体的中心到五边形面的中心的距离,并且已知十二面体的中心到如图21和图22中所示的所讨论的边缘点的距离,使用三角函数计算沿着五边形镜头的边缘的37条光线的入射角。每条光线的高度被限制为沿着五边形边。例如,利用描述表面1的外接圆的半径120mm,点1处的光线具有48.54mm 的高度和31.717度的入射角。点37处的光线具有60mm的高度和37.377度的入射角。表I描述了针对图23中的点1与点36之间的37个点的光线高度和入射角。Knowing the distance from the center of the dodecahedron to the center of the pentagonal face, and knowing the distance from the center of the dodecahedron to the edge points discussed as shown in Figures 21 and 22, trigonometric functions are used to calculate the angles of incidence of the 37 light rays along the edge of the pentagonal lens. The height of each ray is constrained to be along the pentagonal side. For example, using a radius of 120 mm for the circumscribed circle describing surface 1, the ray at point 1 has a height of 48.54 mm and an angle of incidence of 31.717 degrees. The ray at point 37 has a height of 60 mm and an angle of incidence of 37.377 degrees. Table 1 describes the ray heights and angles of incidence for the 37 points between points 1 and 36 in Figure 23.

表ITable I

(数据表明对沿着第一镜头边缘的37条光线的限制)(The data shows a limit of 37 rays along the edge of the first lens)

图24中示出了简图,图示了这些光线限制。光线1具有48.54mm的高度和31.717度的入射角。光线1是穿过图24中的点1的光线。光线2具有60mm 的高度和37.377度的入射角,并且是穿过图24中的点37的光线。所有37条光线由上表中所指定的光线高度和角度来限制。以这种方式进行限制,所有光线以与十二面体的表面相同的角度进入镜头。用另一种方式来看那些相同的光线,我们可知,光线被以正确的入射角恰当地限制到五边形几何结构,如图25 和图26中所图示的。A simplified diagram illustrating these ray constraints is shown in Figure 24. Ray 1 has a height of 48.54 mm and an angle of incidence of 31.717 degrees. Ray 1 is the ray that passes through point 1 in Figure 24. Ray 2 has a height of 60 mm and an angle of incidence of 37.377 degrees and is the ray that passes through point 37 in Figure 24. All 37 rays are constrained by the ray heights and angles specified in the table above. Constrained in this way, all rays enter the lens at the same angle as the surfaces of the dodecahedron. Looking at those same rays another way, we can see that the rays are properly confined to the pentagonal geometry at the correct angles of incidence, as illustrated in Figures 25 and 26.

Claims (14)

1.一种用于形成全景图像的方法,所述方法包括:1. A method for forming a panoramic image, the method comprising: 提供全景成像系统,所述全景成像系统具有被布置为并排阵列的多个分立成像系统,所述分立成像系统中的每一个分立成像系统由视场来表征;以及A panoramic imaging system is provided, the panoramic imaging system having multiple discrete imaging systems arranged in a side-by-side array, each of the discrete imaging systems being characterized by a field of view; and 将沿着所述分立成像系统中的每一个分立成像系统的视场边缘照射的多条主光线限制为基本上平行于沿着所述分立成像系统中紧邻的一个分立成像系统的视场的相邻边缘照射的另外多条主光线,这样使得当从物体空间观看时沿着所述分立成像系统的视场边缘照射的所有主光线看起来会聚至公共点,并且所述多个分立成像系统中的每一个分立成像系统的视场与所述分立成像系统中的所述紧邻的一个分立成像系统的视场相连结但不重叠。Multiple principal rays illuminating along the field of view edge of each of the discrete imaging systems are restricted to be substantially parallel to additional principal rays illuminating along the adjacent edge of the field of view of the next adjacent discrete imaging system. This makes all principal rays illuminating along the field of view edge of the discrete imaging systems appear to converge to a common point when viewed from object space, and the field of view of each of the multiple discrete imaging systems is connected to but does not overlap with the field of view of the next adjacent discrete imaging system. 2.如权利要求1所述的方法,进一步包括:将沿着相邻分立成像系统的视场的相邻边缘照射的所述主光线的至少50%限制为偏离平行20度或更少。2. The method of claim 1, further comprising: limiting at least 50% of the principal rays illuminating along adjacent edges of the field of view of adjacent discrete imaging systems to a deviation from parallelism by 20 degrees or less. 3.如权利要求1所述的方法,其中,所述分立成像系统中的每一个分立成像系统与所述分立成像系统中紧邻着的一个分立成像系统共享沿着所述视场边缘照射的同一组主光线。3. The method of claim 1, wherein each of the discrete imaging systems shares the same set of principal rays illuminating along the edge of the field of view with the discrete imaging system immediately adjacent to it. 4.如权利要求1所述的方法,其中,所述多个分立成像系统中的每一个分立成像系统是完全相同的。4. The method of claim 1, wherein each of the plurality of discrete imaging systems is identical. 5.如权利要求1所述的方法,其中,提供所述全景成像系统的步骤包括:5. The method of claim 1, wherein the step of providing the panoramic imaging system comprises: 将所述并排阵列配置成具有中心的三维几何形状,The side-by-side array is configured into a three-dimensional geometry with a center. 为所述多个分立成像系统中的每一个分立成像系统配置具有多个边缘的前镜头,所述多个边缘相对于所述三维几何形状的所述中心和所述前镜头的中点在沿着所述边缘的点处限定多个边缘表面角度,以及Each of the plurality of discrete imaging systems is configured with a front lens having a plurality of edges, the plurality of edges defining a plurality of edge surface angles at points along the edges relative to the center of the three-dimensional geometry and the midpoint of the front lens. 将所述多个边缘中的每一个边缘配置成与相邻前镜头中的相邻边缘是相邻的,并且Each of the plurality of edges is configured to be adjacent to an adjacent edge in the adjacent front lens, and 对沿着所述视场边缘照射的所述多条主光线进行限制的步骤包括将沿着所述边缘的所述多条主光线中的每一条主光线的入射角与沿着所述相邻边缘的所述边缘表面角度相匹配。The step of limiting the plurality of principal rays illuminating along the edge of the field of view includes matching the angle of incidence of each of the plurality of principal rays along the edge to the edge surface angle along the adjacent edge. 6.如权利要求5所述的方法,其中,所述三维形状是十二面体,并且所述分立成像系统中的每一个分立成像系统中的所述前镜头被配置成具有五边形形状,其中,所述五边形形状的边缘具有长度a,外接所述五边形形状的圆的直径等于a/sin(36°)=1.7013a,内切于所述十二面体内的球体的直径等于:6. The method of claim 5, wherein the three-dimensional shape is a dodecahedron, and the front lens in each of the discrete imaging systems is configured to have a pentagonal shape, wherein the edge of the pentagonal shape has a length a, the diameter of the circle circumscribed in the pentagonal shape is equal to a/sin(36°) = 1.7013a, and the diameter of the sphere inscribed in the dodecahedron is equal to: 并且从所述十二面体的中心到所述前镜头的边上中点的距离等于And the distance from the center of the dodecahedron to the midpoint of the edge of the front lens is equal to 7.一种多相机全景成像系统,包括:7. A multi-camera panoramic imaging system, comprising: 由视场表征并被布置为并排阵列的多个分立成像系统,其中,所述分立成像系统中的每一个分立成像系统的视场与每个相邻的分立成像系统的视场相连结但不重叠,所述分立成像系统中的每一个分立成像系统包括前镜头,所述前镜头被配置成用于将沿着所述分立成像系统中任何一个分立成像系统的视场边缘照射的多条主光线限制为基本上平行于沿着所述分立成像系统中紧邻的一个分立成像系统的视场的相邻边缘照射的另外多条主光线,这样使得当从物体空间观看时沿着所述分立成像系统中的每一个分立成像系统的视场边缘照射的所有主光线看起来会聚至公共点。Multiple discrete imaging systems, characterized by their fields of view and arranged in a side-by-side array, wherein the field of view of each discrete imaging system is connected to but does not overlap with the field of view of each adjacent discrete imaging system, and each discrete imaging system includes a front lens configured to limit multiple principal rays illuminating along the edge of the field of view of any one of the discrete imaging systems to be substantially parallel to additional principal rays illuminating along the adjacent edge of the field of view of an adjacent discrete imaging system, such that when viewed from object space, all principal rays illuminating along the edge of the field of view of each of the discrete imaging systems appear to converge to a common point. 8.如权利要求7所述的多相机全景成像系统,其中,沿着相邻分立成像系统的视场的相邻边缘照射的所述主光线的至少50%偏离平行20度或更少。8. The multi-camera panoramic imaging system of claim 7, wherein at least 50% of the principal rays irradiated along adjacent edges of the field of view of adjacent discrete imaging systems deviate from parallel by 20 degrees or less. 9.如权利要求7所述的多相机全景成像系统,其中,所述并排阵列形成具有中心的三维几何形状,所述分立成像系统中的每一个分立成像系统中的所述前镜头具有多个边缘,所述多个边缘相对于所述三维几何形状的所述中心和所述前镜头的中点在沿着所述边缘的点处限定多个边缘表面角度,所述多个边缘中的每个边缘被配置成与相邻前镜头中的相邻边缘是相邻的,并且沿着所述多个边缘中的每一个的边缘中的沿着所述边缘的所述多个边缘表面角度与沿着所述相邻前镜头中所述相邻边缘的所述多条主光线中的每一条主光线的入射角度相匹配。9. The multi-camera panoramic imaging system of claim 7, wherein the side-by-side array forms a three-dimensional geometry with a center, the front lens in each of the discrete imaging systems has a plurality of edges, the plurality of edges defining a plurality of edge surface angles at points along the edges relative to the center of the three-dimensional geometry and the midpoint of the front lens, each of the plurality of edges being configured to be adjacent to an adjacent edge in an adjacent front lens, and the plurality of edge surface angles along the edges of each of the plurality of edges matching the incident angle of each of the plurality of principal rays along the adjacent edge in the adjacent front lens. 10.如权利要求9所述的多相机全景成像系统,10. The multi-camera panoramic imaging system as described in claim 9, 其中,所述三维形状是十二面体,并且所述分立成像系统中的每一个分立成像系统中的所述前镜头被配置成具有五边形形状,其中,所述五边形形状的边缘具有长度a,外接所述五边形形状的圆的直径等于a/sin(36°)=1.7013a,内切于所述十二面体内的球体的直径等于:Wherein, the three-dimensional shape is a dodecahedron, and the front lens in each of the discrete imaging systems is configured to have a pentagonal shape, wherein the edge of the pentagonal shape has a length 'a', the diameter of the circle circumscribed in the pentagonal shape is equal to a/sin(36°) = 1.7013a, and the diameter of the sphere inscribed in the dodecahedron is equal to: 并且从所述十二面体的中心到所述前镜头的边上中点的距离等于And the distance from the center of the dodecahedron to the midpoint of the edge of the front lens is equal to 11.如权利要求7所述的多相机全景成像系统,其中,所述分立成像系统中的每一个分立成像系统的前镜头是单个连续自由形态光学器件的一部分。11. The multi-camera panoramic imaging system of claim 7, wherein the front lens of each discrete imaging system in the discrete imaging system is part of a single continuous freeform optical device. 12.如权利要求7所述的多相机全景成像系统,其中,所述分立成像系统中的每一个分立成像系统具有弯曲图像平面,从而与所述成像系统的失真和佩兹伐曲率相匹配。12. The multi-camera panoramic imaging system of claim 7, wherein each of the discrete imaging systems has a curved image plane to match the distortion and petzvar curvature of the imaging system. 13.如权利要求7所述的多相机全景成像系统,其中,所述分立成像系统中的每一个分立成像系统包括图像传感器,进一步其中,所述公共点位于所述图像传感器后方。13. The multi-camera panoramic imaging system of claim 7, wherein each of the discrete imaging systems includes an image sensor, and further wherein the common point is located behind the image sensor. 14.如权利要求13所述的多相机全景成像系统,其中,所述图像传感器是波前传感器。14. The multi-camera panoramic imaging system of claim 13, wherein the image sensor is a wavefront sensor.
HK17108516.9A 2014-05-06 2015-05-05 Imaging system and method HK1234932B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US61/989,136 2014-05-06

Publications (2)

Publication Number Publication Date
HK1234932A1 HK1234932A1 (en) 2018-02-23
HK1234932B true HK1234932B (en) 2021-02-26

Family

ID=

Similar Documents

Publication Publication Date Title
US12231773B2 (en) Imaging system, method, and applications
CN110191326A (en) A kind of optical projection system resolution extension method, apparatus and optical projection system
US10057487B1 (en) Panoramic imaging systems based on normal-lens cameras
Lin et al. A low-cost portable polycamera for stereoscopic 360 imaging
CN108604055B (en) Omnidirectional catadioptric lenses with odd-order aspheric profiles or multiple lenses
CN108391116B (en) Whole body scanning device and method based on 3D imaging technology
CN106780621A (en) The method that axicon lens face catadioptric video camera minute surface parameter is solved using straight line
HK1234932B (en) Imaging system and method
HK1234932A1 (en) Imaging system and method
CN106873301A (en) Based on the system and method that array camera is imaged to remote aperture rear
CN104010119A (en) 360-degree cylindrical real-time imaging device
CN206848687U (en) The system being imaged based on array camera to remote aperture rear
HK1260647B (en) Omnidirectional catadioptric lens with odd aspheric contour or multi-lens