[go: up one dir, main page]

HK1246955B - Vehicle monitoring system - Google Patents

Vehicle monitoring system

Info

Publication number
HK1246955B
HK1246955B HK18106475.1A HK18106475A HK1246955B HK 1246955 B HK1246955 B HK 1246955B HK 18106475 A HK18106475 A HK 18106475A HK 1246955 B HK1246955 B HK 1246955B
Authority
HK
Hong Kong
Prior art keywords
electronic display
vehicle
light
vehicle monitoring
monitoring system
Prior art date
Application number
HK18106475.1A
Other languages
Chinese (zh)
Other versions
HK1246955A1 (en
Inventor
David A. Fattal
Original Assignee
镭亚股份有限公司
Filing date
Publication date
Application filed by 镭亚股份有限公司 filed Critical 镭亚股份有限公司
Priority claimed from PCT/US2015/033432 external-priority patent/WO2016195647A1/en
Publication of HK1246955A1 publication Critical patent/HK1246955A1/en
Publication of HK1246955B publication Critical patent/HK1246955B/en

Links

Description

车辆监控系统Vehicle Monitoring System

相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS

不适用。not applicable.

关于联邦资助的研究或开发的声明STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

不适用。not applicable.

背景技术Background Art

车辆监控系统作为用于提供情境知晓和防碰撞的手段变得越来越普遍。这样的车辆监控系统通常包括用于向用户(例如,车辆的驾驶员)传送信息的电子显示器。具体地,电子显示器可以提供与车辆相邻的区域的视图,以使得用户知晓在相邻区域中的对象并且便于用户避开在相邻区域中的对象。Vehicle monitoring systems are becoming increasingly common as a means of providing situational awareness and collision avoidance. Such vehicle monitoring systems typically include an electronic display for conveying information to a user (e.g., the driver of the vehicle). Specifically, the electronic display can provide a view of the area adjacent to the vehicle to inform the user of objects in the adjacent area and facilitate avoidance of objects in the adjacent area.

各种电子显示器可以被用于车辆监控系统,包括但不限于基于阴极射线管(CRT)的显示器、等离子体显示面板(PDP)、液晶显示器(LCD)、电致发光(EL)显示器、有机发光二极管(OLED)和有源矩阵OLED(AMOLED)显示器、电泳(EP)显示器和采用机电或电流体光调制的各种显示器(例如,数字微镜设备、电润湿显示器等)。通常,电子显示器可以被分类为有源显示器(即,发射光的显示器)或无源显示器(即,调制由另一源提供的光的显示器)。有源显示器的最明显的例子是CRT、PDP和OLED/AMOLED。在考虑所发射的光时通常被分类为无源的显示器是LCD和EP显示器。无源显示器虽然经常展现出吸引人的性能特性,包括但不限于固有地低的功耗,但由于缺乏发射光的能力,在许多实际应用中可能会发现有些受限的用途。Various electronic displays can be used in vehicle monitoring systems, including but not limited to cathode ray tube (CRT) based displays, plasma display panels (PDP), liquid crystal displays (LCD), electroluminescent (EL) displays, organic light emitting diodes (OLED) and active matrix OLED (AMOLED) displays, electrophoretic (EP) displays and various displays that use electromechanical or electrofluidic light modulation (e.g., digital micromirror devices, electrowetting displays, etc.). Generally, electronic displays can be classified as active displays (i.e., displays that emit light) or passive displays (i.e., displays that modulate light provided by another source). The most obvious examples of active displays are CRT, PDP and OLED/AMOLED. Displays that are generally classified as passive when considering the light emitted are LCD and EP displays. Although passive displays often exhibit attractive performance characteristics, including but not limited to inherently low power consumption, they may find somewhat limited use in many practical applications due to the lack of the ability to emit light.

为了克服与所发射的光相关联的无源显示器的局限性,许多无源显示器被耦合到外部光源。所耦合的光源可以允许这些其他的要不然是无源的显示器发射光并且实质上作为有源显示器起作用。这种所耦合的光源的例子是背光体(backlight)。背光体是被放置在要不然是无源的显示器后面以照亮无源显示器的光源(通常是板光源)。例如,背光体可以被耦合到LCD或EP显示器。背光体发射穿过LCD或EP显示器的光。所发射的光由LCD或EP显示器调制,并且,然后继而从LCD或EP显示器发射所调制的光。背光体通常被配置为发射白光。然后使用彩色滤光器将白光转换成显示器中使用的各种颜色。例如,彩色滤光器可以被放置在LCD或EP显示器的输出处(较不常见)或在背光体和LCD或EP显示器之间。In order to overcome the limitations of passive displays associated with the emitted light, many passive displays are coupled to external light sources. The coupled light source can allow these otherwise passive displays to emit light and essentially function as active displays. An example of such a coupled light source is a backlight. A backlight is a light source (usually a panel light source) that is placed behind an otherwise passive display to illuminate the passive display. For example, a backlight can be coupled to an LCD or EP display. The backlight emits light that passes through the LCD or EP display. The emitted light is modulated by the LCD or EP display, and the modulated light is then subsequently emitted from the LCD or EP display. The backlight is typically configured to emit white light. Color filters are then used to convert the white light into the various colors used in the display. For example, a color filter can be placed at the output of the LCD or EP display (less common) or between the backlight and the LCD or EP display.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

参考结合附图的以下详细描述,可以更容易地理解根据这里所描述的原理的示例和实施例的各种特征,其中相同的参考标记表示相同的结构元件,并且其中:The various features of examples and embodiments according to the principles described herein may be more readily understood by reference to the following detailed description taken in conjunction with the accompanying drawings, in which like reference numerals represent like structural elements, and in which:

图1示出了根据与这里所描述的原理一致的实施例的示例中的车辆监控系统的方框图。FIG1 shows a block diagram of a vehicle monitoring system in an example according to an embodiment consistent with the principles described herein.

图2A示出了根据与这里所描述的原理一致的实施例的示例中的使用图1的车辆监控系统监控的区域的透视图。2A shows a perspective view of an area monitored using the vehicle monitoring system of FIG. 1 , according to an example of an embodiment consistent with the principles described herein.

图2B示出了根据与这里所描述的原理一致的实施例的示例中的图2B的所监控区域的侧视图。FIG. 2B illustrates a side view of the monitored area of FIG. 2B , according to an example of an embodiment consistent with the principles described herein.

图3A示出了根据与这里所描述的原理一致的实施例的示例中的被扫描的区域的所显示部分。FIG. 3A shows a displayed portion of a scanned area in an example according to an embodiment consistent with the principles described herein.

图3B示出了根据与这里所描述的原理相一致的实施例的示例中的在图3A的所显示部分108中的在视觉上被突出的对象。FIG. 3B shows visually highlighted objects in displayed portion 108 of FIG. 3A , in an example according to an embodiment consistent with the principles described herein.

图3C示出了根据与这里所描述的原理相一致的实施例的示例中的在图3A的所显示部分中的在视觉上被突出的对象。FIG. 3C shows a visually highlighted object in the displayed portion of FIG. 3A , in an example according to an embodiment consistent with the principles described herein.

图4示出了根据与这里所描述的原理相一致的另一实施例的示例中的示出在视觉上被突出的对象的3D电子显示器的透视图。4 illustrates a perspective view of a 3D electronic display showing a visually highlighted object, according to an example of another embodiment consistent with the principles described herein.

图5A示出了根据与这里所描述的原理一致的实施例的示例中的具有基于多束光栅的背光体的三维(3D)电子显示器的横截面图。5A shows a cross-sectional view of a three-dimensional (3D) electronic display with a multibeam grating-based backlight, in an example of an embodiment consistent with the principles described herein.

图5B示出了根据与这里所描述原理相一致的另一实施例的示例中的具有基于多束光栅的背光体的三维(3D)电子显示器的横截面视图。5B shows a cross-sectional view of a three-dimensional (3D) electronic display with a multibeam grating-based backlight, according to an example of another embodiment consistent with principles described herein.

图5C示出了根据与这里所描述的原理一致的实施例的示例中的具有基于多束光栅的背光体的3D电子显示器的一部分的透视图。5C shows a perspective view of a portion of a 3D electronic display with a multibeam grating-based backlight, in an example of an embodiment consistent with the principles described herein.

图6示出了根据这里所描述的原理的实施例的示例中的三维(3D)车辆监控系统的方框图。FIG6 shows a block diagram of a three-dimensional (3D) vehicle monitoring system in an example of an embodiment according to the principles described herein.

图7示出了根据与这里所描述的原理一致的实施例的示例中的车辆监控方法的流程图。FIG7 shows a flow chart of a vehicle monitoring method in an example according to an embodiment consistent with the principles described herein.

某些示例和实施例具有作为在上述所参考的附图中所示出的特征的附加和替代之一的其他特征。以下参考上述所参考的附图详细说明了这些和其他特征。Certain examples and embodiments have other features in addition to or in lieu of the features shown in the above-referenced drawings.These and other features are described in detail below with reference to the above-referenced drawings.

具体实施方式DETAILED DESCRIPTION

根据与这里所描述的原理一致的实施例提供了采用三维(3D)信息的车辆监控系统。具体地,根据与这里所描述的原理一致的一些实施例,针对与车辆相邻的所监控区域收集包括3D扫描或图像的3D信息。例如,所监控区域可以是车辆的前方、旁边和后方中的一个或多个。然后,来自所监控区域的3D信息被用于构建包括在所监控区域内的对象的空间配置的3D模型。此外,显示基于3D模型的所监控区域的一部分,并且在显示部分内的离车辆小于预定阈值距离的对象是视觉上被突出显示的对象。根据各种实施例,可以增强用户对视觉上被突出显示的对象的感知。此外,例如,视觉上被突出显示的对象的所增强的感知可以促进相对于太靠近车辆的那些视觉上被突出显示的对象的防碰撞。According to embodiments consistent with the principles described herein, a vehicle monitoring system using three-dimensional (3D) information is provided. Specifically, according to some embodiments consistent with the principles described herein, 3D information including 3D scans or images is collected for a monitored area adjacent to a vehicle. For example, the monitored area may be one or more of the front, side, and rear of the vehicle. The 3D information from the monitored area is then used to construct a 3D model of the spatial configuration of objects within the monitored area. In addition, a portion of the monitored area based on the 3D model is displayed, and objects within the displayed portion that are less than a predetermined threshold distance from the vehicle are visually highlighted objects. According to various embodiments, a user's perception of the visually highlighted objects can be enhanced. In addition, for example, the enhanced perception of the visually highlighted objects can promote collision avoidance relative to those visually highlighted objects that are too close to the vehicle.

根据各种实施例,3D扫描器或3D照相机与电子显示器组合作为车辆监控系统以监控与车辆相邻的区域。3D扫描器收集有关所监控区域中的对象的3D信息,以促进3D模型的构建。电子显示器基于3D模型提供所监控区域的图像。此外,由电子显示器提供被认为太靠近车辆的对象(即,离车辆小于预定阈值距离的对象)的视觉突出显示。According to various embodiments, a 3D scanner or 3D camera is combined with an electronic display to function as a vehicle monitoring system to monitor an area adjacent to a vehicle. The 3D scanner collects 3D information about objects in the monitored area to facilitate the construction of a 3D model. The electronic display provides an image of the monitored area based on the 3D model. Furthermore, the electronic display provides visual highlighting of objects deemed too close to the vehicle (i.e., objects within a predetermined threshold distance from the vehicle).

根据这里所描述的一些实施例,由3D电子显示器(单色和彩色中的一种或两种)提供对象的视觉突出显示。此外,在各种实施例中,3D电子显示器可以被配置为以所谓的“无眼镜”3D或者自动立体3D方式呈现图像和相关信息。具体地,在一些实施例中,3D电子显示器可以采用基于衍射光栅或“基于光栅”的背光体以产生3D图像或信息的不同视图。在采用基于光栅的背光体的3D电子显示器中,使用多个衍射光栅将光耦合出光导。被耦合出的光形成在预定方向(例如,观看方向)上定向的多个光束。此外,在一些实施例中,多个光束中的光束可以具有彼此不同的主角方向,以在电子显示器的观看方向上形成或提供光场,并且还可以表示多个原色。具有不同主角方向的光束(也称为“不同定向的光束”)(并且在一些实施例中,所述光束表示不同颜色)可以被采用以自动立体地显示包括三维(3D)信息的信息。例如,不同定向的、不同颜色的光束可以被调制并且用作“无眼镜”3D彩色电子显示器的彩色像素或表示“无眼镜”3D彩色电子显示器的不同视图。According to some embodiments described herein, a 3D electronic display (one or both of monochrome and color) provides visual highlighting of an object. Furthermore, in various embodiments, the 3D electronic display can be configured to present images and related information in so-called "glasses-free" 3D or autostereoscopic 3D. Specifically, in some embodiments, the 3D electronic display can employ a diffraction grating-based, or "grating-based," backlight to produce different views of a 3D image or information. In a 3D electronic display employing a grating-based backlight, multiple diffraction gratings are used to couple light out of a light guide. The coupled-out light forms multiple light beams oriented in a predetermined direction (e.g., a viewing direction). Furthermore, in some embodiments, the light beams in the multiple light beams can have different principal angular directions from one another to form or provide a light field in the viewing direction of the electronic display, and can also represent multiple primary colors. Light beams having different principal angular directions (also referred to as "differently oriented light beams") (and in some embodiments, representing different colors) can be employed to autostereoscopically display information including three-dimensional (3D) information. For example, differently directed, differently colored light beams may be modulated and used as color pixels of, or to represent different views of, a "glasses-free" 3D color electronic display.

这里,“光导”被定义为使用全内反射在结构内引导光的所述结构。具体地,光导可以包括在光导的工作波长处基本上是透明的芯。在各种实施例中,术语“光导”通常是指在光导的电介质材料与围绕光导的材料或介质之间的界面处采用全内反射以引导光的电介质光波导。根据定义,全内反射的条件是光导的折射率大于邻近光导材料表面的周围介质的折射率。在一些实施例中,光导可以包括除了或代替上面所描述的折射率差异之外的涂层,以进一步促进全内反射。例如,涂层可以是反射涂层。光导可以是包括但不限于板(plate)或片(slab)光导和条(strip)光导中的一个或两个的若干光导中的任何一个。Here, a "lightguide" is defined as a structure that guides light within the structure using total internal reflection. Specifically, a lightguide may include a core that is substantially transparent at the operating wavelength of the lightguide. In various embodiments, the term "lightguide" generally refers to a dielectric light waveguide that uses total internal reflection at the interface between the dielectric material of the lightguide and the material or medium surrounding the lightguide to guide light. By definition, the condition for total internal reflection is that the refractive index of the lightguide is greater than the refractive index of the surrounding medium adjacent to the surface of the lightguide material. In some embodiments, the lightguide may include a coating in addition to or instead of the refractive index difference described above to further promote total internal reflection. For example, the coating may be a reflective coating. The lightguide may be any of several lightguides including, but not limited to, one or both of a plate or slab lightguide and a strip lightguide.

此外,如在“板光导”中被应用于光导时,术语“板”被定义为分段地(piece-wise)或存在差别地(differentially)成平面的层或薄片(sheet),有时“板光导”被称为“片”光导。具体地,板光导被定义为被配置为在由光导的顶面和底面(即,相对的面)划界的两个基本正交的方向上引导光的光导。此外,在这里,根据定义,顶面和底面两者相互分离,并且可以在至少存在差别的意义上基本上相互平行。也就是说,在板光导的任何存在差别地小的部分内,顶面和底面基本上平行或共面。Furthermore, as in "plate lightguide," when applied to a lightguide, the term "plate" is defined as a piece-wise or differentially planar layer or sheet, and "plate lightguide" is sometimes referred to as a "sheet" lightguide. Specifically, a plate lightguide is defined as a lightguide configured to guide light in two substantially orthogonal directions bounded by a top surface and a bottom surface (i.e., opposing surfaces) of the lightguide. Furthermore, herein, by definition, the top surface and the bottom surface are both separate from each other and may be substantially parallel to each other in at least a differential sense. That is, within any differentially small portion of the plate lightguide, the top surface and the bottom surface are substantially parallel or coplanar.

在一些实施例中,板光导可以是基本上平的(例如,限制为平面)并且因此板光导是平面光导。在其它实施例中,板光导可以在一个或两个正交的维度中是弯曲的。例如,板光导可以在单一维度中弯曲以形成圆柱形的板光导。但是,任何弯曲都具有足够大的曲率半径以保证在板光导中保持全内反射以引导光。In some embodiments, the plate light guide can be substantially flat (e.g., constrained to a plane) and thus be a planar light guide. In other embodiments, the plate light guide can be curved in one or two orthogonal dimensions. For example, the plate light guide can be curved in a single dimension to form a cylindrical plate light guide. However, any curvature has a sufficiently large radius of curvature to ensure that total internal reflection is maintained within the plate light guide to guide light.

根据这里所描述的各种实施例,可以采用衍射光栅(例如,多束衍射光栅)以将光作为光束从光导(例如,板光导)中散射或耦合出。这里,“衍射光栅”通常被定义为被布置成提供入射在衍射光栅上的光的衍射的多个特征(即,衍射特征)。在一些实施例中,多个特征可以以周期性或准周期性方式布置。例如,衍射光栅可以包括以一维(1D)阵列布置的多个特征(例如,在材料表面中的多个凹槽)。在其他示例中,衍射光栅可以是特征的二维(2D)阵列。例如,衍射光栅可以是在材料表面上的凸起物(bump))或在材料表面中的孔的2D阵列。In accordance with various embodiments described herein, a diffraction grating (e.g., a multibeam diffraction grating) can be employed to scatter or couple light as a beam out of a light guide (e.g., a plate light guide). Here, a "diffraction grating" is generally defined as a plurality of features (i.e., diffraction features) arranged to provide diffraction of light incident on the diffraction grating. In some embodiments, the plurality of features can be arranged in a periodic or quasi-periodic manner. For example, the diffraction grating can include a plurality of features arranged in a one-dimensional (1D) array (e.g., a plurality of grooves in a material surface). In other examples, the diffraction grating can be a two-dimensional (2D) array of features. For example, the diffraction grating can be a 2D array of bumps on the material surface or holes in the material surface.

因此,根据这里的定义,“衍射光栅”是提供入射在衍射光栅上的光的衍射的结构。如果光从光导入射到衍射光栅上,则所提供的衍射或衍射散射可以导致并因此被称为“衍射耦合”,因为衍射光栅可以通过衍射将光耦合出光导。衍射光栅还通过衍射(即,以衍射角)重定向或改变光的角度。具体地,作为衍射的结果,离开衍射光栅的光(即,衍射光)通常具有与入射到衍射光栅上的光(即,入射光)的传播方向不同的传播方向。这里,通过衍射改变光的传播方向称为“衍射重定向”。因此,衍射光栅可以被理解为包括衍射特征的结构,所述衍射特征衍射地重定向入射在衍射光栅上的光,并且如果光从光导入射,则衍射光栅也可以衍射地耦合出来自光导的光。Thus, according to the definitions herein, a "diffraction grating" is a structure that provides diffraction of light incident on the diffraction grating. If light is incident on the diffraction grating from a light guide, the diffraction or diffraction scattering provided can result in, and is therefore referred to as, "diffraction coupling", since the diffraction grating can couple light out of the light guide by diffraction. A diffraction grating also redirects or changes the angle of light by diffraction (i.e., at a diffraction angle). In particular, as a result of diffraction, the light exiting the diffraction grating (i.e., the diffracted light) typically has a propagation direction that is different from the propagation direction of the light incident on the diffraction grating (i.e., the incident light). Here, changing the propagation direction of light by diffraction is referred to as "diffraction redirection". Thus, a diffraction grating can be understood as a structure that includes diffraction features that diffractively redirect light incident on the diffraction grating, and if the light is incident from a light guide, the diffraction grating can also diffractively couple light out of the light guide.

此外,根据这里的定义,衍射光栅的特征被称为“衍射特征”,并且可以是在表面处、在表面中和在表面上的一个或多个(即,其中“表面”是指两种材料之间的边界)。表面可以是板光导的表面。衍射特征可以包括衍射光的各种结构中的任何一种,所述结构包括但不限于凹槽、背脊、孔和凸起物中的一个或多个,并且这些结构可以是在表面处、在表面中和在表面上的一个或多个。例如,衍射光栅可以包括在材料表面中的多个平行的凹槽。在另一示例中,衍射光栅可以包括从材料表面突出的多个平行的背脊。衍射特征(无论是凹槽、背脊、孔、凸起物等)可以具有提供衍射的各种横截面形状或轮廓中的任何一种,所述横截面形状或轮廓包括但不限于正弦曲线轮廓、矩形轮廓(例如,二进制衍射光栅)、三角形轮廓和锯齿轮廓(例如,闪耀光栅)中的一个或多个。Furthermore, as defined herein, the features of a diffraction grating are referred to as "diffractive features" and can be one or more of at a surface, in a surface, and on a surface (i.e., where "surface" refers to a boundary between two materials). The surface can be a surface of a plate light guide. The diffractive features can include any of a variety of structures that diffract light, including but not limited to one or more of grooves, ridges, holes, and protrusions, and these structures can be one or more of at a surface, in a surface, and on a surface. For example, a diffraction grating can include a plurality of parallel grooves in a material surface. In another example, a diffraction grating can include a plurality of parallel ridges protruding from a material surface. The diffractive features (whether grooves, ridges, holes, protrusions, etc.) can have any of a variety of cross-sectional shapes or profiles that provide diffraction, including but not limited to one or more of a sinusoidal profile, a rectangular profile (e.g., a binary diffraction grating), a triangular profile, and a sawtooth profile (e.g., a blazed grating).

根据这里的定义,“多束衍射光栅”是产生包括多个光束的耦合出的光的衍射光栅。此外,根据这里的定义,由多束衍射光栅产生的多个光束彼此具有不同的主角方向。具体地,根据定义,由于通过多束衍射光栅进行的入射光的衍射耦合和衍射重定向,所述多个光束中的一个光束具有与所述多个光束中的另一个光束不同的预定的主角方向。多个光束可以表示光场。例如,多个光束可以包括具有八个不同主角方向的八个光束。例如,组合的八个光束(即,所述多个光束)可以表示光场。根据各种实施例,各种光束的不同主角方向由光栅间距或间隔以及各个光束的原点处的多束衍射光栅的衍射特征相对于入射到多束衍射光栅上的光的传播方向的取向(orientation)或旋转(rotation)的组合确定。As defined herein, a "multibeam diffraction grating" is a diffraction grating that produces outcoupled light comprising multiple light beams. Furthermore, as defined herein, the multiple light beams produced by the multibeam diffraction grating have different principal angular directions from one another. Specifically, as defined, one of the multiple light beams has a predetermined principal angular direction that is different from another of the multiple light beams due to diffraction coupling and diffraction redirection of incident light by the multibeam diffraction grating. The multiple light beams may represent a light field. For example, the multiple light beams may include eight light beams having eight different principal angular directions. For example, the combined eight light beams (i.e., the multiple light beams) may represent a light field. According to various embodiments, the different principal angular directions of the various light beams are determined by a combination of the grating pitch or spacing and the orientation or rotation of the diffraction features of the multibeam diffraction grating at the origin of each light beam relative to the propagation direction of light incident on the multibeam diffraction grating.

根据这里所描述的各种实施例,通过衍射光栅(例如,多束衍射光栅)被耦合出光导的光表示电子显示器的像素。具体地,具有多束衍射光栅以产生具有不同主角方向的多个光束的光导可以是电子显示器的背光体的一部分或与电子显示器结合地使用,所述电子显示器例如为但不限于“无眼镜”的三维(3D)电子显示器(也称为多视图或“全息”电子显示器或自动立体显示器)。这样,通过使用多束衍射光栅从光导耦合出所引导光而产生的不同定向的光束可以是或表示3D电子显示器的“像素”。According to various embodiments described herein, light coupled out of a light guide through a diffraction grating (e.g., a multi-beam diffraction grating) represents pixels of an electronic display. Specifically, a light guide having a multi-beam diffraction grating to generate multiple light beams having different principal orientations can be part of a backlight for an electronic display or used in conjunction with an electronic display, such as, but not limited to, a "glasses-free" three-dimensional (3D) electronic display (also known as a multi-view or "holographic" electronic display or an autostereoscopic display). Thus, the differently oriented light beams generated by coupling the guided light out of the light guide using the multi-beam diffraction grating can be or represent "pixels" of the 3D electronic display.

这里,“准直”反射镜(mirror)被定义为具有弯曲形状的反射镜,其被配置为准直由准直反射镜反射的光。例如,准直反射镜可以具有以抛物线曲线或形状为特征的反射面。在另一示例中,准直反射镜可以包括成形的抛物线反射镜。通过“成形的(shaped)抛物线”,表示成形的抛物线反射镜的弯曲反射面以确定为实现预定反射特性(例如,准直程度)的方式偏离“真实”抛物线曲线。在一些实施例中,准直反射镜可以是连续反射镜(即,具有基本上平滑的、连续的反射面),而在其他实施例中,反射镜可以包括提供光准直的菲涅耳反射器或菲涅尔反射镜。根据各种实施例,由准直反射镜提供的准直量可以从一个实施例到另一个实施例以预定的程度或量变化。此外,准直反射镜可以被配置为在两个正交方向(例如,垂直方向和水平方向)中的一个或两个方向上提供准直。也就是说,根据各种示例,准直反射镜可以包括在两个正交方向中的一个或两个方向上的抛物线或成形的抛物线形状。Here, a "collimating" mirror is defined as a mirror having a curved shape that is configured to collimate light reflected by the collimating mirror. For example, the collimating mirror may have a reflective surface characterized by a parabolic curve or shape. In another example, the collimating mirror may include a shaped parabolic mirror. By "shaped parabola," it is meant that the curved reflective surface of the shaped parabolic mirror deviates from a "true" parabolic curve in a manner determined to achieve predetermined reflective characteristics (e.g., a degree of collimation). In some embodiments, the collimating mirror may be a continuous mirror (i.e., having a substantially smooth, continuous reflective surface), while in other embodiments, the mirror may include a Fresnel reflector or Fresnel reflector that provides light collimation. According to various embodiments, the amount of collimation provided by the collimating mirror may vary from one embodiment to another by a predetermined degree or amount. In addition, the collimating mirror may be configured to provide collimation in one or both of two orthogonal directions (e.g., a vertical direction and a horizontal direction). That is, according to various examples, the collimating mirror may include a parabolic or shaped parabolic shape in one or both of two orthogonal directions.

这里,在关于3D电子显示器而使用时,术语“零视差平面”被定义为在3D电子显示器的所有视图中看起来相同(即,没有视觉视差)的被显示或被呈现的3D场景或区域的平面或平面部分。此外,根据这里的定义,零视差平面出现在3D电子显示器的物理表面处、对应于3D电子显示器的物理表面、或与3D电子显示器的物理表面重合。也就是说,当由3D电子显示器呈现并在其上观看时,位于3D区域内的零视差平面处的所显示场景或区域中的对象将看起来与3D电子显示器的物理表面共处一处。比零视差平面离得更远的对象将看起来是在物理表面的后面,而比零视差平面更近的对象将看起来是在物理表面的前面。As used herein with respect to a 3D electronic display, the term "zero parallax plane" is defined as a plane or portion of a plane of a displayed or rendered 3D scene or region that appears the same (i.e., has no visual parallax) in all views of the 3D electronic display. Furthermore, as defined herein, the zero parallax plane occurs at, corresponds to, or coincides with the physical surface of the 3D electronic display. That is, when rendered by and viewed on the 3D electronic display, objects within the displayed scene or region located at the zero parallax plane within the 3D region will appear to be co-located with the physical surface of the 3D electronic display. Objects farther away than the zero parallax plane will appear to be behind the physical surface, while objects closer than the zero parallax plane will appear to be in front of the physical surface.

这里,“投影变换”或等价地“投影转换”被定义为将线映射成线(或将光线映射到光线)的3D空间的(可能非线性的)变换。注意,通常可以通过4×4矩阵根据在四维(4D)空间(即,“投影空间”)中的线性变换表示投影变换。在这里的一些实施例中,投影变换可以包括被配置为压缩深度内容的光学变换,所述深度内容基本上等效于透过发散透镜(例如,鱼眼透镜)观看场景。具体地,投影变换可以将无限远平面映射到离零视差平面的期望距离l/h。提供无限远平面到l/h距离的映射的投影变换可以由等式(1)给出Here, a "projective transformation" or equivalently a "projective conversion" is defined as a (possibly non-linear) transformation of 3D space that maps lines to lines (or maps rays to rays). Note that a projective transformation can generally be represented by a 4×4 matrix according to a linear transformation in four-dimensional (4D) space (i.e., "projective space"). In some embodiments herein, the projective transformation may include an optical transformation configured to compress depth content that is substantially equivalent to viewing a scene through a diverging lens (e.g., a fisheye lens). Specifically, the projective transformation may map an infinite plane to a desired distance l/h from the zero parallax plane. The projective transformation that provides a mapping of an infinite plane to a distance l/h may be given by Equation (1)

其中,(x',y',z',w')是与坐标(x,y,z,w)的投影变换相对应的图像(image)坐标。此外,根据这里的定义,等式(1)的投影变换通常不压缩靠近零视差平面本身的深度或视差。在其他实施例中,可以采用另一种光学转换(例如,由4×4矩阵表示)作为这里的投影变换。例如,根据这里所描述的原理的一些实施例,投影变换可以基本上是如下所描述突出对象或其一部分的任何投影变换。此外,根据各种实施例,这里,投影变换可以包括线性变换或非线性变换。Wherein, (x', y', z', w') are image coordinates corresponding to the projective transformation of the coordinates (x, y, z, w). In addition, according to the definition herein, the projective transformation of equation (1) generally does not compress the depth or disparity near the zero disparity plane itself. In other embodiments, another optical transformation (e.g., represented by a 4×4 matrix) can be used as the projective transformation here. For example, according to some embodiments of the principles described herein, the projective transformation can be substantially any projective transformation that highlights the object or a portion thereof as described below. In addition, according to various embodiments, here, the projective transformation can include a linear transformation or a nonlinear transformation.

此外,如这里所使用的,词语‘一(a)’旨在在本专利技术中具有其普通含义,即一个或多个。例如,“光栅”是指一个或多个光栅,因此,“所述光栅”在这里是指所述一个或多个光栅。此外,这里对“顶”、“底”、“上面”、“下面”、“上”、“下”、“前”、“后”、“第一”、“第二”、“左”或“右”的任何引用在这里并不意味着限制。这里,除非另有明确说明,术语“约”当应用于值时,通常意味着在用于产生该值的设备的容许范围内,或者可以意味着正负10%、或正负5%、或正负1%。此外,这里使用的术语“基本上”是指多数、或几乎全部或全部、或在约51%至约100%的范围内的量。此外,这里的示例旨在仅是说明性的,并且出于讨论目的而不是限制被呈现。In addition, as used herein, the word 'a' is intended to have its ordinary meaning in the present patent technology, i.e., one or more. For example, "grating" refers to one or more gratings, and therefore, "the grating" refers to the one or more gratings here. In addition, any reference to "top", "bottom", "above", "below", "up", "down", "front", "back", "first", "second", "left" or "right" here is not intended to be limiting. Here, unless otherwise expressly stated, the term "about" when applied to a value generally means within the allowable range of the device used to generate the value, or can mean plus or minus 10%, or plus or minus 5%, or plus or minus 1%. In addition, the term "substantially" as used herein refers to a majority, or almost all or all, or an amount in the range of about 51% to about 100%. In addition, the examples here are intended to be illustrative only and are presented for discussion purposes and not for limitation.

根据这里所描述的原理的一些实施例,提供了车辆监控系统。图1示出了根据与这里所描述的原理一致的实施例的示例中的车辆监控系统100的方框图。图2A示出了根据与这里所描述的原理一致的实施例的示例中的使用图1的车辆监控系统100监控的区域102的透视图。图2B示出了根据与这里所描述的原理一致的实施例的示例中的图2A的所监控区域102的侧视图。根据这里的定义,由车辆监控系统100监控的“区域”是车辆附近、邻近车辆或车辆周围的区域(以下可以将“区域”统称为“相邻区域”)。根据各种实施例,被监控的区域102可以包括在车辆前方、车辆后方和车辆侧方中的一个或多个。According to some embodiments of the principles described herein, a vehicle monitoring system is provided. FIG1 shows a block diagram of a vehicle monitoring system 100 in an example of an embodiment consistent with the principles described herein. FIG2A shows a perspective view of an area 102 monitored using the vehicle monitoring system 100 of FIG1 in an example of an embodiment consistent with the principles described herein. FIG2B shows a side view of the monitored area 102 of FIG2A in an example of an embodiment consistent with the principles described herein. As defined herein, an "area" monitored by the vehicle monitoring system 100 is an area near, adjacent to, or around a vehicle (hereinafter "areas" may be collectively referred to as "adjacent areas"). According to various embodiments, the monitored area 102 may include one or more of the front of the vehicle, the rear of the vehicle, and the side of the vehicle.

例如,车辆监控系统100可以被用于监控车辆后方的区域102,并且因此用作后援(backup)或后视监控系统。具体地,车辆监控系统100可以被配置为后视或后援辅助车辆监控系统,以在车辆向后移动时协助防碰撞。在另一示例中,被监控的区域102可以在车辆前方。因此,例如,车辆监控系统100可以用作在车辆向前移动时的前端防碰撞系统。For example, vehicle monitoring system 100 can be used to monitor area 102 behind the vehicle and thus function as a backup or rear-view monitoring system. Specifically, vehicle monitoring system 100 can be configured as a rear-view or backup auxiliary vehicle monitoring system to assist in collision avoidance when the vehicle is moving backward. In another example, monitored area 102 can be in front of the vehicle. Thus, for example, vehicle monitoring system 100 can function as a front-end collision avoidance system when the vehicle is moving forward.

如图1所示,车辆监控系统100包括三维(3D)扫描器110。3D扫描器110被配置为扫描与车辆相邻的区域102。然后,3D扫描器的扫描被用于生成或提供区域102的3D模型。具体地,3D模型包括位于被扫描的区域102内的对象104的空间配置。与车辆相邻的被扫描的区域102在这里也可以被称为“所扫描”区域102,或者等效地被称为“所成像”区域102。As shown in FIG1 , a vehicle monitoring system 100 includes a three-dimensional (3D) scanner 110. The 3D scanner 110 is configured to scan an area 102 adjacent to the vehicle. The scans from the 3D scanner are then used to generate or provide a 3D model of the area 102. Specifically, the 3D model includes the spatial configuration of objects 104 located within the scanned area 102. The scanned area 102 adjacent to the vehicle may also be referred to herein as a "scanned" area 102, or equivalently, as an "imaged" area 102.

通常,3D扫描器110可以包括各种不同的能够确定到所扫描区域102中的各种对象104的距离的3D扫描或成像系统中的任何一种。根据一些实施例,3D扫描器110包括彼此偏移的多个照相机。例如,通过使用由多个照相机的不同照相机捕捉的分开的图像的视差估计,确定从3D扫描器110到所扫描区域102内的对象104的距离。例如,多个照相机可以包括双目照相机对,并且可以使用在被扫描的区域102内的双目视差估计确定到对象104的距离。车辆监控系统100的图像处理器(图1、2A、2B中未示出)可以执行视差估计,并且根据一些实施例还可以从视差估计确定的到对象104的距离生成或以其他方式提供3D模型。例如,图像处理器可以是3D扫描器110的一部分。Generally, the 3D scanner 110 may include any of a variety of 3D scanning or imaging systems capable of determining distances to various objects 104 within the scanned area 102. According to some embodiments, the 3D scanner 110 includes multiple cameras offset from one another. For example, the distance from the 3D scanner 110 to an object 104 within the scanned area 102 may be determined using disparity estimates of separate images captured by different cameras of the multiple cameras. For example, the multiple cameras may include a binocular camera pair, and the distance to the object 104 may be determined using binocular disparity estimates within the scanned area 102. An image processor (not shown in Figures 1, 2A, and 2B) of the vehicle monitoring system 100 may perform the disparity estimation and, according to some embodiments, may also generate or otherwise provide a 3D model based on the distance to the object 104 determined using the disparity estimates. For example, the image processor may be part of the 3D scanner 110.

在另一个实施例中,3D扫描器110包括无扫描器的光检测和测距(LIDAR)系统,例如飞行时间照相机,其中从由在被扫描的区域102中的对象反射的光脉冲的传播时间确定距离。具体地,飞行时间照相机使用激光器或另一个类似的光源产生光脉冲。然后,使用光脉冲对所扫描区域102进行照明。所扫描区域102内的任何对象104将照明光脉冲反射回飞行时间照相机。根据照明光脉冲传播到对象、反射离开对象然后返回到飞行时间照相机的光传感器(例如,焦平面阵列)所需的时间长度或“飞行时间”确定到对象104的距离。例如,可以使用飞行时间照相机逐像素地确定飞行时间距离,以提供所扫描区域102的3D模型。In another embodiment, the 3D scanner 110 includes a scannerless light detection and ranging (LIDAR) system, such as a time-of-flight camera, in which the distance is determined from the propagation time of light pulses reflected by objects in the scanned area 102. Specifically, the time-of-flight camera uses a laser or another similar light source to generate light pulses. The light pulses are then used to illuminate the scanned area 102. Any objects 104 within the scanned area 102 reflect the illumination light pulses back to the time-of-flight camera. The distance to the object 104 is determined based on the length of time, or "time of flight," required for the illumination light pulse to propagate to the object, reflect off the object, and then return to the time-of-flight camera's light sensor (e.g., a focal plane array). For example, the time-of-flight distance can be determined pixel by pixel using a time-of-flight camera to provide a 3D model of the scanned area 102.

在另一个实施例中,3D扫描器110包括距离传感器,该距离传感器被配置为测量到被扫描的区域102内的多个点的距离。例如,多个点可以包括对象104。在包括距离传感器的一些实施例中,3D扫描器110还可以包括被配置为捕捉所扫描区域102的对应二维(2D)图像的照相机。由距离传感器提供的所测量距离可以被用于产生所扫描区域102的点云和对象网格中的一个或两个。继而,点云或对象网格可以直接被用作3D模型,或者被采用以生成3D模型(例如,在车辆监控系统100的图像处理器中)。照相机捕捉的2D图像可以被用于绘制3D模型。通过“绘制”,这是指将2D图像重叠在3D模型上或与3D模型组合(例如,当3D模型在显示器上呈现时)。例如,可以在3D扫描器110的这个实施例中采用多种距离传感器,包括但不限于声学距离传感器和光学(例如基于扫描激光器的)距离传感器。In another embodiment, the 3D scanner 110 includes a distance sensor configured to measure distances to a plurality of points within the scanned area 102. For example, the plurality of points may include an object 104. In some embodiments including a distance sensor, the 3D scanner 110 may also include a camera configured to capture a corresponding two-dimensional (2D) image of the scanned area 102. The measured distances provided by the distance sensor may be used to generate one or both of a point cloud and an object mesh of the scanned area 102. The point cloud or object mesh may then be used directly as a 3D model or employed to generate a 3D model (e.g., in an image processor of the vehicle monitoring system 100). The 2D image captured by the camera may be used to render the 3D model. By "rendering," this means overlaying the 2D image on or combining it with the 3D model (e.g., when the 3D model is presented on a display). For example, a variety of distance sensors may be employed in this embodiment of the 3D scanner 110, including but not limited to acoustic distance sensors and optical (e.g., based on a scanning laser) distance sensors.

具体地,3D扫描器110的距离传感器可以包括被配置为扫描区域102的激光器。此外,距离传感器可以包括光学传感器,其被配置为使用从被扫描的区域102中的一个或多个对象104反射的激光测量到所述多个点的距离。例如,3D扫描器110可以包括组合2D照相机、第二红外照相机和红外激光器投影仪的Intel 3D照相机。2D照相机被配置为捕捉所扫描区域102的2D图像,而红外激光器投影仪和第二红外照相机协同工作作为距离传感器以收集所扫描区域102内的距离信息。Intel 和是IntelCorporation,Santa Clara,CA,USA的注册商标。Specifically, the distance sensor of the 3D scanner 110 may include a laser configured to scan the area 102. Furthermore, the distance sensor may include an optical sensor configured to measure distances to a plurality of points using laser light reflected from one or more objects 104 in the scanned area 102. For example, the 3D scanner 110 may include an Intel 3D camera that combines a 2D camera, a second infrared camera, and an infrared laser projector. The 2D camera is configured to capture a 2D image of the scanned area 102, while the infrared laser projector and the second infrared camera work together as a distance sensor to collect distance information within the scanned area 102. Intel and are registered trademarks of Intel Corporation, Santa Clara, CA, USA.

图1所示的车辆监控系统100还包括电子显示器120。电子显示器120被配置为使用3D模型显示区域102的一部分。此外,电子显示器120被配置为在视觉上突出所显示部分内的对象104',该所显示部分位于距离车辆(或等效地,距离车辆监控系统100)小于阈值处。根据各种实施例,在视觉上突出被配置为增强比阈值距离更接近车辆的对象104'的用户感知。例如,在视觉上被突出的对象104'的增强的感知可以促进避免在对象104'和车辆之间的碰撞。在图2A和2B中,标记为dT的阈值距离被示出为从车辆监控系统100到平面106的距离,平面106被示出为与所监控区域102内的对象104'相交(例如,交叉)的虚线边界。The vehicle monitoring system 100 shown in FIG1 also includes an electronic display 120. The electronic display 120 is configured to display a portion of the area 102 using a 3D model. Furthermore, the electronic display 120 is configured to visually highlight objects 104′ within the displayed portion that are located less than a threshold distance from the vehicle (or equivalently, from the vehicle monitoring system 100). According to various embodiments, the visual highlighting is configured to enhance user perception of objects 104′ that are closer to the vehicle than the threshold distance. For example, the enhanced perception of the visually highlighted objects 104′ can facilitate collision avoidance between the objects 104′ and the vehicle. In FIG2A and 2B , the threshold distance, labeled d T , is illustrated as the distance from the vehicle monitoring system 100 to a plane 106, which is illustrated as a dashed boundary that intersects (e.g., intersects) the objects 104′ within the monitored area 102.

图3A示出了根据与这里所描述的原理一致的实施例的示例中的区域102的所显示部分108。具体地,图3A示出了当对象104可能出现在电子显示器120的显示屏上时被扫描的区域102中的各种对象104。例如,电子显示器120可以是二维(2D)电子显示器120(例如,LCD显示器),并且可以在2D电子显示器上将所扫描区域102的所显示部分108显示或呈现为2D图像。此外,如图3A所示,没有对象104是在视觉上被突出的。FIG3A illustrates a displayed portion 108 of area 102 according to an example of an embodiment consistent with the principles described herein. Specifically, FIG3A illustrates various objects 104 in scanned area 102 as they may appear on a display screen of electronic display 120. For example, electronic display 120 may be a two-dimensional (2D) electronic display 120 (e.g., an LCD display), and displayed portion 108 of scanned area 102 may be displayed or presented as a 2D image on the 2D electronic display. Furthermore, as shown in FIG3A , no object 104 is visually highlighted.

根据一些实施例,比阈值距离更近的对象104'可以使用被施加到对象104'的遮板(mask)在电子显示器120上或由电子显示器120在视觉上被突出。例如,包括交叉阴影线或彩色阴影的遮板可以被施加到被突出显示的对象104'或其一部分。此外,例如,遮板可以包括被配置为引起注意所掩蔽的对象104'的颜色(例如,黄色、红色等)。在一些示例中,遮板可以被施加到被确定为处于离车辆小于阈值距离的距离处的所扫描区域102的任何部分(例如,任何像素)。According to some embodiments, objects 104' that are closer than a threshold distance can be visually highlighted on or by the electronic display 120 using a mask applied to the objects 104'. For example, a mask comprising crosshatching or a colored shading can be applied to the highlighted objects 104' or a portion thereof. Additionally, for example, the mask can include a color (e.g., yellow, red, etc.) configured to draw attention to the masked objects 104'. In some examples, the mask can be applied to any portion (e.g., any pixel) of the scanned area 102 that is determined to be at a distance from the vehicle that is less than the threshold distance.

图3B示出了根据与这里所描述的原理一致的实施例的示例中的图3A的所显示部分108中的在视觉上被突出的对象104'。具体地,图3B示出了包括使用遮板210在视觉上被突出的对象104'的所扫描区域102的所显示部分。如图3B所示,遮板210包括遮盖在比阈值距离更近的对象104'上或遮盖在比阈值距离更近的对象104'的上方的交叉阴影线。在该示例中,整个对象104'基本上由交叉阴影线遮板210覆盖。在其他示例(未示出)中,只有实际上比阈值距离更近的对象104'的一部分由遮板210覆盖以提供视觉上突出,而对象104'的剩余部分可以基本上不具有遮板210(即,未由遮板210覆盖)。FIG3B shows a visually highlighted object 104′ in the displayed portion 108 of FIG3A in an example of an embodiment consistent with the principles described herein. Specifically, FIG3B shows a displayed portion of the scanned area 102 including an object 104′ that is visually highlighted using a mask 210. As shown in FIG3B , the mask 210 includes cross-hatching that obscures or obscures above an object 104′ that is closer than a threshold distance. In this example, the entire object 104′ is substantially covered by the cross-hatched mask 210. In other examples (not shown), only a portion of the object 104′ that is actually closer than the threshold distance is covered by the mask 210 to provide visual prominence, while the remaining portion of the object 104′ may be substantially free of the mask 210 (i.e., not covered by the mask 210).

在另一示例中,显示在电子显示器120上的视觉上突出包括围绕比阈值距离更近的对象的边界或周边的轮廓。该轮廓可以包括引起对于对象的特别注意的颜色,例如但不限于黄色、橙色或红色。此外,在一些示例中,可以围绕被确定为离车辆小于阈值距离的区域102的任何一部分或多个部分而提供轮廓。在一些示例中,轮廓可以与遮板结合使用(例如,也可以勾勒所掩蔽的对象的轮廓)。In another example, the visual highlight displayed on the electronic display 120 includes an outline around the boundary or perimeter of an object that is closer than a threshold distance. The outline may include a color that draws special attention to the object, such as, but not limited to, yellow, orange, or red. Furthermore, in some examples, an outline may be provided around any portion or portions of the area 102 that are determined to be less than a threshold distance from the vehicle. In some examples, the outline may be used in conjunction with a mask (e.g., to also outline the masked object).

在其他示例中,可以在电子显示器120上显示警告图标,以突出确定为处于离车辆小于阈值距离的距离处的对象。例如,警告图标可以被显示为被叠加在对象上或等效地,被叠加在处于阈值距离内的所扫描区域102的部分上。例如,警告图标可以以引起注意的颜色呈现,并且可以包括但不限于三角形、圆形或正方形。在一些示例中,三角形、圆形或正方形可以包围感叹号或另一个字母数字字符,以进一步引起对警告图标的注意。在一些实施例中,警告图标可以与遮板和轮廓中的一个或两个结合使用(例如,警告图标可以位于遮板或轮廓内)。In other examples, a warning icon may be displayed on the electronic display 120 to highlight an object determined to be at a distance less than a threshold distance from the vehicle. For example, the warning icon may be displayed superimposed on the object or, equivalently, superimposed on the portion of the scanned area 102 that is within the threshold distance. For example, the warning icon may be presented in an attention-getting color and may include, but is not limited to, a triangle, a circle, or a square. In some examples, the triangle, circle, or square may surround an exclamation point or another alphanumeric character to further draw attention to the warning icon. In some embodiments, the warning icon may be used in conjunction with one or both of a shield and an outline (e.g., the warning icon may be located within the shield or the outline).

图3C示出了根据与这里所描述的原理一致的另一实施例的示例中的图3A的所显示部分108中的视觉上突出的对象104'。具体地,图3C示出了包括使用轮廓220而在视觉上被突出的对象104'的所扫描区域102的所显示部分。进一步在图3C中示出了警告图标230。虽然警告图标230可以通常位于所显示部分的任何地方,但是在图3C中,作为示例,警告图标230位于轮廓220内并且被叠加在对象104'上方。FIG3C illustrates a visually highlighted object 104′ in displayed portion 108 of FIG3A , according to an example of another embodiment consistent with the principles described herein. Specifically, FIG3C illustrates a displayed portion of scanned area 102 including object 104′ that is visually highlighted using outline 220. Further illustrated in FIG3C is a warning icon 230. While warning icon 230 can generally be located anywhere in the displayed portion, in FIG3C , as an example, warning icon 230 is located within outline 220 and superimposed above object 104′.

再次参考图1,根据一些实施例,车辆监控系统100的电子显示器120可以包括3D电子显示器120。在这些实施例的一些中,阈值距离可以对应于与在3D电子显示器120上被显示的区域102的一部分相关联的零视差平面。此外,根据一些实施例,视觉上突出的对象104'可以是被感知为处于3D电子显示器120的零视差平面前方的对象。具体地,当被显示或被呈现时,位于小于阈值距离的距离处的对象104'被呈现在3D电子显示器120上在零视差平面前方。因此,根据各种实施例,对象被感知(例如,由观看者)为从3D电子显示器120的物理显示表面凸出或伸出或在3D电子显示器120的物理显示表面的前方,以在视觉上突出对象104'。Referring again to FIG. 1 , according to some embodiments, the electronic display 120 of the vehicle monitoring system 100 may include a 3D electronic display 120. In some of these embodiments, the threshold distance may correspond to a zero-disparity plane associated with a portion of the area 102 displayed on the 3D electronic display 120. Furthermore, according to some embodiments, the visually salient object 104′ may be an object that is perceived as being in front of the zero-disparity plane of the 3D electronic display 120. Specifically, when displayed or presented, the object 104′ located at a distance less than the threshold distance is presented on the 3D electronic display 120 in front of the zero-disparity plane. Thus, according to various embodiments, the object is perceived (e.g., by a viewer) as protruding or extending from or in front of the physical display surface of the 3D electronic display 120, visually salient to the object 104′.

图4示出了根据与这里所描述的原理一致的另一实施例的示例中的描绘在视觉上突出的对象104'的3D电子显示器120的透视图。具体地,图4示出了包括通过被呈现在零视差平面前方而在视觉上突出的对象104'的所扫描区域102的所显示部分108。对象104'(例如,儿童玩具自行车)在3D电子显示器上出现为从3D电子显示器的物理表面120'突出或位于其前方。在大于阈值距离的距离处的其他对象104出现在3D电子显示器的物理表面120'的后方,如图4所示。FIG4 shows a perspective view of a 3D electronic display 120 depicting a visually salient object 104′, according to an example of another embodiment consistent with the principles described herein. Specifically, FIG4 shows a displayed portion 108 of a scanned area 102 including an object 104′ that is visually salient by being presented in front of a zero parallax plane. Object 104′ (e.g., a children's toy bicycle) appears on the 3D electronic display as protruding from or located in front of a physical surface 120′ of the 3D electronic display. Other objects 104 at a distance greater than a threshold distance appear behind the physical surface 120′ of the 3D electronic display, as shown in FIG4 .

在一些实施例中,在3D电子显示器120上呈现所显示部分之前,投影变换可以被应用于3D模型。具体地,车辆监控系统100还可以包括图像处理器,例如如下面关于图6所描述的。例如,图像处理器可以是3D电子显示器120的一部分。在其他示例中,图像处理器是3D扫描器110的一部分,或者可以是车辆监控系统100的另一个(例如,分开的)元件。In some embodiments, a projective transformation can be applied to the 3D model before the displayed portion is rendered on the 3D electronic display 120. Specifically, the vehicle monitoring system 100 can also include an image processor, such as described below with respect to FIG6. For example, the image processor can be part of the 3D electronic display 120. In other examples, the image processor is part of the 3D scanner 110, or can be another (e.g., separate) component of the vehicle monitoring system 100.

图像处理器可以被配置为在3D电子显示器120上呈现所显示部分之前将投影变换应用于3D模型。根据各种实施例,投影变换被配置为与在大于对应于零视差平面的阈值距离的距离处的图像中的其他对象104相比,增大在视觉上突出的对象104'的相对大小。结果,不仅在视觉上突出的对象104'出现在3D电子显示器120的物理显示表面120'的前方,而且在被呈现在3D电子显示器120上时,在视觉上突出的对象104'将在空间上变形或增加尺寸。效果就好像在视觉上突出的对象104'相对于由3D电子显示器120显示的其它对象被扩大、放大或在视觉上膨胀或扩展。例如,图4所示的对象104'通过投影变换的应用在空间上变形。因此,根据各种实施例,在视觉上突出的对象104'的感知通过由应用投影变换产生的尺寸变形呈现而被进一步增强。The image processor may be configured to apply a projective transformation to the 3D model before presenting the displayed portion on the 3D electronic display 120. According to various embodiments, the projective transformation is configured to increase the relative size of a visually salient object 104' compared to other objects 104 in the image at distances greater than a threshold distance corresponding to a zero disparity plane. As a result, not only does the visually salient object 104' appear in front of the physical display surface 120' of the 3D electronic display 120, but when presented on the 3D electronic display 120, the visually salient object 104' is spatially deformed or increased in size. The effect is as if the visually salient object 104' is enlarged, magnified, or visually expanded or extended relative to other objects displayed by the 3D electronic display 120. For example, the object 104' shown in FIG. 4 is spatially deformed by the application of the projective transformation. Thus, according to various embodiments, the perception of the visually salient object 104' is further enhanced by the size-distorted presentation resulting from the application of the projective transformation.

根据各种实施例,3D电子显示器120可以基本上是任何3D电子显示器。具体地,在一些实施例中,3D电子显示器120是基于多束光栅的3D电子显示器120,其包括基于多束光栅的背光体和光调制层。图5A示出了根据与这里所描述的原理一致的实施例的示例中的具有基于多束光栅的背光体的3D电子显示器120的横截面图。图5B示出了根据与这里所描述的原理一致的另一实施例的示例中具有基于多束光栅的背光体的3D电子显示器120的横截面图。图5C示出了根据与这里所描述的原理一致的实施例的示例中的具有基于多束光栅的背光体的3D电子显示器120的一部分的透视图。例如,图5C所示的3D电子显示器120的一部分可以表示图5A或图5B的任何一个所示的3D电子显示器120。根据各种实施例,具有基于多束光栅的背光体的3D电子显示器120可以提供如上面所描述的在视觉上突出的对象的增强的感知。According to various embodiments, 3D electronic display 120 can be substantially any 3D electronic display. Specifically, in some embodiments, 3D electronic display 120 is a multibeam grating-based 3D electronic display 120 that includes a multibeam grating-based backlight and a light modulation layer. FIG5A illustrates a cross-sectional view of a 3D electronic display 120 having a multibeam grating-based backlight, according to an example of an embodiment consistent with the principles described herein. FIG5B illustrates a cross-sectional view of a 3D electronic display 120 having a multibeam grating-based backlight, according to an example of another embodiment consistent with the principles described herein. FIG5C illustrates a perspective view of a portion of a 3D electronic display 120 having a multibeam grating-based backlight, according to an example of an embodiment consistent with the principles described herein. For example, the portion of 3D electronic display 120 shown in FIG5C may represent the 3D electronic display 120 shown in either FIG5A or FIG5B. According to various embodiments, a 3D electronic display 120 having a multibeam grating-based backlight can provide an enhanced perception of visually salient objects, as described above.

根据各种实施例,图5A-5C中所示的3D电子显示器120被配置为产生经调制的“定向”光,即包括具有不同主角方向的光束的光。例如,如图5A-5C所示,3D电子显示器120可以提供或生成多个光束,该多个光束被示出为在不同的预定主角方向上(例如,作为光场)被定向为离开并远离3D电子显示器120的箭头。继而,可以调制多个光束以促进具有包括但不限于在视觉上被突出的对象的3D内容的信息的显示。在一些实施例中,具有不同预定主角方向的经调制的光束形成3D电子显示器120的多个像素。此外,3D电子显示器120是所谓的“无眼镜”的3D电子显示器(例如,多视图、“全息”或自动立体显示器),其中,光束对应于与3D电子显示器120的不同“视图”相关联的像素。According to various embodiments, the 3D electronic display 120 shown in Figures 5A-5C is configured to generate modulated "directional" light, i.e., light that includes light beams having different principal directions. For example, as shown in Figures 5A-5C, the 3D electronic display 120 can provide or generate multiple light beams, shown as arrows directed away from and away from the 3D electronic display 120 in different predetermined principal directions (e.g., as a light field). The multiple light beams can then be modulated to facilitate the display of information having 3D content, including, but not limited to, visually highlighted objects. In some embodiments, the modulated light beams having different predetermined principal directions form multiple pixels of the 3D electronic display 120. Furthermore, the 3D electronic display 120 is a so-called "glasses-free" 3D electronic display (e.g., a multi-view, "holographic," or autostereoscopic display), wherein the light beams correspond to pixels associated with different "views" of the 3D electronic display 120.

如图5A、5B和5C所示,3D电子显示器120的基于多束光栅的背光体包括光导122。具体地,根据一些实施例,光导122可以是板光导122。板光导122被配置为引导来自光源(图5A-5C中未示出)的光作为被引导光(被示出为如在下面进一步所描述的在光导122中传播的延伸的箭头)。例如,板光导122可以包括被配置为光波导的电介质材料。电介质材料可以具有大于围绕电介质光波导的介质的第二折射率的第一折射率。例如,该折射率的差异被配置为根据板光导122的一个或多个引导模式促进被引导光的全内反射。As shown in Figures 5A, 5B, and 5C, the multi-beam grating-based backlight of the 3D electronic display 120 includes a light guide 122. Specifically, according to some embodiments, the light guide 122 can be a plate light guide 122. The plate light guide 122 is configured to guide light from a light source (not shown in Figures 5A-5C) as guided light (shown as extended arrows propagating in the light guide 122 as further described below). For example, the plate light guide 122 can include a dielectric material configured as a light waveguide. The dielectric material can have a first refractive index that is greater than a second refractive index of a medium surrounding the dielectric light waveguide. For example, the difference in refractive index is configured to promote total internal reflection of the guided light according to one or more guided modes of the plate light guide 122.

在各种实施例中,来自光源的光沿着板光导122的长度作为光束而被引导。此外,板光导122可以被配置为以非零传播角度引导光(即,被引导光束)。例如,可以使用全内反射在板光导122内以非零传播角度引导被引导光束。具体地,被引导光束104通过以非零传播角度在板光导112的顶表面和底表面之间反射或“弹跳”而传播(例如,通过延伸的、有角度的箭头示出,该箭头表示被引导光束的光线)。In various embodiments, light from a light source is guided as a beam along the length of the plate light guide 122. Furthermore, the plate light guide 122 can be configured to guide light (i.e., a guided beam) at a non-zero propagation angle. For example, the guided beam can be guided at a non-zero propagation angle within the plate light guide 122 using total internal reflection. Specifically, the guided beam 104 propagates by reflecting or "bouncing" between the top and bottom surfaces of the plate light guide 112 at a non-zero propagation angle (e.g., as shown by the extended, angled arrows representing rays of the guided beam).

如这里所定义的,“非零传播角度”是相对于板光导122的表面(例如,顶表面或底表面)的角度。在一些示例中,被引导光束的非零传播角度可以在大约十(10)度和大约五十(50)度之间,或者在一些示例中在大约二十(20)度和大约四十(40)度之间,或在大约二十五(25)度和大约三十五(35)度之间。例如,非零传播角度可以是大约三十(30)度。在其他示例中,非零传播角度可以是大约20度,或大约25度,或大约35度。As defined herein, a "non-zero propagation angle" is an angle relative to a surface (e.g., a top surface or a bottom surface) of the plate light guide 122. In some examples, the non-zero propagation angle of the guided light beam can be between about ten (10) degrees and about fifty (50) degrees, or in some examples between about twenty (20) degrees and about forty (40) degrees, or between about twenty-five (25) degrees and about thirty-five (35) degrees. For example, the non-zero propagation angle can be about thirty (30) degrees. In other examples, the non-zero propagation angle can be about 20 degrees, or about 25 degrees, or about 35 degrees.

在一些示例中,来自光源的光以非零传播角度(例如,大约30-35度)被引入或被耦合到板光导122中。例如,透镜、反射镜或类似的反射器(例如,倾斜的准直反射器)和棱镜(未示出)中的一个或多个可以促进将光作为光束以非零传播角度耦合到板光导122的输入端中。一旦被耦合到板光导122中,被引导光束沿着板光导122在大体上远离输入端的方向上传播(例如,在图5A-5B中通过沿着x轴而指向的粗箭头示出)。In some examples, light from a light source is introduced or coupled into plate light guide 122 at a non-zero propagation angle (e.g., approximately 30-35 degrees). For example, one or more of a lens, a mirror, or similar reflector (e.g., a tilted collimating reflector), and a prism (not shown) can facilitate coupling the light as a beam at the non-zero propagation angle into the input end of plate light guide 122. Once coupled into plate light guide 122, the guided beam propagates along plate light guide 122 in a direction generally away from the input end (e.g., as shown in Figures 5A-5B by the thick arrow pointing along the x-axis).

此外,根据一些示例,通过将光耦合到板光导122中而产生的被引导光束可以是准直光束。具体地,通过“准直光束”,其是指被引导光束内的光线在被引导光束内基本上彼此平行。根据这里的定义,从被引导光束的准直光束发散或被散射的光线不被认为是准直光束的一部分。例如,可以通过用于将光耦合到板光导122中的透镜或反射镜(例如,倾斜的准直反射器等)提供用于产生准直的被引导光束的光的准直。Furthermore, according to some examples, the guided light beam produced by coupling light into the plate light guide 122 can be a collimated light beam. Specifically, by "collimated light beam," it is meant that the light rays within the guided light beam are substantially parallel to one another within the guided light beam. According to the definition herein, light rays that diverge or are scattered from the collimated light beam of the guided light beam are not considered to be part of the collimated light beam. For example, collimation of the light used to produce the collimated guided light beam can be provided by a lens or a reflector (e.g., a tilted collimating reflector, etc.) used to couple the light into the plate light guide 122.

在一些示例中,板光导122可以是包括延伸的、基本上平面的光学透明的电介质材料薄片(sheet)的片(slab)或板光波导。基本上平面的电介质材料薄片被配置为使用全内反射引导被引导光束。根据各种示例,板光导122的光学透明材料可以包括多种电介质材料中的任何一种或由多种电介质材料中的任何一种组成,所述电介质材料包括但不限于各种类型的玻璃(例如,石英玻璃、碱铝硅酸盐玻璃、硼硅酸盐玻璃等)和基本上光学透明的塑料或聚合物(例如,聚乙烯(甲基丙烯酸甲酯)或“丙烯酸玻璃”、聚碳酸酯等)中的一种或多种。在一些示例中,板光导122还可以包括在板光导122的表面(例如,顶表面和底表面的一个或两个)的至少一部分上的覆层(未示出)。根据一些示例,覆层可以被用于进一步促进全内反射。In some examples, the plate light guide 122 can be a slab or plate light waveguide comprising an extended, substantially planar sheet of optically transparent dielectric material. The substantially planar sheet of dielectric material is configured to guide the guided light beam using total internal reflection. According to various examples, the optically transparent material of the plate light guide 122 can include or be composed of any of a variety of dielectric materials, including, but not limited to, one or more of various types of glass (e.g., quartz glass, alkali-aluminosilicate glass, borosilicate glass, etc.) and substantially optically transparent plastics or polymers (e.g., polyethylene (methyl methacrylate) or "acrylic glass", polycarbonate, etc.). In some examples, the plate light guide 122 can also include a cladding (not shown) on at least a portion of a surface (e.g., one or both of the top and bottom surfaces) of the plate light guide 122. According to some examples, the cladding can be used to further promote total internal reflection.

在图5A、5B和5C中,所示的3D电子显示器120的基于多束光栅的背光体还包括多束衍射光栅124的阵列。如图5A-5B所示,多束衍射光栅124位于板光导122的表面(例如,顶表面或前表面)。在其他示例(未示出)中,一个或多个多束衍射光栅124可以位于板光导122内。在其它实施例(未示出)中,一个或多个多束衍射光栅124可以位于板光导122的底表面或后表面(即,与图示具有多束衍射光栅124的表面相反的表面)处或所述底表面或后表面上。组合时,板光导122和多束衍射光栅124的阵列提供或用作3D电子显示器120的基于多束光栅的背光体。In Figures 5A, 5B, and 5C, the illustrated multibeam grating-based backlight for the 3D electronic display 120 further includes an array of multibeam diffraction gratings 124. As shown in Figures 5A-5B, the multibeam diffraction gratings 124 are located on a surface (e.g., the top or front surface) of the plate light guide 122. In other examples (not shown), one or more multibeam diffraction gratings 124 may be located within the plate light guide 122. In other embodiments (not shown), one or more multibeam diffraction gratings 124 may be located at or on the bottom or rear surface (i.e., the surface opposite the surface shown having the multibeam diffraction gratings 124) of the plate light guide 122. When combined, the plate light guide 122 and the array of multibeam diffraction gratings 124 provide or function as the multibeam grating-based backlight for the 3D electronic display 120.

根据各种实施例,所述阵列的多束衍射光栅124被配置为散射或衍射地耦合出的被引导光束的一部分,作为对应于3D电子显示器120的不同视图的具有不同主角方向的多个光束。例如,被引导光束的一部分可以由多束衍射光栅124衍射地耦合出,穿过板光导表面(例如,穿过板光导122的顶表面)。此外,多束衍射光栅124被配置为将被引导光束的一部分衍射地耦合出作为被耦合出的光束,并且将被耦合出的光束作为所述多个光束衍射地重定向远离板光导表面。如上面所讨论的,多个光束中的每个光束具有由多束衍射光栅124的衍射特征的特性确定的不同的预定主角方向。According to various embodiments, the array of multibeam diffraction gratings 124 is configured to scatter or diffractively couple out a portion of the guided light beam as a plurality of light beams having different principal angular directions corresponding to different views of the 3D electronic display 120. For example, a portion of the guided light beam can be diffractively coupled out by the multibeam diffraction grating 124 through a plate light guide surface (e.g., through a top surface of the plate light guide 122). Furthermore, the multibeam diffraction grating 124 is configured to diffractively couple out a portion of the guided light beam as an out-coupled light beam, and to diffractively redirect the out-coupled light beam away from the plate light guide surface as the plurality of light beams. As discussed above, each of the plurality of light beams has a different predetermined principal angular direction determined by the characteristics of the diffraction signature of the multibeam diffraction grating 124.

根据各种实施例,阵列的多束衍射光栅124包括提供衍射的多个衍射特征。所提供的衍射负责将被引导光束的一部分衍射耦合出板光导122。例如,多束衍射光栅124可以包括用作衍射特征的板光导122的表面中的凹槽以及从板光导表面突出的背脊中的一种或两种。凹槽和背脊可以被彼此平行地布置,并且至少在沿着衍射特征的某个点处,凹槽和背脊垂直于由多束衍射光栅124耦合出的被引导光束的传播方向。According to various embodiments, the array's multibeam diffraction grating 124 includes a plurality of diffraction features that provide diffraction. The provided diffraction is responsible for diffractively coupling a portion of the guided light beam out of the plate light guide 122. For example, the multibeam diffraction grating 124 may include one or both of grooves in the surface of the plate light guide 122 and ridges protruding from the surface of the plate light guide as diffraction features. The grooves and ridges may be arranged parallel to each other, and at least at some point along the diffraction features, the grooves and ridges are perpendicular to the propagation direction of the guided light beam coupled out by the multibeam diffraction grating 124.

在一些示例中,凹槽或背脊可以被蚀刻、研磨或模制到板光导表面中。这样,多束衍射光栅124的材料可以包括板光导122的材料。如图5A所示,例如,多束衍射光栅124包括穿透板光导122的表面的基本上平行的凹槽。在图5B中,多束衍射光栅124包括从板光导122的表面突出的基本上平行的背脊。在其他示例(未示出)中,多束衍射光栅124可以是被施加或被附着到板光导表面的膜或层。In some examples, grooves or ridges can be etched, milled, or molded into the surface of the plate light guide. In this way, the material of the multibeam diffraction grating 124 can include the material of the plate light guide 122. As shown in FIG5A, for example, the multibeam diffraction grating 124 includes substantially parallel grooves that penetrate the surface of the plate light guide 122. In FIG5B, the multibeam diffraction grating 124 includes substantially parallel ridges that protrude from the surface of the plate light guide 122. In other examples (not shown), the multibeam diffraction grating 124 can be a film or layer applied or attached to the surface of the plate light guide.

根据一些实施例,多束衍射光栅124可以是或包括啁啾衍射光栅。根据定义,“啁啾”衍射光栅是呈现或具有跨啁啾的衍射光栅的宽度或长度而变化的衍射特征的衍射间隔(即,衍射间距)的衍射光栅,例如,如图5A-5C所示。这里,变化的衍射间隔被定义为和称为“啁啾”。作为啁啾的结果,被衍射地耦合出板光导122的被引导光束的一部分作为被耦合出的光束以对应于多束衍射光栅124的啁啾衍射光栅上的不同原点的不同衍射角离开啁啾衍射光栅或从啁啾衍射光栅被发射。通过预定义的啁啾,啁啾衍射光栅负责多个光束的被耦合出的光束的预定的和不同的主角方向。In some embodiments, the multibeam diffraction grating 124 may be or include a chirped diffraction grating. By definition, a "chirped" diffraction grating is one that exhibits or has a diffraction spacing (i.e., diffraction pitch) that varies across the width or length of the chirped diffraction grating, as shown, for example, in Figures 5A-5C. Herein, the varying diffraction spacing is defined and referred to as "chirp." As a result of the chirp, a portion of the guided light beams that are diffractively coupled out of the plate light guide 122 exit or are emitted from the chirped diffraction grating as outcoupled light beams at different diffraction angles corresponding to different origins on the chirped diffraction grating of the multibeam diffraction grating 124. The chirped diffraction grating is responsible for the predetermined and different principal angular directions of the outcoupled light beams of the multiple light beams, due to the predefined chirp.

在一些示例中,多束衍射光栅124的啁啾衍射光栅可以具有或表现出随距离线性变化的衍射间隔的啁啾。这样,根据定义,啁啾衍射光栅是“线性啁啾”衍射光栅。例如,图5A-5C示出了作为线性啁啾衍射光栅的多束衍射光栅124。具体地,如图所示,衍射特征在多束衍射光栅124的第二端处比在第一端处更靠近在一起。此外,作为示例而非限制,所示的衍射特征的衍射间隔从第一端到第二端线性变化。In some examples, the chirped diffraction grating of the multibeam diffraction grating 124 can have or exhibit a chirp whose diffraction spacing varies linearly with distance. Thus, by definition, the chirped diffraction grating is a "linearly chirped" diffraction grating. For example, Figures 5A-5C illustrate the multibeam diffraction grating 124 as a linearly chirped diffraction grating. Specifically, as shown, the diffraction features are closer together at the second end of the multibeam diffraction grating 124 than at the first end. Furthermore, by way of example and not limitation, the diffraction spacing of the diffraction features shown varies linearly from the first end to the second end.

在另一示例(未示出)中,多束衍射光栅124的啁啾衍射光栅可以表现出衍射间隔的非线性啁啾。可使用各种非线性啁啾以实现多束衍射光栅124,包括但不限于指数啁啾、对数啁啾或以另一种基本上不均匀或随机但仍然单调的方式变化的啁啾。也可以采用例如但不限于正弦啁啾或三角形或锯齿啁啾的非单调的啁啾。也可以使用这些类型的啁啾的任何类型的组合。In another example (not shown), the chirped diffraction grating of the multibeam diffraction grating 124 can exhibit a nonlinear chirp of the diffraction spacing. A variety of nonlinear chirps can be used to implement the multibeam diffraction grating 124, including but not limited to exponential chirp, logarithmic chirp, or chirp that varies in another substantially non-uniform or random but still monotonic manner. Non-monotonic chirps, such as, but not limited to, sinusoidal chirp or triangular or sawtooth chirp, can also be employed. Any combination of these types of chirps can also be used.

根据一些实施例,多束衍射光栅124可以包括弯曲和啁啾中的一个或两个的衍射特征。图5C示出了在板光导122的表面中、表面处或表面上既弯曲又啁啾的多束衍射光栅124的透视图(即,多束衍射光栅124是弯曲啁啾衍射光栅)。在图5C中,被引导光束具有相对于多束衍射光栅124、在多束衍射光栅124的第一端处以粗箭头示出的入射方向。还示出了在板光导122的表面处指向远离多束衍射光栅124的箭头示出的多个被耦合出的或被发射的光束。如图所示,光束在多个预定的不同主角方向上被发射。具体地,如图所示,所发射的光束的预定的不同主角方向在方位角和仰角上都彼此不同。根据各种示例,衍射特征的预定义啁啾和衍射特征的曲线都可以对所发射的光束的预定的不同主角方向负责。According to some embodiments, the multibeam diffraction grating 124 may include diffraction features that are either curved or chirped, or both. FIG5C illustrates a perspective view of a multibeam diffraction grating 124 that is both curved and chirped, located in, at, or on the surface of the plate light guide 122 (i.e., the multibeam diffraction grating 124 is a curved and chirped diffraction grating). In FIG5C , the guided light beams have incident directions relative to the multibeam diffraction grating 124, indicated by thick arrows at a first end of the multibeam diffraction grating 124. Also illustrated are multiple coupled-out or emitted light beams, indicated by arrows pointing away from the multibeam diffraction grating 124 at the surface of the plate light guide 122. As shown, the light beams are emitted in a plurality of predetermined different principal angular directions. Specifically, as shown, the predetermined different principal angular directions of the emitted light beams differ from one another in both azimuth and elevation. According to various examples, both the predefined chirp of the diffraction feature and the curve of the diffraction feature may be responsible for the predetermined different principal angular directions of the emitted light beams.

具体地,在沿着衍射特征的曲线的不同点处,与弯曲的衍射特征相关联的多束衍射光栅124的“底层衍射光栅”具有不同的方位取向角度Φf。通过“底层衍射光栅”,其是指叠加产生多束衍射光栅124的弯曲衍射特征的所述多个非弯曲的衍射光栅中的衍射光栅。在沿着弯曲衍射特征的给定点处,所述曲线具有通常不同于在沿着弯曲衍射特征的另一点处的方位取向角度Φf的特定方位取向角度Φf。此外,该特定方位取向角度Φf导致从给定点发射的光束的主角方向{θ,Φ}中的对应方位分量Φ。在一些示例中,衍射特征(例如,凹槽、背脊等)的曲线可以表示圆的一部分。圆可以与光导表面共面。在其他示例中,曲线可以表示椭圆形或另一个弯曲形状的一部分,例如该部分与光导表面共面。Specifically, at different points along the curve of the diffractive feature, the "underlying diffraction grating" of multibeam diffraction grating 124 associated with the curved diffractive feature has different azimuthal orientation angles Φf . By "underlying diffraction grating," we mean the diffraction gratings of the plurality of uncurved diffraction gratings that are superimposed to produce the curved diffractive feature of multibeam diffraction grating 124. At a given point along the curved diffractive feature, the curve has a particular azimuthal orientation angle Φf that is generally different from the azimuthal orientation angle Φf at another point along the curved diffractive feature. Furthermore, this particular azimuthal orientation angle Φf results in a corresponding azimuthal component Φ in the principal angle directions {θ, Φ} of the light beam emitted from the given point. In some examples, the curve of a diffractive feature (e.g., a groove, ridge, etc.) can represent a portion of a circle. The circle can be coplanar with the lightguide surface. In other examples, the curve can represent a portion of an ellipse or another curved shape, for example, coplanar with the lightguide surface.

再次参考图5A-5B,3D电子显示器120的调制层包括光阀阵列126。根据各种实施例,光阀阵列126被配置为调制对应于3D电子显示器120的不同视图的不同定向的光束(即具有不同的预定主角方向的多个光束)。具体地,所述多个光束中的光束通过光阀阵列126的各个光阀并由光阀阵列126的各个光阀调制。根据各种实施例,经调制的不同定向的光束可以表示3D电子显示器120的像素。在各种示例中,可以在光阀阵列126中使用不同类型的光阀,包括但不限于液晶光阀、电泳光阀和基于电润湿的光阀中的一个或多个。5A-5B , the modulation layer of the 3D electronic display 120 includes a light valve array 126. According to various embodiments, the light valve array 126 is configured to modulate light beams of different orientations (i.e., a plurality of light beams having different predetermined principal directions) corresponding to different views of the 3D electronic display 120. Specifically, light beams of the plurality of light beams pass through and are modulated by respective light valves of the light valve array 126. According to various embodiments, the modulated light beams of different orientations may represent pixels of the 3D electronic display 120. In various examples, different types of light valves may be used in the light valve array 126, including but not limited to one or more of liquid crystal light valves, electrophoretic light valves, and electrowetting-based light valves.

根据这里所描述的原理的一些示例,提供了三维(3D)车辆监控系统。图6示出了根据这里所描述的原理的实施例的示例中的三维(3D)车辆监控系统300的方框图。具体地,3D车辆监控系统300可以被配置为当车辆在所监控的方向上移动时提供防碰撞。例如,3D车辆监控系统300可以被配置为监控车辆后方的区域,并且因此向车辆的操作者提供后援辅助。According to some examples of the principles described herein, a three-dimensional (3D) vehicle monitoring system is provided. FIG6 shows a block diagram of a three-dimensional (3D) vehicle monitoring system 300 in an example of an embodiment according to the principles described herein. Specifically, the 3D vehicle monitoring system 300 can be configured to provide collision avoidance when the vehicle is moving in a monitored direction. For example, the 3D vehicle monitoring system 300 can be configured to monitor the area behind the vehicle and, accordingly, provide backup assistance to the operator of the vehicle.

如图6所示,3D车辆监控系统300包括3D照相机310。在一些实施例中,3D照相机310是向后的3D照相机310。3D照相机310被配置为捕捉与车辆相邻的区域(例如,在车辆后方)的3D图像。根据各种实施例,3D照相机310可以基本上类似于上面关于车辆监控系统100所描述的3D扫描器110。具体地,3D照相机310可以包括以下一个或多个:彼此偏移的多个照相机、飞行时间照相机、以及基于激光的距离传感器和被配置为监控与车辆相邻的区域的二维(2D)照相机的组合。As shown in FIG6 , the 3D vehicle monitoring system 300 includes a 3D camera 310. In some embodiments, the 3D camera 310 is a rear-facing 3D camera 310. The 3D camera 310 is configured to capture a 3D image of an area adjacent to the vehicle (e.g., behind the vehicle). According to various embodiments, the 3D camera 310 can be substantially similar to the 3D scanner 110 described above with respect to the vehicle monitoring system 100. Specifically, the 3D camera 310 can include one or more of the following: a plurality of cameras offset from one another, a time-of-flight camera, and a combination of a laser-based distance sensor and a two-dimensional (2D) camera configured to monitor an area adjacent to the vehicle.

图6所示的3D车辆监控系统300还包括图像处理器320。图像处理器320被配置为使用由3D照相机310捕捉的3D图像提供3D成像区域的3D模型。根据各种实施例,3D模型包括3D成像区域内的对象的空间配置。3D成像区域和3D成像区域内的对象可以基本上类似于上面关于车辆监控系统100所描述的区域102和对象104、104'。The 3D vehicle monitoring system 300 shown in FIG6 further includes an image processor 320. The image processor 320 is configured to provide a 3D model of the 3D imaging area using the 3D images captured by the 3D camera 310. According to various embodiments, the 3D model includes the spatial configuration of objects within the 3D imaging area. The 3D imaging area and the objects within the 3D imaging area can be substantially similar to the area 102 and objects 104, 104' described above with respect to the vehicle monitoring system 100.

根据各种实施例,3D车辆监控系统300还包括3D电子显示器330。3D电子显示器330被配置为使用3D模型显示3D成像区域的一部分。根据一些实施例,在3D电子显示器330上可以在视觉上突出位于离车辆(例如,离车辆的后方)小于阈值距离的距离处的所显示部分内的任何对象。具体地,根据一些实施例,3D电子显示器330被进一步配置为在视觉上突出在位于离车辆小于阈值距离的所显示部分内的对象。According to various embodiments, the 3D vehicle monitoring system 300 further includes a 3D electronic display 330. The 3D electronic display 330 is configured to display a portion of the 3D imaging area using a 3D model. According to some embodiments, any object within the displayed portion that is less than a threshold distance from the vehicle (e.g., from the rear of the vehicle) can be visually highlighted on the 3D electronic display 330. Specifically, according to some embodiments, the 3D electronic display 330 is further configured to visually highlight objects within the displayed portion that are less than a threshold distance from the vehicle.

在一些实施例中,3D电子显示器330基本上类似于上面所描述的车辆监控系统100的3D电子显示器120。例如,阈值距离可以对应于与由3D电子显示器330显示的3D成像区域的一部分相关联的零视差平面。在一些实施例中,在视觉上被突出的对象可以被感知为在零奇偶视差平面前方(即,在3D电子显示器330的物理表面的前方)。此外,在一些实施例中,图像处理器320被进一步配置为在3D电子显示器330上呈现所显示部分之前,将投影变换应用于3D模型。所应用的投影变换可以被配置为与位于大于对应于零视差平面的阈值距离的距离处的所显示部分中的其他对象相比,增大在视觉上被突出的对象的相对大小。In some embodiments, 3D electronic display 330 is substantially similar to 3D electronic display 120 of vehicle monitoring system 100 described above. For example, the threshold distance may correspond to a zero-parity plane associated with a portion of the 3D imaging area displayed by 3D electronic display 330. In some embodiments, visually highlighted objects may be perceived as being in front of the zero-parity plane (i.e., in front of the physical surface of 3D electronic display 330). Additionally, in some embodiments, image processor 320 is further configured to apply a projective transformation to the 3D model prior to presenting the displayed portion on 3D electronic display 330. The applied projective transformation may be configured to increase the relative size of the visually highlighted object compared to other objects in the displayed portion located at a distance greater than the threshold distance corresponding to the zero-parity plane.

在一些实施例中,3D电子显示器330可以包括基于多束光栅的3D电子显示器。例如,在一些实施例中,3D电子显示器330可以基本上类似于具有上面关于车辆监控系统100所描述的基于多束光栅的背光体和调制层的3D电子显示器120。具体地,3D电子显示器330可以包括基于多束光栅的背光体和调制层。基于多束光栅的背光体可以包括用于引导光束(例如,准直光束)的光导、和被配置为衍射地耦合出被引导光束的多个部分作为被定向远离光导的多个不同定向的光束的多束衍射光栅的阵列。光导和多束衍射光栅可以基本上类似于上面对车辆监控系统100描述的板光导122和多束衍射光栅124。此外,调制层可以包括光阀阵列以调制不同定向的光束。根据各种实施例,经调制的、不同定向的光束形成3D电子显示器330的多个不同视图。光阀阵列可以基本上类似于上面关于车辆监控系统100所描述的光阀阵列126。具体地,经调制的、不同定向的光束具有不同的预定主角方向,该不同的预定主角方向形成与3D电子显示器330的不同“视图”相关联的多个像素。In some embodiments, the 3D electronic display 330 may include a multibeam grating-based 3D electronic display. For example, in some embodiments, the 3D electronic display 330 may be substantially similar to the 3D electronic display 120 having a multibeam grating-based backlight and modulation layer described above with respect to the vehicle monitoring system 100. Specifically, the 3D electronic display 330 may include a multibeam grating-based backlight and a modulation layer. The multibeam grating-based backlight may include a light guide for guiding a light beam (e.g., a collimated light beam) and an array of multibeam diffraction gratings configured to diffractively couple out multiple portions of the guided light beam as multiple differently oriented light beams directed away from the light guide. The light guide and the multibeam diffraction gratings may be substantially similar to the plate light guide 122 and the multibeam diffraction grating 124 described above with respect to the vehicle monitoring system 100. Furthermore, the modulation layer may include an array of light valves to modulate the differently oriented light beams. According to various embodiments, the modulated, differently oriented light beams form multiple different views of the 3D electronic display 330. The light valve array can be substantially similar to the light valve array 126 described above with respect to the vehicle monitoring system 100. Specifically, the modulated, differently directed light beams have different predetermined principal angular directions that form a plurality of pixels associated with different "views" of the 3D electronic display 330.

根据一些实施例(未示出),3D电子显示器330还可以包括光源。光源被配置为提供作为被引导光束在光导中传播的光。具体地,根据一些实施例,被引导光是被耦合到光导的边缘(或输入端)的来自光源的光。例如,透镜、准直反射器或类似设备(未示出)可以促进将光在光导的输入端或边缘处耦合到光导中。在各种示例中,光源可以包括基本上任何光源,包括但不限于发光二极管(LED)。在一些示例中,光源可以包括被配置为产生具有由特定颜色表示的窄带光谱的基本上单色光的光发射器。具体地,单色光的颜色可以是特定颜色空间或颜色模型(例如,红-绿-蓝(RGB)颜色模型)的原色。According to some embodiments (not shown), the 3D electronic display 330 may further include a light source. The light source is configured to provide light that propagates in the light guide as a guided light beam. Specifically, according to some embodiments, the guided light is light from the light source that is coupled to the edge (or input end) of the light guide. For example, a lens, a collimating reflector, or a similar device (not shown) may facilitate coupling the light into the light guide at the input end or edge of the light guide. In various examples, the light source may include substantially any light source, including but not limited to a light emitting diode (LED). In some examples, the light source may include a light emitter configured to produce substantially monochromatic light having a narrowband spectrum represented by a specific color. Specifically, the color of the monochromatic light may be a primary color of a specific color space or color model (e.g., a red-green-blue (RGB) color model).

根据这里所描述的原理的一些示例,提供了车辆监控的方法。车辆监控的方法可以被用于监控与车辆相邻的地区或区域。例如,该地区或区域可以包括但不限于车辆的前方、侧方以及后方或后面的区域。According to some examples of the principles described herein, a method for vehicle monitoring is provided. The method for vehicle monitoring can be used to monitor an area or region adjacent to a vehicle. For example, the area or region can include, but is not limited to, the area in front of, to the side of, and behind the vehicle.

图7示出了根据与这里所描述的原理一致的实施例的示例中的车辆监控的方法400的流程图。如图7所示,车辆监控的方法400包括使用3D扫描器捕捉410与车辆相邻的区域的3D扫描(scan)。根据各种实施例,在捕捉410中所使用的3D扫描器可以基本上类似于上面关于车辆监控系统100所描述的3D扫描器110。例如,3D扫描器可以包括以下一个或多个:彼此偏移的多个照相机(例如,双目照相机对)、飞行时间照相机以及基于激光的距离传感器和二维(2D)照相机的组合。在一些示例中,3D扫描器可以基本上类似于上面关于3D车辆监控系统300所描述的3D照相机310。FIG7 shows a flow chart of a method 400 for vehicle monitoring according to an example of an embodiment consistent with the principles described herein. As shown in FIG7 , the method 400 for vehicle monitoring includes capturing 410 a 3D scan of an area adjacent to a vehicle using a 3D scanner. According to various embodiments, the 3D scanner used in capturing 410 can be substantially similar to the 3D scanner 110 described above with respect to the vehicle monitoring system 100. For example, the 3D scanner can include one or more of: a plurality of cameras offset from one another (e.g., a pair of binocular cameras), a time-of-flight camera, and a combination of a laser-based distance sensor and a two-dimensional (2D) camera. In some examples, the 3D scanner can be substantially similar to the 3D camera 310 described above with respect to the 3D vehicle monitoring system 300.

图7所示的车辆监控的方法400还包括从所捕捉的3D扫描产生3D模型。根据各种实施例,3D模型包括位于所扫描区域内的对象的空间配置。例如,可以使用由3D扫描器产生的点云和对象网格中的一个或两个从3D扫描产生3D模型。The vehicle monitoring method 400 shown in FIG7 also includes generating a 3D model from the captured 3D scan. According to various embodiments, the 3D model includes the spatial configuration of objects within the scanned area. For example, the 3D model can be generated from the 3D scan using one or both of a point cloud and an object mesh generated by a 3D scanner.

根据各种实施例,车辆监控的方法400还包括使用3D模型显示430所扫描区域的一部分。根据各种实施例,显示430所扫描区域的一部分包括在视觉上突出在离车辆小于阈值距离的距离处的所显示部分内的对象。在一些实施例中,显示430所扫描区域的一部分可以采用基本上类似于上面所描述的车辆监控系统100的电子显示器120的电子显示器。此外,在视觉上突出对象可以基本上类似于上面所描述的任何形式的在视觉上突出。例如,可以使用遮板、轮廓和警告图标中的一个或多个在视觉上突出对象。在另一示例中,例如,显示430所扫描区域的一部分包括使用如上面关于3D车辆监控系统300的3D电子显示器330所描述的3D电子显示器。通过3D电子显示器,在视觉上被突出的对象看起来在对应于阈值距离的3D电子显示器的零视差平面的前方。According to various embodiments, vehicle monitoring method 400 further includes displaying 430 a portion of the scanned area using the 3D model. According to various embodiments, displaying 430 the portion of the scanned area includes visually highlighting objects within the displayed portion at a distance from the vehicle that is less than a threshold distance. In some embodiments, displaying 430 the portion of the scanned area may utilize an electronic display substantially similar to electronic display 120 of vehicle monitoring system 100 described above. Furthermore, visually highlighting the objects may be substantially similar to any of the forms of visual highlighting described above. For example, the objects may be visually highlighted using one or more of a mask, an outline, and a warning icon. In another example, displaying 430 the portion of the scanned area may include utilizing a 3D electronic display as described above with respect to 3D electronic display 330 of 3D vehicle monitoring system 300. Through the 3D electronic display, the visually highlighted objects appear to be in front of a zero parallax plane of the 3D electronic display corresponding to the threshold distance.

根据一些实施例,使用3D电子显示器(例如,具有基于多束光栅的背光体的3D电子显示器)显示430所扫描区域的一部分可进一步包括在板光导中以非零传播角度引导作为光束的光。使用3D电子显示器显示430所扫描区域的一部分可以进一步包括使用在板光导上的多束衍射光栅的阵列衍射地耦合出被引导光束的一部分。例如,衍射地耦合出被引导光束的一部分可以包括产生多个被耦合出的光束,所述多个被耦合出的光束在对应于3D电子显示器的不同视图的多个不同的主角方向上被定向远离板光导。此外,使用3D电子显示器显示430所扫描区域的一部分还可以包括使用多个光阀调制多个被耦合出的光束,经调制的光束表示3D电子显示器的像素。According to some embodiments, displaying 430 the portion of the scanned area using a 3D electronic display (e.g., a 3D electronic display having a multi-beam grating-based backlight) may further include directing light as a light beam at a non-zero propagation angle in a plate light guide. Displaying 430 the portion of the scanned area using the 3D electronic display may further include diffractively coupling out a portion of the guided light beam using an array of multi-beam diffraction gratings on the plate light guide. For example, diffractively coupling out a portion of the guided light beam may include generating a plurality of coupled-out light beams, the plurality of coupled-out light beams being directed away from the plate light guide in a plurality of different principal angle directions corresponding to different views of the 3D electronic display. Furthermore, displaying 430 the portion of the scanned area using the 3D electronic display may further include modulating the plurality of coupled-out light beams using a plurality of light valves, the modulated light beams representing pixels of the 3D electronic display.

此外,车辆监控的方法400可以包括在3D显示器上显示430所扫描区域的一部分之前,将投影变换应用于3D模型。在一些实施例中,投影变换可以包括所显示部分的深度压缩,以与在大于对应于零视差平面的阈值距离的距离处的图像中的对象相比增大被突出的对象的相对大小。Additionally, the vehicle monitoring method 400 may include applying a projective transformation to the 3D model before displaying 430 the portion of the scanned area on the 3D display. In some embodiments, the projective transformation may include depth compression of the displayed portion to increase the relative size of highlighted objects compared to objects in the image at distances greater than a threshold distance corresponding to a zero disparity plane.

因此,已经描述了在视觉上突出比阈值距离更靠近车辆的对象的车辆监控系统、3D车辆监控系统和车辆监控的方法的示例。应当理解,上面所描述的示例仅仅是说明表示这里所描述的原理的许多具体示例中的一些示例。显然,本领域技术人员可以在不脱离由所附权利要求所限定的范围,容易地设计出许多其它装置。Thus, examples of vehicle monitoring systems, 3D vehicle monitoring systems, and vehicle monitoring methods that visually highlight objects closer to a vehicle than a threshold distance have been described. It should be understood that the examples described above are merely illustrative of some of the many specific examples that demonstrate the principles described herein. Clearly, those skilled in the art can readily devise numerous other arrangements without departing from the scope of the appended claims.

Claims (18)

1.一种车辆监控系统,包括:1. A vehicle monitoring system, comprising: 三维(3D)扫描器,被配置为扫描与车辆相邻的区域,所述扫描被用于提供包含位于所扫描区域内的对象的空间配置的3D模型;以及A three-dimensional (3D) scanner is configured to scan an area adjacent to a vehicle, the scan being used to provide a 3D model containing a spatial configuration of objects located within the scanned area; and 电子显示器,被配置为使用所述3D模型显示所述所扫描区域的一部分,并且视觉上突出显示在所显示部分内的对象,所述所显示部分位于离所述车辆小于阈值距离,An electronic display is configured to display a portion of the scanned area using the 3D model, and to visually highlight objects within the displayed portion, the displayed portion being located at a distance less than a threshold from the vehicle. 其中,所述视觉上突出显示被配置为增强比所述阈值距离更靠近所述车辆的对象的用户感知,The visual highlighting is configured to enhance user perception of objects closer to the vehicle than the threshold distance. 其中,所述电子显示器包括3D电子显示器,所述阈值距离对应于与由所述3D电子显示器显示的所述所扫描区域的一部分相关联的零视差平面,并且,其中位于离所述车辆小于阈值距离的对象的视觉上突出显示是在所述3D电子显示器上的所述零视差平面前方的对象的视觉感知。The electronic display includes a 3D electronic display, the threshold distance corresponds to a zero parallax plane associated with a portion of the scanned area displayed by the 3D electronic display, and the visual prominence of an object located less than the threshold distance from the vehicle is the visual perception of an object in front of the zero parallax plane on the 3D electronic display. 2.根据权利要求1所述的车辆监控系统,其中,所述3D扫描器包括彼此偏移的多个摄像机,离所述3D扫描器的距离由使用由所述多个摄像机的不同摄像机捕获的单独图像的视差估计确定。2. The vehicle monitoring system of claim 1, wherein the 3D scanner comprises a plurality of cameras offset from each other, the distance from the 3D scanner being determined by parallax estimation using individual images captured by different cameras of the plurality of cameras. 3.根据权利要求1所述的车辆监控系统,其中,所述3D扫描器包括飞行时间摄像机。3. The vehicle monitoring system according to claim 1, wherein the 3D scanner includes a time-of-flight camera. 4.根据权利要求1所述的车辆监控系统,其中,所述3D扫描器包括:4. The vehicle monitoring system according to claim 1, wherein the 3D scanner comprises: 距离传感器,被配置为测量所述所扫描区域内的多个点离所述距离传感器的距离;以及A distance sensor is configured to measure the distance from a plurality of points within the scanned area to the distance sensor; and 摄像机,被配置为捕获所述所扫描区域的二维(2D)图像,所测量的距离被用于生成点云和对象网格中的一个或两个以提供所述3D模型,所述2D图像被用于绘制所述3D模型。A camera is configured to capture two-dimensional (2D) images of the scanned area, and the measured distances are used to generate one or both of a point cloud and an object mesh to provide the 3D model, the 2D images being used to draw the 3D model. 5.根据权利要求4所述的车辆监控系统,其中,所述距离传感器包括:5. The vehicle monitoring system according to claim 4, wherein the distance sensor comprises: 被配置为扫描所述所扫描区域的激光器;以及A laser configured to scan the scanned area; and 光传感器,被配置为使用从所述所扫描区域中的对象反射的激光测量到所述多个点的距离。A light sensor is configured to measure the distance to the plurality of points using laser light reflected from an object in the scanned area. 6.根据权利要求1所述的车辆监控系统,其中,所述所显示部分内的位于离所述车辆小于阈值距离的对象的视觉上突出显示包括被施加到所显示对象的掩模、所述所显示对象周围的轮廓以及指示通过所述电子显示器的所述所显示对象的警报图标中的一个或多个。6. The vehicle monitoring system of claim 1, wherein the visual highlighting of an object located at a distance less than a threshold from the vehicle within the displayed portion includes one or more of a mask applied to the displayed object, an outline around the displayed object, and an alarm icon indicating the displayed object via the electronic display. 7.根据权利要求1所述的车辆监控系统,还包括图像处理器,被配置为在所述所显示部分被呈现在所述3D电子显示器之前,将投影变换应用到所述3D模型,所述投影变换被配置为与位于大于对应于所述零视差平面的阈值距离的距离处的所述所显示部分中的对象相比,增强突出显示的对象的相对大小。7. The vehicle monitoring system of claim 1, further comprising an image processor configured to apply a projection transformation to the 3D model before the displayed portion is presented on the 3D electronic display, the projection transformation being configured to enhance the relative size of highlighted objects compared to objects located at a distance greater than a threshold distance corresponding to the zero parallax plane. 8.根据权利要求1所述的车辆监控系统,其中,所述3D电子显示器包括:8. The vehicle monitoring system according to claim 1, wherein the 3D electronic display comprises: 板状光导,被配置为以非零传播角度引导光束;A plate-shaped light guide is configured to guide the light beam at a non-zero propagation angle; 多光束衍射光栅的阵列,所述阵列的多光束衍射光栅被配置为衍射耦合出作为对应于所述3D电子显示器的不同视图的具有不同的主角度方向的多个被耦合出的光束的被引导光;以及An array of multi-beam diffraction gratings, the array of multi-beam diffraction gratings being configured to diffract and couple guided light as multiple coupled beams with different principal angle directions corresponding to different views of the 3D electronic display; and 光阀阵列,被配置为调制对应于所述3D电子显示器的不同视图的所述多个被耦合出的光束,所调制的光束表示所述3D电子显示器的像素。An array of light valves is configured to modulate the plurality of coupled light beams corresponding to different views of the 3D electronic display, the modulated light beams representing pixels of the 3D electronic display. 9.根据权利要求8所述的车辆监控系统,其中,所述多光束衍射光栅包括线性啁啾的衍射光栅,并且,其中所述多光束衍射光栅的衍射特征包括在所述板状光导的表面中的弯曲凹槽以及在所述板状光导表面上的弯曲脊中的一个或两个。9. The vehicle monitoring system according to claim 8, wherein the multi-beam diffraction grating comprises a linearly chirped diffraction grating, and wherein the diffraction features of the multi-beam diffraction grating include one or both of a curved groove in the surface of the plate-shaped light guide and a curved ridge in the surface of the plate-shaped light guide. 10.根据权利要求1所述的车辆监控系统,其中,所述3D扫描器被配置为扫描所述车辆后方的区域,所增强的用户感知被配置为当所述车辆反向移动时辅助防碰撞,所述车辆监控系统是后视、备用辅助的车辆监控系统。10. The vehicle monitoring system according to claim 1, wherein the 3D scanner is configured to scan the area behind the vehicle, the enhanced user perception is configured to assist in collision avoidance when the vehicle moves in the opposite direction, and the vehicle monitoring system is a rear-view, backup-assisted vehicle monitoring system. 11.一种三维(3D)车辆监控系统,包括:11. A three-dimensional (3D) vehicle monitoring system, comprising: 3D摄像机,被配置为捕获与车辆相邻的区域的3D图像;A 3D camera is configured to capture 3D images of the area adjacent to the vehicle; 图像处理器,被配置为使用所述3D图像提供3D所成像区域的3D模型,所述3D模型包含所述3D所成像区域内的对象的空间配置;以及An image processor is configured to use the 3D image to provide a 3D model of a region imaged in 3D, the 3D model including a spatial arrangement of objects within the region imaged in 3D; and 3D电子显示器,被配置为使用所述3D模型显示所述3D所成像区域的一部分,并且视觉上突出显示在所显示部分内的对象,所述所显示部分位于离所述车辆小于阈值距离,A 3D electronic display is configured to display a portion of the 3D-imaged area using the 3D model, and to visually highlight objects within the displayed portion, the displayed portion being located at a distance less than a threshold from the vehicle. 其中,所述视觉上突出显示的对象被配置为当车辆在所述相邻的区域的方向上移动时,提供防碰撞,The visually highlighted object is configured to provide collision avoidance as the vehicle moves in the direction of the adjacent area. 其中,所述阈值距离对应于与被配置为由所述3D电子显示器显示的所述3D所成像区域的一部分相关联的零视差平面,所述显示部分中的所述视觉上突出显示的对象由于在所述零视差平面的前方被感知。The threshold distance corresponds to a zero parallax plane associated with a portion of the 3D-imaged area configured to be displayed by the 3D electronic display, wherein the visually highlighted object in the display portion is perceived in front of the zero parallax plane. 12.根据权利要求11所述的3D车辆监控系统,其中,所述3D摄像机包括彼此偏移的多个摄像机中的一个或多个、飞行时间摄像机、以及基于激光的距离传感器和二维(2D)摄像机。12. The 3D vehicle monitoring system of claim 11, wherein the 3D camera includes one or more of a plurality of cameras offset from each other, a time-of-flight camera, a laser-based distance sensor, and a two-dimensional (2D) camera. 13.根据权利要求11所述的3D车辆监控系统,其中,被配置为在所述所显示部分被呈现在所述3D电子显示器之前,将投影变换应用到所述3D模型,所述投影变换被配置为与在大于对应于所述零视差平面的阈值距离的距离处的所述所显示部分中的对象相比,增强突出显示的对象的相对大小。13. The 3D vehicle monitoring system of claim 11, wherein a projection transformation is applied to the 3D model before the displayed portion is presented on the 3D electronic display, the projection transformation being configured to enhance the relative size of highlighted objects compared to objects in the displayed portion at a distance greater than a threshold distance corresponding to the zero parallax plane. 14.根据权利要求11所述的3D车辆监控系统,其中,所述3D电子显示器包括基于多光束光栅的3D电子显示器。14. The 3D vehicle monitoring system according to claim 11, wherein the 3D electronic display includes a 3D electronic display based on a multibeam grating. 15.一种车辆监控方法,所述方法包括:15. A vehicle monitoring method, the method comprising: 使用3D扫描器捕获与车辆相邻的区域的3D扫描;Use a 3D scanner to capture a 3D scan of the area adjacent to the vehicle; 从所捕获的3D扫描产生3D模型,所述3D模型包含位于所扫描区域内的对象的空间配置;以及A 3D model is generated from the captured 3D scan, the 3D model containing the spatial configuration of objects located within the scanned area; and 使用所述3D模型显示所述所扫描区域的一部分,The 3D model is used to display a portion of the scanned area. 其中,显示所述所扫描区域的一部分包括视觉上突出显示在离车辆小于阈值距离的距离处的所显示部分内的对象,The display of a portion of the scanned area includes objects visually highlighted within the displayed portion at a distance less than a threshold from the vehicle. 其中,所述视觉上突出显示的对象被配置为以增强比所述阈值距离更靠近所述车辆的对象的用户感知,The visually highlighted objects are configured to enhance user perception of objects that are closer to the vehicle than the threshold distance. 其中,显示所述所扫描区域的一部分还包括使用3D电子显示器,所述视觉上突出显示的对象出现在对应于所述阈值距离的所述3D电子显示器的零视差平面的前方。The display of a portion of the scanned area also includes the use of a 3D electronic display, wherein the visually highlighted object appears in front of the zero parallax plane of the 3D electronic display corresponding to the threshold distance. 16.根据权利要求15所述的车辆监控方法,其中产生所述3D模型包括在所述3D电子显示器上显示所述所扫描区域的一部分之前,将投影变换应用于所述3D模型。16. The vehicle monitoring method of claim 15, wherein generating the 3D model includes applying a projection transformation to the 3D model before displaying a portion of the scanned area on the 3D electronic display. 17.根据权利要求16所述的车辆监控方法,其中,所述投影变换包含所述所显示部分的深度压缩,以增强与在大于对应于所述零视差平面的阈值距离的距离处的所述所扫描区域中的对象相比所述视觉上突出显示的对象的相对大小。17. The vehicle monitoring method of claim 16, wherein the projection transformation includes depth compression of the displayed portion to enhance the relative size of the visually highlighted object compared to an object in the scanned region at a distance greater than a threshold distance corresponding to the zero parallax plane. 18.根据权利要求15所述的车辆监控方法,其中,使用所述3D电子显示器显示所述所扫描区域的一部分包括:18. The vehicle monitoring method of claim 15, wherein displaying a portion of the scanned area using the 3D electronic display comprises: 在板光导中以非零传播角度引导作为光束的光;In a plate optical guide, light is guided as a beam at a non-zero propagation angle; 使用在所述板光导上的多光束衍射光栅的阵列衍射地耦合处被引导光束的一部分,其中,衍射地耦合处所述被引导光束的一部分包括产生多个被耦合出的光束,所述多个被耦合出的光束在对应于所述3D电子显示器的不同视图的多个不同的主角度方向上被定向远离所述板光导;以及A portion of the guided beam is diffracted at the coupling point of an array of multi-beam diffraction gratings on the plate light guide, wherein the portion of the guided beam at the diffraction coupling point includes generating a plurality of coupled beams, the plurality of coupled beams being directed away from the plate light guide in a plurality of different principal angular directions corresponding to different views of the 3D electronic display; and 使用多个光阀调制所述多个被耦合出的光束,所调制的光束表示所述3D电子显示器的像素以将所述部分显示为3D图像。The plurality of coupled light beams are modulated using multiple light valves, the modulated light beams representing pixels of the 3D electronic display to display the portion as a 3D image.
HK18106475.1A 2015-05-30 Vehicle monitoring system HK1246955B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2015/033432 WO2016195647A1 (en) 2015-05-30 2015-05-30 Vehicle monitoring system

Publications (2)

Publication Number Publication Date
HK1246955A1 HK1246955A1 (en) 2018-09-14
HK1246955B true HK1246955B (en) 2022-02-18

Family

ID=

Similar Documents

Publication Publication Date Title
US11203346B2 (en) Vehicle monitoring system
JP7126939B2 (en) Multiview display with head tracking
KR102274754B1 (en) Multi-beam diffraction grating-based head-up display
KR101660911B1 (en) Multibeam diffraction grating-based backlighting
EP3326358B1 (en) Multiview camera
US11310478B2 (en) Multiview camera array, multiview system, and method having camera sub-arrays with a shared camera
JP7674244B2 (en) Multi-view display with shiftable convergence plane, system and method - Patents.com
TWI695189B (en) Cross-render multiview camera, system, and method
KR20210101332A (en) Multi-directional backlight, multi-user multi-view display and method
KR20190051992A (en) Transparent display and method
JP2021536588A (en) Multi-view display, system, and method with user tracking
JP2020187762A (en) Vehicle monitoring system
KR20210145853A (en) Light source with binary emission pattern, multiview backlight and method
KR20210088007A (en) Static multi-view display and method with multi-view areas
HK1246955B (en) Vehicle monitoring system
CN112368629B (en) Multiview display and method with dynamically reconfigurable multiview pixels
KR20220106171A (en) Multi-user multi-view displays, systems, and methods
HK1254584A1 (en) Multibeam diffraction grating-based display with head tracking
HK40047057A (en) Multiview display, system, and method with user tracking