[go: up one dir, main page]

HK40016432B - Systems and methods for layered virtual features in an amusement park environment - Google Patents

Systems and methods for layered virtual features in an amusement park environment Download PDF

Info

Publication number
HK40016432B
HK40016432B HK62020005816.7A HK62020005816A HK40016432B HK 40016432 B HK40016432 B HK 40016432B HK 62020005816 A HK62020005816 A HK 62020005816A HK 40016432 B HK40016432 B HK 40016432B
Authority
HK
Hong Kong
Prior art keywords
layer
display
virtual features
virtual
passenger
Prior art date
Application number
HK62020005816.7A
Other languages
Chinese (zh)
Other versions
HK40016432A (en
Inventor
Gregory Shellman Hall
David Gerard Majdali
Original Assignee
Universal City Studios Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universal City Studios Llc filed Critical Universal City Studios Llc
Publication of HK40016432A publication Critical patent/HK40016432A/en
Publication of HK40016432B publication Critical patent/HK40016432B/en

Links

Description

用于游乐园环境中的分层虚拟特征的系统和方法Systems and methods for layered virtual features in amusement park environments

相关申请的交叉引用Cross-references to related applications

本申请要求2017年3月6日提交的题为“SYSTEMS AND METHODS FOR DIGITALOVERLAY IN AN AMUSEMENT PARK ENVIRONMENT”的美国临时申请号62/467,817的优先权和权益,出于所有目的,该临时申请特此以其整体通过引用被并入。This application claims priority and benefit to U.S. Provisional Application No. 62/467,817, filed March 6, 2017, entitled “SYSTEMS AND METHODS FOR DIGITALOVERLAY IN AN AMUSEMENT PARK ENVIRONMENT,” which is hereby incorporated in its entirety by reference for all purposes.

技术领域Technical Field

本文中公开的主题涉及用于通过使用与固定可视化设备协调的可穿戴可视化设备来向用户提供增强和虚拟现实体验的系统和方法。The topics disclosed in this article relate to systems and methods for providing users with augmented and virtual reality experiences by using wearable visualization devices that coordinate with fixed visualization devices.

背景技术Background Technology

游乐园和/或主题公园可以包括在向游乐园的客人(例如,家庭和/或所有年龄的人)提供乐趣方面有用的各种娱乐景点、餐馆和骑乘设备(ride)。游乐园的区域可以具有具体对准某些观众的不同主题。例如,某些区域可以包括传统上儿童感兴趣的主题,而其他区域可以包括传统上更成熟的观众感兴趣的主题。通常,具有与这样的游乐园相关联的主题的位置可以被称为景点或主题景点。Amusement parks and/or theme parks can include a variety of entertainment attractions, restaurants, and rides that are useful in providing fun to park guests (e.g., families and/or people of all ages). Areas within an amusement park can have different themes specifically targeted at certain audiences. For example, some areas may include themes that are traditionally of interest to children, while others may include themes that are traditionally of interest to more mature audiences. Typically, locations with themes associated with such an amusement park can be referred to as attractions or themed attractions.

可以使用固定装备、建筑物布局、道具、装饰品等等来建立主题景点,其中大部分通常可以涉及某个主题。在要在相同位置中建立不同主题的情形下,与较旧主题相关联的特征可以用与较新主题相关联的特征来替换。取决于位置的主题的复杂程度,在装饰物、家具、装备、道具等等可能被移除或替换时,这可能证明是非常困难和耗时的。实际上,对于某些类型的景点,相对复杂的主题已变得更加普遍来为客人提供更加沉浸式的体验。Themed attractions can be created using fixed equipment, building layouts, props, decorations, and so on, most of which typically relate to a single theme. When creating different themes in the same location, features associated with the older theme can be replaced with features associated with the newer theme. Depending on the complexity of the theme at the location, this can prove very difficult and time-consuming when decorations, furniture, equipment, props, etc., may be removed or replaced. In fact, for certain types of attractions, relatively complex themes have become more common to provide guests with a more immersive experience.

现在认识到合期望的是:包括其中有可能以相对于传统技术而言灵活且高效的方式改变景点主题的景点,或者包括或移除这样的景点中的某些主题特征。现在还认识到可能合期望的是:加强客人对这样的景点的沉浸式体验,并且为客人提供更个性化或定制的体验。It is now recognized that what is desirable is to include attractions that have the potential to alter their theme in a more flexible and efficient manner than traditional technologies, or to include or remove certain thematic features from such attractions. It is also now recognized that what may be desirable is to enhance the immersive experience for guests at such attractions and to provide guests with more personalized or customized experiences.

发明内容Summary of the Invention

以下阐述在本文中公开的某些实施例的概述。应当理解的是,呈现这些方面仅仅是为了向读者提供对这些一定的实施例的简要概述,并且这些方面并不意图限制本公开的范围。实际上,本公开可以涵盖可能没有在下面阐述的各种各样的方面。The following provides an overview of some embodiments disclosed herein. It should be understood that these aspects are presented merely to provide the reader with a brief overview of these certain embodiments, and these aspects are not intended to limit the scope of this disclosure. In fact, this disclosure may cover a wide variety of aspects that may not be set forth below.

在一个实施例中,一种用于向用户提供增强现实、虚拟现实和/或混合现实体验的系统,包括第一显示器和第二显示器。用户通过第一显示器和第二显示器观看现实世界环境。该系统包括:包括第一显示器的可穿戴可视化设备和包括第二显示器的固定可视化设备。第一显示器被配置成显示第一层虚拟特征,并且第二显示器被配置成显示第二层虚拟特征。该系统包括:处理器,其被配置成生成第一层虚拟特征和第二层虚拟特征。处理器被配置成与可穿戴可视化设备和固定可视化设备可操作地通信,以协调第一层虚拟特征和第二层虚拟特征的呈现。In one embodiment, a system for providing an augmented reality, virtual reality, and/or mixed reality experience to a user includes a first display and a second display. The user views a real-world environment through the first and second displays. The system includes a wearable visualization device including the first display and a fixed visualization device including the second display. The first display is configured to display a first layer of virtual features, and the second display is configured to display a second layer of virtual features. The system includes a processor configured to generate the first and second layer of virtual features. The processor is configured to operatively communicate with the wearable visualization device and the fixed visualization device to coordinate the presentation of the first and second layer of virtual features.

在一个实施例中,一种用于向用户提供增强现实、虚拟现实和/或混合现实体验的系统,包括乘客骑乘车辆、固定可视化设备以及处理器。乘客骑乘车辆被配置成在游乐园中的骑乘期间穿过路径或轨道。固定可视化设备包括:耦合到乘客骑乘车辆的透明显示器。固定可视化设备被配置成将虚拟特征叠加到通过透明显示器可见的现实世界环境上。处理器被配置成生成虚拟特征并且协调该虚拟特征与骑乘装置的骑乘效果的呈现。In one embodiment, a system for providing an augmented reality, virtual reality, and/or mixed reality experience to a user includes a passenger riding vehicle, a fixed visualization device, and a processor. The passenger riding vehicle is configured to traverse paths or tracks during a ride in an amusement park. The fixed visualization device includes a transparent display coupled to the passenger riding vehicle. The fixed visualization device is configured to overlay virtual features onto a real-world environment visible through the transparent display. The processor is configured to generate virtual features and coordinate the presentation of these virtual features with the riding effect of the riding device.

在一个实施例中,一种用于向用户提供增强现实、虚拟现实和/或混合现实体验的方法,包括:使用处理器来生成第一层虚拟特征和第二层虚拟特征。该方法还包括:响应于来自处理器的指令,在第一显示时间、在第一显示器上显示第一层虚拟特征。第一显示器被设置在可穿戴可视化设备内。该方法进一步包括:响应于来自处理器的指令,在第二显示时间、在第二显示器上显示第二层虚拟特征。第二显示器被设置在固定可视化设备内,该固定可视化设备与可穿戴可视化设备物理地分离。In one embodiment, a method for providing a user with an augmented reality, virtual reality, and/or mixed reality experience includes: using a processor to generate a first layer of virtual features and a second layer of virtual features. The method further includes: displaying the first layer of virtual features on a first display at a first display time in response to an instruction from the processor. The first display is disposed within a wearable visualization device. The method further includes: displaying the second layer of virtual features on a second display at a second display time in response to an instruction from the processor. The second display is disposed within a fixed visualization device, which is physically separated from the wearable visualization device.

可以关于本公开的各种方面进行以上指出的特征的各种细化。同样也可以在这些各种方面中并入另外的特征。这些细化和附加特征可以单独地或以任何组合存在。Various refinements of the features mentioned above can be made with respect to various aspects of this disclosure. Similarly, additional features can be incorporated into these various aspects. These refinements and additional features can exist individually or in any combination.

附图说明Attached Figure Description

当参考附图阅读以下详细描述时,本公开的这些和其他特征、方面和优点将变得更好理解,在所述附图中,相同的字符遍及附图表示相同的部分,其中:These and other features, aspects, and advantages of this disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which the same characters permeate the drawings to denote the same parts, wherein:

图1是根据本实施例的可以在增强现实(AR)或虚拟现实(VR)系统中使用的可穿戴可视化设备和计算机图形生成系统的实施例的图示;Figure 1 is an illustration of an embodiment of a wearable visualization device and a computer graphics generation system that can be used in an augmented reality (AR) or virtual reality (VR) system according to this embodiment;

图2是根据本实施例的图1的可穿戴可视化设备的实施例的分解透视图;Figure 2 is an exploded perspective view of an embodiment of the wearable visualization device of Figure 1 according to this embodiment;

图3是根据本实施例的图1的可穿戴可视化设备的实施例的分解透视图;Figure 3 is an exploded perspective view of an embodiment of the wearable visualization device of Figure 1 according to this embodiment;

图4是根据本实施例的图1的增强现实(AR)或虚拟现实(VR)系统的固定可视化设备和可穿戴可视化设备的图示,该系统可以在乘客骑乘车辆中使用;Figure 4 is an illustration of a fixed visualization device and a wearable visualization device of the augmented reality (AR) or virtual reality (VR) system of Figure 1 according to this embodiment, which can be used in a passenger riding vehicle;

图5是图4的乘客骑乘车辆的透视图,其示出了根据本实施例的具有固定可视化设备的增强现实(AR)或虚拟现实(VR)系统的实施例;Figure 5 is a perspective view of the passenger-riding vehicle of Figure 4, illustrating an embodiment of an augmented reality (AR) or virtual reality (VR) system with fixed visualization equipment according to this embodiment;

图6是图4的乘客骑乘车辆的透视图,其示出了根据本实施例的具有可穿戴可视化设备和固定可视化设备的增强现实(AR)或虚拟现实(VR)系统的实施例;以及Figure 6 is a perspective view of the passenger-riding vehicle of Figure 4, illustrating an embodiment of an augmented reality (AR) or virtual reality (VR) system according to this embodiment, featuring wearable and fixed visualization devices; and

图7是根据本实施例的图4的增强现实(AR)或虚拟现实(VR)系统的操作的方法的流程图。Figure 7 is a flowchart of a method for operating the augmented reality (AR) or virtual reality (VR) system of Figure 4 according to this embodiment.

具体实施方式Detailed Implementation

以下将描述本公开的一个或多个特定实施例。为了提供对这些实施例的简洁描述,可能没有在说明书中描述实际实现方式的全部特征。应当领会的是,在任何这样的实际实现方式的开发中,如在任何工程或设计项目中,必须做出众多实现方式特定的决策来实现开发者的特定目标,诸如符合系统相关和商业相关的约束,该约束可能从一个实现方式到另一个实现方式不同。而且,应当领会的是,这样的开发努力可能是复杂且耗时的,但是对于受益于本公开的普通技术人员而言将仍然是设计、制造和制作的例行任务。The following describes one or more specific embodiments of this disclosure. To provide a concise description of these embodiments, not all features of the actual implementation may be described in the specification. It should be understood that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which may differ from one implementation to another. Moreover, it should be understood that such development efforts may be complex and time-consuming, but will remain routine tasks of design, manufacture, and production for those skilled in the art who benefit from this disclosure.

本实施例涉及如下系统和方法:所述系统和方法提供增强现实(AR)体验、虚拟现实(VR)体验、混合现实(例如,AR和VR的组合)体验或其组合,作为与游乐园或主题公园相关联的景点的部分。根据本实施例,景点可以不必限于游乐园的区域。实际上,本公开的各方面还可以涉及在超出游乐园的边界的位置中的景点的实现方式,诸如在与游乐园相关联的旅馆中,或者在向游乐园和/或旅馆以及从游乐园和/或旅馆运送客人的车辆中。This embodiment relates to systems and methods that provide augmented reality (AR) experiences, virtual reality (VR) experiences, mixed reality (e.g., a combination of AR and VR) experiences, or combinations thereof, as part of attractions associated with an amusement park or theme park. According to this embodiment, attractions need not be limited to the area of the amusement park. In fact, aspects of this disclosure can also relate to the implementation of attractions in locations beyond the boundaries of the amusement park, such as in hotels associated with the amusement park, or in vehicles transporting guests to and/or from the amusement park and/or hotel.

本实施例包括例如下述各项的组合:某些硬件配置、软件配置(例如,算法结构)、以及某些景点特征,其可被利用来实现AR、VR和/或混合现实体验。这样的体验可以为游乐园的客人提供充满景点的体验,其可以是可定制的、个性化的和交互式的。This embodiment includes combinations of, for example, the following: certain hardware configurations, software configurations (e.g., algorithmic structures), and certain attraction features, which can be utilized to realize AR, VR, and/or mixed reality experiences. Such experiences can provide amusement park guests with an attraction-filled experience that can be customizable, personalized, and interactive.

例如,本实施例可以包括:观看设备,诸如可穿戴可视化设备(例如,电子护目镜或显示器、眼镜)和固定可视化设备(例如,透明发光二极管[LED]显示器、透明有机发光二极管[OLED]显示器),游乐园客人和员工可以通过它们观看AR、VR和/或混合现实场景。应当领会的是,本文中公开的固定可视化设备可以固定和/或耦合到结构,诸如乘客骑乘车辆、建筑物的墙壁等等。固定可视化设备可以与可穿戴可视化设备物理地分离并且与其不同。可以利用某些实现方式来加强客人体验,例如,通过在与游乐园相关联的环境中虚拟地移除或添加特征,以提供可调整的虚拟环境以用于同一骑乘中的不同体验,以使得客人能够具有与另一客人相同的视点,等等。For example, this embodiment may include viewing devices, such as wearable visualization devices (e.g., electronic goggles or displays, glasses) and fixed visualization devices (e.g., transparent light-emitting diode [LED] displays, transparent organic light-emitting diode [OLED] displays), through which amusement park guests and staff can view AR, VR, and/or mixed reality scenes. It should be understood that the fixed visualization devices disclosed herein may be fixed and/or coupled to structures, such as passenger ride vehicles, building walls, etc. Fixed visualization devices may be physically separate from and distinct from wearable visualization devices. Certain implementations can be used to enhance the guest experience, for example, by virtually removing or adding features in the environment associated with the amusement park to provide an adjustable virtual environment for different experiences on the same ride, allowing guests to have the same viewpoint as another guest, etc.

游乐园内的某些景点可以包括乘客骑乘车辆,其可以被专门设计成与观看设备协作,诸如向AR、VR或混合现实体验添加附加深度和/或真实感。在一个实施例中,固定可视化设备可以包括透明显示器。在一个实施例中,乘客骑乘车辆的舱室的常规板件(panel)和/或窗户(例如,玻璃、亚克力(acrylic))可以用透明显示器替换,该透明显示器可以通过将虚拟图像和/或视频叠加到透明显示器(例如,透明LED显示器、透明OLED显示器)的部分或整体上来增强舱室外面的景色。例如,在一个实施例中,透明显示器可以被用来在乘客骑乘车辆行驶经过动画人物(例如,龙)时显示冷凝,以创建动画人物在乘客骑乘车辆上呼吸的错觉。Some attractions within an amusement park may include passenger rides that can be specifically designed to work with viewing devices, such as adding additional depth and/or realism to AR, VR, or mixed reality experiences. In one embodiment, the fixed visualization device may include a transparent display. In one embodiment, the conventional panels and/or windows (e.g., glass, acrylic) of the passenger ride's cabin can be replaced with a transparent display that can enhance the view outside the cabin by overlaying virtual images and/or videos onto portions or the entirety of the transparent display (e.g., a transparent LED display, a transparent OLED display). For example, in one embodiment, a transparent display could be used to display condensation as the passenger ride passes an animated character (e.g., a dragon) to create the illusion that the animated character is breathing on the passenger ride.

附加或替换地,可穿戴可视化设备可以被用来增强乘客对环境的感知。例如,可穿戴可视化设备可以创建动画人物进入舱室(例如,龙伸入舱室中或向舱室中喷吐火焰)的错觉,这可能导致针对客人的更加沉浸式的体验。固定可视化设备和可穿戴可视化设备可以被配置成独立操作,或者可以通过控制器(例如,计算机图形生成系统、一个或多个处理器)可操作地耦合,其可以同步和/或协调被显示在固定可视化设备和可穿戴可视化设备上的可视化。控制器还可以同步和/或协调由可穿戴可视化设备和/或固定可视化设备提供的AR、VR和/或混合现实体验与外部电子动物或围绕乘客骑乘车辆的轨道设置的其他骑乘元素。Additionally or alternatively, wearable visualization devices can be used to enhance passengers' perception of their environment. For example, wearable visualization devices can create the illusion of animated characters entering cabins (e.g., a dragon reaching into a cabin or breathing fire into a cabin), which may result in a more immersive experience for guests. Fixed and wearable visualization devices can be configured to operate independently or can be operatively coupled via a controller (e.g., a computer graphics generation system, one or more processors) that can synchronize and/or coordinate visualizations displayed on both fixed and wearable visualization devices. The controller can also synchronize and/or coordinate AR, VR, and/or mixed reality experiences provided by the wearable and/or fixed visualization devices with external electronic animals or other riding elements set up around the track surrounding the passenger's riding vehicle.

此外,某些数据可以被从可穿戴可视化设备收集,以使得能够实现针对目标广告的计算能力和/或其他资源的更高效使用,以提供稀有虚拟特征(例如,“复活节彩蛋”),以用于触发效果或调整节目等等。例如,骑乘控制系统可以在启动骑乘装置的移动或启动其他改变(例如,改变固定可视化设备上的虚拟图像)之前,确定穿戴着可穿戴可视化设备的乘客是否已经在某个方向上看(例如,看固定可视化设备上的虚拟图像)。还可以收集员工可视化数据。例如,骑乘控制系统可以在启动骑乘装置的移动之前确定操作骑乘装置的员工是否已经在某个方向上看(例如,以确认没有客人正进入骑乘装置)。可视化设备还可以被用来起到骑乘操作员平视显示器(HUD)的作用。Furthermore, certain data can be collected from wearable visualization devices to enable more efficient use of computing power and/or other resources for targeted advertising, to provide rare virtual features (e.g., “Easter eggs”) for triggering effects or adjusting programming, and so on. For example, a ride control system can determine whether a passenger wearing a wearable visualization device is already looking in a certain direction (e.g., looking at a virtual image on a fixed visualization device) before initiating movement of the ride or initiating other changes (e.g., changing a virtual image on a fixed visualization device). Employee visualization data can also be collected. For example, a ride control system can determine whether the employee operating the ride is already looking in a certain direction (e.g., to confirm that no customer is entering the ride) before initiating movement of the ride. Visualization devices can also be used as ride operator heads-up displays (HUDs).

为了帮助说明,图1描绘了AR/VR系统10的实施例,该AR/VR系统10被配置成使得用户12(例如,客人、游乐园员工)能够体验受控AR、VR和/或混合现实场景(例如,观看、与之交互)。根据某些实施例,用户12可以购买或以其他方式而被提供可穿戴可视化设备14,在某些实施例中,该可穿戴可视化设备14可以包括电子眼镜16(例如,AR/VR眼镜、护目镜)。如下面进一步详细描述的,可穿戴可视化设备14可以包括:可穿戴部分18,其被示为头带,其被配置成容纳电子眼镜16的至少一部分。For illustrative purposes, Figure 1 depicts an embodiment of an AR/VR system 10 configured to enable a user 12 (e.g., a guest, amusement park employee) to experience controlled AR, VR, and/or mixed reality scenes (e.g., watching, interacting with them). According to some embodiments, the user 12 may purchase or otherwise be provided with a wearable visualization device 14, which in some embodiments may include electronic glasses 16 (e.g., AR/VR glasses, goggles). As described further in detail below, the wearable visualization device 14 may include a wearable portion 18, shown as a headband, configured to accommodate at least a portion of the electronic glasses 16.

可穿戴可视化设备14可以单独使用或与其他特征组合使用,以创建超现实环境20,其可以包括AR体验、VR体验、混合现实体验、计算机中介的现实体验、其组合、或针对用户12的其他类似的超现实环境。具体地,用户12可以在贯穿骑乘(例如,乘客骑乘车辆)的持续时间或者诸如在游戏期间的另一预定点、在游乐园的特定区域的入口处、在去往与游乐园相关联的旅馆的骑乘期间、在旅馆处等等穿戴该可穿戴可视化设备14。The wearable visualization device 14 can be used alone or in combination with other features to create a surreal environment 20, which may include AR experiences, VR experiences, mixed reality experiences, computer-mediated reality experiences, combinations thereof, or other similar surreal environments for the user 12. Specifically, the user 12 may wear the wearable visualization device 14 for the duration of a ride (e.g., a passenger riding a vehicle) or at other predetermined points such as during gameplay, at the entrance to a specific area of an amusement park, during a ride to a hotel associated with the amusement park, at a hotel, etc.

在一个实施例中,可穿戴可视化设备14可以包括其中某些虚拟特征可以被叠加到透明表面(例如,眼镜)上的设备,或者可以包括其中虚拟特征被叠加到大体上实时的视频上的设备,或其组合(例如,可穿戴可视化设备14可以能够在透明与不透明的用户12可视化之间切换)。在一个实施例中,可穿戴可视化设备14可以包括诸如光投射特征之类的特征,其被配置成将光投射到用户12的一只或两只眼睛中,使得虚拟特征被叠合在现实世界对象之上。可以认为这样的可穿戴可视化设备14包括视网膜显示器。In one embodiment, the wearable visualization device 14 may include a device in which certain virtual features can be superimposed onto a transparent surface (e.g., glasses), or may include a device in which virtual features are superimposed onto substantially real-time video, or a combination thereof (e.g., the wearable visualization device 14 may be able to switch between transparent and opaque visualizations of the user 12). In one embodiment, the wearable visualization device 14 may include features such as light-projection features configured to project light into one or both eyes of the user 12, such that virtual features are superimposed onto real-world objects. Such a wearable visualization device 14 may be considered to include a retinal display.

因此,在一个实施例中,用户12可以通过大体上透明的一套电子眼镜16来观看现实世界环境,其中某些特征被叠加到电子眼镜16的表面(或用户12的眼睛)上,使得用户12感知到虚拟特征被整合到实体(physical)环境中。在一个实施例中,用户12可以观看具有叠加的虚拟特征的实体环境的实时视频。Therefore, in one embodiment, user 12 can view a real-world environment through a set of generally transparent electronic glasses 16, wherein certain features are superimposed onto the surface of the electronic glasses 16 (or user 12's eyes), making user 12 perceive virtual features integrated into the physical environment. In one embodiment, user 12 can view a real-time video of a physical environment with superimposed virtual features.

在一个实施例中,在穿戴着可穿戴可视化设备14时,用户12可能会觉得完全被超现实环境20包围,并且可以感知到超现实环境20是包括某些虚拟特征的现实世界实体环境。具体地,在一个实施例中,可穿戴可视化设备14可以完全控制用户12的视图(例如,使用不透明的观看表面),使得超现实环境20可以是实时视频,其包括与一个或多个增强或虚拟现实图像24(例如,虚拟增强)电子地合并的实体环境的现实世界图像22。In one embodiment, when wearing the wearable visualization device 14, the user 12 may feel completely surrounded by the surreal environment 20 and perceive that the surreal environment 20 is a real-world physical environment that includes certain virtual features. Specifically, in one embodiment, the wearable visualization device 14 can have complete control over the user 12's view (e.g., using an opaque viewing surface) such that the surreal environment 20 can be real-time video that includes real-world images 22 of the physical environment electronically merged with one or more augmented or virtual reality images 24 (e.g., virtual augmentation).

现实世界图像22通常表示用户12将看到的内容,即使在没有穿戴可穿戴可视化设备14的时候。术语“实时”指示图像是在大体上接近实际观察时间的时间帧内获得和/或提供的。更具体地,在其他实施例中,可穿戴可视化设备14可以仅部分地控制用户12的视图(例如,使用透明观看表面),使得超现实环境20是具有叠加到透明表面上或用户12的眼睛上的增强或虚拟现实图像24的实际实体环境。根据本公开的另外的实施例,增强或虚拟现实图像24可以起作用来叠加现实世界对象,使得对象似乎不再存在或被删除(例如,现实世界对象利用虚拟对象或虚拟环境表示来被完全或部分遮盖)。Real-world image 22 typically represents what user 12 will see, even when not wearing wearable visualization device 14. The term "real-time" indicates that the image is acquired and/or provided within a time frame substantially close to the actual observation time. More specifically, in other embodiments, wearable visualization device 14 may only partially control user 12's view (e.g., using a transparent viewing surface), such that surreal environment 20 is a real-world environment with augmented or virtual reality image 24 superimposed on the transparent surface or on user 12's eyes. According to further embodiments of this disclosure, augmented or virtual reality image 24 may function to superimpose real-world objects such that the objects appear to no longer exist or have been removed (e.g., real-world objects are completely or partially obscured using virtual object or virtual environment representations).

在一个实施例中以及如在可穿戴可视化设备14的切除部分中图示的,为了支持超现实环境20的各方面的创建,可穿戴可视化设备14可以包括:处理电路25,诸如处理器26和存储器28。处理器26可以可操作地耦合到存储器28以执行用于实施目前公开的技术的指令,例如生成现实世界图像22和/或一个或多个增强或虚拟现实图像24(例如,虚拟特征或图像)。这些指令可以被编码在存储于有形非暂时性计算机可读介质中的程序或代码中,该介质诸如存储器28和/或其他存储装置。处理器26可以是通用处理器、片上系统(SoC)设备、专用集成电路(ASIC)或某个其他类似的处理器配置。存储器28和处理器26可以一起形成AR/VR系统10的全部或部分。In one embodiment, and as illustrated in a cutaway portion of the wearable visualization device 14, to support the creation of various aspects of the surreal environment 20, the wearable visualization device 14 may include processing circuitry 25, such as a processor 26, and memory 28. The processor 26 may be operatively coupled to memory 28 to execute instructions for implementing currently disclosed techniques, such as generating real-world images 22 and/or one or more augmented or virtual reality images 24 (e.g., virtual features or images). These instructions may be encoded in a program or code stored in a tangible, non-transitory computer-readable medium, such as memory 28 and/or other storage devices. The processor 26 may be a general-purpose processor, a system-on-a-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration. Memory 28 and processor 26 may together form all or part of the AR/VR system 10.

在一个实施例中,如进一步图示的,可穿戴可视化设备14还可以包括一对显示器30和32(例如,其可以被提供在可穿戴可视化设备14的框架前面,在该位置中眼镜镜片否则将会出现),其分别对应于用户12的每只眼睛。在一个实施例中,可以采用统一的显示器。通过非限制性示例的方式,相应的显示器30和32均可以包括透明镜片,增强或虚拟现实图像24可以被叠加在该透明镜片上。在一个实施例中,显示器30和32可以是显示器表面,并且可以包括位于其相应外围附近的特征(例如,电路、光发射器),其被配置成叠加增强或虚拟现实图像24。In one embodiment, as further illustrated, the wearable visualization device 14 may also include a pair of displays 30 and 32 (e.g., which may be provided in front of the frame of the wearable visualization device 14, in which eyeglass lenses would otherwise appear), corresponding to each eye of the user 12 respectively. In one embodiment, a uniform display may be used. By way of non-limiting example, both of the respective displays 30 and 32 may include a transparent lens on which the augmented or virtual reality image 24 may be superimposed. In one embodiment, displays 30 and 32 may be display surfaces and may include features (e.g., circuitry, light emitters) located near their respective peripheries, configured to superimpose the augmented or virtual reality image 24.

附加地或替换地,显示器30和32可以包括不透明液晶显示器(LCD)、不透明有机发光二极管(OLED)显示器,或者在向用户12显示现实世界图像22和增强或虚拟现实图像24的方面有用的其他类似的显示器。在一个实施例中,相应的显示器30和32可以均包括透明(例如,透视)LED显示器或透明(例如,透视)OLED显示器,其在允许例如用户12观看作为到实际和实体环境(例如,与游乐园或乘客骑乘车辆的内部相关联的景点)的叠加而出现在相应显示器30和32上的增强或虚拟现实图像24。这样的配置还可以使得用户12能够观看出现在其他显示器上的其他层虚拟图像,如下面更详细地讨论的。Additionally or alternatively, displays 30 and 32 may include opaque liquid crystal displays (LCDs), opaque organic light-emitting diode (OLED) displays, or other similar displays useful for displaying real-world images 22 and augmented or virtual reality images 24 to user 12. In one embodiment, the respective displays 30 and 32 may both include transparent (e.g., see-through) LED displays or transparent (e.g., see-through) OLED displays, which allow, for example, user 12 to view the augmented or virtual reality images 24 appearing on the respective displays 30 and 32 as an overlay to the actual and physical environment (e.g., attractions associated with an amusement park or the interior of a passenger-riding vehicle). Such a configuration may also enable user 12 to view additional layers of virtual images appearing on other displays, as discussed in more detail below.

可穿戴可视化设备14的相机34和36可以分别对应于用户12的视点,并且可以被用来捕获实时视频数据(例如,现场视频)或实体环境的环境光信号。在一个实施例中,可以采用单个相机。可穿戴可视化设备14还可以包括用以跟踪用户的眼睛移动的附加相机,这对于其中将虚拟特征直接投射到用户12的眼睛中的实施例可以特别有用。可穿戴可视化设备14的通信特征38(例如,包括无线收发器)可以将经由相应相机34和36捕获的实时数据(例如,视频数据、眼睛跟踪数据)传送到处理器26和/或计算机图形生成系统40以供处理。Cameras 34 and 36 of the wearable visualization device 14 may correspond to the viewpoints of user 12, respectively, and may be used to capture real-time video data (e.g., live video) or ambient light signals of the physical environment. In one embodiment, a single camera may be used. The wearable visualization device 14 may also include an additional camera for tracking the user's eye movements, which may be particularly useful in embodiments where virtual features are projected directly into the eyes of user 12. Communication features 38 of the wearable visualization device 14 (e.g., including a wireless transceiver) may transmit real-time data (e.g., video data, eye-tracking data) captured via the respective cameras 34 and 36 to processor 26 and/or computer graphics generation system 40 for processing.

如所描绘的,可穿戴可视化设备14可以经由无线网络42(例如,无线局域网[WLAN]、无线广域网[WWAN]、近场通信[NFC])通信地耦合到计算机图形生成系统40(例如,游乐园内的服务器)。然而,在其他实施例中,经由相应相机34和36捕获的实时视频数据可以经由处理器26在可穿戴可视化设备14上被处理。另外,连接到处理器26的通信特征38(例如,无线收发器、输入/输出连接器)可以使得在处理器26和存储器28上包括的固件和/或软件能够被更新和/或配置用于特定使用。在一个实施例中,无线网络42可以通信地耦合AR/VR系统10的全部或一些组件。As depicted, the wearable visualization device 14 can be communicatively coupled to the computer graphics generation system 40 (e.g., a server in an amusement park) via a wireless network 42 (e.g., a wireless local area network [WLAN], a wireless wide area network [WWAN], or near field communication [NFC]). However, in other embodiments, real-time video data captured via respective cameras 34 and 36 can be processed on the wearable visualization device 14 via the processor 26. Additionally, communication features 38 (e.g., a wireless transceiver, an input/output connector) connected to the processor 26 can enable the firmware and/or software included on the processor 26 and memory 28 to be updated and/or configured for a specific use. In one embodiment, the wireless network 42 can communicatively couple all or some components of the AR/VR system 10.

可穿戴可视化设备14的其他特征可以传送取向数据、定位数据、视点数据(例如,焦距、取向、姿态)、运动跟踪数据等等,它们是基于经由可穿戴可视化设备14的传感器所获得的数据而获得和/或导出的。这样的传感器可以包括取向和定位传感器(例如,加速度计、磁力计、陀螺仪、全球定位系统[GPS]接收器)、运动跟踪传感器(例如,电磁和固态运动跟踪传感器)、惯性测量单元(IMU)以及其他的。Other features of the wearable visualization device 14 may transmit orientation data, positioning data, viewpoint data (e.g., focal length, orientation, attitude), motion tracking data, etc., which are obtained and/or derived from data acquired via sensors of the wearable visualization device 14. Such sensors may include orientation and positioning sensors (e.g., accelerometers, magnetometers, gyroscopes, GPS receivers), motion tracking sensors (e.g., electromagnetic and solid-state motion tracking sensors), inertial measurement units (IMUs), and others.

在某些实施例中,可穿戴可视化设备14的特征(例如,几何方面或标记)可以由监控系统41(例如,一个或多个相机)来监控,以确定可穿戴可视化设备14的定位、位置、取向等等以及进而确定用户12的定位、位置、取向等等。监控系统41可以通信地耦合到计算机图形生成系统40,并且被用来识别用户12(或多个用户)的定位、位置、取向等等。In some embodiments, features (e.g., geometric aspects or markings) of the wearable visualization device 14 may be monitored by a monitoring system 41 (e.g., one or more cameras) to determine the location, position, orientation, etc. of the wearable visualization device 14, and consequently, the location, position, orientation, etc. of the user 12. The monitoring system 41 may be communicatively coupled to the computer graphics generation system 40 and may be used to identify the location, position, orientation, etc. of the user 12 (or multiple users).

计算机图形生成系统40包括:处理电路43,诸如处理器44(例如,通用处理器或其他处理器)和存储器46,并且可以处理从可穿戴可视化设备14和监控系统41接收到的实时视频数据(例如,现场视频)、取向和定位数据、视点数据或其任何组合。具体地,计算机图形生成系统40可以使用该数据来生成参考系以将增强或虚拟现实图像24登记到实体环境,例如登记到所生成的现实世界图像22。具体地,使用基于取向数据、定位数据、视点数据、运动跟踪数据等等所生成的参考系,图形生成系统40然后可以渲染增强或虚拟现实图像24的视图,并且在一个实施例中,以在时间上和空间上与用户12在没有穿戴该可穿戴可视化设备14时将感知到的内容相称的方式来渲染现实世界图像22。图形生成系统40可以不断(例如,实时地)更新对现实世界图像的渲染,以反映相应用户12的相应取向、定位和/或运动中的改变。在某些实施例中,计算机图形生成系统40可以跟踪与多个用户12(例如,乘客骑乘车辆的乘客)相对应的这样的数据,其中每个用户12(或至少一些用户12)具有对应的可穿戴可视化设备14。The computer graphics generation system 40 includes processing circuitry 43, such as a processor 44 (e.g., a general-purpose processor or other processor), and memory 46, and can process real-time video data (e.g., live video), orientation and positioning data, viewpoint data, or any combination thereof received from the wearable visualization device 14 and the monitoring system 41. Specifically, the computer graphics generation system 40 can use this data to generate a reference frame to register the augmented or virtual reality image 24 to the physical environment, such as to the generated real-world image 22. Specifically, using the reference frame generated based on orientation data, positioning data, viewpoint data, motion tracking data, etc., the graphics generation system 40 can then render a view of the augmented or virtual reality image 24, and in one embodiment, render the real-world image 22 in a manner that is temporally and spatially commensurate with what the user 12 would perceive when not wearing the wearable visualization device 14. The graphics generation system 40 can continuously (e.g., in real-time) update the rendering of the real-world image to reflect changes in the corresponding orientation, positioning, and/or movement of the user 12. In some embodiments, the computer graphics generation system 40 can track such data corresponding to multiple users 12 (e.g., passengers riding in a vehicle), wherein each user 12 (or at least some users 12) has a corresponding wearable visualization device 14.

如上面阐述的,可穿戴可视化设备14包括若干个组件,并且通常可以包括被配置成被穿戴在用户12的头部上的电子眼镜16。可以使用电子眼镜16的各种各样不同的配置和实现方式,其中不同配置可以具有不同的大小和形状以更好地适应不同用户12的不同大小,以及具有不同的内部组件(例如,通信特征、换能器、显示器)以适应不同实现方式。As described above, the wearable visualization device 14 includes several components and typically includes electronic glasses 16 configured to be worn on the head of user 12. Various different configurations and implementations of the electronic glasses 16 can be used, where different configurations may have different sizes and shapes to better accommodate the different sizes of different users 12, and different internal components (e.g., communication features, transducers, displays) to accommodate different implementations.

为了为电子眼镜16提供附加的灵活性和支持,可穿戴可视化设备14的可穿戴部分18可以采取各种各样的形式,其示例实施例在图2和图3中被描绘。在图2中,可穿戴可视化设备14包括头带作为可穿戴部分18。可穿戴部分18的这样的实施例可以包括各种材料,该各种材料被配置成适应用户12的移动,同时为用户12提供舒适性(例如,弹性材料、吸汗材料、衬垫(padding))。目前认识到的是,可能合期望的是具有单独的可穿戴部分18和电子眼镜16,以使得可穿戴部分18能够被清洗而对可穿戴可视化设备14的处理电路25(图1)没有风险。然而,在某些实现方式中,可穿戴部分18可以并入处理电路25的一个或多个电子组件。在这样的实施例中,可穿戴部分18中的电子组件可以大体上远离环境而被密封以避免损坏。To provide additional flexibility and support for the electronic glasses 16, the wearable portion 18 of the wearable visualization device 14 can take various forms, with example embodiments depicted in Figures 2 and 3. In Figure 2, the wearable visualization device 14 includes a headband as the wearable portion 18. Such embodiments of the wearable portion 18 can include various materials configured to adapt to the movement of the user 12 while providing comfort (e.g., elastic materials, sweat-wicking materials, padding). It is recognized that it may be desirable to have separate wearable portions 18 and electronic glasses 16 so that the wearable portion 18 can be washed without risk to the processing circuitry 25 (Figure 1) of the wearable visualization device 14. However, in some implementations, the wearable portion 18 may incorporate one or more electronic components of the processing circuitry 25. In such embodiments, the electronic components in the wearable portion 18 may be sealed off substantially away from the environment to avoid damage.

图2的可穿戴部分18的实施例包括:容器区60,其被配置成接收电子眼镜16,并且在使用期间维持电子眼镜16相对于用户12的眼睛的定位(图1)。在这方面,在一个实施例中,容器区60可以包括:可围绕电子眼镜16的显示器30、32(图1)的周界固定的中央部分62,以及被配置成围绕(例如,部分地或完全地)电子眼镜16的臂66的侧面部分64。An embodiment of the wearable portion 18 of Figure 2 includes a container area 60 configured to receive the electronic glasses 16 and maintain the positioning of the electronic glasses 16 relative to the eyes of the user 12 during use (Figure 1). In this regard, in one embodiment, the container area 60 may include a central portion 62 that can be fixed around the perimeter of the displays 30, 32 (Figure 1) of the electronic glasses 16, and a side portion 64 configured to surround (e.g., partially or completely) the arm 66 of the electronic glasses 16.

容器区60的中央部分62可以包括衬垫以考虑到用户12的舒适性,同时头带提供针对用户12的头部的足够的压缩力(例如,用于维持电子眼镜16的定位)。在一个实施例中,中央部分62可以包括一种或多种材料,其具有提供稳定性和舒适性的适当组合的对皮肤的摩擦系数。例如,普遍被用在电子眼镜16的鼻子区中的凝胶材料可能是适当的。The central portion 62 of the container area 60 may include padding to accommodate the comfort of the user 12, while the headband provides sufficient compression against the user 12's head (e.g., for maintaining the positioning of the electronic glasses 16). In one embodiment, the central portion 62 may include one or more materials having a coefficient of friction against the skin that provides a suitable combination of stability and comfort. For example, a gel material commonly used in the nose area of the electronic glasses 16 may be appropriate.

如图3的实施例中图示的,除了头带之外或者代替头带,可穿戴部分18还可以包括其他特征。如描绘的,可穿戴部分18包括要被穿戴在用户12的头部之上的帽子70,以及与在图2中阐述的头带类似的特征。在某些实施例中并且如示出的,帽子70可以包括固定区72,在该固定区72中帽子70与头带部分74重叠。固定区72可以包括:闭合机构,诸如钩环紧固件、钩眼紧固件、按钮、磁条等等,其被配置成使得能够实现在帽子70与头带部分74之间的固定。以这种方式,帽子70可与头带部分74分离,这允许它们被单独地使用、单独地清洗等等。在一个实施例中,头带部分74可以与帽子70成一体(例如,缝合到帽子70中),使得头带部分74不可容易地从帽子70移除。As illustrated in the embodiment of Figure 3, the wearable portion 18 may include other features besides or in lieu of a headband. As depicted, the wearable portion 18 includes a cap 70 to be worn over the head of the user 12, and features similar to the headband illustrated in Figure 2. In some embodiments, and as shown, the cap 70 may include a securing area 72 in which the cap 70 overlaps with the headband portion 74. The securing area 72 may include a closure mechanism, such as a hook-and-loop fastener, an eyelet fastener, a button, a magnetic strip, etc., configured to enable securing between the cap 70 and the headband portion 74. In this way, the cap 70 can be separated from the headband portion 74, allowing them to be used separately, washed separately, etc. In one embodiment, the headband portion 74 may be integral with the cap 70 (e.g., sewn into the cap 70), making the headband portion 74 not easily removable from the cap 70.

盖子70的图示实施例包括:帽舌76,其用来遮蔽用户12的眼睛,以及电子眼镜16及其相关联的显示器30、32(图1)以免受强照明源(诸如太阳、顶部照明等等)的影响。例如,帽舌76可以在其中显示器30、32基于光学反射进行操作和/或是透明或半透明的实施例中特别有用。在这样的实施例中,帽舌76可以有助于加强增强或虚拟现实图像24(图1)相比于实体环境的背景的所感知到的视觉对比度。The illustrated embodiment of the cover 70 includes a visor 76 for shielding the eyes of the user 12, and the electronic glasses 16 and their associated displays 30, 32 (FIG. 1) from strong light sources such as the sun, top lighting, etc. For example, the visor 76 may be particularly useful in embodiments where the displays 30, 32 operate based on optical reflection and/or are transparent or translucent. In such embodiments, the visor 76 may help enhance the perceived visual contrast of the augmented or virtual reality image 24 (FIG. 1) compared to the background of the physical environment.

图3的可穿戴可视化设备14的图示实施例还包括:显示器盖78,其被配置成被放置在电子眼镜16的显示器30、32(图1)之上。显示器盖78可以为显示器30、32提供遮蔽物以保护显示器30、32免于物理滥用,从而为增强或虚拟现实图像24的加强的对比度和可视化、为光学滤波等等提供某一程度的不透明度。显示器盖78可以包括:任何适当的固定机构(诸如夹子79),其被配置成是可移除的并且将显示器盖78附接到电子眼镜16。可以使用其他固定特征,诸如临时粘合剂和/或钩环紧固件。The illustrated embodiment of the wearable visualization device 14 in Figure 3 also includes a display cover 78 configured to be placed over the displays 30, 32 (Figure 1) of the electronic glasses 16. The display cover 78 can provide a shielding effect for the displays 30, 32 to protect them from physical abuse, thereby providing a degree of opacity for enhanced contrast and visualization of the augmented or virtual reality image 24, for optical filtering, etc. The display cover 78 can include any suitable securing mechanism (such as a clip 79) configured to be removable and to attach the display cover 78 to the electronic glasses 16. Other securing features, such as temporary adhesives and/or hook-and-loop fasteners, can be used.

现在转到图4,其示出了AR/VR系统10的实施例,该AR/VR系统10可以附加地包括固定可视化设备80,其可以由一个或多个透明显示器82组成。应当领会的是,本文中公开的固定可视化设备80可以被固定和/或耦合到诸如乘客骑乘车辆86、建筑物的墙壁等等的结构。固定可视化设备80可以与可穿戴可视化设备14物理地分离并且与其不同。固定可视化设备80可以代替图1的可穿戴可视化设备14或与其结合地使用。照此,透明显示器82可以被用来替代或加强由可穿戴可视化设备14生成的AR、VR和/或混合现实体验。在一个实施例中,固定可视化设备80可以添加用户12可以感知到的附加层的增强或虚拟现实特征。Turning now to Figure 4, which illustrates an embodiment of AR/VR system 10, which may additionally include a fixed visualization device 80, which may consist of one or more transparent displays 82. It should be understood that the fixed visualization device 80 disclosed herein may be fixed and/or coupled to a structure such as a passenger-riding vehicle 86, a building wall, etc. The fixed visualization device 80 may be physically separate from and distinct from the wearable visualization device 14. The fixed visualization device 80 may be used in place of or in conjunction with the wearable visualization device 14 of Figure 1. Accordingly, the transparent displays 82 may be used to replace or enhance the AR, VR, and/or mixed reality experiences generated by the wearable visualization device 14. In one embodiment, the fixed visualization device 80 may add an additional layer of augmented or virtual reality features that are perceptible to the user 12.

在一个实施例中,透明显示器82可以被耦合到乘客骑乘车辆86的舱室84。在前述想法下,首先描述其中AR/VR系统10可以在游乐园90中使用的设置的实施例,如在图4中示意性示出的,可能是有用的。如图示的,游乐园90可以包括惊险骑乘装置92、游乐园设施94(例如,游戏区域、旅馆、餐馆、纪念品商店)的商场和附加的娱乐景点96(例如,摩天轮、黑暗骑乘)。在某些实施例中,惊险骑乘装置92可以包括过山车或其他类似的惊险骑乘装置92,并且因此可以进一步包括路径,诸如围绕周围的实体环境100(例如,公园设施94、附加的娱乐景点96)设置的闭环轨道98(例如,数英里的轨道98)的系统。轨道98可以被提供为如下基础设施:例如当乘客102(例如,图1的用户12)骑乘该惊险骑乘装置92时,乘客骑乘车辆86可以在其上穿过。尽管在图示的实施例中示出了仅一个乘客102,但是乘客骑乘车辆86可以被配置成容纳1个、2个、3个、4个、5个或更多个乘客102。In one embodiment, the transparent display 82 may be coupled to the cabin 84 of the passenger ride vehicle 86. Following the foregoing ideas, it may be useful to first describe an embodiment of an setup in which the AR/VR system 10 can be used in an amusement park 90, as schematically illustrated in Figure 4. As illustrated, the amusement park 90 may include thrill rides 92, amusement park facilities 94 (e.g., game areas, hotels, restaurants, souvenir shops), shopping malls, and additional entertainment attractions 96 (e.g., Ferris wheel, dark rides). In some embodiments, the thrill rides 92 may include roller coasters or other similar thrill rides 92, and may therefore further include paths, such as a closed-loop track 98 (e.g., a track 98 several miles long) set around the surrounding physical environment 100 (e.g., park facilities 94, additional entertainment attractions 96). The track 98 may be provided as infrastructure over which the passenger ride vehicle 86 can pass, for example, when a passenger 102 (e.g., user 12 of Figure 1) rides the thrill ride 92. Although only one passenger 102 is shown in the illustrated embodiment, the passenger vehicle 86 can be configured to accommodate one, two, three, four, five or more passengers 102.

轨道98可以因此限定乘客骑乘车辆86的运动。然而,在一个实施例中,轨道98可以由受控路径取代,中所述受控路径中可以经由电子系统、磁系统或除轨道98之外的其他类似的系统基础设施来控制乘客骑乘车辆86的移动。换言之,乘客骑乘车辆86的骑乘路径可以被不物理地约束到精确路径,由此允许乘客102对运动路径、视角等等的某种程度的控制。Track 98 can thus limit the movement of the passenger riding vehicle 86. However, in one embodiment, track 98 can be replaced by a controlled path, in which the movement of the passenger riding vehicle 86 can be controlled via electronic systems, magnetic systems, or other similar system infrastructure besides track 98. In other words, the riding path of the passenger riding vehicle 86 can be non-physically constrained to a precise path, thereby allowing the passenger 102 some degree of control over the movement path, viewpoint, etc.

在乘客骑乘车辆86穿过轨道98时,可以在惊险骑乘装置92的周围或附近的区域中为乘客102提供实体环境100的移动旅行(tour)。乘客骑乘车辆86可以附加地移动经过机器人设备(例如,电子动画人物97),其可以被配置成模仿人或动物,或者为另外的无生命对象带来逼真的特性。电子动画人物97可以围绕轨道98的部分设置,并且可以被配置成在乘客骑乘车辆86穿过轨道98时与乘客102交互(例如,吓唬乘客102和/或使乘客102感到吃惊)。电子动画人物97可以由气动装置、液压装置、电动马达或用以致动电子动画人物97的任何附加的部件驱动。虽然乘客102可以发现惊险骑乘装置92是非常愉快的体验,但是加强乘客102的骑乘体验可能是有用的。具体地,代替具有仅仅实体环境100、附加娱乐景点96和/或围绕轨道98设置的电子动画人物97的物理视图,为乘客102提供附加的AR、VR或混合的现实体验可能是有用的。这可以在乘客骑乘车辆86沿着惊险骑乘装置92的轨道98移动时,通过使用可穿戴可视化设备14、固定可视化设备80或两者来完成。As the passenger ride vehicle 86 traverses track 98, a tour of the physical environment 100 can be provided to the passenger 102 in or around the thrill ride device 92. The passenger ride vehicle 86 may additionally move past robotic devices (e.g., an animatronic character 97), which may be configured to mimic humans or animals, or to bring realistic characteristics to other inanimate objects. The animatronic character 97 may be positioned around a portion of track 98 and may be configured to interact with the passenger 102 as the passenger ride vehicle 86 traverses track 98 (e.g., startle the passenger 102 and/or surprise the passenger 102). The animatronic character 97 may be driven by pneumatic, hydraulic, electric motors, or any additional components used to actuate the animatronic character 97. While the passenger 102 may find the thrill ride device 92 a very enjoyable experience, enhancing the passenger 102's riding experience may be useful. Specifically, instead of a physical view consisting only of a physical environment 100, additional entertainment attractions 96, and/or electronically animated characters 97 set up around the track 98, it may be useful to provide passengers 102 with additional AR, VR, or mixed reality experiences. This can be accomplished by using wearable visualization devices 14, fixed visualization devices 80, or both, as passengers ride the vehicle 86 along the track 98 of the thrill ride 92.

图5图示了AR/VR系统10的实施例,其中乘客102可以使用固定可视化设备80。如上面阐述的,固定可视化设备80的透明显示器82可以是透明LED显示器、透明OLED显示器或适合于该应用的任何显示器。透明显示器82在未被激励时可以是大体上和/或完全透明的。照此,在一个实施例中,透明显示器82可以被集成到舱室84的一部分(诸如侧板88)中,这可以创建常规窗户(例如,玻璃窗、亚克力窗户)的错觉。附加地或以其他方式,透明显示器82可以耦合到乘客骑乘车辆86的任何部分(例如,前部、后部、顶部、地板)。因此,乘客102可以通过透明显示器82(例如,诸如通过常规窗户)来观看实体环境100。在一个实施例中,透明显示器82可以被激励(例如,在某些时间连续地或周期性地)以是大体上和/或完全不透明的,这可以创建舱室84被实体墙壁或板件(例如,缺乏常规窗户)完全包封的错觉。Figure 5 illustrates an embodiment of the AR/VR system 10, in which a passenger 102 can use a fixed visualization device 80. As described above, the transparent display 82 of the fixed visualization device 80 can be a transparent LED display, a transparent OLED display, or any display suitable for the application. The transparent display 82 can be substantially and/or completely transparent when not stimulated. Accordingly, in one embodiment, the transparent display 82 can be integrated into a portion of the cabin 84 (such as a side panel 88), which can create the illusion of a conventional window (e.g., a glass window, an acrylic window). Additionally or otherwise, the transparent display 82 can be coupled to any part of the passenger riding vehicle 86 (e.g., the front, rear, top, floor). Thus, the passenger 102 can view the physical environment 100 through the transparent display 82 (e.g., such as through a conventional window). In one embodiment, the transparent display 82 may be stimulated (e.g., continuously or periodically at certain times) to be substantially and/or completely opaque, which can create the illusion that the cabin 84 is completely enclosed by solid walls or panels (e.g., lacking conventional windows).

在一个实施例中,某些虚拟特征可以被叠加到透明显示器82的表面上。乘客102可以通过一个或多个视线110来观看实体环境100,该视线可以在乘客102通过透明显示器82来看时被创建。透明显示器82可以被用来将增强或虚拟现实图像112叠加到乘客102的视线110上。照此,乘客102可以感知到虚拟特征被整合在实体环境100内(例如,物理地存在于实体环境100内)。例如,透明显示器82可以仅部分地遮盖乘客102的视线110(例如,使用透明的观看表面),使得乘客102看到的实体环境100是具有叠加到透明显示器82的透明观看表面上的增强或虚拟现实图像112的实际环境。在一个实施例中,乘客102可以在透明显示器82上观看具有叠加的虚拟特征的实体环境100的实时视频。In one embodiment, certain virtual features may be overlaid onto the surface of the transparent display 82. A passenger 102 can view the physical environment 100 through one or more lines of sight 110, which may be created when the passenger 102 views through the transparent display 82. The transparent display 82 may be used to overlay augmented or virtual reality images 112 onto the passenger 102's lines of sight 110. In this way, the passenger 102 can perceive that virtual features are integrated within the physical environment 100 (e.g., physically present within the physical environment 100). For example, the transparent display 82 may only partially obscure the passenger 102's lines of sight 110 (e.g., using a transparent viewing surface), such that the physical environment 100 seen by the passenger 102 is the actual environment with the augmented or virtual reality images 112 overlaid on the transparent viewing surface of the transparent display 82. In one embodiment, the passenger 102 can view a live video of the physical environment 100 with overlaid virtual features on the transparent display 82.

在一个实施例中,固定可视化设备80可以被可操作地耦合到处理电路116,该处理电路116可以耦合到乘客骑乘车辆86。处理电路116可以包括处理器118(例如,通用处理器或其他处理器)、通信特征119(例如,无线收发器)和存储器120。处理器118可以可操作地耦合到存储器120以执行用于实施目前公开的技术的指令,例如,生成现实世界图像121(例如,实体环境100的实时视频)和/或增强或虚拟现实图像112。这些指令可以被编码在存储于有形非暂时性计算机可读介质(诸如存储器120和/或其他存储装置)中的程序或代码中。处理器118可以是通用处理器、片上系统(SoC)设备、专用集成电路(ASIC)或一些其他类似的处理器配置。在一个实施例中,在乘客骑乘车辆86穿过惊险骑乘装置92的轨道98时,乘客102可以通过透明显示器82来观看增强或虚拟现实图像112和周围的实体环境100。处理电路116可以经由通信特征119和/或无线网络42通信地耦合到计算机图形生成系统40(例如,在游乐园内)。在一个实施例中,处理电路116可以独立于计算机图形生成系统40而操作。如在本文中更详细讨论的,固定可视化设备80可以可操作地耦合到可穿戴可视化设备14(图1)的处理器26(图1),因此使得固定可视化设备80的增强或虚拟现实图像112能够与可穿戴可视化设备14的增强或虚拟现实图像24(图1)同步和/或协调。In one embodiment, a fixed visualization device 80 may be operatively coupled to processing circuitry 116, which may be coupled to a passenger riding vehicle 86. Processing circuitry 116 may include a processor 118 (e.g., a general-purpose processor or other processor), communication features 119 (e.g., a wireless transceiver), and memory 120. Processor 118 may be operatively coupled to memory 120 to execute instructions for implementing techniques currently disclosed, such as generating real-world images 121 (e.g., real-time video of the physical environment 100) and/or augmented or virtual reality images 112. These instructions may be encoded in a program or code stored in a tangible, non-transitory computer-readable medium, such as memory 120 and/or other storage devices. Processor 118 may be a general-purpose processor, a system-on-a-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration. In one embodiment, as the passenger riding vehicle 86 traverses the track 98 of the thrill ride 92, the passenger 102 may view the augmented or virtual reality images 112 and the surrounding physical environment 100 via a transparent display 82. Processing circuitry 116 may be communicatively coupled to computer graphics generation system 40 (e.g., in an amusement park) via communication feature 119 and/or wireless network 42. In one embodiment, processing circuitry 116 may operate independently of computer graphics generation system 40. As discussed in more detail herein, fixed visualization device 80 may be operatively coupled to processor 26 (FIG. 1) of wearable visualization device 14 (FIG. 1), thereby enabling augmented or virtual reality image 112 of fixed visualization device 80 to be synchronized and/or coordinated with augmented or virtual reality image 24 (FIG. 1) of wearable visualization device 14.

在一个实施例中,实时视频数据(例如,现场视频数据)可以从耦合到乘客骑乘车辆86的外部的相机122接收。尽管在所示实施例中仅描画了一个相机122,但是乘客骑乘车辆86可以支持1个、2个、3个、4个、5个或更多个相机122来捕获乘客骑乘车辆86周围的实体环境100的现实世界图像121。处理电路116可以处理实时视频数据以生成现实文字图像121并将其显示在透明显示器82上。在一个实施例中,可以预先记录现实世界图像121并且将其保存在处理电路116的存储器120中。附加地,处理电路116可以收集从相机122和/或可以耦合到乘客骑乘车辆86的附加传感器124所接收到的取向和定位数据、视点数据或其任何组合。具体地,处理电路116可以使用该数据来生成参考系,其可以将所生成的增强或虚拟现实图像112登记和同步和/或协调至现实世界图像121和/或实体环境100,乘客102可以通过视线110观看该现实世界图像121和/或实体环境100。In one embodiment, real-time video data (e.g., live video data) can be received from a camera 122 coupled to the exterior of the passenger riding vehicle 86. Although only one camera 122 is depicted in the illustrated embodiment, the passenger riding vehicle 86 may support one, two, three, four, five, or more cameras 122 to capture real-world images 121 of the physical environment 100 surrounding the passenger riding vehicle 86. Processing circuitry 116 may process the real-time video data to generate a realistic text image 121 and display it on a transparent display 82. In one embodiment, the real-world image 121 may be pre-recorded and stored in the memory 120 of the processing circuitry 116. Additionally, the processing circuitry 116 may collect orientation and positioning data, viewpoint data, or any combination thereof received from the camera 122 and/or additional sensors 124 that may be coupled to the passenger riding vehicle 86. Specifically, the processing circuit 116 can use the data to generate a reference frame, which can register and synchronize and/or coordinate the generated augmented or virtual reality image 112 to the real-world image 121 and/or physical environment 100, which the passenger 102 can view through the line of sight 110.

例如,处理电路116可以使用由相机122和/或传感器124收集的数据,以将实体环境100的现实世界图像121生成到透明显示器82上。具体地,使用基于取向数据、定位数据、视点数据、运动跟踪数据等等所生成的参考系,处理电路116然后可以渲染增强或虚拟现实图像112的视图,并且在一个实施例中,以在时间上和空间上与乘客102在通过常规窗户(例如,玻璃窗户)观看周围环境的情况下将感知到的内容相称的方式来渲染现实世界图像121。处理电路116可以不断地(例如,实时地)更新对增强或虚拟现实图像112和/或现实世界图像121的渲染,以反映乘客102的视线110的相应取向、定位和/或运动中的改变。For example, processing circuitry 116 can use data collected by camera 122 and/or sensor 124 to generate a real-world image 121 of the physical environment 100 onto transparent display 82. Specifically, using a reference frame generated based on orientation data, positioning data, viewpoint data, motion tracking data, etc., processing circuitry 116 can then render a view of augmented or virtual reality image 112, and in one embodiment, render the real-world image 121 in a manner that is temporally and spatially commensurate with what the passenger 102 would perceive when viewing the surrounding environment through a conventional window (e.g., a glass window). Processing circuitry 116 can continuously (e.g., in real time) update the rendering of augmented or virtual reality image 112 and/or real-world image 121 to reflect changes in the corresponding orientation, positioning, and/or movement of the passenger 102's gaze 110.

附加地或以其他方式,处理电路116可以增强实体环境100或实体环境100的现实文字图像121,以加强乘客102的骑乘体验(例如,更改实体环境100以匹配轨道98的主题)。例如,透明显示器82可以渲染雨滴或降雪以增强通过透明显示器82的实体环境100的视图。在一个实施例中,透明显示器82可以利用虚构设置(例如,丛林、外部空间等)的增强或虚拟现实图像112来部分地或完全地覆盖实体环境100的视图。Additionally or otherwise, processing circuitry 116 may enhance the physical environment 100 or realistic textual images 121 of the physical environment 100 to improve the riding experience of passenger 102 (e.g., changing the physical environment 100 to match the theme of track 98). For example, transparent display 82 may render raindrops or snowfall to enhance the view of the physical environment 100 through transparent display 82. In one embodiment, transparent display 82 may partially or completely cover the view of the physical environment 100 using enhanced or virtual reality images 112 of a fictional setting (e.g., jungle, external space, etc.).

处理电路116可以控制骑乘效果或元件(例如,电子动画人物97)的定时,该骑乘效果或元件可以与乘客102交互。在一个实施例中,骑乘效果的定时也可以由计算机图形生成系统40、单独的骑乘控制系统126或两者的组合来控制。当乘客骑乘车辆86穿过轨道98时,骑乘效果可以与显示在透明显示器82上的增强或虚拟现实图像112同步和/或协调。通过使骑乘效果与增强或虚拟现实图像112同步和/或协调,可以加强针对乘客102的对惊险骑乘装置92的沉浸式体验。Processing circuitry 116 can control the timing of riding effects or elements (e.g., an animated character 97) that can interact with passenger 102. In one embodiment, the timing of the riding effects can also be controlled by computer graphics generation system 40, a separate riding control system 126, or a combination of both. As the passenger rides vehicle 86 across track 98, the riding effects can be synchronized and/or coordinated with augmented or virtual reality images 112 displayed on transparent display 82. By synchronizing and/or coordinating the riding effects with the augmented or virtual reality images 112, the immersive experience of the thrill ride device 92 for passenger 102 can be enhanced.

骑乘效果可以被配置成在乘客骑乘车辆86穿过惊险骑乘装置92的轨道98时与乘客骑乘车辆86进行交互。例如,在一个实施例中,电子动画人物97可以临时阻挡乘客骑乘车辆86前方的轨道98,从而创建乘客骑乘车辆86可能与电子动画人物97碰撞的错觉。在一个实施例中,电子动画人物97(例如,龙)可以被配置成提供攻击乘客骑乘车辆86(例如,在乘客骑乘车辆86的方向上呼吸火焰)的错觉。虽然乘客102可以发现与电子动画人物97的交互是非常惊险的体验,但是在一个实施例中,通过可以与电子动画人物97的移动进行同步和/或协调的增强或虚拟现实图像112来加强乘客的骑乘体验可能是有用的。The riding effect can be configured to interact with the passenger vehicle 86 as it traverses the track 98 of the thrill ride device 92. For example, in one embodiment, an animated character 97 can temporarily block the track 98 in front of the passenger vehicle 86, thereby creating the illusion that the passenger vehicle 86 may collide with the animated character 97. In one embodiment, the animated character 97 (e.g., a dragon) can be configured to provide the illusion of attacking the passenger vehicle 86 (e.g., breathing flames in the direction of the passenger vehicle 86). While the passenger 102 may find interacting with the animated character 97 a very thrilling experience, in one embodiment, it may be useful to enhance the passenger's riding experience with augmented or virtual reality images 112 that can be synchronized and/or coordinated with the movement of the animated character 97.

例如,在一个实施例中,透明显示器82可以将玻璃裂纹128或损毁130(例如,来自火焰的变色或炭化)叠加到乘客102的视线110上。这可以进一步加强乘客102所感知到的电子动画人物97的真实感。在一个实施例中,透明显示器82可以将冷凝132(例如,来自呼吸的动物)叠加到视线110上,这可以创建错觉,在该错觉中乘客102感知到电子动画人物97非常接近乘客骑乘车辆86。附加地或以其他方式,可以在透明显示器82上生成任何合期望的增强或虚拟现实图像112,这可以加强特殊效果的真实感。例如,增强或虚拟现实图像112可以包括虫子飞溅、冰雹损毁和/或灰尘覆盖,这可以加强惊险骑乘装置92的真实感。For example, in one embodiment, the transparent display 82 can overlay glass cracks 128 or damage 130 (e.g., discoloration or charring from flames) onto the passenger 102's line of sight 110. This can further enhance the realism of the animated character 97 perceived by the passenger 102. In one embodiment, the transparent display 82 can overlay condensation 132 (e.g., from a breathing animal) onto the line of sight 110, which can create the illusion that the passenger 102 perceives the animated character 97 very close to the passenger riding vehicle 86. Additionally or otherwise, any desired augmented or virtual reality image 112 can be generated on the transparent display 82, which can enhance the realism of special effects. For example, the augmented or virtual reality image 112 may include insect splashes, hail damage, and/or dust coverage, which can enhance the realism of the thrill ride 92.

图6图示了AR/VR系统10的实施例,在该系统中乘客102同时使用图1的可穿戴可视化设备14和图5的固定可视化设备80两者。如上面阐述的,可穿戴可视化设备14可以与固定可视化设备80结合地使用,以加强乘客102的沉浸式AR、VR和/或混合现实体验。例如,在一个实施例中,可穿戴可视化设备14可以被用来通过将虚拟特征(诸如增强或虚拟现实图像24)叠加到乘客102的眼睛上来加强舱室84内的实体环境100。照此,可穿戴可视化设备14可以在乘客骑乘车辆86的舱室84内创建超现实环境20。在一个实施例中,透明显示器82可以通过将虚拟特征(诸如增强或虚拟现实图像112)叠加到乘客102的视线110上来加强在舱室84外部的实体环境100。以这种方式,乘客102可以同时或以协调的方式观看可穿戴可视化设备14上的增强或虚拟现实图像24以及固定可视化设备80的透明显示器82上的增强或虚拟现实图像112。替换地,可穿戴可视化设备14可以在乘客骑乘车辆86的舱室84外部创建超现实环境20。以这种方式,透明显示器82可以叠加前景中的虚拟特征,并且可穿戴可视化设备14可以增强背景中的细节。Figure 6 illustrates an embodiment of AR/VR system 10 in which passenger 102 simultaneously uses both the wearable visualization device 14 of Figure 1 and the fixed visualization device 80 of Figure 5. As described above, the wearable visualization device 14 can be used in conjunction with the fixed visualization device 80 to enhance passenger 102's immersive AR, VR, and/or mixed reality experience. For example, in one embodiment, the wearable visualization device 14 can be used to enhance the physical environment 100 within cabin 84 by overlaying virtual features (such as augmented or virtual reality images 24) onto passenger 102's eyes. Accordingly, the wearable visualization device 14 can create a surreal environment 20 within cabin 84 of the passenger riding vehicle 86. In one embodiment, a transparent display 82 can enhance the physical environment 100 outside cabin 84 by overlaying virtual features (such as augmented or virtual reality images 112) onto passenger 102's line of sight 110. In this way, passenger 102 can simultaneously or in a coordinated manner view augmented or virtual reality images 24 on wearable visualization device 14 and augmented or virtual reality images 112 on the transparent display 82 of fixed visualization device 80. Alternatively, wearable visualization device 14 can create a surreal environment 20 outside the cabin 84 of passenger riding vehicle 86. In this way, transparent display 82 can overlay virtual features in the foreground, and wearable visualization device 14 can enhance details in the background.

在一个实施例中,透明显示器82可以示出介质,诸如玻璃裂纹128、损毁130,和/或冷凝132,它们似乎影响乘客骑乘车辆86的外部。在一个实施例中,可穿戴可视化设备14可以附加地生成介质(例如,诸如湿气或冷凝132)进入乘客骑乘车辆86的舱室84的错觉。这可以在AR体验、VR体验、混合现实体验、计算机中介的现实体验或其组合内创建多层虚拟特征。尽管在图示的实施例中仅描述了两层虚拟特征,但是AR/VR系统10可以被配置成生成乘客102可以与之交互的1、2、3、4或更多层虚拟特征。例如,多个透明显示器82可以按顺序层的方式(例如,相对于彼此进行堆叠)耦合到乘客骑乘车辆86的舱室84,使得每个透明显示器82可以生成一层虚拟特征。In one embodiment, the transparent display 82 may show media, such as glass cracks 128, damage 130, and/or condensation 132, that appear to affect the exterior of the passenger-riding vehicle 86. In one embodiment, the wearable visualization device 14 may additionally generate the illusion that media (e.g., moisture or condensation 132) enter the cabin 84 of the passenger-riding vehicle 86. This can create multiple layers of virtual features within AR experiences, VR experiences, mixed reality experiences, computer-mediated reality experiences, or combinations thereof. Although only two layers of virtual features are depicted in the illustrated embodiment, the AR/VR system 10 can be configured to generate 1, 2, 3, 4, or more layers of virtual features that the passenger 102 can interact with. For example, multiple transparent displays 82 may be coupled to the cabin 84 of the passenger-riding vehicle 86 in a sequential, layered manner (e.g., stacked relative to each other), such that each transparent display 82 can generate one layer of virtual features.

例如,乘客102可以通过可穿戴可视化设备14的电子眼镜16(图1)来看,该电子眼睛16可以生成第一层虚拟特征(例如,增强或虚拟现实图像24)。乘客102可以附加地观看固定可视化设备80的透明显示器82(例如,通过可穿戴可视化设备14的电子眼镜16),其可以创建第二层虚拟特征(例如,增强或虚拟现实图像112)。AR/VR系统10可以被配置成生成第一层虚拟特征、第二层虚拟特征、附加层虚拟特征或其任何组合,以为乘客102创建AR、VR和/或混合现实体验。For example, passenger 102 can view the scene through electronic glasses 16 (FIG. 1) of wearable visualization device 14, which can generate a first layer of virtual features (e.g., augmented or virtual reality image 24). Passenger 102 can additionally view the transparent display 82 of fixed visualization device 80 (e.g., through electronic glasses 16 of wearable visualization device 14), which can create a second layer of virtual features (e.g., augmented or virtual reality image 112). AR/VR system 10 can be configured to generate first-layer virtual features, second-layer virtual features, additional-layer virtual features, or any combination thereof to create AR, VR, and/or mixed reality experiences for passenger 102.

照此,在一个实施例中,AR/VR系统10可以更改乘客102通过由固定可视化设备80所生成的增强或虚拟现实图像112所感知到的周围实体环境100(例如,游乐园90),并且AR/VR系统10可以通过使用可穿戴可视化设备14来在舱室84内创建超现实环境20。在一个实施例中,可穿戴可视化设备14可以与透明显示器82组合或者代替透明显示器82附加地更改周围实体环境100。Accordingly, in one embodiment, the AR/VR system 10 can alter the surrounding physical environment 100 (e.g., amusement park 90) perceived by the passenger 102 through augmented or virtual reality images 112 generated by a fixed visualization device 80, and the AR/VR system 10 can create a surreal environment 20 within the cabin 84 by using a wearable visualization device 14. In one embodiment, the wearable visualization device 14 can additionally alter the surrounding physical environment 100 in combination with or in place of a transparent display 82.

可穿戴可视化设备14和固定可视化设备80的增强或虚拟现实图像24和/或112分别可以由可穿戴可视化设备14的处理器26(图1)、计算机图形生成系统40的处理器44(图1)、固定可视化设备80的处理器118、附加外部处理器(例如,诸如在骑乘控制系统126中)或其任何组合进行同步和/或协调。同步和/或协调可以涉及基于取向数据、定位数据、视点数据、运动跟踪数据或由AR/VR系统10收集的附加数据来调整虚拟特征的参考系。The augmented or virtual reality images 24 and/or 112 of the wearable visualization device 14 and the fixed visualization device 80 can be synchronized and/or coordinated by the processor 26 (FIG. 1) of the wearable visualization device 14, the processor 44 (FIG. 1) of the computer graphics generation system 40, the processor 118 of the fixed visualization device 80, an additional external processor (e.g., such as in the riding control system 126), or any combination thereof. Synchronization and/or coordination may involve adjusting the reference frame of the virtual features based on orientation data, positioning data, viewpoint data, motion tracking data, or additional data collected by the AR/VR system 10.

处理器26、44、118或其任何组合可以经由无线网络42进行通信,并且可以附加地使增强或虚拟现实图像24和/或112与骑乘效果(例如,电子动画人物97)同步和/或协调。在一个实施例中,单独的计算机同步系统(例如,骑乘控制系统126)可以被用来对增强或虚拟现实图像24和/或112与骑乘效果进行同步和/或协调。Processors 26, 44, 118, or any combination thereof, may communicate via wireless network 42 and may additionally synchronize and/or coordinate augmented or virtual reality images 24 and/or 112 with riding effects (e.g., an animated character 97). In one embodiment, a separate computer synchronization system (e.g., riding control system 126) may be used to synchronize and/or coordinate augmented or virtual reality images 24 and/or 112 with riding effects.

在一个实施例中,固定的可视化设备80的处理电路116可以卸载可穿戴可视化设备14的处理电路25(图1)可能需要的处理能力的一部分。固定可视化设备80的处理电路116可以具有比可穿戴可视化设备14的处理电路25更少的空间约束。这可以使得固定可视化设备80的处理电路116能够实现更大和/或更强大的处理器118。照此,透明显示器82可以生成和显示在惊险骑乘装置92期间所需的大部分增强或虚拟现实图像112,而可穿戴可视化设备14可以仅生成更小的细节(例如,在舱室84内创建超现实环境20)。In one embodiment, the processing circuitry 116 of the fixed visualization device 80 can offload a portion of the processing power that the processing circuitry 25 (FIG. 1) of the wearable visualization device 14 might require. The processing circuitry 116 of the fixed visualization device 80 can have fewer space constraints than the processing circuitry 25 of the wearable visualization device 14. This allows the processing circuitry 116 of the fixed visualization device 80 to implement a larger and/or more powerful processor 118. Accordingly, the transparent display 82 can generate and display most of the augmented or virtual reality images 112 required during the thrill ride 92, while the wearable visualization device 14 can generate only smaller details (e.g., creating a surreal environment 20 within the cabin 84).

此外,固定可视化设备80可以比可穿戴可视化设备14更高效地渲染某些虚拟特征。例如,可能合期望的是创建如下错觉:电子动画人物97将特征136给予到乘客骑乘车辆86的舱室84的窗户上(例如,穿孔),作为惊险骑乘装置92的特殊效果的部分。在一个实施例中,固定可视化设备80可以被用来创建特征136已被给予舱室84的窗户(例如,透明显示器82)上的错觉。为了经由可穿戴可视化设备14来提供这样的特征136,可穿戴可视化设备14可能需要连续摄取现实世界图像22和/或更新电子眼镜16上的特征136的定位,这可能需要相当大的处理能力。例如,当乘客102的视点改变(例如,乘客102相对于窗户转动或移动)时,为了确保特征136保持静止(例如,孔不相对于舱室84窗户移动),可穿戴可视化设备14可能需要连续地摄取现实世界图像22和/或更新电子眼镜16上的特征136的定位。在这样的情况下,经由固定可视化设备80提供特征136可能更高效。Furthermore, a fixed visualization device 80 can render certain virtual features more efficiently than a wearable visualization device 14. For example, it might be desirable to create the illusion that an animatronic character 97 applies feature 136 (e.g., a perforation) to the window of the cabin 84 of the passenger riding vehicle 86 as part of a special effect of the thrill ride 92. In one embodiment, a fixed visualization device 80 could be used to create the illusion that feature 136 has been applied to the window of the cabin 84 (e.g., a transparent display 82). To provide such feature 136 via a wearable visualization device 14, the wearable visualization device 14 may need to continuously capture real-world images 22 and/or update the positioning of feature 136 on the electronic glasses 16, which could require considerable processing power. For example, when the viewpoint of passenger 102 changes (e.g., passenger 102 rotates or moves relative to the window), in order to ensure that feature 136 remains stationary (e.g., the perforation does not move relative to the window of cabin 84), the wearable visualization device 14 may need to continuously capture real-world images 22 and/or update the positioning of feature 136 on the electronic glasses 16. In such a case, providing feature 136 via a fixed visualization device 80 may be more efficient.

在一个实施例中,AR/VR系统10可以替代地提供透明显示器82上的特征136。在一个实施例中,AR/VR系统10可以使用电子眼镜16来将可能与特征136相关的细节(例如,源于窗户中的孔的玻璃碎片)的增强或虚拟现实图像24叠加到乘客102的眼睛上,使得该细节可以出现在相对于特征136的适当的定位处。照此,在一个实施例中,可穿戴可视化设备14可以仅生成较小的增强或虚拟现实图像24(例如,细节,诸如玻璃碎片),而固定可视化设备80可以生成大部分的增强或虚拟现实图像112,其包括相对于乘客骑乘车辆86保持静止的特征(例如,特征136,诸如孔)。在操作中,乘客102可以通过大体上透明的电子眼镜16(图1)来观看由透明显示器82生成的特征136和舱室84的内部。照此,无论乘客102的取向和/或视点如何,特征136相对于乘客骑乘车辆86的窗户(例如,透明显示器82)的定位可以保持恒定。与使用可穿戴可视化设备14来生成诸如特征136之类的特征相比,这可以大幅度降低可穿戴可视化设备14所需的处理能力。因此,可穿戴可视化设备14和固定可视化设备80的组合以及AR/VR系统10对这些设备14、18的协调提供了更加动态和高效的系统,其克服了单独使用可穿戴可视化设备14来为乘客102创建AR、VR和/或混合现实体验的问题。In one embodiment, AR/VR system 10 may alternatively provide feature 136 on transparent display 82. In one embodiment, AR/VR system 10 may use electronic glasses 16 to overlay an augmented or virtual reality image 24 of details that may be associated with feature 136 (e.g., a shard of glass originating from a hole in a window) onto the eyes of passenger 102, such that the detail appears at an appropriate location relative to feature 136. Accordingly, in one embodiment, wearable visualization device 14 may generate only a smaller augmented or virtual reality image 24 (e.g., details, such as a shard of glass), while fixed visualization device 80 may generate the majority of the augmented or virtual reality image 112, which includes features that remain stationary relative to passenger riding vehicle 86 (e.g., feature 136, such as a hole). In operation, passenger 102 can view feature 136 and the interior of cabin 84 generated by transparent display 82 through substantially transparent electronic glasses 16 (FIG. 1). Accordingly, the positioning of feature 136 relative to the window of passenger riding vehicle 86 (e.g., transparent display 82) can remain constant regardless of the orientation and/or viewpoint of passenger 102. This significantly reduces the processing power required by the wearable visualization device 14 compared to using the wearable visualization device 14 to generate features such as feature 136. Therefore, the combination of the wearable visualization device 14 and the fixed visualization device 80, along with the coordination of these devices 14 and 18 by the AR/VR system 10, provides a more dynamic and efficient system that overcomes the limitations of using the wearable visualization device 14 alone to create AR, VR, and/or mixed reality experiences for passenger 102.

在一个实施例中,在乘客骑乘车辆86穿过惊险骑乘装置92时,由可穿戴可视化设备14生成的增强或虚拟现实图像24和由固定可视化设备80生成的增强或虚拟现实图像112被同步和/或协调,使得乘客102所体验的虚拟特征可以被感知为比当单独使用可穿戴可视化设备14或固定可视化设备80时更真实。例如,动画特征(例如,爆炸)可以被整合作为惊险骑乘装置92的主题的部分。动画特征可以首先由透明显示器82生成并且被叠加到乘客102观看的周围实体环境100上。透明显示器82接下来可以生成特征的错觉,诸如窗户(例如,透明显示器82)内的裂纹128,并且可以随后生成窗户破碎的错觉(例如,创建玻璃碎片)。可穿戴可视化设备14可以接下来生成碎屑(例如,玻璃碎片)漂浮通过乘客骑乘车辆86的舱室84的错觉。照此,可穿戴可视化设备14和固定可视化设备80可以为乘客102创建多层增强或虚拟现实体验。In one embodiment, as the passenger rides the vehicle 86 through the thrill ride device 92, the augmented or virtual reality image 24 generated by the wearable visualization device 14 and the augmented or virtual reality image 112 generated by the fixed visualization device 80 are synchronized and/or coordinated, so that the virtual features experienced by the passenger 102 can be perceived as more realistic than when the wearable visualization device 14 or the fixed visualization device 80 is used alone. For example, animated features (e.g., explosions) can be integrated as part of the theme of the thrill ride device 92. The animated features can first be generated by the transparent display 82 and superimposed onto the surrounding physical environment 100 viewed by the passenger 102. The transparent display 82 can then generate illusions of features, such as cracks 128 within a window (e.g., the transparent display 82), and can subsequently generate the illusion of a broken window (e.g., creating shards of glass). The wearable visualization device 14 can then generate the illusion of debris (e.g., shards of glass) floating through the cabin 84 of the passenger ride vehicle 86. Accordingly, wearable visualization device 14 and fixed visualization device 80 can create multi-layered augmented or virtual reality experiences for passenger 102.

图7图示了用以向游乐园客人(例如,乘客102)提供AR/VR增强的过程140的实施例的流程图。过程140可能在游乐园体验(诸如惊险骑乘装置92)期间创建AR体验、VR体验和/或混合现实体验方面是有用的。过程140可以表示启动代码或指令,其被存储在非暂时性计算机可读介质(例如,存储器28、46、120)中,并且例如由可穿戴可视化设备14的处理器26、计算机图形生成系统40的处理器44,和/或固定可视化设备80的处理器118来执行。处理器26、44和/或118可以经由诸如无线网络42之类的网络通信地耦合,以接收和发送下面描述的指令。Figure 7 illustrates a flowchart of an embodiment of a process 140 for providing AR/VR enhancements to amusement park guests (e.g., passenger 102). Process 140 may be useful in creating AR, VR, and/or mixed reality experiences during amusement park experiences (such as thrill ride 92). Process 140 may represent initiation code or instructions stored in a non-transitory computer-readable medium (e.g., memories 28, 46, 120) and executed, for example, by processor 26 of wearable visualization device 14, processor 44 of computer graphics generation system 40, and/or processor 118 of fixed visualization device 80. Processors 26, 44, and/or 118 may be communicatively coupled via a network such as wireless network 42 to receive and send instructions described below.

该方法140可以开始于框142,生成AR/VR增强(例如,虚拟特征),诸如增强或虚拟现实图像24、112。AR/VR增强可以由可穿戴可视化设备14、固定可视化设备80、附加可视化设备或其任何组合提供。AR/VR增强可以由可穿戴可视化设备14的处理电路25、计算机图形生成系统40、固定可视化设备80的处理电路116或其任何组合来生成。The method 140 may begin at box 142 to generate AR/VR enhancements (e.g., virtual features), such as enhanced or virtual reality images 24, 112. The AR/VR enhancements may be provided by wearable visualization device 14, fixed visualization device 80, additional visualization device, or any combination thereof. The AR/VR enhancements may be generated by processing circuitry 25 of wearable visualization device 14, computer graphics generation system 40, processing circuitry 116 of fixed visualization device 80, or any combination thereof.

在一个实施例中,可穿戴可视化设备14可以包括透明或半透明显示器表面(例如,显示器30、32),并且将增强或虚拟现实图像24透射到乘客102的眼睛中。附加地或替换地,如下面更详细讨论的,固定可视化设备80还可以被配置成包括透明或半透明显示器表面(例如,透明显示器82),其将增强或虚拟现实图像112显示到乘客102的视线110上。例如,增强或虚拟现实图像112可以遮盖乘客102的视线110的一部分(例如,乘客102仍然可以通过透明显示器82看到实体环境100的部分),从而创建增强或虚拟现实图像112是实体环境100的部分的错觉。In one embodiment, the wearable visualization device 14 may include a transparent or semi-transparent display surface (e.g., displays 30, 32) and project the augmented or virtual reality image 24 into the eyes of the passenger 102. Additionally or alternatively, as discussed in more detail below, the fixed visualization device 80 may also be configured to include a transparent or semi-transparent display surface (e.g., a transparent display 82) that displays the augmented or virtual reality image 112 onto the passenger 102's line of sight 110. For example, the augmented or virtual reality image 112 may obscure a portion of the passenger 102's line of sight 110 (e.g., the passenger 102 can still see a portion of the physical environment 100 through the transparent display 82), thereby creating the illusion that the augmented or virtual reality image 112 is part of the physical environment 100.

现在转至框144,过程140可以包括步骤,或一系列步骤,其中,可穿戴可视化设备14可以将一个或多个增强或虚拟现实图像24叠加或叠合(例如,经由显示器30、32)到实体环境100上以生成乘客102要观看的第一层虚拟特征。例如,处理器26、44、118可以将增强或虚拟现实图像24叠加或叠合到透明或半透明显示器表面(例如,显示器30、32)上,因此生成第一层虚拟特征,乘客102可以通过该显示器表面观看实体环境100。在一个实施例中,乘客102可以通过显示器30、32的透明部分来观看实体环境100,而可穿戴可视化设备14可以仅利用增强或虚拟现实图像24来遮盖显示器30、32的一部分。在一个实施例中,处理器26、44、118可以使用一个或多个视频合并和/或光学合并技术来生成增强或虚拟现实图像和/或将所述增强或虚拟现实图像叠加到现实世界图像22(例如,设施94、实体环境100)的视频数据流上。Turning now to box 144, process 140 may include steps, or a series of steps, in which the wearable visualization device 14 may overlay or superimpose one or more augmented or virtual reality images 24 (e.g., via displays 30, 32) onto the physical environment 100 to generate a first layer of virtual features for the passenger 102 to view. For example, processors 26, 44, 118 may overlay or superimpose the augmented or virtual reality images 24 onto a transparent or translucent display surface (e.g., displays 30, 32), thus generating a first layer of virtual features through which the passenger 102 can view the physical environment 100. In one embodiment, the passenger 102 may view the physical environment 100 through transparent portions of displays 30, 32, while the wearable visualization device 14 may only utilize the augmented or virtual reality images 24 to obscure a portion of displays 30, 32. In one embodiment, processors 26, 44, 118 may use one or more video merging and/or optical merging techniques to generate augmented or virtual reality images and/or overlay the augmented or virtual reality images onto a video data stream of real-world images 22 (e.g., facility 94, physical environment 100).

现在转至框146,方法140可以包括步骤,或一系列步骤,其中,固定可视化设备80可以将一个或多个增强或虚拟现实图像112叠加或叠合(例如,经由透明显示器82)到实体环境100上,以生成乘客102要观看的第二层虚拟特征。例如,处理器26、44、118可以将增强或虚拟现实图像112叠加或叠合到透明或半透明显示器表面(例如,透明显示器82)上,因此生成了第二层虚拟特征,乘客102可以通过该显示器表面观看实体环境100。在一个实施例中,乘客102可以通过透明显示器82观看实体环境100,而固定可视化设备80可以仅利用增强或虚拟现实图像112来遮盖透明显示器82的一部分。在一个实施例中,处理器26、44、118可以使用一个或多个视频合并和/或光学合并技术来生成增强或虚拟现实图像112并且将所述增强或虚拟现实图像112叠加到现实世界图像121(例如,设施94、实体环境100)的视频数据流上。在任何情况下,可穿戴可视化设备14可以生成第一层虚拟特征(例如,经由增强或虚拟现实图像24),并且固定可视化设备80可以生成第二层虚拟特征(例如,经由增强或虚拟现实图像112)。附加地或以其他方式,AR/VR系统10可以被配置成生成1、2、3、4或更多层虚拟特征。Turning now to box 146, method 140 may include steps, or a series of steps, in which a fixed visualization device 80 may overlay or superimpose one or more augmented or virtual reality images 112 (e.g., via a transparent display 82) onto the physical environment 100 to generate a second layer of virtual features for the passenger 102 to view. For example, processors 26, 44, 118 may overlay or superimpose the augmented or virtual reality images 112 onto a transparent or semi-transparent display surface (e.g., transparent display 82), thus generating a second layer of virtual features that the passenger 102 can view through the physical environment 100. In one embodiment, the passenger 102 can view the physical environment 100 through the transparent display 82, while the fixed visualization device 80 may only utilize the augmented or virtual reality images 112 to partially obscure the transparent display 82. In one embodiment, processors 26, 44, 118 may use one or more video merging and/or optical merging techniques to generate the augmented or virtual reality images 112 and overlay the augmented or virtual reality images 112 onto a video data stream of a real-world image 121 (e.g., facility 94, physical environment 100). In any case, the wearable visualization device 14 can generate a first layer of virtual features (e.g., via augmented or virtual reality image 24), and the fixed visualization device 80 can generate a second layer of virtual features (e.g., via augmented or virtual reality image 112). Additionally or otherwise, the AR/VR system 10 can be configured to generate 1, 2, 3, 4 or more layers of virtual features.

现在转至框148,过程140还可以包括:协调第一层虚拟特征第二层虚拟特征的显示。第一层虚拟特征和第二层虚拟特征可以由处理器26、44和/或118进行同步和/或协调,以加强由乘客102感知到的对惊险骑乘装置92的沉浸式体验和虚拟效果的真实感。在一个实施例中,来自除了位于可穿戴可视化设备14或乘客骑乘车辆86上的那些相机之外的相机的图像数据可以用于促进在第一层虚拟特征与第二层虚拟特征之间的同步和/或协调。这样的同步和/或协调可能对于基于某些固定特征(例如,某些景点位置)的已知定位对乘客102的定位的三角测量、对于某些特殊效果(例如,真实的、增强的或模拟的烟花或爆炸)的定时,以及下面描述的其他效果而言是有用的。Turning now to box 148, process 140 may further include: coordinating the display of the first layer of virtual features and the second layer of virtual features. The first layer of virtual features and the second layer of virtual features may be synchronized and/or coordinated by processors 26, 44, and/or 118 to enhance the immersive experience and realism of the virtual effects perceived by passenger 102 on the thrill ride 92. In one embodiment, image data from cameras other than those located on wearable visualization device 14 or passenger ride vehicle 86 may be used to facilitate synchronization and/or coordination between the first layer of virtual features and the second layer of virtual features. Such synchronization and/or coordination may be useful for triangulation of passenger 102's location based on known positioning of certain fixed features (e.g., certain scenic spot locations), for timing certain special effects (e.g., real, enhanced, or simulated fireworks or explosions), and other effects described below.

在一个实施例中,处理器26、44、118可以接收和分析实时捕获的数据,诸如来自其他电子设备的图像数据、定位数据和/或输入。例如,关于图像数据,处理器26、44、118可以接收经由可穿戴可视化设备14和/或乘客骑乘车辆86的相机34、36、122捕获的实时视频数据(例如,现场视频)。在一个实施例中,视频可以被用于生成可以分别在电子眼镜16或透明显示器82上显示的现实世界图像22和121。例如,处理器26、44、118可以生成要在可穿戴可视化设备14的显示器30、32和/或固定可视化设备80的透明显示器82上显示的实体环境100(例如,游乐园90的区)的视频数据流。In one embodiment, processors 26, 44, and 118 can receive and analyze real-time captured data, such as image data, location data, and/or input from other electronic devices. For example, regarding image data, processors 26, 44, and 118 can receive real-time video data (e.g., live video) captured via cameras 34, 36, and 122 of the wearable visualization device 14 and/or the passenger-riding vehicle 86. In one embodiment, the video can be used to generate real-world images 22 and 121 that can be displayed on electronic glasses 16 or a transparent display 82, respectively. For example, processors 26, 44, and 118 can generate a video data stream of an physical environment 100 (e.g., an area of an amusement park 90) to be displayed on displays 30 and 32 of the wearable visualization device 14 and/or the transparent display 82 of the fixed visualization device 80.

在一个实施例中,处理器26、44、118可以基于任何一种因素或因素的组合来渲染第一层虚拟特征和第二层虚拟特征。这样的因素可以包括:在惊险骑乘装置92的循环期间的任何给定时间点、乘客骑乘车辆86沿着轨道98的定位或位置(例如,或者当轨道98不存在时的其他位置)、在惊险骑乘装置92的循环期间、在预定的一段时间之后,或者在乘客骑乘车辆86的乘客102已经执行了一个或多个动作之后、乘客骑乘车辆86行进的预定距离。In one embodiment, processors 26, 44, and 118 may render the first and second layer virtual features based on any one or a combination of factors. Such factors may include: at any given point in time during the cycle of the thrill ride 92, the location or position of the passenger vehicle 86 along the track 98 (e.g., or another location when the track 98 is not present), during the cycle of the thrill ride 92, after a predetermined period of time, or after the passenger 102 of the passenger vehicle 86 has performed one or more actions, and a predetermined distance traveled by the passenger vehicle 86.

在其他实施例中,可穿戴可视化设备14、计算机图形生成系统40和/或固定可视化设备80可以对经由相机34、36、122捕获的视频或图像数据执行一个或多个几何或光度识别算法,以确定乘客102和/或乘客骑乘车辆86的位置点。可穿戴可视化设备14、计算机图形生成系统40和/或固定可视化设备80还可以使用该数据来控制增强或虚拟现实图像24、112相对于骑乘效果(例如,电子动画人物97)的定时,以使第一层虚拟特征和第二层虚拟特征与骑乘效果同步和/或协调。In other embodiments, the wearable visualization device 14, the computer graphics generation system 40, and/or the fixed visualization device 80 may perform one or more geometric or photometric recognition algorithms on video or image data captured via cameras 34, 36, 122 to determine the location points of passenger 102 and/or passenger-riding vehicle 86. The wearable visualization device 14, the computer graphics generation system 40, and/or the fixed visualization device 80 may also use the data to control the timing of augmented or virtual reality images 24, 112 relative to riding effects (e.g., an animated character 97) to synchronize and/or coordinate the first and second layers of virtual features with the riding effects.

虽然某些实施例涉及可穿戴可视化设备14和/或固定可视化设备80在惊险骑乘装置92的情境中的使用,但是应当领会的是,AR/VR系统10可以被用在惊险骑乘装置92之外,以及在各种各样的环境中的任何环境中。例如,透明显示器82可以耦合到墙壁以描绘房间的窗户,并且当用户12坐在房间中和/或穿过房间时,用户12(例如,乘客102)可以穿戴电子眼镜16,以按在本文中公开的方式来提供沉浸式体验。While some embodiments relate to the use of wearable visualization device 14 and/or fixed visualization device 80 in the context of thrill ride device 92, it should be understood that AR/VR system 10 can be used outside of thrill ride device 92, and in any environment of a wide variety of settings. For example, transparent display 82 can be coupled to a wall to depict the windows of a room, and user 12 (e.g., passenger 102) can wear electronic glasses 16 as user 12 sits in and/or moves through the room to provide an immersive experience as disclosed herein.

虽然在本文中图示和描述了本公开的仅某些特征,但是本领域技术人员将想到许多修改和改变。因此,要理解的是,所附权利要求意图覆盖如落入本公开的真实精神内的全部这样的修改和改变。While only certain features of this disclosure have been illustrated and described herein, many modifications and alterations will occur to those skilled in the art. Therefore, it is to be understood that the appended claims are intended to cover all such modifications and alterations that fall within the true spirit of this disclosure.

本文中呈现和要求保护的技术被参考并应用于具有实用性的材料对象和具体示例,其可论证地改进了本技术领域,并且照此不是抽象的、无形的或纯理论的。另外,如果附加于本说明书结尾的任何权利要求包含被指定为“用于[执行][功能]]......的部件”或“用于[执行][功能]......的步骤”的一个或多个元素,则意图的是,要在美国法典第35卷112(f)条下解释这些元素。然而,对于包含以任何其他方式指定的元素的任何权利要求,意图的是,不要在美国法典第35卷 112(f)条下解释这样的元素。The techniques presented and claimed herein are referenced and applied to practical material objects and specific examples that demonstrably improve the field of expertise, and are therefore not abstract, intangible, or purely theoretical. Furthermore, if any claim appended to this specification contains one or more elements designated as “component for [performing] [function]” or “step for [performing] [function]”, it is intended that these elements be interpreted under 35 U.S.C. 112(f). However, for any claim containing elements designated in any other manner, it is intended that such elements not be interpreted under 35 U.S.C. 112(f).

Claims (20)

1.一种用于向用户提供增强现实、虚拟现实和/或混合现实体验的系统,其中所述系统被配置成使得所述用户能够通过第一显示器和第二显示器来观看现实世界环境,所述系统包括:1. A system for providing an augmented reality, virtual reality, and/or mixed reality experience to a user, wherein the system is configured to enable the user to view a real-world environment through a first display and a second display, the system comprising: 包括所述第一显示器的可穿戴可视化设备,其中所述第一显示器被配置成显示第一层虚拟特征以将所述第一层虚拟特征叠加到用户可观看的现实世界环境上;A wearable visualization device including the first display, wherein the first display is configured to display a first layer of virtual features to overlay the first layer of virtual features onto a real-world environment that can be viewed by a user; 包括所述第二显示器的固定可视化设备,其中所述第二显示器被配置成显示第二层虚拟特征以将所述第二层虚拟特征叠加到用户可观看的现实世界环境上;以及A fixed visualization device including a second display, wherein the second display is configured to display a second layer of virtual features to overlay the second layer of virtual features onto a real-world environment viewable by the user; and 处理器,其被配置成生成所述第一层虚拟特征和所述第二层虚拟特征,其中,所述处理器被配置成与所述可穿戴可视化设备和所述固定可视化设备可操作地通信,以基于所接收的传感器数据来在时间上并且在空间上协调所述第一层虚拟特征和所述第二层虚拟特征的呈现与所述现实世界环境,使得用户可同时观看所述第一层虚拟特征、所述第二层虚拟特征以及所述现实世界环境。A processor configured to generate a first layer of virtual features and a second layer of virtual features, wherein the processor is configured to operatively communicate with the wearable visualization device and the fixed visualization device to coordinate the presentation of the first layer of virtual features and the second layer of virtual features in time and space with the real-world environment based on received sensor data, so that a user can simultaneously view the first layer of virtual features, the second layer of virtual features, and the real-world environment. 2.根据权利要求1所述的系统,其中所述第一显示器是第一透明或半透明显示器,并且被配置成使得所述用户在穿戴所述可穿戴可视化设备时能够通过所述第一显示器来观看所述第二显示器,并且其中所述第二显示器是第二透明或半透明显示器。2. The system of claim 1, wherein the first display is a first transparent or semi-transparent display and is configured such that the user can view the second display through the first display while wearing the wearable visualization device, and wherein the second display is a second transparent or semi-transparent display. 3.根据权利要求1所述的系统,其中所述第一层虚拟特征被描绘为相对于可穿戴可视化设备的第一显示器是非静止的,并且所述第二层虚拟特征被描绘为相对于固定可视化设备的第二显示器是静止的。3. The system of claim 1, wherein the first layer of virtual features is depicted as non-stationary relative to a first display of a wearable visualization device, and the second layer of virtual features is depicted as stationary relative to a second display of a fixed visualization device. 4.根据权利要求1所述的系统,其中所述第二显示器被耦合到乘客骑乘车辆,其被配置成沿着路径行进通过游乐园,其中所述现实世界环境包括在所述乘客骑乘车辆周围的游乐园的景点的元素,并且其中用户通过所述第一显示器和所述第二显示器可观看所述元素。4. The system of claim 1, wherein the second display is coupled to a passenger riding vehicle configured to travel along a path through an amusement park, wherein the real-world environment includes elements of attractions of the amusement park surrounding the passenger riding vehicle, and wherein the user can view the elements through the first display and the second display. 5.根据权利要求4所述的系统,其中所述处理器被配置成使所述第一层虚拟特征和所述第二层虚拟特征的呈现与跟所述景点相关联的元素协调。5. The system of claim 4, wherein the processor is configured to coordinate the presentation of the first layer of virtual features and the second layer of virtual features with elements associated with the attraction. 6.根据权利要求1所述的系统,其中所述第一层虚拟特征包括:乘客骑乘车辆的舱室内的对象的虚拟图像,并且所述第二层虚拟特征包括:所述乘客骑乘车辆的窗户上的特征的虚拟图像;以及在所述乘客骑乘车辆的舱室外部的对象的虚拟图像。6. The system of claim 1, wherein the first layer of virtual features includes: virtual images of objects inside the cabin of the passenger vehicle, and the second layer of virtual features includes: virtual images of features on the windows of the passenger vehicle; and virtual images of objects outside the cabin of the passenger vehicle. 7.根据权利要求1所述的系统,其中所述第一层虚拟特征包括在乘客骑乘车辆的舱室外部的对象的虚拟图像。7. The system of claim 1, wherein the first layer of virtual features includes virtual images of objects outside the cabin of the passenger-riding vehicle. 8.根据权利要求1所述的系统,其包括:一个或多个相机或一个或多个传感器,其被配置成监控现实世界环境以促进所述第一层虚拟特征和所述第二层虚拟特征的呈现与所述现实世界环境的协调,其中所述一个或多个相机中的至少一个相机或者所述一个或多个传感器中的至少一个传感器被耦合到游乐园景点的乘客骑乘车辆。8. The system of claim 1, comprising: one or more cameras or one or more sensors configured to monitor a real-world environment to facilitate the presentation of the first layer of virtual features and the second layer of virtual features in harmony with the real-world environment, wherein at least one of the one or more cameras or at least one of the one or more sensors is coupled to a passenger vehicle of an amusement park attraction. 9.根据权利要求1所述的系统,其中所述第一显示器被配置为将所述第一层虚拟特征叠加到所述第二层虚拟特征以及所述现实世界环境上,以使得用户能够在叠加到所述现实世界环境上的堆叠层中同时观看所述第一层虚拟特征和所述第二层虚拟特征二者。9. The system of claim 1, wherein the first display is configured to overlay the first layer of virtual features onto the second layer of virtual features and the real-world environment, such that a user can simultaneously view both the first layer of virtual features and the second layer of virtual features in a stacked layer overlaid on the real-world environment. 10.一种用于向用户提供增强现实、虚拟现实和/或混合现实体验的系统,其中所述系统被配置成使得所述用户能够通过被配置成相对于彼此定位在堆叠层中的第一透明显示器和第二透明显示器来观看现实世界环境,所述系统包括:10. A system for providing an augmented reality, virtual reality, and/or mixed reality experience to a user, wherein the system is configured to enable the user to view a real-world environment through a first transparent display and a second transparent display configured to be positioned relative to each other in a stacked layer, the system comprising: 乘客骑乘车辆,其被配置成在游乐园中的骑乘期间穿过路径;Passengers ride vehicles that are configured to traverse paths during their ride within the amusement park; 可穿戴可视化设备,其被配置成在骑乘期间由乘客骑乘车辆内的用户穿戴,其中所述可穿戴可视化设备包括所述第一透明显示器,并且所述第一透明显示器被配置成将第一层虚拟特征叠加到用户可观看的现实世界环境上;A wearable visualization device configured to be worn by a user inside a passenger riding a vehicle during a ride, wherein the wearable visualization device includes the first transparent display and the first transparent display is configured to overlay a first layer of virtual features onto a real-world environment that the user can view. 固定可视化设备,其耦合到乘客骑乘车辆并且包括所述第二透明显示器,其中所述第二透明显示器被配置成将第二层虚拟特征叠加到用户可观看的现实世界环境上;以及A fixed visualization device coupled to a passenger-riding vehicle and including a second transparent display, wherein the second transparent display is configured to overlay a second layer of virtual features onto a real-world environment viewable by the user; and 处理器,其被配置成生成所述第一层虚拟特征并且生成所述第二层虚拟特征,以基于所接收的传感器数据来在时间上并且在空间上关于彼此以及关于骑乘的骑乘效果来协调所述第一层虚拟特征的呈现和所述第二层虚拟特征的呈现,其中第一层虚拟特征包括被描绘为在骑乘循环的一部分期间相对于乘客骑乘车辆的舱室移动的第一元素,并且第二层虚拟特征包括在骑乘循环的所述部分期间相对于舱室静止的第二元素。A processor configured to generate a first layer of virtual features and a second layer of virtual features to coordinate the presentation of the first layer of virtual features and the second layer of virtual features in time and space with respect to each other and with respect to the riding effect based on received sensor data, wherein the first layer of virtual features includes a first element depicted as moving relative to the cabin of the passenger riding vehicle during a portion of the riding cycle, and the second layer of virtual features includes a second element stationary relative to the cabin during said portion of the riding cycle. 11.根据权利要求10所述的系统,其中所述处理器被配置成基于乘客骑乘车辆沿着所述路径的定位来协调第一层虚拟特征的呈现与第二层虚拟特征的呈现。11. The system of claim 10, wherein the processor is configured to coordinate the rendering of the first layer of virtual features with the rendering of the second layer of virtual features based on the positioning of the passenger riding the vehicle along the path. 12.根据权利要求10所述的系统,其中所述处理器被配置成通过指示第一透明显示器在骑乘的骑乘循环期间的预定时间叠加第一层虚拟特征,并指示第二透明显示器在骑乘的骑乘循环期间的所述预定时间叠加第二层虚拟特征来使所述第一层虚拟特征的呈现和第二层虚拟特征的呈现与所述骑乘效果协调。12. The system of claim 10, wherein the processor is configured to coordinate the presentation of the first layer of virtual features and the second layer of virtual features with the riding effect by instructing a first transparent display to overlay a first layer of virtual features at a predetermined time during a riding cycle, and instructing a second transparent display to overlay a second layer of virtual features at the predetermined time during a riding cycle. 13.根据权利要求10所述的系统,其中,所述处理器被配置成在第一显示时间生成第一层虚拟特征,并且在超前于第一显示时间的第二显示时间生成第二层虚拟特征,其中所述第一元素包括漂浮通过乘客骑乘车辆的舱室的玻璃碎片,并且所述第二元素包括形成在舱室的窗户上的裂纹。13. The system of claim 10, wherein the processor is configured to generate a first layer of virtual features at a first display time and to generate a second layer of virtual features at a second display time preceding the first display time, wherein the first element comprises glass fragments floating through the cabin of the passenger vehicle and the second element comprises cracks formed in the windows of the cabin. 14.根据权利要求10所述的系统,其中透明显示器被配置成在被激励时是不透明的,从而提供所述乘客骑乘车辆的舱室被实体墙壁包围的错觉。14. The system of claim 10, wherein the transparent display is configured to be opaque when stimulated, thereby providing the illusion that the cabin of the passenger-riding vehicle is surrounded by solid walls. 15.一种用于向用户提供增强现实、虚拟现实和/或混合现实体验的方法,所述方法包括:15. A method for providing a user with an augmented reality, virtual reality, and/or mixed reality experience, the method comprising: 使用处理器来生成第一层虚拟特征和第二层虚拟特征;Use a processor to generate the first and second layer of virtual features; 响应于来自所述处理器的指令,在第一显示时间、在第一显示器上显示所述第一层虚拟特征,其中所述第一显示器被设置在可穿戴可视化设备内;以及In response to an instruction from the processor, the first layer of virtual features is displayed on a first display at a first display time, wherein the first display is disposed within a wearable visualization device; and 响应于来自所述处理器的指令,在第二显示时间、在第二显示器上显示第二层虚拟特征,其中所述第二显示器被设置在与所述可穿戴可视化设备物理地分离的固定可视化设备内,其中所述第一显示器被配置成将所述第一层虚拟特征叠加到由第二显示器显示的所述第二层虚拟特征上以使得用户能够在堆叠层中同时观看所述第一层虚拟特征和所述第二层虚拟特征二者,所述堆叠层被叠加到用户通过所述第一显示器和所述第二显示器可观看的现实世界环境上,其中所述处理器被配置成基于所接收的传感器数据来在时间上并且在空间上协调第一层虚拟特征和第二层虚拟特征的呈现。In response to instructions from the processor, a second layer of virtual features is displayed on a second display at a second display time, wherein the second display is disposed within a fixed visualization device physically separated from the wearable visualization device, wherein the first display is configured to overlay the first layer of virtual features onto the second layer of virtual features displayed on the second display so that a user can simultaneously view both the first layer of virtual features and the second layer of virtual features in a stacked layer, the stacked layer being overlaid on a real-world environment visible to the user through the first display and the second display, wherein the processor is configured to coordinate the presentation of the first layer of virtual features and the second layer of virtual features temporally and spatially based on received sensor data. 16.根据权利要求15所述的方法,其中,所述第二显示器包括耦合到乘客骑乘车辆的透明显示器。16. The method of claim 15, wherein the second display comprises a transparent display coupled to the passenger riding vehicle. 17.根据权利要求15所述的方法,其中,所述第一层虚拟特征包括在所述乘客骑乘车辆的舱室内的第一虚拟对象,所述第二层虚拟特征包括定位在所述乘客骑乘车辆外部或者在所述乘客骑乘车辆的窗户上的第二虚拟对象,并且其中所述第一显示时间在所述第二显示时间之后发生以导致所述第一层虚拟特征和所述第二层虚拟特征的经协调的显示。17. The method of claim 15, wherein the first layer of virtual features includes a first virtual object inside the cabin of the passenger riding vehicle, the second layer of virtual features includes a second virtual object positioned outside the passenger riding vehicle or on a window of the passenger riding vehicle, and wherein the first display time occurs after the second display time to result in coordinated display of the first layer of virtual features and the second layer of virtual features. 18.根据权利要求15所述的方法,其中,所述乘客骑乘车辆沿着骑乘的路径在游乐园中行进,并且其中所述第一显示时间和所述第二显示时间导致所述第一层虚拟特征和所述第二层虚拟特征关于彼此以及关于骑乘的骑乘效果的经协调的显示。18. The method of claim 15, wherein the passenger riding vehicle travels along a riding path in the amusement park, and wherein the first display time and the second display time result in a coordinated display of the first layer of virtual features and the second layer of virtual features with respect to each other and with respect to the riding effect. 19.根据权利要求15所述的方法,其包括:在所述处理器处、从一个或多个相机接收指示现实世界环境的信号,其中所述处理器利用所述信号来确定所述第一显示时间和所述第二显示时间以促进所述第一层虚拟特征和所述第二层虚拟特征的呈现与所述现实世界环境中的元素的协调。19. The method of claim 15, further comprising: receiving, at the processor, signals indicative of a real-world environment from one or more cameras, wherein the processor utilizes the signals to determine a first display time and a second display time to facilitate the coordination of the presentation of the first layer of virtual features and the second layer of virtual features with elements in the real-world environment. 20.根据权利要求19所述的方法,其中所述一个或多个相机中的至少一个相机被耦合到游乐园景点的乘客骑乘车辆。20. The method of claim 19, wherein at least one of the one or more cameras is coupled to a passenger vehicle at an amusement park attraction.
HK62020005816.7A 2017-03-06 2018-03-05 Systems and methods for layered virtual features in an amusement park environment HK40016432B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US62/467817 2017-03-06
US15/786359 2017-10-17

Publications (2)

Publication Number Publication Date
HK40016432A HK40016432A (en) 2020-09-11
HK40016432B true HK40016432B (en) 2024-06-14

Family

ID=

Similar Documents

Publication Publication Date Title
JP7655887B2 (en) System and method for layered virtual features in an amusement park environment - Patents.com
JP7079207B2 (en) Systems and methods for generating stereoscopic augmented reality and virtual reality images
JP7322034B2 (en) Systems and methods for overlaying text on an amusement park environment
CN107077209A (en) Systems and methods for generating augmented and virtual reality images
KR102818276B1 (en) Display systems for entertainment environments
HK40016432B (en) Systems and methods for layered virtual features in an amusement park environment
HK40016432A (en) Systems and methods for layered virtual features in an amusement park environment
HK40051493B (en) Display systems in an entertainment environment
HK40036042A (en) Systems and methods for textual overlay in an amusement park environment
HK40036042B (en) Systems and methods for textual overlay in an amusement park environment
HK1242806A1 (en) Systems and methods for generating augmented and virtual reality images