HK40016435B - Augmented ride system and method - Google Patents

Description

Enhanced riding systems and methods

Cross-references to related applications

This application claims priority and benefit to U.S. Provisional Patent Application No. 62/467,817, filed March 6, 2017, entitled “SYSTEMS AND METHODS FOR DIGITALOVERLAY IN AN AMUSEMENT PARK ENVIRONMENT”, which is hereby incorporated by reference in its entirety for all purposes.

Background Technology

The topics discussed in this article relate to amusement park attractions, and more specifically, to providing enhanced experiences within amusement park attractions.

Amusement parks or theme parks can include a variety of entertainment attractions to provide enjoyment for the park's customers (e.g., families and/or people of all ages). For example, attractions can include rides (e.g., closed-loop tracks, dark rides, thrill rides, or other similar rides), and along these rides can be themed environments, which can be traditionally created using equipment, furniture, architectural layouts, props, decorations, etc. Depending on the complexity of the themed environment, this can prove to be both possible and time-consuming to set up and replace them. Creating a themed environment that is enjoyable for all occupants of the ride can also be very difficult. The same themed environment may be appealing to some occupants but not to others.

Furthermore, due to the different movement paths and/or viewing angles of occupants in a vehicle, it may be difficult to provide the same riding experience for all occupants. For example, occupants sitting in the front row may have a better view and therefore a more immersive riding experience than those in the back. It is now recognized that it is desirable to include attractions where it is possible to change the theme of the attraction or include or remove certain thematic features in a more flexible and efficient manner than with conventional technologies. It is also recognized that it may be desirable to provide an immersive and more personalized or customized riding experience for all occupants.

Summary of the Invention

The following outlines certain embodiments that are equivalent to the scope of this disclosure. These embodiments are not intended to limit the scope of this disclosure, but are merely intended to provide a brief overview of the possible forms of these embodiments. In fact, these embodiments can encompass a variety of forms that may be similar to or different from the embodiments set forth below.

In one embodiment, a ride system includes: a ride vehicle configured to accommodate occupants and configured to travel along a ride path during a ride in an amusement park; a head-mounted display connected to the ride vehicle and configured to be worn by the occupants; and a ride and gaming control system integrated with the ride vehicle and configured to coordinate the occupants' ride experience with events occurring during the ride, using at least the head-mounted display and the ride vehicle. The ride and gaming control system includes: a user interface configured to receive input from the occupants; a ride controller configured to control the physical operation of the ride vehicle based at least in part on data relating to operating parameters of the ride vehicle and input from the occupants; and a monitoring system configured to monitor at least the position and orientation of the head-mounted display, the position and orientation of the ride vehicle, or a combination thereof. The ride and gaming control system also includes a computer graphics generation system communicatively coupled to the head-mounted display and configured to selectively generate AR features for display on the head-mounted display based on data received from the ride controller, the monitoring system, the user interface, or any combination thereof.

In another embodiment, a method includes receiving and analyzing data via a ride and gaming control system integrated with a ride vehicle configured to accommodate one or more occupants, wherein the ride vehicle is configured to travel along a ride path during a ride in an amusement park, and wherein the data is associated with one or more occupants, the ride vehicle, or both. The method includes generating gaming effects based on the received and analyzed data via a computer graphics generation system of the ride and gaming control system, wherein the gaming effects include augmented reality (AR) graphics. The method also includes transmitting the AR graphics via the computer graphics generation system for display on a head-mounted display configured to be worn by a respective occupant of the one or more occupants in the ride vehicle.

In another embodiment, a ride and gaming control system physically integrated with a ride vehicle configured to transport occupants along a ride path includes a ride controller configured to receive real-time data related to input control states from at least a user interface, and configured to receive data related to operating parameters of the ride vehicle. The ride and gaming control system includes a gaming controller communicatively coupled to the ride controller and configured to push updates related to the input control states and at least one operating parameter to features of the ride vehicle. The ride and gaming control system also includes a computer graphics generation system communicatively coupled to the gaming controller and a head-mounted display configured to be worn by the occupants, wherein the computer graphics generation system is configured to selectively render augmented reality (AR) graphics for display on the head-mounted display, at least in part based on updates from the gaming controller.

Attached Figure Description

These and other features, aspects, and advantages of this disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which the same characters run throughout the figures to denote the same parts, wherein:

Figure 1 is a perspective view of an embodiment of a riding system that provides an augmented reality (AR) experience to occupants via a head-mounted display according to this embodiment;

Figure 2 is a block diagram of an embodiment of the riding and gaming control system used in the riding system of Figure 1 according to this embodiment;

Figure 3 is a perspective view of an example embodiment of the head-mounted display of Figure 1 according to this embodiment;

Figure 4 is a flowchart illustrating an embodiment of the process for creating an AR-enhanced immersive experience using the riding and gaming control system of Figure 1 according to this embodiment;

Figure 5 is a flowchart illustrating an embodiment of the process for creating a realistic AR experience based on simulation using the riding and gaming control system of Figure 1 according to this embodiment;

Figure 6 is a schematic diagram illustrating an example AR experience with perspective adjustment provided by the riding and gaming control system of Figure 1 according to this embodiment;

Figure 7 is a flowchart of an embodiment of the method for dynamically adjusting the riding perspective according to this embodiment;

Figure 8 is a schematic diagram illustrating an example AR experience with dynamic interactivity provided by the riding and gaming control system of Figure 1 according to this embodiment;

Figure 9 is a schematic diagram illustrating an example AR experience where multiple occupants according to this embodiment share the same AR experience provided by the riding and gaming control system of Figure 1.

Detailed Implementation

One or more specific embodiments of this disclosure will now be described. To provide a concise description of these embodiments, not all features of an actual implementation may be described in the specification. It should be appreciated that, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer’s specific goals, such as compliance with system-related and business-related constraints, which may vary across various implementations. Furthermore, it should be appreciated that such development efforts can be complex and time-consuming, but remain routine tasks of design, construction, and manufacture for those skilled in the art who benefit from this disclosure.

This embodiment relates to systems and methods for providing enhanced experiences to customers visiting themed attractions, such as occupants on rides (e.g., closed-loop tracks, dark rides, or other similar rides). The enhanced experience can be performed as the occupants travel along a ride path within an amusement park or theme park. Specifically, a ride and game control system associated with the attraction can provide game effects that lead to augmented reality (AR) experiences via a head-mounted display. The ride and game control system can use display effect systems (e.g., projection displays, digital displays, sound systems, lighting systems, etc.) set along the ride path to provide additional entertainment experiences. To provide a more personalized and immersive AR experience, the ride and game control system can selectively provide AR experiences based on the occupant's viewing interests and/or engagement with the ride-related attractions. As an example, the ride and game control system can determine which real-world features (e.g., aspects of a physical amusement park attraction) the occupant is looking at and can provide AR experiences based on the occupant's interests, enabling the occupant to interact with AR features associated with the real-world features (e.g., engage, grab, select, aim, move, etc.).

As another example, the ride and game control system can dynamically change the perspective of AR features so that the occupant's visual experience is not obstructed or hindered by other occupants and/or real-world objects (e.g., by bringing the game and/or display effects directly in front of the occupant's eyes). As another example, the ride and game control system can dynamically provide and/or update AR features corresponding to game effects participated in by another occupant. Furthermore, the ride and game control system can provide a real-time adaptive AR experience based on occupant reactions and/or engagement. For example, the presence and/or content of AR features can be updated or changed in real time based on how many occupants are looking, whether occupants appear to enjoy the AR experience, whether occupants are participating in AR-based games, etc.

While this embodiment can be implemented in various configurations, Figure 1 schematically illustrates an example configuration in which a ride and game control system 10 is used in an amusement park 12. As illustrated, the amusement park 12 may include rides 14, themed attractions 16 (e.g., themed fixtures, architectural layouts, props, decorations, etc.) and other amusement park attractions 18 (e.g., a Ferris wheel or other attractions). In some embodiments, rides 14 may include dark rides or other similar thrill rides, and may therefore also include vehicle paths (e.g., closed-loop tracks or closed-loop track systems 20). Track 20 may be provided as infrastructure on which rides 22 can travel when occupants 24, 26, 28, and 30 are accommodated. Track 20 may thus define the movement of rides 22. However, in another embodiment, for example, track 20 may be replaced by a controlled path in which the movement of rides 20 may be controlled via electronic systems, magnetic systems, or other similar system infrastructure besides track 20. In other words, the travel path of vehicle 22 is not physically constrained to a precise path, thereby allowing occupants 24, 26, 28, and 30 to a certain extent control over their movement paths, viewing angles, etc. It should be appreciated that although vehicle 22 may be illustrated as a four-occupant vehicle, in other embodiments, occupant vehicle 22 may include any number of occupant spaces (e.g., 1, 2, 4, 8, 10, or more spaces) to accommodate one or more groups of occupants. It should also be appreciated that although ride-hailing device 14 may be illustrated as having one vehicle 22, ride-hailing device 14 may include any number of vehicle 22s (e.g., 1, 2, 4, 8, 10, or more). As vehicle 22 travels along track 20, occupants may be provided with a mobile tour of a scene (e.g., a themed environment that may include fixtures, architectural layouts, props, decorations, etc., corresponding to a theme). The scene may include the environment surrounding ride-hailing device 14 and/or the environment within infrastructure that can fully or partially accommodate ride-hailing device 14.

While occupants may find the ride 14 a very enjoyable experience, in some embodiments, enhancing their ride experience can be useful. Specifically, instead of a physical view of the scene only, the ride experience provided to occupants 24, 26, 28, and 30 can be enhanced by using gaming effects, including augmented reality (AR) experiences, through head-mounted displays 32. For example, as the ride 22 travels along track 20, the ride and gaming control system 10 can coordinate AR images or features, such as AR objects 36, to be displayed to occupants 24, 26, 28, and 30 on their respective head-mounted displays 32. Additionally, the ride and gaming control system 10 can coordinate off-board (e.g., entertainment outside of the ride 22) entertainment to enhance the ride experience provided to occupants 24, 26, 28, and 30. For example, when the vehicle 22 travels along the track 20, the ride and game control system 10 can coordinate the visual and/or sound presentation provided by the display effects system 34, which may include a projection game computer, display devices (e.g., projection display devices, digital display devices), lighting systems, and sound effects devices (e.g., speakers) arranged along the track 20.

In some embodiments, the riding experience provided to occupants 24, 26, 28, and 30 can be enhanced using playable gameplay that includes AR experiences. For example, some embodiments of the riding device 14 may involve occupant interaction with AR images or features, such as simulated interaction with AR objects 36 as the riding vehicle 22 passes or crosses them. Some embodiments of the riding vehicle 22 may be user-controlled, and one aspect of the game may be avoiding collisions with various AR objects 36 by guiding the riding vehicle 22 toward them and/or by turning away from certain AR objects 36. Simulated interaction can result in influencing the AR objects 36 based on predetermined or modeled responses stored by the riding and gaming control system 10. As an example, predetermined or modeled responses can be implemented using a physics model, engine, or similar module implemented by the riding and gaming control system 10.

Furthermore, the ride and gaming control system 10 can coordinate these gaming effects, including onboard (e.g., on the ride vehicle 22) AR and offboard (e.g., outside the ride vehicle 22) entertainment experiences described above, to enhance the overall ride experience for occupants 24, 26, 28, and 30. For example, the ride and gaming control system 10 can be communicatively coupled to a server 38 (e.g., a remote server, a field server, or an outboard server) via a wireless communication network (e.g., a wireless local area network [WLAN], a wireless wide area network [WWAN], or near field communication [NFC]). The server 38 can be a master gaming server coordinating onboard and offboard experiences. In some embodiments, the server 38 can store and/or process user information for occupants 24, 26, 28, and 30, enabling the ride and gaming control system 10 to provide personalized gaming effects to occupants based on the user information. User information may include any suitable information provided or authorized by the user, such as payment information, membership information, personal information (e.g., age, height, special needs, etc.), game information (e.g., information about video games associated with Theme Park 16, information about specific roles associated with the user in video games, information about the user's game history, etc.).

Figure 2 is a block diagram of the various components of the ride and game control system 10. In the illustrated embodiment, the ride and game control system 10 may be a dedicated system disposed on or integrated with the ride vehicle 22. The ride and game control system 10 may include a communication network 40 (e.g., a wired and/or wireless communication network, such as WLAN, WWAN, and NFC), a ride controller 42, a game controller 44, a monitoring system 46, and one or more game systems 48. The communication network 40 may communicatively couple the ride and game control system 10 to a server 38 and a display effects system 34, which may include a projection gaming computer disposed along the track 20, one or more display devices 35, one or more lighting systems 37, and other devices (e.g., a sound system, speakers). The communication network 40 may also communicatively couple various onboard components (e.g., the ride controller 42, the game controller 44, the monitoring system 46, one or more game systems 48, and the head-mounted display 32) to each other.

The ride controller 42 may be a programmable logic controller (PLC) or other suitable control device. The ride controller 42 may include a processor (e.g., a general-purpose processor, a system-on-a-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration) operatively coupled to a memory (e.g., a tangible, non-transitory computer-readable medium and/or other storage device) to execute instructions for tracking or forming operating parameters of the ride vehicle 22. For example, operating parameters or information for the ride vehicle 22 may include, but are not limited to, the position of the ride vehicle 22 (e.g., with a level of accuracy in the millimeter range), yaw, pitch, roll, and speed, and input control states (e.g., inputs provided by one or more occupants to drive the ride vehicle 22). In some embodiments, the ride controller 42 may also be configured to control or modify the physical operations of the ride vehicle 22 (e.g., modify the position, yaw, pitch, roll, and speed of the ride vehicle 22) based on input control states provided by one or more occupants.

Game controller 44 may be a programmable logic controller (PLC) or other suitable control device. Game controller 44 may include a processor (e.g., a general-purpose processor, a system-on-a-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration) operatively coupled to memory (e.g., a tangible non-transitory computer-readable medium and/or other storage device) to execute instructions stored in the memory. Game controller 44 may be configured to provide one or more game systems 48 and/or servers 38 with operating parameters or information regarding the vehicle 22 (e.g., the overall game state of the vehicle 22). Operating parameters or information may include, but are not limited to, the position, yaw, pitch, roll, and speed of the vehicle 22. In some embodiments, game controller 44 may transmit operating parameters or information to one or more game systems 48 and/or servers 38 via User Datagram Protocol (UDP). It will be appreciated that data transmission via UDP can introduce very little latency, making it an attractive option for latency-sensitive references such as those currently disclosed for generating personalized immersive riding experiences.

The monitoring system 46 may include any suitable sensors and/or computing systems disposed on or integrated with the vehicle 20 to track the position, location, orientation, presence, etc., of occupants (e.g., occupants 24, 26, 28, and 30) and/or the position, location, or orientation of the vehicle 22. Such sensors may include orientation and position sensors (e.g., accelerometers, magnetometers, gyroscopes, GPS receivers), motion tracking sensors (e.g., electromagnetic and solid-state motion tracking sensors), inertial measurement units (IMUs), presence sensors, etc. Information obtained by the monitoring system 46 may be useful in determining each occupant's gaze direction, viewing angle, field of view, viewing interest, interaction with the game, etc. In some embodiments, the monitoring system 46 may also receive data obtained from the head-mounted display 32 indicating the respective occupant's gaze direction, viewing angle, field of view, viewing interest, interaction with the game, etc. (e.g., position and orientation data of the head-mounted display 32).

One or more gaming systems 48 may typically be configured to render virtual or augmented graphics for overlay on a real-world environment view. One or more gaming systems 48 may also be responsible for game logic and run simulations of real-world vehicle and stage geometry for the placement of virtual objects in real space. In some embodiments, one or more gaming systems 48 are configured to provide AR and/or gaming experiences to occupants (e.g., occupants 24, 26, 28, and 30). Specifically, each seat of the vehicle 22 may include a dedicated gaming system 48. In some embodiments, one or more gaming systems 48 may be communicatively coupled to each other, allowing occupants to participate in shared games (e.g., games with multiple players). One or more gaming systems 48 may be communicatively coupled (directly or indirectly) to a game controller 44, a monitoring system 46, a server 38, and an effects display system 34. Each of the one or more gaming systems 48 may include a user interface 50 and a computer graphics generation system 52. User interface 50 can be communicatively coupled to computer graphics generation system 52, and computer graphics generation system 52 can be communicatively coupled to a corresponding head-mounted display 32 (e.g., via communication network 40).

User interface 50 may include one or more user input devices (e.g., handheld controllers, joysticks, buttons) disposed on the vehicle 22 to enable occupants to provide input. For example, user interface 50 may be configured to enable the application of different actions and/or effects within the AR environment. For instance, user interface 50 may enable occupants to control AR feature characters or objects in different directions (e.g., up, down, left, right) within the AR environment. More specifically, user interface 50 may enable occupants to select or grasp/release AR feature objects within the AR environment. In some embodiments, user interface 50 may enable occupants to control the operation of the vehicle 22, such as changing its speed and/or direction. In some embodiments, user interface 50 may also include a display screen and/or touchscreen to enable the communication of riding and gaming-related information to occupants.

The computer graphics generation system 52 can generate and transmit AR graphics to be displayed on the corresponding head-mounted display 32, enabling the corresponding occupant to enjoy an immersive riding experience enhanced by AR. The computer graphics generation system 52 includes processing circuitry such as a processor 54 (e.g., a general-purpose processor or other processor) and memory 56, and can process data useful in generating the AR experience for the corresponding occupant. Data useful in generating the AR experience may include, but is not limited to, real-time data received from the head-mounted display 32, user interface 50, and game controller 44 (e.g., data from the riding controller 42, monitoring system 46, and server 38) and data stored in memory 56.

The computer graphics generation system 52 can use such data to generate reference frames to register AR graphics to a real-world environment (e.g., to a generated real-world image or to an actual physical environment). Specifically, in some embodiments, by using reference frames generated based on orientation data, position data, viewpoint data, motion tracking data, etc., the computer graphics generation system 52 can render a view of the AR graphics in a manner that is temporally and spatially equivalent to what the corresponding occupant would perceive without wearing the head-mounted display 32. The computer graphics generation system 52 can store a model of the riding device 14 constructed using spatial information including real-world physical features of the riding device 14, encompassing the subject environment. This model, along with other inputs such as from the riding controller 42, game controller 44, monitoring system 46, and/or head-mounted display 32, is used to locate the corresponding occupant and determine the occupant's gaze direction and/or field of view. This model can be used to provide display signals to the head-mounted display 32, which are dynamically updated as the occupant moves along the track 20.

For example, the computer graphics generation system 52 can selectively generate AR graphics to reflect changes in the orientation, position, gaze direction, field of view, motion, etc., of the corresponding occupants. The computer graphics generation system 52 can selectively generate AR graphics based on data received from the monitoring system 46 indicating the position, yaw, speed, and/or other operational parameters of the vehicle 22. The computer graphics generation system 52 can also selectively generate AR graphics to reflect changes in input provided by the corresponding occupants using the user interface 50. Furthermore, the computer graphics generation system 52 can generate AR graphics based on simulated interactions that can cause AR objects to be affected according to certain predetermined or modeled responses stored by the computer graphics generation system 52 (e.g., in memory 56). As an example, predetermined or modeled responses can be implemented by a physics engine or similar module or implemented as part of the computer graphics generation system 52. In some embodiments, the computer graphics generation system 52 can track the information or data described above corresponding to multiple occupants (e.g., occupants 24, 26, 28, and 30) in a shared game, so that occupants in the shared game can see game effects applied by other players in the shared game.

Figure 3 is an illustration of an embodiment of the head-mounted display 32. In some embodiments, the head-mounted display 32 may be coupled to (e.g., tethered to) a riding vehicle 22 via cables or wires. In some embodiments, the head-mounted display 32 may be purchased or otherwise provided to an occupant of the riding vehicle 22. The head-mounted display 32 may include electronic glasses 60 (e.g., AR glasses, goggles) and a wearable portion 62 configured to house at least a portion of the electronic glasses 60. The head-mounted display 32 may be used alone or in combination with other features to create a surreal environment 64 (e.g., an AR environment), which may include an AR experience or other similar surreal environment for the occupant 25. Specifically, the head-mounted display 32 may be worn by the occupant 25 throughout the riding.

The head-mounted display 32 may include a processor 66 and a memory 68 (e.g., a tangible, non-transitory computer-readable medium). The processor 66 and memory 68 may be configured to allow the head-mounted display 32 to act as a display (e.g., to receive signals from a computer graphics generation system 52 that ultimately drives the display). The processor 66 may be a general-purpose processor, a system-on-a-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration.

The head-mounted display 32 may include a tracking system 70, which may include orientation and/or position sensors (such as accelerometers, magnetometers, gyroscopes, GPS receivers), motion tracking sensors, electromagnetic and solid-state motion tracking sensors, IMUs, presence sensors, etc. The tracking system 70 may collect real-time data indicating the occupant's position, orientation, focal length, gaze direction, field of view, motion, or any combination thereof. The head-mounted display 32 may include a communication interface 72 (e.g., including a wireless transceiver) that can transmit real-time data captured via the tracking system 70 to a processor 66 and/or a computer graphics generation system 52 for processing. The communication interface 72 may also enable the head-mounted display 32 to receive display signals transmitted by the computer graphics generation system 52.

The electronic glasses 60 of the head-mounted display 32 may include one or more displays 74. The one or more displays 74 may include a see-through display surface on which images are projected, such as a see-through liquid crystal display (LCD), a see-through organic light-emitting diode (OLED) display, or other similar displays useful for displaying real-world and AR graphic images to the occupant 25. For example, the occupant 25 may view AR graphics displayed on the respective displays 74 as overlaid onto the actual and physical real-world environment. According to this embodiment, the head-mounted display 32 may receive display signals (e.g., AR graphics along with corresponding overlay information, such as spatial and/or temporal information relative to one or more displays 74) via a communication interface 72, such that the head-mounted display 32 may process the AR graphics via a processor 66 and overlay the AR graphics onto one or more displays 74, thereby allowing the occupant 25 to perceive the AR graphics integrated into the real-world environment. In some embodiments, the head-mounted display 32 may include one or more sound devices (e.g., headphones, speakers, microphones).

Figure 4 is a flowchart of an embodiment of a process 80 that provides gaming effects (e.g., onboard and offboard entertainment experiences) to enhance the overall riding experience of the occupants of the vehicle 22. Process 80 may be implemented by a combination of the riding and gaming control system 10, the head-mounted display 32, and/or the effects display system 34. Process 80 may represent initial code or instructions stored in a non-transitory computer-readable medium (e.g., memory 56) and executed, for example, by a processor 54 included in the computer graphics generation system 52, a processor 66 in the head-mounted display 32, or both. Process 80 may include receiving (block 82) and analyzing real-time data and/or occupant-related data. It should be noted that the data received and/or analyzed in block 82 may be provided from various components of the riding and gaming control system 10 and/or components coupled to the riding and gaming control system 10 (e.g., head-mounted display 32, server 38, riding controller 42, game controller 44, monitoring system 46, one or more gaming systems 48, user interface 50).

As an example, real-time data may include operating parameters or information of the vehicle 22 (e.g., from the vehicle controller 42, game controller 44, user interface 50, or a combination thereof), which may include, but are not limited to, the position, yaw, pitch, roll, and speed of the vehicle 22. Real-time data may include input provided by one or more occupants (e.g., from the user interface 50) for driving the vehicle 22. Input provided by the occupants may include requests to change the position, yaw, pitch, roll, and/or speed of the vehicle 22. Real-time data may include position/orientation data for each occupant (e.g., from the vehicle controller 42, game controller 44, monitoring system 46, head-mounted display 32). Such data may relate to or otherwise indicate the occupant's position, orientation, gaze direction, field of view, or any combination thereof. Real-time data may include user input data (e.g., from the user interface 50) that may indicate interaction with or control of AR features, such as grasping or releasing AR objects. As can be appreciated, real-time data can be useful in determining the current state of each occupant during the ride (e.g., the occupant's current location and/or orientation, what the occupant is looking at, and the occupant's interaction with AR features in the surreal environment 64).

The data received and analyzed at box 82 also includes occupant-related data. For example, occupant-related data may include, but is not limited to, occupant identity and game history (e.g., from server 38). As will be appreciated, occupant-related data can be useful in determining attractive AR features and/or other attractive visual and/or auditory presentations for the respective occupant. In some embodiments, real-time data and/or occupant-related data received by the processor 54 (at box 82) of each gaming system 48 can be shared among them, enabling the overall riding experience of occupants (e.g., occupants 24, 26, 28, and 30) to be coordinated by the riding and gaming control system 10. As described in more detail herein, position/or orientation data from the monitoring system 46 and/or the head-mounted display 32 can be used to facilitate synchronization between certain perspectives, such as the viewing perspective of one occupant and the viewing perspective of another occupant. Such synchronization can be useful for triangulation of occupant positions based on known locations with certain fixed features (e.g., certain tourist attractions), for timing of certain special effects (e.g., realism and/or enhancement), for modeling of realistic AR effects (e.g., based on physical models), and for other effects described below.

Furthermore, the data received according to box 82 can be useful not only for directly impacting the experience of individual occupants, but also for facilitating and enhancing the physical layout of real-world and/or simulated environments. For example, the ride and game control system 10 can track historical data, such as the most common locations and views across a relatively large sample size (e.g., more than 10, 50, or 100 occupants with corresponding head-mounted displays 32), to ensure that occupant notifications are in readily visible locations. Such data can also be used for the selective application of special effects. For example, the ride and game control system 10 can track historical data of the user interface 50 and generate game effects if the occupant is a gamer (e.g., if the timing and/or use of the user interface 50 corresponds to a game), and generate regular display effects if the occupant is not a gamer. For example, the ride and game control system 10 can track the occupant's viewing angle and generate special effects corresponding to a themed attraction (e.g., game effects, AR effects) if the occupant is looking in the direction of a themed attraction. Additionally, such data can be used (e.g., based on the user's viewing perspective) to identify rarely viewed locations, in order to pinpoint areas used to hide certain real-world features (e.g., hide unsightly cables, or virtually remove such features, as illustrated herein) and/or hide certain items that may be experientially desirable (e.g., hide virtual Easter eggs or virtual treasure hunt items).

Process 80 may include generating (box 84) game effects based on real-time data. In some embodiments, generating game effects may include generating onboard entertainment including AR graphics to be displayed on head-mounted display 32. For example, the processor 54 of computer graphics generation system 52 may generate AR graphics and/or video to be displayed on one or more displays 74 of head-mounted display 32 based on any one or a combination of factors. Such factors may include the occupant's gaze direction and/or field of view at any given point in time during the cycle of ride 14, the occupant's use of user interface 50, the occupant's game play history, the position and/or orientation of ride 22 along track 20 (or other locations when track 22 is not present), and a predetermined distance traveled by ride 22 during the cycle of ride 14, after a predetermined time has elapsed, or after one or more occupants of ride 22 have performed one or more actions. Specifically, the processor 54 of the computer graphics generation system 52 may use projection, one or more video fusion and/or optical fusion techniques, etc., to generate overlapping AR features, enabling the occupant to view overlapping AR features as a view of the actual and physical real-world environment of the occupant on one or more displays 74 of the head-mounted display 32.

The generation of AR graphics can be used for AR addition of objects from the environment to add objects to the environment, creating games and developing personalized experiences for themed environments. For example, animated features can be virtually added to the occupant's view on one or more displays 74 of the head-mounted display 32. In some embodiments, the generation of AR graphics can be used for AR removal of objects from the environment, such as hiding unsightly objects from the occupant or making certain objects (e.g., special effects features) appear to float to enhance the realism of the desired visual effect. For example, a bird or similar animated mechanical feature can be levitated by a series of poles and lines, and these poles or lines can be actively removed from the environment, making the bird appear to be flying. As another example, certain themed areas may be enclosed by constructed fences, which are generally considered a negative experience. AR features can be used to virtually remove the constructed fences (e.g., the enclosed area may overlap with environmental features, or transform into a virtual attraction while construction is in progress). In yet another embodiment, the computer graphics generation system 52 can generate the realistic AR effects described above based on a physical model used to simulate and/or time certain special effects.

In some embodiments, generating game effects may include using a display effects system 34 to generate or initiate off-board entertainment, which includes visual and/or auditory effects. For example, the processor 54 of the computer graphics generation system 52 may be programmed to control the operation of the display effects system 34 (e.g., a projection gaming computer, one or more display devices 35, and one or more lighting systems 37) to provide occupants with realistic display effects. Based on a model of the riding device 14, the occupant's location/orientation, gaze direction, field of view, and other data obtained at frame 82, the computer graphics generation system 52 may generate signals to display scene-specific images or videos on one or more display devices 35 and/or alter the operation of one or more lighting systems 37 (e.g., change lighting effects such as lighting direction, timing, intensity, color, etc.). In some embodiments, for example, based on any one or a combination of factors, the processor 54 may generate signals to control the display content and timing of one or more display devices 35 and may generate signals to control lighting effects. Such factors may include the occupant’s gaze direction and/or field of view at any given point in time during the cycle of the ride device 14, the occupant’s use of the user interface 50, the occupant’s gaming history, the occupant’s position and/or orientation of the vehicle 22 along the track 20 (or other locations when the track 22 is not present), the predetermined distance traveled by the vehicle 22 during the cycle of the ride device 14, after a predetermined time has elapsed, or after one or more occupants of the vehicle 22 have performed one or more actions.

In another embodiment, processor 54 may generate signals based on the generated AR graphics to control display effects system 34, such that the content displayed on one or more displays 35, the lighting effects provided by one or more lighting systems 37, and the AR graphics displayed on the respective head-mounted display 32 are synchronized with each other. Different aspects of generating game effects will be discussed in more detail with respect to Figures 5-8. Process 80 may include transmitting and displaying (box 86) the generated game effects to a receiver. Specifically, the AR graphics and/or control signals generated in box 84 are transmitted to head-mounted display 32 and/or display effects system 34, respectively.

Figure 5 is a flowchart illustrating a process 90 for creating a realistic AR experience using the ride and game control system 10. Specifically, process 90 can be considered as an embodiment of the way game effects are generated in block 84 of process 80. Process 90 can represent initial code or instructions stored in memory 56 included in the computer graphics generation system 52. The illustrated process 90 includes receiving (block 92) real-time data from the ride controller 42, game controller 44, user interface 50, monitoring system 46, and/or head-mounted display 32.

Process 90 may also include performing a simulation based on the received real-time data (box 94). As an example, processor 54 may use a physical model stored in memory 56 to simulate realistic AR effects. The physical model may be implemented using suitable software or algorithms that describe, simulate, and/or illustrate the actual movement and interaction of objects. The physical model may take into account any factor or combination of factors obtained from the real-time data to simulate the movement and interaction of AR graphics. Such factors may include, in addition to other factors that can affect how an occupant may perceive the simulated AR graphics, the occupant's gaze direction and/or field of view, the occupant's position/or orientation, or changes in position/or orientation (e.g., speed and direction of movement, speed and direction of rotation).

The physical model can also take into account the properties of interactive AR objects and real-world objects. For example, in some embodiments, the computer graphics generation system 52 can use computer-aided design or similar 3D representations (e.g., digital 3D models) of the real-world environment surrounding the ride-on device to enhance the simulation of the interaction between real-world objects and the computerized effects shown on the head-mounted display 32. For example, features of the real-world environment surrounding the ride-on device can be represented from a construction perspective in terms of geometry and materials, allowing for accurate simulation of the interaction between real-world features and AR objects. In this way, the position, orientation, material composition, etc., of real-world objects can be stored in memory 56. Specially configured software of the computer graphics generation system 52 can allow the association of real-world object representations with AR display effects, AR play, and physical models (or multiple models) that control how AR features are generated and updated.

In this regard, the computer graphics generation system 52 can use a physical model to simulate realistic interactions between real-world objects and computerized objects (e.g., AR objects and real-world objects). As an example, the computer graphics generation system 52 can accurately simulate a computer-generated ball bouncing off a real-world object, such as a wall. The computer graphics generation system 52 may have stored representations of the walls, such as their size, shape, and material composition. In simulating the interaction where the ball hits the wall, the computer graphics generation system 52 will take these variables into account, for example, by simulating realistic deformation of the ball, simulating realistic bouncing off the wall, and so on. Changes in momentum, velocity, trajectory, etc., for the simulated ball will be controlled at least in part by the physical model of the computer graphics generation system 52.

Once the computer graphics generation system 52 has performed the appropriate simulation, process 90 may include generating (box 96) game effects based on the simulation. Specifically, processor 54 may use the simulated AR graphics to generate game effects based on aspects of process 80 discussed in box 84 of FIG. 4.

It should be noted that for ride-on devices with known motion profiles (e.g., a specific path or set of tracks), certain simulations can be pre-loaded into the computer graphics generation system 52 to reduce computational requirements. For example, the number of occupants' orientations, positions, and speeds is typically limited when the ride-on vehicle 22 travels along path 20. In this regard, the computer graphics generation system 52 can perform a comparison between information related to a specific occupant and known motion profiles (e.g., profiles for which specific simulations have already been performed). In cases where the motion profile matches a known motion profile, the computer graphics generation system 52 can generate graphics based on the already performed simulations.

Furthermore, in some embodiments, AR simulations can also be combined with real-world effects. For example, if a simulated AR object collidees with a movable real-world object, various actuation devices can be triggered to cause the real-world object to move in response to the simulated interaction.

Figure 6 is a schematic diagram illustrating an example AR experience with perspective adjustment rendered by the ride and gaming control system 10. In the illustrated embodiment, rear-seat occupant 26 and front-seat occupant 28 can view the themed attraction 100 through their respective head-mounted displays 32. However, due to the difference in their perspectives (e.g., due to seating arrangement), occupant 26 may not fully experience the ride compared to occupant 28, who has a relatively better field of view. For example, the themed attraction 100 may include real-world features 102 (e.g., birds in flight), which may be real-world objects or images displayed on one or more display devices 35. Since occupant 28 is in the front row, occupant 28 may have an unobstructed viewing angle 104 for the real-world feature 102 (e.g., not obstructed by any intervening objects). However, rear-seat occupant 26 may have an obstructed field of view 106 because at least a portion of the real-world feature 102 is obstructed by occupant 28.

According to one embodiment of this disclosure, the ride and gaming control system 10 can perform a simulation to allow an occupant to experience certain parts of the ride from an alternative perspective. Specifically, based on acquired real-time data (e.g., from the ride controller 42, gaming controller 44, head-mounted display 32, and/or monitoring system 46), the ride and gaming control system 10 can determine that the occupant 26's field of view 106 is at least partially obstructed. In response to this determination, the ride and gaming control system 10 can generate gaming effects to provide an adjusted viewpoint 108 and display the generated gaming effects on the corresponding head-mounted display 32 of the occupant 26, allowing the occupant 26 to have an unobstructed view of the real-world feature 102. For example, the generated gaming effects may include a virtual adjustment of the position of the real-world feature 102 such that it is brought in front of the occupant 26's eyes while the occupant 26 can still see the occupant 28. In some embodiments, the gaming effects generated in the adjusted viewpoint 108 may include AR features illustrating the occupant 28's viewpoint (e.g., field of view 104).

The method of adjusting the viewing angle can depend on several factors. An example illustration of method 110 for dynamically adjusting the riding viewing angle is shown in the flowchart in Figure 7. As illustrated, method 110 includes virtualizing the riding device (box 112). For example, the riding device can be virtualized by storing a computer graphics representation of the riding device, its surrounding environment, and the effect shown in memory (e.g., memory 56). The effect shown can be a real-world or virtual effect (e.g., AR effect), and the computer graphics representation can be a surface representation that is realistic in terms of relative size, position, etc. The action represented by box 112 can also include simulating and storing a known motion profile for the riding device and a viewing angle for the known motion profile in memory (e.g., memory 56). In this way, the known motion profile and the effect that will be seen along the known motion profile are stored in memory (e.g., memory 56) and are accessible to allow for future display and/or overlay.

The illustrated method 110 also includes synchronizing the position and orientation of a particular head-mounted display 32 with a stored virtual riding profile (known profile) (box 114). For example, synchronization of actions according to box 114 may include synchronizing the timing of an identified gaze on the head-mounted display 32 with the stored virtual riding profile. As another example, synchronization may include synchronizing the position and rotation measured by sensors on the head-mounted display 32 with the known riding profile. This allows the computer graphics generation system 52 to compare and identify differences between the viewing angle of the head-mounted display 32 and the viewing angle of the known riding profile. Using these differences, appropriate amounts of viewing angle adjustment can be identified to allow the computer graphics generation system 52 to adjust the enhancements displayed on the head-mounted display 32 to more closely correspond to the viewing angle of the known riding profile.

To identify whether the viewing angle adjustment is appropriate, the computer graphics generation system 52 can, for example, monitor aspects of the head-mounted display 32 to identify (box 116) potential gaze occlusions. For example, the motion profile of the vehicle 22 and the occupant's desired viewing angle (e.g., field of view including scenic features) may be known. This allows the computer graphics generation system 52 to identify, at some point during the ride, a potential gaze occlusion that would block an occupant's entire field of view of a specific scenic feature. As an example, the computer graphics generation system 52 can identify potential gaze occlusions attributable to a combination of factors, such as the presence of seat positions and other occupants, fixed features of the ride equipment, and their known locations, etc.

In response to situations where potential gaze obstruction exists or where an occupant (specific head-mounted display 32) may not have full field of vision of the location, the computer graphics generation system 52 can dynamically adjust (box 118) the viewing angle of at least a portion of the riding device shown on the head-mounted display 32. As an example, the computer graphics generation system 52 can shift specific virtual augmented locations (or multiple augmented locations) so that they are within the full field of vision of an occupant whose view would otherwise be obstructed by other occupants or environmental riding elements.

Figure 8 is a schematic diagram illustrating an example AR experience with dynamic interactivity rendered by a ride and game control system 10 according to this embodiment. In the illustrated embodiment, an occupant 28 wearing a head-mounted display 32 can view a themed attraction 120 (e.g., a volcano), which may include real-world features (e.g., real-world objects or images displayed on one or more display devices 35) and/or AR features. During the ride, the occupant 28 may gaze in different directions and may change the viewing angle from a first field of view 122 to a second field of view 124, and then to a third field of view 126. According to one embodiment of this disclosure, the ride and game control system 10 may render game effects dynamically based on the occupant's field of view. In this example, in response to determining that the occupant 28 has a gaze in the first field of view 122, the ride and game control system 10 may not render AR features, such that the occupant 28 wearing the head-mounted display 32 may only see the dormant volcano 128. In response to determining that occupant 28 has a gaze in a second field of view 124, the ride and gaming control system 10 can render AR features 130, allowing occupant 28 wearing head-mounted display 32 to see birds flying around the volcano. In response to determining that occupant 28 has a gaze in a third field of view 126, the ride and gaming control system 10 can render AR features 132, allowing occupant 28 wearing head-mounted display 32 to see the erupting volcano.

In some embodiments, the ride and game control system 10 may also modify one or more lighting systems 37 and/or other display effects (e.g., sound effects) based on the rendered AR features. For example, in response to determining that occupant 28 has a gaze in a second field of view 124, the ride and game control system 10 may modify the lighting conditions of one or more lighting systems 37 (e.g., light intensity, direction, color, etc.) to highlight the rendered AR feature 130 (e.g., a bird in flight). For example, in response to determining that occupant 28 has a gaze in a third field of view 126, the ride and game control system 10 may modify the lighting conditions of one or more lighting systems 37 (e.g., light intensity, direction, color, etc.) and/or may modify sound effects (e.g., provided via a sound effects device of the head-mounted display 32 or the display effects system 34) to reflect a specific scene of a volcanic eruption.

In some embodiments, the ride and gaming control system 10 may render an AR feature in response to determining that at least a threshold number (e.g., 2, 4, 6, 10 or more) of occupants show viewing interest. For example, the ride and gaming control system 10 may render an AR feature 132 (e.g., an erupting volcano) only in response to determining that at least two occupants (e.g., occupants 26 and 28) are looking in the field of view 126. It should be appreciated that the threshold number may be scene-specific. For example, the threshold number for AR feature 132 (e.g., an erupting volcano) may be two, and the threshold number for AR feature 130 (e.g., a flying bird) may be four.

Figure 9 is a schematic diagram illustrating an example of connectivity/engagement among multiple gaming systems 48 of the ride and gaming control system 10. In the illustrated embodiment, one or more gaming systems 48 of the ride and gaming control system 10 (shown in Figure 2) located within a single ride vehicle 22 (operated by occupants 24, 26, 28, and 30) are communicatively and operatively coupled to each other.

Both occupants 28 and 30 may gaze in substantially the same direction at a themed attraction 140 (e.g., a volcano), which may include real-world features (e.g., real-world objects or images displayed on one or more display devices 35) and/or AR features. For example, in response to determining that a portion of occupant 28's field of view 142 overlaps with a portion of occupant 30's field of view 144, the riding and gaming control system 10 may render the same AR features to be displayed on the respective head-mounted displays 32 of occupants 28 and 30, but from different perspectives. Furthermore, both occupants 28 and 30 may see actions 146 (e.g., actions in an AR environment) performed by either occupant 28 or 30 on a corresponding user interface 50 of the gaming system 48. In the illustrated example, occupant 28 operates the corresponding user interface 50 to perform action 146, such as firing a fireball 148 at volcano 150. For example, occupant 28 may adjust the operation of the corresponding user interface 50 to change the trajectory of the fireball 148. Correspondingly, from the respective head-mounted display 32, occupant 30 can see the action 146 performed by occupant 28 (e.g., firing a fireball 148 at volcano 150). In some embodiments, the ride and game control system 10 may determine that occupant 30 is participating in the same game as occupant 28 (e.g., occupant 30 may use user interface 50 to provide an instruction to consent to join the game with occupant 28), and in response to this determination, the ride and game control system 10 may display the same AR features, including the result of action 146, on the respective head-mounted displays 32 of occupants 28 and 30.

While certain features of this embodiment have been described and illustrated herein, many modifications and alterations will be apparent to those skilled in the art. Therefore, it is to be understood that the appended claims are intended to cover all such modifications and alterations falling within the true spirit of this disclosure. Furthermore, it should be understood that certain elements of the disclosed embodiments can be combined or interchanged with each other.

Claims (18)

1. A riding system, comprising: A ride-on vehicle configured to accommodate occupants and travel along a ride path during the ride in the amusement park; A head-mounted display, which is connected to the vehicle and configured to be worn by the occupant; and A riding and gaming control system, integrated with the riding vehicle and configured to coordinate the occupant's riding experience with events occurring during the riding, using at least the head-mounted display and the riding vehicle, wherein the riding and gaming control system includes: A user interface configured to receive input from the occupants; A passenger controller is configured to control the physical operation of the passenger vehicle based at least in part on data relating to the operating parameters of the passenger vehicle and the input from the occupant; A surveillance system configured to monitor at least the position and orientation of the head-mounted display, the position and orientation of the vehicle, or a combination thereof; and A computer graphics generation system communicatively coupled to the head-mounted display and configured to selectively generate augmented reality (AR) features for display on the head-mounted display based on data received from the ride controller, the monitoring system, the user interface, or any combination thereof, and to provide the occupants with a specific AR experience associated with the specific real-world feature in response to determining that more than a threshold number of additional occupants in the ride vehicle are looking at the specific real-world feature. 2. The riding system of claim 1, wherein the computer graphics generation system is configured to selectively generate the AR features based at least in part on data received from the monitoring system indicating the position, yaw, and speed of the riding vehicle. 3. The riding system of claim 1, wherein the monitoring system comprises one or more orientation and position sensors, one or more motion tracking sensors, one or more inertial measurement units, one or more presence sensors, or a combination thereof. 4. The riding system of claim 1, wherein the computer graphics generation system is configured to perform a viewpoint adjustment of the AR feature in response to determining that the occupant has an obstructed field of view. 5. The riding system of claim 4, wherein the computer graphics generation system is configured to perform a viewpoint adjustment of the AR feature such that the occupant has an unobstructed field of vision of the AR feature. 6. The riding system of claim 1, wherein the riding and gaming control system is configured to provide the occupant with a unique AR experience corresponding to identification information associated with the occupant. 7. The riding system of claim 1, wherein the computer graphics generation system is configured to generate the AR features based on simulations of one or more physical models and digital 3D models of the environment surrounding the riding vehicle. 8. The riding system of claim 1, further comprising a display effect system communicatively coupled to the riding and gaming control system, wherein the display effect system includes a display device and a lighting system disposed along the riding path. 9. The ride system of claim 8, wherein the display effect system is configured to change the operation of the display device, the operation of the lighting system, or both, based on data from the ride controller, the monitoring system, the user interface, or a combination thereof. 10. A method comprising: Data is received and analyzed via a ride and gaming control system integrated with the ride vehicle, which is configured to accommodate one or more occupants, wherein the ride vehicle is configured to travel along a ride path during a ride in the amusement park, and wherein the data is related to the one or more occupants, the ride vehicle, or both. The ride and game control system determines, based on the data, that a first real-world object in the environment surrounding the ride vehicle is at least partially occluded by a second real-world object in the environment for the respective occupant of the one or more occupants; The computer graphics generation system of the ride and game control system generates game effects based on the data, wherein the game effects include augmented reality (AR) graphics of the first real-world object generated in response to identifying that the first real-world object is at least partially occluded for the respective occupant. The AR graphics of the first real-world object are transmitted via the computer graphics generation system for display on a head-mounted display configured to be worn by a corresponding occupant in the vehicle, to perform perspective adjustment for the corresponding occupant by overlaying the AR graphics of the first real-world object onto the field of view of the corresponding occupant, such that the AR graphics of the first real-world object are overlaid onto a second real-world object, the environment, or both; and In response to determining that more than a threshold number of additional occupants in the vehicle are looking at a specific real-world feature, the occupants are provided with a specific AR experience associated with that specific real-world feature. 11. The method of claim 10, wherein receiving the data comprises receiving real-time data collected via one or more orientation and position sensors, one or more motion tracking sensors, one or more inertial measurement units, one or more presence sensors, or any combination thereof. 12. The method of claim 10, further comprising displaying the AR graphics on one or more displays of the head-mounted display via the head-mounted display, wherein the head-mounted display is physically coupled to the vehicle. 13. The method of claim 10, wherein generating the game effect comprises generating the AR graphics based on simulations of one or more physical models and digital 3D models of the environment surrounding the vehicle. 14. The method of claim 10, further comprising using a display effect system based on the data to display visual graphics on one or more displays arranged along the riding path, to change the operation of one or more lighting systems arranged along the riding path, or both, the display effect system communicating with the riding and gaming control system, wherein the display effect system is detached from the riding vehicle. 15. A ride and gaming control system physically integrated with a ride vehicle configured to transport occupants along a ride path, the ride and gaming control system comprising: A ride controller is configured to receive real-time data relating to input control states from at least a user interface, and to receive data relating to operating parameters of the ride vehicle. A game controller communicatively coupled to the ride controller and configured to push updates related to at least one of the input control state and the operating parameters to the ride vehicle; and A computer graphics generation system communicatively coupled to the game controller and a head-mounted display configured to be worn by the occupant, wherein the computer graphics generation system is configured to selectively render augmented reality (AR) graphics for display on the head-mounted display based at least in part on updates from the game controller, and wherein the game controller is configured to adjust a lighting system positioned along the riding path based on the AR graphics and based on the occupant's gaze direction to highlight the AR graphics superimposed on the occupant's field of vision through the head-mounted display. 16. The ride and gaming control system of claim 15, wherein the ride vehicle is configured to carry a plurality of occupants along the ride path, and wherein the ride and gaming control system includes a plurality of computer graphics generation systems, each computer graphics generation system being configured to receive the update from the gaming controller to render a corresponding AR graphic unique to the perspective of each of the plurality of occupants for display on a respective head-mounted display of the plurality of occupants. 17. The riding and gaming control system of claim 16, wherein the gaming controller is configured to: Provide the total game status of the vehicle to the server of the vehicle's non-board-mounted location; and Provide scene-specific game events to a non-board-mounted projection gaming computer or display effects system, or both, of the vehicle. 18. The riding and gaming control system of claim 15, comprising a monitoring system having one or more orientation and position sensors, one or more motion tracking sensors, one or more inertial measurement units, one or more presence sensors, or combinations thereof, wherein the monitoring system is configured to provide feedback to the gaming controller, the feedback indicating the occupant's gaze direction.