System and method for layered virtual features in an amusement park environment - Patents.com

The integration of wearable and fixed visualization devices in amusement parks addresses the inefficiency of traditional theme changes by enabling flexible and immersive augmented, virtual, and mixed reality experiences, enhancing visitor engagement and park adaptability.

JP7655887B2Active Publication Date: 2025-04-02UNIVERSAL CITY STUDIOS LLC
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2022147654
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2017-10-17
Filing Date
2022-09-16
Publication Date
2025-04-02
Estimated Expiration
2038-03-05

AI Technical Summary

Technical Problem

Existing methods for changing or adding thematic features in amusement parks are inefficient and time-consuming, making it difficult to adapt attractions to different themes and provide personalized, immersive experiences for visitors.

Method used

A system combining wearable and fixed visualization devices to provide augmented, virtual, and mixed reality experiences, allowing for the efficient addition or removal of thematic features and enhancing visitor immersion through customizable and interactive experiences.

Benefits of technology

Enables flexible and efficient theme changes in amusement park attractions, providing visitors with personalized and immersive experiences by overlaying virtual features onto real environments through coordinated displays in wearable and fixed visualization devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007655887000001
    Figure 0007655887000001
  • Figure 0007655887000002
    Figure 0007655887000002
  • Figure 0007655887000003
    Figure 0007655887000003
Patent Text Reader

Abstract

Enhance the guest's immersive experience with the attraction and provide a more personalized or customized experience for the guest. A user views a real environment through a first display and a second display. The AR / VR system includes a wearable visualization device including the first display and a stationary visualization device including the second display. The first display is configured to display a first layer of virtual features, and the second display is configured to display a second layer of virtual features. The AR / VR system includes a processor configured to generate the first layer of virtual features and the second layer of virtual features. The processor is in operative communication with the wearable visualization device and the stationary visualization device to coordinate the display of the first layer of virtual features and the second layer of virtual features.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Provisional Patent Application No. 62 / 467,817, filed March 6, 2017, and entitled "SYSTEMS AND METHODS FOR DIGITAL OVERLAY IN AN AMUSEMENT PARK ENVIRONMENT," which is incorporated herein by reference in its entirety for all purposes.

[0002] The subject matter disclosed herein relates to systems and methods for providing augmented and virtual reality experiences to a user through the use of a combination of wearable and fixed visualization devices. [Background technology]

[0003] Amusement parks and / or theme parks may include a variety of entertainment attractions, restaurants, and rides useful in providing entertainment to amusement park patrons (e.g., families and / or people of all ages). Areas of an amusement park may have different themes specifically targeted to particular audiences. For example, some of these areas may include themes that traditionally interest children, while other areas may include themes that traditionally interest a more adult audience. Generally, such themed locations associated with an amusement park may be referred to as attractions or themed attractions.

[0004] A themed attraction can be constructed with fixed fixtures, building layouts, props, decorations, etc., most of which can generally relate to a particular theme. In situations where a different theme is to be constructed at the same location, features associated with the old theme can be replaced with features associated with the new theme. Depending on the complexity of the theme of the location, this can prove to be very difficult and time consuming, as it may involve removing or replacing decorations, fixtures, fixtures, props, etc. Indeed, for some types of attractions, relatively complex themes are becoming more common in order to provide an immersive experience for visitors. Summary of the Invention [Problem to be solved by the invention]

[0005] It is now recognized that it would be desirable to include attractions that may allow for changes in attraction theme, or to include or remove certain themed features in such attractions in a more flexible and efficient manner than traditional methods. It is also now recognized that it would be desirable to enhance a guest's immersive experience with such attractions, and to provide a more personalized or customized experience for guests. [Means for solving the problem]

[0006] Below, we will provide an overview of some embodiments disclosed herein. It should be understood that these aspects are merely intended to provide the reader with a summary of some of these embodiments and are not intended to limit the scope of the present disclosure. In fact, the present disclosure may include various aspects that may not be described below.

[0007] In one embodiment, a system for providing an augmented reality, virtual reality, and / or mixed reality experience to a user includes a first display and a second display. The user views a real environment through the first display and the second display. The system includes a wearable visualization device including the first display and a stationary visualization device including the second display. The first display is configured to display a first layer of virtual features and the second display is configured to display a second layer of virtual features. The system includes a processor configured to generate the first layer of virtual features and the second layer of virtual features. The processor is configured in operative communication with the wearable visualization device and the stationary visualization device to coordinate the display of the first layer of virtual features and the second layer of virtual features.

[0008] In one embodiment, a system for providing an augmented reality, virtual reality, and / or mixed reality experience to a user includes a passenger ride vehicle, a fixed visualization device, and a processor. The passenger ride vehicle is configured to travel along a path or track within an amusement park during a ride. The fixed visualization device includes a transparent display coupled to the passenger ride vehicle. The fixed visualization device is configured to superimpose virtual features onto a real environment viewed through the transparent display. The processor is configured to generate the virtual features and coordinate the display of the virtual features with ride effects of the ride.

[0009] In one embodiment, a method of providing an augmented reality, virtual reality, and / or mixed reality experience to a user includes generating a first layer of virtual features and a second layer of virtual features using a processor. The method also includes displaying the first layer of virtual features on a first display in response to instructions from the processor at a first display time. The first display is disposed within a wearable visualization device. The method further includes displaying the second layer of virtual features on the first display in response to instructions from the processor at a second display time. The second display is disposed within a stationary visualization device that is physically separate from the wearable visualization device.

[0010] Various refinements of the features described above may be made in relation to the various aspects of the disclosure. Further features may also be incorporated into these various aspects. These refinements and further features may exist individually or in any combination.

[0011] These and other features, aspects, and advantages of the present disclosure will be better understood when read in conjunction with the following detailed description and the accompanying drawings, in which like elements are designated with like reference characters throughout. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 illustrates an embodiment of a wearable visualization device and computer graphics generation system that can be used in an augmented reality (AR) or virtual reality (VR) system, according to an embodiment of the present invention. [Diagram 2] FIG. 2 is an exploded perspective view of the embodiment of the wearable visualization device of FIG. 1 in accordance with an embodiment of the present invention. [Diagram 3] FIG. 2 is an exploded perspective view of the embodiment of the wearable visualization device of FIG. 1 in accordance with an embodiment of the present invention. [Figure 4] 2 illustrates a fixed visualization device and a wearable visualization device of the augmented reality (AR) or virtual reality (VR) system of FIG. 1 that can be used in a passenger ride vehicle according to an embodiment of the present invention. [Diagram 5] 5 is a perspective view of the passenger ride vehicle of FIG. 4 illustrating an embodiment of an augmented reality (AR) or virtual reality (VR) system having a fixed visualization device in accordance with an embodiment of the present invention. [Figure 6] 5 is a perspective view of the passenger ride vehicle of FIG. 4 illustrating an embodiment of an augmented reality (AR) or virtual reality (VR) system having a wearable visualization device and a fixed visualization device in accordance with an embodiment of the present invention. [Figure 7] 5 is a flowchart of a method of operation of the augmented reality (AR) or virtual reality (VR) system of FIG. 4 in accordance with an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] One or more specific embodiments of the present disclosure are described below. In order to concisely describe these embodiments, not all features of the implementations may be described herein. It should be understood that in the development of any such implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer's particular objectives, such as compliance with system-related and business-related constraints that may vary from implementation to implementation. Moreover, it should be understood that such development efforts may be complex and time-consuming, but are routine undertakings of design, fabrication and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0014] The present embodiments relate to systems and methods for providing an augmented reality (AR), virtual reality (VR), mixed reality (e.g., a combination of AR and VR) experience, or a combination thereof, as part of attractions associated with an amusement park or theme park. In accordance with the present embodiments, these attractions may not necessarily be limited to the realm of an amusement park. Indeed, aspects of the present disclosure may relate to the implementation of attractions beyond the boundaries of an amusement park, such as in a hotel associated with the amusement park, or in vehicles transporting guests to and from the amusement park and / or hotel.

[0015] The present embodiment includes, for example, a combination of hardware configurations, software configurations (e.g., algorithmic structures), and attraction features that can be utilized to implement AR, VR, and / or mixed reality experiences that can provide park guests with an attraction-filled experience that can be customizable, personalized, and interactive.

[0016] For example, the present embodiments may include visual devices such as wearable visualization devices (e.g., electronic goggles or displays, glasses) and fixed visualization devices (e.g., transparent light emitting diode [LED] displays, transparent organic light emitting diode [OLED] displays) through which park guests and employees can view the AR, VR, and / or mixed reality scenes. It should be understood that the fixed visualization devices disclosed herein may be fixed and / or coupled to structures such as passenger ride vehicles or building walls. The fixed visualization devices may be physically separate and distinct from the wearable visualization devices. Some implementations may be utilized to enhance a guest's experience, for example, by virtually removing or adding features within an environment associated with the park, provide adjustable virtual environments for different experiences on the same ride, or allow one guest to have the same perspective as another guest.

[0017] Some attractions in amusement parks may include passenger ride vehicles that can be specifically designed to work with visual devices to add more depth and / or realism to the AR, VR, or mixed reality experience. In one embodiment, the fixed visualization device may include a transparent display. In one embodiment, the conventional panels and / or windows (e.g., glass, acrylic) of the passenger ride vehicle's cabin may be replaced with a transparent display that can augment the cabin's exterior view by overlaying virtual images and / or virtual videos on some or all of the transparent display (e.g., transparent LED elements, transparent OLED displays). For example, in one embodiment, the transparent display may be used to display condensation as the passenger ride vehicle moves past the animated figure, creating the illusion that the animated figure (e.g., a dragon) is breathing on the passenger ride vehicle.

[0018] Additionally or alternatively, wearable visualization devices may be used to augment passengers' perception of the environment. For example, the wearable visualization devices may enhance a guest's immersive experience by creating the illusion of an animated figure entering the cabin (e.g., a dragon reaching into the cabin or breathing fire). The fixed and wearable visualization devices may be configured to operate independently or may be operatively coupled through a controller (e.g., a computer graphics generation system, one or more processors) to synchronize and / or coordinate visualizations displayed on the fixed and wearable visualization devices. The controller may also synchronize and / or coordinate AR, VR, and / or mixed reality experiences provided by the wearable and / or fixed visualization devices with external animatronics or other ride elements positioned around the track of the passenger ride vehicle.

[0019] Additionally, some data may be collected from the wearable visualization devices to more efficiently utilize computing power and / or other resources for targeted advertising, or to provide unusual virtual features (e.g., "Easter eggs") for triggering effects or tailoring a show. For example, the ride control system may determine whether a passenger wearing a wearable visualization device looked in a particular direction (e.g., to view a virtual image on a fixed visualization device) before starting the ride's movement or before initiating some other change (e.g., changing the virtual image on a fixed visualization device). Employee visualization data may also be collected. For example, the ride control system may determine whether an employee operating the ride looked in a particular direction (e.g., to ensure that no guests were currently boarding the ride) before starting the ride's movement. The visualization devices may also be used to function as ride operator heads-up displays (HUDs).

[0020] For illustrative purposes, Figure 1 illustrates an embodiment of an AR / VR system 10 configured to enable a user 12 (e.g., amusement park guest, amusement park employee) to experience (e.g., view, interact with) a controlled AR, VR, and / or mixed reality scene. According to some embodiments, the user 12 may purchase or otherwise obtain a wearable visualization device 14, which in some embodiments may include electronic glasses 16 (e.g., AR / VR glasses, goggles). As described in more detail below, the wearable visualization device 14 may include a wearing portion 18, shown as a headband, configured to receive at least a portion of the electronic glasses 16.

[0021] The wearable visualization device 14 can be used alone or in combination with other features to generate an unrealistic environment 20 that can include an AR experience, a VR experience, a mixed reality experience, a computer-assisted reality experience, a combination thereof, or other similar unrealistic environment for the user 12. In particular, the user 12 can wear the wearable visualization device 14 throughout the duration of the ride (e.g., a passenger ride vehicle) or at other predetermined times, such as during the game, when entering a particular area of ​​the amusement park, during the ride to and stay at a hotel associated with the amusement park.

[0022] In one embodiment, the wearable visualization device 14 may include a device capable of superimposing some virtual features onto a transparent surface (e.g., glass) or a device that superimposes virtual features onto a substantially real-time video, or a combination thereof (e.g., the wearable visualization device 14 may switch between a transparent and an opaque visualization of the user 12). In one embodiment, the wearable visualization device 14 may include functionality such as a light projection functionality configured to project light onto one or both eyes of the user 12 such that virtual features are superimposed onto real-world objects. Such a wearable visualization device 14 may be considered to include a retinal display.

[0023] Thus, in one embodiment, user 12 can view the real environment through substantially transparent electronic glasses 16 with certain virtual features superimposed on the surface of electronic glasses 16 (or the eyes of user 12) to provide the illusion of virtual features being embedded in the physical environment. In one embodiment, user 12 can view real-time video of the physical environment with the virtual features superimposed.

[0024] In one embodiment, when wearing the wearable visualization device 14, the user 12 may feel completely immersed in the unrealistic environment 20, which he or she may perceive as a real-world physical environment that includes some virtual features. Specifically, in one embodiment, the wearable visualization device 14 may fully control the viewpoint of the user 12 (e.g., using an opaque screen) such that the unrealistic environment 20 may be a real-time video that includes real-world images 22 of the physical environment electronically blended with one or more augmented or virtual reality images 24 (e.g., virtual augmentation).

[0025] In general, the real-world image 22 refers to what would be visible to the user 12 even when not wearing the wearable visualization device 14. The term "real-time" indicates that the image is acquired and / or provided within a time frame that is substantially close to the actual viewing time. Specifically, in other embodiments, the wearable visualization device 14 may only partially control the user 12's viewpoint (e.g., using a transparent screen) such that the unrealistic environment 20 is an actual physical environment with an augmented or virtual reality image 24 superimposed on a transparent surface or the user's 12's eye. According to further embodiments of the present disclosure, the augmented or virtual reality image 24 may function to be superimposed on a real-world object such that the object appears to no longer exist or to have been removed (e.g., the real-world object is completely or partially obscured by a virtual object or virtual environment representation).

[0026] In one embodiment, as shown in a cutaway portion of the wearable visualization device 14, the wearable visualization device 14 can include processing circuitry 25, such as a processor 26, and a memory 28 to assist in characterizing the unrealistic environment 20. The processor 26 can be operatively coupled to the memory 28 to execute instructions for performing the methods of the present disclosure, for example, generating the real-world image 22 and / or one or more augmented or virtual reality images 24 (e.g., virtual features or images). These instructions can be encoded in a program or code stored in a tangible, non-transitory computer-readable medium, such as the memory 28 and / or other storage devices. The processor 26 can be a general-purpose processor, a system-on-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration. The memory 28 and the processor 26 together can form all or part of the AR / VR system 10.

[0027] In one embodiment, as further shown, the wearable visualization device 14 may also include a pair of displays 30 and 32, one for each eye of the user 12 (e.g., may be provided on a frame in front of the wearable visualization device 14 where the eyeglass lenses would appear). In one embodiment, a unified display may be used. As a non-limiting example, each display 30 and 32 may include a transparent lens onto which the augmented or virtual reality image 24 may be overlaid. In one embodiment, the displays 30 and 32 may be display surfaces that may include features (e.g., circuitry, lights) located adjacent their respective peripheries configured to overlay the augmented or virtual reality image 24.

[0028] Additionally or alternatively, displays 30 and 32 may include opaque liquid crystal displays (LCDs), opaque organic light emitting diode (OLED) displays, or other similar displays that aid in displaying real world images 22 and augmented or virtual reality images 24 to user 12. In one embodiment, each display 30 and 32 may include a transparent (e.g., see-through) LED display or a transparent (e.g., see-through) OLED display that aids in making visible to user 12 the augmented or virtual reality images 24 that appear, for example, on each display 30 and 32 as an overlay on an actual physical environment (e.g., an amusement park-related attraction, or the interior of a passenger ride vehicle). As described in more detail below, such a configuration may also enable user 12 to view layers of other virtual images that appear on other displays.

[0029] The cameras 34 and 36 of the wearable visualization device 14 may each correspond to the viewpoint of the user 12 and may be used to capture real-time video data (e.g., live video) or ambient light signals of the physical environment. In one embodiment, a single camera may be used. The wearable visualization device 14 may also include an additional camera that tracks the user's eye movements, which may be useful, among other things, in embodiments where virtual features are projected directly onto the eyes of the user 12. A communication capability 38 (e.g., including a wireless transmitter) of the wearable visualization device 14 may transmit real-time data (e.g., video data, eye-tracking data) captured through the respective cameras 34 and 36 to the processor 26 and / or computer graphics generation system 40 for processing.

[0030] As shown, the wearable visualization device 14 can be communicatively coupled to a computer graphics generation system 40 (e.g., a server in an amusement park) via a wireless network 42 (e.g., wireless local area network [WLAN], wireless wide area network [WWAN], near field communication [NFC]). However, in other embodiments, real-time video data captured through the respective cameras 34 and 36 can also be processed on the wearable visualization device 14 via the processor 26. Additionally, communication capabilities 38 (e.g., wireless transceiver, input / output connectors) connected to the processor 26 can also enable firmware and / or software contained on the processor 26 and memory 28 to be updated and / or configured for a particular application. In one embodiment, the wireless network 42 can communicatively couple all or some of the components of the AR / VR system 10.

[0031] Other features of the wearable visualization device 14 can transmit orientation data, position data, viewpoint data (e.g., focal length, orientation, pose), motion tracking data, etc., acquired and / or derived based on data acquired via sensors in the wearable visualization device 14. Such sensors can include orientation and position sensors (e.g., accelerometers, magnetometers, gyroscopes, Global Positioning System [GPS] receivers), motion tracking sensors (e.g., electromagnetic and solid-state motion tracking sensors), inertial measurement units (IMUs), etc.

[0032] In some embodiments, a monitoring system 41 (e.g., one or more cameras) can monitor features (e.g., geometric features or marks) of the wearable visualization device 14 to determine the position, location, orientation, etc. of the wearable visualization device 14 and, in turn, of the user 12. The monitoring system 41 can be communicatively coupled to the computer graphics generation system 40 and can be used to identify the position, location, orientation, etc. of the user 12 (or multiple users).

[0033] The computer graphics generation system 40 includes processing circuitry 43, such as a processor 44 (e.g., a general-purpose processor or other processor), and memory 46, and can process real-time video data (e.g., live video), orientation and position data, viewpoint data, or any combination thereof, received from the wearable visualization device 14 and the monitoring system 41. Specifically, the computer graphics generation system 40 can use this data to generate a frame of reference for aligning the augmented or virtual reality image 24 with a physical environment, such as the generated real-world image 22. Specifically, the graphics generation system 40 can then use the generated frame of reference based on the orientation data, position data, viewpoint data, motion tracking data, etc., to render a view of the augmented or virtual reality image 24, and in one embodiment, the real-world image 22, that is aligned in time and space with what the user 12 would perceive if not wearing the wearable visualization device 14. The graphics generation system 40 can continually (e.g., in real-time) update the rendering of the real-world image to reflect changes in the orientation, position, and / or movement of each user 12. In some embodiments, the computer graphics generation system 40 may track such data corresponding to multiple users 12 (e.g., passengers in a passenger vehicle), each user 12 (or at least some of the users 12) having a corresponding wearable visualization device 14.

[0034] As mentioned above, the wearable visualization device 14 includes multiple components and may generally include electronic glasses 16 configured to be worn on the head of the user 12. A variety of different configurations and implementations of the electronic glasses 16 may be used, having different sizes and shapes to better accommodate different sizes of different users 12, and may have different internal components (e.g., communications capabilities, transducers, displays) to accommodate different implementations.

[0035] The mounting portion 18 of the wearable visualization device 14 can take a variety of forms to provide additional flexibility and support to the electronic glasses 16, example embodiments of which are shown in FIGS. 2 and 3. In FIG. 2, the wearable visualization device 14 includes a headband as the mounting portion 18. Such embodiments of the mounting portion 18 can include a variety of materials configured to accommodate the movements of the user 12 while providing comfort to the user 12 (e.g., elastic materials, sweat-wicking materials, padding). It is currently recognized that it is desirable for the mounting portion 18 and the electronic glasses 16 to be separate so that the mounting portion 18 can be cleaned without risk to the processing circuit 25 (FIG. 1) of the wearable visualization device 14. However, in some implementations, the mounting portion 18 can also include one or more electronic components of the processing circuit 25. In such embodiments, the electronic components of the mounting portion 18 can be substantially sealed off from the environment to avoid damage.

[0036] 2 includes a receptacle region 60 configured to receive the electronic glasses 16 and maintain the position of the electronic glasses 16 relative to the eyes of the user 12 (FIG. 1) during use. In this regard, in one embodiment, the receptacle region 60 may include a central portion 62 that may be secured around the periphery of the displays 30, 32 (FIG. 1) of the electronic glasses 16, and side portions 64 that are configured to surround (e.g., partially or completely) the arms 66 of the electronic glasses 16.

[0037] The central portion 62 of the receptacle area 60 may include padding to allow for comfort for the user 12, and the headband may provide an appropriate compressive force (e.g., to maintain the position of the electronic glasses 16) against the head of the user 12. In one embodiment, the central portion 62 may include one or more materials having a skin coefficient of friction that provides an appropriate combination of stability and comfort. For example, a gel material typically used in the nose area of ​​electronic glasses 16 may be suitable.

[0038] As shown in the embodiment of FIG. 3, the mounting portion 18 may include other features in addition to or instead of a headband. As shown, the mounting portion 18 includes a cap 70 that is worn over the head of the user 12, and features similar to the headband shown in FIG. 2. In some embodiments, as shown, the cap 70 may include a fastening region 72 that overlaps a headband portion 74. The fastening region 72 may include a closure mechanism, such as a hook-and-loop fastener, clasp, button, magnetic strip, or the like, that is configured to fasten the cap 70 to the headband portion 74. In this manner, the cap 70 may be separated from the headband portion 74, allowing them to be used and washed separately. In one embodiment, the headband portion 74 may be integrated into the cap 70 (e.g., sewn into the cap 70) so that the headband portion 74 cannot be easily removed from the cap 70.

[0039] The illustrated embodiment of the cap 70 includes a visor 76 that serves to protect the eyes of the user 12, the electronic glasses 16 and their associated displays 30, 32 (FIG. 1) from strong illumination sources, such as the sun and ceiling lighting. For example, the visor 76 may be particularly useful in embodiments in which the displays 30, 32 operate based on light reflection and / or are transparent or translucent. In such embodiments, the visor 76 may help to enhance the perceived visual contrast of the augmented or virtual reality image 24 (FIG. 1) against the background of the physical environment.

[0040] The embodiment of the wearable visualization device 14 shown in Figure 3 also includes a display cover 78 configured to be placed over the displays 30, 32 (Figure 1) of the electronic glasses 16. The display cover 78 can provide shading to the displays 30, 32 to protect them from physical abuse, provide a degree of opacity for enhanced contrast and visualization of the augmented or virtual reality images 24, light filtering, and the like. The display cover 78 can include any suitable fastening mechanism, such as clips 79 that are removable and configured to attach the display cover 78 to the electronic glasses 16. Other fastening mechanisms, such as temporary adhesives and / or hook-and-loop fasteners, can also be used.

[0041] Reference is now made to FIG. 4, which illustrates an embodiment of an AR / VR system 10 that may further include a fixed visualization device 80, which may be comprised of one or more transparent displays 82. It should be understood that the fixed visualization device 80 disclosed herein may be fixed and / or coupled to a structure, such as a passenger ride vehicle 86 or a wall of a building. The fixed visualization device 80 may be physically separate and distinct from the wearable visualization device 14. The fixed visualization device 80 may be used in place of or in combination with the wearable visualization device 14 of FIG. 1. Thus, the transparent display 82 may be used to replace or enhance the AR, VR and / or mixed reality experience generated by the wearable visualization device 14. In one embodiment, the fixed visualization device 80 may add an additional layer of augmented or virtual reality features that the user 12 may perceive.

[0042] In one embodiment, the transparent display 82 can be coupled to a passenger cabin 84 of a passenger ride vehicle 86. In view of the above, it may be useful to first describe an embodiment of a setting in which the AR / VR system 10 can be used within an amusement park 90, as shown generally in FIG. 4. As shown, the amusement park 90 can include a thrill ride 92, a mall 94 of amusement park amenities (e.g., games areas, hotels, restaurants, souvenir shops), and additional amusement park attractions 96 (e.g., Ferris wheel, dark rides). In some embodiments, the thrill ride 92 can include a roller coaster or other similar thrill ride 92, and thus can further include a path, such as a closed-loop track system 98 (e.g., miles of track 98) disposed around a surrounding physical environment 100 (e.g., park amenities 94, additional amusement park attractions 96). The track 98 can be provided as infrastructure along which the passenger ride vehicle 86 can travel, for example, when a passenger 102 (e.g., user 12 of FIG. 1) is riding the thrill ride 92. Although only one passenger 102 is shown in the illustrated embodiment, the passenger ride vehicle 86 may be configured to accommodate 1, 2, 3, 4, 5, or more than 6 passengers 102.

[0043] Thus, the track 98 may define the movement of the passenger ride vehicle 86. However, in one embodiment, the track 98 may be replaced with a control path that may control the movement of the passenger ride vehicle 86 via electronic, magnetic, or other similar system infrastructure other than the track 98. In other words, the ride path of the passenger ride vehicle 86 may not be physically constrained to a precise path, thereby allowing the passenger 102 a degree of control over the path of motion, view perspective, etc.

[0044] As the passenger ride vehicle 86 travels along the track 98, the passengers 102 may be provided with a moving tour of a physical environment 100 of the area surrounding or near the thrill ride 92. Additionally, the passenger ride vehicle 86 may pass by robotic devices (e.g., animatronic figures 97) that may be configured to mimic a human or animal, or to provide life-like characteristics to otherwise inanimate objects. The animatronic figures 97 may be positioned around a portion of the track 98 and configured to interact with the passengers 102 (e.g., to scare and / or surprise the passengers 102) as the passenger ride vehicle 86 travels along the track 98. The animatronic figures 97 may be powered by pneumatic motors, hydraulic motors, electric motors, or any additional means for actuating the animatronic figures 97. While the passengers 102 may find the thrill ride 92 to be a very enjoyable experience, it may be useful to enhance the ride experience of the passengers 102. In particular, rather than just physically viewing the physical environment 100, the additional amusement park attractions 96, and / or the animatronic figures 97 positioned around the track 98, it may be useful to provide the passengers 102 with additional AR, VR, or mixed reality experiences. These experiences may be provided using the wearable visualization device 14, the fixed visualization device 80, or both, as the passenger ride vehicle 86 moves along the track 98 of the thrill ride 92.

[0045] FIG. 5 illustrates an embodiment of the AR / VR system 10 in which a passenger 102 may use a fixed visualization device 80. As described above, the transparent display 82 of the fixed visualization device 80 may be a transparent LED display, a transparent OLED display, or any other display suitable for the application. The transparent display 82 may be substantially and / or completely transparent when not activated. Thus, in one embodiment, the transparent display 82 may be incorporated into a portion of the passenger cabin 84, such as a side panel 88, to create the illusion of a traditional window (e.g., glass window, acrylic window). Additionally or alternatively, the transparent display 82 may be coupled to any portion of the passenger ride vehicle 86 (e.g., front, rear, ceiling, floor). Thus, the passenger 102 may view the physical environment 100 through the transparent display 82 (e.g., through a traditional window, etc.). In one embodiment, the transparent display 82 may be activated (e.g., continuously or periodically at certain times) to be substantially and / or completely opaque to create the illusion that the passenger cabin 84 is completely enclosed by a solid wall or panel (e.g., lacking a traditional window).

[0046] In one embodiment, some virtual features can be superimposed on the surface of the transparent display 82. The passenger 102 can view the physical environment 100 through one or more lines of sight 110 that can be formed when the passenger 102 looks through the transparent display 82. The transparent display 82 can be used to superimpose an augmented or virtual reality image 112 onto the line of sight 110 of the passenger 102. In this way, the passenger 102 can feel that the virtual features blend into (e.g., are physically present in) the physical environment 100. For example, the transparent display 82 can be made to only partially obstruct the line of sight 110 of the passenger 102 (e.g., using a transparent screen) such that the physical environment 100 viewed by the passenger 102 is an actual environment with the augmented or virtual reality image 112 superimposed on the transparent screen of the transparent display 82. In one embodiment, the passenger 102 can view a real-time video of the physical environment with the superimposed virtual features on the transparent display.

[0047] In one embodiment, the fixed visualization device 80 can be operably coupled to a processing circuit 116, which can be coupled to the passenger ride vehicle 86. The processing circuit 116 can include a processor 118 (e.g., a general-purpose processor or other processor), a communication capability 119 (e.g., a wireless transceiver), and a memory 120. The processor 118 can be operably coupled to the memory 120 to execute instructions for performing the methods of the present disclosure, for example, generating real-world images 121 (e.g., real-time video of the physical environment 100) and / or augmented or virtual reality images 112. These instructions can be encoded in a program or code stored in a tangible, non-transitory computer-readable medium, such as the memory 120 and / or other storage devices. The processor 118 can be a general-purpose processor, a system-on-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration. In one embodiment, passengers 102 can view augmented or virtual reality images 112 and the surrounding physical environment 100 through the transparent display 82 as passenger ride vehicle 86 travels along track 98 of thrill ride 92. Processing circuitry 116 can be communicatively coupled to computer graphics generation system 40 (e.g., in the amusement park) via communications functionality 119 and / or wireless network 42. In one embodiment, processing circuitry 116 can operate independent of computer graphics generation system 40. As described in more detail herein, fixed visualization device 80 can be operatively coupled to processor 26 (FIG. 1) of wearable visualization device 14 (FIG. 1), such that augmented or virtual reality images 112 of fixed visualization device 80 can be synchronized and / or coordinated with augmented or virtual reality images 24 (FIG. 1) of wearable visualization device 14.

[0048] In one embodiment, real-time video data (e.g., live video data) may be received from a camera 122 coupled to the exterior of the passenger ride vehicle 86. Although only one camera 122 is shown in the illustrated embodiment, the passenger ride vehicle 86 may support one, two, three, four, five, six or more cameras 122 to capture real-world images 121 of the physical environment 100 surrounding the passenger ride vehicle 86. The processing circuitry 116 may process the real-time video data to generate and display the real-world images 121 on the transparent display 82. In one embodiment, the real-world images 121 may be pre-recorded and stored in the memory 120 of the processing circuitry 116. The processing circuitry 116 may also collect orientation and position data, viewpoint data, or any combination thereof received from the camera 122 and / or additional sensors 124 that may be coupled to the passenger ride vehicle 86. Specifically, the processing circuitry 116 can use this data to generate a frame of reference that can align, synchronize, and / or coordinate the generated augmented reality or virtual reality image 112 with the real-world image 121 and / or physical environment 100 that the passenger 102 can see through their line of sight 110.

[0049] For example, the processing circuitry 116 may use data collected by the camera 122 and / or the sensor 124 to generate a real-world image 121 of the physical environment 100 on the transparent display 82. Specifically, the processing circuitry 116 may use a frame of reference generated based on the orientation data, position data, viewpoint data, motion tracking data, etc. to render a view of the augmented or virtual reality image 112, and in one embodiment, the real-world image 121, that is aligned in time and space with what the passenger 102 would perceive if viewing the surrounding environment through a traditional window (e.g., a glass window). The processing circuitry 116 may continually (e.g., in real time) update the rendering of the augmented or virtual reality image 112 and / or the real-world image 121 to reflect changes in the orientation, position, and / or movement of the line of sight 110 of each of the passengers 102.

[0050] Additionally or alternatively, the processing circuitry 116 may augment the physical environment 100 or a real-world image 121 of the physical environment 100 to enhance the ride experience of the passengers 102 (e.g., modify the physical environment 100 to match the theme of the track 98). For example, the transparent display 82 may render dripping rain or falling snow to augment the view of the physical environment 100 through the transparent display 82. In one embodiment, the transparent display 82 may partially or completely cover the view of the physical environment 100 with an augmented reality or virtual reality image 112 of a fictional setting (e.g., a jungle, space, etc.).

[0051] The processing circuitry 116 may control the timing of ride effects or elements (e.g., animatronic figures 97) that may interact with passengers 102. In one embodiment, the timing of ride effects may be controlled by the computer graphics generation system 40, a separate ride control system 126, or a combination of both. The ride effects may be synchronized and / or coordinated with augmented or virtual reality images 112 displayed on the transparent display 82 as the passenger ride vehicle 86 travels along the track 98. By synchronizing and / or coordinating the ride effects with the augmented or virtual reality images 112, the immersive experience of the thrill ride 92 may be enhanced for the passengers 102.

[0052] The ride effects can be configured to interact with the passenger ride vehicle 86 as it travels along the track 98 of the thrill ride 92. For example, in one embodiment, the animatronic figure 97 can momentarily block the track 98 in front of the passenger ride vehicle 86, creating the illusion that the passenger ride vehicle 86 may collide with the animatronic figure 97. In one embodiment, the animatronic figure 97 (e.g., a dragon) can be configured to create the illusion of attacking the passenger ride vehicle 86 (e.g., spitting fire in the direction of the passenger ride vehicle 86). While the passengers 102 can find the interaction with the animatronic figure 97 to be a very thrilling experience, in one embodiment, it can be useful to enhance the passenger's ride experience through augmented or virtual reality images 112 that can be synchronized and / or coordinated with the movements of the animatronic figure 97.

[0053] For example, in one embodiment, the transparent display 82 may superimpose glass cracks 128 or damage 130 (e.g., discoloration or charring from fire) onto the line of sight 110 of the passenger 102, thereby further enhancing the realism of the animatronic figure 97 as perceived by the passenger 102. In one embodiment, the transparent display 82 may superimpose condensation 132 (e.g., from an animal's breathing) onto the line of sight 110, creating the illusion that the passenger 102 feels that the animatronic figure 97 is very close to the passenger ride vehicle 86. Additionally or alternatively, the realism of the special effects may be enhanced by generating any desired augmented or virtual reality image 112 on the transparent display 82. For example, the augmented or virtual reality image 112 may include jumping bugs, hail damage, and / or a dust cover to enhance the realism of the thrill ride 92.

[0054] FIG. 6 illustrates an embodiment of the AR / VR system 10 in which a passenger 102 is simultaneously using the wearable visualization device 14 of FIG. 1 and the fixed visualization device 80 of FIG. 5. As described above, the wearable visualization device 14 can be used in conjunction with the fixed visualization device 80 to enhance the immersive AR, VR, and / or mixed reality experiences of the passenger 102. For example, in one embodiment, the wearable visualization device 14 can be used to enhance the physical environment 100 within the cabin 84 by superimposing virtual features, such as augmented or virtual reality images 24, onto the eyes of the passenger 102. Thus, the wearable visualization device 14 can create a non-realistic environment 20 within the cabin 84 of the passenger ride vehicle 86. In one embodiment, the transparent display 82 can enhance the physical environment 100 outside the cabin 84 by superimposing virtual features, such as augmented or virtual reality images 112, onto the line of sight 110 of the passenger 102. In this manner, the passenger 102 may simultaneously or cooperatively view the augmented or virtual reality image 24 on the wearable visualization device 14 and the augmented or virtual reality image 112 on the transparent display 82 of the stationary visualization device 80. Alternatively, the wearable visualization device 14 may create an unrealistic environment 20 outside the passenger compartment 84 of the passenger ride vehicle 86. In this manner, the transparent display 82 may overlay virtual features in the foreground while the wearable visualization device 14 augments detail in the background.

[0055] In one embodiment, the transparent display 82 may show representations such as glass cracks 128, breaks 130, and / or condensation 132 that appear to affect the exterior of the passenger vehicle 86. In one embodiment, the wearable visualization device 14 may further create the illusion that the representations (e.g., moisture or condensation 132) are entering the passenger vehicle 84. This may create multiple layers of virtual features within the AR, VR, mixed reality, computer-assisted reality, or combinations thereof. Although only two layers are shown in the illustrated embodiment, the AR / VR system 10 may be configured to generate one, two, three, four, five, or more layers of virtual features with which the passenger 102 may interact. For example, multiple transparent displays 82 may be coupled to the passenger vehicle 86 in a series of layers (e.g., stacked on top of each other) such that each transparent display 82 may generate a layer of virtual features within the passenger vehicle 86's passenger vehicle cabin 84.

[0056] For example, the passenger 102 may view through electronic glasses 16 ( FIG. 1 ) of the wearable visualization device 14, which may generate a first layer of virtual features (e.g., augmented or virtual reality images 24). Additionally, the passenger 102 may view (e.g., through electronic glasses 16 of the wearable visualization device 14) a transparent display 82 of the stationary visualization device 80, which may generate a second layer of virtual features (e.g., augmented or virtual reality images 112). The AR / VR system 10 may be configured to generate the first layer of virtual features, the second layer of virtual features, the further layer of virtual features, or any combination thereof to provide the passenger 102 with an AR experience, a VR experience, and / or a mixed reality experience.

[0057] Thus, in one embodiment, the AR / VR system 10 can change the surrounding physical environment 100 (e.g., amusement park 90) perceived by the passengers 102 through augmented or virtual reality images 112 generated by the fixed visualization device 80, and the wearable visualization device 14 can be used to create the unrealistic environment 20 within the cabin 84. In one embodiment, the wearable visualization device 14 can further change the surrounding situational physical environment 100 in combination with or in place of the transparent display 82.

[0058] The augmented or virtual reality images 24 and / or 112 of the wearable visualization device 14 and the fixed visualization device 80 may be synchronized and / or coordinated, respectively, by the processor 26 of the wearable visualization device 14 (FIG. 1), the processor 44 of the computer graphics generation system 40 (FIG. 1), the processor 118 of the fixed visualization device 80, an additional external processor (e.g., in the vehicle control system 126), or any combination thereof. The synchronization and / or coordination may involve adjusting the frame of reference of the virtual features based on orientation data, position data, viewpoint data, motion tracking data, or additional data collected by the AR / VR system 10.

[0059] Processor 26, 44, 118, or any combination thereof, may communicate over wireless network 42 to further synchronize and / or coordinate the augmented or virtual reality images 24 and / or 112 with the ride effects (e.g., animatronic figure 97). In one embodiment, a separate computer synchronization system (e.g., ride control system 126) may also be used to synchronize and / or coordinate the augmented or virtual reality images 24 and / or 112 with the ride effects.

[0060] In one embodiment, the processing circuitry 116 of the fixed visualization device 80 can free up some of the processing power that may be required by the processing circuitry 25 (FIG. 1) of the wearable visualization device 14. The processing circuitry 116 of the fixed visualization device 80 can have fewer space constraints than the processing circuitry 25 of the wearable visualization device 14. As such, the processing circuitry 116 of the fixed visualization device 80 can implement a larger and / or more powerful processor 118. Thus, the transparent display 82 can generate and display most of the augmented or virtual reality images 112 required during the thrill ride 92, whereas the wearable visualization device 14 can only generate fine details (e.g., form the unrealistic environment 20 within the cabin 84).

[0061] Also, the fixed visualization device 80 may render some virtual features more efficiently than the wearable visualization device 14. For example, as part of the special effects of the thrill ride 92, it may be desirable to create the illusion that the animatronic figure 97 has imparted features 136 (e.g., drilled holes) into the windows of the passenger compartment 84 of the passenger ride vehicle 86. In one embodiment, the fixed visualization device 80 may be used to create the illusion that the windows (e.g., the transparent display 82) of the passenger compartment 84 have imparted features 136. To impart such features 136 via the wearable visualization device 14 requires that the wearable visualization device 14 continually capture real-world images 22 and / or update the location of the features 136 on the electronic glasses 16, which may require significant processing power. For example, ensuring that the feature 136 remains stationary (e.g., the hole does not move relative to the cabin 84 window) as the passenger's 102 viewpoint changes (e.g., the passenger 102 turns or moves relative to the window) may require the wearable visualization device 14 to continually capture real-world images 22 and / or update the location of the feature 136 on the electronic glasses 16. In such cases, it may be more efficient to provide the feature 136 via a fixed visualization device 80.

[0062] In one embodiment, the AR / VR system 10 can instead provide the feature 136 on the transparent display 82. In one embodiment, the AR / VR system 10 can use the electronic glasses 16 to superimpose an augmented or virtual reality image 24 of details that may be related to the feature 136 (e.g., glass shards from a hole in a window) onto the passenger's 102 eyes such that the details appear in the appropriate location relative to the feature 136. Thus, in one embodiment, the wearable visualization device 14 can generate only fine augmented or virtual reality images 24 (e.g., fine details such as glass shards), whereas the fixed visualization device 80 can generate most of the augmented or virtual reality image 112 that includes features that remain stationary relative to the passenger ride vehicle 86 (e.g., feature 136 such as a hole). In operation, the passenger 102 can view the interior of the passenger cabin 84 and the feature 136 generated by the transparent display 82 through the substantially transparent electronic glasses 16 (FIG. 1). Thus, the position of feature 136 relative to a window (e.g., transparent display 82) of the passenger ride vehicle 86 can remain constant regardless of the orientation and / or viewpoint of the passenger 102. This can substantially reduce the processing power required by the wearable visualization device 14 compared to using the wearable visualization device 14 to generate features such as feature 136. Thus, the combination of the wearable visualization device 14 and the fixed visualization device 80, and the coordination of these devices 14, 80 by the AR / VR system 10, provides a more dynamic and efficient system that overcomes the challenges associated with using the wearable visualization device 14 alone to provide AR, VR and / or mixed reality experiences for the passenger 102.

[0063] In one embodiment, the augmented or virtual reality images 24 generated by the wearable visualization device 14 and the augmented or virtual reality images 112 generated by the fixed visualization device 80 may be synchronized and / or coordinated as the passenger ride vehicle 86 travels through the thrill ride 92, allowing the virtual features experienced by the passenger 102 to feel more realistic than if the wearable visualization device 14 or the fixed visualization device 80 were used alone. For example, animated features (e.g., explosions) may be incorporated as part of the theme of the thrill ride 92. The animated features may be first generated by the transparent display 82 and superimposed on the surrounding physical environment 100 as viewed by the passenger 102. The transparent display 82 may then create the illusion of a feature such as a crack 128 in a window (e.g., the transparent display 82), followed by the illusion of the window shattering (e.g., by generating glass shards). The wearable visualization device 14 can then create the illusion of debris (e.g., glass shards) floating within the passenger compartment 84 of the passenger ride vehicle 86. The wearable visualization device 14 and the fixed visualization device 80 can thus provide the passenger 102 with a multi-layered augmented or virtual reality experience.

[0064] 7 is a flow diagram of an embodiment of a process 140 for providing AR / VR enhancements to amusement park guests (e.g., passengers 102). Process 140 may be useful in providing AR, VR and / or mixed reality experiences during an amusement park experience, such as thrill rides 92. Process 140 represents start code or instructions stored in a non-transitory computer readable medium (e.g., memory 28, 46, 120) and may be executed, for example, by processor 26 of wearable visualization device 14, processor 44 of computer graphics generation system 40, and / or processor 118 of stationary visualization device 80. Processors 26, 44 and / or 118 may be communicatively coupled via a network, such as wireless network 42, to receive and transmit instructions as described below.

[0065] Process 140 may begin at block 142 with generating AR / VR enhancements (e.g., virtual features), such as an augmented or virtual reality image 24, 112. The AR / VR enhancements may be provided by the wearable visualization device 14, the fixed visualization device 80, an additional visualization device, or any combination thereof. The AR / VR enhancements may be generated by the processing circuitry 25 of the wearable visualization device 14, the computer graphics generation system 40, the processing circuitry 116 of the fixed visualization device 80, or any combination thereof.

[0066] In one embodiment, the wearable visualization device 14 can include a transparent or semi-transparent display surface (e.g., displays 30, 32) to project the augmented or virtual reality image 24 to the eyes of the passenger 102. Additionally or alternatively, as described in more detail below, the stationary visualization device 80 can also be configured to include a transparent or semi-transparent display surface (e.g., transparent display 82) to display the augmented or virtual reality image 112 in the line of sight 110 of the passenger 102. For example, the augmented or virtual reality image 112 can occlude a portion of the line of sight 110 of the passenger 102 (e.g., the passenger 102 can still see a portion of the physical environment 100 through the transparent display 82), creating the illusion that the augmented or virtual reality image 112 is part of the physical environment 100.

[0067] Referring now to block 144, the process 140 may include one or a series of steps in which the wearable visualization device 14 may overlay or superimpose one or more augmented or virtual reality images 24 onto the physical environment 100 (e.g., via the displays 30, 32) to generate a first layer of virtual features viewed by the passenger 102. For example, the processor 26, 44, 118 may generate the first layer of virtual features by overlaying or superimposing the augmented or virtual reality images 24 onto a transparent or semi-transparent viewing surface (e.g., the displays 30, 32) through which the passenger 102 can view the physical environment 100. In one embodiment, the wearable visualization device 14 may occlude only a portion of the displays 30, 32 with the augmented or virtual reality images 24 while the passenger 102 can view the physical environment 100 through a transparent portion of the displays 30, 32. In one embodiment, the processor 26, 44, 118 may generate and / or overlay augmented reality or virtual reality images onto a video data stream of a real-world image 22 (e.g., facility 94, physical environment 100) using one or more video integration and / or optical integration techniques.

[0068] Referring now to block 146, the process 140 may include one or a series of steps in which the fixed visualization device 80 may overlay or superimpose one or more augmented or virtual reality images 112 onto the physical environment 100 (e.g., via the transparent display 82) to generate a second layer of virtual features viewed by the passenger 102. For example, the processor 26, 44, 118 may generate the second layer of virtual features by overlaying or superimposing the augmented or virtual reality images 112 onto a transparent or semi-transparent display surface (e.g., the transparent display 82) through which the passenger 102 can view the physical environment 100. In one embodiment, the fixed visualization device 80 may occlude only a portion of the transparent display 82 with the augmented or virtual reality images 112 while the passenger 102 can view the physical environment 100 through the transparent display 82. In one embodiment, the processor 26, 44, 118 may generate an augmented or virtual reality image 112 and overlay it onto a video data stream of a real-world image 121 (e.g., facility 94, physical environment 100) using one or more video and / or optical integration techniques. In either case, the wearable visualization device 14 may generate a first layer of virtual features (e.g., via the augmented or virtual reality image 24) and the stationary visualization device 80 may generate a second layer of virtual features (e.g., via the augmented or virtual reality image 112). Additionally or alternatively, the AR / VR system 10 may be configured to generate one, two, three, four, five or more layers of virtual features.

[0069] Referring now to block 148, the process 140 may also include coordinating the display of the first layer of virtual features and the second layer of virtual features. The processors 26, 44 and / or 118 may synchronize and / or coordinate the first layer of virtual features and the second layer of virtual features to enhance the immersive experience and realism of the virtual effects perceived by the passengers 102 of the thrill ride 92. In one embodiment, image data from a camera other than the wearable visualization device 14 or a camera located on the passenger ride vehicle 86 may serve to facilitate the synchronization and / or coordination between the first layer of virtual features and the second layer of virtual features. Such synchronization and / or coordination may be useful to triangulate the position of the passengers 102 based on the known positions of some fixed features (e.g., the location of some attractions) for timing some special effects (e.g., real, augmented or simulated fireworks or explosions) and other effects described below.

[0070] In one embodiment, the processor 26, 44, 118 may receive and analyze real-time captured data, such as image data, position data, and / or input from other electronic devices. For example, with respect to image data, the processor 26, 44, 118 may receive real-time video data (e.g., live video) captured via the cameras 34, 36, 122 of the wearable visualization device 14 and / or the passenger ride vehicle 86. In one embodiment, this video may be used to generate real-world images 22 and 121, respectively, that may be displayed on the electronic glasses 16 or the transparent display 82. For example, the processor 26, 44, 118 may generate a video data stream of the physical environment 100 (e.g., an area of ​​the amusement park 90) to be displayed on the display 30, 320 of the wearable visualization device 14 and / or the transparent display 82 of the stationary visualization device 80.

[0071] In one embodiment, the processor 26, 44, 118 may render the first layer of virtual features and the second layer of virtual features based on any one or combination of factors, such as the position or location of the passenger ride vehicle 86 along the track 98 at a given time during a cycle of the thrill ride 92 (e.g., or other location when the track 98 is not present), the predetermined distance traveled by the passenger ride vehicle 86 after a predetermined time has elapsed during a cycle of the thrill ride 92, or after a passenger 102 of the passenger ride vehicle 86 has performed one or more actions.

[0072] In other embodiments, the wearable visualization device 14, computer graphics generation system 40 and / or fixed visualization device 80 may perform one or more geometric or photometric recognition algorithms on the video or image data captured via the cameras 34, 36, 122 to pinpoint the location of the passenger 102 and / or passenger ride vehicle 86. The wearable visualization device 14, computer graphics generation system 40 and / or fixed visualization device 80 may also use this data to control the timing of the augmented reality or virtual reality images 24, 112 relative to the ride effects (e.g., the animatronic figure 97) to synchronize and / or coordinate the first and second layers of virtual features with the ride effects.

[0073] While some embodiments relate to the use of the wearable visualization device 14 and / or the fixed visualization device 80 in the context of a thrill ride 92, it should be understood that the AR / VR system 10 can also be used outside of the thrill ride 92 and in any of a variety of environments. For example, the transparent display 82 can be coupled to a wall to represent a window in a room, and the electronic glasses 16 can be worn by a user 12 (e.g., passenger 102) when seated in and / or moving around the room to provide an immersive experience as disclosed herein.

[0074] While only certain features of the present disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes which comply with the true spirit of the present disclosure.

[0075] The technology presented and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that positively improve the art and are therefore not abstract, intangible, or purely theoretical. Moreover, if any claim appended at the end of this specification contains one or more elements designated as "means for [performing] ... [function]" or "step for [performing] ... [function]," such elements are to be construed pursuant to 35 U.S.C. 112(f). On the other hand, for any claim containing an element designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f). [Explanation of symbols]

[0076] 10 AR / VR Systems 14 Wearable visualization device 80 Fixed visualization device 82 Transparent Display 84 Rooms 86 Passenger vehicles 90 Amusement Park 92 Thrill Rides 94 Amusement park facilities mall 96 More Amusement Park Attractions 97 Animatronic Figures 98 orbit 100 Physical environment 102 passengers

Claims

1. 1. A system for providing an augmented reality and / or mixed reality experience to a user in a passenger ride vehicle, the system being configured to enable the user to view a real environment through a first display and a second display; a wearable visualization device configured to be worn by the user within the passenger ride vehicle, the wearable visualization device including the first display, the first display configured to display a first layer of virtual features such that the first layer of virtual features is superimposed on the real environment viewable by the user; a fixed visualization device coupled to the passenger ride vehicle, the fixed visualization device including the second display, the second display configured to display the second layer of virtual features such that the second layer of virtual features is superimposed on the real environment viewable by the user; a processor configured to generate the first layer of virtual features at a first display time and generate the second layer of virtual features at a second display time preceding the first display time; Equipped with the processor is configured to operatively communicate with the wearable visualization device and the stationary visualization device to coordinate the presentation of the first layer of virtual features and the second layer of virtual features with the real environment such that the second layer of virtual features provides a visual illusion of a special effect occurring outside the passenger ride vehicle and the first layer of virtual features provides an additional visual illusion of an animation effect occurring inside the passenger ride vehicle in association with the special effect. system.

2. 2. The system of claim 1, wherein the first display is a first transparent or translucent display and is configured to enable the user to view the second display through the first display when wearing the wearable visualization device, and the second display is a second transparent or translucent display.

3. 2. The system of claim 1, wherein the passenger ride vehicle is configured to travel along a route through an amusement park, and the real environment comprises elements of attractions of the amusement park surrounding the passenger ride vehicle, the elements being viewable by the user through the first display and the second display.

4. The system of claim 3 , wherein the processor is configured to coordinate the presentation of the first layer of virtual features and the second layer of virtual features with the element associated with the attraction.

5. the first layer of virtual features includes a virtual image of each first object within the interior of the passenger ride vehicle; The second layer of virtual features comprises: a virtual image of each of the passenger vehicle window features; and a respective virtual image of a second object external to the passenger ride vehicle; and Including, The system of claim 1 .

6. The system of claim 5 , wherein the first layer of virtual features includes a virtual image of each of additional objects external to the passenger ride vehicle.

7. 2. The system of claim 1, comprising one or more cameras or one or more sensors configured to monitor the real environment to facilitate coordinating the presentation of the first layer of virtual features and the second layer of virtual features with the real environment, and at least one of the one or more cameras or at least one of the one or more sensors is coupled to the passenger ride vehicle of the amusement park attraction.

8. 1. A system for providing an augmented reality and / or mixed reality experience to a user, the system being configured to enable the user to view a real environment through a first transparent display and a second transparent display; a passenger ride vehicle configured to travel a path during a ride at an amusement park; a wearable visualization device configured to be worn by the user within the passenger ride vehicle during the ride, the wearable visualization device comprising the first transparent display, the first transparent display configured to superimpose a first layer of virtual features onto the real environment viewable by the user; a fixed visualization device coupled to the passenger ride vehicle and comprising the second transparent display, the second transparent display configured to superimpose a second layer of virtual features onto the real environment viewable by the user; and a processor configured to generate a first layer of virtual features at a first display time instant, generate a second layer of virtual features at a second display time instant preceding the first display time instant, and coordinate the presentation of the first layer of virtual features and the presentation of the second layer of virtual features with each other and with vehicle effects of the ride; Equipped with the second layer of virtual features provides a visual illusion of damage to an exterior of the passenger ride vehicle during a portion of a ride cycle, and the first layer of virtual features provides an additional visual illusion of debris associated with the damage during a portion of the ride cycle. system.

9. 10. The system of claim 8, wherein the processor is configured to coordinate the presentation of the first layer of virtual features with the presentation of the second layer of virtual features based on a position of the passenger ride vehicle along the path.

10. 10. The system of claim 8, wherein the processor is configured to coordinate the presentation of the first layer of virtual features and the presentation of the second layer of virtual features with the vehicle effect by instructing the first transparent display to overlay the first layer of virtual features at a predetermined time during a ride cycle of the ride and instructing the second transparent display to overlay the second layer of virtual features at the predetermined time during the ride cycle of the ride.

11. 9. The system of claim 8, wherein the first layer of virtual features includes a virtual image of each piece of debris floating within a passenger compartment of the passenger vehicle, and the second layer of virtual features includes a virtual image of each crack formed on a window of the passenger compartment.

12. 10. The system of claim 8, wherein the second transparent display is configured to become opaque when activated, thereby providing the illusion of a passenger ride vehicle cabin being surrounded by a solid wall.

13. 1. A control method performed by a system for providing an augmented reality and / or mixed reality experience to a user, comprising: generating, using a processor, a first layer of virtual features and a second layer of virtual features; displaying the first layer of virtual features on a first display in response to instructions from the processor at a first display time, the first display being disposed within a wearable visualization device configured to be worn by the user within a passenger ride vehicle; displaying the second layer of virtual features on a second display in response to instructions from the processor at a second display time preceding the first display time; Including, the second display is physically separate from the wearable visualization device and is located within a fixed visualization device coupled to the passenger ride vehicle, the first display being configured to superimpose the layer of first virtual features onto the layer of second virtual features displayed by the second display such that the user can simultaneously view both the layer of first virtual features and the layer of second virtual features in a stack superimposed on a real environment viewable by the user through the first display and the second display; the processor is configured to coordinate the presentation of the first layer of virtual features and the second layer of virtual features to provide a visual illusion of damage to an exterior of the passenger ride vehicle through the second layer of virtual features at the second display time, and thereafter provide an additional visual illusion of debris associated with the damage at the first display time. Control methods.

14. 14. The method of claim 13, wherein the first layer of virtual features includes a first virtual image of a first object within a passenger vehicle cabin and the second layer of virtual features includes a second virtual image of a second object located outside the passenger vehicle or on a window of the passenger vehicle.

15. 14. The method of claim 13, wherein the passenger ride vehicle moves along a ride path in an amusement park, and the display at the first display time and the second display time results in the display of the first layer of virtual features and the second layer of virtual features coordinated with each other and with an animated figure along the ride path to provide the visual illusion of the damage caused by the animated figure.

16. 14. The method of claim 13, further comprising receiving, in the processor, signals indicative of the real environment from one or more cameras, the processor utilizing the signals to determine the first display instant and the second display instant to facilitate presentation of the first layer of virtual features and the second layer of virtual features in coordination with elements in the real environment.

17. 2. The system of claim 1, wherein the first display is configured to superimpose the first layer of virtual features onto the second layer of virtual features and the real environment such that the user can simultaneously view both the first layer of virtual features and the second layer of virtual features in a stack superimposed on the real environment.

18. 2. The system of claim 1, wherein the first layer of virtual features is rendered as non-stationary relative to the first display of the wearable visualization device and the second layer of virtual features is rendered as stationary relative to the second display of the fixed visualization device.

19. The system of claim 1 , wherein the special effect includes an explosion and the animation effect includes debris associated with the explosion.

20. The system of claim 8 , wherein the first layer of virtual features provides the additional visual illusion of debris within the interior of the passenger ride vehicle.

Citation Information

Patent Citations

  • Picture synthesis device and virtual reality device using the same

    JP1994176131A

  • Metallic mold for forming foam pattern

    JP1995108346A

  • Game device

    JP1995275510A

  • Head mounted video display system and device thereof

    JP1996160349A

  • Stereoscopic image display device, method thereof and recording medium

    JP1998333094A