Augmented Reality System for Entertainment Vehicles

The augmented reality system for amusement rides uses face and skeleton recognition sensors to enhance guest interaction by dynamically updating animations based on real-time detection, addressing the limitations of existing systems in presenting and interacting with augmented reality displays.

JP7702512B2Active Publication Date: 2025-07-03UNIVERSAL CITY STUDIOS LLC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024010268
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2018-12-06
Filing Date
2024-01-26
Publication Date
2025-07-03
Estimated Expiration
2039-08-29

AI Technical Summary

Technical Problem

Existing amusement rides face challenges in presenting images and interactions throughout the ride due to complexity, limiting guest engagement with augmented reality displays.

Method used

An augmented reality system for amusement rides that includes face and skeleton recognition sensors, presence sensors, and a controller to generate and update animations based on guest presence, body, and facial movements, enabling interactive experiences.

Benefits of technology

Enhances guest interaction and engagement by dynamically updating augmented reality animations based on real-time detection of guest presence, body, and facial features, providing immersive and interactive experiences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007702512000001
    Figure 0007702512000001
  • Figure 0007702512000002
    Figure 0007702512000002
  • Figure 0007702512000003
    Figure 0007702512000003
Patent Text Reader

Abstract

To provide, generally, an augmented reality system, and more specifically, an augmented reality system for an amusement ride.SOLUTION: An augmented reality system for an amusement ride includes a facial recognition sensor that detects a guest's face, a skeletal recognition sensor that detects a guest's body, a presence sensor that detects a guest's presence, and a controller. The controller includes a processor and a memory. The controller is configured to generate an augmented reality animation based on a first signal indicative of the guest's presence received from the presence sensor. In response to receiving a second signal indicative of the guest's body from the skeletal recognition sensor, the controller is configured to update the augmented reality animation based on the guest's body. Further, in response to receiving a third signal indicative of the guest's face from the facial recognition sensor, the controller is configured to update the augmented reality animation based on the guest's face.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure generally relates to augmented reality systems, and more particularly to augmented reality systems for amusement rides.

[0002] [Cross - Reference to Related Applications] This application claims the benefit and priority of U.S. Provisional Patent Application No. 62 / 735,754, filed on September 24, 2018, entitled "Augmented Reality System for Amusement Rides", the disclosure of which is hereby incorporated by reference in its entirety for all purposes.

Background Art

[0003] Generally, an amusement ride can include a ride vehicle and a ride path. The ride vehicle can move along the ride path and carry guests. An amusement ride can also include a display that can present certain images visible to guests along the ride path. For example, the display can present certain animations, videos, augmented reality images, and other images. For a particular ride, guests can interact with the display to control the images. However, due to the complexity of some amusement rides, the display may not be configured to present images to guests throughout the amusement ride. In addition, the ability of guests to interact with the displayed images on a particular amusement ride may be limited.

Summary of the Invention

[0004] Specific embodiments corresponding to the scope of the disclosed subject matter are summarized below. These embodiments are not intended to limit the scope of the present disclosure; rather, these embodiments are only intended to present an overview of certain disclosed embodiments. In fact, the present disclosure can encompass various forms that may be similar to or different from the embodiments described below.

[0005] In certain embodiments, an augmented reality system for an amusement ride includes a face recognition sensor that detects a guest's face, a skeleton recognition sensor that detects the guest's body, a presence sensor that detects the presence of the guest, and a controller. The controller includes a processor and a memory. The controller is configured to generate an augmented reality animation based on a first signal indicative of the presence of the guest received from the presence sensor. The controller is configured to update the augmented reality animation based on the guest's body in response to receiving a second signal indicative of the guest's body from the skeleton recognition sensor. Further, the controller is configured to update the augmented reality animation based on the guest's face in response to receiving a third signal indicative of the guest's face from the face recognition sensor.

[0006] The above and other features, aspects, and advantages of the present disclosure will be better understood by reading the following detailed description with reference to the accompanying drawings, in which like parts are designated by like reference numerals.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Best Mode for Carrying Out the Invention

[0008] Hereinafter, one or more specific embodiments of the present disclosure will be described. For the sake of brevity in describing these embodiments, not all features of actual implementations may be described herein. In the development of any such actual implementation, as seen in any engineering or design project, it should be understood that numerous implementation-specific decisions must be made to achieve the individual goals of the developer, such as compliance with system-related and business-related constraints that may vary depending on the implementation. Furthermore, such development efforts can be complex and time-consuming, but should be understood as routine endeavors of design, fabrication, and manufacture for those skilled in the art who benefit from the present disclosure.

[0009] When describing elements of various embodiments of the present disclosure, the articles "a", "an", "the", and "said" are intended to mean that there is one or more of the elements. The terms "comprising", "including", and "having" are inclusive and are intended to mean that there may be additional elements other than the recited elements. Any example of operating parameters and / or environmental conditions does not exclude other parameters / conditions of the disclosed embodiments.

[0010] Certain embodiments of the present disclosure include an amusement vehicle system having an augmented reality system. In certain embodiments, the amusement vehicle system and / or the augmented reality system includes sensors configured to detect a guest's face, body, presence, or a combination thereof while the guest is on the vehicle of the amusement vehicle system. For example, a face recognition sensor can detect the guest's face and / or body, a skeleton recognition sensor can detect the guest's body, and a presence sensor can detect the guest's presence within the vehicle. Each sensor can output a signal to a controller of the augmented reality system. Based on the signals received from the sensors, the augmented reality system can generate an augmented reality animation and provide the augmented reality animation to a display assembly disposed adjacent to and / or on the vehicle. For example, the display assembly can include a screen viewable by the guest. Thus, the augmented reality system and / or the amusement vehicle system can detect a guest's face, body, presence, or a combination thereof, generate an augmented reality animation, and display the augmented reality animation for viewing by the guest. In certain embodiments, the augmented reality system can continuously detect a guest's face, body, presence, or some combination thereof, generate and provide an augmented reality animation based on the guest's face, body, presence, or a combination thereof, and enable the guest to interact with and / or control the augmented reality animation through at least a portion of the amusement vehicle system.

[0011] In view of the above, embodiments of the present invention related to an augmented reality system can be used in any entertainment vehicle system. For example, FIG. 1 is a top view of an embodiment of an entertainment vehicle system 10. As illustrated, the entertainment vehicle system 10 includes a vehicle 12 having one or more seats 13. The vehicle 12 can generally travel along a vehicle path 14 in a direction 15 and can carry a guest 16 through the entertainment vehicle system 10. For example, the guest 16 can sit on the seat 13 and can be restrained by a seat restraint device 18 when the vehicle 12 moves through the entertainment vehicle system 10. The seat restraint device 18 can be a knee bar, a seat belt, an overhead restraint device, another type of seat restraint device, or a combination thereof. In the illustrated embodiment, the vehicle 12 includes four seats 13, but the vehicle 12 can include a different number of seats with other configurations. Additionally, in certain embodiments, the entertainment vehicle system 10 can include additional vehicles 12 (e.g., two vehicles 12, three vehicles 12, four vehicles 12).

[0012] As illustrated, the vehicle path 14 is a rail system having a track that defines the movement of the vehicle 12. However, in other embodiments, the vehicle path 14 can be a path along the floor of the entertainment vehicle system 10 or another system configured to transport and / or guide the vehicle 12. For example, the vehicle 12 can be an automobile, and the vehicle path 14 can be a path configured to guide the vehicle 12. Additionally, the vehicle 12 is shown with the guest 16 facing laterally towards the display assembly 20 and being substantially lateral (e.g., perpendicular) in the direction 15. In certain embodiments, the guest 16 can be positioned to face along the direction 15 such that the display assembly 20 is on the side of the guest 16. In certain embodiments, the guest 16 can change position while moving along the vehicle path 14 and / or while stopped on the vehicle path 14. For example, the guest 16 can change from the illustrated lateral position to a forward position and / or another position.

[0013] The display assembly 20 can be coupled to and / or mounted on the side surface of the vehicle 12 such that the display assembly 20 moves with the vehicle 12 when the vehicle 12 moves along the vehicle path 14. Additionally or alternatively, the display assembly 20 can be coupled to and / or mounted on the vehicle path 14 such that the vehicle 12 can pass by the display assembly 20 when the vehicle 12 moves in the direction 15 along the vehicle path 14. In some embodiments, the display assembly 20 can be disposed generally in front of the vehicle 12 along the direction 15 such that a guest 16 facing forward along the direction 15 can view the display assembly 20 forward.

[0014] The amusement vehicle system 10 includes an augmented reality system 22. As illustrated, the augmented reality system 22 includes four display assemblies 20, four face recognition sensors 24, four skeleton recognition sensors 26, and four presence sensors 28. However, in certain embodiments, the augmented reality system 22 can include more or fewer display assemblies 20, face recognition sensors 24, skeleton recognition sensors 26, and / or presence sensors 28. Additionally or alternatively, the augmented reality system 22 can include other forms of sensors and / or facilities capable of detecting a guest's head, body, presence, surroundings, or combinations thereof. In certain embodiments, the augmented reality system 22 can include all or part of the vehicle 12 and / or the vehicle path 14. For example, the augmented reality system 22 can include presence sensors 28 at each seat 13 of the vehicle 12.

[0015] As will be described in further detail below, the augmented reality system 22 can provide augmented reality images and animations for the guest 16 to view and / or interact with. The augmented reality animations can include graphics or animations overlaid on a captured image or animation of the guest 16 such that the graphics or animations appear to be part of the guest 16 within the augmented reality animation. Such graphics or animations can include replacing the guest's facial features with animated facial features (e.g., replacing the guest's nose and eyes with an animal's nose and eyes), replacing the guest's head with an animated head, replacing the guest's body with an animated body, and other modifications to the captured image or animation of the guest 16. In certain embodiments, the animation can be displayed over the entire display assembly 20. For example, in such embodiments, the entire augmented reality animation is animated and does not include the captured image of the guest 16 and / or the surroundings of the guest.

[0016] The face recognition sensor 24 is configured to detect the feature parts of the face of the guest 16. For example, one of the face recognition sensors 24 can be positioned in front of a specific guest 16 and can detect the feature parts of the face of that guest 16. The face recognition sensor 24 can also detect the feature parts of the skeleton of the guest 16. In a particular embodiment, the face recognition sensor 24 can be a camera (e.g., a red / green / blue (RGB) detection camera or a camera having similar detection capabilities) configured to detect face feature parts and / or skeletal feature parts. The face recognition sensor 24 can be disposed above the display assembly 20 and / or coupled to the display assembly 20. The face recognition sensor 24 can accurately detect the face feature parts of the guest and enable the guest 16 to interact with the augmented reality system 22 and / or the entertainment vehicle system 10. For example, while the guest 16 is viewing the augmented reality animation on the display assembly 20, the face recognition sensor 24 can continue to observe and detect the face feature parts of the guest and update the augmented reality animation on the display assembly 20 based on the changing face feature parts of the guest. The augmented reality animation can include replacing some or all of the face feature parts of the guest with animated face feature parts (e.g., replacing the guest's nose with an animated nose). Thus, the guest 16 can interact with and / or control the augmented reality animation via the face recognition sensor 24 by moving his or her face feature parts and / or head. In a particular embodiment, the face recognition sensor 24 can be attached to the vehicle 12 or another part of the entertainment vehicle system 10.

[0017] The skeleton recognition sensor 26 is configured to detect the skeleton feature part of the guest 16. For example, the skeleton recognition sensor 26 can be a depth sensor arranged in front of a specific guest 16 that can detect the head and / or body of the guest. The skeleton recognition sensor 26 can be a second camera arranged entirely above the display assembly 20, or another type of sensor configured to detect the head and / or body of the guest. The skeleton recognition sensor 26 can be arranged above the display assembly 20 and / or coupled to the display assembly 20 so that the skeleton recognition sensor 26 can accurately detect the head and / or body of the guest, enabling the guest 16 to interact with the augmented reality system 22 and / or the entertainment vehicle system 10 by moving his or her own head and / or body. For example, while the guest 16 is watching the augmented reality animation on the display assembly 20, the skeleton recognition sensor 26 can continue to observe and detect the head and / or body of the guest, and update the augmented reality animation on the display assembly 20 based on the changing head and / or body of the guest. The augmented reality animation can include replacing some or all of the facial feature parts of the guest with animated facial feature parts (for example, replacing the guest's nose with an animated nose). Therefore, the guest 16 can interact with and / or control the augmented reality animation via the skeleton recognition sensor 26 by moving his or her own head and / or body. In a specific embodiment, the skeleton recognition sensor 26 can be attached to the vehicle 12 or another part of the entertainment vehicle system 10.

[0018] The occupancy sensor 28 is configured to detect the presence of the guest 16 within the vehicle 12. For example, the vehicle 12 can include an occupancy sensor 28 corresponding to each seat 13. The occupancy sensor 28 can detect the presence of the guest 16 in the seat 13. For example, the occupancy sensor 28 can be a pressure sensor configured to detect the weight of the guest 16 in the seat 13. In a particular embodiment, the occupancy sensor 28 can be the seat restraint device 18 for the seat 13. For example, after the guest 16 sits on the seat 13, the seat restraint device 18 can be firmly fixed to indicate the presence of the guest 16 in the seat 13. After the occupancy sensor 28 detects the presence of the guest 16, the display assembly 20 can provide an augmented reality animation for the guest 16 to view. The augmented reality animation can include an animation that appears to be sitting on the seat 13 shown on the display assembly 20, or can include an animation that occupies the entire screen of the display assembly 20 (e.g., without showing a part of the surroundings of the vehicle 12 and / or the guest).

[0019] Additionally or alternatively, in a particular embodiment, the amusement vehicle system 10 and / or the augmented reality system 22 can include an animated figure (e.g., animatronics) instead of or in addition to the display assembly 20. Such an animated figure can be a robotic figure that can be controlled to mimic the movements of the guest. For example, the augmented reality system 22 can control the animated figure based on signals received from the face recognition sensor 24, the skeleton recognition sensor 26, and / or the occupancy sensor 28, and can enable the guest to interact with the animated figure and the augmented reality system 22. In some embodiments, the amusement vehicle system 10 and / or the augmented reality system 22 can replace the display assembly 20 with an animated figure based on signals received from the sensors and / or based on the position of the vehicle 12 along the vehicle path 14.

[0020] The entertainment vehicle system 10 and / or the augmented reality system 22 can include a control device 40. As illustrated, the control device 40 includes a processor 42 and a memory 44. In certain embodiments, the entertainment vehicle system 10 and / or the augmented reality system 22 can include additional control devices, additional processors, additional memories, or combinations thereof to perform various functions. For example, each display assembly 20 can include a control device configured to receive signals from various sensors, control the animations on the display assembly 20, and communicate with the control device 40 and / or combinations thereof. In some embodiments, the memory 44 of the entertainment vehicle system 10 and other memories can include one or more tangible non-transitory computer-readable media that store instructions executable by the processor 42 and / or data processed by the processor 42. For example, the memory 44 can include random access memory (RAM), read-only memory (ROM), rewritable non-volatile memory such as flash memory, a hard drive, an optical disk, other forms of memory, or combinations thereof. Further, the processor 42 of the entertainment vehicle system 10 and other processors can include one or more general-purpose microprocessors, one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), or some combination thereof.

[0021] The control device 40 can further include a user interface 46 that can facilitate communication between the control device 40 and a user (e.g., an operator). The user interface 46 can be disposed adjacent to or at a remote location from the entertainment vehicle system 10 in the case of a remotely controlled or autonomously operating entertainment vehicle system. For example, the user interface 46 can include one or more of buttons, a keyboard, a mouse, a track pad, etc. that enable user interaction with the control device 40. Further, the user interface 46 can include an electronic display that visually presents information via, for example, a graphical user interface (GUI), an application interface, text, a still image, video content, or a combination thereof. The user interface 46 can be configured to receive input from a user (e.g., an operator of the entertainment vehicle system 10 and / or the augmented reality system 22).

[0022] During operation, the control device 40 can receive various input signals from sensors via the processor 42 throughout the entertainment vehicle system 10 and / or the augmented reality system 22. For example, each of the face recognition sensor 24, the skeleton recognition sensor 26, and the presence sensor 28 can output a signal indicating their detected features (e.g., the detected face features of a guest, head, body, presence) to the control device 40. The signals output from the face recognition sensor 24, the skeleton recognition sensor 26, and the presence sensor 28 can be received by the processor 42 of the control device 40. In certain embodiments, each display assembly 20 can include a display control device that receives signals from the face recognition sensor 24, the skeleton recognition sensor 26, and the presence sensor 28. Further, the display control device can communicate with the control device 40 and / or generate and provide animations to be displayed for viewing by the guest 16.

[0023] As illustrated, each display assembly 20 is connected to and communicates with a control device 40 via a wired connection 48 (e.g., Ethernet, Universal Serial Bus (USB), canbus, ISObus). For example, each display assembly 20 can output a signal to the control device 40 via the wired connection 48 and receive a signal from the control device 40. Additionally or alternatively, each display assembly 20 can communicate with the control device 40 via a wireless connection. For example, each display assembly 20 can include a display transceiver that outputs a signal to and receives a signal from a control device transceiver of the control device 40. Each of the display transceiver and the control device transceiver can utilize any suitable wireless communication protocol, such as a standard protocol (e.g., Wi-Fi, Bluetooth®) or a proprietary protocol.

[0024] FIG. 2 is a front view of an embodiment of an augmented reality system 22. As illustrated, the augmented reality system 22 includes a display assembly 20, a face recognition sensor 24, a skeleton recognition sensor 26, and a presence sensor 28. The face recognition sensor 24 is configured to detect a guest's face and output a signal indicating the guest's face to the control device 40, the skeleton recognition sensor 26 is configured to detect a guest's body and output a signal indicating the guest's body to the control device 40, and the presence sensor 28 is configured to detect a guest's presence and output a signal indicating the guest's presence to the control device 40. In certain embodiments, the augmented reality system 22 can include additional display assemblies 20, additional face recognition sensors 24, additional skeleton recognition sensors 26, and additional presence sensors 28. Further, the guest 16 can be seated on the seat 13 of the vehicle 12 or standing within the vehicle 12.

[0025] An exemplary embodiment of the display assembly 20 includes a screen 50 that provides an augmented reality animation 52 for viewing by the guest 16. As illustrated, the augmented reality animation 52 includes a clown 54 that can be controlled by the guest 16 based on the guest's movement. In certain embodiments, the augmented reality animation 52 can include other images and animations in addition to or instead of the clown 54 (e.g., livestock, cartoons, characters).

[0026] In certain embodiments, the control device 40 can include instructions to generate and provide the augmented reality animation 52 displayed on the screen 50 based on signals received from the face recognition sensor 24, the skeleton recognition sensor 26, the presence sensor 28, or a combination thereof. For example, based on a first signal indicating the presence of the guest received from the presence sensor 28, the control device 40 can generate the augmented reality animation 52 and provide the augmented reality animation 52 for viewing by the guest 16 on the display assembly 20. The augmented reality animation 52 can be positioned on the screen 50 at a location generally corresponding to the position of the guest 16. However, in certain embodiments, the first signal indicating the presence of the guest itself does not enable interaction between the guest 16 and the specific or all augmented reality animations.

[0027] In response to receiving a second signal indicating the guest's body from the skeleton recognition sensor 26, the control device 40 can update the augmented reality animation 52 based on the guest's body. For example, first, as described above, the control device 40 receives a first signal indicating the presence of the guest, and then receives a second signal indicating the guest's body. The control device 40 can update the augmented reality animation 52 to mimic the movement of the guest's body. In a particular embodiment, when the control device 40 receives both a first signal indicating the presence of the guest from the presence sensor 28 and a second signal indicating the guest's body from the skeleton recognition sensor 26 simultaneously, the control device 40 can generate the augmented reality animation 52 based on the guest's body. For example, the augmented reality animation 52 can be an animation that mimics the movement of the guest 16. In this way, the control device 40 can enable the guest 16 to control the body of the augmented reality animation 52.

[0028] In response to receiving a third signal indicating the guest's face and / or body from the face recognition sensor 24, the control device 40 can generate or update the augmented reality animation 52 based on the guest's face and / or body. For example, when the control device 40 receives a first signal indicating the presence of the guest from the presence sensor 28, a second signal indicating the guest's body from the skeleton recognition sensor 26, and a third signal indicating the guest's face and / or body from the face recognition sensor 24, the control device 40 can generate the augmented reality animation 52 based on the guest's face and / or body. The augmented reality animation 52 can include a plurality of portions of a video feed (e.g., a video feed captured by the face recognition sensor 24) such as a captured image / captured video of the guest 16 around the vehicle 12 and / or the guest. Also, the augmented reality animation 52 can include an animation superimposed on the video feed such that the animation appears to be part of the guest 16 and / or part of the video feed. For example, the augmented reality animation 52 can include a plurality of portions of a captured video (e.g., a live video feed) of the guest 16 located inside the vehicle 12 and an animation that appears to be part of the guest 16 and / or part of the area around the guest. The animation can include replacing a part of the guest's facial features, a body part, the entire guest body, or a combination thereof. In this way, the control device 40 can enable the guest 16 to control the facial features and / or head of the augmented reality animation 52. In a particular embodiment, the control device 40 generates and provides the augmented reality animation 52 based on a second signal indicating the guest's body and a third signal indicating the guest's face and / or body, enabling the guest 16 to interact with and control the body and facial features of the augmented reality animation 52. Additionally, the control device 40 can update the augmented reality animation 52 previously generated based on the presence and / or body of the guest to include control of the facial features. The face recognition sensor 24 can continue to detect signals and output them to the control device 40 together with the skeleton recognition sensor 26 and the presence sensor 28.When the control device 40 receives each signal, the control device 40 generates and / or updates the augmented reality animation 52 based on the received signal.

[0029] In certain embodiments, the amusement ride system 10 may include elements that prevent a particular sensor from detecting a guest's features (e.g., face and body). For example, when the vehicle 12 travels along the ride path 14, elements of the amusement ride system 10 may prevent a particular one of the face recognition sensor 24 and the skeleton recognition sensor 26 from detecting and / or tracking each of the guest's features (e.g., face and body). If a given sensor (e.g., the face recognition sensor 24 or the skeleton recognition sensor 26) is unable to detect the guest 16, the control device 40 may generate and provide the augmented reality animation based on signals received from another sensor (e.g., the skeleton recognition sensor 26 or the presence sensor 28).

[0030] For example, if the control device 40 first receives a signal indicating the guest's body from the skeleton recognition sensor 26 and does not receive a signal indicating the guest's face from the face recognition sensor 24, the control device 40 can generate the augmented reality animation 52 based on the guest's body and provide it to the display assembly 20. Further, if the control device 40 receives a signal indicating the presence of the guest from the presence sensor 28 and does not receive a signal indicating the guest's face or a signal indicating the guest's body, the control device 40 can generate the augmented reality animation 52 based on the presence of the guest and provide it to the display assembly 20. However, after receiving a signal indicating the presence of the guest from the presence sensor 28, if the control device 40 receives a signal indicating the guest's face from the face recognition sensor 24 or a signal indicating the guest's body from the skeleton recognition sensor 26, the control device 40 generates an updated augmented reality animation 52 based on the newly received signal (e.g., a signal indicating the guest's face and / or body from the face recognition sensor 24 or a signal indicating the guest's body from the skeleton recognition sensor 26). In this way, the augmented reality animation 52 or the guest's ability to control the augmented reality animation 52 may change based on the signals received by the control device 40 from various sensors.

[0031] FIG. 3 is a front view of an embodiment of the augmented reality system 22. As illustrated, the augmented reality system 22 includes four display assemblies 20, four face recognition sensors 24, four skeleton recognition sensors 26, and four presence sensors 28. However, in certain embodiments, the augmented reality system 22 can include a greater number or a lesser number of display assemblies 20, face recognition sensors 24, skeleton recognition sensors 26, presence sensors 28, or combinations thereof. Further, each display assembly 20 can be controlled by an independent control device (e.g., the control device 40 of FIGS. 1 and 2) configured to provide an augmented reality animation 52 displayed on the display assembly 20. For example, the control device 40 can receive signals from a corresponding face recognition sensor 24, a corresponding skeleton recognition sensor 26, a corresponding presence sensor 28, or a combination thereof, and generate an augmented reality animation 52 based on the received signals. In certain embodiments, a single control device can receive signals from all of the sensors of the augmented reality system 22 and control all of the display assemblies 20.

[0032] In certain embodiments, the entertainment vehicle system 10 and / or the augmented reality system 22 can include a display assembly that displays a plurality of augmented reality animations. For example, a single display assembly can be viewable by a plurality of guests 16 and display an augmented reality animation 52 directed to each guest 16. The control device can generate a plurality of augmented reality animations 52 directed to each guest 16 and provide the plurality of augmented reality animations 52 to a single display assembly.

[0033] The control device of each display assembly 20 can provide various augmented reality animations 52 for each display assembly 20. For example, in the illustrated embodiment of FIG. 3, the augmented reality animations 52 displayed on each screen 50 are different. Guests who view and / or interact with the display assembly 20 can have various control levels with respect to the augmented reality animations 52 displayed on each display assembly 20. For example, a first guest positioned adjacent to the first display assembly 20A can, based on one of the corresponding face recognition sensors 24 capable of detecting the facial features and / or body of the first guest, control the movement of the facial features and / or body of the augmented reality animation 52 displayed on the first display assembly 20A. A second guest positioned adjacent to the second display assembly 20B can, based on one of the corresponding skeleton recognition sensors 26 capable of detecting the body of the second guest, control the movement of the body of the augmented reality animation 52 displayed on the second display assembly 20B. A third guest positioned adjacent to the third display assembly 20C can, based on the face recognition sensor 24 capable of detecting the facial features and / or body of the third guest and based on the skeleton recognition sensor 26 capable of detecting the body of the third guest, control both the movement of the body and the facial features of the augmented reality animation 52 displayed on the third display assembly 20C. A fourth guest positioned adjacent to the fourth display assembly 20D can view the augmented reality animation 52 displayed on the fourth display assembly 20D based on a presence sensor 28 capable of detecting the presence of the fourth guest (e.g., within the vehicle 12). In some embodiments, as described herein, some or all of the screen 50 can be replaced with an animated figure (e.g., animatronics) that generally mimics the movement of the guest.

[0034] Figure 4 is a flowchart of an embodiment of a method 60 for generating and / or updating the augmented reality animation 52 of FIGS. 2 and 3. Although shown in a particular order, the operations described with respect to method 60 can be performed in an order different from that illustrated and described, and in fact, such reordering of method 60 is to be noted as being encompassed by the present disclosure. Method 60 can be performed by the augmented reality system 22, for example, by the control device 40. The control device 40 can first receive an indication that the vehicle 12 of FIG. 1 has reached a position in front of and / or adjacent to the display assembly 20, as shown in block 62. For example, the control device 40 can receive this indication from a second control device of the amusement vehicle system 10. The second control device can be configured to track the position of the vehicle 12 along the vehicle path 14 and output a signal indicating the position of the vehicle 12 to the control device 40.

[0035] In a particular embodiment, the control device 40 can receive an indication that the vehicle sequence has started. The memory 44 of the control device 40 can store vehicle path data including information regarding the position of the vehicle along the vehicle path 14 as a function of time and / or other factors. The control device 40 can determine that the vehicle 12 has arrived at a position in front of and / or adjacent to the display assembly 20 based on the elapsed time and / or other factors. In a particular embodiment, block 62 of method 60 can be omitted since the indication that the vehicle sequence has started and / or the indication that the vehicle 12 has reached a position adjacent to the display assembly 20 is not necessarily used.

[0036] Next, the control device 40 can receive an indication of the guest 16 from any one of the face recognition sensor 24, the skeleton recognition sensor 26, and the presence sensor 28. For example, at block 64, the control device 40 can receive an indication of the presence of the guest from the presence sensor 28. At block 66, the control device 40 can receive an indication of the guest's body from the skeleton recognition sensor 26. At block 68, the control device 40 can receive an indication of the guest's face and / or body from the face recognition sensor 24.

[0037] Based on the received indication of the guest 16, the control device 40 can generate and / or update the augmented reality animation 52 and provide the generated and / or updated augmented reality animation 52 to each display assembly 20. For example, at block 70, the control device 40 can generate and / or update the augmented reality animation 52 based on the indication of the presence of the guest and provide it to the display assembly 20. The display assembly 20 can display the augmented reality animation 52 at a predetermined position for viewing by the guest 16 in response to the presence of the guest in the vehicle 12.

[0038] At block 72, based on the indication of the guest's body, the control device 40 can generate and / or update the augmented reality animation 52 and provide it to the display, enabling the guest 16 to view and interact with the augmented reality animation 52 displayed on the display assembly 20. The guest 16 can move their own body (e.g., head, arms, torso), and the control device 40 can update the augmented reality animation 52 to generally match the movement of the guest's body for the guest 16 to view. At block 74, based on the indication of the guest's face and / or body, the control device 40 can generate / update and provide the augmented reality animation 52, enabling the guest 16 to view and interact with the augmented reality animation 52 displayed on the display assembly 20. The guest 16 can move their own facial features (e.g., eyes, eyebrows, nose, mouth) and / or body, and the control device 40 can update the augmented reality animation 52 to generally match the movement of the guest's facial features and / or body (e.g., happy face, sad face, smiling face, eye movement, mouth movement, and other facial feature movements of the augmented reality animation 52) for the guest 16 to view.

[0039] The control device 40 can determine which indication to use to generate and / or update the augmented reality animation 52 based on the amount of interaction that the indication and the corresponding augmented reality animation 52 will enable for the guest 16. For example, if the control device 40 receives both an indication of the guest's presence from the presence sensor 28 (e.g., a signal indicating the guest's presence from the presence sensor 28) and an indication of the guest's face and / or body from the face recognition sensor 24, the control device 40 can generate and / or update the augmented reality animation 52 based on the guest's face and / or body. This enables the guest 16 to move their facial features and view an augmented reality animation 52 with similar movements, thereby enabling a greater interaction with the amusement vehicle system 10.

[0040] As another example, when the control device 40 receives both an indication of the presence of the guest from the presence sensor 28 and an indication of the body of the guest from the skeleton recognition sensor 26 at the same time, the control device 40 can generate and / or update the augmented reality animation 52 based on the body of the guest. Further, when the control device 40 receives both an indication of the body of the guest from the skeleton recognition sensor 26 and an indication of the face and / or body of the guest from the face recognition sensor 24, the control device 40 can generate and / or update the augmented reality animation 52 based on the face and / or body of the guest. In a particular embodiment, the control device 40 can generate and / or update the augmented reality animation based on the indication of the guest received from the skeleton recognition sensor 26 and the indication of the face and / or body of the guest received from the face recognition sensor 24, enabling the guest 16 to interact with the body and face of the augmented reality animation 52.

[0041] After generating and / or updating the augmented reality animation 52, the method 60 can proceed to query 76. At query 76, the control device 40 can determine whether the vehicle is still at a position in front of and / or adjacent to the display assembly 20. For example, the control device 40 can receive a signal from a second control device that the vehicle 12 is still at that position, or can determine that the vehicle 12 is still at that position based on information stored in the memory 44 of the control device 40. Based on the determination that the vehicle 12 is still at a position in front of and / or adjacent to the display assembly 20, the method 60 can return to any of blocks 64, 66, or 68. Thus, the control device 40 can continue to receive indications of the guest 16, and update the augmented reality animation 52 based on these indications.

[0042] As shown in block 78, the control device 40 can stop providing the augmented reality animation 52 to the display assembly 20 based on the determination that the vehicle 12 is not in a position in front of and / or adjacent to the display assembly 20. For example, the control device 40 can stop outputting a signal indicating the latest information augmented reality animation 52 to the display assembly 20. In response, the display assembly 20 can stop displaying the augmented reality animation 52. In this case, the control device 40 can cause the display assembly 20 to display a canned animation, a blank screen, or another feature prepared in advance.

[0043] The control device 40 can repeatedly execute each of blocks 64, 66, 68, 70, 72, 74 and query 76 to generate and provide the augmented reality animation 52 for the guest 16 to view. For example, after initially generating and providing the augmented reality animation 52, the control device 40 can receive additional signals from the face recognition sensor 24, the skeleton recognition sensor 26, the presence sensor 28, or a combination thereof, and update the augmented reality animation 52 to provide the updated augmented reality animation 52 to the display assembly 20. Thus, the control device 40 can update the augmented reality animation 52 based on the movement of the guest's body and / or facial features. The guest 16 can view each version of the augmented reality animation 52 and continue to move the augmented reality animation 52 by moving his or her own body and / or facial features. In this way, the guest 16 can interact with and / or control the augmented reality animation 52. Therefore, the augmented reality system 22 can provide an interactive environment that provides entertainment for the guest 16.

[0044] In this specification, only some features of the present disclosure have been illustrated and described, but many modifications and changes will occur to those skilled in the art. Therefore, it is to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the present disclosure.

[0045] The methods presented and claimed in this specification are referred to and applied to substantial objects and specific examples of a practical nature that clearly improve the technical field of the present invention, and for this reason, are not abstract, intangible, or truly theoretical. Further, if any claim appended at the end of this specification includes one or more elements designated as a "means for performing" a "function" or a "step for performing" a "function," such elements shall be construed in accordance with 35 U.S.C. § 112(f). However, for any claim that includes elements designated in any other way, such elements shall not be construed in accordance with 35 U.S.C. § 112(f).

Claims

1. A system for an amusement park attraction, the system comprising: A display assembly configured to be viewable by a guest of the amusement park attraction; A vehicle configured to carry the guest while the guest is at the amusement park attraction; One or more sensors configured to generate a signal indicative of movement of the guest's body while the guest is within the amusement park attraction; A control device; The control device is configured to: Command the display of an animation on the display assembly in response to the vehicle being within a defined area near the display assembly; Receive a signal from the one or more sensors; Adjust the animation based on the signal from the one or more sensors such that the animation responds to the movement of the guest's body. A system configured as such.

2. The system according to claim 1, further comprising one or more additional sensors configured to generate an additional signal indicative of the presence of the guest within the vehicle, wherein the control device is configured to command the display of the animation on the display assembly in response to receiving the additional signal indicative of the presence of the guest within the vehicle.

3. The system according to claim 1, wherein the control device is configured to command the display of a blank screen or a pre - prepared animation other than the animation while the vehicle is outside the defined area.

4. The system according to claim 1, further comprising one or more additional sensors configured to generate an additional signal indicative of the position of the guest within the vehicle, wherein the control device is configured to command the display of the animation on the display assembly corresponding to the position of the guest within the vehicle.

5. The system according to claim 1, wherein the signal indicates each movement of the guest's face, and the control device is configured to adjust the animation based on the signal such that the animation responds to each movement of the guest's face.

6. The system according to claim 1, wherein the animation includes an animation body, and the control device is configured to adjust the animation by moving the animation body so as to mimic the movement of the guest's body.

7. The system according to claim 6, wherein the signal indicates the movement of the arm of the guest's body, and the control device is configured to adjust the animation by moving each arm of the animation body so as to mimic the movement of the arm of the guest's body.

8. The display assembly is configured to be viewable by additional guests of the amusement park attraction, the one or more sensors are configured to generate the signal indicating the movement of each body of the additional guests while the additional guests are within the amusement park attraction, and the control device orders the display of additional animation on the display assembly, and adjusts the additional animation based on the signal from the one or more sensors such that the additional animation responds to the movement of each body of the additional guests. The system according to claim 1, which is configured as described above.

9. The system according to claim 1, wherein the control device is configured to receive an image of the guest and order the display of the animation combined with at least a first portion of the image on the display assembly.

10. A system for an amusement park attraction, the system comprising one or more sensors, the movement of the guest while the guest is in the vehicle of the amusement park attraction, and the position of the guest relative to the vehicle one or more sensors configured to generate a signal indicating the above, and a control device, wherein the control device receives a signal indicating the movement of the guest and the position of the guest relative to the vehicle, generates an animation that mimics the movement of the guest based on the signal and represents the position of the guest relative to the vehicle, and orders the display of the animation on the display assembly while the guest is in the vehicle of the amusement park attraction and the vehicle is within a defined area near the display assembly. A system configured as described above.

11. The vehicle is configured to carry the guest along a passenger route and near the display assembly in the amusement park attraction, the system according to claim 10.

12. The signal indicates the expression of the guest, and the control device is configured to generate an animation imitating the expression of the guest based on the signal, the system according to claim 10.

13. The control device is configured to command the display of an animation on the display assembly while the vehicle is at a defined position near the display assembly, and to command the display of a blank screen or a feature other than the animation while the vehicle is not at the defined position, the system according to claim 10.

14. A method of operating a system for an amusement park attraction, comprising: detecting, using one or more sensors, the movement of a guest while the guest is in the amusement park attraction; receiving, in a control device, a signal from the one or more sensors, the signal indicating the movement of the guest; generating, using the control device, an animation based on the signal such that the animation responds to the movement of the guest; commanding, using the control device, a display assembly to display the animation in response to the guest being within a defined area near the display assembly; The method.

15. The method according to claim 14, comprising transporting the guest in a vehicle through the amusement park attraction.

16. receiving, in the control device, an indication of the position of the vehicle within the amusement park attraction; determining, using the control device, that the guest is within the defined area based on the position of the vehicle within the amusement park attraction; The method according to claim 15.

17. The step of detecting the movement of the guest includes detecting the movement of the guest's arm such that the signal indicates the movement of the guest's arm, and the method includes generating the animation based on the signal such that the animation mimics the movement of the guest's arm, the method according to claim 14.

18. Using the control device, after the guest is within the defined area near the display assembly and then while the guest is outside the defined area near the display assembly, commanding the display assembly to display a screen with nothing other than the animation or a pre-prepared animation. The method according to claim 14, comprising this step.

19. Using the control device, commanding the display assembly to display the animation such that the animation appears to be seated on a seat of a passenger vehicle. The method according to claim 14, comprising this step.

20. Using the one or more sensors, detecting the presence of the guest within the passenger vehicle while the guest is at the amusement park attraction; In the control device, receiving an additional signal from the one or more sensors, the additional signal indicating the presence of the guest within the passenger vehicle; Using the control device, generating the animation based on the signal and the additional signal such that the animation appears to be seated on the seat of the passenger vehicle as shown on the display assembly in response to the movement of the guest; The method according to claim 14, comprising this.

Citation Information

Patent Citations

  • Motion-based attractions including video display assemblies

    JP2013512729A

  • Ferris wheel

    JP2017113295A

  • Experience ride representation apparatus and method for real-sense media service based on multi-vision

    US20150321107A1

  • Movable screen

    WO2015071693A1