Augmented reality systems for amusement rides
By using a combination of guest tracking sensors, projectors and translucent mirrors in the rides, generating a three-dimensional augmented reality image solves the problems of high cost and low operational efficiency of traditional equipment, providing an efficient and lightweight augmented reality experience, enhancing the Interactive and entertaining rides.
Patent Information
- Application Number
- CN201980086690.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-12-28
- Filing Date
- 2019-12-19
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2039-12-19
AI Technical Summary
Traditional augmented reality headsets are cost-effective and inefficient in use in recreational ride facilities, and guests need to wear the device to experience the augmented reality effect, which increases queue time.
Using an augmented reality system including guest tracking sensors, projectors, translucent mirrors and controllers, a three-dimensional augmented reality image is generated through projection and reflection technologies, allowing guests to experience the three-dimensional environment without wearing a head-mounted device.
Reduces equipment costs and operational complexity, reduces queueing time, provides a lightweight augmented reality experience, making the 3D image appear realistic through the Pepper phantom effect, and enhances the interactive and entertaining of the rides.
Smart Images

Figure CN113227884B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates generally to augmented reality systems, and more particularly to augmented reality systems for amusement rides. Background Art
[0002] In some cases, an amusement ride may include an augmented reality (AR)-based image that is displayed and can be viewed by a guest. For example, an amusement ride may include a display positioned adjacent to a guest. The display may output an AR image for viewing by the guest. For some rides, the AR image may be three-dimensional (3D). The guest may wear an augmented reality headset or helmet that enables the guest to properly view and experience the 3D AR image. However, conventional AR or 3D AR headsets and helmets for amusement rides may be expensive. In addition, the AR headset may need to be cleaned after use by each guest. Therefore, it is now recognized that conventional AR headsets may increase operating costs and other inefficiencies associated with amusement rides, and guests may experience increased queue times for amusement rides.
[0003] This section is intended to introduce the reader to various aspects of the art that may be related to various aspects of the present technology described and / or claimed below. It is believed that this discussion helps to provide the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Therefore, it should be understood that these statements are to be read in this context and not as an admission of the prior art. Summary of the invention
[0004] Some embodiments that are commensurate in scope with the disclosed subject matter are summarized below. These embodiments are not intended to limit the scope of the present disclosure, but these embodiments are only intended to provide a brief summary of certain disclosed embodiments. In fact, the present disclosure can encompass various forms that may be similar or different from the embodiments set forth below.
[0005] In an embodiment, an augmented reality system for an amusement ride includes: a guest tracking sensor that determines the location of a guest, a projector that projects an imagery, a semi-transparent mirror that reflects the imagery as an augmented reality imagery, and a controller including a processor and a memory. The controller receives a sensor signal indicating the location of the guest from the guest tracking sensor, generates image data based on the location of the guest, and outputs a control signal indicating the image data to the projector. The projector projects the imagery based on the control signal indicating the image data.
[0006] In an embodiment, a method for generating an augmented reality image of an amusement ride includes: receiving an indication of a location of a guest; and in response to receiving the indication of the location of the guest, generating image data based on the location of the guest. The method also includes projecting the image onto a semi-transparent mirror based on the image data; and reflecting the image toward the guest as an augmented reality image for viewing by the guest. When viewed through 3D eyewear, the augmented reality image appears as a three-dimensional (3D) image.
[0007] In an embodiment, an augmented reality system for an amusement ride includes: a guest tracking sensor that determines the location of a guest, a three-dimensional (3D) projector that projects an image, a semi-transparent mirror that reflects the image as an augmented reality image, 3D eyewear, and a controller including a processor and a memory. The controller receives a sensor signal indicating the location of the guest from the guest tracking sensor, generates image data based on the location of the guest, and outputs a control signal indicating the image data to the 3D projector, such that the control signal causes the 3D projector to project an image based on the image data onto the semi-transparent mirror. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] These and other features, aspects and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which like characters refer to like parts throughout the drawings, and in which:
[0009] Figure 1 is a perspective view of an embodiment of an amusement ride system having an augmented reality system according to aspects of the present disclosure;
[0010] Figure 2 It is used to generate and display augmented reality images. Figure 1 A front view of an embodiment of an augmented reality system;
[0011] Figure 3 yes Figure 1 A block diagram of an embodiment of an augmented reality system; and
[0012] Figure 4 According to aspects of the present disclosure, Figure 1 A flowchart of an embodiment of a process for an augmented reality system to generate and display an augmented reality image. DETAILED DESCRIPTION
[0013] One or more specific embodiments will be described below. In order to provide a concise description of these embodiments, not all features of the actual implementation are described in the specification. It should be understood that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer's specific goals, such as meeting system-related and business-related constraints, which may vary depending on the implementation. In addition, it should be understood that such development work may be complex and time-consuming, but it will still be a routine task of design, production and manufacturing for ordinary technicians who benefit from this disclosure.
[0014] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more elements. The terms "comprising," "including," and "having" are intended to be inclusive, and mean that there may be additional elements other than the listed elements. Additionally, it should be understood that reference to "one embodiment" or "an embodiment" of the present disclosure is not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.
[0015] In order to reproduce or simulate the augmented reality effect without using an augmented reality head-mounted device, the augmented reality system may include a projector that can project an image from a screen (or projection screen). The image can be reflected by a semi-transparent mirror as an augmented reality image. Guests can view the augmented reality image as a 3D image or a 3D environment using 3D eyewear (e.g., 3D glasses). The semi-transparent mirror can be positioned at an angle relative to the guest's face and the projector to produce a Pepper's ghost effect. The Pepper's ghost effect includes reflecting the image via a mirror so that the viewer can simultaneously view the 3D image on the mirror and the object on the opposite side of the mirror. The Pepper's ghost effect may make the 3D image appear to be covered on top of any object behind the semi-transparent mirror. In addition, the guest's head can be tracked, and the positioning of the guest's head relative to the semi-transparent mirror and the object behind the semi-transparent mirror can be used to update the 3D image displayed on the semi-transparent mirror. For example, as the guest moves their head, the 3D image may include a parallax effect that accurately moves portions of the 3D image relative to each other and relative to objects behind the semi-transparent mirror (e.g., portions of the 3D image that appear closer to the guest may move more than portions of the 3D image that appear farther away from the guest). In this way, an augmented reality effect may be generated that is viewable by the guest while wearing only lightweight 3D eyewear rather than an augmented reality head mounted device.
[0016] In view of the foregoing, the present embodiments related to augmented reality systems may be used in any amusement ride or attraction system. For example, Figure 11 is a perspective view of an embodiment of an amusement ride system 10 having an augmented reality system 12. As illustrated, the amusement ride system 10 includes the augmented reality system 12, a viewing area 14, and a performance area 16. The viewing area 14 provides an area for (one or more) guests of the amusement ride system 10 to stand and / or sit while the guests are positioned within the amusement ride system 10. As illustrated, a guest 18 is standing in the viewing area 14. The performance area 16 provides an area for (one or more) real or animate objects 20 within the amusement ride system 10 to perform. In the illustrated embodiment, the objects 20 include performers positioned within the performance area 16. The objects 20 (e.g., performers) within the performance area 16 are viewable from the perspective of the guests 18 and may include animate objects (e.g., performers), inanimate objects, machines (e.g., animated characters, vehicles, and other moving systems), and / or any other suitable objects that may be used in a performance. It should be understood that in some embodiments, the performance area 16 may not be present, or there may be no objects 20 positioned within the performance area 16. Furthermore, while the present disclosure relates to an amusement ride system 10, it should be understood that the disclosed embodiments may be applied to any suitable environment, such as a theater, show, or entertainment venue, where guests may stand or sit in relatively fixed positions, and not just in rides or vehicles where guests may be moving.
[0017] The augmented reality system 12 can generate and provide certain augmented reality effects within the amusement ride 10, including augmented reality images that appear to interact with certain parts of the amusement ride 10 (e.g., objects 20) from the perspective of the guest 18. As illustrated, the augmented reality system 12 includes a semi-transparent mirror 22, a projector 26, a guest tracking sensor 32, and a three-dimensional (3D) eyewear assembly 34. The projector 26 can project the image 36 that appears to be a 3D image or 3D environment when viewed through the 3D eyewear. For example, the projector 26 can be a 3D projector that projects a pair of 2D images (e.g., image 36) having a specific color scheme (e.g., red and blue, respectively). When viewed through the 3D eyewear 34, the 2D image can appear to be a 3D environment. In the illustrated embodiment, a single projector is used and is positioned below the semi-transparent mirror 22, which is angled to reflect the image from the projector 26. However, in other embodiments, multiple projectors in different orientations can be employed.
[0018] In the illustrated embodiment, projector 26 is at the same approximately vertical level as floor 28. However, in some embodiments, projector 26 may be located below floor 28, on the ceiling, on barrier 30, or in any other suitable positioning. In addition, projector 26 may be arranged to be approximately parallel to floor 28 of viewing area 14, and / or projector 26 may be arranged to be significantly lower than floor 28 (e.g., several meters lower than floor 28). In some embodiments, projector 26 may include any suitable type of display or screen, such as an LED (light emitting diode) display, an OLED (organic LED) display, or an LCD (liquid crystal display). As illustrated, projector 26 is arranged on the opposite side of barrier 30 relative to viewing area 14. When guest 18 is positioned in viewing area 14, barrier 30 may prevent projector 26 from being seen from the field of vision of guest 18.
[0019] The projector 26 may cause an augmented reality image 38 to appear on the semi-transparent mirror 22. For example, the semi-transparent mirror 22 may reflect the image 36 as the augmented reality image 38 for viewing by the guest 18. Thus, the augmented reality image 38 may include a reflected 2D image pair (e.g., the image 36) that appears to be a 3D environment from the perspective of the guest 18 wearing the 3D eyewear 34. Additionally, the semi-transparent mirror 22 may be semi-transparent, enabling the guest 18 to simultaneously view the augmented reality image 38 and the objects 20 in the performance area 16. The semi-transparent mirror 22 may be composed of glass or another suitable material that is capable of displaying (opaque) the augmented reality image 38 but otherwise remains transparent. As illustrated, the augmented reality image 38 includes scenery 39 (e.g., trees and bushes) and a bird 40. From the perspective of the guest 18, the object 20 may appear to be part of the augmented reality image 38 (or vice versa) and may appear to interact with the augmented reality image 38 (e.g., interact with the scenery 39 and / or the bird 40). For example, from the perspective of a guest 18 wearing 3D eyewear 34, object 20 may appear to be part of the 3D environment of augmented reality image 38. In some embodiments, augmented reality image 38 may include other types of images / objects (e.g., characters, weather, structures, vehicles, signs) in addition to or in lieu of scenery 39 and bird 40.
[0020] Image 36 is reflected by and / or projected onto semi-transparent mirror 22 as augmented reality image 38. Guest 18 may wear 3D eyewear 34 while positioned within amusement ride 10 and while viewing semi-transparent mirror 22. In certain embodiments, 3D eyewear 34 may be a wireless head mounted device that is easily donned and removed by guest 18 (e.g., 3D eyewear 34 may be a pair of 3D glasses that enable guest 18 to view a 3D environment). Guest 18 may easily don the 3D glasses before or after entering viewing area 14, may view the 3D environment of object 20 and augmented reality image 38 using 3D eyewear 34, and may easily remove the 3D glasses when leaving viewing area 14. Guest 18 may be provided with 3D eyewear 34 when entering viewing area 14, and may return 3D eyewear 34 when leaving viewing area 14.
[0021] Projector 26 and semi-transparent mirror 22 may provide augmented reality image 38 such that augmented reality image 38 appears "real" and semi-transparent mirror 22 appears invisible from the guest's perspective. In some cases, this is accomplished by projector 26 and semi-transparent mirror 22 producing a Pepper's Ghost effect. That is, image 36 projected by projector 26 is reflected by semi-transparent mirror 22, which is viewed from the guest's perspective as augmented reality image 38. From the guest's perspective, objects 20 behind semi-transparent mirror 22 may appear to be part of augmented reality image 38 (e.g., may appear to be part of the 3D environment of augmented reality image 38).
[0022] To achieve this effect (e.g., Pepper's Ghost effect), the semi-transparent mirror 22 can be disposed at an angle 41 relative to the projector 26 that enables the semi-transparent mirror 22 to reflect the image 36 for viewing by the guest 18. Thus, the angle 41 can vary depending on certain dimensions of the amusement ride system 10 (e.g., the distance between the guest 18 and the semi-transparent mirror 22, the dimensions of the semi-transparent mirror 22 and the projector 26, the size of the viewing area 14 and the performance area 16, and other factors). For example, in some embodiments, the angle 41 can be forty-five degrees, and in some embodiments, the angle 41 can be in the range of thirty to sixty degrees. In some embodiments, the semi-transparent mirror 22 can extend substantially vertically from the floor, and the suspended projector can provide the image 36.
[0023] Although Figure 1The augmented reality image 38 is illustrated as being reflected by the semi-transparent mirror 22, but in some embodiments, the semi-transparent mirror 22 may include a projector 26 such that the projector 26 projects the augmented reality image 38 directly onto the semi-transparent mirror 22. That is, the semi-transparent mirror 22 may include a "see-through" electronic display that enables the guest 18 to look through it and view both the object 20 and the augmented reality image 38 simultaneously. The see-through display may be made of any suitable material, such as glass, and use any suitable display technology, such as LED, OLED, or LCD. Furthermore, the semi-transparent mirror 22 including the projector 26 may provide the augmented reality image 38 as a 3D environment when viewed through the 3D eyewear 34.
[0024] In some embodiments, projector 26 can be replaced by a physical object that is reflected by semi-transparent mirror 22. For example, a physical object can be positioned in a similar approximate location of projector 26 and can appear as augmented reality image 38 on semi-transparent mirror 22. Such physical objects can include animated faces and / or bodies. Semi-transparent mirror 22 can reflect animated faces and / or bodies and their movement. In addition, performance area 16 can include blank physical characters. Animated faces and / or bodies can be overlaid onto blank physical characters. Therefore, from the perspective of guests 18 who are viewing augmented reality image 38 and performance area 16 at the same time, physical animated faces and / or bodies can appear to be real objects in performance area 16, which can appear to be moving in performance area 16.
[0025] In some embodiments, performance area 16 may include a mirror that reflects guest 18 and / or objects adjacent to guest 18 (e.g., objects within viewing area 14). Guest 18 may simultaneously view the reflected image on the mirror and augmented reality image 38 on semi-transparent mirror 22, such that the reflected image (e.g., the reflected image of guest 18 and objects adjacent to guest 18) and augmented reality image 38 appear to be part of the same image or animation.
[0026] In order to enable more interaction between the guest 18 and the augmented reality system 12 (e.g., the object 20 and the augmented reality image 38 viewed by the guest 18), the guest tracking sensor 32 can facilitate modifying or maintaining the augmented reality image 38 based on the positioning of the guest's head, so that the augmented reality image 38 appears real and the semi-transparent mirror 22 appears invisible from the guest's perspective (e.g., Pepper's Ghost effect). Specifically, for example, the augmented reality image 38 can be modified to provide an appropriate angle based on the positioning of the guest 18. In some embodiments, the guest tracking sensor 32 can determine the positioning of other parts of the guest 18, such as the positioning of the general positioning of the guest 18, the positioning of (one or more) eyes of the guest 18 (e.g., via infrared light for tracking eyes), the positioning of (one or more) facial features of the guest 18, and / or the body movement of the guest 18. As illustrated, the guest tracking sensor 32 can determine the positioning of the guest's head within the detectable area 42 (e.g., defined by the dotted line 44). The detectable area 42 may include all or some of the viewing area 14. In some embodiments, the guest tracking sensor 32 may determine the location of the vehicle carrying the guest 18 to determine the location of the guest 18. As illustrated, the guest tracking sensor 32 is mounted to a crossbar 46 generally above the translucent mirror 22. The crossbar 42 may be part of the structure of the amusement ride system 10. In some embodiments, the guest tracking sensor 32 may be mounted to other portions of the amusement ride system 10 (e.g., the translucent mirror 22).
[0027] The guest tracking sensor 32 may include any suitable sensor that determines the location of a guest's head or another portion of the guest 18. For example, the guest tracking sensor 32 may include a camera that detects the guest's head, skeletal features, body movements, eyes, facial features, and / or other portions of the guest 18. In some embodiments, the 3D eyewear 34 may include a marker that is detectable by the guest tracking sensor 32. For example, the marker may include a quick response ("QR") code, a barcode, or another detectable marker (e.g., a retroreflective marker that reflects infrared light). The guest tracking sensor 32 disposed on the crossbar 46 or disposed elsewhere in the amusement ride system 10 other than the guest 18 may detect the marker (e.g., the QR code) to determine the location of the guest's head. Furthermore, although tracking of a guest's head is described throughout this disclosure, such tracking is an example of various other means by which information about a guest's head and / or eyes may be indicated and / or provided.
[0028] The guest tracking sensor 32 may output a signal indicating the location of the guest's head to the controller of the augmented reality system 12. For example, when the guest 18 is positioned within the viewing area 14, the guest tracking sensor 32 may determine the location of the guest's head and may output a signal indicating the location of the guest's head to the controller. The controller of the augmented reality system 12 may then adjust the augmented reality image 38 displayed on the semi-transparent mirror 22 (e.g., by adjusting the image 36 projected by the projector 26) based on the location of the guest's head to maintain the augmented reality image 38. As the guest 18 moves around the viewing area 14 and / or relative to the semi-transparent mirror 22, the controller updates the augmented reality image 38 based on the changed location of the guest's head. When viewed by the guest 18 through the 3D eyewear 34, the 3D environment of the augmented reality image 38 may appear to move relative to the object 20 as the guest 18 moves. For example, as the guest 18 moves, certain parts of the 3D environment (e.g., plants, characters, weather) may appear to move relative to each other and relative to the object 20. Portions of the augmented reality image 38 that appear to be closer to the guest 18 from the perspective of the guest 18 may appear to move more (e.g., may have greater parallax) than portions of the augmented reality image 38 that appear to be farther away from the guest 18. Thus, a parallax effect of the augmented reality image 38 and / or the object 20 may be generated from the perspective of the guest 18. The parallax effect enables the augmented reality system 12 to simulate 3D movement of portions of the augmented reality image 38 (e.g., the landscape 39 and the bird 40) relative to each other, and to simulate 3D movement of the object 20 relative to portions of the augmented reality image 38.
[0029] In some embodiments, the augmented reality system 12 may include additional cameras that capture augmented reality effects (e.g., objects 20, augmented reality images 38, and / or guests 18) and / or other portions of the amusement ride system 10. Additionally, the augmented reality system 12 may include sensors that track the location of the camera so that the augmented reality system 12 can accurately depict augmented reality effects from the camera's perspective. For example, the controller described herein may provide and / or update the augmented reality image 38 based on the camera's location.
[0030] In some embodiments, the augmented reality system 12 may include an object tracking sensor to track the location of the object 20 within the performance area 16. For example, in the illustrated embodiment, the object tracking sensor may determine the location of the performer (e.g., as represented by the object 20). The object tracking sensor may output a signal indicating the location of the object 20 to a controller of the augmented reality system 12. The controller may adjust the augmented reality image 38 displayed on the semi-transparent mirror 22 based on the sensor signal (e.g., based on the location of the object 20). For example, if the object 20 moves from a first location to a second location within the performance area 16, the controller may receive a signal indicating the first location and the second location from the object tracking sensor. Based on the location of the object 20 (e.g., the first location and the second location), the controller may adjust the augmented reality image 38 on the semi-transparent mirror 22. The controller may occlude certain portions of the augmented reality image 38 so that the object 20 appears at different depths within the augmented reality image 38. Thus, the object tracking sensor may enable the object 20 to interact with the augmented reality image 38 from the perspective of the guest 18. The object tracking sensor may be disposed generally above the performance area 16 (eg, on the beam 46 adjacent to the guest tracking sensor 32 ) or at another location within the amusement ride system 10 .
[0031] In some embodiments, the amusement ride system 10 may include multiple objects 20 (e.g., multiple performers, multiple props, multiple animals, or a combination thereof) within the performance area 16. In such embodiments, the object tracking sensor may determine and track the location of each object 20 within the performance area 16. For example, each object 20 within the performance area 16 may include a marker (e.g., a QR code) that can be detected by the object tracking sensor. The object tracking sensor may determine the corresponding location of each object 20 based on the corresponding location of the marker. In some embodiments, the augmented reality system 12 may include a separate object tracking sensor (e.g., multiple object tracking sensors) for each object 20. Each object tracking sensor may output a signal indicating the location of the corresponding object 20 to the controller. The augmented reality system 12 may provide an augmented reality image 38 for viewing by the guest 18, so that the guest 18 can view the augmented reality image 38 and the multiple objects 20. From the perspective of the guest 18, the multiple objects 20 may appear to interact with the augmented reality image 38. For example, a guest 18 viewing an augmented reality image 38 through 3D eyewear 34 may view an object 20 interacting with the 3D environment of the augmented reality image 38 (eg, with the scenery 39 and the bird 40 ).
[0032] In some embodiments, the amusement ride system 10 may have multiple guests 18 positioned within the viewing area 14. The multiple guests 18 may view a single translucent mirror 22, or may view separate, individual translucent mirrors 22. For embodiments with multiple guests 18, the augmented reality system 12 may include multiple guest tracking sensors 32 (e.g., a separate guest tracking sensor 32 for each respective guest 18). Additionally, the amusement ride system 10 may include multiple augmented reality systems 12 (e.g., a separate augmented reality system 12 for each respective guest 18). Each augmented reality system 12 may provide a separate augmented reality image 38 for viewing by the respective guest 18. Additionally, each guest 18 may view the augmented reality image 38 through a separate 3D eyewear 34.
[0033] In certain embodiments with a single semi-transparent mirror 22 and multiple guests 18, the augmented reality system 12 may determine an average location of the guests 18 (e.g., an average location of two guests 18) via a controller. For example, the controller may receive signals from a single guest tracking sensor 32 or from multiple guest tracking sensors 32, each signal indicating a respective location of a respective guest 18. The controller may determine an average location of the locations of the guests 18. Based on the average location, the controller may provide an image 36 to the projector 26. The projector 26 may project the image 36 to be reflected by the semi-transparent mirror 22 as an augmented reality image 38. Multiple guests 18 may view the object 20 and the augmented reality image 38, and the object 20 may appear to interact with the augmented reality image 38 from respective perspectives of the multiple guests 18.
[0034] In some embodiments with a single semi-transparent mirror 22 and multiple guests 18, the augmented reality system 12 may generate separate individual augmented reality images 38 for each guest 18. Each guest 18 may view only the corresponding augmented reality image 38 generated for their perspective. For example, each corresponding augmented reality image 38 may include a separate time-sequential image provided specifically for a particular guest 18. In addition, the semi-transparent mirror 22 may display each of the augmented reality images 38 in sequence. For example, in an embodiment with four guests 18 viewing the semi-transparent mirror 22, the augmented reality system 12 may provide a set of four augmented reality images 38. The semi-transparent mirror 22 may display a frame (e.g., a set of four frames) of each augmented reality image 38 for viewing by the guests 18. The 3D eyewear 34 may allow the guests 18 to view only their corresponding augmented reality image 38. For example, the 3D eyewear 34 may allow the respective guests 18 to view each frame of their respective augmented reality image 38 and may block the respective guests 18's field of view for frames that include other augmented reality images 38 (e.g., the 3D eyewear 34 may include a blocking mechanism that allows the guests 18 to view only frames of their respective augmented reality image 38 and blocks other frames). Each of the four guests 18 may view every third frame provided by the semi-transparent mirror 22. In addition, the semi-transparent mirror 22 may provide frames of the augmented reality image 38 at a high rate (e.g., 240 frames per second) so that the frames and augmented reality image 38 viewed by each guest 18 appear to be a continuous animation. That is, due to the high rate of frames, the guests 18 may not notice that their field of view is blocked for three of every four frames. Therefore, each guest 18 may experience a unique and individual augmented reality image 38 within the amusement ride system 10.
[0035] Figure 2 yes Figure 1 A front perspective view of an embodiment of an augmented reality system 12 and an augmented reality image 38 on a semi-transparent mirror 22. Figure 2 The view may be a perspective view of a guest 18 positioned within the viewing area 14. From the perspective of the guest 18, the object 20 may appear to be part of the augmented reality image 38. For example, the object 20 may appear to be positioned next to the scenery 39 of the augmented reality image 38, and the bird 40 may appear to be flying above the object 20. However, as described above with respect to Figure 1As described, the object 20 may actually be located within the performance area 16 and behind the semi-transparent mirror 22 and the augmented reality image 38. Furthermore, although the augmented reality system 12 includes the semi-transparent mirror 22 in the illustrated embodiment, the guest 18 may not notice the semi-transparent mirror 22. For example, the guest 18 may only view the augmented reality image 38 on the semi-transparent mirror 22 and may not view other portions (e.g., edges and mounting features) of the semi-transparent mirror 22. The amusement ride system 10 may include lighting effects and / or structures that hide other portions of the semi-transparent mirror 22 from the view of the guest 18.
[0036] When the guest 18 views the augmented reality image 38 and the object 20 using the 3D eyewear 34, the object 20 may appear to be part of the 3D environment of the augmented reality image 38. In addition, the controller of the augmented reality system 12 may adjust the augmented reality image 38 so that from the perspective of the guest 18 wearing the 3D eyewear 34, the object 20 appears to move throughout the 3D environment of the augmented reality image 38 (e.g., the scenery 39 and the bird 40). For example, the guest tracking sensor 32 may determine the position of the guest's head relative to the semi-transparent mirror 22 and / or relative to the object 20, and the controller may update the augmented reality image 38 based on the relative position of the guest's head. Additionally, the object tracking sensor may determine the position of the object 20, and the controller may update the augmented reality image 38 based on the relative position of the object 20. The augmented reality system 12 may provide a parallax effect that includes portions of the 3D environment that appear closer to the guest 18 moving more (e.g., having a larger parallax) than portions of the 3D environment that appear farther away from the guest 18 (which may have a smaller parallax). The amount of movement of the corresponding portion of the augmented reality system 38 (e.g., the amount of parallax) may depend on the relative positioning of the guest's head, the object 20, the semi-transparent mirror 22, and / or portions of the augmented reality image 38 (e.g., the 3D environment of the augmented reality image 38). As the guest 18 moves around the viewing area 14, the object 20 may appear to interact with the 3D environment of the augmented reality image 38 from the perspective of the guest 18 wearing the 3D eyewear 34. Thus, the augmented reality system 12 may provide and update the augmented reality image 38 for providing an interactive and entertaining environment for the guest 18.
[0037] Figure 3 yes Figure 1 1 is a block diagram of an embodiment of an augmented reality system 12. As illustrated, the guest tracking sensor 32 and the projector 26 are each communicatively coupled to a controller 60 of the augmented reality system 12. The controller 60 includes a processor 62, a memory 64, and a user interface 66. The controller 60 can control the display provided to the guest based on the signal received from the guest tracking sensor 32. Figure 136 of the projector 26. For example, the guest tracking sensor 32 may determine the location of the guest's head and may output a sensor signal indicating the location of the guest's head to the controller 60. Based on the location of the guest's head, the controller 60 may generate and / or update image data indicating the image 36 to be reflected as the augmented reality image 38 via the processor 62. The update to the image 36 may include the above-mentioned parallax effect, which includes: the portion of the augmented reality image 38 that appears closer to the guest 18 moves more than the portion of the augmented reality image 38 that appears farther away from the guest 18. The controller 60 may output a control signal indicating the image data to the projector 26. Based on the control signal indicating the image data received from the controller 60, the projector 26 may project and / or update the image 36 to provide the augmented reality image 38 on the semi-transparent mirror 22. In addition, as described above, the image 36 may include an image pair that appears to be a 3D environment when projected onto the semi-transparent mirror 22 as the augmented reality image 38 and viewed through the 3D eyewear 34. The guest 18 may experience a parallax effect such that portions of the augmented reality image 38 move relative to each other and relative to the object 20 as the guest 18 moves their head.
[0038] The controller 60 may cause the projector 26 to initially begin providing the image 36 based on certain factors. For example, the controller 60 may receive an input to the user interface 66 indicating an instruction to begin providing the image 36. In response, the controller 60 may output a control signal to the guest tracking sensor 32 to cause the guest tracking sensor 32 to begin tracking / determining the location of the guest's head. Based on the initial sensor signal indicating the initial location of the guest's head, the controller 60 may output a control signal indicating image data to the projector 26. In some embodiments, the augmented reality system 12 may automatically determine the presence and location of the guest's head via the guest tracking sensor 32, and the controller 60 may automatically cause the projector 26 to provide the image 36 to be reflected as the augmented reality image 38 for viewing by the guest 18 without input to the user interface 66.
[0039] The guest tracking sensor 32 may continuously detect the position of the guest's head and may output a sensor signal indicative of the position of the guest's head to the controller 60. In response, the controller 60 may update the image data based on the position of the guest's head and may output a control signal indicative of the updated image data to the projector 26. The projector 26 may provide an updated image 36 to the semi-transparent mirror 22 (e.g., the projector 26 projects the image 36 reflected by the semi-transparent mirror 22 as an augmented reality image 38) based on the updated image data for viewing by the guest 18. Portions of the updated augmented reality image 38 may appear to move compared to the previous augmented reality image 38 provided by the controller 60. Thus, the augmented reality system 12 may provide a parallax effect via the controller 60 such that portions of the augmented reality image 38 move relative to the object 20 and relative to each other from the perspective of the guest 18 wearing the 3D eyewear 34. The augmented reality system 12 may stop providing the augmented reality image 38 based on user input to the user interface 66, based on an elapsed time period, based on the guest tracking sensor 32 no longer detecting the location of the guest's head, and / or based on other factors.
[0040] In some embodiments, the controller 60 may be communicatively coupled to other portions of the augmented reality system 12. For example, the controller 60 may be communicatively coupled to the object tracking sensor described above, such that the controller 60 may receive a signal from the object tracking sensor indicating the location of the object 20, and may generate / update image data based on the location of the object 20. Additionally, the controller 60 may be communicatively coupled to the semi-transparent mirror 22. For example, in an embodiment having a semi-transparent mirror 22 that displays an image 36 (e.g., directly provides an augmented reality image 38) for viewing by the guest 18 (e.g., the projector 26 is included in the semi-transparent mirror 22), the controller 60 may output a signal indicating the image data to the semi-transparent mirror 22. In response, the semi-transparent mirror 22 may display the augmented reality image 38 for viewing by the guest 18. Additionally, the controller 60 may be communicatively coupled to Figure 1 3D eyewear 34.
[0041] In certain embodiments, the amusement ride system 10 and / or augmented reality system 12 may include additional controllers, processors, and / or memory to perform various functions. For example, in embodiments having multiple semi-transparent mirrors 22, each semi-transparent mirror 22 may include a controller that receives signals from the guest tracking sensor 32, controls the augmented reality image 38 on the corresponding semi-transparent mirror 22, and / or communicates with the controller 60. In some embodiments, the memory 64 and other memories of the amusement ride system 10 may include one or more tangible, non-transitory computer-readable media that stores instructions executable by the processor 62 and / or data to be processed by the processor 62. For example, the memory 64 may include random access memory (RAM), read-only memory (ROM), rewritable non-volatile memory (such as flash memory), a hard drive, an optical disk, and / or other types of memory. In addition, the processor 62 and other processors of the amusement ride system 10 may include one or more general-purpose microprocessors, one or more application-specific integrated circuits (ASICs), and / or one or more field-programmable gate arrays (FPGAs).
[0042] The user interface 66 can facilitate communication between the controller 60 and a user (e.g., an operator). The user interface 66 can be disposed adjacent to the amusement ride system 10, or can be disposed at a remote location in the case of a remotely controlled or autonomously operated amusement ride system. For example, the user interface 66 can include one or more of buttons, a keyboard, a mouse, a touch pad, and / or the like to allow a user to interact with the controller 60. In addition, the user interface 66 can include an electronic display to provide a visual representation of information, such as via a graphical user interface (GUI), an application interface, text, still images, video content, or a combination thereof. The user interface 66 can receive input from a user (e.g., an operator of the amusement ride system 10 and / or the augmented reality system 12). For example, the input to the user interface 66 can include a desired augmented reality effect to be provided by the augmented reality system 12 within the amusement ride 10.
[0043] The guest tracking sensor 32 and / or the projector 26 may be connected to and communicatively coupled with the controller 60 via a wired connection (e.g., Ethernet, a universal serial bus (USB), a CAN bus, or an ISO bus). For example, the guest tracking sensor 32 may output signals to the controller 60 via the wired connection, and the projector 26 may receive signals from the controller 60 via the wired connection. Additionally or alternatively, the guest tracking sensor 32 and / or the projector 26 may communicate with the controller 60 via a wireless connection. For example, the projector 26 may include a transceiver that receives signals from a controller transceiver of the controller 60. Each of the projector 32 transceiver and the controller transceiver may utilize any suitable wireless communication protocol, such as a standard protocol (e.g., Wi-Fi or Bluetooth) or a proprietary protocol.
[0044] Figure 4 Is used for Figure 1 Flowchart of an embodiment of a process 80 for generating and displaying an augmented reality image 38 by an augmented reality system 12. As illustrated, the augmented reality system 12 first receives an indication of the location of a guest's head (block 82). For example, the guest tracking sensor 32 may determine the location of the guest's head and may output a sensor signal indicating the location of the guest's head to the user. Figure 2 The controller 60 may receive the sensor signal.
[0045] Next, the augmented reality system 12 may generate an augmented reality image 38 based on the positioning of the guest's head (block 84). For example, the controller 60 may output a control signal indicating image data based on a sensor signal received from the guest tracking sensor 32 indicating the positioning of the guest's head (e.g., the augmented reality system 12 may provide a parallax effect via the controller 60). The controller 60 may provide image data such that when the image 36 is reflected as the augmented reality image 38, from the perspective of the guest 18, the object 20 appears to interact with the augmented reality image 38. From the perspective of the guest 18 wearing the 3D eyewear 34, the object 20 may appear to be part of the 3D environment of the augmented reality image 38. In some embodiments, the controller 60 may receive a sensor signal from the object tracking sensor indicating the positioning of the object 20. The controller 60 may provide image data based on both the positioning of the object 20 and the positioning of the guest's head. As the respective positioning of the guest 18 and the object 20 changes, the controller 60 may adjust the image data so that portions of the reflected augmented reality image 38 that appear to be closer to the guest 18 may move more (e.g., may have greater parallax) than portions of the 3D environment that appear to be farther away from the guest 18. Thus, the controller 60 may provide a parallax effect that includes portions of the object 20 and / or augmented reality image 38 moving relative to each other from the perspective of the guest 18.
[0046] Additionally, the augmented reality system 12 may display the augmented reality image 38 on the semi-transparent mirror 22 for viewing by the guest 18 (block 86). For example, the projector 26 may project the image 36, which may be reflected by the mirror 22 as the augmented reality image 38 for viewing by the guest 18. The guest 18 may view the object 20 and the augmented reality image 38 simultaneously, such that the object 20 and the augmented reality image 38 appear to be part of the same image (e.g., appear to be part of the same 3D environment when viewed through the 3D eyewear 34).
[0047] The augmented reality system 12 may iteratively repeat the process 80 while the guest 18 is positioned within the viewing area 14 and / or while the guest 18 is viewing the semi-transparent mirror 22. For example, after providing the initial augmented reality image 38 for viewing by the guest, the augmented reality system 12 may repeat each of blocks 82, 84, and 86 to update the augmented reality image 38 based on the updated position of the guest 18. In some embodiments, the augmented reality system 12 may update the augmented reality image 38 based on the updated position of the object within the performance area 16 (e.g., based on the updated position of the object detected by the object detection sensor). With each iteration of the process 80, from the perspective of the guest 18 wearing the 3D eyewear 34, the object 20 may appear to interact with the augmented reality image 38.
[0048] therefore, Figure 1 The amusement ride system 10 and augmented reality system 12 provide an entertainment and interactive environment for guests 18. For example, to reproduce or simulate augmented reality effects without using an augmented reality head mounted device, the augmented reality system 12 may include a projector 26 that projects an image 36 that may appear to be a 3D image or 3D environment when viewed using 3D eyewear 34 (e.g., 3D glasses). The image 36 may be reflected by the semi-transparent mirror 22 as an augmented reality image 38. The guest 18 may view the augmented reality image 38 as a 3D environment using the 3D eyewear 34. The semi-transparent mirror 22 may be positioned at an angle 41 relative to the projector 26 to produce a Pepper's ghost effect, which may make the 3D image appear to be overlaid on top of the object 20 behind the semi-transparent mirror 22.
[0049] In addition, the guest's head can be tracked by the guest tracking sensor 32, and the position of the guest's head relative to the semi-transparent mirror 22 and the object 20 can be used to update the augmented reality image 38 (e.g., 3D image / environment) displayed on the semi-transparent mirror 22. For example, when the guest 18 moves their head, the 3D image can include a parallax effect that accurately moves portions of the 3D image relative to each other and relative to the object 20 (e.g., portions of the 3D image that appear closer to the guest 18 can move more than portions of the 3D image that appear farther away from the guest 18). In this way, an augmented reality effect that can be viewed by the guest 18 can be generated when only lightweight 3D glasses (e.g., 3D eyewear 34) are worn instead of an augmented reality head-mounted device. Thus, the amusement ride system 10 and the augmented reality system 12 provide an interactive 3D environment with generated images (e.g., augmented reality image 38) and real objects (e.g., object 20) for the enjoyment of the guest 18 wearing the 3D eyewear 34.
[0050] Although only certain features of the present disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the present disclosure.
[0051] The technology presented and claimed herein is cited and applied to material objects and specific examples of a practical nature that demonstrably advance the art and is therefore not abstract, intangible, or purely theoretical. In addition, if any claim appended to the end of this specification contains one or more elements designated as "means for [performing] ... [function]" or "steps for [performing] ... [function]," it is intended that such elements be interpreted in accordance with 35 USC 112(f). However, for any claim containing elements designated in any other manner, it is intended that such elements not be interpreted in accordance with 35 USC 112(f).
Claims
1. An augmented reality system for an amusement ride, comprising: a guest tracking sensor configured to determine the location of the guest; a projector configured to project an image; a semi-transparent mirror configured to reflect the image as an augmented reality image, wherein the guest is disposed on a first side of the semi-transparent mirror; and A controller comprising a processor and a memory, wherein the controller is configured to: receiving a first sensor signal from the guest tracking sensor indicating a first location of the guest; generating image data based on the first positioning of the guest; outputting a first control signal indicative of the image data to the projector, wherein the projector is configured to project the image based on the first control signal indicative of the image data; receiving a second sensor signal from the guest tracking sensor indicating a second location of the guest; updating the image data to updated image data in response to receiving the second sensor signal; and A second control signal indicating the updated image data is output to the projector, wherein the projector is configured to project an updated image based on the second control signal, and wherein the updated image causes the augmented reality image to appear to move relative to an object disposed on a second side of the semi-transparent mirror opposite to the first side through a parallax effect.
2. The augmented reality system of claim 1 , wherein the image is configured to appear as a 3D image when viewed through 3D eyewear, wherein the 3D eyewear comprises stereo glasses that enable the image to be viewed as the 3D image.
3. The augmented reality system of claim 2, wherein the augmented reality image is configured to interact with the object from the guest's perspective.
4. The augmented reality system of claim 2, comprising the 3D eyewear, wherein the 3D eyewear is configured to cause the augmented reality image to appear as the 3D image from the perspective of the guest wearing the 3D eyewear.
5. The augmented reality system of claim 1, wherein the controller is configured to iteratively update the image based on the second location of the guest.
6. The augmented reality system of claim 1, wherein the controller is configured to generate the image based on user input, time sequence, or a combination thereof.
7. The augmented reality system of claim 1, wherein the guest tracking sensor is configured to detect retroreflected infrared light.
8. The augmented reality system of claim 1, wherein the semi-transparent mirror is disposed at an angle between 30 and 60 degrees relative to the projector.
9. The augmented reality system according to claim 1, wherein the projector is arranged above or below the semi-transparent mirror and is located at an angle that the guest cannot see the projector.
10. The augmented reality system according to claim 1, wherein: The controller is configured to update the image data by moving a first portion of the augmented reality image further than a second portion of the augmented reality image, wherein the second portion of the augmented reality image appears to be farther away from the guest relative to the first portion of the augmented reality image.
11. The augmented reality system according to claim 10, wherein: The first portion of the augmented reality image and the second portion of the augmented reality image include positioning of the guest's head, eyes, one or more facial features, other parts of the guest, or any combination thereof.
12. The augmented reality system according to claim 1, wherein: The controller is configured to: receiving a third sensor signal indicating that the guest is not on the first side of the semi-transparent mirror; and outputting a third control signal indicating an instruction to stop providing the image or the updated image to the projector, wherein the projector is configured to stop projecting the image or the updated image based on the third control signal.
13. A method for generating an augmented reality image for an amusement ride, comprising: Receive the guest's first location instructions; in response to receiving the indication of the first location of the guest, generating image data based on the first location of the guest; projecting an image onto a semi-transparent mirror based on the image data, wherein the guest is disposed on a first side of the semi-transparent mirror; reflecting the image toward the guest as an augmented reality image for viewing by the guest, wherein the augmented reality image appears as a 3D image when viewed through 3D eyewear, wherein the 3D eyewear includes stereo glasses that enable viewing of the augmented reality image as the 3D image; receiving an indication of a second location of the guest; updating the image data to updated image data in response to receiving the indication of the second location of the guest; projecting an updated image onto the semi-transparent mirror based on the updated image data; and The updated image is reflected toward the guest as the augmented reality image for viewing by the guest, wherein the updated image causes the augmented reality image to appear to move relative to an object disposed on a second side of the semi-transparent mirror opposite the first side through a parallax effect.
14. The method of claim 13, wherein the image comprises two or more 2D images configured to appear as the 3D image when viewed through the 3D eyewear.
15. The method of claim 13, comprising receiving an indication of a location of the object on the second side of the semi-transparent mirror.
16. The method of claim 15, comprising adjusting the image data based on the positioning of the object.
17. An augmented reality system for an amusement ride, comprising: a guest tracking sensor configured to determine the location of the guest; a 3D projector configured to project an image; a semi-transparent mirror configured to reflect the image as an augmented reality image, wherein the guest is disposed on a first side of the semi-transparent mirror; 3D eyewear comprising stereo glasses configured to enable viewing of the augmented reality image as a 3D environment; and A controller comprising a processor and a memory, wherein the controller is configured to: receiving a first sensor signal from the guest tracking sensor indicating a first location of the guest; generating image data based on the first position of the guest; and outputting a first control signal indicating the image data to the 3D projector, such that the first control signal causes the 3D projector to project the image onto the semi-transparent mirror based on the image data; receiving a second sensor signal from the guest tracking sensor indicating a second location of the guest; updating the image data to updated image data in response to receiving the second sensor signal; and A second control signal indicating the updated image data is output to the projector, wherein the projector is configured to project an updated image based on the second control signal, and wherein the updated image causes the augmented reality image to appear to move relative to an object disposed on a second side of the semi-transparent mirror opposite to the first side through a parallax effect.
18. The augmented reality system of claim 17, wherein the guest tracking sensor comprises a marker disposed within the 3D eyewear, and the marker is configured to transmit location data indicative of the guest.
19. The augmented reality system according to claim 18, wherein: The markings include quick response (QR) codes, bar codes, or retroreflective markings that reflect infrared light.
20. The augmented reality system of claim 17, wherein the guest tracking sensor comprises a camera configured to determine the location of the guest.
