Augmented reality display with adjustable parallax

Abstract

A performance effect system (56) of an amusement park may include a sensor (58) that communicates customer data, a display (68) that projects virtual images, and a mirror (70) that deflects the virtual images. The presentation effect system (56) may also include an actuator (66) coupled with the display (68) and / or the mirror (70), and a beam splitter (62) having a partially transmissive and partially reflective viewing surface between the viewing area and the mirror (70). The beam splitter (62) may reflect light from the viewing area back to the viewing area as a reflected image and enable the virtual image deflected from the mirror (70) to be transmitted through the beam splitter (62) to the viewing area as a transmitted image. The performance effect system (56) may also include a controller (74) communicatively coupled with the sensor (58), the actuator (66), and the display (68). The controller (74) may instruct the actuator (66) to adjust an orientation and / or orientation of the display (68), the mirror (70), or both based on customer data.

Description

(19) State Intellectual Property Office (12) Invention Patent Application (10) Application Publication Number (43) Application Publication Date (21) Application Number 202480027485.5 (22) Application Date 2024.04.11 (30) Priority Data 63 / 461392 2023.04.24 US 18 / 619131 2024.03.27 US (85) PCT International Application Entering National Phase Date 2025.10.22 (86) PCT International Application Application Data PCT / US2024 / 024061 2024.04.11 (87) PCT International Application Publication Data WO2024 / 226309 EN 2024.10.31 (71) Applicant: Universal City Cinema LLC Address: California, USA (72) Inventors: A.C. Jerome, A.M. Kraussamer, T.F. Garnier (74) Patent Agency: China Patent Agency (Hong Kong) Limited 72001 Patent Attorneys: Du Juanjuan, Liu Chunyuan (51) Int.Cl. A63G 31 / 00 (2006.01) G03B 21 / 28 (2006.01) (54) Title of Invention: Augmented Reality Display with Adjustable Parallax (57) Abstract: An amusement park performance effects system (56) may include a sensor (58) for transmitting customer data, a display (68) for projecting virtual images, and a mirror (70) for deflecting virtual images. The performance effects system (56) may also include an actuator (66) coupled to the display (68) and / or the mirror (70), and a beam splitter (62) having a partially transmissive and partially reflective viewing surface located between the viewing area and the mirror (70). The beam splitter (62) can reflect light from the viewing area back to the viewing area as a reflected image, and allow virtual images deflected from the mirror (70) to be transmitted to the viewing area as transmitted images through the beam splitter (62). The performance effects system (56) may also include a controller (74) communicatively coupled to the sensor (58), actuator (66), and display (68). The controller (74) may instruct the actuator (66) to adjust the orientation and / or orientation of the display (68), mirror (70), or both, based on customer data.Claims (3 pages), Description (15 pages), Drawings (5 pages), CN 121079135 A, 2025.12.05, CN 1 21 07 91 35 A. 1. A performance effects system for an amusement park, the performance effects system comprising: a display configured to project one or more virtual images; a mirror configured to deflect the one or more virtual images; one or more sensors configured to transmit customer data based on customer detection in a viewing area, wherein the customer data includes data indicating the position and / or orientation of a customer relative to the mirror; one or more actuators coupled to the display and / or the mirror and configured to adjust the positioning of the display and / or the mirror; a beam splitter located between the viewing area and the mirror, wherein the beam splitter is configured to: The system reflects light from the viewing area back to the viewing area as a reflected image; and allows the one or more virtual images deflected from the mirror to be transmitted as transmitted images through the beam splitter to the viewing area; and one or more controllers communicatively coupled to the one or more sensors and to at least the one or more actuators or the display, wherein the one or more controllers are configured to instruct the one or more actuators to adjust the orientation and / or orientation of the display, the mirror, or both based on the customer data. 2. The performance effects system of claim 1, wherein the customer data includes customer height data, and wherein the one or more controllers are configured to instruct the one or more actuators to adjust the orientation and / or orientation of the display, the mirror, or both based on the customer height data. 3. The performance effects system of claim 2, wherein the one or more controllers are configured to estimate the customer's viewing angle based on the customer's height data. 4. The performance effects system of claim 3, wherein the one or more controllers are configured to instruct the one or more actuators to adjust the orientation and / or orientation of the display, the mirror, or both based on the customer's viewing angle to superimpose the reflected image and the transmitted image onto each other. 5. The performance effects system of claim 1, wherein the one or more controllers are configured to: generate image data based on the customer data; transmit the image data to the display; and instruct the display to project the one or more virtual images based on the image data.6. The performance effects system of claim 1, further comprising one or more tracks movably coupled to the mirror and / or the display, wherein the one or more controllers are configured to instruct the one or more actuators to adjust the orientation and / or orientation of the display, the mirror, or both along the one or more tracks. 7. The performance effects system of claim 1, further comprising an additional actuator coupled to the beam splitter and communicatively coupled to the one or more controllers, wherein the one or more controllers are configured to instruct the one or more actuators to adjust the orientation and / or orientation of the beam splitter based on the customer data. 8. The performance effects system of claim 1, further comprising one or more physical objects located, together with the display and the mirror, on the side of the beam splitter opposite the viewing area. 9. The performance effects system of claim 8, further comprising a light source communicatively coupled to the one or more controllers, wherein the one or more controllers are configured to instruct modulation of the light source to adjust the visibility of the one or more physical objects through the beam splitter from the viewing area. Claims 1 / 3 page 2 CN 121079135 A 10. The performance effects system of claim 1, wherein the display comprises a two-dimensional display, a three-dimensional display, or a volumetric display. 11. The performance effects system of claim 1, wherein the beam splitter comprises a visual barrier. 12. A non-transitory computer-readable medium comprising instructions configured, when executed by one or more processors, to cause the one or more processors to perform operations including: determining the location and / or orientation of a customer relative to a performance system of an amusement park attraction system, wherein the performance system includes a beam splitter configured to reflect an image of the customer as a reflective element at a first location, and the performance system includes a mirror and a display configured to project one or more virtual images onto the mirror for deflection through the beam splitter as a transmissive element at a second location; and, based on the location and / or orientation of the customer, instructing one or more actuators of the performance system to move and / or rotate the display, the mirror, or both to adjust the projection of the one or more virtual images onto the mirror and to adjust the second location of the transmissive element.13. The non-transitory computer-readable medium of claim 12, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations including: determining a movement and / or directional change of the customer within the performance effects system that results in an adjustment of the first position and / or orientation of the reflective element; and, based on the customer's movement and / or directional change to the additional position and / or orientation, instructing the one or more actuators to move and / or rotate the display, the mirror, or both to adjust the projection of the one or more virtual images onto the mirror and to adjust the second position of the transmissive element and / or change the orientation of the transmissive element. 14. The non-transitory computer-readable medium of claim 13, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations including: in response to determining that the customer's movement and / or orientation change is toward the beam splitter to the additional orientation and / or orientation, instructing the one or more actuators to move and / or rotate the display and the mirror toward each other; or in response to determining that the customer's movement and / or orientation change is away from the beam splitter to the additional orientation and / or orientation, instructing the one or more actuators to move and / or rotate the display and the mirror away from each other. 15. The non-transitory computer-readable medium of claim 12, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations including: determining the customer's height; and, based on the customer's height, instructing the one or more actuators to move and / or rotate the mirror and / or the display. 16. The non-transitory computer-readable medium of claim 12, wherein the instructions, when executed by the one or more processors, are configured to: instruct an additional actuator to adjust the orientation and / or orientation of an object based on the customer's orientation and / or orientation. 17. The non-transitory computer-readable medium of claim 12, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform an operation comprising: determining a distance between the customer and the beam splitter; determining that the distance is within a threshold distance; and, in response to determining that the distance between the customer and the beam splitter is within the threshold distance, instructing the display to project the one or more virtual images onto the mirror for deflection through the beam splitter as the transmissive element at the second position.18. An attraction system for an amusement park, the attraction system comprising: a viewing area for a customer; a beam splitter configured to reflect the appearance of the customer toward the viewing area; a mirror located on the opposite side of the beam splitter relative to the viewing area; a display configured to project one or more virtual images onto the mirror, such that the mirror deflects the one or more virtual images through the beam splitter; and one or more actuators configured to move the mirror and / or the display to adjust the depth of view of the one or more virtual images. 19. The attraction system of claim 18, further comprising: one or more sensors configured to detect the orientation of the customer within the viewing area and generate orientation data based on the orientation; and one or more controllers communicatively coupled to the one or more actuators, wherein the one or more controllers are configured to instruct the one or more actuators to move the display, the mirror, or both based on the orientation data to adjust the depth of view. 20. The attraction system of claim 18, comprising one or more controllers coupled to the one or more actuators, wherein the one or more controllers are configured to perform operations including: determining a first distance between the customer and the beam splitter; and, based on the first distance, instructing the one or more actuators to adjust a second distance between the display and the mirror. Claims 3 / 3 Page 4 CN 121079135 A Augmented Reality Display with Adjustable Parallax

[0001] Cross-Reference to Related Applications This application claims priority to and benefit from U.S. Provisional Application No. 63 / 461392, filed April 24, 2023, entitled “AUGMENTED REALITY MIRROR WITH ADJUSTABLE PARALLAX,” which is hereby incorporated in its entirety by reference for all purposes. Background Art

[0002] This section is intended to introduce to the reader various aspects of the art that may be associated with various aspects of the present art, which are described and / or claimed below. This discussion is intended to provide readers with background information to facilitate a better understanding of the various aspects of this disclosure. Therefore, it should be understood that these statements are to be read in this context and not as an admission of prior art.

[0003] Throughout amusement parks and other entertainment venues, special effects can be used to help immerse customers in the experience of riding in a ride or attraction. Immersive environments may include three-dimensional (3D) props and sets, robotic or mechanical elements, and / or display surfaces that present media. For example, amusement parks may offer augmented reality (AR) experiences to customers.The AR experience may include presenting virtual objects to customers, and these virtual objects may provide customers with unique special effects. These special effects may enable amusement park sections to offer innovative ways to entertain customers (such as by convincingly simulating real-world elements). Summary of the Invention

[0004] An overview of certain embodiments disclosed herein is set forth below. It should be understood that these aspects are presented merely to provide the reader with a brief overview of these certain embodiments, and these aspects are not intended to limit the scope of this disclosure. In fact, this disclosure may cover a wide variety of aspects that may not be set forth below.

[0005] In one embodiment, an amusement park performance effects system may include: one or more sensors configured to transmit customer data based on customer detection in a viewing area; a display configured to project one or more virtual images; and a mirror configured to deflect the one or more virtual images. The customer data may include location data indicating the location of the customer. The performance effects system may also include: one or more actuators coupled to the display and / or the mirror and configured to adjust their positioning; and a beam splitter comprising a partially transmissive and partially reflective viewing surface located between the viewing area and the mirror. A beam splitter can reflect light from the viewing area back to the viewing area as a reflected image, and allow one or more virtual images deflected from a mirror to be transmitted through the beam splitter to the viewing area as transmitted images. The performance effects system may also include one or more controllers communicatively coupled to the one or more sensors and communicatively coupled to the one or more actuators and / or displays, wherein the one or more controllers are configured to instruct the one or more actuators to adjust the orientation of the display, mirror, or both based on position data.

[0006] In one embodiment, a non-transitory computer-readable medium includes instructions configured, when executed by one or more processors, to cause the one or more processors to perform operations including: determining the orientation of a customer relative to the performance effects system of the amusement park attraction system, and instructing one or more actuators of the performance effects system, based on the customer's orientation, to move the display, mirror, or both to adjust the projection of one or more virtual images onto the mirror, and to adjust a second position of the transmitted element. The performance effects system may include a beam splitter configured to reflect the customer's image as a reflective element at a first position. The performance effects system may also include mirrors and displays, the displays being configured to project the one or more virtual images as transmissive elements onto a second location via a beam splitter.

[0007] In one embodiment, an attraction system for an amusement park may include: a viewing area for customers; a beam splitter configured to reflect the appearance of customers toward the viewing area; and a mirror located on the opposite side of the beam splitter relative to the viewing area. The attraction system may also include: a display configured to project one or more virtual images onto the mirror, such that the mirror deflects the one or more virtual images through the beam splitter; and one or more actuators configured to move the mirror and / or the display to adjust the apparent depth of the one or more virtual images.

[0008] These and other features, aspects, and advantages of the present disclosure will become more readily understood when the following detailed description is read with reference to the accompanying drawings, in which similar characters throughout the drawings denote similar parts, wherein: FIG1 is a schematic diagram of an embodiment of an amusement park attraction system according to one aspect of the present disclosure; FIG2 is a side view of the performance effects system of FIG1 according to one aspect of the present disclosure; FIG3 is a side view of an embodiment of the performance effects system of FIG1 according to one aspect of the present disclosure; FIG4 is a flowchart of an embodiment of a method or process for providing performance effects via the performance effects system of FIG1 according to one aspect of the present disclosure; FIG5 is a flowchart of an embodiment of a method or process for providing performance effects via the performance effects system of FIG1 according to one aspect of the present disclosure; and FIG6 is a flowchart of an embodiment of a method or process for providing performance effects via the performance effects system of FIG1 according to one aspect of the present disclosure. Detailed Description

[0009] One or more specific embodiments of the present disclosure will be described below. In an effort to provide a concise description of these embodiments, not all features of actual implementations may be described in the specification. It should be understood that, as in any engineering or design project, the development of any such practical implementation requires numerous implementation-specific decisions to achieve the developer’s specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Furthermore, it should be understood that such development work may be complex and time-consuming, but will be nothing more than routine work of design, fabrication, and production for those skilled in the art who benefit from this disclosure.

[0010] When describing elements of various embodiments of this disclosure, the articles “a” and “described” are intended to mean the presence of one or more of the elements. The terms “comprising” and “including” are intended to be inclusive and mean the presence of additional elements besides those listed. Furthermore, it should be understood that references to “an embodiment” or “an embodiment” are not intended to be construed as excluding the presence of additional embodiments that are also incorporated into the described features.

[0011] As used herein, the terms “approximately,” “generally,” “substantially,” etc., are intended to convey that the described characteristic value may be within a relatively small range of that characteristic value, as would be understood by one of ordinary skill in the art. Mathematical terms, such as “parallel” and “perpendicular,” should not be rigidly interpreted in a strict mathematical sense, but rather should be interpreted as would be understood by one of ordinary skill in the art. For example, one of ordinary skill in the art would understand that two lines substantially parallel to each other are substantially parallel, but may deviate slightly from perfect parallelism.

[0012] This disclosure is directed to providing performance effects for entertainment purposes. For example, this embodiment can be used to entertain customers in an amusement park. The amusement park may include a wide variety of features, such as rides (e.g., roller coasters), theatrical performances, set design, performers, and / or decorative elements, to entertain customers. Performance effects can be used to complement or supplement said features, such as to provide customers with a more immersive and / or unique experience. For example, performance effects may be presented together with real-world objects to provide customers with an interactive experience.

[0013] The attraction system according to this embodiment may include a performance effects system configured to present virtual or simulated objects that complement the appearance of real-world objects. For example, the performance effects system may track a customer's facial features and expressions to overlay virtual images or digital elements onto real-world objects (e.g., map them to the customer's facial features and expressions), such as in real-time or near real-time. It may be desirable to provide virtual images in a convincing manner (e.g., having an appropriate size relative to the customer's features). Thus, the virtual images may look like real-world objects in order to provide a realistic performance effect for the customer.

[0014] Therefore, embodiments of this disclosure are directed to performance effects systems that provide virtual images (e.g., one or more virtual images) with a realistic appearance, such as by providing a three-dimensional (3D) appearance to the virtual images and / or positioning them at an appropriate depth from the customer's perspective. In particular, the performance effects system may include one or more sensors to detect the customer's position relative to the performance effects system and one or more attributes of the customer (e.g., height, facial features). The performance effects system can utilize Pepper's illusion-based technology, where optical beamsplitters (e.g., glass, semi-reflective mirrors) provide a realistic depiction of a combination (e.g., superposition, combination, overlap) of images from a first region (e.g., images transmitted through the optical beamsplitter) and images from a second region (e.g., images reflected from the optical beamsplitter). In other words, the optical beamsplitters can be arranged such that a first image projected through the beamsplitter can be transmitted, and a second image projected onto the beamsplitter can be reflected.

[0015] In one embodiment, a customer may be located on a first side of the optical beamsplitter, and the customer's image (e.g., a reflection of the customer) may be deflected from the optical beamsplitter and return towards the customer (e.g., relative to the customer's viewing angle). Therefore, the customer can view their own image via the optical beamsplitter. Furthermore, the performance effects system may include a display and a mirror on a second side of the optical beamsplitter (opposite to the first side). The display may project a virtual image onto the mirror, and the mirror may be arranged (e.g., at an angle relative to the optical beamsplitter) to deflect the appearance of the virtual image through the optical beamsplitter. Therefore, the customer can view the virtual image via projection through the optical beamsplitter. In this way, the customer can observe their own reflected image and the virtual image projected through the optical beamsplitter in a combined, superimposed, or overlapping appearance via the optical beamsplitter. The sensor may determine the customer's position and / or orientation relative to the optical beamsplitter. For example, the performance effects system may adjust the projection of the virtual image onto the display based on the customer's position to adjust the appearance of the virtual image deflected by the mirror through the optical beamsplitter for the customer to view. The adjusted projection of a virtual image onto a display can realistically depict a virtual image with appropriate 3D depth and size relative to the customer's viewing angle (corresponding to the customer's position relative to the optical beamsplitter). For example, a performance effects system can achieve this by including actuators (such as motorized tracks or robotic arms) that adjust the orientation of the display and mirrors relative to each other (e.g., moving the display and mirrors away from and / or toward each other), wherein the mirrors are angled to direct light from the display toward the beamsplitter. Adjusting the orientation of the display and mirrors relative to each other can adjust the appearance of the virtual image via the beamsplitter, such as the depth at which the virtual image can be positioned. In another example, the performance effects system can adjust the orientation and / or orientation of the beamsplitter based on the customer's orientation. This can be done alone or in combination with adjusting the orientation and / or orientation of the mirrors, the display, or both. The customer can be positioned at an angle relative to the beamsplitter. The beamsplitter can be angled, rotated, moved, or otherwise based on the customer's orientation to provide a virtual image with appropriate depth and size relative to the customer's viewing angle. Therefore, customers can view virtual images with appropriate depth of view and size.

[0016] Additionally or alternatively, the performance effects system can project virtual images based on a threshold distance (e.g., a threshold distance range) of the customer within the performance effects system (e.g., an optical beam splitter). For example, the mirrors and displays of the performance effects system can be fixed relative to each other and / or relative to the optical beam splitter.Therefore, when the display is activated, the virtual image projected onto the mirror by the display and deflected by the mirror through the optical beam splitter may have the same 3D appearance (e.g., the same depth orientation). The projection of the virtual image when the customer is within a threshold distance may make the virtual image have an appropriate appearance relative to the customer's viewpoint. For example, the virtual image may look like a real-world object that is properly positioned (e.g., superimposed on) relative to the customer's reflected image. The virtual image may also be blocked from projection based on the customer being outside the threshold distance of the performance effect system. In this way, the projection of the virtual image can be carried out when the customer is in a specific position where the projected virtual image may have a realistic appearance relative to the customer's reflected image. However, the projection of the virtual image may be blocked when the customer is not in that specific position where the projected virtual image may have a realistic appearance relative to the customer's reflected image. Therefore, the virtual image can be selectively projected to have an appropriate appearance (e.g., depth of view) from the customer's viewpoint. For example, the virtual image may look like it is at the same or substantially similar depth as the customer.

[0017] In view of the above, FIG1 is a schematic diagram of an embodiment of an attraction system 50 of an amusement park. As an example, customer area 52 may include paths (e.g., sidewalks, queues, routes) that customers 54 can navigate through. As another example, customer area 52 may include spaces (e.g., seating areas, standing areas) where customers 54 can reside to watch a performance. As a further example, customer area 52 may include vehicles that can move and transport customers 54 through attraction system 50.

[0018] Furthermore, attraction system 50 may include performance effects system 56 (e.g., a Pepper's Illusion-based system) that can provide entertainment to customers 54 located in customer area 52 and / or within attraction system 50. For example, performance effects system 56 can provide an immersive experience for customers 54. The performance effects system 56 may include a sensor 58 (e.g., representing one or more sensors) that generates sensor data associated with one or more customers 54; a virtual area 60 (e.g., an augmented reality scene) for providing performance effects (e.g., virtual image projection, performance effect projection) viewed by one or more customers 54; and a beam splitter 62 between the customer area 52 and the virtual area 60. In this way, the customer area 52 may be located on a first side of the beam splitter 62, and the virtual area 60 may be located on a second side of the beam splitter 62 (opposite to the first side).

[0019] By way of example, a customer may approach the performance effects system 56 via the customer area 52. The sensor 58 may be positioned to monitor customer activity associated with one or more customers 54.For example, customer activity may include postures provided by one or more customers 54, such as movement of body parts (e.g., head, arms, legs). In another example, customer activity may include the distance between one or more customers 54 and the performance effects system 56. For this purpose, sensor 58 may include cameras (e.g., optical cameras, 3D cameras, infrared (IR) cameras, depth-based cameras), orientation sensors (e.g., sonar sensors, radar sensors, laser imaging, detection and ranging (LIDAR) sensors), time-of-flight sensors, and the like. For example, sensor 58 may generate video data of one or more customers 54 (e.g., in IR spectrum, which may be invisible to one or more customers 54). In one embodiment, sensor 58 may include a low-latency face and / or body tracking system. For example, sensor 58 may include a laser-based time-of-flight sensor that generates sensor data in multi-hertz to track the longitudinal orientation of one or more customers 54 relative to the performance effects system 56. In another example, sensor 58 may include a computer vision system that tracks the longitudinal and lateral orientation of one or more customers 54 relative to the performance effects system 56. In this way, rapid movements (e.g., body parts, facial expressions) of one or more customers 54 can be captured by sensor data. In one embodiment, one or more customers 54 may wear or otherwise hold tags, such as IR reflective tags or ultraviolet (UV) tags, which can be tracked by sensor 58 to determine customer activity associated with one or more customers 54.

[0020] Sensor 58 can generate sensor data indicating the presence and / or perspective (e.g., line of sight) of one or more customers 54. For example, sensor 58 can detect movement indicating that one or more customers 54 are approaching the performance effects system 56. In another example, sensor 58 can track one or more attributes of one or more customers 54 (e.g., facial features, height, eye level). The performance effects system 56 can then operate based on such sensor data to provide performance effects. Additionally or alternatively, sensor data can be analyzed to determine the line of sight of one or more customers 54, and the performance effects system 56 can operate to improve the visibility of the performance effects.

[0021] The beam splitter 62 can combine the appearance of one or more customers 54 with images (e.g., virtual images) from the virtual area 60 (e.g., overlay, overlap, misalignment) to provide a performance effect to one or more customers 54.For example, beam splitter 62 can be partially visible and partially reflective, allowing images projected through it to be transmitted and images projected onto it (e.g., based on light reflected from a customer's face) to be reflected. For instance, beam splitter 62 can reflect light from the viewing area back as a reflected image to one or more customers 54. In effect, beam splitter 62 can reflect images of one or more customers 54 located adjacent to it, allowing them to view their own reflected images. Furthermore, beam splitter 62 can allow one or more customers 54 to view virtual images projected from virtual area 60 through it. Therefore, one or more customers 54 can view both reflected and virtual images via beam splitter 62. The properties of the materials constituting beam splitter 62 can facilitate this operation. For example, beam splitter 62 may be made of a material that includes both transmission and reflection properties (such as glass, plastic, foil, and / or translucent mirror) to allow one or more customers 54 to view both reflected and transmitted images via beam splitter 62.

[0022] Virtual area 60 may include various components configured to generate and project virtual images with an accurate depth appearance (e.g., relative to the appearance of one or more customers 54). For example, virtual area 60 may include actuator 66 (e.g., linear actuator, rotary actuator), display 68, and mirror 70. Display 68 may include any suitable display (e.g., liquid crystal display (LCD), light-emitting diode (LED) display, organic light-emitting diode (OLED) display, micro LED) that receives image data and projects (e.g., displays) the image data as a virtual image. Display 68 may project the virtual image onto mirror 70, and mirror 70 may deflect the virtual image through beam splitter 62 for viewing by one or more customers 54. Thus, the virtual image projected by display 68 may supplement the reflected image of one or more customers 54. Display 68 can adjust or manipulate virtual images to enhance (e.g., distort, alter, overlay, or interact with) the reflected images of (one or more) customers 54. For example, the virtual images may include a goblin effect that transforms the appearance of (one or more) customers 54 (e.g., as viewed from the customer's perspective) into that of a goblin. In one embodiment, display 68 may include a two-dimensional (2D) display. In additional or alternative embodiments, display 68 may include a 3D or volumetric display, such as an autostereoscopic display, a light field display, and the like. Still in other embodiments, display 68 may include a tracked 3D surface projected and mapped by a projection system within display 68.For example, display 68 may include a flexible display shaped like a face, and the virtual image may be a mask shaped like a face, which can be positioned to match the customer's distance and posture. In this way, the virtual image can be projected to align with a reflected image of the customer's face.

[0023] Actuator 66 may be coupled to display 68 and / or mirror 70 and may adjust the orientation and / or orientation of display 68 and / or mirror 70 based on sensor data. For example, actuator 66 may move display 68 and / or mirror 70 along one or more motorized tracks, such as in a direction along the plane of beam splitter 62 (e.g., lateral direction, longitudinal direction) and / or in a direction intersecting the plane of beam splitter 62 (e.g., longitudinal direction). Movement of display 68 and / or mirror 70 along beam splitter 62 may move the orientation of the virtual image viewed by one or more customers 54 along beam splitter 62. Movement of display 68 and / or mirror 70 intersecting the plane of beam splitter 62 may adjust the depth of view of the virtual image. In another example, actuator 66 can adjust the relative orientation between display 68 and mirror 70 to adjust the depth of view of the virtual image. The distance (e.g., relative to beam splitter 62) of the virtual image depth of view specification (page 5 / 15, 9 CN 121079135 A) can be based on the distance between display 68 and mirror 70. For example, increasing the distance between display 68 and mirror 70 by one centimeter (cm) (e.g., 0.4 inches) (such as by moving mirror 70 and / or display 68 away from each other) can increase the depth of view of the virtual image by two centimeters (e.g., 0.8 inches). The movement of display 68 and / or mirror 70 relative to each other for adjusting the depth of view of the virtual image can reduce the amount of torque and / or power consumed by actuator 66 compared to moving each of mirror 70 or display 68 relative to (e.g., toward, away from, left, right) beam splitter 62 using actuator 66 (or other actuators). Additionally or alternatively, actuator 66 may adjust the angle (e.g., tilt) between mirror 70 and display 68. Adjusting the angle between mirror 70 and display 68 may adjust the appearance of the virtual image, such as the angle at which the virtual image appears when viewed by one or more customers 54. If changing this angle results in any distortion, in some embodiments the virtual image may be adjusted to counteract said distortion.

[0024] In some cases, beam splitter 62 may include a visual barrier to hide virtual area 60 from the customer's perspective and / or limit the performance effect to one or more specific customers 54 who are directly looking at beam splitter 62. For example, beam splitter 62 may be covered by a visual barrier (e.g., fabric (e.g., black cloth), membrane (e.g., privacy film)). In this way, ambient light in virtual area 60 may be attenuated or blocked by the visual barrier.For example, reducing ambient light in virtual area 60 can allow one or more customers 54 to view the projected virtual image more clearly and better block direct observation of the display 68 and / or mirror 70 through beam splitter 62. In another example, performance effects system 56 may have multiple customers 54 viewing it. However, when one or more customers 54 are not looking at beam splitter 62 from a particular angle, the performance effects projection may appear distorted or altered. For example, when viewing beam splitter 62 from an undesirable angle, one or more customers 54 may perceive the image from virtual area 60 as incorrectly combined with the appearance of the customer's reflected image. To address this, visual barriers can reduce or prevent one or more customers 54 from viewing the performance effects from an undesirable angle. For example, a visual barrier can cause light to travel perpendicularly through beam splitter 62 along the plane in which it extends, making the performance effects invisible to one or more customers 54 looking at beam splitter 62 from an oblique angle (rather than a perpendicular angle).

[0025] In one embodiment, the beam splitter 62 may be coupled to an actuator (e.g., a linear actuator, a rotary actuator) that can adjust the orientation and / or orientation of the beam splitter 62 based on the orientation and / or orientation of one or more customers 54. The orientation and / or orientation of the beam splitter 62 can be adjusted to match the angle of one or more customers 54 when the customers 54 are looking at the beam splitter 62 from an angle. Movement of the beam splitter 62 (e.g., toward or away from one or more customers 54) can adjust the orientation of the reflected image and / or virtual image as viewed by one or more customers 54. Furthermore, adjustments to the orientation (e.g., rotational movement) can adjust the appearance of the reflected image and / or virtual image. For example, the orientation of the edges of the beam splitter 62 can be adjusted so that the beam splitter 62 can be rotated. In some cases, visual barriers may not be used to reduce or prevent one or more customers 54 from viewing the performance effect projection. Therefore, the viewing area can be expanded by adjusting the orientation and / or orientation of beam splitter 62. As previously mentioned, beam splitter 62 can also be adjusted in conjunction with adjustments to the orientation and / or positioning of other features (e.g., display 68 and mirror 70) to achieve a desired result (e.g., adapting to a particular customer's viewing point).

[0026] Virtual area 60 may also include object 72 located within virtual area 60. One or more customers 54 may be able to view object 72 through beam splitter 62. For example, object 72 may be viewed as a transmitted image through beam splitter 62.In some cases, object 72 may include physical objects, such as props, animated characters, people (e.g., performers in costumes), or any other suitable physical objects placed within virtual area 60, to create an interactive experience for one or more customers 54. For example, object 72 may provide the appearance of a virtual environment in which the reflected image of one or more customers 54 can be positioned. Thus, object 72 may further provide one or more customers 54 with a performance effect that looks realistic. In some cases, actuator 66 may be coupled to the physical object and may adjust the orientation of the physical object based on sensor data. For example, actuator 66 may adjust the reflected image of the physical object relative to one or more customers 54 and / or the appearance of the physical object relative to beam splitter 62 (when viewed by one or more customers 54).

[0027] In some cases, light source 73 (e.g., LED, OLED, bulb) may be used to illuminate object 72 and / or adjust the lighting of virtual area 60 to improve the visibility of object 72. For example, in one embodiment where ambient light is limited in the virtual area 60, the light source can enable one or more customers 54 to view the object 72 more clearly. As further described with respect to FIG3, the light source 73 can be modulated to illuminate the virtual area 60, thereby adjusting the visibility of the virtual image, the image of the virtual area 60, or a combination thereof. In other cases, the object 72 can be an additional virtual image projected (e.g., without using mirror 70) via beam splitter 62. For example, an additional display can project the object 72 directly through beam splitter 62 without first deflecting the image of the object 72 from a mirror (e.g., mirror 70).

[0028] The performance effects system 56 may include a controller 74 (e.g., a control system, an automatic controller, a programmable controller, an electronic controller, a control circuit module, a cloud computing system) configured to instruct the operation of the performance effects system 56 to provide an interactive experience to one or more customers 54. The controller 74 may include a memory 76 and a processor 78 (e.g., a processing system, a processing circuit module). Memory 76 may include volatile memory (such as random access memory (RAM)) and / or non-volatile memory (such as read-only memory (ROM), optical drive, hard disk drive, solid-state drive, or any other non-transitory computer-readable medium including instructions for operating the effects system 56). Processor 78 may be configured to execute such instructions. For example, processor 78 may include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof.

[0029] The controller 74 may receive sensor data from the sensor 58 and instruct the operation of the performance effects system 56 based on the orientation and / or orientation of the customer 54 (e.g., relative to the beam splitter 62) (as determined from the sensor data). For example, using the sensor data, the controller 74 may use image analysis techniques to determine the orientation of (one or more) customers 54 relative to the beam splitter 62, such as the distance between (one or more) customers 54 and the beam splitter 62. In another example, the controller 74 may use image analysis techniques to determine the orientation of (one or more) customers 54 relative to the beam splitter 62, such as the angle of (one or more) customers 54 relative to the beam splitter 62, the line of sight of (one or more) customers 54, the viewing direction of (one or more) customers 54, and so on. The controller 74 may then determine the target orientation of the virtual image viewed by (one or more) customers 54 based on the orientation and / or orientation of (one or more) customers 54. The controller 74 can identify the corresponding orientation and / or orientation of the display 68 and mirror 70 relative to the beam splitter 62 and / or relative to each other, so that the display 68 can project a virtual image that appears to be in the target orientation. In some cases, the controller 74 can determine the corresponding orientation and / or orientation of the beam splitter 62. For this purpose, the controller 74 can utilize data from a high-speed, low-latency computer vision face tracking system to identify the orientation and / or orientation of(one or more) customers 54 relative to the beam splitter 62, and instruct the adjustment of the orientation of the display 68 and / or mirror 70 based on the orientation of(one or more) customers 54. Therefore, the orientation and / or orientation of the projected virtual image can more accurately correspond to the orientation of(one or more) customers 54.

[0030] By way of example, the controller 74 can operate such that the projected virtual image has a depth of view that matches the reflected image of(one or more) customers 54. For example, the projected virtual image may include clothing, and matching the depth of view of the projected virtual image with the depth of view of the reflected image of(one or more) customers 54 can provide the appearance that(one or more) customers 54 are wearing the clothing. To this end, controller 74 may instruct actuator 66 to position display 68 and / or mirror 70 at a distance relative to beam splitter 62 that matches (or substantially matches) the relative distance between beam splitter 62 and(one or more) customers 54. Controller 74 may also monitor movement data of(one or more) customers 54 and, based on the monitored movement data, instruct actuator 66 to adjust the orientation of display 68 and / or mirror 70.For example, in response to determining that one or more customers 54 move toward (e.g., in the longitudinal direction) beam splitter 62, controller 74 may instruct actuator 66 to move display 68 and mirror 70 toward beam splitter 62 and / or to move display 68 and mirror 70 toward each other. In response to determining that one or more customers 54 move relative to beam splitter 62 in the lateral direction (e.g., left, right), controller 74 may instruct actuator 66 to move mirror 70 and display 68 in the corresponding lateral direction.

[0031] In an additional or alternative embodiment, controller 74 may instruct delayed adjustments to the orientation of display 68 and / or mirror 70 based on the orientation of one or more customers 54. Delayed adjustments to the orientation of display 68 and / or mirror 70 may provide one or more customers 54 with different performance experience. By way of example, virtual images may include an outline surrounding one or more customers 54. Delayed movement of display 68 and / or mirror 70 can delay the movement of the silhouette, which may provide a ghostly appearance of the silhouette corresponding to the previous orientation of (one or more) customers 54. Otherwise, more immediate adjustments to the orientation of display 68 and / or mirror 70 based on the orientation of (one or more) customers 54 may not provide the ghostly appearance.

[0032] In some cases, actuator 66 may have a minimum or maximum permissible range of movement (e.g., in the longitudinal, lateral, and vertical directions). For example, controller 74 may prevent display 68 and / or mirror 70 from moving beyond certain portions along the motorized track. In response to the determination that the orientation of display 68 and / or mirror 70 based on the customer's orientation may exceed the permissible range, controller 74 may prevent the presentation of virtual images via display 68. Therefore, virtual images may not be presented to (one or more) customers 54 at certain locations in customer area 52.

[0033] Additionally or alternatively, the controller 74 may determine attributes of one or more customers 54 (such as facial features (e.g., eye orientation, nose orientation, mouth orientation, facial expression)) based on sensor data to identify corresponding image data to be transmitted to the display 68 for projecting virtual images. For example, the controller 74 may instruct adjustments to the size, shape, color, etc., of the virtual image based on the attributes of one or more customers 54. In one embodiment, the controller 74 may determine the height of one or more customers 54 and instruct adjustments to the size of the virtual image projected by the display 68 so that the appearance of one or more customers 54 is aligned with the virtual image. For example, the virtual image may include a mask superimposed on a reflective image of the customer's face to provide the appearance of the projected virtual image of one or more customers 54 wearing a mask.The controller 74 can instruct the display 68 to project a virtual image of the mask such that the size of the virtual image corresponds to the size of the customer's face, so as to appropriately overlay the virtual image of the mask to appear as if it were being worn by one or more customers 54. In another example, the controller 74 can instruct the display 68 and / or the mirror 70 to adjust their orientation so that the size of the virtual image corresponds to the size of the customer's face. Thus, the controller 74 can determine various attributes of one or more customers 54 based on sensor data to determine the size and / or placement of facial features, thereby giving the projected virtual image of the mask an appearance adapted to the size and / or placement of the facial features. Thus, the performance effects system 56 can convincingly provide the appearance of the projected virtual image of one or more customers 54 wearing a mask. It should also be noted that the light intensity associated with the mask (e.g., the brightness of the image of the mask on the display 68) can be adjusted based on detected illumination to control the mask to a desired level of perceived opacity or translucency.

[0034] Furthermore, the controller 74 can instruct the display 68 to adjust the projection of the virtual image based on the movement of(one or more) customers 54 (such as as indicated by adjustments to the facial features of(one or more) customers 54).(one or more) customers 54 may turn their heads, such as by turning their cheeks to face the beam splitter 62, or tilting their chins or their foreheads to face the beam splitter 62. Thus, the reflected image of the customer's face may be adjusted. In some cases, the orientation and / or orientation of the beam splitter 62 may be adjusted so that(one or more) customers 54 appear to be wearing a mask (in a convincing manner). In other cases, the controller 74 may determine the movement of(one or more) customers 54 and / or the adjustment of the reflected image of the customer's face, and may instruct the actuator 66 to tilt or rotate the display 68 so that(one or more) customers 54 appear to be wearing a mask. For example, the size of the projected image may be adjusted to fit and conform to the adjusted facial features of(one or more) customers 54.

[0035] In another example, the sensor data may include additional information about the customer(s) 54, such as the orientation and / or orientation of the customer(s) 54's limbs. By way of example, the virtual image may include costumes to be superimposed on the body of the customer(s) 54's reflected image. For this reason, the controller 74 may determine the posture of the customer 54 based on the sensor data, such as the orientation of the customer's arms, legs, torso, and feet. The controller 74 may then instruct the display 68 to project a virtual image of the costume based on the posture to provide the appearance (in a convincing manner) of the projected virtual image of the customer(s) 54 wearing the costume.For example, controller 74 may instruct display 68 to project a virtual image of a costume to match the positioning of various body parts of customer(s) 54. Based on the movement of customer(s) 54, which may cause various body parts to move, controller 74 may instruct display 68 to change the corresponding appearance of the virtual image.

[0036] As previously mentioned, object 72 may be viewed together with the virtual image provided by display 68 via beam splitter 62. Like display 68, object 72 may also be controlled. For example, controller 74 may instruct actuator 66 (which may represent one or more actuators operating together or separately) to adjust the orientation of object 72 based on the orientation of customer(s) 54. For example, object 72 may include a physical hat that appears to be worn by customer(s) 54 (e.g., superimposed on a reflected image when viewed from the customer's perspective). Controller 74 may instruct actuator 66 to adjust the orientation, shape, orientation, or other aspects of object 72 based on determined movement of customer(s) 54.

[0037] In one embodiment, multiple performance effects systems 56 may be positioned adjacent to each other within the attraction system 50. For example, the beam splitters 62 of each performance effects system 56 may be aligned to appear as continuous, uniform, or monolithic pieces from the customer's perspective. Multiple customers 54 may be located within the customer area 52, and the corresponding performance effects system 56 may provide performance effects to each different customer 54 to provide virtual images that appear correctly positioned (e.g., with depth of view) for each customer's different perspective.

[0038] Furthermore, in one embodiment (e.g., where the orientation of the display 68 and / or mirror 70 may be fixed), the controller 74 may instruct the display 68 to project virtual images in response to determining that one or more customers 54 are within a threshold distance (e.g., a threshold distance range) relative to the beam splitter 62. For example, the projection of virtual images via the display 68 when one or more customers 54 are within a threshold distance relative to the beam splitter 62 may make the virtual images appear to be in the appropriate orientation (e.g., at the appropriate depth) relative to the reflected images of one or more customers 54. As an example, the distance between beam splitter 62 and display 68 and / or mirror 70 may be the same as a threshold distance. Therefore, the virtual image can have a depth of view matching the reflected image of customer(s) 54.

[0039] FIG2 is a side view of the performance effects system 56. In particular, FIG2 depicts customer 54 standing in a first position 105 and looking at the performance effects system 56 and moving towards a second position 107. Customer 54 can view the reflected image 102 at a depth of view equivalent to the distance between customer 54 and beam splitter 62. Components of virtual region 60 can generate and project a virtual image 110 (e.g., one or more virtual images) combined with the reflected image 102.For example, the controller 74 can position the display 68 and / or mirror 70 at a distance from the beam splitter 62 similar to the distance between the customer 54 and the beam splitter 62. In this way, the projected virtual image 110 can be transmitted through the beam splitter 62 as a transmitted image 103 and appear to be at the same or substantially similar depth of view as the reflected image 102. In fact, the reflected image 102 and the transmitted image 103 can be combined to create a performance effect projection. Furthermore, the depth of view can be taken into account when adding the virtual image 110 to the reflected image 102, because the virtual image 110 should be properly coordinated with the reflected image 102. For example, the virtual costume should fit the reflected image 102 of the customer 54. Specification 9 / 15 pages 13 CN 121079135 A

[0040] In the illustrated performance effect system 56, the sensor 58 can be positioned to track the movement of the customer 54 within the customer area 52 and relative to the beam splitter 62. Customer 54 may wear or otherwise hold tag 100 to facilitate tracking of customer 54's movement via sensor 58. For example, sensor 58 may monitor the orientation of customer 54 relative to beam splitter 62 in longitudinal direction 104, lateral direction 106, and / or vertical direction 108. The performance effects system 56 also includes a virtual area 60 in which actuator 66, display 68, and mirror 70 can be positioned. Reflections of customer 54 via beam splitter 62 can provide a reflected image 102 of customer 54, and the reflected image 102 may appear to be in a first orientation 105 (e.g., within virtual area 60). Furthermore, display 68 may project a virtual image 110 onto mirror 70 for deflection from mirror 70 through beam splitter 62. Thus, virtual image 110 may be visible to customer 54 as a transmitted image 103 appearing to be in a second orientation 107 (e.g., within virtual area 60). The combination of reflected image 102 and transmitted image 103 can be perceived by customer 54 as a performance effect. Although the illustrated display 68 includes a 2D display capable of generating a 2D virtual image 110 for deflection from mirror 70 and viewing by customer 54, display 68 may include a large stereoscopic or light field-based display system capable of generating a 3D virtual image 110 for deflection from mirror 70 and viewing by customer 54.

[0041] Returning to sensor 58, sensor 58 may be located adjacent to (e.g., on top of, or on its lateral side) or embedded therein with beam splitter 62. Sensor 58 may generate sensor data associated with customer 54 during operation of performance effects system 56. Sensor data may include attributes of customer 54, orientation of customer 54, and / or orientation of customer 54. Performance effects system 56 may include, and the illustrated sensor 58 may represent any suitable number of sensors 58 to provide accurate sensor data associated with customer 54.

[0042] In one embodiment, a customer 54 may wear or hold a tag 100, which may be tracked by a sensor 58. The tag 100 may include luminescent colored or infrared (IR) light-emitting diodes (LEDs), passive reflective markings, printed patterns (e.g., QR codes or other types of barcodes), or known markings, or the like. For example, the tag 100 may be a printed pattern on a prop (such as a hat, headband, clip, etc.). The customer 54 may wear the prop, and the sensor 58 may generate sensor data indicating the tag 100. The controller 74 may receive the sensor data generated by the sensor 58 and determine the location of the tag 100 based on the sensor data to determine the orientation of the customer 54. In one embodiment, the tag 100 may include a wired or wireless communication device communicatively coupled to the sensor 58, such as an AR headset, a mobile phone, a radio frequency (RF) orientation-based wearable device, and the like. For example, the tag 100 may include an RF orientation-based wearable device, such as a watch, glasses, or mask, embedded with an ultra-wideband (UWB) tracking beacon that transmits signals to the sensor 58. The signal may include the orientation of marker 100 within customer area 52, which may be associated with the orientation of one or more customers 54 within customer area 52.

[0043] Controller 74 may instruct actuator 66 (which may represent one or more actuators operating together or separately) to adjust the orientation of display 68 and / or mirror 70 based on received sensor data. For example, display 68 and / or mirror 70 may be coupled to track 112 extending along vertical direction 108, and controller 74 may instruct actuator 66 to move display 68 and / or mirror 70 along track 112 (e.g., along vertical direction 108). For example, controller 74 may instruct actuator 66 to adjust the orientation of display 68 and / or mirror 70 relative to each other along vertical direction 108 to adjust the depth of view of transmissive image 103, thereby adjusting the second orientation 107 of transmissive image 103. In some cases, mirror 70 may remain fixed at the customer 54's line of sight (e.g., vertically aligned with the customer's viewing angle), and controller 74 may instruct actuator 66 to move display 68 relative to mirror 70. For this reason, display 68 may project virtual image 110, and mirror 70 may deflect virtual image 110 through beam splitter 62 to the customer 54's line of sight, thus reducing image distortion that might otherwise occur due to misalignment between the deflection of virtual image 110 and the customer 54's line of sight.

[0044] In the illustrated example, customer 54 is located in front of beam splitter 62 and can move toward beam splitter 62 in the longitudinal direction 104. In fact, Figure 2 illustrates this movement as indicated by arrow 114 from first configuration 116A to second configuration 116B in specification page 10 / 15, CN 121079135 A.The movement of customer 54 along longitudinal direction 104 toward beam splitter 62 may alter the depth of view associated with a first orientation 105 of reflected image 102 along longitudinal direction 104. Such alterations are described by differences in first configuration 116A and second configuration 116B. For example, reflected image 102 may increase in size, may appear positioned closer to beam splitter 62, or both. Controller 74 may operate performance effects system 56 to provide a desired appearance of transmitted image 103 relative to reflected image 102. For example, controller 74 may operate based on the depth of view associated with the first orientation 105 of reflected image 102 to adjust the depth of view associated with a second orientation 107 of transmitted image 103. To this end, controller 74 can receive sensor data (e.g., associated with marker 100, associated with customer 54), determine the orientation and / or orientation of customer 54 relative to beamsplitter 62 based on the sensor data, and transmit signals based on the orientation and / or orientation of customer 54 relative to beamsplitter 62 to instruct actuator 66 to adjust the orientation and / or orientation of display 68 and / or mirror 70. For example, controller 74 can instruct actuator 66 to move display 68 along vertical direction 108 to change the distance between display 68 and mirror 70, thereby adjusting the depth of view associated with the second orientation 107 of transmitted image 103 (e.g., to align the second orientation 107 of transmitted image 103 (e.g., a mask aligned with the customer's face) and the first orientation 105 of reflected image 102 with each other, thereby maintaining the superposition of transmitted image 103 on reflected image 102). In one embodiment, reducing the distance between display 68 and mirror 70 may cause transmitted image 103 to appear positioned closer to beamsplitter 62. Therefore, in response to determining that the customer 54 is moving toward the beam splitter 62 (so that the first orientation 105 of the reflected image 102 appears closer to the beam splitter 62), the controller 74 may instruct the actuator 66 to move the display 68 and the mirror toward each other, so that the second orientation 107 of the transmitted image 103 appears closer to the beam splitter 62.

[0045] In one embodiment, the actuator 66 may include a multi-axis actuator system that can move the display 68 and / or the mirror 70 along the longitudinal direction 104 and / or the lateral direction 106 (e.g., along corresponding tracks). As an example, the actuator 66 may move the display 68 and / or the mirror 70 along the longitudinal direction 104 to adjust the depth of view associated with the second orientation 107 of the transmitted image 103. As another example, the customer 54 may move relative to the beam splitter 62 in the lateral direction 106, so that the first orientation 105 of the reflected image 102 moves along the lateral direction 106. In response, actuator 66 can move display 68 and / or mirror 70 along lateral direction 106 to adjust the second orientation 107 of transmissive image 103 accordingly along lateral direction 106.Such additional movement of the display 68 and / or mirror 70 can further enable control over the appearance of the performance effect presented to the customer 54. The actuator 66 can also adjust the angular orientation of the mirror 70 and / or display 68. Coordinated angular adjustments of the display 68 and / or mirror 70 can achieve desired image distortion or counteract image distortion. Furthermore, the image provided by the display 68 can be adjusted based on changes in the positioning of the mirror 70 and / or display 68, and such changes in the image can be made to create smooth transitions or intentionally add distortion to the transmitted image 103.

[0046] In one embodiment, the orientation and / or direction of the beam splitter 62 can be adjusted based on the orientation and / or direction of the customer 54 (e.g., via an actuator). For example, the customer 54 may be positioned in front of the beam splitter 62 and may be moving toward the beam splitter 62 in the longitudinal direction 104. The controller 74 can instruct the actuator to move the beam splitter 62 along the longitudinal direction 104 to change the distance between the customer 54 and the beam splitter 62, which may change the depth of view associated with the reflected image 102. In some cases, changing the orientation of the beam splitter 62 may change the distance between the beam splitter 62 and the display 68 and / or the mirror 70, which may adjust the depth of view associated with the transmitted image 103. Thus, the reflected image 102 and the transmitted image 103 can be combined with an appropriate depth of view to provide a performance effect. In another example, the customer 54 may view the beam splitter 62 at an angle. The controller 74 can determine the orientation of the customer 54 relative to the beam splitter 62 based on sensor data and instruct the actuator to adjust the orientation of the beam splitter 62. For example, the edge of the beam splitter 62 can be rotated so that the customer 54 can view the beam splitter 62 at a vertical angle. Thus, the customer 54 can view a performance effect projection with reduced or eliminated distortion.

[0047] FIG3 is a side view of the performance effect system 56. For example, customer 54 may move in the lateral direction 106, and sensor 58 may track the movement of customer 54 such that the projected virtual image is aligned with the reflected image 102 of customer 54. Specifically, Figure 3 depicts customer 54 standing at a first position 105 and moving towards a second position 107, where this transition is indicated by arrow 114.

[0048] Controller 74 may instruct actuator 66 to move mirror 70 based on sensor data received from sensor 58 and associated with customer 54. For example, as discussed herein, it may be desirable to align mirror 70 with the line of sight of customer 54 so that the virtual image 110 (e.g., when projected by display 68 and deflected from mirror 70) has a desirable (e.g., distortion-free) appearance when viewed by customer 54.For this reason, controller 74 can determine the gaze of customer 54 and, based on the gaze of customer 54, instruct actuator 66 to move mirror 70. By way of example, first customers 54, 54A may include adults of relatively tall stature, and second customers 54, 54B may include children of relatively short stature. Controller 74 can instruct actuator 66 to move mirror 70 to align with the height of customer 54. For example, controller 74 can instruct actuator 66 to move mirror 70 in a vertical direction 108 (e.g., downward) to change the alignment of mirror 70 from alignment with first customer 54, 54A to alignment with second customer 54, 54B. Although Figure 2 shows first customer 54, 54A, Figure 2 can be applied to any customer 54. Although Figure 3 shows second customer 54, 54B, Figure 3 can be applied to any customer 54. Additionally or alternatively, controller 74 can identify facial features (e.g., eye orientation) of customer 54 from sensor data to determine the gaze of customer 54. Based on eye orientation, controller 74 can instruct actuator 66 to adjust the orientation of display 68 and / or mirror 70.

[0049] As discussed herein, during operation of performance effects system 56, customer 54 may move relative to beam splitter 62, such as moving along lateral direction 106. In addition to or as an alternative to moving display 68 and / or mirror 70 along lateral direction 106 based on customer 54's movement, controller 74 can instruct display 68 to adjust the position where virtual image 110 is projected from display 68. Therefore, the position where virtual image 110 is projected onto mirror 70 and the second orientation 107 of transmitted image 103 deflected from mirror 70 can also be adjusted. For example, controller 74 can instruct display 68 to project virtual image 110 from a first position 146A on display 68 onto mirror 70 based on customer 54's orientation 138 along lateral direction 106. Customer 54 may move along the lateral direction 106, and controller 74 may instruct display 68 to project virtual image 110 from a second position 146B on display 68 onto mirror 70 based on updated orientation 138 of customer 54 along the lateral direction 106. For example, an adjustment in the projection of virtual image 110 from first position 146A to second position 146B may correspond to an adjustment of customer 54 along the lateral direction 106. In this way, the second orientation 107 of transmitted image 103 relative to the first orientation 105 of reflected image 102 can be maintained.

[0050] In addition to actuator 66, display 68, and mirror 70, the illustrated performance effects system 56 also includes an animated character 140 (e.g., with respect to object 72 described in FIG. 1) and a light source 73 placed within virtual area 60. Animated character 140 is visible to customer 54 via beam splitter 62.Therefore, in addition to the reflected image 102 and the transmitted image 103, the customer 54 can also see the animated character 140. In this way, the animated character 140 can further enhance the performance effect provided to the customer 54. In one embodiment, the movement of the animated character 140 can be coordinated with other aspects of the system (e.g., images from the display 68) to enhance immersion. It should be noted that the mirror 70 may be partially transparent so that the customer 54 can view the animated character 140 through the mirror 70 and also through the beam splitter 62.

[0051] The light source 73 can be modulated to increase or decrease the visibility of the reflected image 102, the transmitted image 103, and / or the animated character 140. For example, increasing the light in the virtual area 60 can increase the visibility of the animated character 140 when viewed by the customer 54. Decreasing the light in the virtual area 60 can increase the visibility of the transmitted image 103 when viewed by the customer 54. As an example, light source 73 can be dimmed to hide or reduce the visibility of virtual area 60 (such as the visibility of track 112) from the viewpoint of customer 54, while still ensuring sufficient visibility of animated character 140. In additional or alternative embodiments, light source 73 may include one or more additional light sources located in customer area 52, which can be used to adjust the visibility of reflected image 102, transmitted image 103, and / or animated character 140. Light source 73 can be used in conjunction to adjust the illumination of virtual area and / or customer area 52. For example, increasing the light in customer area 52 can increase the visibility of reflected image 102 when viewed by customer 54, and decreasing the light in customer area 52 can increase the visibility of animated character 140 when viewed by customer 54.

[0052] In some cases, the controller 74 may instruct actuators (e.g., linear actuators, rotary actuators) to move or rotate the animated character 140 based on sensor data indicating the orientation of the customer 54. For example, in response to the customer 54 moving in the lateral direction 106, the animated character 140 may move in the lateral direction 106. In this way, the animated character 140 may appear to interact with or respond to the customer 54's movement, such as by chasing the reflected image 102, thereby further enhancing the performance provided to the customer 54. The controller 74 may also adjust the operation of the light source 73 (e.g., the direction of light emission, the intensity of light emission) in response to the movement of the animated character 140 so that the animated character 140 can be seen by the customer 54. While the virtual area 60 includes the animated character 140, in additional or alternative embodiments, props (e.g., icons), toys, costumes (e.g., funny hats, glasses, masks), and other physical objects such as these may be positioned in the virtual area 60.

[0053] Each of Figures 4-6 described below illustrates a method or process for operating a performance effects system. Any suitable device (e.g., processor 78 of controller 74 illustrated in Figures 1-3) can use the features of performance effects system 56 to direct the corresponding method. In one embodiment, each method can be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium (e.g., memory 76 of controller 74 illustrated in Figures 1-3). For example, each method can be performed at least in part by one or more software components, one or more software applications, and the like. While each method is described using operations in a particular sequence, additional operations can be performed, the described operations can be performed in a different order than the illustrated sequence, and / or some described operations can be skipped or not performed at all. Furthermore, the corresponding operations of each method can be performed relative to each other in any way, such as in response to each other and / or in parallel with each other.

[0054] In view of the foregoing, Figure 4 is a flowchart of an embodiment of a method or process 160 for operating a performance effects system to provide immersive performance effects. In one embodiment, the controller of the performance effects system can track the customer's orientation and generate performance effects based on the customer's orientation.

[0055] At block 162, the controller can receive sensor data indicating the customer's orientation. For example, the sensor data can indicate the customer's orientation within a customer area. In another example, the sensor data can be associated with markings the customer may be holding, such as patterns, IR stickers, signals from wearable devices, or the like.

[0056] At block 164, the controller can determine the customer's orientation relative to a beam splitter, and the customer's orientation relative to the beam splitter can indicate the customer's line of sight. The controller can use image analysis techniques based on the sensor data to determine the customer's orientation relative to the beam splitter in the longitudinal, lateral, vertical, or combinations thereof. For example, the controller can determine the distance between the customer and the beam splitter to determine the customer's orientation in the longitudinal direction. In another example, the controller can determine the customer's height and / or the customer's eye orientation (e.g., estimated eye level) to determine the customer's orientation.

[0057] At block 166, the controller can instruct the adjustment of the position of the display and / or mirrors of the performance effects system based on the orientation. In one embodiment, the controller may instruct the actuator to adjust the distance between the display and the mirror based on the customer's orientation. In an additional or alternative embodiment, the controller may instruct the actuator to adjust the orientation of the display and the mirror in the longitudinal, lateral, and / or vertical directions (e.g., while maintaining the relative orientation of the display and the mirror with respect to each other).

[0058] At block 168, the controller may generate and instruct the transmission of image data to the display so that the display projects virtual images based on the image data.The projected virtual image can be deflected from a mirror and transmitted through a beam splitter to be visible to the customer as a transmitted image. Furthermore, the customer's appearance can be reflected from the beam splitter, making it visible to the customer as a reflected image. The transmitted and reflected images can be combined with each other to provide an immersive performance effect to the customer.

[0059] In one embodiment, the controller can generate image data and instruct the transmission of the image data to cause the projection of a virtual image corresponding to or adapted to the customer's attributes. For example, the image data may include a comical hat that appears to be worn by the customer's reflected image (e.g., when reflected by a beam splitter). The size and shape of the hat may be generated based on the size and shape of the customer's head (e.g., measured by sensors, or based on detected and stored customer attributes). In this way, the virtual image (when projected by a display) may have a more convincing appearance relative to the reflected image. In another example, the controller can generate image data that is partially superimposed or not superimposed on the customer's reflected image. For example, the controller may instruct the projection of a dinosaur that appears to be chasing the customer's reflected image. The controller can instruct the display to project a virtual image at a preset distance from the customer's reflected image and can adjust the image data based on the customer's orientation. In some cases, the controller can generate image data to adjust the distance between the projected virtual image and the customer's reflected image, such as reducing the distance until the virtual image partially overlaps the customer.

[0060] As described herein, the projected virtual image may have a more realistic appearance to the customer due to the position of the display and / or mirror adjusted based on the customer's orientation. For example, the depth of view of the virtual image may match the depth of view of the customer's reflected image. In fact, adjusting the distance between the display and the mirror can adjust the depth of view of the virtual image viewed by the customer. For example, increasing the distance between the display and the mirror can increase the viewing distance between the virtual image and the beam splitter. Furthermore, the position of the display and / or mirror (e.g., in the lateral direction, vertical direction) may cause the virtual image to be transmitted through the beam splitter at a desired position (such as to match the customer's position relative to the beam splitter). Furthermore, the position of the mirror can be aligned with the customer's line of sight to align the virtual image with the customer's line of sight, thereby reducing distortion of the virtual image.

[0061] Method 160 can also be repeated or continuously performed. For example, updated sensor data can be received, the customer's updated orientation (e.g., rotation, displacement) can be determined, the updated position of the display and / or mirror can be established, and updated image data can be generated and transmitted. Thus, the virtual image projected based on the image data can be updated to adapt to changes in the customer's orientation, thereby maintaining the realistic appearance of the virtual image.

[0062] Although the illustrated method or process 160 is described with respect to a single performance effects system, in one embodiment, multiple performance effects systems may perform method 160 to generate performance effects for multiple customers. For example, corresponding actuators (such as robotic attachments that may be coupled to displays and mirror pairs, respectively) may be instructed to adjust the orientation of multiple displays and / or multiple mirrors to provide a corresponding virtual image for each customer. In other words, each performance effects system may provide a corresponding virtual image that can be appropriately presented to each customer. In one example, corresponding controllers may operate different performance effects systems. In another example, multiple performance effects systems may be controlled by a single controller (e.g., a master controller).

[0063] FIG5 is a flowchart of one embodiment of a method or process 180 for operating performance effects systems to provide immersive performance effects. In one embodiment, the controller may track customer attributes and continuously generate performance effects based on customer attributes.

[0064] At block 182, the controller may receive sensor data indicating the customer (similar to block 162 in FIG4). At block 184, the controller may determine one or more customer attributes based on the sensor data. For example, the controller can determine height, facial features, orientation, etc. The controller can also determine the customer's body orientation, such as the orientation of the customer's arms, legs, feet, torso, etc.

[0065] At block 186, the controller can instruct the adjustment of the orientation and / or orientation of the display and / or mirror based on customer attributes. For example, the controller can determine the customer's line of sight based on facial features (e.g., eye orientation) and instruct the adjustment of the mirror's orientation in the vertical direction to align with the line of sight. In another example, the controller can instruct the rotation of the display and / or mirror to align with the line of sight or additional customer attributes. In another example, the controller can instruct the adjustment of the angle of the mirror relative to the beam splitter and / or relative to the display. In one embodiment, the controller can instruct the adjustment of the orientation and / or orientation of the beam splitter based on customer attributes. For example, the controller can determine the customer's orientation relative to the beam splitter and instruct the rotation of the beam splitter to align with the customer's orientation.

[0066] In box 188, the controller can generate and transmit image data to the display (similar to box 168 in FIG. 4). The controller can instruct parameters of the image data to be adjusted to match the customer's attributes. For example, the virtual image may include a superhero suit superimposed on the customer's appearance. The controller can determine the customer's posture (e.g., the position of various body parts) and generate image data based on the posture to make the virtual image of the superhero suit look more realistically as if it were worn by the customer.

[0067] FIG. 6 is a flowchart of one embodiment of a method or process 230 for operating a performance effects system to provide realistic performance effects.In one embodiment, the controller may monitor data corresponding to the customer's orientation relative to the beam splitter and, in response to determining that the customer is within a threshold distance of the beam splitter, indicate activation of the performance effect.

[0068] In block 232, the controller may receive sensor data indicating the customer (similar to block 162 in FIG. 4 and block 182 in FIG. 5). In block 234, the controller may determine the customer's orientation relative to the beam splitter (similar to block 164 in FIG. 4).

[0069] In block 236, the controller may determine whether the customer's orientation is within a threshold distance of the beam splitter (e.g., within a threshold distance range). For example, the display and mirror may be positioned at a fixed distance (or within a fixed range) from the beam splitter within a virtual area. The fixed orientation of the display and mirror may be related to providing the desired effect to the customer when the customer is approximately at a threshold distance from the beam splitter. When the mirror and / or display have a range of orientations, the threshold may vary with said range.

[0070] In response to determining that the customer's orientation is within a threshold distance, the controller may instruct the activation of a performance effect (similar to box 164 in Figure 4 and box 184 in Figure 5). For example, the performance effect may include the projection of a virtual image of flames enveloping the customer's appearance, and the virtual image may be deflected from a mirror and passed through a beam splitter for the customer to view. In another example, the virtual image may be a balloon perceived as appearing from behind the customer. By triggering the performance effect at the threshold distance, the virtual image may have a similar (or substantially similar) depth of vision compared to the customer's reflected image. Thus, the performance effect can have a realistic appearance relative to the reflected image.

[0071] If the customer's orientation is not within the threshold distance, the controller may not generate a performance effect, and the method or process may return to box 232 to receive sensor data indicating the customer. This avoids the presentation of images that cannot be properly fitted together because the customer's viewpoint is outside the expected range of viewing. Avoiding operation outside certain thresholds prevents the customer from observing inconsistencies in operation that could disrupt immersion.

[0072] While only certain features of this disclosure have been illustrated and described herein, many modifications and alterations will occur to those skilled in the art. Therefore, it is to be understood that the appended claims are intended to cover all such modifications and alterations as fall within the true spirit of this disclosure.

[0073] The techniques presented and claimed herein are referenced and applied to substantial objects and concrete instances that can arguably improve the practical nature of the art, and are therefore not abstract, abstract, or purely theoretical. Furthermore, if any claim appended to the end of this specification contains one or more elements designated as “component for (performing)...(function)” or “step for (performing)...(function)”, such elements are intended to be interpreted in accordance with 35 USC 112(f).However, for any claim containing elements specified in any other manner, it is intended that such elements not be interpreted according to 35U.SC112(f). Specification 15 / 15 pages 19 CN 121079135 A Figure 1 Specification Figure 1 / 5 pages 20 CN 121079135 A Figure 2 Specification Figure 2 / 5 pages 21 CN 121079135 A Figure 3 Specification Figure 3 / 5 pages 22 CN 121079135 A Figure 4 Figure 5 Specification Figure 4 / 5 pages 23 CN 121079135 A Figure 6 Specification Figure 5 / 5 pages 24 CN 121079135 A.

Claims

1. An amusement park show effect system, the show effect system comprising: a display configured to project one or more virtual images; a mirror configured to deflect the one or more virtual images; one or more sensors configured to transmit guest data based on guest detection in a viewing area, wherein the guest data includes position and / or orientation data indicative of a guest relative to the mirror; one or more actuators coupled with the display and / or the mirror and configured to adjust a positioning of the display and / or the mirror; a beamsplitter between the viewing area and the mirror, wherein the beamsplitter is configured to: reflect light from the viewing area back to the viewing area as a reflected image; and enable the one or more virtual images deflected from the mirror to be transmitted through the beamsplitter to the viewing area as a transmitted image; and one or more controllers communicatively coupled with the one or more sensors and with at least the one or more actuators or the display, wherein the one or more controllers are configured to instruct the one or more actuators to adjust a bearing and / or an orientation of the display, the mirror, or both based on the guest data.

2. The show effect system of claim 1, wherein, the guest data includes guest height data, and wherein the one or more controllers are configured to instruct the one or more actuators to adjust the bearing and / or the orientation of the display, the mirror, or both based on the guest height data.

3. The show effect system of claim 2, wherein, the one or more controllers are configured to estimate a guest perspective based on the guest height data.

4. The show effect system of claim 3, wherein, the one or more controllers are configured to instruct the one or more actuators to adjust the bearing and / or the orientation of the display, the mirror, or both based on the guest perspective to cause the reflected image and the transmitted image to overlap one another.

5. The show effect system of claim 1, wherein, the one or more controllers are configured to: generate image data based on the guest data; transmit the image data to the display; and instruct the display to project the one or more virtual images based on the image data.

6. The show effect system of claim 1, comprising one or more tracks, the one or more tracks being movably coupled with the mirror and / or the display, wherein, the one or more controllers are configured to instruct the one or more actuators to adjust the bearing and / or the orientation of the display, the mirror, or both along the one or more tracks.

7. The show effect system of claim 1, comprising an additional actuator coupled with the beam splitter and communicatively coupled with the one or more controllers, wherein, the one or more controllers are configured to instruct the one or more actuators to adjust a bearing and / or an orientation of the beamsplitter based on the guest data.

8. The show effect system of claim 1, comprising one or more physical objects located with the display and the mirror on a side of the beamsplitter opposite the viewing area.

9. The show effect system of claim 8, comprising a light source communicatively coupled with the one or more controllers, wherein, the one or more controllers are configured to instruct to modulate the light source to adjust a visibility of the one or more physical objects from the viewing area through the beamsplitter.

10. The show effect system of claim 1, wherein, the display comprises a two-dimensional display, a three-dimensional display, or a volumetric display.

11. The show effect system of claim 1, wherein, the beamsplitter comprises a visual barrier.

12. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, are configured to cause the one or more processors to perform operations comprising: determining a position and / or orientation of a guest relative to a show effect system of an amusement park attraction system, wherein the show effect system includes a beamsplitter configured to reflect an image of the guest as a reflected element at a first location, and the show effect system includes a mirror and a display configured to project one or more virtual images onto the mirror for deflection through the beamsplitter as a transmitted element at a second location; and based on the position and / or orientation of the guest, instructing one or more actuators of the show effect system to move and / or rotate the display, the mirror, or both, to adjust the projection of the one or more virtual images onto the mirror and to adjust the second location of the transmitted element.

13. The non-transitory computer readable medium of claim 12, wherein, the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations comprising: determining a movement and / or change in orientation of the guest within the show effect system to an additional position and / or orientation that results in an adjustment of the first location and / or orientation of the reflected element; and based on the movement and / or change in orientation of the guest to the additional position and / or orientation, instructing the one or more actuators to move and / or rotate the display, the mirror, or both, to adjust the projection of the one or more virtual images onto the mirror and to adjust the second location and / or change an orientation of the transmitted element.

14. The non-transitory computer readable medium of claim 13, wherein, the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations comprising: in response to determining that the movement and / or change in orientation of the guest is toward the beamsplitter to the additional position and / or orientation, instructing the one or more actuators to move and / or rotate the display and the mirror toward each other; or in response to determining that the movement and / or change in orientation of the guest is away from the beamsplitter to the additional position and / or orientation, instructing the one or more actuators to move and / or rotate the display and the mirror away from each other.

15. The non-transitory computer readable medium of claim 12, wherein, the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations comprising: determining a height of the guest; and based on the height of the guest, instructing the one or more actuators to move and / or rotate the mirror and / or the display.

16. The non-transitory computer readable medium of claim 12, wherein, the instructions, when executed by the one or more processors, are configured to: based on the position and / or orientation of the guest, instruct an additional actuator to adjust a position and / or orientation of an object.

17. The non-transitory computer readable medium of claim 12, wherein, the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations comprising: determining a distance between the guest and the beamsplitter; determining that the distance is within a threshold distance; and in response to determining that the distance between the guest and the beamsplitter is within the threshold distance, instructing the display to project the one or more virtual images onto the mirror for deflection through the beamsplitter as the transmissive element at the second location.

18. An attraction system for an amusement park, the attraction system comprising: a viewing area for a guest, a beamsplitter configured to reflect an appearance of the guest toward the viewing area; a mirror located on an opposite side of the beamsplitter relative to the viewing area; a display configured to project one or more virtual images onto the mirror such that the mirror deflects the one or more virtual images through the beamsplitter; and one or more actuators configured to move the mirror and / or the display to adjust a depth of field of the one or more virtual images.

19. The attraction system of claim 18, comprising: one or more sensors configured to detect a position of the guest within the viewing area and generate position data based on the position; and one or more controllers communicatively coupled with the one or more actuators, wherein the one or more controllers are configured to instruct the one or more actuators to move the display, the mirror, or both, to adjust the depth of field based on the position data.

20. The attraction system of claim 18, comprising one or more controllers coupled with the one or more actuators, wherein, the one or more controllers are configured to perform operations comprising: determining a first distance between the guest and the beamsplitter; and based on the first distance, instructing the one or more actuators to adjust a second distance between the display and the mirror. the one or more controllers are configured to perform operations comprising: determining a first distance between the guest and the beamsplitter; and based on the first distance, instructing the one or more actuators to adjust a second distance between the display and the mirror.

Images