Parallax-adjustable augmented reality display

Abstract

An amusement park show effect system (56) may include a sensor (58) that transmits guest data, a display (68) that projects a virtual image, and a mirror (70) that deflects the virtual image. The show effect system (56) may also include an actuator (66) coupled to the display (68) and / or the mirror (70), and a beam splitter (62) having a partially transparent and partially reflective observation surface positioned between the observation area and the mirror (70). The beam splitter (62) can reflect light from the observation area back to the observation area as a reflected image, and transmit the virtual image deflected from the mirror (70) through the beam splitter (62) to the observation area as a transmitted image. The show effect system (56) may also include a controller (74) communicatively coupled to the sensor (58), the actuator (66), and the display (68). The controller (74) can instruct the actuator (66) to adjust the position and / or orientation of the display (68), the mirror (70), or both, based on guest data.

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application claims priority and the benefit thereof to U.S. Provisional Patent Application No. 63 / 461,392, entitled "AUGMENTED REALITY MIRROR WITH ADJUSTABLE PARALLAX", filed on April 24, 2023, the entire disclosure of which is hereby incorporated by reference in its entirety for all purposes.

Background Art

[0002] This section is for introducing the reader to various aspects of technologies that may be related to the various aspects of the technology described and / or claimed hereinafter. This discussion is thought to be useful in showing the reader the background circumstances and facilitating a better understanding of the various aspects of the present disclosure. Accordingly, these descriptions should not be construed as admitting prior art, but should be understood to be read from the above perspective.

[0003] In amusement parks and other entertainment venues, special effects can be used to help guests immerse themselves in the experience of rides or attractions. An immersive environment can include three - dimensional (3D) props and large props, robots or mechanical elements, and / or display surfaces presenting media. For example, an amusement park can provide guests with an augmented reality (AR) experience. The AR experience can include presenting virtual objects to the guests, and the virtual objects can provide unique special effects to the guests. The special effects can enable the amusement park to provide creative ways to entertain guests, such as by realistically simulating elements of the real world.

Summary of the Invention

[0004] The following outlines some embodiments disclosed herein. These embodiments are merely summaries of some of these embodiments and should not be understood as limiting the scope of this disclosure. In practice, this disclosure may include various embodiments not shown below.

[0005] In one embodiment, an amusement park show effect system may include one or more sensors configured to transmit guest data based on the detection of guests in an observation area, a display configured to project one or more virtual images, and a mirror configured to deflect one or more virtual images. The guest data may include location data indicating the location of the guests. The show effect system may also include one or more actuators configured to be coupled to the display and / or mirror to adjust the position of the display and / or mirror, and a beam splitter including a partially transparent and partially reflective observation surface positioned between the observation area and the mirror. The beam splitter can reflect light from the observation area back into the observation area as a reflected image, and transmit one or more virtual images deflected from the mirror through the beam splitter to the observation area as a transmitted image. The show effect system may also include one or more controllers communicably coupled to the one or more sensors and to one or more actuators and / or the display, the one or more controllers configured to instruct one or more actuators to adjust the position of the display, the position of the mirror, or both, based on location data.

[0006] In one embodiment, a non-transient computer-readable medium may contain instructions, which, when executed by one or more processors, cause one or more processors to perform actions including determining the position of a guest relative to a show effects system of an amusement park attraction system, and instructing one or more actuators of the show effects system to move a display, a mirror, or both of these based on the guest's position to adjust the projection of one or more virtual images onto the mirror and to adjust the second position of a transparent element. The show effects system may include a beam splitter configured to reflect the guest's image as a reflective element at the first position. The show effects system may also include a mirror and a display configured to project one or more virtual images as transparent elements at the second position through the beam splitter.

[0007] In one embodiment, an amusement park attraction system may include an observation area for guests, a beam splitter configured to reflect the appearance of guests toward the observation area, and a mirror positioned opposite the observation area from the beam splitter. The attraction system may also include a display configured to project one or more virtual images onto the mirror such that the mirror deflects one or more virtual images through the beam splitter, and one or more actuators configured to move the mirror and / or the display to adjust the apparent depth of the one or more virtual images.

[0008] A better understanding of these and other features, aspects and advantages of this disclosure will be gained by reading the following detailed description while referring to the attached drawings, which show the same elements with the same symbols throughout. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic diagram of an embodiment of an amusement park attraction system according to the present disclosure. [Figure 2]This is a side perspective view of the show effect system shown in Figure 1, according to the embodiments of this disclosure. [Figure 3] This is a side perspective view of an embodiment of the show effect system shown in Figure 1, according to an aspect of this disclosure. [Figure 4] This is a flowchart of an embodiment of a method or process for providing a show effect via the show effect system shown in Figure 1, according to an aspect of the present disclosure. [Figure 5] This is a flowchart of an embodiment of a method or process for providing a show effect via the show effect system shown in Figure 1, according to an aspect of the present disclosure. [Figure 6] This is a flowchart of an embodiment of a method or process for providing a show effect via the show effect system shown in Figure 1, according to an aspect of the present disclosure. [Modes for carrying out the invention]

[0010] The following describes one or more specific embodiments of this disclosure. For the sake of brevity, this specification may not describe all the features of actual implementations. It should be understood that the development of any such implementation found in any engineering or design project will require numerous implementation-specific decisions to achieve the developer's specific objectives, such as compliance with system-related and business-related constraints, which may vary depending on the implementation. Furthermore, while such development efforts may be complex and time-consuming, they should be understood by those skilled in the art who benefit from this disclosure as routine design, fabrication, and manufacturing activities.

[0011] When describing elements of the various embodiments of this disclosure, the articles “a,” “an,” and “the” mean that there are one, two, or more of these elements. The terms “comprising,” “including,” and “having” are intended to be comprehensive and mean that there may be further elements other than those listed. Furthermore, any reference to “one embodiment” or “a certain embodiment” in this disclosure should not be interpreted as excluding the existence of further embodiments, including the features described.

[0012] The terms “approximately,” “generally,” and “substantially” used herein are intended to convey that the characteristic value being described falls within a relatively narrow range of characteristic values ​​as understood by a person skilled in the art. Mathematical terms such as “parallel” and “perpendicular” should not be interpreted strictly in their precise mathematical sense, but rather as a person skilled in the art would interpret them. For example, a person skilled in the art would understand that two lines that are substantially parallel to each other are parallel to a considerable extent, but may deviate slightly from being strictly parallel.

[0013] This disclosure relates to providing show effects for entertainment purposes. For example, this embodiment can be employed to entertain guests in an amusement park. An amusement park may include various features to entertain guests, such as rides (e.g., roller coasters), theatrical shows, set designs, performers, and / or decorative elements. Show effects can be used to supplement or complement these features to provide guests with an immersive and / or unique experience. For example, show effects can be presented together with real-world objects to provide guests with an interactive experience.

[0014] The attraction system according to this embodiment may include a show effects system configured to present virtual or simulated objects that complement the appearance of real-world objects. For example, the show effects system can track the facial features and expressions of guests and overlay virtual images or digital elements onto real-world objects (e.g., mapped to the guests' facial features and expressions) in real time or near real time. It is desirable that the virtual images be provided in a convincing manner, including correct dimensions related to the guest's attributes. In this way, a realistic show effect can be provided to guests by making the virtual images look like real-world objects.

[0015] Accordingly, embodiments of the present disclosure relate to a show effect system that provides a virtual image having a realistic appearance (e.g., one or more virtual images) by providing a virtual image having a three-dimensional (3D) appearance and / or positioning it at the correct depth from the guest's viewpoint. Specifically, the show effect system may include one or more sensors that detect the guest's position relative to the show effect system and one or more attributes of the guest (e.g., height, facial features). The show effect system can utilize Pepper's Ghost-based technology, where a light beam splitter (e.g., glass, half-mirror) provides a realistic depiction of a combination (e.g., overlapped, synthesized, overlaid) of an image from a first area (e.g., an image transmitted through a light beam splitter) and an image from a second area (e.g., an image reflected from a light beam splitter). In other words, the light beam splitter can be positioned to allow transmission of the first image projected through the beam splitter and to reflect the second image projected onto the beam splitter.

[0016] In one embodiment, the guest is positioned on a first side of the light beam splitter, and the guest's image (e.g., the guest's reflection) can be deflected from the light beam splitter and returned to the guest (e.g., relative to the guest's viewpoint). Thus, the guest can see their own image through the light beam splitter. The show effect system may also include a display and a mirror on a second side opposite to the first side of the light beam splitter. The display projects a virtual image onto the mirror, and the mirror can be positioned (e.g., angled relative to the light beam splitter) to deflect the appearance of the virtual image through the light beam splitter. Thus, the guest can see the virtual image through the projection via the light beam splitter. In this way, the guest can be observed through the light beam splitter in a combined, overlapping, or overlaid appearance of their own reflected image and the virtual image projected through the light beam splitter. A sensor can determine the guest's position and / or orientation relative to the light beam splitter. For example, a show effects system can adjust the projection of a virtual image onto a display based on the guest's position, so that the guest sees the appearance of the virtual image deflected by a mirror through a light beam splitter. By adjusting and projecting the virtual image onto the display, the virtual image can be realistically depicted with the correct apparent 3D depth and dimensions relative to the guest's viewpoint, corresponding to the guest's position relative to the light beam splitter. For example, a show effects system can achieve this by including actuators such as a motorized track or robotic arm that adjust the relative positions of the display and mirror (e.g., moving the display and mirror away from each other and / or toward each other), and the mirror is angled to direct the light from the display towards the beam splitter. By adjusting the relative positions of the display and mirror, the appearance of the virtual image through the beam splitter can be adjusted, such as the depth at which the virtual image can be positioned.In another example, a show effects system can adjust the position and / or orientation of a beam splitter based on the guest's orientation. This adjustment can be done independently or in combination with the position and / or orientation of a mirror, display, or both. The guest may be positioned at an angle to the beam splitter. The beam splitter can be angled, rotated, or moved based on the guest's orientation to provide a virtual image with the correct apparent depth and dimensions relative to the guest's viewpoint. Thus, the guest can view the virtual image with the correct apparent depth and dimensions.

[0017] In addition to or instead of this, the show effect system can also project a virtual image based on whether the guest is within a threshold distance (e.g., threshold distance range) of the show effect system (e.g., a light beam splitter). For example, the mirrors and displays of the show effect system can be fixed relative to each other and / or to the light beam splitter. Thus, when the display is activated, the virtual image projected onto the mirror by the display and the virtual image deflected by the mirror through the light beam splitter can have the same 3D appearance (e.g., the same depth position). By projecting a virtual image when the guest is within the threshold distance, the virtual image can be made to have the correct appearance relative to the guest's viewpoint. For example, the virtual image can appear as a real-world object correctly positioned (e.g., overlaid) relative to the guest's reflected image. Alternatively, the projection of the virtual image can be blocked based on whether the guest is outside the threshold distance of the show effect system. In this way, the projection of the virtual image can be performed when the guest is in a specific location where the projected virtual image can have a realistic appearance relative to the guest's reflected image. On the other hand, the projection of the virtual image can be blocked when the guest is not present in a specific location where the projected virtual image can have a realistic appearance relative to the guest's reflected image. In this way, the virtual image can be selectively projected to have the correct appearance (e.g., apparent depth) from the guest's viewpoint. For example, the virtual image can appear to be at the same or substantially the same depth as the guest.

[0018] Based on these considerations, Figure 1 is a schematic diagram of an embodiment of the amusement park attraction system 50. As an example, the guest area 52 may include paths (e.g., walkways, queues, lines) on which guests 54 (one or more) can move. As another example, the guest area 52 may include spaces (e.g., seating areas, standing areas) on which guests 54 (one or more) can be positioned to watch performances. As yet another example, the guest area 52 may include vehicles that can travel throughout the entire attraction system 50 and transport guests 54 (one or more).

[0019] Furthermore, the attraction system 50 may include a show effects system 56 (e.g., a Pepper's Ghost-based system) that can provide entertainment to (one or more) guests 54 located within the guest area 52 and / or within the attraction system 50. For example, the show effects system 56 may provide an immersive experience to (one or more) guests 54. The show effects system 56 may include a sensor 58 (e.g., representing one or more sensors) that generates sensor data related to (one or more) guests 54, a virtual area 60 (e.g., an augmented reality scene) for providing show effects (e.g., virtual image projection, show effect projection) that (one or more) guests 54 see, and a beam splitter 62 between the guest area 52 and the virtual area 60. Thus, the guest area 52 may be located on a first side of the beam splitter 62, and the virtual area 60 may be located on a second side opposite to the first side of the beam splitter 62.

[0020] For example, a guest can approach the show effects system 56 via the guest area 52. Sensors 58 can be positioned to monitor guest activity related to a guest 54 (one or more). For example, guest activity may include gestures made by the guest 54, such as movements of body components (e.g., head, arms, legs). In another example, guest activity may include the distance between the guest 54 and the show effects system 56. For this purpose, sensors 58 may include cameras (e.g., optical cameras, 3D cameras, infrared (IR) cameras, depth-based cameras), position sensors (e.g., sonar sensors, radar sensors, laser imaging, detection and ranging (LIDAR) sensors), and time-of-flight sensors. For example, sensor 58 can generate video data of the guest 54 (e.g., in an IR spectrum invisible to the guest 54). In one embodiment, sensor 58 may include a low-latency face and / or body tracking system. For example, sensor 58 may include a laser-based time-of-flight sensor that generates sensor data at multiple Hertz frequencies to track the longitudinal position of a guest 54 (one or more) relative to the show effects system 56. In another example, sensor 58 may include a computer vision system that tracks the longitudinal and lateral positions of the guest 54 relative to the show effects system 56. In this way, rapid movements of the guest 54 (e.g., body parts, facial expressions) can be captured in the sensor data. In one embodiment, the guest 54 (one or more) may wear or otherwise possess markers such as IR reflective markers or ultraviolet (UV) markers, and sensor 58 can track these markers to determine guest activity associated with the guest 54 (one or more).

[0021] Sensor 58 can generate sensor data indicating the presence and / or viewpoint (e.g., gaze) of a guest 54 (one or more). For example, sensor 58 can detect movement indicating that a guest 54 is approaching the show effect system 56. In another example, sensor 58 can track one or more attributes of a guest 54 (e.g., facial features, height, eye height). The show effect system 56 can then operate to provide show effects based on such sensor data. Alternatively, the sensor data can be analyzed to determine the gaze of a guest 54 and to operate the show effect system 56 to enhance the visibility of the show effects.

[0022] The beam splitter 62 can provide a show effect to the guest(s) 54 by combining (e.g., overlapping, overlay-displaying, misaligning) the appearance of the guest(s) 54 with an image from the virtual area 60 (e.g., a virtual image). For example, the beam splitter 62 can be partially transmissive and partially reflective to enable the transmission of the image projected through the beam splitter 62 and the reflection of the image projected onto the beam splitter 62 (e.g., based on the light reflected from the face of the guest). For example, the beam splitter 62 can retroreflect the light from the observation area to the guest(s) 54 as a reflected image. In practice, the beam splitter 62 can reflect the image of the guest(s) 54 located adjacent to the beam splitter 62 so that the guest 54 can observe its own reflected image. Also, the beam splitter 62 can enable the guest(s) 54 to observe the virtual image projected from the virtual area 60 through the beam splitter 62. Therefore, the guest 54 can see both the reflected image and the virtual image through the beam splitter 62. The beam splitter 62 can facilitate this operation based on the properties of the material forming the beam splitter 62. For example, the beam splitter 62 can be formed of a material that includes both transmissive and reflective properties, such as glass, plastic, foil, and / or a semi-transparent mirror, so that the guest(s) 54 can observe both the reflected image and the transmissive image through the beam splitter 62.

[0023] The virtual area 60 may include various components configured to generate and project a virtual image having an accurate depth of view (for example, relative to the appearance of the (single or multiple) guests 54). For example, the virtual area 60 may include an actuator 66 (e.g., a linear actuator, a rotary actuator), a display 68, and a mirror 70. The display 68 may include any suitable display (e.g., a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, or a micro-LED) that receives image data and projects (e.g., displays) it as a virtual image. The display 68 projects the virtual image onto the mirror 70, which can deflect the virtual image through a beam splitter 62 so that it is visible to the (single or multiple) guests 54. Thus, the virtual image projected by the display 68 can complement the reflected image of the (single or multiple) guests 54. The display 68 may adjust or manipulate the virtual image to enhance (e.g., distort, modify, superimpose, or interact with) the reflected image of the (single or multiple) guests 54. For example, the virtual image may include a goblin effect that transforms the appearance of a guest 54 (one or multiple, as seen from the guest's perspective) into a goblin. In one embodiment, the display 68 may include a two-dimensional (2D) display. In further or different embodiments, the display 68 may include a 3D or volumetric display, such as an autostereoscopic display and a light field display. In yet another embodiment, the display 68 may include a tracked 3D surface that is projection-mapped by a projection system within the display 68. For example, the display 68 may include a face-shaped flexible display, and the virtual image may be a face-shaped mask that can be positioned to match the guest's distance and pose. In this way, the virtual image can be projected to match a reflective image of the guest's face.

[0024] The actuator 66 is coupled to the display 68 and / or mirror 70 and can adjust the position and / or orientation of the display 68 and / or mirror 70 based on sensor data. For example, the actuator 66 can move the display 68 and / or mirror 70 along one or more motorized tracks in directions along the plane of the beam splitter 62 (e.g., lateral, vertical) and / or in directions intersecting the plane of the beam splitter 62 (e.g., longitudinal). Moving the display 68 and / or mirror 70 along the beam splitter 62 allows the position of the virtual image viewed by the (one or multiple) guest 54 to move along the beam splitter 62. Moving the display 68 and / or mirror 70 laterally relative to the plane of the beam splitter 62 can adjust the apparent depth of the virtual image. In another example, the actuator 66 can adjust the apparent depth of the virtual image by adjusting the relative position between the display 68 and the mirror 70. The apparent depth of the virtual image (for example, relative to the beam splitter 62) can be based on the distance between the display 68 and the mirror 70. For example, increasing the distance between the display 68 and the mirror 70 by 1 centimeter (cm) (e.g., 0.4 inches (in)) by moving the mirror 70 and / or the display 68 apart from each other can increase the apparent depth of the virtual image by 2 centimeters (e.g., 0.8 inches). Adjusting the apparent depth of the virtual image by moving the display 68 and / or the mirror 70 relative to each other can reduce the amount of torque and / or power consumed by the actuator 66 (or other actuator) compared to using the actuator to move each of the mirror 70 or the display 68 relative to the beam splitter 62 (e.g., towards, away, left, right). In addition to or instead of this, the actuator 66 can also adjust the angle (e.g., tilt) between the mirror 70 and the display 68. By adjusting the angle between the mirror 70 and the display 68, the appearance of the virtual image, such as the angle at which the virtual image appears when a (single or multiple) guest 54 is viewing it, can be adjusted.In some embodiments, when distortion occurs by changing this angle, the virtual image can be adjusted to cancel out the distortion.

[0025] In some embodiments, the beam splitter 62 can include a visual barrier for hiding the virtual area 60 from the guest's perspective and / or for restricting the show effect to a particular guest(s) 54 directly viewing the beam splitter 62. For example, the beam splitter 62 can be covered with a visual barrier (e.g., a fabric (e.g., a black cloth), a film (e.g., a privacy film)). In this way, the ambient light within the virtual area 60 can be reduced or blocked by the visual barrier. For example, by reducing the ambient light within the virtual area 60, the projected virtual image can be made to appear clearer to the guest(s) 54, and the display 68 and / or the mirror 70 being directly observed through the beam splitter 62 can be effectively hidden. In another example, the show effect system 56 can have a plurality of guests 54 viewing the show effect system 56. However, when the guest(s) 54 is not viewing the beam splitter 62 from a particular angle, the show effect projection may appear distorted or changed. For example, when the guest(s) 54 views the beam splitter 62 from an undesirable angle, the guest may perceive that the image from the virtual area 60 is not properly combined with the appearance of the guest's reflected image. For this purpose, the visual barrier can suppress or prevent a particular guest(s) 54 from viewing the show effect at an undesirable angle. For example, the visual barrier can make the passage of light through the beam splitter 62 perpendicular to the plane in which the beam splitter 62 extends so that the show effect is not visible to a guest(s) 54 viewing the beam splitter 62 from an oblique rather than a vertical angle.

[0026] In one embodiment, the beam splitter 62 can be coupled to an actuator (e.g., a linear actuator, a rotary actuator) that can adjust the position and / or orientation of the beam splitter 62 based on the position and / or orientation of the (single or multiple) guest 54. When the (single or multiple) guest 54 is viewing the beam splitter 62 from one angle, the position and / or orientation of the beam splitter 62 can be adjusted to match the angle of the (single or multiple) guest 54. The position of the reflected and / or virtual images seen by the (single or multiple) guest 54 can be adjusted by moving the beam splitter 62 (e.g., towards the (single or multiple) guest 54, away from the (single or multiple) guest 54). The appearance of the reflected and / or virtual images can also be adjusted by adjusting the orientation (e.g., rotational motion). For example, the position of the edges of the beam splitter 62 can be adjusted so that the beam splitter 62 can rotate. In some cases, it is also possible to suppress or prevent the (single or multiple) guest 54 from seeing the show effect projection without using a visual barrier. Therefore, the observation area can be expanded by adjusting the position and / or orientation of the beam splitter 62. As described above, the beam splitter 62 can also be adjusted in conjunction with the orientation and / or position of other features (e.g., the display 68 and the mirror 70) to achieve the desired result (e.g., to correspond to the viewpoint of a particular guest).

[0027] The virtual area 60 may also include an object 72 placed within the virtual area 60. A guest 54 (one or multiple) can see the object 72 through the beam splitter 62. For example, the object 72 may be seen as a transparent image through the beam splitter 62. In some cases, the object 72 may include a physical object such as a prop, an animated figure, a person (e.g., a costumed performer), or other suitable physical object placed within the virtual area 60 to provide an interactive experience for the guest 54. For example, the object 72 may provide an appearance of the virtual environment on which a reflective image of the guest 54 can be placed. Thus, the object 72 can further provide the guest 54 with a show effect that looks realistic. In some cases, an actuator 66 may be coupled to the physical object and adjust the position of the physical object based on sensor data. For example, the actuator 66 may adjust the appearance of the physical object that the guest 54 is seeing to the guest 54's reflective image and / or the beam splitter 62.

[0028] In some cases, a light source 73 (e.g., an LED, OLED, or light bulb) can be used to illuminate the object 72 and / or adjust the illumination of the virtual area 60 to enhance the visibility of the object 72. For example, in embodiments where ambient light within the virtual area 60 is limited, the light source can make the object 72 more clearly visible to the (single or multiple) guests 54. As will be further illustrated with reference to Figure 3, the light source 73 can be modulated to illuminate the virtual area 60 to adjust the visibility of the virtual image, the image of the virtual area 60, or a combination thereof. In other cases, the object 72 may be a further virtual image projected through the beam splitter 62 without the involvement of a mirror 70, etc. For example, a further display can project the object 72 directly through the beam splitter 62 without first deflecting the image of the object 72 from a mirror (e.g., mirror 70).

[0029] The show effect system 56 may include a controller 74 (e.g., a control system, automation controller, programmable controller, electronic controller, control circuit, or cloud computing system) configured to instruct the operation of the show effect system 56 to provide an interactive experience to (one or more) guests 54. The controller 74 may include memory 76 and a processor 78 (e.g., a processing system or processing circuit). The memory 76 may include volatile memory such as random access memory (RAM) and / or non-volatile memory such as read-only memory (ROM), an optical drive, a hard disk drive, a solid-state drive, or any other non-temporary computer-readable medium containing instructions for operating the show effect system 56. The processor 78 may be configured to execute such instructions. For example, the processor 78 may include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof.

[0030] The controller 74 receives sensor data from the sensor 58 and can command the operation of the show effect system 56 based on the position and / or orientation of the guest 54 (relative to the beam splitter 62) determined from the sensor data. For example, the controller 74 can use the sensor data and image analysis techniques to determine the position of the guest 54 (single or multiple) relative to the beam splitter 62, such as the distance between the guest 54 and the beam splitter 62. In another example, the controller 74 can use image analysis techniques to determine the orientation of the guest 54 (single or multiple) relative to the beam splitter 62, such as the angle of the guest 54 (single or multiple) relative to the beam splitter 62, the line of sight of the guest 54 (single or multiple) and the direction in which the guest 54 (single or multiple) is looking. The controller 74 can then determine the target position of the virtual image that the guest 54 (single or multiple) is looking at, based on the position and / or orientation of the guest 54 (single or multiple). The controller 74 can identify the corresponding positions and / or orientations of the display 68 and mirror 70 relative to the beam splitter 62 and / or each other, so that the display 68 can project a virtual image to appear at the target position. In some cases, the controller 74 can determine the corresponding position and / or orientation of the beam splitter 62. To this end, the controller 74 can use data from a high-speed, low-latency computer vision face tracking system to identify the position and / or orientation of the (single or multiple) guest 54 relative to the beam splitter 62 and instruct the display 68 and / or mirror 70 to adjust their positions based on the positions of the (single or multiple) guest 54. Thus, the position and / or orientation of the projected virtual image can more accurately correspond to the position of the (single or multiple) guest 54.

[0031] For example, the controller 74 can operate to match the apparent depth of the projected virtual image to the apparent depth of the reflected image of the (single or multiple) guest 54. For instance, if the projected virtual image includes clothing, the (single or multiple) guest 54 can be made to appear as if it is wearing clothing by matching the apparent depth of the projected virtual image to the apparent depth of the reflected image of the (single or multiple) guest 54. To this end, the controller 74 can instruct the actuator 66 to match (or substantially match) the distance at which the display 68 and / or mirror 70 are positioned relative to the beam splitter 62 to the relative distance between the (single or multiple) guest 54 and the beam splitter 62. The controller 74 can also monitor the movement data of the (single or multiple) guest 54 and instruct the actuator 66 to adjust the position of the display 68 and / or mirror 70 based on the monitored movement data. For example, in response to the controller 74 determining that a guest (one or multiple) 54 has moved toward the beam splitter 62 (for example, longitudinally), the controller 74 can instruct the actuator 66 to move the display 68 and mirror 70 toward the beam splitter 62, and / or move the display 68 and mirror 70 toward each other. In response to the controller 74 determining that a guest (one or multiple) 54 has moved laterally relative to the beam splitter 62 (for example, left or right), the controller 74 can instruct the actuator 66 to move the mirror 70 and display 68 in the corresponding lateral direction.

[0032] In further or alternative embodiments, the controller 74 may be instructed to adjust the position of the display 68 and / or mirror 70 with a delay based on the position of the (single or multiple) guest 54. By adjusting the position of the display 68 and / or mirror 70 with a delay, different show effect experiences can be provided to the (single or multiple) guest 54. For example, the virtual image may include a contour surrounding the guest 54. By moving the display 68 and / or mirror 70 with a delay, the delayed movement of the contour can provide an apparitional appearance of the contour corresponding to the (single or multiple) guest 54's previous position. It is not considered possible to provide an apparitional appearance by adjusting the position of the display 68 and / or mirror 70 more quickly based on the position of the (single or multiple) guest 54.

[0033] In some cases, the actuator 66 may have a minimum or maximum allowable range of movement (e.g., in the longitudinal, lateral, and vertical directions). For example, the controller 74 may prevent the display 68 and / or mirror 70 from moving beyond a certain portion along the motorized track. The controller 74 may, in response to determining that the position of the display 68 and / or mirror 70 may be beyond an allowable range based on the guest's position, prevent the presentation of a virtual image via the display 68. Thus, a virtual image may not be presented to the (one or more) guests 54 at a particular location in the guest area 52.

[0034] In addition to or instead of this, the controller 74 can determine attributes of the (single or multiple) guest 54, such as facial features (e.g., eye position, nose position, mouth position, facial expression), based on sensor data, and identify corresponding image data to be transmitted to the display 68 for projecting a virtual image. For example, the controller 74 can instruct the display 68 to adjust the size, shape, and color of the virtual image based on the attributes of the (single or multiple) guest 54. In one embodiment, the controller 74 can determine the height of the (single or multiple) guest 54 and instruct the display 68 to adjust the size of the virtual image projected so that the appearance of the (single or multiple) guest 54 matches the virtual image. For example, the virtual image may include a mask superimposed on a reflective image of the guest's face to provide the appearance of the (single or multiple) guest 54 wearing a projected virtual image of a mask. The controller 74 can instruct the display 68 to project a virtual image of a mask such that the dimensions of the virtual image of the mask correspond to the dimensions of the guest's face, so that the virtual image of the mask correctly overlaps, so that the guest 54 appears to be wearing a mask. In another example, the controller 74 can instruct the display 68 and / or mirror 70 to adjust their position so that the dimensions of the virtual image correspond to the dimensions of the guest's face. In this way, the controller 74 can determine the size and / or placement of facial features by determining various attributes of the (single or multiple) guest 54 based on sensor data, so that the projected virtual image of the mask has an appearance corresponding to the size and / or placement of the facial features. Thus, the show effect system 56 can provide a convincing appearance of the (single or multiple) guest 54 wearing the projected virtual image of the mask. It is also possible to adjust the light intensity related to the mask (e.g., the brightness of the mask image on the display 68) based on detected illumination to control the mask so that it is perceived at a desired level of opacity or translucency.

[0035] Furthermore, the controller 74 can instruct the display 68 to adjust the projection of the virtual image based on the movement of the (single or multiple) guest 54, as indicated by the adjustment of the (single or multiple) guest 54's facial features. The (single or multiple) guest 54 may rotate their head to point their cheeks towards the beam splitter 62, or tilt their chin or forehead towards the beam splitter 62. As a result, the reflected image of the guest's face can be adjusted. In some cases, the position and / or orientation of the beam splitter 62 can be adjusted so that the (single or multiple) guest 54 appears to be wearing the mask convincingly. In other cases, the controller 74 can determine the movement of the (single or multiple) guest 54 and / or the adjustment of the reflected image of the guest's face, and instruct the actuator 66 to tilt or rotate the display 68 so that the (single or multiple) guest 54 appears to be wearing the mask. For example, the dimensions of the projected image can be adjusted to perfectly match the adjusted facial features of the (single or multiple) guest 54.

[0036] In another example, the sensor data may include other information about the guest 54, such as the position and / or orientation of the guest's appendages. For example, the virtual image may include clothing to be superimposed on the reflective image of the guest 54's body. Thus, the controller 74 can determine the guest 54's posture, such as the position of the guest's arms, legs, torso, and feet, based on the sensor data. The controller 74 can then instruct the display 68 to project a virtual image of the clothing so as to provide a convincing appearance of the guest 54 wearing the projected virtual image of the clothing. For example, the controller 74 can instruct the display 68 to project a virtual image of the clothing to fit the positions of various body components of the guest 54. The controller 74 can also instruct the display 68 to change the appearance of the corresponding virtual image based on the guest 54's movements, which may cause movements of various body components.

[0037] As described above, the object 72 can also be viewed through the beam splitter 62 along with the virtual image provided by the display 68. The object 72 can also be controlled, similar to the display 68. For example, the controller 74 can instruct actuators 66 (which may represent one or more actuators operating cooperatively or independently) to adjust the position of the object 72 based on the position of the (one or multiple) guest 54. For example, the object 72 could include a physical hat that appears to be worn by the (one or multiple) guest 54 (e.g., superimposed on a reflective image seen from the guest's perspective). The controller 74 can instruct actuators 66 to adjust the position, shape, orientation, or other aspects of the object 72 based on the determined movement of the (one or multiple) guest 54.

[0038] In one embodiment, multiple show effect systems 56 can be arranged adjacent to each other within the attraction system 50. For example, the beam splitters 62 of each show effect system 56 can be aligned so that they appear as a continuous, unified, or integrated part to the guest's viewpoint. Multiple guests 54 may be present within the guest area 52, and each show effect system 56 can provide show effects to each different guest 54, providing a virtual image that appears to be correctly positioned (e.g., has apparent depth) to suit each of the guests' different viewpoints.

[0039] Furthermore, in embodiments (for example, where the positions of the display 68 and / or mirror 70 can be fixed), the display 68 can be instructed to project a virtual image in response to the controller 74 determining that a (single or multiple) guest 54 is within a threshold distance (e.g., threshold distance range) of the beam splitter 62. For example, by projecting a virtual image via the display 68 when a (single or multiple) guest 54 is within a threshold distance of the beam splitter 62, the virtual image can be made to appear at the correct position (e.g., the correct depth) relative to the reflected image of the (single or multiple) guest 54. As an example, the distance of the beam splitter 62 to the display 68 and / or mirror 70 can be the same as the threshold distance. Thus, the virtual image can have an apparent depth that matches the reflected image of the (single or multiple) guest 54.

[0040] Figure 2 is a side perspective view of the show effect system 56. Specifically, Figure 2 shows a guest 54 standing at a first position 105, viewing the show effect system 56, and then moving to a second position 107. The guest 54 can view the reflected image 102 at an apparent depth corresponding to the distance between the guest 54 and the beam splitter 62. Components of the virtual area 60 can generate and project a virtual image 110 (e.g., one or more virtual images) that combines with the reflected image 102. For example, the controller 74 can position the display 68 and / or mirror 70 from the beam splitter 62 at a distance similar to the distance between the guest 54 and the beam splitter 62. In this way, the projected virtual image 110 passes through the beam splitter 62 as a transmitted image 103 and appears to exist at the same or substantially the same apparent depth as the reflected image 102. In practice, the reflected image 102 and the transmitted image 103 can be combined to form a show effect projection. Furthermore, when adding the virtual image 110 to the reflective image 102, apparent depth can be considered because the virtual image 110 needs to coordinate correctly with the reflective image 102. For example, virtual clothing should fit the reflective image 102 of guest 54.

[0041] In the illustrated show effect system 56, sensors 58 can be positioned to track the movement of a guest 54 within the guest area 52 and relative to the beam splitter 62. To facilitate tracking the movement of the guest 54 via sensors 58, the guest 54 may wear or otherwise possess markers 100. For example, sensors 58 can monitor the position of the guest 54 along the longitudinal direction 104, the transverse direction 106, and / or the vertical direction 108 relative to the beam splitter 62. The show effect system 56 also includes a virtual area 60 where actuators 66, a display 68, and a mirror 70 can be positioned. The reflection of the guest 54 via the beam splitter 62 provides a reflected image 102 of the guest 54, which can appear to be located at a first position 105 (for example, located within the virtual area 60). The display 68 can also project a virtual image 110, deflected from the mirror 70 via the beam splitter 62, onto the mirror 70. As a result, the guest 54 can see the virtual image 110 as a transparent image 103 that appears to be located at a second location 107 (for example, located within the virtual area 60). The guest 54 can perceive the combination of the reflected image 102 and the transparent image 103 as a show effect. The illustrated display 68 includes a 2D display that can generate the 2D virtual image 110 that the guest 54 sees when deflected from the mirror 70, but the display 68 may also include a large stereoscopic or light-field based display system that can generate the 3D virtual image 110 that the guest 54 sees when deflected from the mirror 70.

[0042] Returning to the sensor 58, the sensor 58 can be positioned adjacent to the beam splitter 62 (for example, on top of or to the side of the beam splitter 62) or embedded within the beam splitter 62. The sensor 58 can generate sensor data related to the guest 54 during the operation of the show effect system 56. The sensor data may include the attributes of the guest 54, the location of the guest 54, and / or the orientation of the guest 54. The show effect system 56 may include any preferred number of sensors 58 to provide accurate sensor data related to the guest 54, and the sensor 58 shown in the illustration may represent any preferred number of sensors 58.

[0043] In one embodiment, a guest 54 may wear or possess a marker 100 that can be tracked by the sensor 58. The marker 100 may include an illumination color or infrared (IR) light-emitting diode (LED), a passive reflective marker, a printed pattern (e.g., a QR code® or other type of barcode), or a known marker. For example, the marker 100 may be a pattern printed on a prop such as a hat, cap, and clip. The guest 54 may wear the prop, and the sensor 58 may generate sensor data indicating the marker 100. The controller 74 can receive the sensor data generated by the sensor 58 and determine the location of the guest 54 by determining the location of the marker 100 based on the sensor data. In one embodiment, the marker 100 may include a wired or wireless communication device communicatively coupled to the sensor 58, such as an AR headset device, a mobile phone, and a radio frequency (RF) location-based wearable. For example, marker 100 could include an RF position-based wearable such as a watch, glasses, or mask that incorporates an ultra-wideband (UWB) tracking beacon that transmits a signal to sensor 58. The signal could include the position of marker 100 within guest area 52, which can be associated with the location of (one or more) guests 54 within guest area 52.

[0044] The controller 74 can command actuators 66 (which can represent one or more actuators working together or independently) to adjust the position of the display 68 and / or mirror 70 based on the sensor data received. For example, the display 68 and / or mirror 70 can be coupled to a trajectory 112 extending along a vertical direction 108, and the controller 74 can command actuators 66 to move the display 68 and / or mirror 70 along the trajectory 112 (for example, along the vertical direction 108). For example, the controller 74 can adjust the second position 107 of the transparent image 103 by commanding actuators 66 to adjust the relative positions of the display 68 and / or mirror 70 along the vertical direction 108 in order to adjust the apparent depth of the transparent image 103. In some cases, the mirror 70 can remain fixed in the line of sight of the guest 54 (for example, aligned perpendicular to the guest's viewpoint), and the controller 74 can command actuators 66 to move the display 68 relative to the mirror 70. As a result, the display 68 can project the virtual image 110, and the mirror 70 can deflect the virtual image 110 to the guest 54's line of sight through the beam splitter 62, thereby reducing image distortion that might otherwise occur as a misalignment between the deflection of the virtual image 110 and the guest 54's line of sight.

[0045] In the illustrated example, guest 54 is positioned in front of the beam splitter 62 and can move toward the beam splitter 62 along the longitudinal direction 104. In practice, Figure 2 shows movement from a first configuration 116A to a second configuration 116B, as indicated by arrow 114. As guest 54 moves toward the beam splitter 62 along the longitudinal direction 104, the apparent depth associated with the first position 105 of the reflected image 102 along the longitudinal direction 104 can change. Such changes are indicated by the differences between the first configuration 116A and the second configuration 116B. For example, the reflected image 102 may appear to be larger, located closer to the beam splitter 62, or both. The controller 74 can operate the show effect system 56 to provide a desired appearance of the transmitted image 103 relative to the reflected image 102. For example, the controller 74 may operate to adjust the apparent depth of the transmitted image 103 relative to a second position 107 based on the apparent depth of the reflected image 102 relative to a first position 105. To this end, the controller 74 may receive sensor data (e.g., related to marker 100, related to guest 54), determine the position and / or orientation of guest 54 relative to beam splitter 62 based on the sensor data, and send a signal to instruct actuator 66 to adjust the position and / or orientation of display 68 and / or mirror 70 based on the position and / or orientation of guest 54 relative to beam splitter 62. For example, the controller 74 can adjust the apparent depth related to the second position 107 of the transparent image 103 by commanding the actuator 66 to move the display 68 along the vertical direction 108 to change the distance between the display 68 and the mirror 70 (for example, to maintain the overlap of the transparent image 103 with respect to the reflected image 102 by aligning the second position 107 of the transparent image 103 (e.g., a mask aligned to the guest's face) with the first position 105 of the reflected image 102).In one embodiment, reducing the distance between the display 68 and the mirror 70 can make the transmitted image 103 appear to be located closer to the beam splitter 62. Thus, in response to the controller 74 determining that the first position 105 of the reflected image 102 appears to be closer to the beam splitter 62 due to the guest 54 moving toward the beam splitter 62, the controller 74 can command the actuator 66 to move the display 68 and the mirror toward each other so that the second position 107 of the transmitted image 103 appears to be closer to the beam splitter 62.

[0046] In one embodiment, the actuator 66 may include a multi-axis actuator system that can move the display 68 and / or mirror 70 along the longitudinal direction 104 and / or transverse direction 106 (for example, along their respective trajectories). As an example, the actuator 66 may move the display 68 and / or mirror 70 along the longitudinal direction 104 to adjust the apparent depth related to the second position 107 of the transmitted image 103. As another example, the first position 105 of the reflected image 102 may move along the transverse direction 106 as the guest 54 moves along the transverse direction 106 relative to the beam splitter 62. In response, the actuator 66 may move the display 68 and / or mirror 70 along the transverse direction 106 and, correspondingly, adjust the second position 107 of the transmitted image 103 along the transverse direction 106. Such further movement of the display 68 and / or mirror 70 can further allow for control over the appearance of the show effect provided to the guest 54. Actuator 66 can also adjust the angular position of the mirror 70 and / or the display 68. Coordinated angular adjustment of the display 68 and / or the mirror 70 can achieve desired image distortion or image distortion cancellation. Furthermore, the image provided by the display 68 can also be adjusted based on the positional changes of the mirror 70 and / or the display 68, and such image modification can be done to produce a smooth transition or to intentionally add distortion to the transmitted image 103.

[0047] In one embodiment, the position and / or orientation of the beam splitter 62 can be adjusted (e.g., via an actuator) based on the position and / or orientation of the guest 54. For example, the guest 54 may be positioned in front of the beam splitter 62 and move toward the beam splitter 62 along the longitudinal direction 104. The controller 74 can change the apparent depth associated with the reflected image 102 by commanding the actuator to move the beam splitter 62 along the longitudinal direction 104 to change the distance between the guest 54 and the beam splitter 62. In some cases, changing the position of the beam splitter 62 changes the distance between the beam splitter 62 and the display 68 and / or mirror 70, thereby adjusting the apparent depth associated with the transmitted image 103. Thus, the reflected image 102 and the transmitted image 103 can be combined with the correct apparent depth to provide a show effect. In another example, the guest 54 may view the beam splitter 62 at a certain angle. The controller 74 can determine the orientation of the guest 54 relative to the beam splitter 62 based on sensor data and can instruct the actuator to adjust the orientation of the beam splitter 62. For example, the edges of the beam splitter 62 can be rotated so that the guest 54 can view the beam splitter 62 at a right angle. Thus, the guest 54 can see a show effect projection with reduced or eliminated distortion.

[0048] Figure 3 is a side perspective view of the show effect system 56. For example, a guest 54 may move laterally 106, and a sensor 58 can track the guest 54's movement so that the projected virtual image aligns with the guest 54's reflected image 102. Specifically, Figure 3 shows a guest 54 standing at a first position 105 and moving to a second position 107, with this transition indicated by an arrow 114.

[0049] The controller 74 can instruct the actuator 66 to move the mirror 70 based on sensor data related to the guest 54 received from the sensor 58. For example, as described herein, it is desirable to align the mirror 70 with the guest 54's line of sight so that the virtual image 110 (e.g., projected by the display 68 and deflected from the mirror 70) has a desirable (e.g., distortion-free) appearance when the guest 54 is looking at it. Therefore, the controller 74 can determine the guest 54's line of sight and instruct the actuator 66 to move the mirror 70 based on the guest 54's line of sight. As an example, the first guests 54, 54A may include relatively tall adults, and the second guests 54, 54B may include relatively short children. The controller 74 can instruct the actuator 66 to move the mirror 70 to match the height of the guest 54. For example, the controller 74 can instruct the actuator 66 to move the mirror 70 along the vertical direction 108 (for example, downward) to change the alignment of the mirror 70 from a state suited to the first guest 54, 54A to a state suited to the second guest 54, 54B. Figure 2 shows the first guests 54, 54A, but Figure 2 can be applied to any guest 54. Figure 3 shows the second guests 54, 54B, but Figure 3 can be applied to any guest 54. In addition to or instead of this, the controller 74 can also determine the gaze of the guest 54 by identifying facial features of the guest 54 (for example, eye position) from sensor data. The controller 74 can instruct the actuator 66 to adjust the position of the display 68 and / or mirror 70 based on the eye position.

[0050] As described herein, the guest 54 can move relative to the beam splitter 62 along the lateral direction 106, etc., while the show effect system 56 is in operation. In addition to or instead of moving the display 68 and / or mirror 70 along the lateral direction 106 based on the movement of the guest 54, the controller 74 can also instruct the display 68 to adjust the position from which the virtual image 110 is projected from the display 68. In this way, the position from which the virtual image 110 is projected onto the mirror 70, and the second position 107 of the deflected transmissive image 103 from the mirror 70 can also be adjusted. For example, based on the position 138 of the guest 54 along the lateral direction 106, the controller 74 can instruct the display 68 to project the virtual image 110 onto the mirror 70 from a first position 146A on the display 68. As guest 54 moves along the lateral direction 106, controller 74 can instruct display 68 to project the virtual image 110 onto mirror 70 from a second position 146B on display 68, based on the updated position 138 of guest 54 along the lateral direction 106. For example, adjustment of the projection of the virtual image 110 from a first position 146A to a second position 146B can correspond to adjustment of guest 54 along the lateral direction 106. In this way, the second position 107 of the transmitted image 103 relative to the first position 105 of the reflected image 102 can be maintained.

[0051] The illustrated show effect system 56 includes, in addition to the actuator 66, display 68, and mirror 70, an animated figure 140 (e.g., the object 72 described in relation to Figure 1) and a light source 73 placed within the virtual area 60. The animated figure 140 is visible to the guest 54 through the beam splitter 62. Thus, the guest 54 can see the animated figure 140 in addition to the reflected image 102 and the transmitted image 103. In this way, the animated figure 140 can further enhance the show effect provided to the guest 54. In one embodiment, the movement of the animated figure 140 can be coordinated with other aspects of the system (e.g., images from the display 68) to enhance immersion. The mirror 70 can also be partially transparent so that the guest 54 can see the animated figure 140 through the mirror 70 and the beam splitter 62.

[0052] The light source 73 can be modulated to increase or decrease the visibility of the reflected image 102, the transmitted image 103, and / or the animated figure 140. For example, increasing the light in the virtual area 60 can improve the visibility of the animated figure 140 as seen by the guest 54. Decreasing the light in the virtual area 60 can decrease the visibility of the transmitted image 103 as seen by the guest 54. As an example, by dimming the light source 73, the trajectory 112 and other elements in the virtual area 60 can be made invisible or difficult to see from the guest 54's viewpoint, while still allowing the animated figure 140 to be clearly visible. In further or alternative embodiments, the light source 73 may also include one or more additional light sources placed in the guest area 52, which can be used to adjust the visibility of the reflected image 102, the transmitted image 103, and / or the animated figure 140. The light source 73 can be used in conjunction to adjust the lighting of the virtual area and / or the guest area 52. For example, increasing the light in the guest area 52 can improve the visibility of the reflective image 102 visible to guest 54, and decreasing the light in the guest area 52 can improve the visibility of the animated figure 140 visible to guest 54.

[0053] In some cases, the controller 74 can instruct actuators (e.g., linear actuators, rotary actuators) to move and rotate the animated figure 140 based on sensor data indicating the position of the guest 54. For example, the animated figure 140 can move along the lateral direction 106 in response to the guest 54 moving along the lateral direction 106. In this way, the show effect provided to the guest 54 can be further enhanced by making the animated figure 140 appear to interact with the guest 54's movements or to appear to follow the reflected image 102 in response to the guest 54's movements. The controller 74 can also adjust the operation of the light source 73 (e.g., the direction in which light is emitted, the intensity in which light is emitted) in response to the movement of the animated figure 140 so that the animated figure 140 is visible to the guest 54. Although the virtual area 60 contains the animated figure 140, in further or different embodiments, other physical objects such as props (e.g., icons), toys, or clothing (e.g., a funny hat, glasses, or a face mask) can also be placed within the virtual area 60.

[0054] Each of Figures 4 to 6, described later, illustrates a method or process of operating the show effect system. Any preferred device (e.g., the processor 78 of the controller 74 shown in Figures 1 to 3) can instruct each method using the features of the show effect system 56. In one embodiment, each method can be implemented by executing instructions stored in a tangible, non-temporary computer-readable medium (e.g., the memory 76 of the controller 74 shown in Figures 1 to 3). For example, each method can be implemented by at least partially one or more software components and one or more software applications. Each method will be described using a specific order of operation, but further operations may be performed, the operations described may be performed in an order different from the illustrated order, and / or some of the operations described may be skipped or not performed at all. Furthermore, each operation of each method may be performed in any way with respect to each other, for example, in response to each other and / or simultaneously with each other.

[0055] Based on these considerations, Figure 4 is a flowchart of an embodiment of a method or process 160 for operating a show effects system to provide immersive show effects. In one embodiment, the show effects system's controller can track the guest's location and generate show effects based on the guest's location.

[0056] In block 162, the controller can receive sensor data indicating a guest. For example, the sensor data may indicate the guest's location within the guest area. In another example, the sensor data may be associated with a marker such as a pattern, IR sticker, or signal from a wearable device that the guest can access.

[0057] In block 164, the controller can determine the guest's position relative to the beam splitter, which can indicate the guest's line of sight. The controller can use image analysis techniques and sensor data to determine the guest's position relative to the beam splitter along the longitudinal, lateral, vertical, or a combination thereof. For example, the controller can determine the distance between the guest and the beam splitter to determine the guest's position along the longitudinal direction. In another example, the controller can determine the guest's height and / or the guest's eye position (e.g., estimated eye height) to determine the guest's position.

[0058] In block 166, the controller can command the position of the show effect system's display and / or mirrors to be adjusted based on the position. In one embodiment, the controller can command the actuators to adjust the distance between the display and the mirrors based on the guest's position. In a further or different embodiment, the controller can command the actuators to adjust the position of the display and mirrors along the longitudinal, lateral and / or vertical directions (for example, while maintaining the relative positions of the display and mirrors to each other).

[0059] In block 168, the controller can instruct the display to generate image data and send it, and to project a virtual image onto the display based on the image data. The projected virtual image can be deflected by the mirror and passed through the beam splitter, appearing to the guest as a transmitted image. Alternatively, the guest's appearance can be reflected by the beam splitter, appearing to the guest as a reflected image. The transmitted and reflected images can be combined to provide the guest with an immersive show effect.

[0060] In one embodiment, the controller can generate image data to project a virtual image corresponding to or suited to the guest's attributes and instruct the controller to transmit the image data. For example, the image data could include a comical hat that appears to be worn by the guest's reflected image (e.g., reflected by a beam splitter). The size and shape of the hat could be generated based on the guest's head size and shape (measured by sensors or based on guest detection and stored guest attributes). In this way, the virtual image projected by the display can have a convincing appearance relative to the reflected image. In another example, the controller can generate image data that partially overlaps or does not overlap the guest's reflected image. For example, the controller could instruct the controller to project a dinosaur that appears to be chasing the guest's reflected image. The controller can instruct the display to project a virtual image at a predetermined distance from the guest's reflected image and adjust the image data based on the guest's position. In some cases, the controller can generate image data to adjust the distance between the projected virtual image and the guest's reflected image, reducing the distance until the virtual image partially overlaps the guest.

[0061] As described herein, the projected virtual image can present a more realistic appearance to the guest as a result of the display position and / or mirror position being adjusted based on the guest's position. For example, the apparent depth of the virtual image can match the depth of the guest's reflected image. In practice, the apparent depth of the virtual image seen by the guest can be adjusted by adjusting the distance between the display and the mirror. For example, increasing the distance between the display and the mirror can increase the apparent distance between the virtual image and the beam splitter. The position of the display and / or mirror (e.g., lateral, vertical) can also be used to transmit the virtual image to the beam splitter at a desired position and to align the guest's position with the beam splitter. Furthermore, distortion of the virtual image can be reduced by aligning the mirror position with the guest's line of sight to match the virtual image with the guest's line of sight.

[0062] Method 160 can also be performed iteratively or sequentially. For example, updated sensor data can be received, the updated (e.g., rotated, shifted) guest position can be determined, the updated display position and / or updated mirror position can be established, and updated image data can be generated and transmitted. In this way, the projected virtual image can be updated to correspond to the change in the guest position based on the image data, thereby maintaining the realistic appearance of the virtual image.

[0063] Although the illustrated method or process 160 describes a single show effect system, in some embodiments, multiple show effect systems can perform method 160 to generate show effects for multiple guests. For example, each actuator, such as robot appendages, each of which can be coupled to a pair of displays and mirrors, can be instructed to adjust the positions of multiple displays and / or multiple mirrors to provide each guest with their own virtual image. In other words, each show effect system can provide its own virtual image that can be suitably presented to individual guests. In one example, each controller can operate a different show effect system. In another example, a single controller (e.g., a master controller) can control multiple show effect systems.

[0064] Figure 5 is a flowchart of an embodiment of a method or process 180 for operating a show effects system to provide immersive show effects. In one embodiment, a controller can track guest attributes and continuously generate show effects based on the guest attributes.

[0065] In block 182, the controller can receive sensor data indicating a guest, similar to block 162 in Figure 4. In block 184, the controller can determine the attributes of one or more guests based on the sensor data. For example, the controller can determine height, facial features, and orientation. The controller can also determine the guest's body position, such as the position of the guest's arms, legs, feet, and torso.

[0066] In block 186, the controller can command adjustments to the position and / or orientation of the display and / or mirror based on guest attributes. For example, the controller can determine the guest's line of sight based on facial features (e.g., eye position) and command the position of the mirror along the vertical to match the line of sight. In another example, the controller can command the rotation of the display and / or mirror to match the line of sight or further guest attributes. In yet another example, the controller can command the orientation angle of the mirror relative to the beam splitter and / or display. In one embodiment, the controller can command adjustments to the position and / or orientation of the beam splitter based on guest attributes. For example, the controller can determine the guest's orientation relative to the beam splitter and command the rotation of the beam splitter to match the guest's orientation.

[0067] In block 188, the controller can generate and transmit image data to the display, similar to block 168 in Figure 4. The controller can instruct the parameters of the image data to be adjusted to match the guest's attributes. For example, the virtual image may include a superhero suit superimposed on the guest's appearance. The controller can determine the guest's posture (e.g., the positions of various body components) and generate image data based on the posture so that the guest appears to be wearing a more realistic virtual image of the superhero suit.

[0068] Figure 6 is a flowchart of an embodiment of a method or process 230 for operating a show effect system to provide a realistic show effect. In one embodiment, a controller may monitor data corresponding to the guest's position relative to a beam splitter and command the controller to activate the show effect in response to determining that the guest is within a threshold distance of the beam splitter.

[0069] In block 232, the controller can receive sensor data indicating the guest, similar to block 162 in Figure 4 and block 182 in Figure 5. In block 234, the controller can determine the guest's position relative to the beam splitter, similar to block 164 in Figure 4.

[0070] In block 236, the controller can determine whether the guest's position is within a threshold distance of the beam splitter (e.g., within a threshold distance range). For example, the display and mirror can be positioned at a certain distance (or within a certain range) from the beam splitter in the virtual area. The fixed positions of the display and mirror may be related to providing the guest with the desired effect when the guest is located approximately within a threshold distance from the beam splitter. If the mirror and / or display have positions within a certain range, the threshold can vary with this range.

[0071] The controller can command the activation of a show effect in response to determining that the guest's position is within a threshold distance, similar to block 164 in Figure 4 and block 184 in Figure 5. For example, the show effect could include the projection of a virtual image of flames enveloping the guest's appearance, which is deflected by a mirror, passes through a beam splitter, and is visible to the guest. In another example, the virtual image could be a balloon perceived as appearing from behind the guest. By triggering the show effect at a threshold distance, the virtual image can have an apparent depth similar (or substantially similar) to the guest's reflected image. In this way, the show effect can have a realistic appearance relative to the reflected image.

[0072] If the guest's position is not within the threshold distance, the controller does not generate a show effect, and the method or process can return to block 232 and receive sensor data indicating the guest. As a result, it is possible to avoid the presentation of images that do not fit correctly due to the guest's viewpoint being outside the desired observation range. By avoiding certain threshold-excluded behaviors, it is possible to prevent the guest from observing inconsistent behaviors that could disrupt immersion.

[0073] While this specification illustrates and describes only some features of the present disclosure, many modifications and changes will come to mind for those skilled in the art. Therefore, it should be understood that the appended claims are intended to cover all such modifications and changes that fall within the actual spirit of the invention.

[0074] The claimed technologies described herein refer to and apply to tangible objects and specific examples of a practical nature that are not abstract, intangible, or purely theoretical, but which certainly improve the art. Furthermore, if any of the claims appended to the end of this specification contain one or more elements designated as "...means for (performing) (a function)" or "...steps for (performing) (a function)," such elements should be interpreted in accordance with 112(f) of the United States Patent Act. On the other hand, any claim containing elements designated in any other form should not be interpreted in accordance with 112(f) of the United States Patent Act. [Explanation of Symbols]

[0075] 52 Guest Area 54, 54A First Guest 54, 54B Second Guest 56 Show Effects System 58 sensors 60 Virtual Areas 62 Beam Splitter 66 Actuators 68 displays 70 Mirror 74 Controllers 76 memory 78 processors 102 Reflection Image 103 Transparent Image 104 Longitudinal direction 105 First position 106 Horizontal 107 Second position 108 Vertical 110 Virtual Images 112 Orbit 114 Arrows indicating movement 116A First configuration 116B Second configuration

Claims

1. It is a show effect system for amusement parks. A display configured to project one or more virtual images, A mirror configured to deflect one or more virtual images, One or more sensors configured to transmit guest data, including position and / or orientation data indicating the guest relative to the mirror, based on the detection of a guest within the observation area, One or more actuators coupled to the display and / or the mirror and configured to adjust the position of the display and / or the mirror, A beam splitter positioned between the observation area and the mirror, The light from the observation area is reflected back to the observation area as a reflected image. This enables the one or more virtual images deflected from the mirror to be transmitted as a transmitted image to the observation area through the beam splitter. A beam splitter configured as follows, One or more sensors and one or more controllers communicably coupled to at least one or more actuators or the display, the controllers being configured to command the one or more actuators to adjust the position and / or orientation of the display, the mirror, or both based on the guest data, A show effect system equipped with these features.

2. The show effect system according to claim 1, wherein the guest data includes guest height data, and the one or more controllers are configured to instruct the one or more actuators to adjust the position and / or orientation of the display, the mirror, or both based on the guest height data.

3. The show effect system according to claim 2, wherein the one or more controllers are configured to estimate the guest's viewpoint based on the guest's height data.

4. The show effect system according to claim 3, wherein the one or more controllers are configured to command the one or more actuators to adjust the position and / or orientation of the display, the mirror, or both thereof, so that the reflected image and the transmitted image overlap each other based on the guest viewpoint.

5. The one or more controllers described above are: Based on the aforementioned guest data, image data is generated. The image data is transmitted to the display, The display is instructed to project the one or more virtual images based on the image data. The show effect system according to claim 1, configured as described above.

6. The show effect system according to claim 1, comprising one or more trajectories movably coupled to the mirror and / or the display, wherein the one or more controllers are configured to command the one or more actuators to adjust the position and / or orientation of the display, the mirror, or both along the one or more trajectories.

7. The show effect system according to claim 1, further comprising a further actuator coupled to the beam splitter and communicably coupled to one or more controllers, wherein the one or more controllers are configured to instruct the one or more actuators to adjust the position and / or orientation of the beam splitter based on the guest data.

8. The show effect system according to claim 1, further comprising one or more physical objects arranged together with the display and the mirror on the opposite side of the beam splitter from the observation area.

9. The show effect system according to claim 8, comprising a light source communicably coupled to one or more controllers, wherein the one or more controllers are configured to command the light source to modulate in order to adjust the visibility of the one or more physical objects from the observation area through the beam splitter.

10. The show effect system according to claim 1, wherein the display includes a two-dimensional display, a three-dimensional display, or a volumetric display.

11. The show effect system according to claim 1, wherein the beam splitter includes a visual barrier.

12. A non-temporary computer-readable medium containing instructions, wherein the instructions, when executed by one or more processors, A show effect system for an amusement park attraction system, comprising a beam splitter configured to reflect the guest's image as a reflective element at a first position, a mirror, and a display configured to project one or more virtual images onto the mirror, which are deflected as transmissive elements through the beam splitter at a second position, to determine the guest's position and / or orientation to the show effect system, Based on the position and / or orientation of the guest, one or more actuators of the show effect system are instructed to move and / or rotate the display, the mirror, or both thereof to adjust the projection of the one or more virtual images onto the mirror and to adjust the second position of the transparent element. A non-temporary computer-readable medium configured to cause one or more processors to perform an operation including the above.

13. When the instruction is executed by the one or more processors, To determine the movement and / or orientation of the guest to a further position and / or orientation within the show effect system, resulting in the adjustment of the first position and / or orientation of the reflective element, Based on the movement and / or change in orientation of the guest to the further position and / or orientation, the one or more actuators are commanded to move and / or rotate the display, the mirror, or both thereof to adjust the projection of the one or more virtual images onto the mirror and to adjust the second position and / or change the orientation of the transparent element. A non-temporary computer-readable medium according to claim 12, configured to cause one or more processors to perform an operation including the above.

14. When the instruction is executed by the one or more processors, In response to determining that the movement and / or change of orientation of the guest is toward the beam splitter to the further position and / or orientation, the one or more actuators are commanded to move and / or rotate the display and the mirror toward each other, In response to determining that the movement and / or change of orientation of the guest causes it to move away from the beam splitter to the further position and / or orientation, command the one or more actuators to move and / or rotate the display and the mirror away from each other. A non-temporary computer-readable medium according to claim 13, configured to cause one or more processors to perform an operation including the above.

15. When the instruction is executed by the one or more processors, To determine the height of the aforementioned guest, Commanding one or more actuators to move and / or rotate the mirror and / or the display based on the height of the guest, A non-temporary computer-readable medium according to claim 12, configured to cause one or more processors to perform an operation including the above.

16. When the instruction is executed by the one or more processors, The system commands further actuators to adjust the position and / or orientation of an object based on the position and / or orientation of the guest. A non-temporary computer-readable medium according to claim 12, configured as described above.

17. When the instruction is executed by the one or more processors, Determining the distance between the guest and the beam splitter, Determining that the aforementioned distance is within the threshold distance, In response to determining that the distance between the guest and the beam splitter is within the threshold distance, the display is commanded to project the one or more virtual images that are deflected as the transparent elements through the beam splitter at the second position onto the mirror, A non-temporary computer-readable medium according to claim 12, configured to cause one or more processors to perform an operation including the above.

18. It is an amusement park attraction system. An observation area for guests, A beam splitter configured to reflect the appearance of the guest toward the observation area, A mirror positioned on the opposite side of the beam splitter from the observation area, A display configured to project one or more virtual images onto a mirror such that the mirror deflects one or more virtual images through a beam splitter, One or more actuators configured to move the mirror and / or the display in order to adjust the apparent depth of the one or more virtual images, An attraction system equipped with these features.

19. One or more sensors configured to detect the position of the guest within the observation area and generate position data based on the position, One or more controllers, which are communicatively coupled to the one or more actuators, and which are configured to adjust the apparent depth by commanding the one or more actuators to move the display, the mirror, or both based on the position data, The attraction system according to claim 18, comprising:

20. The system comprises one or more controllers coupled to the one or more actuators, and the one or more controllers are Determining a first distance between the guest and the beam splitter, Commanding one or more actuators to adjust a second distance between the display and the mirror based on the first distance, The attraction system according to claim 18, configured to perform an operation including the following:

Images