Systems and methods for an interactive augmented reality kiosk

Abstract

A performance effect system 56 of an amusement park may include a housing 80; an interaction space 58 within the enclosure 80, wherein the interaction space 58 receives the object 62 from outside the enclosure 80; and a display system 66 that presents an image. The performance effect system 56 may also include a beam splitter 68 positioned to enable visibility from the viewing portion 60 through the beam splitter 68 into the interaction space 58, and visibility of the virtual image via reflection from the beam splitter 68. A sensor 64 of the performance effect system 56 may monitor the interaction space 58 and provide sensor data related to an object 62 within the interaction space 58. One or more controllers 74 of the performance effect system 56 may be communicatively coupled with the sensor 64 and the display system 66, and may perform operations including determining one or more parameters of the object 62 based on the sensor data, and generating image data based on the parameters of the object 62.

Description

(19) State Intellectual Property Office (12) Invention Patent Application (10) Application Publication Number (43) Application Publication Date (21) Application Number 202480022029.1 (22) Application Date 2024.03.08 (30) Priority Data 63 / 455174 2023.03.28 US 18 / 596445 2024.03.05 US (85) PCT International Application Entering National Phase Date 2025.09.25 (86) PCT International Application Application Data PCT / US2024 / 019196 2024.03.08 (87) PCT International Application Publication Data WO2024 / 205869 EN 2024.10.03 (71) Applicant Universal City Cinema LLC Address California, USA (72) Inventors H.B. Moore, M. Waller, A.C. Jerome (74) Patent Agency China Patent Agency (Hong Kong) Limited 72001 Patent Attorneys Liu Moyang, Liu Chunyuan (51) Int.Cl. G02B 27 / 01 (2006.01) A47F 11 / 00 (2006.01) G06F 3 / 01 (2006.01) (54) Invention Title System and Method for Interactive Augmented Reality Kiosk (57) Abstract An amusement park performance effects system 56 may include a housing 80; an interactive space 58 within the housing 80, wherein the interactive space 58 receives an object 62 from outside the housing 80; and a display system 66 for presenting images. The performance effects system 56 may further include a beam splitter 68 positioned to enable visibility from the viewing portion 60 through the beam splitter 68 into the interactive space 58, and visibility of the virtual image via reflections from the beam splitter 68. Sensors 64 of the performance effects system 56 can monitor the interactive space 58 and provide sensor data relating to objects 62 within the interactive space 58. One or more controllers 74 of the performance effects system 56 may be communicatively coupled to the sensors 64 and the display system 66, and may perform operations including determining one or more parameters of the object 62 based on the sensor data, and generating image data based on the parameters of the object 62.Claims (3 pages), Description (15 pages), Drawings (8 pages), CN 120917364 A, 2025.11.07, CN 1 20 91 73 64 A. 1. A performance effects system for an amusement park, the performance effects system comprising: a housing; an interactive space within the housing, wherein the interactive space is configured to receive an object; a display system configured to present an image; an adjustable beam splitter positioned to enable the following visibility from a viewing portion: visibility through the adjustable beam splitter into the interactive space; and visibility of the image via reflection from the adjustable beam splitter; a sensor configured to monitor the interactive space and provide sensor data relating to the object within the interactive space; and one or more controllers communicatively coupled to the sensor and the display system, wherein the one or more controllers are configured to perform operations including: determining one or more parameters of the object based on the sensor data; generating image data based on at least one of the one or more parameters of the object; instructing the transmission of the image data to the display system; and instructing the display system to present the image based on the image data. 2. The performance effects system of claim 1, further comprising an additional sensor configured to monitor eye movement of a customer in the viewing area, wherein the additional sensor is communicatively coupled to the one or more controllers and configured to transmit additional sensor data indicative of the customer's eye movement. 3. The performance effects system of claim 2, further comprising an actuator coupled to the adjustable beam splitter and communicatively coupled to the one or more controllers, wherein the one or more controllers are configured to instruct the actuator to adjust the orientation and / or azimuth of the adjustable beam splitter relative to the display system based on the additional sensor data. 4. The performance effects system of claim 1, wherein the one or more controllers are configured to: determine the size or orientation of the object based on the sensor data; and generate or adjust the image based on the size or orientation of the object. 5. The performance effects system of claim 1, wherein the housing includes one or more openings that expose the interactive space to the external environment for access to the interactive space. 6. The performance effects system of claim 1, wherein the interactive space includes one or more reflective markers, and wherein the one or more controllers are configured to determine the position of the object based on at least one distance measurement between the object and at least one of the one or more reflective markers.7. The performance effects system of claim 1, wherein the one or more controllers are configured to: determine, based on the one or more parameters of the object, a target position of one or more virtual images of the image to be rendered by the display system onto the adjustable beam splitter; and instruct the display system to render the one or more virtual images based on the target position. 8. The performance effects system of claim 7, wherein the one or more parameters include a relative distance between the object and the adjustable beam splitter. 9. The performance effects system of claim 1, wherein the object includes one of a plurality of objects within the interactive space. 10. The performance effects system of claim 1, comprising an actuable cover assembly, the actuable cover assembly including one or more actuable first cover extending above the adjustable beam splitter and one or more actuable second cover on one or more lateral sides of the housing, wherein the actuable cover assembly is configured to reduce or block ambient light directed onto the adjustable beam splitter. 11. A non-transitory computer-readable medium comprising instructions, which, when executed by one or more processors, are configured to cause the one or more processors to perform operations including: determining one or more characteristics of a viewer based on sensor data from one or more sensors at a viewing position of a performance effects system; determining one or more parameters of an object positioned within the interactive area of ​​the performance effects system based on additional sensor data received from one or more additional sensors at an interactive area of ​​the system, wherein the object is visible from the viewing position as a transmission element via a beam splitter; instructing one or more actuators to adjust the orientation or orientation of the beam splitter based on the sensor data; generating image data based on the one or more parameters of the object; and instructing a display system to project one or more virtual images onto the beam splitter based on the image data, such that the one or more virtual images are visible from the viewing position as a reflective element overlapping the transmission element via reflection from the beam splitter. 12. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations including: determining one or more types of the object based on one or more identifiers on the object detected according to the additional sensor data; and generating the image data associated with the one or more types of the object.13. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations including: determining a movement of the object from a first orientation within the interaction region to an additional orientation within the interaction region; and updating the image data based on the additional orientation of the object within the interaction region. 14. The non-transitory computer-readable medium of claim 11, wherein instructing the display system to project the one or more virtual images onto the beam splitter comprises: instructing a first display of the display system to project a first virtual image of the one or more virtual images onto the beam splitter; and instructing a second display of the display system to project a second virtual image of the one or more virtual images onto the beam splitter, wherein the first virtual image and the second virtual image overlap to form the reflective element. 15. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations including: determining the gaze of a viewer in the viewing position based on the sensor data; and instructing the one or more actuators of the beam splitter to move and / or orient the beam splitter based on the gaze of the viewer in the viewing position.16. A attraction system for a scenic spot, the attraction system comprising: a housing including a beam splitter defining an interactive space and a viewing portion within the housing, wherein the interactive space is configured to receive an object, the viewing portion including a three-dimensional display system configured to project one or more virtual images onto the beam splitter, and the beam splitter being configured to enable visibility of the object within the interactive space via the beam splitter, and configured to enable visibility of the one or more virtual images projected onto the beam splitter via reflection from the beam splitter; one or more sensors configured to track movement of the object, wherein the object is positioned within the interactive space; and a controller configured to: receive sensor data from the one or more sensors, wherein the sensor data indicates the movement of the object positioned within the interactive space; Image data is generated based on the movement of the object positioned within the interaction space as indicated by the sensor data; and the three-dimensional display system is instructed to project the one or more virtual images onto the beamsplitter based on the image data, such that the one or more virtual images are combined to form the illusion of a three-dimensional image, and visible at a first location of visibility via reflection from the beamsplitter, the first location of visibility being based on a second location of visibility of the object through the beamsplitter. 17. The attraction system of claim 16, further comprising one or more actuators, wherein the controller is configured to instruct the one or more actuators to move and / or orient the beamsplitter within the housing. 18. The attraction system of claim 17, further comprising one or more additional sensors configured to determine one or more parameters indicating the orientation of a user relative to the beamsplitter, wherein the controller is configured to instruct the one or more actuators to move and / or orient the beamsplitter within the housing based on the orientation of the user relative to the beamsplitter. 19. The attraction system of claim 18, wherein the controller is configured to instruct the one or more actuators to rotate, translate, or both of the beam splitter relative to the 3D display system, adjust the beam splitter within the housing based on the user's orientation relative to the beam splitter. 20. The attraction system of claim 16, wherein the controller is configured to instruct the 3D display system to project at least one of the one or more virtual images onto the beam splitter to overlap a first position of visibility of the one or more virtual images reflected from the beam splitter with a second position of visibility of the object through the beam splitter.Claims 3 / 3 Page 4 CN 120917364 A System and Method for Interactive Augmented Reality Kiosk

[0001] Cross-Reference to Related Applications This application claims priority and benefit to U.S. Provisional Application No. 63 / 455174, filed March 28, 2023, entitled “SYSTEMS AND METHODS FOR AN INTERACTIVE AUGMENTED REALITY KIOSK”, which is hereby incorporated in its entirety by reference for all purposes. Background Art

[0002] This section is intended to introduce the reader to various aspects of the art that may be associated with various aspects of the present art, which are described and / or claimed below. This discussion is considered helpful in providing the reader with background information to facilitate a better understanding of the various aspects of this disclosure. Accordingly, it should be understood that these statements are to be read in this context rather than as an admission of prior art.

[0003] Throughout amusement parks and other entertainment venues, special effects can be used to help immerse customers in the experience of riding in a ride or attraction. Immersive environments may include three-dimensional (3D) props and set pieces, robotic or mechanical elements, and / or display surfaces for presenting media. For example, an amusement park may offer augmented reality (AR) experiences to customers. AR experiences may include presenting virtual objects to customers, and these virtual objects may provide customers with unique special effects. Special effects may enable the amusement park to offer creative ways to interest customers, such as by convincingly simulating real-world elements. Summary of the Invention

[0004] An overview of certain embodiments disclosed herein is set forth below. It should be understood that these aspects are presented merely to provide the reader with a brief overview of these certain embodiments, and these aspects are not intended to limit the scope of this disclosure. In fact, this disclosure may cover a variety of aspects that may not be set forth below.

[0005] In one embodiment, an amusement park performance effects system may include a housing; an interactive space within the housing, wherein the interactive space receives objects from outside the housing; and a display system for presenting images (any suitable display (e.g., liquid crystal display (LCD), light-emitting diode (LED) display, organic light-emitting diode (OLED) display, micro-LED), light field display, and / or a projector with a screen). The effects system may also include a beam splitter, which is positioned to enable visibility from the viewing area (e.g., viewing orientation) into the interactive space, and visibility of the virtual image via reflections from the beam splitter. Sensors in the effects system monitor the interactive space and provide sensor data relating to objects within the interactive space. One or more controllers in the effects system may be communicatively coupled to the sensors and the display system.The one or more controllers are capable of performing operations including: determining one or more parameters of an object based on sensor data, generating image data based on the object parameters, instructing the transmission of the image data to a display system (e.g., a projector), and instructing the display system to present an image based on the image data.

[0006] In one embodiment, a non-transitory computer-readable medium includes instructions that, when executed by one or more processors, cause the one or more processors to perform operations including determining one or more parameters of an object disposed within an interactive area of ​​a performance effects system based on sensor data received from one or more sensors monitoring an interactive area. The object can be seen from a viewing position as a transmissive element via a beam splitter. The operations may also include generating image data based on one or more parameters of the object, and instructing the display system to project one or more virtual images onto the beam splitter based on the image data, such that the one or more virtual images are visible from a viewing position as reflective elements overlapping with the transmissive elements via reflection from the beam splitter.

[0007] In one embodiment, a attraction system for a scenic spot may include a housing with a beam splitter defining an interactive space and a viewing portion within the housing. The interactive space can receive objects. The viewing component may include a display system that projects one or more virtual images onto a beamsplitter, and the beamsplitter is capable of enabling visibility of objects within the interactive space via reflection from the beamsplitter, and of enabling visibility of one or more virtual images projected onto the beamsplitter via reflection from the beamsplitter. The viewing system may also include one or more sensors that track the movement of objects within the interactive space and a controller capable of receiving sensor data from the one or more sensors. The sensor data may indicate the movement of objects within the interactive space. The controller may generate image data based on the movement of objects within the interactive space and instruct the display system to project virtual images onto the beamsplitter based on the image data, such that one or more virtual images are visible at a first location of visibility via reflection from the beamsplitter, the first location of visibility being based on a second location of visibility of the object via the beamsplitter.

[0008] These and other features, aspects, and advantages of the invention will become more readily understood when the following detailed description is read with reference to the accompanying drawings, in which the same characters denote the same parts throughout the drawings, wherein: FIG1 is a schematic diagram of an embodiment of an attraction system in an amusement park or theme park according to one aspect of the present disclosure; FIG2 is a front perspective view of an embodiment of the attraction system of FIG1 according to one aspect of the present disclosure; FIG3 is a side perspective view of an embodiment of the attraction system of FIG1 according to one aspect of the present disclosure; FIG4 is a perspective view of an embodiment of the attraction system of FIG1 according to one aspect of the present disclosure; FIG5 is a perspective view of an embodiment of the attraction system of FIG1 according to one aspect of the present disclosure; FIG6 is a front perspective view of the attraction system of FIG1 according to one aspect of the present disclosure adjusting the display of the projection of the performance effect; FIG7 is a schematic diagram illustrating the performance effect provided by the performance effect system of FIG1 according to one aspect of the present disclosure; FIG8 is a flowchart of an embodiment of a method or process for providing performance effects via the attraction system of FIG1 according to one aspect of the present disclosure; and FIG9 is a flowchart of an embodiment of a method or process for operating the attraction system of FIG1 according to one aspect of the present disclosure. Detailed Description

[0009] One or more specific embodiments of the present disclosure will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in this specification. It should be understood that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer’s specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Furthermore, it should be understood that such development work may be complex and time-consuming, but will be nothing more than routine tasks of design, fabrication, and manufacturing for those skilled in the art who benefit from the present disclosure.

[0010] When introducing elements of the various embodiments of the present disclosure, the articles “a” and “described” are intended to mean that one or more of the elements described in CN 120917364 A are present. The terms “comprising” and “including” are intended to be inclusive and mean that additional elements may exist in addition to the elements listed. Additionally, it should be understood that references to "one embodiment" or "an embodiment" in this disclosure are not intended to be construed as excluding the existence of additional embodiments that are also incorporated into the described features.

[0011] This disclosure relates to providing performance effects for amusement parks or theme parks. Amusement parks may include a variety of features such as rides (e.g., roller coasters), theatrical performances, set design, performers and / or decorative elements to interest customers.Performance effects can be used to supplement or complement features, such as to provide customers with a more immersive, interactive, and / or unique experience. For example, performance effects can be presented together with real-world objects to provide customers with an interactive experience.

[0012] The attraction system may include a performance effects system configured to present virtual or simulated objects that supplement the appearance of real-world objects via a Pepper's Ghost system. The Pepper's Ghost system may employ a primary area (e.g., a background scene), secondary areas (e.g., an augmented reality scene), and optical beamsplitters (e.g., glass). The optical beamsplitters may be arranged to allow the transmission of images within the primary area through the optical beamsplitters. The optical beamsplitters may also reflect images from the secondary areas. Thus, customers can observe images from the primary area (e.g., real images transmitted from the primary area through the optical beamsplitters) and images from the secondary area (e.g., virtual images reflected from the secondary area through the optical beamsplitters), which are combined, superimposed, or overlaid relative to each other via the optical beamsplitters.

[0013] Embodiments of this disclosure relate to performance effects systems that utilize Papiopeia-based techniques to provide a realistic depiction of combined elements of secondary and primary areas (such as those described above). For example, as illustrated in Figures 2-6, the performance effects system may include apertures (e.g., slots, holes, such as opening 90) to receive real-world objects (e.g., physical objects, appendages, props) via customer interaction in a primary area (e.g., interactive space 58). Images of elements in the secondary areas (e.g., images on a display (such as a liquid crystal display (LCD), viewing portion 60)) may be adjusted or manipulated to provide distortion of the image of a real-world object in the primary area, visual alteration of the image, interaction with the representation of the image, or any other suitable enhancement. For this purpose, the primary area may include sensors (e.g., an IR camera) to detect objects and track their position within the primary area (e.g., position relative to an optical beam splitter). Detection of objects may include any sensing parameters associated with the object. To more realistically depict elements (e.g., virtual objects) in secondary areas as physically positioned relative to the customer's perspective within the primary area, the images of the secondary area elements can be generated based on the object's location. Therefore, the images of the secondary area elements can be overlaid, superimposed, or combined with images from the primary area. For example, the performance effects system disclosed herein can provide realistic performance effects to customers via augmented reality without requiring or using wearable technologies (such as headsets or goggles). Thus, the operational (e.g., maintenance, cleaning, repair, control of each individual wearable object) and / or costs associated with wearable technologies (e.g., installation costs, maintenance costs) can be avoided while simultaneously enhancing the customer experience.Additionally, performance effects systems can be more easily implemented and operated, such as without requiring customers to wear wearable technology to achieve the performance effects provided.

[0014] In some instances, a performance effects system may include one or more sensors (e.g., forward sensors) to detect the presence of a customer and the customer's perspective (e.g., line of sight). For example, a performance effects system may track the customer's eye movement to determine focus. In another example, a performance effects system may track the height of a customer relative to a primary or secondary area to determine the customer's perspective. In response to determining the customer's perspective, the performance effects system may adjust the angle of an optical beam splitter to improve the visibility of the image of elements in the secondary area. Additionally or alternatively, a performance effects system may include one or more masking elements to reduce or block ambient light, thereby improving the visibility of the image provided for the secondary area.

[0015] In view of the foregoing, FIG1 is a schematic diagram of an embodiment of an attraction system 50 in an amusement park or theme park. The specification, page 3 / 15, CN 120917364 A, describes an attraction system 50 as including a customer area 52 with customers 54 positioned therein and a performance effects system 56 visible from and potentially accessible from the customer area 52. As one example, the customer area 52 may include paths (e.g., sidewalks, queues, routes) or open spaces through which customers 54 can traverse. As another example, the customer area 52 may include spaces (e.g., seating areas) where customers 54 can position themselves to watch a performance. As a further example, the customer area 52 may include vehicles that can move through the attraction system 50 and transport customers 54.

[0016] Furthermore, the attraction system 50 may include a performance effects system 56 (e.g., a Pablo Phantom-based system, an aerial projection system) that can provide entertainment to customers 54 located within the customer area 52 and / or the attraction system 50. The performance effects system 56 may include an arcade-like configuration that uses Papioca-based technology to create performance effects (e.g., visual effects) visible to one or more customers 54. To create these effects, the optical beamsplitter of the performance effects system 56 may be able to transmit images within a primary area and also reflect images within secondary areas. Alternatively, the performance effects system 56 may use aerial imaging technology to create performance effects. For example, the optical beamsplitter may be able to transmit images within a primary area, and a retroreflector may reflect the images to create the performance effects. The reflected images may appear as aerial images or images suspended within the performance effects system 56. The retroreflector may be adjacent to the optical beamsplitter and made of a reflective material. Thus, performance effects can be presented to customer 54.

[0017] The performance effects system 56 may include one or more augmented reality kiosks located throughout the attraction system 50 as part of the exploration of the customer 54. The performance effects system 56 may include supports (e.g., countertops, tables) to accommodate physical objects (e.g., food, drinks, souvenirs), and the performance effects system 56 may utilize a spray shield to protect the objects and also display information about the objects to (one or more) customers 54. In any of these examples, the performance effects system 56 may include an interactive space 58 (primary area, background area) for customer interaction (e.g., customer input), a viewing area 60 (secondary area, augmented reality scene) for (one or more) customers 54 to view performance effects (e.g., performance effect projection), and a beam splitter 68 separating the interactive space 58 and the viewing area 60 from each other.

[0018] The interactive space 58 may receive an object 62 (e.g., an apple), and one or more sensors 64 of the performance effects system 56 are operable to detect the position of the object 62 within the interactive space 58. In the illustrated embodiment, the sensors 64 are located within the interactive space 58. However, in other embodiments, the sensor(s)64 may be located anywhere that allows the sensor(s)64 to detect the object(s)62. The object(s)62 may be any suitable physical object (e.g., a token, book, food, hand) positioned within the performance effects system 56. In one embodiment, the interaction space 58 may include an opening to enable the object(s)62 to be moved into and / or removed from the interaction space 58. For example, a customer(s)54 may insert the object(s)62 into the interaction space 58 via the opening. The performance effects system 56 may present different performance effects based on the inserted object(s)62 to provide an interactive experience for the customer(s). For example, a customer(s)54 may insert a token(s) into the interaction space 58 (as part of the exploration), and the performance effects system 56 may present performance effects (such as a treasure chest) that can be viewed by the customer(s)54 to enhance the appearance of the token(s). In another example, a customer(s)54 may insert their hand(s) into the interaction space 58 via the opening, such as to retrieve a physical object (e.g., food, book, card) positioned within the interaction space 58 for purchase. The performance effects system 56 can present performance effects (such as information about physical objects) to enhance the experience of the customer 54 who is viewing the physical objects (e.g., a shopping experience).

[0019] The interaction space 58 may include one or more of one or more sensors 64 to track the position of the object 62 within the interaction space 58.One or more sensors 64 may be cameras (e.g., optical cameras, 3D cameras, infrared (IR) cameras, depth cameras), orientation sensors (e.g., sonar sensors, radar sensors, laser imaging, detection and ranging (LIDAR) sensors), etc. For example, one or more sensors 64 may generate video data of object 62 (e.g., which may be invisible to one or more customers 54 in the IR spectrum). One or more sensors 64 may represent multiple sensors located in different locations (e.g., multiple locations within and outside the interaction space 58) to generate different sensor data (e.g., video data, image data) indicating the location of object 62. In one embodiment, the interaction space 58 may include one or more markers 65 (such as IR reflective markers, ultraviolet markers, etc.) that facilitate the determination of the location of object 62. For example, markers 65 may be placed at specific locations (e.g., within the interactive space 58, in a grid pattern), and the orientation of object 62 may be determined relative to the specific location of markers 65 to facilitate the determination of the positioning of object 62. In another example, markers 65 may have a known shape (e.g., circle, square, rhombus) and be placed in a known configuration (e.g., in a pattern, at a predetermined angle, etc.). As a specific example, the position of object 62 may be determined based on feedback from one or more sensors 64 indicating that certain markers 65 are unobservable because they are obscured or blocked by object 62.

[0020] In one embodiment, one or more sensors 64 may also detect the presence and / or viewing angle (e.g., line of sight) of one or more customers 54. For example, one or more sensors 64 may be cameras positioned to monitor one or more customers 54 and may generate sensor data of one or more customers 54 during operation of the performance effects system 56. For example, one or more sensors 64 may be between one or more customers 54 and viewing section 60. Sensor data may include facial features, eye movements, height, arm length, and / or orientation of one or more customers 54. For example, sensor data may include the relative orientation between one or more customers 54 and the performance effects system 56. As further described herein, sensor data may be analyzed to determine the gaze of one or more customers 54 and to adjust the performance effects system 56 to improve the visibility of the performance. In additional or alternative embodiments, one or more sensors 64 may detect movement of one or more customers 54 and may generate sensor data indicative of customer attributes. For example, one or more sensors 64 may generate sensor data on facial features or other attributes of one or more customers 54.The performance effects system 56 may then operate based on such sensor data (including the identity of the customer 54 (e.g., based on facial recognition) or other attributes of the customer (e.g., identity, height, body shape, weight, clothing, hairstyle, accessories, tattoos)) to provide performance effects. The performance effects system 56 may also operate based on user input to provide performance effects. User input may include customer attributes (e.g., height, body shape, weight, age, color blindness) or any customer preference.

[0021] Additionally, the performance effects system 56 may include a viewing portion 60 that can generate and project virtual images (e.g., images as part of an augmented or virtual reality presentation) to provide an augmented reality scene for (one or more) customers 54. For this purpose, the viewing portion 60 may include a display system 66 to create and project virtual images for (one or more) customers 54. The display system 66 may be any suitable display (e.g., a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, a micro LED) and / or a projector with a screen that receives image data and projects (e.g., displays) the image data as virtual images. Display system 66 may also include a three-dimensional display (such as a volumetric display, light field display, stereoscopic display, lens display, etc.). Virtual images can be adjusted or manipulated to enhance (e.g., distort, alter, overlay, or interact with) the appearance of object 62 within interactive space 58. For example, a virtual image could be a scaly lizard mask that transforms the appearance of a customer's hand (e.g., when viewed from the customer's perspective) into the claws of a lizard. In another example, a virtual image could be one or more maps providing additional information to the attraction system 50, and one or more customers 54 could interact with the maps to view the information. In yet another example, a virtual image could be one or more text strings overlaid on object 62 (e.g., when viewed from the customer's perspective), wherein the text describes certain features of object 62 (e.g., features determined based on image recognition).

[0022] In one embodiment, a virtual image (e.g., an image) can be any suitable two-dimensional image output (e.g., projected by) display system 66. For example, a virtual image could be a static image (such as an unchanging picture or image). In another example, a virtual image could be a dynamic image and / or video that changes over time. In additional or alternative embodiments, the virtual image may include a three-dimensional image that may be static or dynamic. For example, display system 66 may include a light field display, which may include an array of surfaces (e.g., lenses) that manipulate how light converges, focuses, and / or is guided.An array of surfaces allows light to be focused at different locations (such as at different depths relative to one or more customers 54) to generate an image with a layered, contoured, and / or textured appearance, thereby forming a three-dimensional profile for the projected image. In another example, the display system 66 may include multiple displays 66, each generating a portion (e.g., slice) of a three-dimensional virtual image, and the combination of these portions forms an image. Each portion generated by a respective display 66 may be a two-dimensional or three-dimensional image. In yet another example, the display system 66 may include a single display that can be moved to different locations and generate different virtual images to create a three-dimensional image (due to the persistence of vision of one or more customers 54, e.g., viewers). The display system 66 may be positioned to project virtual images onto a beam splitter 68. The virtual images may include one or more virtual images projected by the display system 66, which are reflected from the beam splitter 68 as reflective elements 72 and displayed at one or more locations.

[0023] The beam splitter 68 can combine (e.g., overlay, superimpose) the appearance of the object 62 from the interaction space 58 with the image (e.g., a virtual image projected by the display system 66) from the viewing portion 60 to provide a performance effect to one or more customers 54. For example, the beam splitter 68 can be partially transmissive and partially reflective, and one or more customers 54 can view elements through the beam splitter 68 as well as elements reflected from the beam splitter 68. Thus, from the customer area 52, one or more customers 54 can view the object 62 positioned in the interaction space 58 as a transmissive element 70 that is transmitted through or visible through the beam splitter 68 (e.g., at a visible location), and one or more customers 54 can view the virtual image projected by the display system 66 in the viewing portion 60 as a reflective element 72 that is reflected from the beam splitter 68 and toward the customer 54 (e.g., at a visible location). For this purpose, the beam splitter 68 may be made of a material with both transmissive and reflective properties (such as glass, plastic, foil, and / or a translucent mirror) to enable viewing of the object 62 in the interaction space 58 as a transmissive element 70 through the beam splitter 68, and to enable viewing of a virtual image of the viewing portion 60 reflected from the beam splitter 68 as a reflective element 72. Thus, one or more customers 54 can view a combined image including the transmissive element 70 and the reflective element 72. In some instances, the beam splitter 68 may have a flat or planar shape. In other instances, the beam splitter 68 may have an arcuate or concave shape, which can manipulate or change the appearance of the object 62 and / or the image projected by the display system 66.Furthermore, beam splitter 68 may be angled (e.g., at 45 degrees) relative to the line of sight of(one or more) customers 54 and / or relative to display system 66 to reflect the image projected by display system 66 toward(one or more) customers 54 in a desired manner. In some instances, beam splitter 68 may be coupled to actuator 73, which adjusts beam splitter 68 based on the viewing angle (e.g., line of sight) of(one or more) customers 54 (e.g., by rotating, orienting, and / or linearly translating beam splitter 68). Additionally or alternatively, actuator 73 may adjust the distance between beam splitter 68 and display system 66 (e.g., by translating beam splitter 68). Thus, actuator 73 may further adjust the appearance of reflective element 72 (when viewed by(one or more) customers 54).

[0024] In one embodiment, performance effects system 56 may include a cover that may be positioned around viewing portion 60 to enhance the visibility of reflective element 72 (e.g., by reducing or blocking ambient light or glare onto beam splitter 68). For example, the performance effects system 56 may include a cloth or fabric that shields one side of the viewing portion 60. In another example, the shield may extend beyond the boundary of the display system 66 to reduce or block light from entering the viewing portion 60, thereby improving the visibility of the virtual image (e.g., as reflected from the beam splitter 68). The performance effects system 56 may operate to adjust visibility (e.g., by providing different shades of color (e.g., for color contrast adjustment) or different shades (for increasing light intensity) based on incident light (e.g., sunlight, streetlights), based on the detection of light (e.g., via one or more light sensors that measure glare or direct light), or based on timing (e.g., a timer may be set to initiate adjustments based on a known lighting scene). In one embodiment, the performance effects system 56 may include one or more input devices (e.g., buttons, touchscreens, knobs) for customer input, and the performance effects system 56 may adjust the visibility of the virtual image based on customer input. For example, one or more customers 54 can rotate a knob to increase the visibility of the reflective element 72. For this purpose, the performance effects system 56 may include one or more light sources (e.g., OLED, LED) that output an amount of light to adjust the brightness level of the virtual image reflected from the beam splitter 68. For example, one or more light sources may be LEDs that can be modulated to increase the amount of output light to increase the brightness level of the interactive space 58, thereby increasing the brightness level of the virtual image reflected from the beam splitter 68. In another example, one or more light sources may reduce the amount of output light to increase the contrast between the virtual images reflected from the beam splitter 68 and improve image visibility. Additionally or alternatively, one or more light sources may adjust the color of the interactive space 58.For example, one or more light sources may include multiple LEDs of different colors that can be modulated to output colors (such as red, green, blue, etc.). In this way, the color contrast level of the virtual image reflected from the beam splitter 68 can be adjusted.

[0025] In one embodiment, one or more customers 54 may use one or more input devices to input one or more customer attributes, and the performance effects system 56 may adjust the virtual image based on the customer attributes. For example, one or more customers 54 may input height, color blindness status, color preference, etc. As further described herein, the performance effects system 56 may adjust the orientation of the beam splitter 68 based on the height and / or line of sight of one or more customers 54 to improve the visibility of the virtual image reflected from the beam splitter 68. The performance effects system 56 may adjust the color of the virtual image based on the color blindness attribute of one or more customers 54. To this end, the performance effects system 56 may generate the virtual image based on colors visible to one or more customers, and / or by removing colors invisible to one or more customers 54 or color combinations that cannot be distinguished by one or more customers 54 from the virtual image. In this way, the visibility of the virtual image can be improved. In another example, one or more customers 54 can select a color preference (e.g., via one or more input devices), and the performance effects system 56 can generate a virtual image based on the color preference. Returning to the lizard claw example, one or more customers 54 can indicate green as a color preference, and the performance effects system 56 can generate a green scaly lizard mask. Alternatively or additionally, the display system 66 may include one or more displays 66 that can generate virtual images individually or jointly. For example, a first display 66 can generate a first portion of the green scaly lizard mask, and a second display 66 can generate a second portion of the green scaly lizard mask. In another example, the first display 66 can generate a green scaly lizard mask, and the second display 66 can adjust the color of the lizard mask by generating a red scaly lizard mask to cover and form a yellow scaly lizard mask. In yet another example, the first display 66 and the second display 66 may generate a lizard mask, and the third display 66 may generate a colored background that can adjust the brightness level of the lizard mask and / or the color contrast between the lizard mask and the background, and improve the visibility of virtual images such as those reflected from the beam splitter 68.

[0026] The performance effects system 56 may include or coordinate with a controller 74 (e.g., a control system, an automatic controller, a programmable controller, an electronic controller, a control circuitry, a cloud computing system), the controller 74 being configured to operate the performance effects system 56 to provide an interactive experience to one or more customers 54.For example, controller 74 may be communicatively coupled to (e.g., via one or more wires, via wireless communication (e.g., via a transmitter, receiver, transceiver)) sensor(s) 64, display system 66, and / or actuator 73. Controller 74 may include memory 76 and processor 78 (e.g., a processing circuitry system). Memory 76 may include volatile memory (such as random access memory (RAM)) and / or non-volatile memory (such as read-only memory (ROM), optical drives, hard disk drives, solid-state drives, or any other non-transitory computer-readable medium including instructions for operating performance effects system 56). Processor 78 may be configured to execute such instructions. For example, processor 78 may include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof. In some instances, controller 74 may include one or more controllers communicatively coupled and capable of performing the actions described herein individually or collectively. Alternatively or additionally, controller 74 may include one or more processors 78 and / or one or more memories 76 capable of performing the actions described herein individually or collectively.

[0027] In one embodiment, controller 74 may receive sensor data from one or more sensors 64 and operate to identify object 62, identify the location of object 62, and transmit image data (e.g., image data generated based on sensor data provided by one or more sensors 64) to display system 66 to generate a virtual image. For example, controller 74 may utilize image analysis techniques to determine the size, shape, color, texture, reflectivity, brightness, orientation, and / or type of object 62. Controller 74 may then identify corresponding characteristics (e.g., size, shape, type) of the image data to be transmitted to display system 66. For example, controller 74 may identify object 62 as a ticket and generate image data with information about the ticket (such as ticket type, duration of stay, ticket price, etc.). In another example, controller 74 may identify object 62 as a souvenir (e.g., a book) and generate image data associated with the souvenir (such as special effects or price). To generate realistic special effects, controller 74 can determine the position of object 62 and the corresponding projection orientation of the virtual image to coordinate with object 62 to provide the desired appearance of reflective element 72. For example, controller 74 can determine the position of object 62 based on a grid pattern of markers 65 positioned within interaction space 58.The controller 74 may determine the relative distance between the object 62 and the beam splitter 68 based on multiple images captured by one or more sensors 64 and indicating the object 62 relative to various markers 65 positioned at known locations (e.g., known coordinates in a three-dimensional coordinate system of the interaction space 58). In some embodiments, the one or more sensors 64 may include one or more LiDAR sensors capable of determining positioning information. Alternatively or additionally, the controller 74 may use image analysis techniques to determine the size of the object 62 and / or the position of the object 62 relative to the beam splitter 68 using the shadow of the object 62. The controller 74 may also continue to track the position of the object 62 and adjust (e.g., update) the image data transmitted to the display system 66. For example, the controller 74 may adjust the size and / or position of a virtual image projected by the display system 66 based on the position of the object 62.

[0028] As an example, the controller 74 may transmit image data to the display system 66, which depicts the movement and / or size adjustment of the reflective element 72 in response to a determined movement of the object 62 (e.g., relative to the beam splitter 68). For example, controller 74 may instruct display system 66 to operate to provide reflective elements 72 that can be superimposed on the appearance of object 62 to alter (e.g., distort, manipulate, adjust, enhance) the appearance of object 62 as viewed by customer 54. For example, controller 74 may instruct display system 66 to project a larger virtual image (relative to a previously projected image) in response to determining that object 62 is within a threshold distance of beam splitter 68 (e.g., moving closer to the viewer), and controller 74 may instruct display system 66 to project a smaller virtual image (relative to a previously projected image) in response to determining that object 62 is moved away from beam splitter 68 beyond a threshold distance (e.g., moving away from the viewer). Thus, the virtual image can provide reflective elements 72 that appear to conform to the transmissive elements 70 as viewed by customer(s) 54. Therefore, performance effects system 56 can provide a realistic or otherwise desired depiction of the combined image (e.g., transmissive elements 70 and reflective elements 72) and provide an interactive experience for customer(s) 54. In one embodiment, controller 74 may determine the appearance of reflective elements 72 based on sensor data received from sensor(s) 64. The controller 74 may determine whether the appearance of the reflective element 72 is desired (e.g., matches the target appearance) and may operate the display system 66 (such as instructing the display system 66 to adjust the virtual image being projected) in response to the appearance of the reflective element 72 being undesirable.

[0029] In one embodiment, the controller 74 may be configured to instruct the actuator 73 to adjust the orientation of the beam splitter 68 based on the position of one or more customers 54 (e.g., one or more viewers). For example, the controller 74 may receive sensor data and operate to determine the viewing angle of one or more customers 54.The controller 74 can identify the orientation / orientation (e.g., the orientation / orientation of the head of one or more customers 54), the height of one or more customers 54, the eye level / orientation of one or more customers 54, eye movement, etc., to determine the viewing angle of one or more customers 54. For example, the controller 74 can determine the area of ​​the beam splitter 68 viewed by one or more customers 54. The controller 74 can transmit signals to the actuator 73 coupled to the beam splitter 68 to adjust the angle of the beam splitter 68 based on the viewing angle of one or more customers 54 (e.g., by rotating the beam splitter 68 relative to the display system 66) to improve the visualization of the transmission element 70 and / or the reflection element 72. Alternatively or additionally, the controller 74 can instruct the actuator 73 to adjust the distance between the beam splitter 68 and the display system 66 based on the viewing angle of one or more customers 54 (e.g., by translating the beam splitter 68 relative to the display system 66). Therefore, controller 74 can facilitate viewing of reflective element 72 by one or more customers 54.

[0030] FIG2 is a front perspective view of an embodiment of attraction system 50. In particular, FIG2 illustrates a performance effect system 56 having a viewing section 60, the performance effect system 56 including a sensor 64A positioned adjacent to or within the viewing section 60 (e.g., above the interaction space 58) and two sensors 64B positioned adjacent to or within the interaction space 58. In an embodiment, performance effect system 56 may include any suitable number of sensors 64A adjacent to or within the viewing section 60, and any suitable number of sensors 64B adjacent to or within the interaction space 58. Sensor 64A may be positioned between the viewing section 60 and a customer facing the viewing section 60, and sensor 64A may generate sensor data indicating customer characteristics (e.g., viewing angle). Sensor 64B can be positioned relative to the interaction space 58 and can generate sensor data indicating objects positioned within the interaction space 58 (e.g., for object 62 described in FIG. 1). The performance effects system 56 may also include a controller 74 positioned adjacent to (e.g., below) the interaction space 58 and the viewing section 60. The controller 74 may be communicatively coupled to the display system 66 of the viewing section 60, the sensors 64A of the viewing section 60, the sensors 64B of the interaction space 58A, and the actuator 73 coupled to the beam splitter 68. In the illustrated embodiment, sensors 64A and 64B are disposed within or coupled to the housing 80 of the performance effects system 56. However, in other embodiments, sensors 64A and 64B may be positioned outside the housing 80 in a manner that allows for separate monitoring of the viewing section 60 and the interaction space 58.

[0031] As indicated above, the performance effects system 56 may include a housing 80 (e.g., representing a plurality of housings coupled to each other, or representing a single housing). The housing 80 may define a first volume 82 having an interaction space 58 and a viewing portion 60. For example, a beam splitter 68 may be positioned within the first volume 82 to further divide the first volume 82 into the interaction space 58 and the viewing portion 60. The housing 80 may also define a second volume 84 in which a controller 74 may be positioned. However, in other embodiments, the controller 74 may be external to the housing 80 and may even be wirelessly communicating with other aspects of the performance effects system 56. The housing 80 may include various features (such as walls, panels, and fences) that can protect components of the performance effects system 56 (e.g., sensors 64A and 64B, beam splitter 68, controller 74) from various external elements (such as dust and debris). Thus, the housing 80 can protect such components to enable desired operation and / or extend the effective lifespan of the performance effects system 56. In additional or alternative embodiments, housing 80 may include features (such as doors) that enable access to components (such as controller 74) disposed within housing 80. Thus, housing 80 allows various operations (such as inspection, maintenance, repair, and replacement operations) to be performed on the components while also providing protection for performance effects system 56.

[0032] Display system 66 may face beam splitter 68 such that virtual images projected from display system 66 may be reflected from beam splitter 68 and enter the viewer's field of vision (e.g., line of sight). Display system 66 may receive image data from controller 74 and digitally render virtual images based on the image data. Display system 66 may project virtual images onto a region (e.g., a portion) of beam splitter 68 based on the image data. When viewed by a customer, reflective elements (e.g., the reflected virtual images) may appear to be located within interactive space 58. For example, beam splitter 68 may be angled 88 (e.g., 45 degrees) relative to display system 66 to provide a desired (e.g., realistic) appearance of reflective elements within interactive space 58. However, in one embodiment, controller 74 may instruct actuator 73 to adjust beam splitter 68 to any suitable angle, any suitable distance, and / or any other suitable orientation relative to display system 66. For example, controller 74 may transmit signals to actuator 73 based on sensor data to adjust beam splitter 68. Sensor 64A of viewing portion 60 may generate sensor data of the customer, which may include facial features, eye level, height, arm length, etc., for transmission to controller 74. Controller 74 may instruct actuator 73 to adjust beam splitter 68 based on sensor data received from sensor 64A.For example, controller 74 may instruct actuator 73 to adjust beam splitter 68 to improve the visibility of reflective elements, thereby enabling the performance effect (e.g., a combined image of transmitted and reflected elements) to be correctly viewed by the customer.

[0033] In one embodiment, display system 66 may be a volumetric display that projects a three-dimensional virtual image such that reflective elements can be displayed from any viewing angle with accurate depth and size. The volumetric display may include a screen (e.g., a thin film layer) that can be rapidly and repeatedly transmitted through the volume, while images can be projected onto the screen at various orientations in a manner that creates the illusion of a three-dimensional object due to the persistence of vision of the customer (e.g., the viewer). Therefore, controller 74 may not instruct actuator 73 to adjust the angle of beam splitter 68. In one embodiment, display system 66 may be located behind beam splitter 68 such that the virtual image projected from display system 66 can be transmitted through beam splitter 68 and enter the customer's viewing angle. Additionally, the display system 66 may include a first display 66 facing the beam splitter 68 and projecting a virtual image reflected from the beam splitter 68, and a second display 66 located behind the beam splitter 68 and projecting a virtual image transmitted through the beam splitter 68.

[0034] The controller 74 may also instruct the display system 66 to project virtual images based on objects positioned within the interaction space 58. The housing 80 may define an opening 90 that exposes the interaction space 58 to the external environment for access to the interaction space 58. For example, the opening 90 may enable the positioning of objects (such as object 62 described with respect to FIG. 1) into and / or removal of objects from the interaction space 58. For example, a customer may insert their hand into the opening 90 during interaction with the performance effects system 56. Sensors 64B within the interaction space 58 may generate sensor data indicating the orientation of the customer's hand. In some instances, the controller 74 may determine the size of the customer's hand and the relative position of the customer's hand based on the sensor data. The controller 74 may generate image data to be transmitted to the display system 66 based on the size and relative position of the customer's hand. The controller 74 can also determine the orientation of the image data to be projected by the display system 66 based on the relative position of the customer's hand. In this way, the controller 74 can instruct the display system 66 to project virtual images to adjust the appearance of reflective elements in order to provide a more interactive experience for the customer. For example, the reflective element 72 can be presented as a virtual tattoo on the customer's hand and can be adjusted to correspond to the movement of the customer's hand within the interaction space 58.

[0035] FIG3 is a side perspective view of an embodiment of the attraction system 50. In particular, FIG3 illustrates an attraction effect system 56, in which the interaction space 58 includes physical objects 100 (e.g., for the object 62 described in FIG1) extending from the customer 54 into the interaction space 58 via an opening 90. The illustrated attraction effect system 56 also includes a plurality of markers 65 arranged in a grid pattern within the interaction space 58.For example, physical object 100 is represented as a ticket made of a non-transparent material (e.g., paper, plastic, metal). However, physical object 100 can be any suitable object (such as an appendage of customer 54, e.g., a hand, merchandise, e.g., food, books, tokens, maps, coins, etc.). Physical object 100 positioned within interaction space 58 can be visible to customer 54 as a transmissive element through beam splitter 68.

[0036] Sensor 64B of interaction space 58 can generate sensor data (e.g., captured image data, location data) associated with physical object 100. Controller 74 can identify the type of physical object 100 based on sensor data. For example, controller 74 can utilize image analysis (e.g., processing) techniques to identify the type of physical object 100 as a ticket. In one instance, controller 74 can compare the shape of physical object 100 with one or more shapes stored in memory 76. In other instances, the ticket may include a text description and / or image that can be identified using image analysis techniques and matched with a description or image stored in memory 76. In some instances, controller 74 may identify one or more identifiers 102 (e.g., QR codes, barcodes) on physical object 100 and compare one or more identifiers 102 with a list of identifiers stored in memory 76. As illustrated, physical object 100 includes a barcode that can be used by controller 74 to identify the type of physical object 100. Specification 10 / 15 pages 14 CN 120917364 A

[0037] Controller 74 may also determine the position of physical object 100 within interaction space 58 based on sensor data. For example, one or more of markers 65 may be placed at known locations within interaction space 58, and controller 74 may identify the relative position of physical object 100 with respect to one or more markers 65 to determine the position of physical object 100 within interaction space 58. For example, controller 74 may determine the relative distance between physical object 100 and beam splitter 68 to determine the size of image data. In another example, controller 74 may determine the position of physical object 100 to determine the orientation of image data. The controller 74 may determine the image data to be transmitted to the display system 66 based on the type and / or location of the physical object 100 within the interaction space 58. For example, the controller 74 may identify image data associated with different types of objects that can be located within the interaction space 58.

[0038] The controller 74 may instruct the display system 66 to operate by overlaying additional visual information to change the appearance of the physical object 100. For example, the controller 74 may instruct the display system 66 to adjust the appearance of the ticket by projecting ticket-related information, changing the color of the ticket by projecting colors onto the ticket, and / or by projecting animations that appear to be displayed on the ticket.Such special effects can be realistically provided by controller 74 based on the size and / or position of physical object 100 within interaction space 58 (e.g., by enabling display 66 to project virtual images that provide reflective elements corresponding to the appearance of physical object 100 visible to customer 54).

[0039] FIG4 is a perspective view of one embodiment of attraction system 50. In the embodiment illustrated in FIG4, attraction system 56 may be an arcade-like configuration with a mask 120A to reduce or block ambient light directed to a portion of attraction system 56. For example, mask 120A may at least partially surround viewing portion 60. Mask 120A may extend above (e.g., overlap with) beam splitter 68 in longitudinal direction 122. Mask 120A may block light (e.g., light directed toward beam splitter 68 in vertical direction 124). In one instance, controller 74 may instruct actuator 123 to extend, retract, or otherwise move mask 120A. For example, in response to determining that the light intensity is below a threshold level (e.g., on a cloudy day when the sun is partially obscured), controller 74 may instruct actuator 123 to retract the occlusion 120, thereby increasing the amount of light directed to beam splitter 68 to increase the visibility of objects within interactive space 58. In response to determining that the light intensity is above a threshold level (e.g., on a sunny day when the sun is not obscured), controller 74 may instruct actuator 123 to extend the occlusion 120, thereby reducing the amount of light directed to beam splitter 68 to increase the visibility of reflective elements in viewing portion 60. For example, an increase in light intensity may reduce the relative brightness level of the virtual image (e.g., relative to the customer's viewing angle). Extending the occlusion 120 may block the amount of light directed to beam splitter 68, which may increase the relative brightness level of the virtual image, thereby improving the visibility of the virtual image relative to the customer's viewing angle. To this end, the sensors of the performance effects system 56 (e.g., for sensor 64 described in FIG. 1) can generate sensor data indicating light conditions (e.g., brightness level, light intensity), and the controller 74 can instruct the actuator 123 to adjust the mask 120 based on the light conditions to provide customers with a better viewing experience of the special effects provided by the performance effects system 56.

[0040] Alternatively or additionally, the performance effects system 56 may include a mask 120B on the lateral side of the performance effects system 56. The mask 120B may extend across the lateral side of the performance effects system 56 (e.g., along the longitudinal direction 122, along the vertical direction 124). Thus, the mask 120B may reduce or block ambient light directed toward the beam splitter 68 in the lateral direction 125. The controller 74 may also instruct the actuator 123 to adjust the mask 120B based on the detected light conditions. In this way, the masks 120A and 120B can synergistically improve the visibility of the performance effects system 56 to the customer.Alternatively or alternatively, the masking elements 120A and 120B may guide the customer to look directly at the beam splitter 68 to improve the visibility of the reflective elements. In this way, the customer can view the beam splitter 68 without being at an angle and without viewing distorted performance effects.

[0041] In one embodiment, the interactive space 58 may include a light emitter (e.g., LED, OLED) to adjust the brightness level within the performance effects system 56. For example, the light emitter may be adjusted to ensure that the transmissive elements are visible to the customer. For example, the controller 74 may determine the amount of light within the interactive space 58, which may indicate the visibility of objects positioned within the interactive space 58 to the customer. Alternatively or alternatively, the controller 74 may adjust the rendering of the reflective elements based on the appearance of the physical object 100 (such as adjusting the brightness level of the image output from the display system 66 to the beam splitter 68). Thus, the controller 74 can provide various operations to adjust the visibility of the transmissive and / or reflective elements by the customer.

[0042] FIG. 5 is a perspective view of the attraction system 50. In the embodiment illustrated in FIG. 5, the beam splitter 68 of the illustrated performance system 56 extends and blocks access from the customer-facing side 126 of the performance system 56 to the interaction space 58. For example, the housing 80 may include a partition 127 that divides and separates a first volume 82 and a second volume 84 of the housing 80 from each other. The beam splitter 68 may extend to abut or contact the partition 127. Thus, the beam splitter 68 and the partition 127 may collaboratively define the interaction space 58. Therefore, the performance system 56 may not include openings that enable the positioning of objects within the interaction space 58. Additionally, the illustrated performance system 56 may not include cover elements on the lateral sides of the performance system 56 (e.g., cover element 120B described in FIG. 4). For example, the performance system 56 may be integrated with a self-service food line (e.g., a buffet line), a display case with physical objects, a ticket line, etc. In another example, the performance effects system 56 can be integrated with a grocery store checkout counter, a display case for one or more products, a glass conference room, and / or an office. Therefore, the lateral sides of the performance effects system 56 can be open (e.g., without obstructions) to facilitate customer interaction (such as allowing customers to access objects positioned within the interaction space 58 from the lateral sides). The performance effects system 56 can provide additional information, such as information about physical objects (e.g., food, toys, books, tickets). For example, the performance effects system 56 can be integrated with a performance display case and display information about physical objects (e.g., toys, books) within the store. The physical objects can be within the interaction space 58, and the controller 74 can cause corresponding information to be displayed adjacent to the physical object (when viewed relative to a customer).The display system 66 can receive image data from the controller 74 and project virtual images onto the beam splitter 68 as reflective elements for customer viewing. Sensors within the interaction space 58 can receive indications of customer interaction (e.g., picking up merchandise, customer presence). In response to these indications, the controller 74 can generate image data with information about the merchandise. For example, the information may include the price of the physical object, the quantity of the physical object, the return policy of the physical object, the serial number of the physical object, etc. As a specific example, a conveyor belt can pass through the performance effects system 56, such that items on the conveyor belt (e.g., several plates of sushi) pass through the interaction space 58 and become visible through the beam splitter 68, thereby allowing the items to be detected via the sensor 64 and information about the items (e.g., the toppings for the sushi) to be displayed via the reflective elements.

[0043] FIG6 is a front perspective view of the display of the performance effects projection adjusted by the attraction system 50. In particular, FIG6 illustrates performance effects (e.g., a combined image of transmissive elements 70 and reflective elements 72) provided via the performance effects system 56. By way of example, a customer 54 can reach into their arm through opening 90 to position their hand 128 (e.g., for object 62 described in FIG. 1) within the interactive space 58 of the performance effects system 56 for an interactive experience. The hand 128 can be seen by the customer 54 as a transmissive element 70 via beam splitter 68. The performance effects system 56 can be operated to enhance or augment the appearance of the hand 128. For example, the performance effects provided by the performance effects system 56 include reflective elements 72 that appear to be set (e.g., physically set) in the interactive space 58 when viewed relative to the customer 54. Thus, reflective elements 72 can realistically appear as a physical object interacting with the customer 54's hand 128. As an example, reflective elements 72 can provide the appearance of an additional object (such as a flame, cup, or ball held in the customer 54's hand 128). As another example, reflective elements 72 can appear to transform the hand 128 into having different appearances, such as wearing gloves, having scales, or emitting light. However, the reflective element 72 may include any suitable image that provides an interaction with or a modified appearance of the customer 54's hand 128.

[0044] In one embodiment, the controller 74 may be configured to generate and transmit image data to the display system 66 to cause the display system 66 to project a virtual image to provide the reflective element 72 for performance effects. For example, sensors in the interaction space 58 may track the position of the hand 128, and the controller 74 may determine the position, size, and / or shape of the customer's hand relative to the beam splitter 68 based on sensor data received from such sensors to create realistic performance effects.The controller 74 may instruct the display system 66 to generate and project a virtual image in the viewing portion 60 so that the reflective element 72 appears in the interactive space 58 at or near the location of the customer's hand (when viewed by the customer 54). For example, the orientation of the virtual image projected by the display system 66 and reflected from the beam splitter 68 may cause the reflective element 72 to overlap with the customer's hand. Specifically, the customer's hand may be viewed by the customer as a transmission element 70 through the beam splitter 68 at a visible location within the interactive space 58. The display system 66 may project the virtual image based on the visible location. For example, the transmission element 70 and the reflective element 72 may overlap at the visible location to create a performance effect. Alternatively or additionally, the controller 74 may instruct the display system 66 to project a virtual image in the viewing portion 60 such that the size and / or shape of the reflective element 72 appears to conform to the shape of the customer's hand. In practice, the reflective element 72 may appear to be combined with or superimposed on the transmission element 70. In one embodiment, the reflective element 72 may be presented such that the partially transparent effect allows the customer 54 to see their hand 128 through the reflective element 72 overlapping with it. However, the appearance of the reflective element 72 may not be distorted by the hand 128 or another object in the interaction space 58. Thus, the reflective element 72 provided by the controller 74 may have a realistic or desired appearance when overlapping with the hand 128.

[0045] The controller 74 may also instruct the display system 66 to adjust the appearance of the reflective element 72. For example, the controller 74 may track the movement of the hand 128 within the interaction space 58 and instruct the display system 66 to adjust the projection of the virtual image so that the reflective element 72 follows the movement of the hand 128 (e.g., maintaining the overlap of the reflective element 72 on the transmissive element 70 associated with the hand 128). As an example, the customer 54 may move their hand 128 within the interaction space 58 (such as from a first position 130A to a second position 130B (e.g., from left to right)). The controller 74 can detect movement of the hand 128 based on sensor data and instruct the display system 66 to adjust the orientation of the virtual image so that the reflective element 72 changes orientation to follow the hand 128 from a first position 130A to a second position 130B. Therefore, the movement of the reflective element 72 can appear to be driven by the movement of the hand 128. In some instances, the customer 54 can move their hand 128 relative to the beam splitter 68, thereby changing the size of the transmissive element 70. The controller 74 can detect the movement and instruct the display system 66 to adjust the size of the virtual image so that the reflective element 72 changes size to maintain conformity to the appearance of the hand 128. In yet another example, the controller 74 can operate the display system 66 to offset the reflective element 72 from the appearance of the hand 128.

[0046] Figure 7 is a schematic diagram illustrating the performance effects provided by the performance effects system 56.By way of example, the performance effects system 56 can provide information about goods available for purchase within the performance effects system 56, such as for a self-service food line. For example, in addition to forming the interactive space and viewing section 60, the beam splitter 68 can be used as a glass panel in the form of a pop filter. One or more physical objects (e.g., hamburgers) can be placed in the interactive space. Customers accessing the self-service food line can retrieve the physical goods for purchase. In an additional or alternative embodiment, the performance effects system 56 can be implemented in another context, and the physical objects can include other suitable physical objects, such as books, tokens, maps, etc.

[0047] As illustrated, the physical objects can be seen through the beam splitter 68 as a transmission element 70. The controller 74 can identify physical objects based on image analysis techniques and / or one or more identifiers of the physical objects. In some instances, the controller 74 can use image analysis techniques to determine the size, shape, or type of the physical object and match the size, shape, or type with one or more stored templates in the memory 76 to identify the physical object. In another example, the goods can include one or more identifiers. In other instances, the physical product might be a hamburger on a plate, and the plate may include one or more identifiers, such as a barcode (e.g., a QR code) recognizable by the controller 74. The controller 74 may match one or more identifiers with one or more stored identifiers in memory 76 to identify and / or retrieve image content corresponding to the fried chicken strips. For example, the controller 74 may generate image data associated with the physical object and transmit the image data to a display system so that a reflective element 72 is displayed. The illustrated reflective element 72 includes information about the physical object (such as the type of the physical object, the cost of the physical object, the nutritional value of the physical object). The controller 74 may cause a virtual image to be displayed in the viewing portion 60 to generate a reflective element 72 that appears to be in the interactive space. For example, the reflective element specification 13 / 15 page 17 CN 120917364 A 72 may include information about the physical product (such as the cost of the product, the type of the product, the nature of the product, etc.). In the illustrated example, the reflective element 72 displays the type of product (e.g., hamburger), the cost of the product (e.g., cost: 3.00), and the nature of the product (e.g., calories: 550). Furthermore, a portion of the reflective element 72 and a portion of the transmissive element 70 are superimposed relative to each other to clearly associate the reflective element 72 with a physical object. In other examples, the reflective element 72 may be shown adjacent to (e.g., above, below, or to its side) the transmissive element 70 without overlapping.

[0048] Each of Figures 8 and 9 described below illustrates a method or process for operating a performance effects system.Any suitable device (e.g., processor 78 of controller 74 illustrated in Figures 1-3, coordinating with other system components) can execute the corresponding method. In one embodiment, each method can be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium (e.g., memory 76 of controller 74 illustrated in Figures 1-3). For example, each method can be executed at least in part by one or more software components, one or more software applications, etc. Although each method is described using operations in a specific order, additional operations may be performed, the described operations may be performed in a different order than illustrated, and / or some described operations may be skipped or not performed at all.

[0049] Figure 8 is a flowchart of one embodiment of a method or process 130 for operating a performance effects system to provide realistic performance effects. That is, the performance effects system can be operated to provide virtual images that can supplement the appearance of real-world objects (when viewed by a customer). In block 132, parameters of objects (e.g., real-world objects) within the interactive space of the performance effects system can be determined. For example, parameters may include the object's color, texture, reflectivity, brightness, size, shape, orientation, and / or orientation. The controller may determine the object's parameters based on one or more markers within the interaction space. In another example, the controller may receive image data captured for different areas within the interaction space, and the controller may determine the object's parameters based on the different image data. In yet another example, the controller may determine the relative distance between the object and a beam splitter or other boundaries of the interaction space.

[0050] At block 134, image data may be generated based on the object's parameters (e.g., orientation). For example, the size of the image data and / or the location for projecting the image data may be determined based on the object's parameters within the interaction space. As an example, to provide image data that matches the size of the object viewed by the customer, the size of the image data may be inversely proportional to the distance from the object to the beam splitter. In other words, the size of the image data may decrease as the distance between the object and the beam splitter increases. As another example, the controller may determine a target location for the image data based on the object's parameters. For example, the target location may allow the projected image data to provide a virtual image covering or overlapping the object viewed by the customer.

[0051] In block 136, image data may be transmitted to present a virtual image in the viewing portion of the performance effects system. For example, image data transmitted to the display system may be projected onto a target location on a beam splitter such that reflective and transmissive elements overlap and align with each other relative to the viewer's line of sight. In another example, image data transmitted to the display system may be offset in one direction such that a portion of the reflective element does not overlap with the transmissive element.

[0052] Alternatively or additionally, image data may be generated based on the type of object. For example, the controller may identify the type of object based on its shape and / or a pattern of markings located on one side of the object.The controller can identify a match between the shape and / or marked pattern of an object and a corresponding shape and / or marked pattern stored in memory, and the controller can determine the type of object associated with the matched shape and / or marked pattern. The controller can then identify image data associated with the type of object.

[0053] It should be noted that method 130 can be performed continuously or repeatedly. For example, the controller can continuously monitor parameters of objects in the interaction space and adjust image data (e.g., the size of image data, the position of image data) based on the parameters of the objects. Thus, image data can be adjusted and updated based on the parameters of the objects to provide a more suitable appearance.

[0054] FIG9 is a flowchart of an embodiment of a method or process 150 for operating a performance effects system to provide realistic performance effects. For example, method 150 can be performed to improve the visibility of reflective elements by a customer. At block 152, the customer's viewing angle relative to the performance effects system can be determined. For example, sensors can generate sensor data indicating the orientation of the customer relative to the beam splitter of the performance effects system. For example, based on sensor data, the controller can determine customer attributes such as the customer's height, the customer's arm length relative to the performance effect system, and / or the customer's orientation. In another example, the controller can determine the customer's perception based on the customer's eye level and / or facial features. The controller can also track the customer's eye movements to determine the customer's perspective. In one embodiment, the customer can input one or more attributes such as color blindness, color contrast adjustment, customer height, etc. The controller can adjust the brightness level of the virtual image, the light intensity of one or more light sources, and / or the extension length of the masking element. In this way, the visibility of the virtual image can be improved based on customer attributes.

[0055] At block 154, the beam splitter can be adjusted based on the customer's perspective. In one embodiment, the controller can instruct the actuator to adjust the orientation of the beam splitter to provide greater visibility of the reflective elements. For example, the controller can instruct the actuator to position the beam splitter at an angle (e.g., at 45 degrees) relative to the customer's perspective and / or relative to the display system to change the visibility of the reflective elements. In additional or alternative embodiments, the controller may adjust the orientation of the beam splitter (e.g., relative to the display system) to alter the visibility of the reflective elements.

[0056] While only certain features of the invention have been illustrated and described herein, many modifications and alterations will occur to those skilled in the art. Therefore, it is to be understood that the appended claims are intended to cover all such modifications and alterations that fall within the true spirit of the invention.

[0057] The techniques presented and claimed herein are referenced and applied to specific examples and substantial objects that can arguably improve the practical nature of the art, and are not abstract, abstract, or purely theoretical.Furthermore, if any claim appended to this specification contains one or more elements designated as “component for (performing)...(function)” or “step for (performing)...(function)”, such elements are intended to be interpreted in accordance with 35 USC 112(f). However, for any claim containing elements designated in any other manner, such elements are not intended to be interpreted in accordance with 35 U.SC 112(f). Instruction manual, page 15 / 15, 19 CN 120917364 A, Figure 1, Instruction manual, Figure 1 / 8, page 20 CN 120917364 A, Figure 2, Instruction manual, Figure 2 / 8, page 21 CN 120917364 A, Figure 3, Instruction manual, Figure 3 / 8, page 22 CN 120917364 A, Figure 4, Instruction manual, Figure 4 / 8, page 23 CN 120917364 A, Figure 5, Instruction manual, Figure 5 / 8, page 24 CN 120917364 A, Figure 6, Instruction manual, Figure 6 / 8, page 25 CN 120917364 A, Figure 7, Instruction manual, Figure 7 / 8, page 26 CN 120917364 A, Figure 8, Figure 9, Instruction manual, Figure 8 / 8, page 27 CN 120917364 A.

Claims

1. An attraction effect system for an amusement park, the attraction effect system comprising: a housing; an interaction space within the housing, wherein the interaction space is configured to receive an object; a display system configured to present imagery; an adjustable beam splitter positioned to enable the following visibility from a viewing portion: visibility through the adjustable beam splitter into the interaction space; and visibility of the imagery via reflection off of the adjustable beam splitter; a sensor configured to monitor the interaction space and provide sensor data related to the object within the interaction space; and one or more controllers communicatively coupled with the sensor and the display system, wherein the one or more controllers are configured to perform operations comprising: determining one or more parameters of the object based on the sensor data; generating image data based on at least one of the one or more parameters of the object; directing a transfer of the image data to the display system; and directing the display system to present the imagery based on the image data.

2. The attraction effect system of claim 1, comprising an additional sensor configured to monitor eye movement of a guest in the viewing portion, wherein the additional sensor is communicatively coupled to the one or more controllers and configured to transfer additional sensor data indicative of the eye movement of the guest.

3. The attraction effect system of claim 2, comprising an actuator coupled to the adjustable beam splitter and communicatively coupled to the one or more controllers, wherein the one or more controllers are configured to direct the actuator to adjust an orientation and / or position of the adjustable beam splitter relative to the display system based on the additional sensor data.

4. The attraction effect system of claim 1, wherein the one or more controllers are configured to: determine a size or position of the object based on the sensor data; and generate or adjust the imagery based on the size or the position of the object.

5. The attraction effect system of claim 1, wherein the housing comprises one or more openings that expose the interaction space to an external environment for access to the interaction space.

6. The attraction effect system of claim 1, wherein the interaction space comprises one or more reflective markers, and wherein the one or more controllers are configured to: determine a location of the object based on at least one distance measurement between the object and at least one of the one or more reflective markers.

7. The attraction effect system of claim 1, wherein the one or more controllers are configured to: determine a target position of one or more virtual images of the imagery to be presented by the display system onto the adjustable beam splitter based on the one or more parameters of the object; and direct the display system to present the one or more virtual images based on the target position. ​ 8. The show effect system of claim 7, wherein the one or more parameters include a relative distance between the object and the adjustable beam splitter.

9. The show effect system of claim 1, wherein the object includes one of a plurality of objects within the interaction space.

10. The show effect system of claim 1, comprising a set of actuatable coverings including one or more actuatable first coverings extending over the adjustable beam splitter and one or more actuatable second coverings on one or more lateral sides of the enclosure, wherein the set of actuatable coverings are configured to reduce or block ambient light directed onto the adjustable beam splitter.

11. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, are configured to cause the one or more processors to perform operations comprising: determining one or more characteristics of a viewer based on sensor data from one or more sensors monitoring a viewing position of a show effect system; determining one or more parameters of an object disposed within an interaction area of the show effect system based on additional sensor data received from one or more additional sensors monitoring the interaction area, wherein the object is visible from the viewing position through a beam splitter as a transmissive element; directing one or more actuators to adjust an orientation or position of the beam splitter based on the sensor data; generating image data based on the one or more parameters of the object; and directing a display system to project one or more virtual images onto the beam splitter based on the image data to cause the one or more virtual images to be visible from the viewing position via reflection from the beam splitter as a reflective element overlapping the transmissive element.

12. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations comprising: determining one or more types of the object based on one or more identifiers on the object detected from the additional sensor data; and generating the image data associated with the one or more types of the object.

13. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations comprising: determining movement of the object from a first position within the interaction area to an additional position within the interaction area; and updating the image data based on the additional position of the object within the interaction area.

14. The non-transitory computer-readable medium of claim 11, wherein directing the display system to project the one or more virtual images onto the beam splitter comprises: directing a first display of the display system to project a first virtual image of the one or more virtual images onto the beam splitter; and directing a second display of the display system to project a second virtual image of the one or more virtual images onto the beam splitter. ​ ​ ​ instruct a second display of the display system to project a second virtual image of the one or more virtual images onto the beamsplitter, wherein the first virtual image and the second virtual image overlap to form the reflective element.

15. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, configure the one or more processors to perform operations comprising: determining a line of sight of the viewer in the viewing position based on the sensor data; and instructing the one or more actuators of the beamsplitter to move and / or orient the beamsplitter based on the line of sight of the viewer in the viewing position.

16. An attraction system for an attraction, the attraction system comprising: a housing comprising a beamsplitter defining an interaction space and a viewing portion within the housing, wherein the interaction space is configured to receive an object, the viewing portion comprises a three-dimensional display system configured to project one or more virtual images onto the beamsplitter, and the beamsplitter is configured to enable visibility of the object within the interaction space through the beamsplitter and to enable visibility of the one or more virtual images projected onto the beamsplitter via reflection from the beamsplitter; one or more sensors configured to track movement of the object, wherein the object is disposed within the interaction space; and a controller configured to: receive sensor data from the one or more sensors, wherein the sensor data is indicative of the movement of the object disposed within the interaction space; generate image data based on the movement of the object disposed within the interaction space as indicated by the sensor data; and instruct the three-dimensional display system to project the one or more virtual images onto the beamsplitter based on the image data such that the one or more virtual images combine to form an illusion of a three-dimensional image and are visible via the reflection from the beamsplitter in a first position of visibility that is based on a second position of visibility of the object through the beamsplitter.

17. The attraction system of claim 16, comprising one or more actuators, wherein the controller is configured to instruct the one or more actuators to move and / or orient the beamsplitter within the housing.

18. The attraction system of claim 17, comprising one or more additional sensors configured to determine one or more parameters indicative of a position of a user relative to the beamsplitter, wherein the controller is configured to instruct the one or more actuators to move and / or orient the beamsplitter within the housing based on the position of the user relative to the beamsplitter.

19. The attraction system of claim 18, wherein the controller is configured to instruct the one or more actuators to rotate the beam splitter relative to the three-dimensional display system, to translate the beam splitter relative to the three-dimensional display system, or both, to adjust the beam splitter within the housing based on the orientation of the user relative to the beam splitter.

20. The attraction system of claim 16, wherein the controller is configured to instruct the three-dimensional display system to project at least one of the one or more virtual images onto the beam splitter to overlap the first location of visibility of the one or more virtual images via the reflection off of the beam splitter with the second location of visibility of the object through the beam splitter.

Images