System and method for interactive augmented reality kiosk

Abstract

A performance effect system 56 of an amusement park may include a housing 80; an interaction space 58 within the enclosure 80, wherein the interaction space 58 receives the object 62 from outside the enclosure 80; and a display system 66 that presents an image. The performance effect system 56 may also include a beam splitter 68 positioned to enable visibility from the viewing portion 60 through the beam splitter 68 into the interaction space 58, and visibility of the virtual image via reflection from the beam splitter 68. A sensor 64 of the performance effect system 56 may monitor the interaction space 58 and provide sensor data related to an object 62 within the interaction space 58. One or more controllers 74 of the performance effect system 56 may be communicatively coupled with the sensor 64 and the display system 66, and may perform operations including determining one or more parameters of the object 62 based on the sensor data, and generating image data based on the parameters of the object 62.

Description

[0001] Cross-reference to related applications This application claims priority and benefit from U.S. Provisional Application No. 63 / 455174, filed March 28, 2023, entitled “SYSTEMS AND METHODS FOR AN INTERACTIVE AUGMENTED REALITY KIOSK,” which is hereby incorporated in its entirety by reference for all purposes. Background Technology

[0002] This section aims to introduce the reader to various aspects of the technology that may be associated with this technology, which are described and / or claimed below. This discussion is intended to provide the reader with background information to facilitate a better understanding of the various aspects of this disclosure. Accordingly, it should be understood that these statements are to be read in this context rather than as an admission of prior art.

[0003] Throughout amusement parks and other entertainment venues, special effects can be used to help immerse customers in the experience of rides or attractions. Immersive environments can include three-dimensional (3D) props and set pieces, robotic or mechanical elements, and / or display surfaces that present media. For example, amusement parks can offer augmented reality (AR) experiences. AR experiences may involve presenting customers with virtual objects that can provide unique special effects. Special effects enable amusement parks to offer creative ways to engage customers, such as by convincingly simulating real-world elements. Summary of the Invention

[0004] The following provides an overview of some embodiments disclosed herein. It should be understood that these aspects are presented merely to provide the reader with a brief overview of these certain embodiments, and these aspects are not intended to limit the scope of this disclosure. In fact, this disclosure may cover many aspects that may not be set forth below.

[0005] In an embodiment, an amusement park show effect system can include a housing; an interaction space within the housing, where the interaction space receives an object from outside the housing; and a display system (any suitable display (e.g., liquid crystal display (LCD), light emitting diode (LED) display, organic light emitting diode (OLED) display, micro-LED, light field display, and / or projector with screen)) that presents imagery. The show effect system can also include a beam splitter positioned to enable visibility through the beam splitter from a viewing portion (e.g., viewing position) into the interaction space, and visibility of a virtual image via reflection off the beam splitter. A sensor of the show effect system can monitor the interaction space and provide sensor data related to the object within the interaction space. One or more controllers of the show effect system can be communicatively coupled with the sensor and the display system. The one or more controllers can perform operations including determining one or more parameters of the object based on the sensor data, generating image data based on the parameters of the object, instructing a transfer of the image data to the display system (e.g., projector), and instructing the display system to present imagery based on the image data.

[0006] In an embodiment, a non-transitory computer-readable medium includes instructions that, when executed by one or more processors, can cause the one or more processors to perform operations including determining one or more parameters of an object disposed within an interaction area of a show effect system based on sensor data received from one or more sensors that monitor the interaction area. The object can be visible as a transmissive element from a viewing position through a beam splitter. The operations can also include generating image data based on the one or more parameters of the object, and instructing a display system to project one or more virtual images onto the beam splitter based on the image data such that the one or more virtual images are visible from the viewing position as reflective elements overlapping the transmissive element via reflection off the beam splitter.

[0007] In an embodiment, an attraction system for an attraction can include a housing with a beamsplitter defining an interaction space and a viewing portion within the housing. The interaction space can receive an object. The viewing portion can include a display system that can project one or more virtual images onto the beamsplitter, and the beamsplitter can enable visibility of the object within the interaction space through the beamsplitter and visibility of the one or more virtual images projected onto the beamsplitter via reflection from the beamsplitter. The attraction system can also include one or more sensors that track movement of the object within the interaction space and a controller that can receive sensor data from the one or more sensors. The sensor data can indicate movement of the object within the interaction space. The controller can generate image data based on the movement of the object within the interaction space and instruct the display system to project virtual images onto the beamsplitter based on the image data to cause the one or more virtual images to be visible via reflection from the beamsplitter at a first location of visibility that is based on a second location of visibility of the object through the beamsplitter. BRIEF DESCRIPTION OF DRAWINGS

[0008] These and other features, aspects, and advantages of the present application will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein: Figure 1 is a schematic diagram of an embodiment of an attraction system within an amusement park or theme park in accordance with an aspect of the present disclosure; Figure 2 is a front perspective view of an embodiment of the attraction system of Figure 1 in accordance with an aspect of the present disclosure; Figure 3 is a side perspective view of an embodiment of the attraction system of Figure 1 in accordance with an aspect of the present disclosure; Figure 4 is a perspective view of an embodiment of the attraction system of Figure 1 in accordance with an aspect of the present disclosure; Figure 5 is a perspective view of an embodiment of the attraction system of Figure 1 in accordance with an aspect of the present disclosure; Figure 6 is a front perspective view of an embodiment of the attraction system of Figure 1 adjusting a display of a show effect in accordance with an aspect of the present disclosure; Figure 7 is a schematic diagram illustrating a show effect provided by a show effect system of Figure 1 in accordance with an aspect of the present disclosure; Figure 8 is a flowchart of a method for adjusting a display of a show effect via Figure 1a flowchart of an embodiment of a method or process for operating an attraction system of the present disclosure; and Figure 9 a flowchart of an embodiment of a method or process for operating an attraction system of the present disclosure; and Figure 1 a flowchart of an embodiment of a method or process for operating an attraction system of the present disclosure; and DETAILED DESCRIPTION

[0009] One or more specific embodiments of the present disclosure will be described below. To provide a concise description of these embodiments, all features of an actual implementation can not be described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which can vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time-consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.

[0010] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there can be additional elements other than the listed elements. Additionally, it should be understood that references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

[0011] The present disclosure relates to providing show effects for amusement parks or theme parks. Amusement parks can include a variety of features, such as rides (e.g., roller coasters), theatrical shows, scenery, performers, and / or decorative elements, to interest patrons. Show effects can be used to augment or supplement features, such as to provide patrons with a more immersive, interactive, and / or unique experience. For example, show effects can be presented in conjunction with real-world objects in order to provide patrons with an interactive experience.

[0012] The attraction system may include a performance effects system configured to present virtual or simulated objects that complement the appearance of real-world objects via Pepper's Ghostsystem. Pepper's Ghostsystem may employ a primary area (e.g., a background scene), secondary areas (e.g., an augmented reality scene), and optical beamsplitters (e.g., glass). The optical beamsplitters may be arranged to allow the transmission of images within the primary area through them. The optical beamsplitters may also reflect images from the secondary areas. Thus, the customer can observe images from the primary area (e.g., real images transmitted from the primary area via the optical beamsplitters) and images from the secondary area (e.g., virtual images reflected from the secondary area via the optical beamsplitters), which are combined, superimposed, or overlaid on each other via the optical beamsplitters.

[0013] Embodiments of this disclosure relate to a performance effects system that utilizes Papioca Phantom-based technology to provide a realistic depiction of combined elements of secondary and primary areas (such as those described above). For example, as Figures 2-6 As illustrated, the performance effects system may include apertures (e.g., slots, holes, such as opening 90) to receive real-world objects (e.g., physical objects, appendages, props) via customer interaction in a primary area (e.g., interactive space 58). Images of elements in secondary areas (e.g., images on displays (such as liquid crystal displays (LCDs), viewing portion 60) may be adjusted or manipulated to provide distortion of the images of real-world objects in the primary area, visual alterations to the images, interaction with the representation of the images, or any other suitable enhancement. For this purpose, the primary area may include sensors (e.g., IR cameras) to detect objects and track their position within the primary area (e.g., position relative to an optical beam splitter). Object detection may include any sensing parameters associated with the object. To more realistically depict elements in the secondary area (e.g., virtual objects) as appearing physically positioned in the primary area relative to the customer's perspective, images of the secondary area elements may be generated based on the object's position. Therefore, images of the secondary area elements may be overlaid, superimposed, or combined with images from the primary area. For example, the performance effects system disclosed herein can deliver realistic performance effects to customers via augmented reality without the need for or use of wearable technologies (such as headsets or goggles). Therefore, the customer experience can be enhanced while avoiding the operations (e.g., maintenance, cleaning, repair, control of each individual wearable device) and / or costs associated with wearable technologies (e.g., installation costs, maintenance costs). Furthermore, the performance effects system can be more easily implemented and operated, such as without requiring customers to equip themselves with wearable technologies to achieve the provided performance effects.

[0014] In certain instances, the show effect system can include one or more sensors (e.g., forward facing sensors) to detect the presence of a guest and the perspective (e.g., line of sight) of the guest. For example, the show effect system can track the eye movement of a guest to determine a focal point. In another example, the show effect system can track the position of the height of a guest relative to the primary area or the secondary area to determine the perspective of the guest. In response to determining the perspective of the guest, the show effect system can adjust the angle of the optical splitter to improve the visibility of the imagery for the elements of the secondary area. Additionally or alternatively, the show effect system can include one or more coverings to reduce or block ambient light to improve the visibility of the imagery provided for the secondary area.

[0015] With the foregoing in mind, Figure 1 is a schematic diagram of an embodiment of an attraction system 50 within an amusement park or theme park. The attraction system 50 is illustrated as including a guest area 52 having a guest 54 positioned therein and a show effect system 56 that is viewable and possibly accessible from the guest area 52. As an example, the guest area 52 can include a path (e.g., a walkway, a queue, a route) or an open space through which the guest(s) 54 can pass. As another example, the guest area 52 can include a space (e.g., a seating section) in which the guest(s) 54 can be positioned to view a performance. As a further example, the guest area 52 can include a ride vehicle that can move through the attraction system 50 and carry the guest(s) 54.

[0016] Further, the attraction system 50 can include a show effect system 56 (e.g., a Pepper’s Ghost based system, an aerial image based system) that can provide entertainment to the guest(s) 54 located within the guest area 52 and / or the attraction system 50. The show effect system 56 can include an arcade-like configuration that uses Pepper’s Ghost based technology to create a show effect (e.g., a visual effect) that is viewable by the guest(s) 54. To create the show effect, an optical splitter of the show effect system 56 can be capable of transmitting imagery within a primary area through the optical splitter and can also reflect imagery within a secondary area. Additionally or alternatively, the show effect system 56 can use aerial image based technology to create the show effect. For example, the optical splitter can be capable of transmitting imagery within a primary area through the optical splitter and a reflector can reflect the imagery to create the show effect. The reflected imagery can appear as an aerial image or an image suspended within the show effect system 56. The reflector can be adjacent to the optical splitter and made of a reflective material. Thus, the show effect can be presented to the guest 54.

[0017] The show effect system 56 can include one or more augmented reality kiosks located throughout the attraction system 50 as part of the exploration by the guest 54. The show effect system 56 can include a support (e.g., a table top, a table) to house a physical object (e.g., food, a beverage, a souvenir), and the show effect system 56 can utilize a splash guard to protect the object and also display information about the object to the guest(s) 54. In any of these examples, the show effect system 56 can include an interaction space 58 (primary area, background area) for guest interaction (e.g., guest input), a viewing portion 60 (secondary area, augmented reality scene) for the guest(s) 54 to view a show effect (e.g., a show effect projection), and a beam splitter 68 separating the interaction space 58 and the viewing portion 60 from each other.

[0018] The interaction space 58 can receive an object 62 (e.g., an apple), and one or more sensors 64 of the show effect system 56 can operate to detect a location of the object 62 within the interaction space 58. In the illustrated embodiment, the sensor(s) 64 are located in the interaction space 58. However, in other embodiments, the sensor(s) 64 can be located anywhere that allows the sensor(s) 64 to detect the object 62. The object 62 can be any suitable physical object (e.g., a token, a book, food, a hand) positioned within the show effect system 56. In one embodiment, the interaction space 58 can include an opening or aperture to enable movement of the object 62 into and / or out of the interaction space 58. For example, the guest 54 can insert the object 62 into the interaction space 58 via the opening. The show effect system 56 can present different show effects based on the inserted object 62 in order to provide an interactive experience for the guest 54. For example, the guest 54 can insert a token into the interaction space 58 (as part of the exploration), and the show effect system 56 can present a show effect (such as a treasure chest) that can be viewed by the guest(s) 54 to enhance the appearance of the token. In another example, the guest 54 can insert their hand into the interaction space 58 via the opening, such as to retrieve a physical object (e.g., food, a book, a card) positioned within the interaction space 58 for purchase. The show effect system 56 can present a show effect (such as information about the physical object) to enhance the experience (e.g., a shopping experience) of the guest 54 who is viewing the physical object.

[0019] The interaction space 58 can include one or more of the sensor(s) 64 to track the position of the object 62 within the interaction space 58. The sensor(s) 64 can be a camera (e.g., optical camera, three-dimensional (3D) camera, infrared (IR) camera, depth camera), orientation sensor (e.g., sonar sensor, radar sensor, laser imaging, detection, and ranging (LIDAR) sensor), etc. For example, the sensor(s) 64 can generate video data of the object 62 (e.g., in the IR spectrum, which can not be visible to the customer(s) 54). The sensor(s) 64 can represent multiple sensors positioned in different locations (e.g., multiple locations within and outside of the interaction space 58) to generate different sensor data (e.g., video data, image data) indicative of the position of the object 62. In an embodiment, the interaction space 58 can include one or more markers 65 (such as IR reflective markers, ultraviolet markers, etc.) that can facilitate the determination of the position of the object 62. For example, the markers 65 can be disposed at particular locations (such as in a grid pattern within the interaction space 58), and the orientation of the object 62 can be determined relative to the particular locations of the markers 65 to facilitate the determination of the position of the object 62. In another example, the markers 65 can have a known shape (e.g., circular, square, diamond) disposed in a known configuration (such as in a pattern, at a predetermined angle, etc.). As a specific example, the position of the object 62 can be determined based on feedback from the sensor(s) 64 indicative of certain markers 65 being unobservable because they are occluded or blocked by the object 62.

[0020] In an embodiment, the sensor(s) 64 can also detect the presence and / or perspective (e.g., line of sight) of the customer(s) 54. For example, the sensor(s) 64 can be cameras positioned to monitor the customer(s) 54 and can generate sensor data of the customer(s) 54 during operation of the show effect system 56. For example, the sensor(s) 64 can be between the customer(s) 54 and the viewing portion 60. The sensor data can include facial features, eye movement, height, arm length, and / or orientation of the customer(s) 54. For example, the sensor data can include the relative orientation between the customer(s) 54 and the show effect system 56. As further described herein, the sensor data can be analyzed to determine the line of sight of the customer(s) 54 and adjust the show effect system 56 to improve the visibility of the show effect. In additional or alternative embodiments, the sensor(s) 64 can detect movement of the customer(s) 54 and can generate sensor data indicative of customer attributes. For example, the sensor(s) 64 can generate sensor data of facial features or other attributes of the customer(s) 54. The show effect system 56 can then operate to provide a show effect based on such sensor data, including the identity of the customer(s) 54 (e.g., based on facial recognition) or other attributes of the customer (e.g., identity, height, body type, weight, clothing, hairstyle, accessories, tattoos). The show effect system 56 can also operate to provide a show effect based on user input. The user input can include customer attributes (e.g., height, body type, weight, age, color blindness) or any customer preferences.

[0021] Additionally, show effects system 56 can include a viewing portion 60 that can generate and project virtual images (e.g., imagery that is part of an augmented or virtual reality presentation) in order to provide augmented reality scenes for customer(s) 54. To this end, viewing portion 60 can include a display system 66 in order to create and project virtual images for customer(s) 54. Display system 66 can be any suitable display (e.g., liquid crystal display (LCD), light emitting diode (LED) display, organic light emitting diode (OLED) display, micro-LED) and / or a projector with a screen that receives image data and projects (e.g., displays) the image data as a virtual image. Display system 66 can also include a three-dimensional display such as a volumetric display, a light field display, a stereoscopic display, a lenticular display, etc. The virtual images can be adjusted or manipulated to enhance (e.g., warp, alter, overlay, interact with) the appearance of objects 62 within interaction space 58. For example, the virtual images can be a scaly lizard mask that transforms the appearance of a customer’s hand (e.g., as viewed from the customer’s perspective) into a lizard claw. In another example, the virtual images can be one or more maps that provide additional information for attraction system 50, and customer(s) 54 can interact with the maps to view the information. In yet another example, the virtual images can be one or more strings of text overlaid on objects 62 (e.g., as viewed from the customer’s perspective), where the text describes certain features of objects 62 (e.g., features as determined based on image recognition).

[0022] In one embodiment, the virtual image (e.g., an avatar) can be any suitable two- dimensional image outputted (e.g., projected) by the display system 66. For example, the virtual image can be a static image (such as a picture or image that does not change). In another example, the virtual image can be a dynamic image and / or video that changes over time. In additional or alternative embodiments, the virtual image can include a three-dimensional image that can be static or dynamic. For example, the display system 66 can include a light field display, which can include an array of surfaces (e.g., lenses) that manipulate how light rays converge, focus, and / or are directed. The array of surfaces can focus light rays at different locations (such as different depths relative to the customer(s) 54) to generate an avatar with a layered, contoured, and / or textured appearance, thereby forming a three-dimensional profile for the projected image. In another example, the display system 66 can include multiple displays 66 that each generate a portion (e.g., a slice) of a three-dimensional virtual image, and the combination of the portions forms the image. Each portion generated by a respective display 66 can be a two-dimensional image or a three-dimensional image. In yet another example, the display system 66 can include one display that can be moved to different locations and generate different virtual images to create a three-dimensional image (due to the visual persistence of the customer(s) 54 (e.g., viewer)). The display system 66 can be positioned to project the virtual image onto the beam splitter 68. The virtual image can include one or more virtual images projected by the display system 66 that appear at one or more locations as a reflection element 72 reflects from the beam splitter 68.

[0023] The beamsplitter 68 can combine (e.g., superimpose, overlay) the appearance of the object 62 from the interaction space 58 with the imagery from the viewing portion 60 (e.g., a virtual image projected by the display system 66) to provide a show effect to the customer(s) 54. For example, the beamsplitter 68 can be partially transmissive and partially reflective, and the customer(s) 54 can view elements that are transmitted through the beamsplitter 68, as well as elements that are reflected from the beamsplitter 68. Thus, from the customer area 52, the customer(s) 54 can view the object 62 positioned in the interaction space 58 as a transmitted element 70 (e.g., in the position of visibility) that is transmitted through the beamsplitter 68, and the customer(s) 54 can view the virtual image projected by the display system 66 in the viewing portion 60 as a reflected element 72 (e.g., in the position of visibility) that is reflected from the beamsplitter 68 and toward the customer(s) 54. To this end, the beamsplitter 68 can be made of a material that includes both transmissive and reflective properties, such as glass, plastic, foil, and / or a semi-transparent mirror, to enable viewing of the object 62 of the interaction space 58 as the transmitted element 70 through the beamsplitter 68, and to enable viewing of the virtual image of the viewing portion 60 that is reflected from the beamsplitter 68 as the reflected element 72. Thus, the customer(s) 54 can view a combined imagery that includes the transmitted element 70 and the reflected element 72. In certain instances, the beamsplitter 68 can have a flat or planar profile. In other instances, the beamsplitter 68 can have an arcuate or concave profile that can manipulate or alter the appearance of the object 62 and / or the image projected by the display system 66. Further, the beamsplitter 68 can be angled (e.g., at a 45-degree angle) relative to the line of sight of the customer(s) 54 and / or relative to the display system 66 to reflect the image projected by the display system 66 toward the customer(s) 54 in a desired manner. In certain instances, the beamsplitter 68 can be coupled to an actuator 73 that adjusts the beamsplitter 68 (e.g., by rotating, orienting, and / or linearly translating the beamsplitter 68) based on the viewing angle (e.g., line of sight) of the customer(s) 54. Additionally or alternatively, the actuator 73 can adjust the distance between the beamsplitter 68 and the display system 66 (e.g., by translating the beamsplitter 68). Thus, the actuator 73 can further adjust the appearance of the reflected element 72 (when viewed by the customer(s) 54).

[0024] In an embodiment, the show effects system 56 can include a cover that can be disposed around the viewing portion 60 to facilitate visibility of the reflective element 72 (such as to reduce or block ambient light or glare onto the beam splitter 68). For example, the show effects system 56 can include a cloth or fabric that shades one side of the viewing portion 60. In another example, the cover can extend beyond the boundaries of the display system 66 to reduce or block light from entering the viewing portion 60 to improve visibility of the virtual image (e.g., as reflected from the beam splitter 68). The show effects system 56 can operate to adjust the visibility (e.g., via providing different color shading (e.g., for color contrast adjustment), different shadows (for increasing light intensity)) based on incident light (e.g., sunlight, streetlight), based on detection of light (e.g., via one or more light sensors that measure glare or direct light), or based on timing (e.g., a timer can be provided to initiate adjustments based on known lighting scenarios). In an embodiment, the show effects system 56 can include one or more input devices (e.g., buttons, touchscreens, knobs) for customer input, and the show effects system 56 can adjust the visibility of the virtual image based on the customer input. For example, the customer(s) 54 can turn a knob to cause an increase in the visibility of the reflective element 72. To this end, the show effects system 56 can include one or more light sources (e.g., OLEDs, LEDs) that output an amount of light to adjust the brightness level of the virtual image as reflected from the beam splitter 68. For example, the one or more light sources can be LEDs that can be modulated to increase the amount of light output to increase the brightness level of the interactive space 58, and thus the brightness level of the virtual image as reflected from the beam splitter 68. In another example, the one or more light sources can decrease the amount of light output to increase the contrast between the virtual image as reflected from the beam splitter 68 and improve the visibility of the image. Additionally or alternatively, the one or more light sources can adjust the color of the interactive space 58. For example, the one or more light sources can include a plurality of LEDs of different colors that can be modulated to output a color (such as red, green, blue, etc.). In this way, the color contrast level of the virtual image as reflected from the beam splitter 68 can be adjusted.

[0025] In an embodiment, the customer(s) 54 can use one or more input devices to input one or more customer attributes, and the show effects system 56 can adjust the virtual image based on the customer attributes. For example, the customer(s) 54 can input a height, a colorblind status, a color preference, etc. As further described herein, the show effects system 56 can adjust an orientation of the beam splitter 68 based on the height and / or line of sight of the customer(s) 54 to improve visibility of the virtual image as reflected from the beam splitter 68. The show effects system 56 can adjust a color of the virtual image based on a colorblind attribute of the customer(s) 54. To this end, the show effects system 56 can generate the virtual image based on colors visible to the customer(s) and / or by removing colors from the virtual image that are not visible to the customer(s) 54 or color combinations that are not distinguishable by the customer(s) 54. In this way, visibility of the virtual image can be improved. In another example, the customer(s) 54 can select a color preference (e.g., via one or more input devices), and the show effects system 56 can generate the virtual image based on the color preference. Returning to the example of the lizard hand, the customer(s) 54 can indicate green as the color preference, and the show effects system 56 can generate a green scaly lizard mask. Additionally or alternatively, the display system 66 can include one or more displays 66 that can individually or collectively generate the virtual image. For example, a first display 66 can generate a first portion of the green scaly lizard mask, and a second display 66 can generate a second portion of the green scaly lizard mask. In another example, the first display 66 can generate the green scaly lizard mask, and the second display 66 can adjust a color of the lizard mask by generating a red scaly lizard mask to overlay and form a yellow scaly lizard mask. In yet another example, the first display 66 and the second display 66 can generate the lizard mask, and a third display 66 can generate a colored background that can adjust a brightness level of the lizard mask and / or a color contrast between the lizard mask and the background and improve visibility of the virtual image as reflected from the beam splitter 68.

[0026] Show effects system 56 can include or be coordinated with a controller 74 (e.g., control system, automated controller, programmable controller, electronic controller, control circuitry, cloud computing system) configured to operate show effects system 56 to provide an interactive experience to customer(s) 54. For example, controller 74 can be communicatively coupled (e.g., via one or more wires, via wireless communication (e.g., via a transmitter, receiver, transceiver)) with sensor(s) 64, display system 66, and / or actuator 73. Controller 74 can include a memory 76 and a processor 78 (e.g., processing circuitry). Memory 76 can include volatile memory (such as random access memory (RAM)) and / or non-volatile memory (such as read-only memory (ROM), optical drives, hard disc drives, solid-state drives, or any other non-transitory computer-readable medium including instructions for operating show effects system 56). Processor 78 can be configured to execute such instructions. For example, processor 78 can include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof. In certain examples, controller 74 can include one or more controllers that are communicatively coupled and can individually or collectively perform the actions described herein. Additionally or alternatively, controller 74 can include one or more processors 78 and / or one or more memories 76 that can individually or collectively perform the actions described herein.

[0027] In an embodiment, the controller 74 can receive sensor data from the sensor(s) 64 and operate to identify the object 62, identify a position of the object 62, and transmit image data (e.g., image data generated based on the sensor data provided by the sensor(s) 64) to the display system 66 to generate a virtual image. For example, the controller 74 can utilize image analysis techniques to determine a size, shape, color, texture, reflectivity, brightness, orientation, and / or type of the object 62. The controller 74 can then identify a corresponding characteristic (e.g., size, shape, type) of the image data to transmit to the display system 66. For example, the controller 74 can identify the object 62 as a ticket and generate image data with information about the ticket (such as a type of ticket, a duration of stay, a price of the ticket, etc.). In another example, the controller 74 can identify the object 62 as a souvenir (e.g., a book) and generate image data associated with the souvenir (such as a special effect or a price). To generate a realistic special effect, the controller 74 can determine a position of the object 62 and determine a corresponding projection orientation of the virtual image to coordinate with the object 62 to provide a desired appearance of the reflective element 72. For example, the controller 74 can determine the position of the object 62 based on a grid pattern of markers 65 positioned within the interaction space 58. The controller 74 can determine a relative distance between the object 62 and the beam splitter 68 based on a plurality of images of the object 62 captured by the sensor(s) 64 and indicated relative to various markers 65 positioned at known positions (e.g., known coordinates in a three-dimensional coordinate system of the interaction space 58). In some embodiments, the sensor(s) 64 can include one or more LiDAR sensors that can be utilized to determine positioning information. Additionally or alternatively, the controller 74 can use image analysis techniques to utilize a shadow of the object 62 to determine a size of the object 62 and / or a position of the object 62 relative to the beam splitter 68. The controller 74 can also continue to track the position of the object 62 and adjust (e.g., update) the image data transmitted to the display system 66. For example, the controller 74 can adjust a size and / or a position of the virtual image projected by the display system 66 based on the position of the object 62.

[0028] As an example, the controller 74 can transmit image data to the display system 66 that depicts movement and / or sizing of the reflective element 72 in response to determined movement of the object 62 (e.g., relative to the beam splitter 68). For example, the controller 74 can instruct the display system 66 to operate to provide the reflective element 72 that can be superimposed onto the appearance of the object 62 to alter (e.g., warp, manipulate, adjust, enhance) the appearance of the object 62 as viewed by the customer 54. For example, the controller 74 can instruct the display system 66 to project a larger virtual image (relative to a previously projected image) in response to determining that the object 62 is within a threshold distance of the beam splitter 68 (e.g., moved closer to the viewer), and the controller 74 can instruct the display system 66 to project a smaller virtual image (relative to a previously projected image) in response to determining that the object 62 is beyond the threshold distance from the beam splitter 68 (e.g., moved away from the viewer). Thus, the virtual image can provide the reflective element 72 that can appear to conform to the transmitted element 70 as viewed by the customer(s) 54. Thus, the show effect system 56 can provide a realistic or other desired depiction of the combined imagery (e.g., the transmitted element 70 and the reflective element 72), and provide an interactive experience for the customer(s) 54. In an embodiment, the controller 74 can determine the appearance of the reflective element 72 based on sensor data received from the sensor(s) 64. The controller 74 can determine whether the appearance of the reflective element 72 is desired (e.g., matches a target appearance), and can operate the display system 66 (such as instructing the display system 66 to adjust a virtual image being projected) in response to the appearance of the reflective element 72 being undesired.

[0029] In one embodiment, the controller 74 can be configured to instruct the actuator 73 to adjust the orientation of the beam splitter 68 based on the position of the customer(s) 54 (e.g., the viewer(s)). For example, the controller 74 can receive sensor data and operate to determine the viewing angle of the customer(s) 54. The controller 74 can identify the orientation of the customer(s) 54 (e.g., the orientation of the head of the customer(s) 54), the height of the customer(s) 54, the eye level / orientation of the customer(s) 54, eye movement, etc., to determine the viewing angle of the customer(s) 54. For example, the controller 74 can determine the area of the beam splitter 68 that is being viewed by the customer(s) 54. The controller 74 can transmit a signal to the actuator 73 coupled to the beam splitter 68 to adjust the angle of the beam splitter 68 (e.g., by rotating the beam splitter 68 relative to the display system 66) based on the viewing angle of the customer(s) 54 to improve the visualization of the transmissive element 70 and / or the reflective element 72. Additionally or alternatively, the controller 74 can instruct the actuator 73 to adjust the distance between the beam splitter 68 and the display system 66 (e.g., by translating the beam splitter 68 relative to the display system 66) based on the viewing angle of the customer(s) 54. Accordingly, the controller 74 can facilitate the viewing of the reflective element 72 by the customer(s) 54.

[0030] Figure 2 is a front perspective view of an embodiment of an attraction system 50. In particular, Figure 2 FIG. illustrates a show effect system 56 having a viewing portion 60 that includes one sensor 64A positioned adjacent to or within the viewing portion 60 (e.g., above the interactive space 58) and two sensors 64B positioned adjacent to or within the interactive space 58. In embodiments, the show effect system 56 can include any suitable number of sensor(s) 64A adjacent to or within the viewing portion 60 and any suitable number of sensors 64B adjacent to or within the interactive space 58. The sensor 64A can be positioned between the viewing portion 60 and a customer facing the viewing portion 60, and the sensor 64A can generate sensor data indicative of a customer characteristic (e.g., a viewing angle). The sensors 64B can be positioned at various locations relative to the interactive space 58 and can generate sensor data indicative of objects positioned within the interactive space 58 (e.g., for Figure 1The described object 62) of sensor data. The show effects system 56 can also include a controller 74 positioned adjacent to (e.g., below) the interactive space 58 and the viewing portion 60. The controller 74 can be communicatively coupled with the display system 66 of the viewing portion 60, the sensors 64A of the viewing portion 60, the sensors 64B of the interactive space 58A, and an actuator 73 coupled to the beam splitter 68. In the illustrated embodiment, the sensors 64A, 64B are disposed within or coupled with a housing 80 of the show effects system 56. However, in other embodiments, the sensors 64A, 64B can be positioned outside of the housing 80 in a manner that allows for monitoring of the viewing portion 60 and the interactive space 58, respectively.

[0031] As indicated above, the show effects system 56 can include a housing 80 (e.g., representing multiple housings coupled with one another, or representing a single housing). The housing 80 can define a first volume 82 having the interactive space 58 and the viewing portion 60. For example, the beam splitter 68 can be positioned within the first volume 82 to further divide the first volume 82 into the interactive space 58 and the viewing portion 60. The housing 80 can also define a second volume 84 in which the controller 74 can be positioned. However, in other embodiments, the controller 74 can be external to the housing 80 and can even be in wireless communication with other aspects of the show effects system 56. The housing 80 can include various features (such as walls, panels, and grates) that can shield the components of the show effects system 56 (e.g., the sensors 64A and 64B, the beam splitter 68, the controller 74) from various external elements, such as dust and debris. Thus, the housing 80 can protect such components to enable desired operations and / or to extend the effective life of the show effects system 56. In additional or alternative embodiments, the housing 80 can include features (such as doors) that can enable access to components disposed within the housing 80, such as the controller 74. Thus, the housing 80 can enable various operations (such as inspection operations, maintenance operations, repair operations, replacement operations) to be performed with respect to the components while also providing shielding capabilities for the show effects system 56.

[0032] The display system 66 can face the beamsplitter 68 such that a virtual image projected from the display system 66 can be reflected from the beamsplitter 68 and into the perspective (e.g., line of sight) of the customer. The display system 66 can receive image data from the controller 74 and digitally render a virtual image based on the image data. The display system 66 can project the virtual image onto a certain area (e.g., portion) of the beamsplitter 68 based on the image data. When viewed by the customer, the reflected element (e.g., the reflected virtual image) can appear to be located in the interaction space 58. For example, the beamsplitter 68 can be angled 88 (e.g., at a 45 degree angle) with respect to the display system 66 to provide a desired (e.g., realistic) appearance of the reflected element within the interaction space 58. However, in an embodiment, the controller 74 can instruct the actuator 73 to adjust the beamsplitter 68 to any suitable angle, any suitable distance, and / or any other suitable position / orientation with respect to the display system 66. For example, the controller 74 can transmit a signal to the actuator 73 to adjust the beamsplitter 68 based on sensor data. The sensor 64A of the viewing portion 60 can generate sensor data of the customer, which can include facial features, eye level, height, arm length, etc., for transmission to the controller 74. The controller 74 can instruct the actuator 73 to adjust the beamsplitter 68 based on the sensor data received from the sensor 64A. For example, the controller 74 can instruct the actuator 73 to adjust the beamsplitter 68 to improve visibility of the reflected element, enabling the show effect (e.g., the combined imagery of the transmitted element and the reflected element) to be properly viewed by the customer.

[0033] In an embodiment, the display system 66 can be a volumetric display that projects a three-dimensional virtual image such that the reflected element can appear with accurate depth and size from any perspective. The volumetric display can include a screen (e.g., a thin film layer) that can be rapidly and repeatedly transported through a volume while imagery can be projected onto the screen at various positions of the screen in a manner that creates the illusion of a three-dimensional object due to the visual persistence effect of the customer (e.g., viewer). Accordingly, the controller 74 can not instruct the actuator 73 to adjust the angle of the beamsplitter 68. In an embodiment, the display system 66 can be behind the beamsplitter 68 such that a virtual image projected from the display system 66 can be transmitted through the beamsplitter 68 and into the perspective of the customer. Additionally, the display system 66 can include a first display 66 facing the beamsplitter 68 and projecting a virtual image for reflection from the beamsplitter 68, and a second display 66 that can be behind the beamsplitter 68 and projecting a virtual image for transmission through the beamsplitter 68.

[0034] The controller 74 can also instruct the display system 66 to project a virtual image based on an object positioned within the interaction space 58. The housing 80 can define an opening 90 that exposes the interaction space 58 to an external environment for accessing the interaction space 58. For example, the opening 90 can enable positioning of an object (such as the object 62 described with respect to Figure 1 the show effect system 56) into and / or removing the object from the interaction space 58. For example, a patron can insert a hand into the opening 90 during interaction with the show effect system 56. The sensor 64B within the interaction space 58 can generate sensor data indicative of the position of the patron's hand. In certain instances, the controller 74 can determine the size of the patron's hand and the relative position of the patron's hand based on the sensor data. The controller 74 can generate image data to be communicated to the display system 66 based on the size of the patron's hand and the relative position of the patron's hand. The controller 74 can also determine the position of the image data to be projected by the display system 66 based on the relative position of the patron's hand. In this way, the controller 74 can instruct the display system 66 to project a virtual image to adjust the appearance of the reflective element in order to provide a more interactive experience for the patron. For example, the reflective element 72 can appear as a virtual tattoo on the patron's hand and can be adjusted to correspond to movement of the patron's hand within the interaction space 58.

[0035] Figure 3 is a side perspective view of an embodiment of the attraction system 50. In particular, Figure 3 FIG. 1 illustrates the show effect system 56, the interaction space 58 includes a physical object 100 (e.g., the object 62 described with respect to Figure 1 FIG. 1) extended into the interaction space 58 by the patron 54 via the opening 90. The illustrated show effect system 56 also includes a plurality of markers 65 disposed in a grid pattern within the interaction space 58. For example, the physical object 100 is represented as a ticket made of a non-transparent material (e.g., paper, plastic, metal). However, the physical object 100 can be any suitable object (such as an appendage of the patron 54 (e.g., a hand), a commodity (e.g., food, a book), a token, a map, a coin, etc.). The physical object 100 positioned within the interaction space 58 can be visible to the patron 54 as a transmissive element through the beam splitter 68.

[0036] The sensors 64B of the interaction space 58 can generate sensor data (e.g., captured image data, position data) associated with the physical object 100. The controller 74 can identify a type of the physical object 100 based on the sensor data. For example, the controller 74 can utilize image analysis (e.g., processing) techniques to identify the type of the physical object 100 as a ticket. In an example, the controller 74 can compare a shape of the physical object 100 to one or more shapes stored in the memory 76. In other examples, the ticket can include a textual description and / or an image that can be identified using image analysis techniques and matched to a description or image stored in the memory 76. In certain examples, the controller 74 can identify one or more identifiers 102 (e.g., QR code, bar code) on the physical object 100 and compare the one or more identifiers 102 to a list of identifiers stored in the memory 76. As illustrated, the physical object 100 includes a bar code that can be used by the controller 74 to identify the type of the physical object 100.

[0037] The controller 74 can also determine a position of the physical object 100 within the interaction space 58 based on the sensor data. For example, one or more of the markers 65 can be placed at known locations within the interaction space 58, and the controller 74 can identify a relative position of the physical object 100 with respect to the one or more markers 65 to determine a position of the physical object 100 within the interaction space 58. For example, the controller 74 can determine a relative distance between the physical object 100 and the beam splitter 68 to determine a size of the image data. In another example, the controller 74 can determine a position of the physical object 100 to determine an orientation of the image data. The controller 74 can determine image data to be communicated to the display system 66 based on the type and / or position of the physical object 100 within the interaction space 58. For example, the controller 74 can identify image data associated with different types of objects that can be positioned within the interaction space 58.

[0038] The controller 74 can instruct the display system 66 to operate to alter an appearance of the physical object 100 by overlaying additional visual information. For example, the controller 74 can instruct the display system 66 to adjust an appearance of the ticket by projecting information related to the ticket, by changing a color of the ticket by projecting a color on the ticket, and / or by projecting an animation that appears to be displayed on the ticket. Such special effects can be realistically provided by the controller 74 based on a size and / or position of the physical object 100 within the interaction space 58 (e.g., by enabling the display 66 to project a virtual image that provides reflective elements that correspond to an appearance of the physical object 100 that is visible to the customer 54).

[0039] Figure 4 is a perspective view of an embodiment of the attraction system 50. In Figure 4In the illustrated embodiment, show effect system 56 can be an arcade-like configuration with a cover 120A to reduce or block ambient light directed to a portion of show effect system 56. For example, cover 120A can at least partially enclose viewing portion 60. Cover 120A can extend (e.g., overlap) above beam splitter 68 in a longitudinal direction 122. Cover 120A can block light (e.g., light directed toward beam splitter 68 in a vertical direction 124). In an example, controller 74 can instruct actuator 123 to extend, retract, or otherwise move cover 120A. For example, in response to determining that the intensity of light is below a threshold level (e.g., on a cloudy day with the sun partially obscured), controller 74 can instruct actuator 123 to retract cover 120, thereby increasing the amount of light directed to beam splitter 68 to increase the visibility of objects within interaction space 58. In response to determining that the intensity of light is above a threshold level (e.g., on a sunny day with the sun unobscured), controller 74 can instruct actuator 123 to extend cover 120, thereby reducing the amount of light directed to beam splitter 68 to increase the visibility of reflective elements in viewing portion 60. For example, an increase in the intensity of light can decrease the relative brightness level of the virtual image (e.g., relative to the perspective of the customer). Extending cover 120 can block the amount of light directed at beam splitter 68, which can increase the relative brightness level of the virtual image, thereby improving the visibility of the virtual image relative to the perspective of the customer. To this end, sensors of show effect system 56 (e.g., sensor 64 described Figure 1 described) can generate sensor data indicative of light conditions (e.g., brightness level, intensity of light), and controller 74 can instruct actuator 123 to adjust cover 120 based on the light conditions to provide the customer with a better viewing experience of the special effects provided by show effect system 56.

[0040] Additionally or alternatively, show effect system 56 can include a cover 120B on lateral sides of show effect system 56. Cover 120B can extend across the lateral sides of show effect system 56 (e.g., along longitudinal direction 122, along vertical direction 124). Accordingly, cover 120B can reduce or block ambient light directed toward beam splitter 68 in a lateral direction 125. Controller 74 can also instruct actuator 123 to adjust cover 120B based on detected light conditions. In this way, covers 120A, 120B can cooperatively improve the visibility of show effect system 56 by a customer. Additionally or alternatively, covers 120A, 120B can direct the customer to look directly at beam splitter 68 to improve the visibility of the reflective elements. In this way, the customer can not view beam splitter 68 at an angle and can not view a distorted show effect.

[0041] In an embodiment, the interaction space 58 can include light emitters (e.g., LEDs, OLEDs) to adjust a level of brightness within the show effect system 56. For example, the light emitters can be adjusted to ensure that the transmissive elements are visible to the guest. For example, the controller 74 can determine an amount of light within the interaction space 58, which can be indicative of the visibility of the object positioned within the interaction space 58 to the guest. Additionally or alternatively, the controller 74 can cause the rendering of the reflective elements to be adjusted based on the appearance of the physical object 100, such as adjusting a level of brightness of the image output by the display system 66 onto the beam splitter 68. Accordingly, the controller 74 can provide various operations to adjust the visibility of the transmissive elements and / or the reflective elements by the guest.

[0042] Figure 5 is a perspective view of the attraction system 50. In Figure 5 In the illustrated embodiment of the attraction system 50, the beam splitter 68 of the illustrated show effect system 56 extends and blocks access from the guest-facing side 126 of the show effect system 56 to the interaction space 58. For example, the housing 80 can include a partition 127 that divides and separates the first volume 82 and the second volume 84 of the housing 80 from one another. The beam splitter 68 can extend to abut or contact the partition 127. Accordingly, the beam splitter 68 and the partition 127 can cooperatively define the interaction space 58. Thus, the show effect system 56 can not include an opening that enables the positioning of the object within the interaction space 58. Additionally, the illustrated show effect system 56 can not include a cover on the lateral sides of the show effect system 56 (e.g., for the Figure 4The described cover 120B). For example, the show effect system 56 can be integrated with a self-serve food line (e.g., a buffet line), a display case with physical objects, a ticket line, etc. In another example, the show effect system 56 can be integrated with a checkout counter of a grocery store, a display case for one or more products, a glass conference room, and / or an office, etc. Accordingly, the lateral sides of the show effect system 56 can be open (e.g., without a cover) to facilitate customer interaction (such as enabling a customer to access an object positioned within the interaction space 58 from a lateral side). The show effect system 56 can provide additional information, such as information about a physical object (e.g., food, toys, books, tickets). For example, the show effect system 56 can be integrated with a show case and display information about physical objects (e.g., toys, books) within the store. The physical objects can be within the interaction space 58 and the controller 74 can cause corresponding information to be displayed adjacent to the physical objects (when viewed relative to the customer). The display system 66 can receive image data from the controller 74 and project a virtual image onto the beam splitter 68 as a reflective element viewed by the customer. A sensor within the interaction space 58 can receive an indication of a customer interaction (e.g., taking an item, customer presence). In response to the indication, the controller 74 can generate image data with information about the item. For example, the information can include a price of the physical object, a quantity of the physical object, a return policy of the physical object, a serial number of the physical object, etc. As a specific example, a conveyor belt can pass through the show effect system 56 such that an item on the conveyor belt (e.g., a few plates of sushi) passes through the interaction space 58 and becomes visible through the beam splitter 68, thereby allowing the item to be detected via the sensor 64 and information about the item (e.g., ingredients of the sushi) to be displayed via the reflective element.

[0043] Figure 6 is a front perspective view of the attraction system 50 adjusting a display of a show effect projection. In particular, Figure 6 illustrates a show effect provided via the show effect system 56 (e.g., a combined image of the transmissive element 70 and the reflective element 72). By way of example, the customer 54 can reach in through the opening 90 with their arm to place their hand 128 (e.g., for a high-five) with the show effect system 56 displaying a virtual image of a hand 130 of a virtual character 132 (e.g., a cartoon character) that appears to be high-fiving the customer 54. Figure 1The described object 62) is positioned within the interactive space 58 of the show effect system 56 for an interactive experience. The hand 128 can be seen by the customer 54 through the beam splitter 68 as a transmissive element 70. The show effect system 56 can be operable to augment or enhance the appearance of the hand 128. For example, the show effect provided by the show effect system 56 includes a reflective element 72 that appears to be disposed (e.g., physically disposed) in the interactive space 58 when viewed relative to the customer 54. Thus, the reflective element 72 can realistically appear as a physical object that interacts with the customer's 54 hand 128. As an example, the reflective element 72 can provide the appearance of an additional object such as a flame, a cup, or a ball held in the customer's 54 hand 128. As another example, the reflective element 72 can appear to transform the hand 128 to have a different appearance such as wearing a glove, having scales, or emitting light. However, the reflective element 72 can include any suitable imagery that provides an appearance of interaction with or modification to the customer's 54 hand 128.

[0044] In an embodiment, the controller 74 can be configured to implement the show effect by generating and transmitting image data to the display system 66 to cause the display system 66 to project a virtual image to provide the reflective element 72. For example, sensors of the interactive space 58 can track the position of the hand 128, and the controller 74 can determine the position, size, and / or shape of the customer's hand relative to the beam splitter 68 based on sensor data received from such sensors to create a realistic show effect. The controller 74 can instruct the display system 66 to generate and project a virtual image in the viewing portion 60 so as to appear in the interactive space 58 for the reflective element 72 at or near the position of the customer's hand (when viewed by the customer 54). For example, the orientation of the virtual image projected by the display system 66 and reflected from the beam splitter 68 can cause the reflective element 72 to overlap with the customer's hand. In particular, the customer's hand can be viewed by the customer through the beam splitter 68 as a transmissive element 70 at a position within the interactive space 58 and at a position of visibility. The display system 66 can project the virtual image based on the position of visibility. For example, the transmissive element 70 and the reflective element 72 can overlap at the position of visibility to form the show effect. Additionally or alternatively, the controller 74 can also instruct the display system 66 to project the virtual image in the viewing portion 60 so that the size and / or shape of the reflective element 72 appears to conform to the contours of the customer's hand. In effect, the reflective element 72 can appear to combine or superimpose with the transmissive element 70. In an embodiment, the reflective element 72 can be presented so that the partially transparent effect enables the customer 54 to see their hand 128 through the reflective element 72 that overlaps with their hand 128. However, the appearance of the reflective element 72 can not be distorted by the hand 128 or another object in the interactive space 58. Thus, the reflective element 72 provided by the controller 74 can have a realistic or desired appearance when overlaid with the hand 128.

[0045] The controller 74 can also instruct the display system 66 to adjust the appearance of the reflective element 72. For example, the controller 74 can track movement of the hand 128 within the interaction space 58 and instruct the display system 66 to adjust the projection of the virtual image to cause the reflective element 72 to follow the movement of the hand 128 (e.g., to maintain the overlap of the reflective element 72 on the transmissive element 70 associated with the hand 128). As an example, the customer 54 can move their hand 128 within the interaction space 58, such as from a first position 130A to a second position 130B (e.g., from left to right). The controller 74 can detect the movement of the hand 128 based on the sensor data and instruct the display system 66 to adjust the orientation of the virtual image to cause the reflective element 72 to change orientation to follow the hand 128 from the first position 130A to the second position 130B. Thus, the movement of the reflective element 72 can appear to be driven by the movement of the hand 128. In certain instances, the customer 54 can move their hand 128 relative to the beam splitter 68, thereby changing the size of the transmissive element 70. The controller 74 can detect the movement and instruct the display system 66 to adjust the size of the virtual image to cause the reflective element 72 to change size to maintain the appearance of the hand 128. In yet another example, the controller 74 can operate the display system 66 to offset the reflective element 72 from the appearance of the hand 128.

[0046] Figure 7 is a schematic diagram illustrating a show effect provided by the show effect system 56. By way of example, the show effect system 56 can provide information about items for purchase within the show effect system 56, such as for a self-serve food line. For example, in addition to forming the interaction space and viewing portion 60, the beam splitter 68 can be used as a glass panel in the form of a splash guard. One or more physical objects (e.g., hamburgers) can be placed in the interaction space. A customer accessing the self-serve food line can retrieve the physical items for purchase. In additional or alternative embodiments, the show effect system 56 can be implemented in another context, and the physical objects can include another suitable physical object, such as a book, a token, a map, etc.

[0047] As illustrated, the physical object can be visible through the transmissive element 70 as a reflective element 72 by the beam splitter 68. The controller 74 can identify the physical object based on image analysis techniques and / or one or more identifiers of the physical object. In certain instances, the controller 74 can use image analysis techniques to determine a size, shape, or type of the physical object and match the size, shape, or type to one or more stored templates in the memory 76 in order to identify the physical object. In another example, the item can include one or more identifiers. In other instances, the physical item can be a hamburger placed on a plate, and the plate can include one or more identifiers, such as a barcode (e.g., QR code) that can be identified by the controller 74. The controller 74 can match the one or more identifiers to one or more stored identifiers in the memory 76 in order to identify and / or retrieve image content corresponding to the fried chicken strips. For example, the controller 74 can generate image data associated with the physical object and transmit the image data to the display system to cause the reflective element 72 to be displayed. The illustrated reflective element 72 includes information about the physical object, such as a type of the physical object, a cost of the physical object, a nutritional value of the physical object. The controller 74 can cause a virtual image to be displayed in the viewing portion 60 in order to generate the reflective element 72 that appears to be in the interaction space. For example, the reflective element 72 can include information about the physical item, such as a cost of the item, a type of the item, a property of the item, etc. In the illustrated example, the reflective element 72 displays a type of the item (e.g., hamburger), a cost of the item (e.g., cost: 3.00), and a property of the item (e.g., calories: 550). Further, a portion of the reflective element 72 and a portion of the transmissive element 70 are superimposed relative to each other to clearly associate the reflective element 72 with the physical object. In other examples, the reflective element 72 can be displayed adjacent to (e.g., above, below, to the side of) the transmissive element 70 without overlap.

[0048] Each of the methods described below Figure 8 and Figure 9 illustrate a method or procedure for operation of a show effects system. Any suitable device (e.g., a processor 78 of a controller 74 illustrated in Figures 1-3 in coordination with other system components) can perform the respective method. In an embodiment, each method can be implemented by execution of instructions stored in a tangible, non-transitory computer-readable medium (e.g., a memory 76 of a controller 74 illustrated in Figures 1-3 ). For example, each method can be performed at least in part by one or more software components, one or more software applications, etc. Although each method is described using operations in a particular order, additional operations can be performed, described operations can be performed in a different order than illustrated, and / or certain described operations can be omitted or not performed at all.

[0049] Figure 8 is a flowchart of an embodiment of a method or process 130 for operating a show effect system to provide realistic show effects. That is, the show effect system can be operated to provide a virtual image that can augment the appearance of a real-world object (as viewed by a patron). At block 132, parameters of an object (e.g., a real-world object) within an interaction space of the show effect system can be determined. For example, the parameters can include a color, a texture, a reflectivity, a brightness, a size, a shape, an orientation, and / or a position of the object. The controller can determine the parameters of the object based on one or more markers within the interaction space. In another example, the controller can receive image data captured for different regions within the interaction space, and the controller can determine the parameters of the object based on the different image data. In yet another example, the controller can determine a relative distance between the object and a beam splitter or other boundary of the interaction space.

[0050] At block 134, image data can be generated based on the parameters (e.g., the position) of the object. For example, a size of the image data and / or a location for projecting the image data can be determined based on the parameters of the object within the interaction space. As an example, to provide image data that matches the size of the object as viewed by the patron, the size of the image data can be inversely proportional to the distance of the object to the beam splitter. In other words, the size of the image data can decrease as the distance between the object and the beam splitter increases. As another example, the controller can determine a target location for the image data based on the parameters of the object. For example, the target location can cause the projected image data to provide a virtual image that covers or overlaps the object as viewed by the patron.

[0051] At block 136, the image data can be transmitted to cause a virtual image to be presented in a viewing portion of the show effect system. For example, the image data transmitted to the display system can be projected in the target location on the beam splitter such that the reflective element and the transmissive element overlap and align with each other with respect to the line of sight of the patron. In another example, the image data transmitted to the display system can be offset in a direction such that a portion of the reflective element does not overlap with the transmissive element.

[0052] Additionally or alternatively, the image data can be generated based on a type of the object. For example, the controller can identify the type of the object based on a shape of the object and / or a pattern of markers located on a side of the object. The controller can identify a match between the shape of the object and / or the pattern of markers and a corresponding shape and / or a corresponding pattern of markers stored in a memory, and the controller can determine the type of the object associated with the matched shape and / or the pattern of markers. The controller can then identify image data associated with the type of the object.

[0053] It should be noted that the method 130 can be continuously or repeatedly performed. For example, the controller can continuously monitor the parameters of the object in the interaction space and adjust the image data (e.g., size of the image data, location of the image data) based on the parameters of the object. Thus, the image data can be adjusted and updated based on the parameters of the object to provide a more suitable appearance.

[0054] Figure 9 is a flowchart of one embodiment of a method or process 150 for operating a show effect system to provide a realistic show effect. For example, the method 150 can be performed to improve the visibility of a reflective element by a guest. At block 152, a viewing angle of a guest relative to the show effect system can be determined. For example, a sensor can generate sensor data indicative of an orientation of the guest relative to a beam splitter of the show effect system. For example, based on the sensor data, a controller can determine guest attributes such as a height of the guest, an arm length of the guest relative to the show effect system, and / or an orientation of the guest. In another example, the controller can determine a perception of the guest based on an eye level of the guest and / or facial features of the guest. The controller can also track eye movement of the guest to determine a viewing angle of the guest. In one embodiment, the guest can input one or more attributes such as a colorblind status, a color contrast adjustment, a height of the guest, etc. The controller can adjust a brightness level of a virtual image, a light intensity of one or more light sources, and / or an extension length of a cover. In this way, the visibility of the virtual image can be improved based on the guest attributes.

[0055] At block 154, the beam splitter can be adjusted based on the viewing angle of the guest. In one embodiment, the controller can instruct an actuator to adjust an orientation of the beam splitter to provide a higher visibility of the reflective element. For example, the controller can instruct the actuator to position the beam splitter at an angle (e.g., at 45 degrees) relative to the viewing angle of the guest and / or relative to the display system to change the visibility of the reflective element. In additional or alternative embodiments, the controller can adjust an orientation of the beam splitter (e.g., relative to the display system) to change the visibility of the reflective element.

[0056] While only certain features of the application have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is therefore, understood that the appended claims, intended to cover all such modifications and changes as fall within the true spirit of the application.

[0057] The technology presented and claimed herein is cited and applied to specific examples and implementations of the technology, and is not abstract, intangible or purely theoretical. Further, if any claims appended to this specification contain one or more elements designated as "means for" or "steps for" performing a certain function, it is intended that such elements are to be construed as a "means-plus-function" claim under 35 U.S.C. 112(f). However, for any claims containing elements designated as "means for" or "steps for" performing a certain function, it is intended that such elements are not to be construed as a "means-plus-function" claim under 35 U.S.C. 112(f) unless such claim specifically recites the words "means for" or "steps for" performing the function.

Claims

1. An attraction effect system for an amusement park, the attraction effect system comprising: a housing; an interaction space within the housing, wherein the interaction space is configured to receive an object; a display system configured to present imagery; an adjustable beam splitter positioned to enable the following visibility from a viewing portion: visibility through the adjustable beam splitter into the interaction space; and visibility of the imagery via reflection off of the adjustable beam splitter; a sensor configured to monitor the interaction space and provide sensor data related to the object within the interaction space; and one or more controllers communicatively coupled with the sensor and the display system, wherein the one or more controllers are configured to perform operations comprising: determining one or more parameters of the object based on the sensor data; generating image data based on at least one of the one or more parameters of the object; directing a transfer of the image data to the display system; and directing the display system to present the imagery based on the image data.

2. The attraction effect system of claim 1, comprising an additional sensor configured to monitor eye movement of a guest in the viewing portion, wherein the additional sensor is communicatively coupled to the one or more controllers and configured to transfer additional sensor data indicative of the eye movement of the guest.

3. The attraction effect system of claim 2, comprising an actuator coupled to the adjustable beam splitter and communicatively coupled to the one or more controllers, wherein the one or more controllers are configured to direct the actuator to adjust an orientation and / or position of the adjustable beam splitter relative to the display system based on the additional sensor data.

4. The attraction effect system of claim 1, wherein the one or more controllers are configured to: determine a size or position of the object based on the sensor data; and generate or adjust the imagery based on the size or the position of the object.

5. The attraction effect system of claim 1, wherein the housing comprises one or more openings that expose the interaction space to an external environment for access to the interaction space.

6. The attraction effect system of claim 1, wherein the interaction space comprises one or more reflective markers, and wherein the one or more controllers are configured to: determine a location of the object based on at least one distance measurement between the object and at least one of the one or more reflective markers.

7. The attraction effect system of claim 1, wherein the one or more controllers are configured to: determine a target position of one or more virtual images of the imagery to be presented by the display system onto the adjustable beam splitter based on the one or more parameters of the object; and direct the display system to present the one or more virtual images based on the target position. ​ 8. The show effect system of claim 7, wherein the one or more parameters include a relative distance between the object and the adjustable beam splitter.

9. The show effect system of claim 1, wherein the object includes one of a plurality of objects within the interaction space.

10. The show effect system of claim 1, comprising a set of actuatable coverings including one or more actuatable first coverings extending over the adjustable beam splitter and one or more actuatable second coverings on one or more lateral sides of the enclosure, wherein the set of actuatable coverings are configured to reduce or block ambient light directed onto the adjustable beam splitter.

11. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, are configured to cause the one or more processors to perform operations comprising: determining one or more characteristics of a viewer based on sensor data from one or more sensors monitoring a viewing position of a show effect system; determining one or more parameters of an object disposed within an interaction area of the show effect system based on additional sensor data received from one or more additional sensors monitoring the interaction area, wherein the object is visible from the viewing position through a beam splitter as a transmissive element; directing one or more actuators to adjust an orientation or position of the beam splitter based on the sensor data; generating image data based on the one or more parameters of the object; and directing a display system to project one or more virtual images onto the beam splitter based on the image data to cause the one or more virtual images to be visible from the viewing position via reflection from the beam splitter as a reflective element overlapping the transmissive element.

12. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations comprising: determining one or more types of the object based on one or more identifiers on the object detected from the additional sensor data; and generating the image data associated with the one or more types of the object.

13. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, are configured to cause the one or more processors to perform operations comprising: determining movement of the object from a first position within the interaction area to an additional position within the interaction area; and updating the image data based on the additional position of the object within the interaction area.

14. The non-transitory computer-readable medium of claim 11, wherein directing the display system to project the one or more virtual images onto the beam splitter comprises: directing a first display of the display system to project a first virtual image of the one or more virtual images onto the beam splitter; and directing a second display of the display system to project a second virtual image of the one or more virtual images onto the beam splitter. ​ ​ ​ instruct a second display of the display system to project a second virtual image of the one or more virtual images onto the beamsplitter, wherein the first virtual image and the second virtual image overlap to form the reflective element.

15. The non-transitory computer-readable medium of claim 11, wherein the instructions, when executed by the one or more processors, configure the one or more processors to perform operations comprising: determining a line of sight of the viewer in the viewing position based on the sensor data; and instructing the one or more actuators of the beamsplitter to move and / or orient the beamsplitter based on the line of sight of the viewer in the viewing position.

16. An attraction system for an attraction, the attraction system comprising: a housing comprising a beamsplitter defining an interaction space and a viewing portion within the housing, wherein the interaction space is configured to receive an object, the viewing portion comprises a three-dimensional display system configured to project one or more virtual images onto the beamsplitter, and the beamsplitter is configured to enable visibility of the object within the interaction space through the beamsplitter and to enable visibility of the one or more virtual images projected onto the beamsplitter via reflection from the beamsplitter; one or more sensors configured to track movement of the object, wherein the object is disposed within the interaction space; and a controller configured to: receive sensor data from the one or more sensors, wherein the sensor data is indicative of the movement of the object disposed within the interaction space; generate image data based on the movement of the object disposed within the interaction space as indicated by the sensor data; and instruct the three-dimensional display system to project the one or more virtual images onto the beamsplitter based on the image data such that the one or more virtual images combine to form an illusion of a three-dimensional image and are visible via the reflection from the beamsplitter in a first position of visibility that is based on a second position of visibility of the object through the beamsplitter.

17. The attraction system of claim 16, comprising one or more actuators, wherein the controller is configured to instruct the one or more actuators to move and / or orient the beamsplitter within the housing.

18. The attraction system of claim 17, comprising one or more additional sensors configured to determine one or more parameters indicative of a position of a user relative to the beamsplitter, wherein the controller is configured to instruct the one or more actuators to move and / or orient the beamsplitter within the housing based on the position of the user relative to the beamsplitter.

19. The attraction system of claim 18, wherein the controller is configured to instruct the one or more actuators to rotate the beam splitter relative to the three-dimensional display system, to translate the beam splitter relative to the three-dimensional display system, or both, to adjust the beam splitter within the housing based on the orientation of the user relative to the beam splitter.

20. The attraction system of claim 16, wherein the controller is configured to instruct the three-dimensional display system to project at least one of the one or more virtual images onto the beam splitter to overlap the first location of visibility of the one or more virtual images via the reflection off of the beam splitter with the second location of visibility of the object through the beam splitter.

Images