System and method for interactive augmented reality kiosk

Abstract

The amusement park show effect system 56 may include an enclosure 80, an interaction space 58 within the enclosure 80 that receives an object 62 from outside the enclosure 80, and a display system 66 that presents an image. The show effect system 56 may also include a beam splitter 68, which is positioned to allow the interaction space 58 to be seen from an observation section 60 through the beam splitter 68, and a virtual image to be seen via reflection from the beam splitter 68. Sensors 64 of the show effect system 56 may monitor the interaction space 58 and provide sensor data related to the object 62 in the interaction space 58. One or more controllers 74 of the show effect system 56 may be communicatively coupled to the sensors 64 and the display system 66 and perform operations including determining one or more parameters of the object 62 based on the sensor data, and generating image data based on the parameters of the object 62.

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application claims priority and the benefit thereof to U.S. Provisional Patent Application No. 63 / 455,174, entitled "SYSTEMS AND METHODS FOR AN INTERACTIVE AUGMENTED REALITY KIOSK," filed on March 28, 2023, which is hereby incorporated by reference in its entirety for all purposes.

Background Art

[0002] This section is for introducing the reader to various aspects of technologies that may be related to the various aspects of the technology described and / or claimed below. This discussion is considered useful in showing the reader the background circumstances and facilitating a better understanding of the various aspects of the present disclosure. Accordingly, these descriptions should not be regarded as an admission of prior art, but should be understood to be read from the above perspective.

[0003] In amusement parks and other entertainment venues, special effects can be used to help guests immerse in the experience of rides or attractions. An immersive environment can include three - dimensional (3D) props and large props, robots or mechanical elements, and / or a display surface presenting media. For example, an amusement park can provide an augmented reality (AR) experience to guests. The AR experience can include presenting virtual objects to guests, and the virtual objects can provide unique special effects to guests. The special effects can enable the amusement park to provide a creative way to entertain guests, such as by simulating real - world elements in a believable form.

Summary of the Invention

[0004] The following outlines some embodiments disclosed herein. These embodiments are merely summaries of some of these embodiments and should not be understood as limiting the scope of this disclosure. In practice, this disclosure may include various embodiments not shown below.

[0005] In one embodiment, an amusement park show effect system may include an enclosure, an interaction space within the enclosure that receives objects from outside the enclosure, and a display system that presents an image (any preferred display (e.g., liquid crystal display (LCD), light-emitting diode (LED) display, organic light-emitting diode (OLED) display, microLED), light field display, and / or projector with display screen)). The show effect system may also include a beam splitter, which is positioned to allow viewing of the interaction space through the beam splitter and viewing of a virtual image via reflection from the beam splitter from an observation area (e.g., observation position). Sensors in the show effect system may monitor the interaction space and provide sensor data about objects in the interaction space. One or more controllers of the show effect system may be communicatively coupled to the sensors and the display system. One or more controllers may perform operations including determining one or more parameters of an object based on sensor data, generating image data based on the object parameters, instructing the display system (e.g., projector) to transmit the image data, and instructing the display system to present an image based on the image data.

[0006] In one embodiment, a non-transient computer-readable medium includes an instruction that, when executed by one or more processors, causes one or more processors to perform an operation that includes determining one or more parameters of an object placed within an interaction area based on sensor data received from one or more sensors monitoring the interaction area of ​​a show effect system. The object can be seen from an observation position as a transmitted element through a beam splitter. The operation may include generating image data based on one or more parameters of the object, and instructing a display system to project one or more virtual images onto the beam splitter based on the image data so that the one or more virtual images are seen from an observation position as reflective elements superimposed on the transmitted element via reflection from the beam splitter.

[0007] In one embodiment, an attraction system for an attraction may include an enclosure containing a beam splitter, which defines an interaction space and an observation area within the enclosure. The interaction space can receive objects. The observation area may include a display system capable of projecting one or more virtual images onto the beam splitter, which can enable objects in the interaction space to be seen through the beam splitter, and enable one or more virtual images projected onto the beam splitter to be seen via reflection from the beam splitter. The attraction system may include one or more sensors that track the movement of objects in the interaction space, and a controller capable of receiving sensor data from one or more sensors. The sensor data can indicate the movement of objects in the interaction space. The controller can generate image data based on the movement of objects in the interaction space and can instruct the display system to project virtual images onto the beam splitter based on the image data so that one or more virtual images are visible via reflection from the beam splitter at a first visible position based on a second visible position where objects are seen through the beam splitter.

[0008] These and other features, embodiments, and advantages of the present invention will be better understood by reading the following detailed description while referring to the attached drawings, which show the same elements with the same symbols throughout. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic diagram of an embodiment of an attraction system in an amusement park or theme park according to the embodiments of this disclosure. [Figure 2] This is a front perspective view of an embodiment of the attraction system shown in Figure 1, according to an aspect of this disclosure. [Figure 3] This is a side perspective view of an embodiment of the attraction system shown in Figure 1, according to an aspect of this disclosure. [Figure 4] This is a perspective view of an embodiment of the attraction system shown in Figure 1 according to an aspect of this disclosure. [Figure 5] This is a perspective view of an embodiment of the attraction system shown in Figure 1 according to an aspect of this disclosure. [Figure 6] This is a front perspective view of the attraction system of Figure 1, which adjusts the display of show effect projections according to an aspect of this disclosure. [Figure 7] This is a schematic diagram illustrating the show effect provided by the show effect system of Figure 1 according to an aspect of this disclosure. [Figure 8] This is a flowchart of an embodiment of a method or process for providing show effects via the attraction system shown in Figure 1, according to an aspect of the present disclosure. [Figure 9] This is a flowchart of an embodiment of a method or process for operating the attraction system shown in Figure 1, according to an aspect of this disclosure. [Modes for carrying out the invention]

[0010] The following describes one or more specific embodiments of this disclosure. For the sake of brevity, this specification may not describe all the features of actual implementations. It should be understood that the development of any such implementation found in any engineering or design project will require numerous implementation-specific decisions to achieve the developer's specific objectives, such as compliance with system-related and business-related constraints, which may vary depending on the implementation. Furthermore, while such development efforts may be complex and time-consuming, they should be understood by those skilled in the art who benefit from this disclosure as routine design, fabrication, and manufacturing activities.

[0011] When describing elements of the various embodiments of this disclosure, the articles “a,” “an,” and “the” mean that there are one, two, or more of these elements. The terms “comprising,” “including,” and “having” are intended to be comprehensive and mean that there may be further elements other than those listed. Furthermore, any reference to “one embodiment” or “a certain embodiment” in this disclosure should not be interpreted as excluding the existence of further embodiments, including the features described.

[0012] This disclosure relates to providing show effects for amusement parks or theme parks. Amusement parks can include a variety of features to entertain guests, such as rides (e.g., roller coasters), theatrical shows, set designs, performers, and / or decorative elements. Show effects can be used to supplement or complement these features to provide guests with a highly immersive and / or unique experience. For example, show effects can be presented together with real-world objects to provide guests with an interactive experience.

[0013] The attraction system may include a show effects system configured to present virtual or simulated objects that complement the appearance of real-world objects via the Pepper's Ghost system. The Pepper's Ghost system may employ a primary area (e.g., background scene), a secondary area (e.g., augmented reality scene), and a light beam splitter (e.g., glass). The light beam splitter may be positioned to allow the transmission of images within the primary area through it. The light beam splitter may also reflect images from the secondary area. Thus, guests can observe images from the primary area (e.g., actual images transmitted from the primary area through the light beam splitter) and images from the secondary area (e.g., virtual images reflected from the secondary area to the light beam splitter) that are combined, overlapped, or overlaid on each other via the light beam splitter.

[0014] Embodiments of the present disclosure relate to providing a realistic representation of a combination of secondary area elements and primary area elements as described above, utilizing Peppers Ghost-Based technology. For example, as shown in Figures 2 to 6, the show effect system may include apertures (e.g., slots, holes such as aperture 90) for receiving real-world objects (e.g., physical objects, appendages, props) through guest interaction in the primary area (e.g., interaction space 58). Images of secondary area elements (e.g., images on a display such as a liquid crystal display (LCD), on a viewing portion 60) may be adjusted or manipulated to produce distortion, visual alteration, interaction representation with such images, or any other preferred enhancement of the images of real-world objects in the primary area. For this purpose, the primary area may include sensors (e.g., IR cameras) that detect objects and track the position of objects within the primary area (e.g., position relative to a light beam splitter). Object detection may include any detection parameters related to the object. To more realistically represent how elements in a secondary area (e.g., virtual objects) appear to be physically located within the primary area from the guest's perspective, images of the secondary area elements can be generated based on the object's position. In this way, images of the secondary area elements can be superimposed, overlaid, or combined with images from the primary area. For example, the show effects system disclosed herein can provide guests with realistic show effects via augmented reality without requiring or using wearable technology such as headsets or goggles. Thus, the guest experience can be enhanced while avoiding the work (e.g., maintenance, cleaning, repair, and control of individual wearable objects) and / or costs (e.g., installation costs, maintenance costs) associated with wearable technology. Furthermore, the show effects system can be more easily implemented and operated without requiring guests to wear wearable technology to enable the provided show effect experience.

[0015] In some cases, the show effect system may include one or more sensors (e.g., forward-facing sensors) that detect the presence of a guest and the guest's viewpoint (e.g., line of sight). For example, the show effect system may track the guest's eye movements to determine focus. In another example, the show effect system may track the guest's height relative to a primary or secondary area to determine the guest's viewpoint. In response to determining the guest's viewpoint, the show effect system may adjust the angle of a light beam splitter to enhance the visibility of images of elements in the secondary area. In addition to or instead of this, the show effect system may also include one or more covers that can enhance the visibility of images provided to the secondary area by reducing or blocking ambient light.

[0016] Based on the above, Figure 1 is a schematic diagram of an embodiment of an attraction system 50 in an amusement park or theme park. The attraction system 50 is shown to include a guest area 52 in which guests 54 are seated, and a show effects system 56 visible from and potentially accessible from the guest area 52. As an example, the guest area 52 may include paths (e.g., aisles, queues, lines) or spaces through which guests 54 can pass. As another example, the guest area 52 may include spaces (e.g., seating areas) where (one or more) guests 54 can be positioned to view a performance. As yet another example, the guest area 52 may include a vehicle that can travel throughout the entire attraction system 50 and transport (one or more) guests 54.

[0017] Furthermore, the attraction system 50 may include a show effects system 56 (e.g., a Pepper's Ghost-based system, an aerial-based image system) that can provide entertainment to (one or more) guests 54 located within the guest area 52 and / or within the attraction system 50. The show effects system 56 may include an arcade-like configuration that uses Pepper's Ghost-based technology to create show effects (e.g., visual effects) visible to (one or more) guests 54. The light beam splitter of the show effects system 56 may allow images in the primary area to pass through the light beam splitter and may also reflect images in the secondary area in order to create show effects. In addition to or instead of this, the show effects system 56 may also create show effects using an aerial-based image method. For example, the light beam splitter may allow images in the primary area to pass through the light beam splitter, and this image may be reflected by a retroreflector to create show effects. The reflected image may appear as an aerial image or an image floating within the show effects system 56. The retroreflector is adjacent to the light beam splitter and can be formed from a reflective material. In this way, a show effect can be presented to guest 54.

[0018] The show effects system 56 may include one or more augmented reality kiosks placed throughout the attraction system 50 as part of the guest 54's quest. The show effects system 56 may include supports (e.g., counters, tables) for accommodating physical objects (e.g., food, drinks, souvenirs), and the show effects system 56 may also utilize sneeze guards to shield the objects and display information about the objects to the (one or more) guest 54. In any of these examples, the show effects system 56 may include an interaction space 58 (primary area, background area) for guest interaction (e.g., guest input), an observation area 60 (secondary area, augmented reality scene) for the (one or more) guest 54 to view show effects (e.g., show effect projection), and a beam splitter 68 separating the interaction space 58 and the observation area 60 from each other.

[0019] The interaction space 58 can receive an object 62 (e.g., an apple), and one or more sensors 64 of the show effect system 56 can operate to detect the position of the object 62 within the interaction space 58. In the illustrated embodiment, (one or more) sensors 64 are located within the interaction space 58. However, in other embodiments, (one or more) sensors 64 can be located in any location where (one or more) sensors 64 can detect the object 62. The object 62 can be any preferred physical object (e.g., a token, a book, food, a hand) located within the show effect system 56. In one embodiment, the interaction space 58 may include an aperture or opening that allows the movement of the object 62 into and / or out of the interaction space 58. For example, a guest 54 can insert the object 62 into the interaction space 58 through the aperture. The show effect system 56 can present different show effects based on the inserted object 62 to provide the guest 54 with an interactive experience. For example, a guest 54 may insert a token into the interaction space 58 as part of a quest, and the show effects system 56 may enhance the appearance of the token by presenting show effects, such as a treasure chest, that are visible to the guest 54 (one or multiple). In another example, a guest 54 may insert their hand into the interaction space 58 through an aperture to retrieve a physical object (e.g., food, a book, a card) placed within the interaction space 58 for purchase. The show effects system 56 may enhance the guest 54's experience (e.g., a shopping experience) of viewing the physical object by presenting show effects, such as information about the physical object.

[0020] The interaction space 58 can include one or more sensors 64 that track the position of an object 62 within the interaction space 58. The sensor(s) 64 can be a camera (e.g., an optical camera, a three-dimensional (3D) camera, an infrared (IR) camera, a depth camera) and a position sensor (e.g., a sonar sensor, a radar sensor, a laser imaging, detection and ranging (LIDAR) sensor), etc. For example, the sensor(s) 64 can generate video data of the object 62 (e.g., in an IR spectrum that may not be visible to the guest(s) 54). The sensor(s) 64 can represent a plurality of sensors arranged at different positions (e.g., multiple positions inside and outside the interaction space 58) to generate different sensor data (e.g., video data, image data) indicating the position of the object 62. In one embodiment, the interaction space 58 can include one or more markers 65, such as IR reflection markers and ultraviolet markers, that can facilitate the determination of the position of the object 62. For example, the marker 65 can be arranged in a grid pattern or the like at a specific position within the interaction space 58, and the position of the object 62 relative to the specific position of this marker 65 can be determined to facilitate the determination of the position of the object 62. In another example, the marker 65 can have a known shape (e.g., circular, square, diamond), and these can be arranged in a known configuration such as a certain pattern and a predetermined angle. As a specific example, the position of the object 62 can be determined based on feedback from the sensor(s) 64 indicating that a specific marker 65 is not observable because it is covered or blocked by the object 62.

[0021] In one embodiment, the (single or multiple) sensors 64 may also detect the presence and / or viewpoint (e.g., line of sight) of the (single or multiple) guests 54. For example, the (single or multiple) sensors 64 may be cameras positioned to monitor the (single or multiple) guests 54 and can generate sensor data of the (single or multiple) guests 54 during the operation of the show effect system 56. For example, the (single or multiple) sensors 64 may be located between the (single or multiple) guests 54 and the observation unit 60. The sensor data may include the facial features, eye movements, height, arm length, and / or position of the (single or multiple) guests 54. For example, the sensor data may include the relative position between the guest 54 and the show effect system 56. As further described herein, the sensor data can be analyzed to determine the line of sight of the (single or multiple) guests 54 and adjust the show effect system 56 to enhance the visibility of the show effect. In further or another embodiment, the (single or multiple) sensors 64 may detect the movement of the (single or multiple) guests 54 and generate sensor data indicating guest attributes. For example, the (single or multiple) sensors 64 can generate sensor data of the (single or multiple) guest's facial features or other attributes. The show effect system 56 can then operate to provide show effects based on such sensor data, including the guest's identity or other attributes of the guest (e.g., identity, height, build, weight, clothing, hairstyle, accessories, tattoos) (e.g., based on facial recognition). The show effect system 56 can also operate to provide show effects based on user input, which may include guest attributes (e.g., height, build, weight, age, color blindness) or any guest preference.

[0022] In addition, the show effect system 56 can include an observation part 60 that can generate and project a virtual image (e.g., an image that functions as an element of an augmented reality or virtual reality presentation) to provide an augmented reality scene to the guest(s) 54. For this purpose, the observation part 60 can include a display system 66 that forms and projects a virtual image to the guest(s) 54. The display system 66 can be any suitable display (e.g., a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a micro LED), and / or a projector with a screen that receives image data and projects (e.g., displays) it as a virtual image. The display system 66 can also include a three-dimensional display such as a volumetric display, a light field display, a stereo display, and a lenticular display. The virtual image can be adjusted or manipulated to enhance (e.g., distort, change, superimpose, interact with) the appearance of the object 62 within the interaction space 58. For example, the virtual image can be a scaly lizard mask that transforms the appearance of the guest's hand (e.g., as seen from the guest's perspective) into the hand of a lizard. In another example, the virtual image can be one or more maps that provide additional information about the attraction system 50, and the guest(s) 54 can interact with the map to view the information. In yet another example, the virtual image can be one or more character strings that are overlaid on the object 62 (e.g., as seen from the guest's perspective) and describe some features of the object 62 (e.g., determined based on image recognition).

[0023] In one embodiment, the virtual image (e.g., image) can be any preferred two-dimensional image output (e.g., projected) by the display system 66. For example, the virtual image can be a still image, such as a photograph or picture that does not change. In another example, the virtual image can be a moving image and / or video that changes over time. In further or another embodiment, the virtual image can include a three-dimensional image that can be static or dynamic. For example, the display system 66 can include a light field display that includes an array of surfaces (e.g., lenses) that manipulate how light converges, converges, and / or is directed. The array of surfaces can form a three-dimensional profile of the projected image by focusing the light on (one or multiple) guests 54 at different positions, such as different depths, to produce an image with a layered, contoured, and / or textured appearance. In another example, the display system 66 can include a plurality of displays 66, each generating a portion (e.g., a slice) of a three-dimensional virtual image, the combination of which forms an image. Each portion generated by each display 66 can be a two-dimensional or three-dimensional image. In yet another example, the display system 66 may include a single display that moves to different locations to generate different virtual images, and which can form a three-dimensional image through the persistence of the vision of a (one or more) guest 54 (e.g., an observer). The display system 66 may be positioned to project the virtual images onto a beam splitter 68. The virtual images may include one or more virtual images projected by the display system 66 that appear at one or more locations as reflective elements 72 from the beam splitter 68.

[0024] The beam splitter 68 can provide a show effect to the (one or multiple) guests 54 by combining (e.g., superimposing, overlaying) the appearance of the object 62 from the interaction space 58 with an image from the observation area 60 (e.g., a virtual image projected by the display system 66). For example, the beam splitter 68 can be partially transparent and partially reflective, so that the (one or multiple) guests 54 can see elements through the beam splitter 68 and simultaneously see reflected elements from the beam splitter 68. Thus, from the guest area 52, the (one or multiple) guests 54 can see the object 62 placed in the interaction space 58 as a transparent element 70 that has passed through or is visible through the beam splitter 68 (e.g., at the location of visibility), and can also see the virtual image projected onto the observation area 60 by the display system 66 as a reflected element 72 that has been reflected from the beam splitter 68 and is directed towards the guest 54 (e.g., at the location of visibility). For this purpose, the beam splitter 68 can be formed of a material that has both transmitting and reflective properties, such as glass, plastic, foil, and / or translucent mirrors, so that an object 62 in the interaction space 58 is visible through the beam splitter 68 as a transmitting element 70, and a virtual image of the observation portion 60 reflected from the beam splitter 68 is visible as a reflecting element 72. In this way, the (single or multiple) guest 54 can see a composite image including the transmitting element 70 and the reflecting element 72. In some cases, the beam splitter 68 can have a flat or planar profile. In other cases, the beam splitter 68 can have a curved or concave profile that can manipulate or change the appearance of the object 62 and / or the image projected by the display system 66. Furthermore, the beam splitter 68 can have an angle (e.g., 45 degrees) such that the image projected by the display system 66 is reflected toward the (single or multiple) guest 54 in a desired manner relative to the line of sight of the (single or multiple) guest 54 and / or the display system 66.In some cases, the beam splitter 68 can be coupled to an actuator 73 that adjusts the beam splitter 68 based on the viewpoint (e.g., line of sight) of the (single or multiple) guest 54 (e.g., by rotating, directing, and / or linearly translating the beam splitter 68). In addition to or instead of this, the actuator 73 can also adjust the distance between the beam splitter 68 and the display system 66 (e.g., by translating the beam splitter 68). Thus, the actuator 73 can further adjust the appearance of the reflective element 72 as seen by the (single or multiple) guest 54.

[0025] In one embodiment, the show effect system 56 may include a cover positioned around the observation area 60 to facilitate the visibility of the reflective elements 72 and reduce or block ambient light or glare onto the beam splitter 68. For example, the show effect system 56 may include a cloth or fabric covering the sides of the observation area 60. In another example, the cover may extend beyond the boundary of the display system 66 to reduce or block light incident on the observation area 60 in order to enhance the visibility of the virtual image (e.g., reflected from the beam splitter 68). The show effect system 56 may operate to adjust visibility based on incident light (e.g., sunlight, streetlights), light detection (e.g., via one or more light sensors measuring glare or direct light), or timing (e.g., a timer can be set to initiate adjustments based on a known lighting scenario) (e.g., by changing the hue (e.g., for color contrast adjustment) or changing the shading (e.g., for increasing light intensity)). In one embodiment, the show effect system 56 may include one or more inputs for guest input (e.g., buttons, touch screens, knobs) that can adjust the visibility of the virtual image based on the guest input. For example, a guest 54 can turn a knob to increase the visibility of the reflective element 72. For this purpose, the show effect system 56 may include one or more light sources (e.g., OLEDs, LEDs) that output light amounts to adjust the brightness level of the virtual image reflected from the beam splitter 68. For example, one or more light sources may be LEDs that can be modulated to increase the amount of light output to increase the brightness level of the interaction space 58, and thus increase the brightness level of the virtual image reflected from the beam splitter 68. In another example, one or more light sources may decrease the amount of light output to enhance the contrast between the virtual images reflected from the beam splitter 68 and improve the visibility of the image. In addition to or instead of this, one or more light sources may also adjust the color of the interaction space 58. For example, one or more light sources may include multiple LEDs of different colors that can be modulated to output colors such as red, green, and blue.In this way, the color contrast level of the virtual image reflected from the beam splitter 68 can be adjusted.

[0026] In one embodiment, a guest 54 (one or more) can input one or more guest attributes using one or more input units, and the show effect system 56 can adjust the virtual image based on the guest attributes. For example, a guest 54 (one or more) can input height, color blindness status, and color preferences. As further described herein, the show effect system 56 can adjust the position of the beam splitter 68 based on the height and / or line of sight of the guest 54 (one or more) to improve the visibility of the virtual image reflected from the beam splitter 68. The show effect system 56 can adjust the color of the virtual image based on the color blindness attribute of the guest 54 (one or more). To this end, the show effect system 56 can generate a virtual image based on the colors visible to the guest (one or more) and / or by removing colors that are not visible to the guest 54 (one or more) or color schemes that the guest 54 (one or more) cannot distinguish from the virtual image. In this way, the visibility of the virtual image can be improved. In another example, a guest 54 (one or multiple) can select a color preference (for example, via one or more inputs), and the show effects system 56 can generate a virtual image based on the color preference. Taking the lizard hand example again, a guest 54 (one or multiple) can indicate that green is their preferred color, and therefore the show effects system 56 can generate a green scaly lizard mask. In addition to or instead of this, the display system 66 may also include one or more displays 66 that can generate virtual images individually or collectively. For example, a first display 66 can generate a first part of a green scaly lizard mask, and a second display 66 can generate a second part of a green scaly lizard mask. In another example, the first display 66 can generate a green scaly lizard mask, and the second display 66 can generate a red scaly lizard mask and overlay it to form a yellow scaly lizard mask, thereby adjusting the color of the lizard masks.In yet another example, the first and second displays 66 generate a lizard mask, and the third display 66 generates a colored background, thereby adjusting the brightness level of the lizard mask and / or the color contrast between the lizard mask and the background to improve the visibility of the virtual image reflected from the beam splitter 68.

[0027] The show effect system 56 includes, or can cooperate with, a controller 74 (e.g., a control system, automation controller, programmable controller, electronic controller, control circuit, or cloud computing system) configured to operate the show effect system 56 and provide an interactive experience to (one or more) guests 54. For example, the controller 74 can be communicably coupled to (one or more) sensors 64, a display system 66, and / or actuators 73 (e.g., via one or more wires, wireless communication (e.g., via transmitters, receivers, transceivers)). The controller 74 may include memory 76 and a processor 78 (e.g., processing circuitry). The memory 76 may include volatile memory such as random access memory (RAM) and / or non-volatile memory such as read-only memory (ROM), an optical drive, a hard disk drive, a solid-state drive, or any other non-temporary computer-readable medium containing instructions for operating the show effect system 56. The processor 78 may be configured to execute such instructions. For example, the processor 78 may include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof. In some cases, the controller 74 may include one or more controllers that are communicatively coupled and can individually or collectively perform the actions described herein. In addition to or instead of this, the controller 74 may also include one or more processors 78 and / or one or more memories 76 that can individually or collectively perform the actions described herein.

[0028] In one embodiment, the controller 74 may operate to receive sensor data from (one or multiple) sensors 64, identify an object 62, identify the location of the object 62, and send image data (e.g., image data generated based on the sensor data provided by (one or multiple) sensors 64) to the display system 66 to generate a virtual image. For example, the controller 74 may use image analysis techniques to determine the size, shape, color, texture, reflectivity, brightness, orientation, and / or type of the object 62. The controller 74 may then identify the corresponding characteristics (e.g., size, shape, type) of the image data to be sent to the display system 66. For example, the controller 74 may identify the object 62 as a ticket and generate image data that includes information about the ticket, such as the ticket type, length of stay, and price. In another example, the controller 74 may identify the object 62 as a souvenir (e.g., a book) and generate image data related to the souvenir, such as special effects or price. The controller 74 can determine the position of the object 62 and the corresponding projection position of the virtual image to generate realistic special effects, and in coordination with the object 62, provide the desired appearance of the reflective element 72. For example, the controller 74 can determine the position of the object 62 based on a grid pattern of markers 65 placed in the interaction space 58. The controller 74 can determine the relative distance between the object 62 and the beam splitter 68 based on multiple images showing the object 62 relative to various markers 65 placed at known positions (e.g., known coordinates in the three-dimensional coordinate system of the interaction space 58) captured by the (one or more) sensors 64. In some embodiments, the (one or more) sensors 64 may include one or more LiDAR sensors that can be used to determine positional information. In addition to or instead of this, the controller 74 may also use image analysis techniques to utilize the shadow of the object 62 to determine the size of the object 62 and / or the position of the object 62 relative to the beam splitter 68. The controller 74 can continue to track the position of the object 62 and adjust (e.g., update) the image data transmitted to the display system 66.For example, the controller 74 can adjust the size and / or position of the virtual image projected by the display system 66 based on the position of the object 62.

[0029] For example, the controller 74 can transmit image data representing the movement and / or resizing of the reflective element 72 in response to the determined movement of the object 62 (e.g., relative to the beam splitter 68). For example, the controller 74 can instruct the display system 66 to operate to provide a reflective element 72 that can overlap the appearance of the object 62 in order to change (e.g., distort, manipulate, adjust, or enhance) the appearance of the object 62 as seen by the guest 54. For example, the controller 74 can instruct the display system 66 to project a larger virtual image (compared to a previously projected image) in response to determining that the object 62 is within a threshold distance of the beam splitter 68 (e.g., approaching the observer), and can instruct the display system 66 to project a smaller virtual image (compared to a previously projected image) in response to determining that the object 62 is beyond a threshold distance from the beam splitter 68 (e.g., away from the observer). Therefore, the virtual image can provide a reflective element 72 that appears to match the transparent element 70 that the (one or multiple) guest 54 is viewing. In this way, the show effect system 56 can provide a realistic or other desirable representation of the composite image (e.g., the transparent element 70 and the reflective element 72) and provide the (one or multiple) guest 54 with an interactive experience. In one embodiment, the controller 74 can determine the appearance of the reflective element 72 based on sensor data received from the sensor 64. The controller 74 can determine whether the appearance of the reflective element 72 is desirable (e.g., matches the target appearance) and, in response to the appearance of the reflective element 72 being undesirable, can instruct the display system 66 to act, for example, adjust the projected virtual image.

[0030] In one embodiment, the controller 74 can be configured to instruct the actuator 73 to adjust the position of the beam splitter 68 based on the position of a guest 54 (e.g., an observer). For example, the controller 74 can receive sensor data and operate to determine the viewpoint of the guest 54. To determine the viewpoint of the guest 54, the controller 74 can identify the guest 54's position / orientation (e.g., head position / orientation), height, eye height / position, and eye movements, etc. For example, the controller 74 can determine the area of ​​the beam splitter 68 that the guest 54 is looking at. The controller 74 can improve the visualization of the transmissive element 70 and / or reflective element 72 by sending a signal to the actuator 73 coupled to the beam splitter 68 to adjust the angle of the beam splitter 68 based on the viewpoint of the (one or multiple) guest 54 (for example, by rotating the beam splitter 68 relative to the display system 66). In addition to or instead of this, the controller 74 can also instruct the actuator 73 to adjust the distance between the beam splitter 68 and the display system 66 based on the viewpoint of the (one or multiple) guest 54 (for example, by translating the beam splitter 68 relative to the display system 66). Thus, the controller 74 can facilitate observation of the reflective element 72 by the (one or multiple) guest 54.

[0031] Figure 2 is a front perspective view of an embodiment of the attraction system 50. Specifically, Figure 2 shows a show effect system 56 having an observation section 60 which includes one sensor 64A positioned adjacent to or within the observation section 60 (for example, above the interaction space 58) and two sensors 64B positioned adjacent to or within the interaction space 58. In embodiments, the show effect system 56 may include a preferred number of sensors 64A adjacent to or within the observation section 60 and a preferred number of sensors 64B adjacent to or within the interaction space 58. Sensors 64A are positioned between the observation section 60 and a guest facing the observation section 60 and can generate sensor data indicating the guest's characteristics (e.g., viewpoint). Sensors 64B are positioned at various locations relative to the interaction space 58 and can generate sensor data indicating an object (e.g., object 62 as described in relation to Figure 1) placed within the interaction space 58. The show effect system 56 may also include a controller 74 positioned adjacent to (for example, below) the interaction space 58 and the observation section 60. The controller 74 can be communicatively coupled to the display system 66 of the observation section 60, the sensor 64A of the observation section 60, the sensor 64B of the interaction space 58A, and an actuator 73 coupled to the beam splitter 68. In the illustrated embodiment, the sensors 64A and 64B are located within or coupled to the enclosure 80 of the show effect system 56. However, in other embodiments, the sensors 64A and 64B may be located outside the enclosure 80 in a manner that allows them to monitor the observation section 60 and the interaction space 58, respectively.

[0032] As described above, the show effect system 56 may include an enclosure 80 (representing, for example, multiple enclosures coupled together or a single enclosure). The enclosure 80 may define a first volume 82 having an interaction space 58 and an observation section 60. For example, a beam splitter 68 may be placed within the first volume 82 to further divide the first volume 82 into the interaction space 58 and the observation section 60. The enclosure 80 may also define a second volume 84 in which a controller 74 can be placed. However, in other embodiments, the controller 74 may be located outside the enclosure 80 and communicate wirelessly with other embodiments of the show effect system 56. The enclosure 80 may include various features such as walls, panels, and barriers that can shield the components of the show effect system 56 (e.g., sensors 64A and 64B, beam splitter 68, controller 74) from various external elements such as dust and debris. Therefore, the enclosure 80 can protect such components to enable desired operation and / or extend the useful life of the show effect system 56. In further or alternative embodiments, the enclosure 80 may also include features such as doors that allow access to components such as a controller 74 located inside the enclosure 80. Thus, the enclosure 80 can also provide shielding capabilities for the show effect system 56 while allowing various operations such as inspection, maintenance, repair, and replacement to be performed on the components.

[0033] The display system 66 can face the beam splitter 68 so that a virtual image projected from the display system 66 is reflected by the beam splitter 68 and enters the guest's viewpoint (e.g., line of sight). The display system 66 can receive image data from the controller 74 and digitally render a virtual image based on the image data. The display system 66 can project the virtual image onto a specific area (e.g., a portion) of the beam splitter 68 based on the image data. The reflective element (e.g., the reflected virtual image) can appear to be located within the interaction space 58 when viewed by the guest. For example, the beam splitter 68 can have an angle 88 (e.g., a 45-degree angle) relative to the display system 66 that provides a desirable (e.g., realistic) appearance of the reflective element within the interaction space 58. However, in some embodiments, the controller 74 can instruct the actuator 73 to adjust the beam splitter 68 to any preferred angle, any preferred distance, and / or any other preferred position / orientation relative to the display system 66. For example, the controller 74 can send a signal to the actuator 73 to adjust the beam splitter 68 based on sensor data. The sensor 64A in the observation section 60 can generate guest sensor data, including facial features, eye height, height, and arm length, and transmit it to the controller 74. The controller 74 can instruct the actuator 73 to adjust the beam splitter 68 based on the sensor data received from sensor 64A. For example, the controller 74 can instruct the actuator 73 to adjust the beam splitter 68 so that the guest can see the show effect (e.g., a composite image of transmissive and reflective elements) correctly by increasing the visibility of the reflective elements.

[0034] In one embodiment, the display system 66 may be a volumetric display that projects a three-dimensional virtual image such that the reflective elements appear with accurate depth and dimensions from any viewpoint. The volumetric display may include a screen (e.g., a film layer) that can move quickly and iteratively within a volume while an image is projected onto the screen at various positions on the screen, creating the illusion of a three-dimensional object by the persistence of the visual effect on the guest (e.g., an observer). Therefore, the controller 74 does not need to command the actuator 73 to adjust the angle of the beam splitter 68. In one embodiment, the display system 66 is located behind the beam splitter 68 so that the virtual image projected from the display system 66 can pass through the beam splitter 68 and enter the guest's viewpoint. The display system 66 may also include a first display 66 that faces the beam splitter 68 and projects a virtual image reflected from the beam splitter 68, and a second display 66 that is located behind the beam splitter 68 and projects a virtual image that passes through the beam splitter 68.

[0035] The controller 74 can also instruct the display system 66 to project a virtual image based on an object placed in the interaction space 58. The enclosure 80 can define an aperture 90 that exposes the interaction space 58 to the external environment so that it can be accessed. For example, the aperture 90 can allow the placement of an object (such as the object 62 described in Figure 1) into the interaction space 58 and / or the removal of an object from the interaction space 58. For example, a guest may insert their hand into the aperture 90 while interacting with the show effect system 56. A sensor 64B in the interaction space 58 can generate sensor data indicating the position of the guest's hand. In some cases, the controller 74 can determine the size of the guest's hand and its relative position based on the sensor data. Based on the size and relative position of the guest's hand, the controller 74 can generate image data to be sent to the display system 66. Based on the relative position of the guest's hand, the controller 74 can also determine the position of the image data that the display system 66 should project. In this way, the controller 74 can instruct the display system 66 to project virtual images and adjust the appearance of the reflective elements to provide guests with a more interactive experience. For example, the reflective element 72 can be presented as a virtual tattoo on the guest's hand and adjusted to correspond to the guest's hand movements in the interaction space 58.

[0036] Figure 3 is a side perspective view of an embodiment of the attraction system 50. Specifically, Figure 3 shows a show effect system 56, in which the interaction space 58 includes a physical object 100 (e.g., the object 62 described in relation to Figure 1) that a guest 54 presents into the interaction space 58 through an aperture 90. The illustrated show effect system 56 includes a plurality of markers 65 arranged in a grid pattern within the interaction space 58. For example, the physical object 100 is represented as a ticket formed from an opaque material (e.g., paper, plastic, metal). However, the physical object 100 can be any preferred object such as an accessory of the guest 54 (e.g., a hand), merchandise (e.g., food, a book), a token, a map, or a coin. The physical object 100 placed within the interaction space 58 can be seen by the guest 54 as a transparent element through a beam splitter 68.

[0037] Sensor 64B in the interaction space 58 can generate sensor data (e.g., acquired image data, location data) related to the physical object 100. Controller 74 can identify the type of physical object 100 based on the sensor data. For example, controller 74 can use image analysis (e.g., processing) techniques to identify the type of physical object 100 as a ticket. In one case, controller 74 can compare the shape of the physical object 100 with one or more shapes stored in memory 76. In another case, the ticket may include a text description and / or an image, and image analysis techniques can be used to identify this text description and / or image and compare it with a description or image stored in memory 76. In some cases, controller 74 can identify one or more identifiers 102 (e.g., a QR code®, a barcode) on the physical object 100 and compare one or more identifiers 102 with a list of identifiers stored in memory 76. As shown in the figure, the physical object 100 includes a barcode that controller 74 can use to identify the type of physical object 100.

[0038] The controller 74 can also determine the position of the physical object 100 in the interaction space 58 based on sensor data. For example, one or more markers 65 can be placed at known locations in the interaction space 58, and the controller 74 can determine the position of the physical object 100 in the interaction space 58 by identifying the relative position of the physical object 100 with respect to one or more markers 65. For example, the controller 74 can determine the size of the image data by determining the relative distance between the physical object 100 and the beam splitter 68. In another example, the controller 74 can determine the position of the image data by determining the position of the physical object 100. The controller 74 can determine the image data to be transmitted to the display system 66 based on the type and / or position of the physical object 100 in the interaction space 58. For example, the controller 74 can identify image data associated with different types of objects that can be placed in the interaction space 58.

[0039] The controller 74 can instruct the display system 66 to operate in a way that alters the appearance of the physical object 100 by overlaying additional visual information. For example, the controller 74 can instruct the display system 66 to adjust the appearance of the ticket by projecting information about the ticket, change the color of the ticket by projecting color onto the ticket, and / or project an animation that appears to be displayed on the ticket. The controller 74 can realistically provide such special effects based on the size and / or position of the physical object 100 in the interaction space 58 (for example, by enabling the display 66 to project a virtual image that provides reflective elements corresponding to the appearance of the physical object 100 as seen by the guest 54).

[0040] Figure 4 is a perspective view of an embodiment of the attraction system 50. In the embodiment shown in Figure 4, the show effect system 56 may be an arcade-like configuration having a cover 120A that reduces or blocks ambient light directed toward a specific part of the show effect system 56. For example, the cover 120A can at least partially surround the observation area 60. The cover 120A may extend longitudinally 122, covering (for example, overlapping) the beam splitter 68. The cover 120A can block light (for example, directed toward the beam splitter 68 in the vertical direction 124). In one example, a controller 74 may command an actuator 123 to extend, retract, or otherwise move the cover 120A. For example, in response to the controller 74 determining that the light intensity is below a threshold (for example, on a cloudy day when the sun is partially obscured), the controller 74 can instruct the actuator 123 to increase the amount of light directed towards the beam splitter 68 by retracting the cover 120, thereby improving the visibility of objects in the interaction space 58. In response to the controller 74 determining that the light intensity is above a threshold (for example, on a sunny day when the sun is not obscured), the controller 74 can instruct the actuator 123 to decrease the amount of light directed towards the beam splitter 68 by extending the cover 120, thereby improving the visibility of reflective elements in the observation area 60. For example, as the light intensity increases, the relative brightness level of the virtual image (for example, relative to the guest's viewpoint) can decrease. By extending the cover 120, the amount of light directed towards the beam splitter 68 can be blocked, increasing the relative brightness level of the virtual image and thus improving the visibility of the virtual image relative to the guest's viewpoint. For this purpose, the sensors of the show effects system 56 (for example, the sensor 64 described in relation to Figure 1) can generate sensor data indicating the state of light (e.g., brightness level, light intensity), and the controller 74 can instruct the actuator 123 to adjust the cover 120 based on the state of light to provide guests with a better viewing experience of the special effects provided by the show effects system 56.

[0041] In addition to or instead of this, the show effect system 56 may also include a cover 120B on its side. The cover 120B may extend across the side of the show effect system 56 (for example, along the longitudinal direction 122 and along the vertical direction 124). Thus, the cover 120B can reduce or block ambient light directed toward the beam splitter 68 in the lateral direction 125. The controller 74 may also instruct the actuator 123 to adjust the cover 120B based on the detected light state. In this way, the covers 120A, 120B can collectively improve the visibility of the show effect system 56 to guests. In addition to or instead of this, the covers 120A, 120B may also guide guests to look directly at the beam splitter 68 to enhance the visibility of the reflective elements. In this way, guests can avoid viewing the beam splitter 68 from an oblique angle and thus avoid seeing a distorted show effect.

[0042] In one embodiment, the interaction space 58 may include light-emitting elements (e.g., LEDs, OLEDs) that adjust the brightness levels within the show effect system 56. For example, the light-emitting elements can be adjusted to ensure that the transmissive elements are visible to the guest. For example, the controller 74 can determine the amount of light in the interaction space 58 so that the visibility of objects placed within the interaction space 58 to the guest can be indicated. In addition to or instead of this, the controller 74 can adjust the rendering of reflective elements based on the appearance of the physical object 100 to adjust the brightness levels of the image output to the beam splitter 68 by the display system 66. In this way, the controller 74 can provide a variety of operations to adjust the visibility of transmissive and / or reflective elements to the guest.

[0043] Figure 5 is a perspective view of the attraction system 50. In the embodiment shown in Figure 5, a beam splitter 68 of the illustrated show effect system 56 extends from the guest-facing side 126 of the show effect system 56 to block access to the interaction space 58. For example, the enclosure 80 may include a partition 127 that divides and separates a first volume 82 and a second volume 84 of the enclosure 80 from each other. The beam splitter 68 may extend to abut against or in contact with the partition 127. Thus, the beam splitter 68 and the partition 127 can work together to define the interaction space 58. For this reason, the show effect system 56 may not include an aperture that allows for the positioning of objects within the interaction space 58. Also, the illustrated show effect system 56 may not include a cover on the side of the show effect system 56 (e.g., cover 120B as described in relation to Figure 4). For example, the show effect system 56 may be integrated with a self-service food line (e.g., a buffet line), a display case with physical objects, and a ticket line. In another example, the show effect system 56 can be integrated with a checkout counter in a grocery store, a display case for one or more products, a glass-enclosed conference room and / or office, etc. In this way, the sides of the show effect system 56 can be opened (e.g., by removing a cover) to facilitate guest interaction, allowing guests to access objects placed in the interaction space 58 from the side. The show effect system 56 can provide additional information, such as information about physical objects (e.g., food, toys, books, tickets). For example, by being integrated with a showcase, the show effect system 56 can display information about physical objects in the store (e.g., toys, books). The physical objects can be located in the interaction space 58, and the controller 74 can display corresponding information adjacent to the physical objects when visible to the guest. The display system 66 can receive image data from the controller 74 and project a virtual image onto the beam splitter 68 as a reflective element visible to the guest.Sensors within the interaction space 58 can receive guest interaction instructions (e.g., reaching for an item, presence of a guest). In response to the instructions, the controller 74 can generate image data containing information about the item. For example, this information may include the price of the physical object, the quantity of the physical object, the return policy for the physical object, or the serial number of the physical object. Specifically, by passing a conveyor belt through the show effect system 56 so that items on the conveyor belt (e.g., plates of sushi) pass through the interaction space 58 and are visible through the beam splitter 68, it is possible to enable detection of items via sensors 64 and display of information about the items (e.g., sushi toppings) via reflective elements.

[0044] Figure 6 is a front perspective view showing how the attraction system 50 adjusts the display of show effect projections. Specifically, Figure 6 shows a show effect provided through the show effect system 56 (e.g., a composite image of a translucent element 70 and a reflective element 72). As an example, a guest 54 can extend their arm through the aperture 90 for an interactive experience and position their hand 128 (e.g., the object 62 described in relation to Figure 1) within the interaction space 58 of the show effect system 56. The hand 128 can be seen by the guest 54 as a translucent element 70 through the beam splitter 68. The show effect system 56 can operate to enhance or augment the appearance of the hand 128. For example, the show effect provided by the show effect system 56 includes a reflective element 72 that appears to be positioned (e.g., physically positioned) within the interaction space 58 when seen by the guest 54. Thus, the reflective element 72 can appear realistic as a physical object interacting with the guest 54's hand 128. As an example, the reflective element 72 can provide the appearance of a further object, such as a fire, cup, or ball, held in the guest's hand 128. As another example, the reflective element 72 can appear to transform the hand 128 into a different appearance, such as a gloved appearance, a scaly appearance, or a light-emitting appearance. However, the reflective element 72 may include either an image that provides an appearance of interacting with the guest's hand 128 or a modified appearance of the hand 128.

[0045] In one embodiment, the controller 74 can be configured to generate image data and transmit it to the display system 66, causing the display system 66 to project a virtual image and provide a reflective element 72, thereby producing a show effect. For example, sensors in the interaction space 58 can track the position of the hand 128, and the controller 74 can determine the position, size, and / or shape of the guest's hand relative to the beam splitter 68 based on sensor data received from such sensors, in order to create a realistic show effect. The controller 74 can instruct the display system 66 to generate a virtual image and project it onto the observation area 60 such that the reflective element 72 appears at or near the position of the guest's hand in the interaction space 58 when the guest 54 is looking at it. For example, the position of the virtual image projected by the display system 66 and reflected from the beam splitter 68 can align the reflective element 72 with the guest's hand. Specifically, the guest's hand can be located in the interaction space 58, and the guest can see the transmissive element 70 that has passed through the beam splitter 68 in a visible position. The display system 66 can project a virtual image based on the visible position. For example, the transparent element 70 and the reflective element 72 can overlap in a visible position to form a show effect. In addition to or instead of this, the controller 74 can also instruct the display system 66 to project a virtual image onto the observation area 60 so that the size and / or shape of the reflective element 72 appears to match the profile of the guest's hand. In practice, the reflective element 72 can appear to be combined with or overlapping the transparent element 70. In one embodiment, the reflective element 72 can be presented so that the guest 54 can see their hand 128 through the reflective element 72 that overlaps with their hand 128 through a partially transparent effect. On the other hand, the appearance of the reflective element 72 can be made so as not to be distorted by the hand 128 or another object in the interaction space 58. Thus, the reflective element 72 provided by the controller 74 can have a realistic or desirable appearance when it overlaps with the hand 128.

[0046] The controller 74 can also instruct the display system 66 to adjust the appearance of the reflective element 72. For example, the controller 74 can track the movement of the hand 128 in the interaction space 58 and instruct the display system 66 to adjust the projection of the virtual image so that the reflective element 72 follows the movement of the hand 128 (for example, to maintain the overlay display of the reflective element 72 on the translucent element 70 associated with the hand 128). As an example, the guest 54 can move the hand 128 in the interaction space 58 from a first position 130A to a second position 130B (for example, from left to right). The controller 74 can detect the movement of the hand 128 based on sensor data and instruct the display system 66 to adjust the position of the virtual image so that the position of the reflective element 72 changes from the first position 130A to the second position 130B to follow the hand 128. Thus, the movement of the reflective element 72 can appear to be driven by the movement of the hand 128. In some cases, the guest 54 can change the size of the transparent element 70 by moving the hand 128 relative to the beam splitter 68. The controller 74 can detect this movement and instruct the display system 66 to adjust the size of the virtual image so that the size of the reflective element 72 changes while still matching the appearance of the hand 128. In yet another example, the controller 74 can also instruct the display system 66 to offset the reflective element 72 from the appearance of the hand 128.

[0047] Figure 7 is a schematic diagram illustrating the show effect provided by the show effect system 56. As an example, the show effect system 56 can provide information about products for purchase within the show effect system 56, such as in a self-service food line. For example, the beam splitter 68 can function as a splash-proof guard glass panel in addition to forming the interaction space and observation area 60. One or more physical objects (e.g., hamburgers) can be placed within the interaction space. Guests visiting the self-service food line can take physical products for purchase. In further or alternative embodiments, the show effect system 56 can be implemented in a different context, and the physical objects may include other suitable physical objects such as books, tokens, and maps.

[0048] As shown in the figure, a physical object can be seen as a transparent element 70 through the beam splitter 68. The controller 74 can identify a physical object based on image analysis techniques and / or one or more identifiers of the physical object. In some cases, the controller 74 can use image analysis techniques to determine the size, shape, or type of a physical object and match the size, shape, or type to one or more stored templates in memory 76 to identify the physical object. In another example, a product may include one or more identifiers. In yet another example, the physical product may be a hamburger on a plate, and the plate may include one or more identifiers, such as a barcode (e.g., QR code®) that the controller 74 can identify. The controller 74 can match one or more identifiers to one or more stored identifiers in memory 76 to identify and / or retrieve image content corresponding to chicken tender. For example, the controller 74 can generate image data associated with a physical object and transmit the image data to a display system to display the reflective element 72. The illustrated reflective element 72 contains information about the physical object, such as the type of physical object, the cost of the physical object, and the nutritional value of the physical object. The controller 74 can display a virtual image in the observation section 60 to generate the reflective element 72 as if it were present in the interaction space. For example, the reflective element 72 may include information about the product, such as the cost of the product, the type of product, and the characteristics of the product. In the illustrated example, the reflective element 72 displays the type of product (e.g., burger), the cost of the product (e.g., cost: 3.00), and the characteristics of the product (e.g., calories: 550). Furthermore, to clearly associate the reflective element 72 with the physical object, a portion of the reflective element 72 and a portion of the transparent element 70 are superimposed on each other. In other examples, the reflective element 72 may also be displayed adjacent to the transparent element 70 (e.g., above, below, or to the side of the transparent element 70) so as not to overlap.

[0049] Figures 8 and 9, described later, illustrate the operation methods or processes of the show effect system, respectively. Any preferred apparatus (for example, the processor 78 of the controller 74 shown in Figures 1 to 3 in cooperation with other system components) can perform each method. In some embodiments, each method can be implemented by executing instructions stored in a tangible, non-temporary computer-readable medium (for example, the memory 76 of the controller 74 shown in Figures 1 to 3). For example, each method can be performed, at least in part, by one or more software components and one or more software applications. Each method will be described using a specific order of operation, but further operations may be performed, the operations described may be performed in an order different from the illustrated order, and / or some of the operations described may be skipped or not performed at all.

[0050] Figure 8 is a flowchart of an embodiment of a method or process 130 for operating a show effect system to provide realistic show effects. That is, the show effect system can operate to provide virtual images that can supplement the appearance of real-world objects when viewed by a guest. In block 132, parameters of an object (e.g., a real-world object) in the interaction space of the show effect system can be determined. For example, parameters may include the object's color, texture, reflectivity, brightness, size, shape, orientation, and / or position. The controller can determine the object's parameters based on one or more markers in the interaction space. In another example, the controller can receive captured image data for different areas in the interaction space and determine the object's parameters based on the different image data. In yet another example, the controller can determine the relative distance between the object and a beam splitter or other boundary of the interaction space.

[0051] In block 134, image data can be generated based on the parameters of an object (e.g., position). For example, the size of the image data and / or the position on which the image data is projected can be determined based on the parameters of an object in the interaction space. As an example, to provide image data that matches the size of an object being viewed by a guest, the size of the image data can be inversely proportional to the distance of the object from the beam splitter. In other words, the size of the image data can be reduced as the distance between the object and the beam splitter increases. As another example, the controller can determine the target position of the image data based on the parameters of an object. For example, the target position can cause the projected image data to provide a virtual image that is overlaid or overlaps the object being viewed by the guest.

[0052] In block 136, image data can be transmitted to present a virtual image to the observation portion of the show effect system. For example, the image data transmitted to the display system can be projected onto a target position on the beam splitter such that the reflective and transmissive elements overlap and coincide with each other in relation to the guest's line of sight. In another example, the image data transmitted to the display system can be offset in a direction such that some of the reflective elements do not overlap with the transmissive elements.

[0053] Alternatively, image data can be generated based on the type of object. For example, a controller can identify the type of object based on the shape of the object and / or the pattern of markers placed next to the object. The controller can identify a match between the shape of the object and / or the pattern of markers and the corresponding shape and / or corresponding marker pattern stored in memory, and determine the type of object associated with the matching shape and / or marker pattern. The controller can then identify image data associated with the type of object.

[0054] Method 130 can be performed continuously or repeatedly. For example, the controller can continuously monitor the parameters of an object in the interaction space and adjust the image data (e.g., the size of the image data, the position of the image data) based on the object's parameters. Thus, the image data can be adjusted and updated to provide a more suitable appearance based on the object's parameters.

[0055] Figure 9 is a flowchart of an embodiment of a method or process 150 for operating a show effect system to provide realistic show effects. For example, method 150 can be performed to enhance the visibility of reflective elements to a guest. In block 152, the guest's viewpoint relative to the show effect system can be determined. For example, a sensor can generate sensor data indicating the guest's position relative to the beam splitter of the show effect system. For example, a controller can determine the guest's attributes based on the sensor data, such as the guest's height, the length of the guest's arms relative to the show effect system, and / or the guest's orientation. In another example, the controller can determine the guest's perception based on the guest's eye level and / or facial features. The controller can also determine the guest's viewpoint by tracking the guest's eye movements. In one embodiment, the guest can input one or more attributes, such as color blindness, color contrast adjustment, and the guest's height. The controller can adjust the brightness level of the virtual image, the light intensity of one or more light sources, and / or the length of the cover extension. In this way, the visibility of the virtual image can be enhanced based on the guest's attributes.

[0056] In block 154, the beam splitter can be adjusted based on the guest's viewpoint. In one embodiment, the controller can instruct the actuator to adjust the orientation of the beam splitter to enhance the visibility of the reflective elements. For example, the controller can instruct the actuator to position the beam splitter at a certain angle (e.g., 45 degrees) relative to the guest's viewpoint and / or the display system to change the visibility of the reflective elements. In further or different embodiments, the controller can also adjust the position of the beam splitter (e.g., relative to the display system) to change the visibility of the reflective elements.

[0057] While only some features of the present invention have been illustrated and described herein, many modifications and changes will come to mind for those skilled in the art. Therefore, it should be understood that the appended claims are intended to cover all such modifications and changes that are part of the actual spirit of the invention.

[0058] The claimed technologies described herein refer to and apply to tangible objects and specific examples of a practical nature that are not abstract, intangible, or purely theoretical, but which certainly improve the art. Furthermore, if any of the claims appended to the end of this specification contain one or more elements designated as "...means for (performing) (a function)" or "...steps for (performing) (a function)," such elements should be interpreted in accordance with 112(f) of the United States Patent Act. On the other hand, any claim containing elements designated in any other form should not be interpreted in accordance with 112(f) of the United States Patent Act. [Explanation of Symbols]

[0059] 50 Attraction Systems 54 Guests 56 Show Effects System 58 Interaction space 60 Observation Section 64A, 64B sensors 65 Markers 66 Display Systems 68 Beam Splitter 73 Actuators 74 Controllers 76 memory 78 processors 80 Enclosures 82 First volume 84 Second volume 90 Aperture 100 physical objects 102 Identifier

Claims

1. It is a show effect system for amusement parks. Enclosure and, An interaction space within the enclosure configured to receive an object, A display system configured to present an image, An adjustable beam splitter, from the observation section, The interaction space is visible through the adjustable beam splitter, and The image is visible through the reflection from the adjustable beam splitter. An adjustable beam splitter positioned to enable this, A sensor configured to monitor the interaction space and provide sensor data related to the object in the interaction space, One or more controllers communicably coupled to the sensor and the display system, The controllers comprising the above one or more controllers are Based on the sensor data, one or more parameters of the object are determined, To generate image data based on at least one of the one or more parameters of the object, Commanding the display system to transmit the aforementioned image data, To instruct the display system to display the image based on the image data, A show effects system configured to perform actions including those mentioned above.

2. The observation section includes a further sensor configured to monitor the guest's eye movements, and the further sensor is communicably coupled to the one or more controllers and configured to transmit further sensor data indicating the guest's eye movements. The show effect system according to claim 1.

3. The adjustable beam splitter is coupled to an actuator which is communicatively coupled to one or more controllers, the one or more controllers being configured to instruct the actuator to adjust the orientation and / or position of the adjustable beam splitter relative to the display system based on the further sensor data. The show effect system according to claim 2.

4. The one or more controllers described above are: Based on the aforementioned sensor data, the size or position of the object is determined. The image is generated or adjusted based on the size or position of the object. The show effect system according to claim 1, configured as described above.

5. The enclosure includes one or more apertures that expose the interaction space to the external environment for access to the interaction space. The show effect system according to claim 1.

6. The interaction space includes one or more reflective markers, and the one or more controllers are The position of the object is determined based on at least one distance measurement between the object and at least one of the one or more reflective markers. The show effect system according to claim 1, configured as described above.

7. The one or more controllers described above are: Based on the one or more parameters of the object, the display system determines the target positions of one or more virtual images of the image to be presented on the adjustable beam splitter. The display system is instructed to present one or more virtual images based on the target position. The show effect system according to claim 1, configured as described above.

8. The one or more parameters mentioned above include the relative distance between the object and the adjustable beam splitter. The show effect system according to claim 7.

9. The object includes one of the plurality of objects in the interaction space, The show effect system according to claim 1.

10. The enclosure includes an operable cover set comprising one or more operable first covers extending over the adjustable beam splitter and one or more operable second covers on one or more sides of the enclosure, wherein the operable cover set is configured to reduce or block ambient light directed onto the adjustable beam splitter. The show effect system according to claim 1.

11. A non-temporary computer-readable medium containing instructions, wherein the instructions, when executed by one or more processors, Based on sensor data from one or more sensors that monitor the observation position of the show effect system, one or more characteristics of the observer are determined. Based on further sensor data received from one or more additional sensors monitoring the interaction area of ​​the show effect system, one or more parameters of an object located within the interaction area that is visible as a transmitted element through the beam splitter from the observation position are determined. Commanding one or more actuators to adjust the orientation or position of the beam splitter based on the sensor data, To generate image data based on the one or more parameters of the object, The system is instructed to project one or more virtual images onto the beam splitter based on the image data, so that the one or more virtual images appear from the observation position as reflective elements overlapping the transmission element via reflection from the beam splitter. A non-temporary computer-readable medium configured to cause one or more processors to perform an operation including the above.

12. When the instruction is executed by the one or more processors, Based on the further sensor data, one or more identifiers on the object are used to determine one or more types of the object. To generate the image data relating to the one or more types of the object, A non-temporary computer-readable medium according to claim 11, configured to cause one or more processors to perform an operation including the above.

13. When the instruction is executed by the one or more processors, Determining the movement of the object from a first position within the interaction area to a further position within the interaction area, Updating the image data based on the further position of the object within the interaction area, A non-temporary computer-readable medium according to claim 11, configured to cause one or more processors to perform an operation including the above.

14. Commanding the display system to project the one or more virtual images onto the beam splitter is: Commanding the first display of the display system to project the first virtual image from the one or more virtual images onto the beam splitter, Commanding the second display of the display system to project the second virtual image from the one or more virtual images onto the beam splitter, The non-temporary computer-readable medium according to claim 11, comprising the first virtual image and the second virtual image overlapping to form the reflective element.

15. When the instruction is executed by the one or more processors, Based on the aforementioned sensor data, the observer's line of sight at the observation position is determined, Commanding one or more actuators of the beam splitter to move and / or orient the beam splitter based on the observer's line of sight at the observation position, A non-temporary computer-readable medium according to claim 11, configured to cause one or more processors to perform an operation including the above.

16. An attraction system for attractions, The enclosure includes a beam splitter, One or more sensors, Controller and Equipped with, The beam splitter defines an interaction space and an observation area within the enclosure, the interaction space being configured to receive an object, and the observation area including a three-dimensional display system configured to project one or more virtual images onto the beam splitter, the beam splitter being configured to allow the object in the interaction space to be seen through the beam splitter, and the one or more virtual images projected onto the beam splitter to be seen via reflection from the beam splitter. The one or more sensors are configured to track the movement of the object placed in the interaction space. The aforementioned controller, The sensor receives sensor data from one or more of the sensors indicating the movement of the object placed in the interaction space. Image data is generated based on the movement of the object placed in the interaction space indicated by the sensor data, The three-dimensional display system is instructed to project the one or more virtual images onto the beam splitter based on the image data, so that the one or more virtual images combine to form the illusion of a three-dimensional image, and so that the one or more virtual images are visible via the reflection from the beam splitter at a first visible position based on a second visible position from which the object can be seen through the beam splitter. An attraction system configured in such a way.

17. The system comprises one or more actuators, and the controller is configured to command the one or more actuators to move and / or direct the beam splitter within the enclosure. The attraction system according to claim 16.

18. The system comprises one or more additional sensors configured to determine one or more parameters indicating the user's position relative to the beam splitter, and the controller is configured to command the one or more actuators to move and / or orient the beam splitter within the enclosure based on the user's position relative to the beam splitter. The attraction system according to claim 17.

19. The controller is configured to command the one or more actuators to rotate the beam splitter relative to the three-dimensional display system, translate the beam splitter relative to the three-dimensional display system, or both, in order to adjust the beam splitter within the enclosure based on the user's position relative to the beam splitter. The attraction system according to claim 18.

20. The controller is configured to instruct the 3D display system to project at least one of the one or more virtual images onto the beam splitter such that a first visible position where the one or more virtual images are visible via the reflection from the beam splitter overlaps with a second visible position where the object is visible through the beam splitter. The attraction system according to claim 16.

Images