Optical effect system for an attraction system

Abstract

An optical effects system (56) for an amusement park utilizes a Pepper's Ghost based effect to provide a more realistic depiction of a virtual shadow by combining visual elements of a primary area (e.g., optical effects area 58) with visual elements of a secondary area (e.g., display area 60). In particular, the optical effects system (56) detects one or more characteristics of an interactive element (68) (such as a person or object) within the primary area via a sensor (82). The one or more characteristics can include a position, an orientation, a shape, a movement, etc. of the interactive element (68). Further, the optical effects system (56) generates and / or adjusts image data including a virtual shadow based on the detected one or more characteristics. The optical effects system (56) additionally causes display of the image data within the secondary area such that an image of the virtual shadow is reflected through a beam splitter (70) and combined with an image of the interactive element (68) within the primary area.

Description

Background Technology

[0001] This section aims to introduce the reader to various aspects of the technology that may be associated with this technology, which are described and / or claimed below. This discussion is intended to help provide the reader with background information to facilitate a better understanding of the various aspects of this disclosure. Therefore, it should be understood that these statements are to be read in this light and not as an admission of prior art.

[0002] Throughout amusement parks and other entertainment venues, special effects (such as optical effects) can be used to help immerse customers in the experience of rides or attractions. Immersive environments can include three-dimensional (3D) props and sets, robotic or mechanical elements, and / or display surfaces that present media. For example, amusement parks can offer augmented reality (AR) experiences to customers. AR experiences can include presenting virtual elements to customers, and these virtual elements can provide unique special effects. Special effects enable amusement parks to offer creative ways to entertain customers, such as by presenting simulated real-world elements and the impression that customers interact with these simulated real-world elements in a convincing way.

[0003] For example, traditional amusement park attractions (e.g., performance attractions) can utilize various combinations of physical performance elements (or props), stage setups, and lighting to create a variety of visual effects from the customer's perspective. One commonly used visual effect can be called the Pepper's Ghost illusion. For example, a traditional Pepper's Ghost system can employ a main stage (main scene), secondary stages (secondary scenes), and an optical beamsplitter (e.g., a piece of glass, a screen) positioned to substantially combine images from each scene when viewed from the customer's viewpoint. Images from the secondary scenes can be reflected from the beamsplitter toward the customer (e.g., reflected from a glass surface), while images from the main scene are transmitted through the beamsplitter (e.g., transmitted through glass). Stage lighting can be controlled to illuminate aspects of the scene but not the beamsplitter. This can increase the visibility of desired scene features and limit or prevent the customer's observation of the beamsplitter itself. This creates the illusion of a physical presence on the main stage, which is actually merely a reflection from the secondary stage.

[0004] While recognized effects (such as the traditional Pepper's Illusion effect) are effective illusions, it is now recognized that these traditional effects may lack meaningful and / or realistic customer interaction. For example, customers on the main stage may interact unrealistically with aspects of secondary scenes reflected from beam splitters, thus interfering with the visual illusion of the Pepper's Illusion effect. Therefore, there is a desire for improved amusement park attraction systems that provide more realistic and interactive Pepper's Illusion illusions. Summary of the Invention

[0005] The following describes an overview of certain embodiments disclosed herein. It should be understood that these aspects are presented merely to provide the reader with a brief overview of these certain embodiments, and these aspects are not intended to limit the scope of this disclosure. In fact, this disclosure may cover many aspects that may not be described below.

[0006] In one embodiment, the optical effects system includes a sensor configured to capture sensor data from an optical effects region. A display system is configured to display an image based on the sensor data. A beam splitter is disposed between the optical effects region and an observation region such that the optical effects region is observable from the observation region through the beam splitter. The beam splitter is positioned to reflect light from the image toward the observation region. The optical effects system includes a control system configured to determine characteristics associated with a person or object in the optical effects region from the sensor data, and configured to determine an image based on said characteristics such that when the image is displayed by the display system, the image overlaps with the person or object when viewed from the observation region.

[0007] In one embodiment, a method of operating an optical effects system for a scenic spot system includes: receiving sensor data at a processing system, the sensor data including one or more characteristics of a person or object located within an optical effects area. The sensor data is received from a sensor configured to monitor the optical effects area. The method further includes: generating image data at the processing system based on the sensor data for use in a display system, wherein the image data includes virtual shadows having one or more visual characteristics corresponding to one or more characteristics of the person or object. The processing system instructs the display of the image data, wherein the image data is configured to be reflected via a beam splitter and combined with an image of the optical effects area.

[0008] In one embodiment, the attraction system of an amusement park includes an optical effects system comprising a main stage configured to house interactive elements, a secondary stage configured to house displays, sensors configured to detect one or more first characteristics associated with the interactive elements, and a control system. The control system includes a processor system configured to receive sensor data from the sensors, wherein the sensor data includes one or more first characteristics, generates image data including virtual shadows, wherein the virtual shadows include darkened silhouettes of interactive elements having one or more second characteristics corresponding to the one or more first characteristics, and causes the image data to be displayed within the secondary stage. The optical effects system also includes a beam splitter disposed between the main stage and an observation area, wherein the beam splitter is configured to reflect the display of the image data toward the observation area, and wherein the observation area is positioned such that customers of the attraction system can view the combination of the reflected display of the image data and the interactive elements. Attached Figure Description

[0009] These and other features, aspects, and advantages of this disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which the same characters throughout the drawings denote the same parts, wherein: Figure 1 This is a schematic diagram of an embodiment of an attraction system in an amusement park or theme park according to one aspect of the disclosure herein; Figure 2 This is based on one aspect disclosed in this article. Figure 1 A schematic top view of an embodiment of a tourist attraction system; Figure 3 This is based on one aspect disclosed in this article. Figure 1 A perspective view of an embodiment of a tourist attraction system; Figure 4 It is based on one aspect disclosed in this document for operation Figure 1 A flowchart illustrating an embodiment of a method or process for providing realistic virtual shadow effects via Pepper's Illusion in a scenic area system; and Figure 5 It is based on one aspect disclosed in this document for operation Figure 1 A flowchart of an embodiment of a method or process for providing realistic virtual shadow effects via Pepper's Illusion illusion in a scenic spot system. Detailed Implementation

[0010] One or more specific embodiments of this disclosure will be described below. In an effort to provide a concise description of these embodiments, not all features of the actual implementation are described in the specification. It should be understood that, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Furthermore, it should be understood that such development work may be complex and time-consuming, but will be nothing more than routine tasks of design, fabrication, and manufacturing for those skilled in the art who benefit from this disclosure.

[0011] When describing elements of various embodiments of this disclosure, the articles “a” and “described” are intended to mean the presence of one or more of the elements. The terms “comprising” and “including” are intended to be inclusive and mean that additional elements may be present in addition to those listed. Furthermore, it should be understood that references to “an embodiment” or “an embodiment” in this disclosure are not intended to be construed as excluding the existence of additional embodiments incorporating the described features.

[0012] As used herein, the terms “approximately,” “usually,” and “substantially” are intended to convey that the described attribute value may be within a relatively small range of the attribute value, as will be understood by one of ordinary skill in the art. For example, when an attribute value is described as “approximately” equal to (or, for example, “substantially similar” to) a given value, this is intended to mean that the attribute value may be within a range of + / - 5%, + / - 4%, + / - 3%, + / - 2%, + / - 1%, or even closer to the given value.

[0013] This disclosure generally relates to an attraction system comprising an improved interactive and / or responsive optical effects system for entertainment venues (e.g., theme parks, amusement parks, theaters). The optical effects system employs an effective and more realistic Pepper's Illusion effect. In particular, this disclosure relates to an optical effects system that adjusts aspects of the Pepper's Illusion effect based on the detection of interactive and / or visual information from customers to increase the perceived realism of the Pepper's Illusion illusion and thus improve the entertainment and immersive experience for customers within the attraction system.

[0014] Optical effects systems (e.g., performance effects systems, visual effects systems, optical effects generation systems) can be configured to present virtual or simulated elements that complement real-world elements via Pepper's Illusion effects. Specifically, as further discussed herein, "Pepper's Illusion" can refer to a visual effect achievable by various stage setups / lighting structures and techniques, which may include primary areas (e.g., primary stage, background scene, optical effects area), secondary areas (e.g., secondary stage, augmented reality scene), and optical beamsplitters (e.g., a piece of glass, a screen) positioned to substantially combine images from each area when viewed from a customer's viewpoint. In particular, optical beamsplitters can be arranged such that images within the primary area are viewable through and / or transmitted through the optical beamsplitter. Optical beamsplitters can also reflect images from secondary areas. Therefore, customers within the observation area can view the images in a manner that combines, superimposes, or overlaps images from the primary area (e.g., real images transmitted from the primary area through the optical beamsplitter) and images from the secondary area (e.g., virtual and / or real images reflected from the secondary area by the optical beamsplitter) relative to each other. Stage lighting can be controlled to illuminate aspects of the scene and enhance the Pepper illusion while improving the concealment of the optical beamsplitter. This can increase the visibility of desired scene features and limit or prevent observation of the optical beamsplitter itself by the audience. Thus, the Pepper illusion effect can create the illusion of the physical presence of elements (e.g., real and / or virtual elements) on the primary stage, which are actually merely reflections of elements within the secondary stage.

[0015] Embodiments of this disclosure relate to improved operation of an optical effects system that utilizes Pepper's illusion-based technology to provide a more realistic depiction of elements in a combined secondary and primary area. Specifically, images of elements in the secondary area (e.g., images on a display, projected images) can be adjusted or manipulated to depict distortions, alterations, and / or interactions based on interactions with objects and / or individuals (e.g., customers) located within the primary area. Thus, the optical effects system can increase the realism of reflective and / or refractive elements (e.g., elements reflected via a beam splitter), as viewed by other customers within the attraction system (e.g., the observation area). In other words, the optical effects system can enable visually compelling customer interaction with elements reflected via a beam splitter (e.g., virtual elements). Specifically, the optical effects system can detect the orientation (e.g., position, depth), outline (e.g., silhouette, contour, boundary), and / or movement of interactive elements (e.g., one or more customers, objects) within the main area (e.g., contained therein) of the Pepper illusion effect, and adjust the images reflected by the beam splitter associated with the secondary area based on the detected orientation (e.g., position, depth), outline (e.g., silhouette, contour, boundary), and / or movement of the interactive elements.

[0016] As an example, detected interactions by customers located within the primary area can alter the scene or enhance its visual effects (e.g., as observed by another customer). Specifically, the optical effects system can detect the orientation (e.g., position, depth), shape (e.g., silhouette), and / or movement of customers within the primary area, and generate and / or adjust images associated with secondary areas (e.g., images reflected to combine with images of the primary area) to include virtual silhouettes and / or shadows (e.g., dynamically darkened silhouettes) of customers corresponding to (e.g., mimicking, associating) the detected orientation, shape, and / or movement of the customers. As a result, a beam splitter enables virtual silhouettes and / or shadows from secondary areas to visually overlay (e.g., overlap, visually combine) customers and / or any other images in the primary area from the viewpoint of other customers positioned within the observation area of ​​the sight system.

[0017] In this way, the optical effects system can create an enhanced Pepper's Illusion illusion in which images (including virtual silhouettes and / or shadows) associated with secondary areas behave as if they physically exist within the main area and / or interact with physical (e.g., real) elements (such as customers) within the main area (e.g., respond to physical elements within the main area). In other words, the embodiments disclosed herein can enable realistic virtual shadow effects to be presented to other customers of the attraction system via Pepper's Illusion effects. Furthermore, realistic virtual shadow effects can be dynamically and / or continuously adjusted based on the detected orientation (e.g., position, depth), shape (e.g., silhouette, outline, boundary), and / or movement of interactive elements (e.g., one or more customers) within the main area.

[0018] Considering the foregoing, Figure 1 This is a schematic diagram of one embodiment of an attraction system 50 within an amusement park or theme park. The attraction system 50 is illustrated as including an observation area 52 and an optical effects system 56, in which customers 54 are positioned. The optical effects system 56 is at least partially visible from the observation area 52 and is potentially accessible. As an example, the observation area 52 may include paths (e.g., aisles, queues, lines) or open spaces through which customers 54 can traverse. As another example, the observation area 52 may include spaces (e.g., seating areas) where customers 54 can be positioned to watch performances. As a further example, the observation area 52 may include a moving vehicle that carries customers 54 through the attraction system 50.

[0019] Furthermore, the attraction system 50 may include an optical effects system 56 (e.g., a Pepper's Illusion-based system, a performance effects system, an optical effects generation system) that can provide entertainment to one or more customers 54 located in the viewing area 52 and / or within the attraction system 50. For example, the optical effects system 56 can create visual effects that can be viewed by one or more customers 54. In one embodiment, the optical effects system 56 may include an optical effects area 58 (e.g., a main area, a main stage, a background scene) that can be viewed from the viewing area 52 by one or more customers 54. As an example, the optical effects area 58 may include a stage in which one or more physical elements (e.g., physical objects, performers, another customer, props) can be positioned (e.g., included, contained) and / or a display screen on which images can be projected.

[0020] The optical effects system 56 may also include a display area 60 (e.g., a secondary area, an augmented reality scene). The display area 60 may include one or more real elements 62 (e.g., physical objects, performers, props, animated characters), one or more virtual elements 64, and / or combinations thereof. The one or more virtual elements may include images emitted via the display system 66, which may include (e.g., accommodating) a display (e.g., a screen) and / or a projector system (e.g., images projected onto a screen via a projector).

[0021] Specifically, one or more virtual elements 64 in display area 60 may include digitally rendered images displayed and / or projected within display area 60 via display system 66. As an example, in some embodiments, display area 60 may include a light field display (in which three-dimensional (3-D) images can be projected), a projector, or other means configured to cause the display of one or more virtual elements 64 (e.g., a display, a backlit display, one or more LED displays, an LCD display, an OLED display). For example, display area 60 may include a display array or surface (e.g., an array of lenses) that can manipulate how light converges, focuses, and / or is directed. For example, the display array may cause light to be focused at different locations, such as at different depths relative to the viewpoint of customer 54. Manipulation of light properties may give an image projected onto or via the display array the appearance of layers, contours, and / or textures, thereby forming a 3-D contour for the projected image.

[0022] Alternatively or alternatively, display area 60 may include different displays, such as two-dimensional (2-D) displays and / or 3-D displays that do not use light field displays. In such embodiments, one or more virtual elements 64 may be projected based on a defined field of view of one or more customers 54, such as based on the eye position of the customers 54 to present an accurate appearance of the reflection of the virtual element 64 as seen from the perspective of one or more customers 54. Alternatively or alternatively, multiple viewpoints of one or more virtual elements 64 may be presented, and time-multiplexed images (e.g., synchronized refresh of images and alternating illumination of images from different viewpoints) may be utilized to simultaneously provide different viewpoints of one or more virtual elements 64 (e.g., to multiple customers 54 positioned at different locations in viewing area 52). In some embodiments, display area 60 may include a projector or other device (e.g., a display) configured to display one or more virtual elements 64 within display area 60.

[0023] One or more real elements 62 can represent any number of real-world objects. As discussed herein, the images of one or more real elements 62 can be projected toward or onto a beamsplitter (e.g., beamsplitter 70) and perceived by one or more clients 54 as reflections of one or more real elements 62 (e.g., reflective elements 72). The reflections of one or more real elements 62 can overlap with optical effects areas 58 (e.g., interactive elements 68) such that the one or more real elements 62 appear as if they physically exist (e.g., coexist) within optical effects areas 58. Additionally, optical effects system 56 (e.g., via control system 76) can adjust the appearance of one or more virtual elements 64 based on the one or more real elements 62. As an example, optical effects system 56 can adjust the appearance of one or more virtual elements 64 to simulate interaction between one or more virtual elements 64 and one or more real elements 62. Furthermore, as discussed in more detail below, the optical effects system 56 can adjust the appearance of one or more virtual elements 64 to simulate the interaction or combination between the reflected virtual elements 64 and / or one or more real elements 62 and any object and / or person (e.g., a customer) located in the optical effects area 58. It should be understood that in some embodiments, the optical effects system 56 may not include one or more real elements 62 within the display area 60, and thus produce a virtual shadow effect through the virtual elements 64 displayed by the display system 66.

[0024] Alternatively or concurrently, in some embodiments, the display system 66 includes a projector, and the control system 76 is configured to adjust the appearance (e.g., angle, distortion, bending, projection mapping) of one or more virtual elements 64 based on the position of the projector relative to one or more real elements 62 (e.g., real walls). For example, the projector may be configured to project one or more virtual elements 64 onto one or more real elements 62, and thus adjusting the angle, appearance, distortion, bending, or any combination thereof of one or more virtual elements 64 (e.g., image data) based on the position of the projector (e.g., via the control system 76) can provide a more realistic appearance of one or more reflective elements 74 based on a combination of both virtual elements 64 and one or more real elements 62 in the display area 60.

[0025] Additionally, in some embodiments, the display area 60 may not be directly visible from the viewing area 52 to one or more customers 54. For example, as further discussed herein, a partition (e.g., a wall, panel, screen) may be positioned to block one or more customers 54 from directly seeing the display area 60 from the viewing area 52. In one embodiment, the display area 60 may be raised and positioned behind or above the viewing area 52. Similarly, the display area 60 may be positioned below the viewing area 52 or within a recess relative to the viewing area 52.

[0026] continue Figure 1 The physical or real-world elements positioned within the optical effects area 58 may include one or more interactive elements 68 (e.g., performers, another customer, props, objects, animated characters). Additionally, the optical effects system 56 may be configured to provide a visual illusion effect in which the interactive elements 68 appear as if they are interacting with (e.g., responding to, reacting to) the real elements 62 and / or virtual elements 64 of the display area 60 and / or residing in the same space as (e.g., coexisting with) the real elements 62 and / or virtual elements 64 of the display area 60. Conversely, the visual illusion effect can cause the real elements 62 and / or virtual elements 64 of the display area 60 to appear as if they are interacting with and / or coexisting with the interactive elements 68 of the optical effects area 58.

[0027] For this purpose, the optical effects system 56 (e.g., optical effects area 58) may include a beam splitter 70 (partially reflective surface) positioned to combine images from the optical effects area 58 with images from the display area 60. For example, from the viewing area 52, one or more customers 54 may perceive one or more physical elements (e.g., including interactive elements 68, physical objects, background scenes, performers, props, and / or displays) located within the optical effects area 58 as transmitted through or visible through the beam splitter 70 as one or more transmissive elements 72. In other words, one or more customers 54 may see and directly view the transmissive elements 72 associated with the physical elements located in the optical effects area 58 through the beam splitter 70. Furthermore, one or more customers 54 may perceive one or more real elements 62 and / or one or more virtual elements 64 of the display area 60 as reflected elements 74 reflected from the beam splitter 70 toward the viewing area 52. That is, one or more customers 54 can see the reflections of one or more real elements 62 and / or one or more virtual elements 64 via beam splitter 68. Specifically, the lighting in the attraction system 50 (e.g., in display area 60) can cause images of one or more real elements 62 and / or one or more virtual elements 64 of display area 60 to be projected toward or onto beam splitter 70 for reflection toward viewing area 52, and beam splitter 70 can be oriented such that one or more reflecting elements 74 (e.g., reflections of one or more real elements 62 and / or one or more virtual elements 64) can appear physically positioned within optical effect area 58. In other words, one or more reflecting elements 74 can appear to overlap (e.g., combine with, cover, or be adjacent to) transmissive elements 72.

[0028] As an example, the beam splitter 70 can be angled (e.g., at approximately 45 degrees) relative to the line of sight of one or more customers 54 toward the optical effect area 58 and / or relative to the projection of one or more real elements 62 and / or one or more virtual elements 64 from the display area 60 toward the beam splitter 70. Furthermore, the beam splitter 70 can be made of a material (such as glass, plastic, foil, and / or a translucent mirror) that includes both transmissive and reflective properties to enable viewing of the transmissive elements 72 of the optical effect area 58 through the beam splitter 70, as well as viewing of the reflective elements 74 associated with the one or more real elements 62 and / or one or more virtual elements 64 of the display area 60 (such as reflective elements 74 reflected from the beam splitter 70).

[0029] like Figure 1 The real elements 62 and / or virtual elements 64 illustrated within the reflective elements 74 are depicted with dashed lines to indicate that the real elements 62 and / or virtual elements 64 in the display area 60 merely appear to exist within the optical effect area 58, but are actually reflections of the real elements 62 and / or virtual elements 64 within the display area 60. The combined image of the transmissive elements 72 and reflective elements 74 in the optical effect area 58 can provide a unique viewing experience for one or more customers 54. For example, movement, adjustment, or any other change to the real elements 62 and / or virtual elements 64 in the display area 60 can cause corresponding changes in the reflective elements 74 in the optical effect area 58.

[0030] As an example, one or more real elements 62 and / or one or more virtual elements 64 in display area 60 can be adjusted (e.g., based on detected characteristics associated with interactive element 68 and / or optical effect area 58) to simulate the interaction between one or more reflective elements 74 and one or more transmissive elements 72 in optical effect area 58. Additionally, one or more real elements 62 and / or one or more virtual elements 64 can be adjusted to achieve a more realistic appearance of the combination and / or interaction of one or more reflective elements 74 and one or more transmissive elements 72. Furthermore, in one embodiment, the one or more reflective elements 74 visible to one or more customers 54 may also include certain attributes, properties, or characteristics (e.g., one or more visual characteristics). Additionally, the one or more reflective elements 74 may have transparent or translucent properties. For example, one or more transmissive elements 72 and / or another physical element (e.g., interactive element 74) in optical effect area 58 may appear to be at least partially visible through the one or more reflective elements 74. Therefore, the appearance of (one or more) reflective elements 74 may differ from the direct viewing appearance of (one or more) real elements 62 and / or (one or more) virtual elements 64 within the display area 60.

[0031] In addition, the optical effects system 56 may include a control system 76 (e.g., an automation controller, a programmable logic controller, an electronic controller) configured to operate to adjust the experience provided to one or more customers 54 via the optical effects system 56. The control system 76 may include a memory 78 and a processing system 80 (e.g., a processor, a processor system, a processing circuitry system, a system of processors). The memory 78 may include volatile memory (such as random access memory (RAM)) and / or non-volatile memory (such as read-only memory (ROM), optical disc drives, hard disk drives, solid-state drives, or any other non-transitory computer-readable medium including instructions). The processing system 80 may be configured to execute such instructions. For example, the processing system 80 may include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof. In some instances, the control system 76 may include one or more controllers communicatively coupled, and these controllers may perform the actions described herein individually or collectively. Alternatively or additionally, the control system 76 may include one or more processing systems 80 and / or one or more memories 78 that may perform the actions described herein individually or collectively.

[0032] In some embodiments, the control system 76 may be communicatively coupled to components of the display area 60 (e.g., one or more real elements 62 and / or the display system 66). For example, the control system 76 may operate to provide one or more virtual elements 64 to the display system 66. As an example, the control system 76 may transmit image data to the display system 66 to cause the display system 66 to display one or more virtual elements 64 based on the image data. Alternatively or additionally, the control system 76 may adjust and update the image data provided to the display system 66 to adjust the appearance of one or more virtual elements 64, which causes a corresponding adjustment to the appearance of one or more reflective elements 74 in the optical effect area 58. In particular, the control system 76 may transmit image data to the display system 66 that results in perceived movement (such as relative to one or more transmissive elements 72) of one or more reflective elements 74 in the optical effect area 58. As another example, the control system 76 may adjust and update the image data provided to the display system 66 based on detected orientation, shape, and / or movement of interactive elements 68. Therefore, the appearance (e.g., orientation, shape, movement, color, form) of the resulting (one or more) reflective elements 74 (such as virtual element 64) can be changed based on the detected orientation, shape, and / or movement of the interactive element 68.

[0033] The optical effects system 56 may include a sensor 82 communicatively coupled to the control system 76. In some embodiments, the sensor 82 may be disposed within and / or oriented toward the optical effects region 58. Additionally, the sensor 82 may be configured to detect the interactive element 68, one or more attributes associated with the interactive element 68 (e.g., characteristics, visual characteristics), and / or one or more attributes associated with the optical effects region 58, or any combination thereof, as sensor data. Furthermore, the sensor 82 is configured to transmit (e.g., transfer) the sensor data to the control system 76. For example, the sensor 82 may be a light sensor, an image sensor (e.g., a camera, a 3D camera), an orientation sensor, a motion sensor, a depth sensor, or any combination thereof. In some embodiments, the sensor data may include information indicating the detected orientation, shape, and / or movement of an element (e.g., an object, a customer, the interactive element 68) within the optical effects region 58. For example, the sensor 82 may detect (e.g., track) the orientation, shape, and / or movement of one or more interactive elements 68 within the optical effects region 58 and transmit the sensor data to the control system 76. The control system 76 can be configured to generate image data based on received sensor data. As a result, one or more virtual elements 64, displayed via the display system 66 and reflected via the beam splitter 70, have an enhanced realistic appearance (as perceived by the viewpoint of the viewing area 52). In particular, as discussed herein, when viewed by the customer 54, the reflected virtual elements 64 are combined (e.g., overlaid, superimposed, overlapped) with the transmissive elements 72 via the beam splitter 70 as a composite image.

[0034] This embodiment provides a dynamic optical effects system 56 that monitors one or more interactive elements 68 within an optical effects area 58 (e.g., the main stage of the Pepper's Illusion effect) to generate and / or adjust one or more virtual elements 64, which are associated, corresponded, interacted with, and / or responded to by the detected positioning and / or movement of the interactive elements 68. Therefore, when the virtual elements 64 are reflected via a beam splitter 70 and combined with one or more transmissive elements 72 within the optical effects area 58, the resulting combined image is a more realistic Pepper's Illusion illusion that enhances the immersive nature of the attraction and improves the overall customer experience.

[0035] The optical effects system 56 may include an illumination system 84 (e.g., an illumination effects system, a projector system) communicatively coupled to and / or operated by the control system 76. In some embodiments, the illumination system 84 may include one or more light sources 86. The light sources 86 may include one or more real light sources such that they can emit light. In some embodiments, the light sources 86 may include one or more artificial light sources (e.g., one or more virtual light sources, one or more digital light sources, one or more artificial light sources) because the light sources 86 may include the appearance of an object that can emit light (such as a lamp, lantern, flashlight, etc.) and are further combined with one or more virtual or digital light sources. Specifically, the artificial light sources 86 may include the appearance of an object that can emit light, or the artificial light sources 86 may emit a relatively small amount of light, and the optical effects system 56 may display a beam of light (e.g., via one or more virtual light sources of the display / projection system 66), which is then combined with the artificial light sources 86 via a beam splitter 70 to appear as if the beam is being emitted from the artificial light sources 86. As another example, in some embodiments, one or more artificial light sources 86 may consist entirely of one or more virtual elements 64 displayed via a display / projection system 66 and combined with one or more transmission elements 72 via a beam splitter 70.

[0036] Furthermore, in some embodiments, the lighting system 84 may be communicatively coupled to and controlled via the control system 76. For example, the control system 76 may transmit instructions to the lighting system 84 to turn on and / or off the light emitted by one or more light sources 86, change the direction of the light emitted by one or more light sources 86, change the color, brightness, and / or appearance of the light emitted by one or more light sources 86, or any combination thereof. One or more of the light sources 86 may be positioned within the optical effect area 58 (e.g., behind the beam splitter 68, relative to the viewpoint of the customer 54 within the viewing area 52, such as...). Figure 2 (As illustrated in the diagram). One or more of the (one or more) light sources 86 can be positioned close to the observation area 52 and oriented toward the optical effect area 58 (e.g., in front of the beam splitter 68 relative to the line of sight of the customer 54, as shown in the diagram). Figure 2(As illustrated in the figure). Furthermore, in some embodiments, one or more of the light sources 86 may be static (e.g., held in a fixed orientation within the optical effect area 58). One or more of the light sources 86 may be dynamic, as they may move through the optical effect area 58. Additionally, one or more of the light sources 86 may be located co-located with or separately from the sensor 82. In any case, the lighting system 84 may be configured to facilitate the creation of the illusion of light emanating towards the optical effect area 58, such as light that can cause shadows when one or more interactive elements 68 positioned within the optical effect area 58 are in the path of the light.

[0037] In one embodiment, the display system 66 includes a projector configured to project a virtual shadow corresponding to an interactive element 68 positioned within an optical effect area 58. As discussed herein, sensor 82 detects characteristics such as the orientation, shape, movement, or any combination thereof of the interactive element 68. Additionally, control system 76 can receive the detected orientation, shape, movement, or any combination thereof of the interactive element 68 from sensor 82 as sensor data. Furthermore, control system 76 is configured to generate the virtual shadow based on the sensor data. The projector can be positioned within display area 60 at a location corresponding to the orientation of sensor 82 toward optical effect area 58. When the virtual shadow is reflected via beam splitter 70 and displayed such that it overlaps with the interactive element 68, it can appear (e.g., when viewed from viewing area 52) as a realistic shadow of the interactive element 68 within optical effect area 58. From the perspective of one or more customers 54, the virtual shadow can appear as if it were a real-world shadow of the interactive element 68.

[0038] For example, sensor 82 can be positioned at a distance and / or at an angle relative to a location (e.g., a virtual location, a location perceived from the viewpoint of customer 54 in observation area 52), where reflective element 74 can be visually present within optical effect area 58. Similarly, projector can be positioned at a distance and / or at an angle relative to projector screen (on which virtual shadows can be projected within display area 60), and the distance and / or angle of sensor 82 can be substantially the same as the distance and / or angle of projector.

[0039] The lighting system 84 can also be operated to provide dynamic stage lighting within the optical effects area 58 to improve the visual realism of the virtual shadow effect. For example, the control system 76 can (e.g., indicate, operate) the lighting system 84 to produce a light curtain effect, such that interactive elements 68 can be illuminated or de-illuminated (e.g., darkened) based on the orientation and / or depth of (one or more) interactive elements 68 within the optical effects area 58 (e.g., in the foreground compared to the background of the optical effects area 58). The position of the transition between the foreground and background of the optical effects area 58 can correspond to the position of (one or more) reflective elements 74 (such as virtual walls and / or virtual shadows). As a result, when (one or more) interactive elements 68 are positioned in front of the position of (one or more) reflective elements 74 (e.g., virtual walls and / or virtual shadows) relative to the line of sight 104 of (one or more) customers 54 within the viewing area 52, (one or more) interactive elements 68 can be illuminated and thus more visible (e.g., more visible to (one or more) customers 54 in the viewing area 52). Additionally, when one or more interactive elements 68 are positioned behind the location of one or more reflective elements 74 within the optical effects area 58, the interactive elements 68 may not be illuminated and / or may be dimmed. In this way, virtual elements 64 (such as virtual shadows) are reflected via beam splitter 70 and combined with one or more transmissive elements 72 within the optical effects area 58 (e.g., one or more interactive elements 68), and the resulting combined image is a more realistic virtual shadow effect. In other words, when one or more interactive elements 68 approach and pass through the location of virtual walls and / or virtual shadows within the optical effects area 58, one or more customers 54 within the viewing area 52 may perceive the interactive elements 68 as passing through physical walls within the optical effects area 58.

[0040] Continuing with the example above, the control system 76 can receive sensor data from sensor 82 and identify and / or isolate the shape (e.g., boundary, outline, silhouette, edge) of the interactive element 68 detected within the optical effect area 58. Specifically, the control system 76 can determine silhouette data corresponding to the shape of the detected interactive element 68 from the sensor data. In some embodiments, the control system 76 can additionally identify the orientation (e.g., position, depth) of the interactive element 68 relative to and / or within the optical effect area 58 based on the sensor data. Furthermore, the control system 76 can transmit image data (e.g., image data generated based on the sensor data provided by sensor 82) to the display system 66 to generate virtual element 64. For example, the control system 76 can utilize image analysis techniques (e.g., computer vision, image recognition) to determine (e.g., detect) one or more characteristics associated with the interactive element 68 within the optical effect area 58 (e.g., size, shape, orientation, movement, orientation, type, or any combination thereof of the interactive element 68). In some embodiments, the control system 76 may further identify or determine corresponding characteristics (e.g., visual characteristics, size, shape, type, orientation, movement, or direction) of the image data to be transmitted to the display system 66 based on one or more determined characteristics associated with the interactive element 68. For example, the control system 76 may identify the shape of the interactive element 68 and generate image data of a virtual shadow corresponding to the shape of the interactive element 68. The virtual shadow may include a dynamically darkened silhouette image of the interactive element 68 and may be a visual representation of the interactive element 68 corresponding to the determined characteristics associated with the interactive element 68.

[0041] Additionally, the control system 76 can determine the orientation of the interactive element 68 within the optical effect area 58 and generate image data with corresponding orientation of a virtual shadow, which creates the illusion of a realistic shadow of the interactive element 68 when the virtual shadow is combined with the interactive element 68 via the beam splitter 70. In some embodiments, a portion of the virtual shadow may overlap and / or intersect with a portion of the interactive element 68. Specifically, to generate a realistic shadow effect, the control system 76 can determine the orientation of the interactive element 68 and determine the corresponding projection orientation of the virtual element 64 to provide the desired appearance of the reflective virtual element 64 in coordination with the interactive element 68. In some embodiments, the control system 76 can determine the orientation of the interactive element 68 based on a grid pattern of markers positioned within the optical effect area 58. In some embodiments, the sensor 82 may be a depth sensor, such as a LiDAR sensor and / or a near-infrared (NIR) sensor, which can detect orientation information of the interactive element 68 within the optical effect area 58 (e.g., the position and / or depth of the interactive element 74).

[0042] The control system 76 can receive or determine the orientation of one or more light sources 86 relative to the optical effect area 58. Specifically, the control system 76 can receive or determine the orientation of one or more light sources 86 configured to create the illusion of virtual shadows for the interactive effect 68. The control system 76 can receive orientation data of one or more light sources 86 stored in the memory 78. When fixed, the orientation data of one or more light sources 86 within the optical effect system 56 and / or the spotlight system 50 can be known and stored in the memory 78. One or more of the light sources 86 can be dynamic light sources, and the control system 76 can receive orientation data or indications of orientation data of one or more light sources 86 from the lighting system 84 and / or the one or more light sources 86. The one or more dynamic light sources 86 may include position sensors configured to transmit orientation information of the one or more light sources 86 to the control system 76. The light source 86 may include one or more virtual light sources, and as discussed in more detail below, the control system 76 may determine the orientation information of one or more virtual light sources based on the 3D scene rendered from and corresponding to the optical effect area 58.

[0043] Based on orientation data associated with interactive element 68 and / or received sensor data, as well as orientation data associated with one or more light sources 86, control system 76 can determine one or more virtual elements 64 to be displayed via display system 66. As discussed in more detail below, control system 76 can generate image data including virtual shadows to be displayed in display area 60, and thus visualized via one or more reflective elements 74 within optical effect area 58. Image data may include characteristics of the virtual shadows (e.g., deformation, angle, size, shape, profile, movement, orientation) based on orientation data associated with one or more interactive elements 68 and / or received sensor data, as well as orientation data associated with one or more light sources 86. Furthermore, control system can determine the characteristics of the virtual shadows within the image data by comparing the orientation data associated with one or more interactive elements 68 and / or sensor data with the orientation data associated with one or more light sources 86. Specifically, when the orientation of one or more interactive elements 68 changes relative to the orientation of one or more light sources 86, the control system 76 can adjust the image data to generate virtual shadows. These virtual shadows include the orientation (e.g., from the viewpoint of the observation area 52), size, shape, angle (e.g., relative to one or more interactive elements 68), deformation, or any combination thereof, relative to the orientation and characteristics of the one or more interactive elements 68 relative to the light source 86. As an example, when one or more interactive elements 68 move within the optical effect area 58 and the distance between one or more interactive elements 68 and one or more light sources 86 increases, the control system 76 can adjust or update the image data such that the resulting displayed virtual shadow increases in size.

[0044] In this manner, this embodiment provides a dynamic optical effects system 56 that monitors (e.g., tracked via sensor 82) one or more interactive elements 68 and one or more light sources 86 within an optical effects area 58 (e.g., the main stage of the Pepper's Illusion effect) to generate one or more virtual elements 64 (such as virtual shadows), which are associated, correspond to, interact with, and / or respond to the detected positioning and / or movement of the one or more light sources 86 and / or the one or more interactive elements 68. Therefore, when the virtual shadows are reflected via beam splitter 70 and combined with one or more transmissive elements 72 within the optical effects area 58, the resulting combined image is a more realistic Pepper's Illusion.

[0045] Figure 2 It is based on one aspect of this disclosure. Figure 1A schematic top view of one embodiment of the attraction system 50. Specifically, the attraction system 50 includes an observation area 52 in which one or more customers 54 are positioned, and an optical effects system 56. The optical effects system 56 is configured to provide a virtual shadow effect visible from the observation area 52 by the one or more customers 54 via Pepper's Illusion. The optical effects system 56 may include an optical effects area 58 and a display area 60. The display area 60 includes one or more real elements 62, a display system 66 configured to display one or more virtual elements 64, or any combination thereof. The optical effects area 58 may include one or more physical elements (such as interactive elements 68) and is configured to provide a visual illusion effect in which the interactive element 68 appears as if it is interacting with one or more real elements 62 and / or one or more virtual elements 64 of the display area 60 and / or residing in the same space as the one or more real elements 62 and / or one or more virtual elements 64. Conversely, in the aforementioned visual illusion effect, the visual illusion effect can make one or more real elements 62 and / or one or more virtual elements 64 of the display area 60 appear as if they are interacting with and / or coexisting with one or more interactive elements 68 of the optical effect area 58. For this purpose, the optical effect system 56 (e.g., the optical effect area 58) may include a beam splitter or partial reflective surface 70, which is positioned to combine the image from the optical effect area 58 with the image from the display area 60.

[0046] From the observation area 52, one or more customers 54 can perceive one or more physical elements (such as one or more interactive elements 68) positioned within the optical effect area 58 as one or more transmissive elements 72 transmitted or visible through the beam splitter 70. In other words, one or more customers 54 can see and directly view the transmissive elements 72 associated with the physical elements positioned in the optical effect area 58 through the beam splitter 70. Furthermore, one or more customers 54 can perceive one or more real elements 62 and / or one or more virtual elements 64 of the display area 60 as one or more reflective elements 74 reflected from the beam splitter 70 toward the observation area 52. That is, one or more customers 54 can see the reflections of one or more real elements 62 and / or one or more virtual elements 64 via the beam splitter 70. Specifically, the lighting in the attraction system 50 (e.g., in the display area 60) can cause images of one or more real elements 62 and / or one or more virtual elements 64 of the display area 60 to be projected toward and reflected from the beam splitter 70 in a first direction 100 (e.g., bounced back from the beam splitter 70), and projected toward the viewing area 52 in a second direction 102 (e.g., as one or more reflective elements 74). Furthermore, the beam splitter 70 can be oriented such that one or more reflective elements 74 (e.g., reflections of one or more real elements 62 and / or one or more virtual elements 64) appear to be physically positioned within the optical effect area 58. In other words, one or more reflective elements 74 can appear to overlap, interact with, and / or respond to the orientation, orientation, and / or movement of one or more transmissive elements 72.

[0047] like Figure 2 As illustrated, the beam splitter 70 can be angled (e.g., at approximately 45 degrees) relative to the line of sight 104 of one or more customers 54 toward the optical effect area 58 and / or relative to the projection of one or more real elements 62 and / or one or more virtual elements 64 from the display area 60 toward the beam splitter 70 in the first direction 100. Figure 2 One or more real elements 62 and / or one or more virtual elements 64 within the reflective element 74 are depicted with dashed lines to indicate that the one or more real elements 62 and / or one or more virtual elements 64 in the display area 60 merely appear to be physically present in the optical effect area 58, but are actually reflections of the one or more real elements 62 and / or one or more virtual elements 64 within the display area 60.

[0048] Figure 2The optical effects system 56 is configured to present virtual shadow effects corresponding to one or more interactive elements 68 (e.g., another customer, object) within the optical effects area 58. In other words, one or more customers 54 viewing the optical effects area 58 within the viewing area 52 can perceive something that appears to be a realistic, physically present shadow of one or more interactive elements 68. Additionally, in some embodiments, the optical effects system 56 can present an illusion in which one or more interactive elements 68 appear (e.g., from the perspective of one or more customers 54 in the viewing area 52) to pass through (e.g., walk through, proceed through) the walls within the optical effects area 58. Specifically, one or more real elements 62 of the display area 60 may include real-world walls, and one or more virtual elements may include virtual shadows generated and adjusted to correspond to one or more interactive elements 68, as discussed herein. Therefore, the control system 76 can be configured to provide image data of virtual shadows to be displayed and / or projected onto real-world walls. The virtual shadows and the images of the real-world walls can then be reflected via beam splitter 70 toward one or more customers 54 within the viewing area 52. The reflections of the virtual shadows and the real-world walls can appear as if they actually exist within the optical effects area 58.

[0049] Real-world walls can be relatively flat and / or may include portions with more complex geometries that project images, such as doors, windows, brick, stone, and / or vegetation. Control system 76 may use projection mapping techniques to account for the more complex shapes and / or surfaces of real-world walls. Display / projection system 66 may include multiple projectors positioned at various angles relative to the real-world wall to cover the surface of the real-world wall with projected images (e.g., virtual shadows).

[0050] The control system 76 can be configured to provide image data of virtual walls and virtual shadows to the display system 66, and the virtual walls together with the virtual shadows can be displayed and / or projected via the display / projection system 66. The images of the virtual walls and virtual shadows can then be reflected and appear as if they physically exist within the optical effect area 58.

[0051] The control system 76 can adjust and / or update the image data provided to the display system 66 to adjust the appearance of the virtual walls and / or virtual shadows, causing a corresponding adjustment in the appearance of the virtual walls and / or virtual shadows as they are reflected toward one or more customers 54 in the viewing area 52 via the beam splitter 70. In other words, the virtual walls and / or virtual shadows can appear and / or be perceived as changing, moving, and / or visually adjusting in a realistic manner, which can correspond to detected movement and / or positioning of one or more interactive elements 68 within the optical effect area 58 (as discussed herein). As an example, the control system 76 can adjust and / or update the image data provided to the display system 66 based on the detected orientation, shape, and / or movement of one or more interactive elements 68, and thus adjust the displayed and reflected virtual walls and / or virtual shadows. For this purpose, the appearance of the resulting reflected virtual walls and / or virtual shadows can change based on the detected orientation, shape, and / or movement of one or more interactive elements 68.

[0052] The optical effects system 56 may include one or more sensors 82 communicatively coupled to the control system 76 and configured to track and / or detect (e.g., measure) the orientation, shape, and / or movement of one or more interactive elements 68 within the optical effects area 58. The sensors 82 may be positioned within and / or oriented toward the optical effects area 58. Additionally, the sensors 82 may be configured to track and / or detect one or more attributes associated with the interactive elements 68, one or more attributes associated with the optical effects area 58, or any combination thereof, as sensor data. For example, one or more attributes may include orientation, shape, texture, form, size, position, depth, movement, color, identification information, orientation, or any combination thereof.

[0053] Furthermore, one or more sensors 82 are configured to send (e.g., transmit) sensor data to the control system 76. For example, one or more sensors 82 may be light sensors, image sensors (e.g., cameras, 3D cameras), orientation sensors, motion sensors, depth sensors, radio frequency (RF) sensors (e.g., near-field (NF) communication sensors), global positioning system (GPS) sensors, or any combination thereof. In some embodiments, the sensor data may include information indicating the detected orientation, shape, and / or movement of the interactive element 68 within the optical effect area 58. For example, sensor 82 may detect and / or track the orientation, shape, and / or movement of one or more interactive elements 68 and transmit the sensor data to the control system 76. The control system 76 may receive the sensor data and is configured to generate image data associated with virtual walls and / or virtual shadows based on the received sensor data. More specifically, the control system 76 may use imaging techniques to detect the edges and / or shape of the interactive element 68 within the sensor data. Additionally, the control system 76 can be configured to generate image data including a portion of the resulting display image located inside the detected edge, which is darker (e.g., darker in color) than the rest of the resulting display image. Therefore, the resulting display image based on the image data can appear as if it were a shadow with a shape corresponding to the shape of the interactive element 68. Furthermore, the edges of the shape can be adjusted or modified to correspond to the type of lighting within the optical effect area 58. For example, the control system 76 can generate image data of a virtual shadow, where the edges of the virtual shadow are blurred and / or sharp (depending on the type of lighting and the expected shadow to be projected). As a result, the virtual wall and / or virtual shadow displayed via the display system 66 and reflected via the beam splitter 70, combined with the interactive element(s) 68, create an enhanced, realistic shadow effect, as perceived by the viewpoint of one or more customers 54 within the viewing area 52.

[0054] Throughout the rest of the discussion below, the term virtual wall is used for two embodiments: a reflective element 74 comprising a real-world wall located in display area 60 and reflected via beam splitter 70, and a reflective element 74 comprising an image of the wall displayed in display area 60 (e.g., via display system 66) and reflected via beam splitter 70. In either embodiment, the reflected image of the wall appears to physically exist within optical effects system 58, and will therefore be referred to as a virtual wall.

[0055] Furthermore, as discussed herein, the reflected virtual walls and / or virtual shadows are combined (e.g., covered, superimposed, or overlapped) with (one or more) interactive elements 68 and / or other physical elements (e.g., one or more transmissive elements 72) of the optical effects area 58 via beam splitter 70 as a combined image viewed by a customer 54 within the observation area 52. Therefore, this embodiment provides a dynamic optical effects system 56 that monitors (one or more) interactive elements 68 within the optical effects area 58 to generate realistic virtual walls and / or virtual shadows that are associated with, correspond to, interact with, and / or respond to the positioning and / or movement of (one or more) interactive elements 68. Therefore, when the virtual wall and / or virtual shadow are reflected via beam splitter 70 and combined with one or more interactive elements 68 within the optical effects area 58, the resulting combined image is a more realistic Pepper's Illusion that appears (e.g., from the perspective of one or more customers 54 in viewing area 52) close to, through, or combined with the real-world wall and the interactive elements 68, which appear physically present within the optical effects area 58. Specifically, in some embodiments, the virtual shadow may cover and / or overlap with the virtual wall in a visually realistic manner, mimicking real-world shadows cast from one or more interactive elements 68 onto the real-world wall. In this way, the current virtual shadow effect provided by the optical effects system 56 improves the immersive nature of the attraction and enhances the overall customer experience within the attraction system 50.

[0056] Furthermore, the lighting system 84 can be communicatively coupled to and controlled via the control system 76. For example, the control system 76 can transmit commands to the lighting system 84 to activate and / or deactivate light emitted by one or more light sources 86, adjust the direction of light emitted by one or more light sources 86, adjust the orientation of one or more light sources 86, change the color, brightness, and / or appearance of light emitted by one or more light sources 86, or any combination thereof. As an example, the color of one or more virtual light sources can be adjusted to correspond to the desired color of light to be emitted by one or more artificial light sources 86. Figure 2 As illustrated, one or more of the light sources 86 may be positioned within the optical effect area 58 (e.g., behind the beam splitter 70, relative to the line of sight 104 of the customer 54 within the viewing area 52). Alternatively, one or more of the light sources 86 may be positioned close to the viewing area 52 and oriented toward the optical effect area 58 (e.g., in front of the beam splitter 70, relative to the viewpoint of the customer 54, such as...). Figure 2(As illustrated in the diagram). One or more of the light sources 86 may be static, dynamic, located alongside or separately from the sensor 82. In any case, the lighting system 84 may be configured to facilitate the creation of the illusion of emitted light (e.g., bright light) directed toward the optical effect area 58, such that one or more interactive elements 68 located in the path of the emitted light can be expected to cast shadows. In particular, in some embodiments, the optical effect system 56 may produce the illusion that one or more interactive elements 68 are positioned between the one or more light sources 86 and a virtual wall, such that one or more interactive elements 68 can be expected to cast shadows (e.g., virtual shadows) on the virtual wall.

[0057] From the customer's perspective, the detected orientation of one or more interactive elements 68 relative to the orientation or position of one or more reflective elements 74 (e.g., virtual walls) can also be used to determine the duration for which the virtual shadow is displayed. For example, when one or more interactive elements 68 pass through the virtual wall, the control system 76 can cause the display system 66 to stop displaying the virtual shadow on the virtual wall. Specifically, the optical effects system 56 may include a depth sensor (e.g., a 3D camera) configured to detect the depth and / or orientation of the interactive elements 68. Furthermore, the control system 76 may be configured to receive 3D data (such as the depth and / or orientation of the interactive elements 68) and adjust the image data based on the depth and / or orientation to exclude the virtual shadow. For example, a threshold depth and / or orientation may be determined based on the position or orientation of one or more reflective elements 74 (e.g., virtual walls and / or virtual shadows) within the optical effects area 58, as perceived by the viewpoint of the customer 54 within the viewing area 52. Furthermore, when the depth and / or orientation of the interactive element 68 is less than a threshold depth and / or orientation, the control system 76 can generate image data to include a virtual shadow, and when the depth and / or orientation of the interactive element 68 is greater than the threshold depth and / or orientation, the control system 76 can adjust the image data to exclude the virtual shadow. In other words, when one or more interactive elements 68 pass through the virtual wall and appear to enter the background of the optical effect area 58, the customer 54 will not view the virtual shadow corresponding to the one or more interactive elements 68. In some embodiments, the position or orientation of the one or more reflective elements 74 (e.g., the perceived orientation of the reflected virtual wall within the optical effect area 58 viewed by the customer 54) can be determined by the control system 76 based on three-dimensional (3D) digital rendering (e.g., 3D digital representation) of the optical effect area 58, such as the orientation of the virtual wall displayed in the display area 60 relative to the orientation of the projector displaying the virtual wall, such as the orientation of the virtual wall displayed in the display area 60 relative to the beam splitter 70, or any combination thereof.

[0058] Figure 3 It is based on one aspect of this disclosure. Figure 1 A perspective view of an embodiment of the attraction system 50. Specifically, Figure 3 The illustration shows a view of the optical effects area 58 from the perspective of one or more customers 54 within the observation area 52. The optical effects area 58 includes one or more interactive elements 68, a light source 86, and virtual walls 200 and virtual shadows 202 as reflective elements 74. The virtual walls 200 and virtual shadows 202 are reflected via beam splitters 70 and appear as if they are physically present in the optical effects area 58. The image data of the virtual walls 202 may include any such textures and / or shading to enhance the appearance and realism of the virtual walls 202. Additionally, the image of the virtual shadows 202 includes shapes and / or edges (e.g., forms) corresponding to the outlines and / or edges (e.g., shapes) of the interactive elements 68. The image of the virtual shadows 202 includes the interior of the outline, which is darker in color and / or hue than the exterior areas of the outline.

[0059] From the perspective of customer 54, a portion of the virtual shadow overlapping with one or more interactive elements 68 can be excluded from the shadow, such that the overlapping portion is not included in the shape or dark interior. Specifically, the control system 76 can detect the orientation and shape and / or form of one or more interactive elements 68 within the optical effect area 58 via one or more sensors 82. Additionally, as discussed herein, the control system 76 can generate image data of the virtual shadow corresponding to the orientation and shape and / or form of one or more interactive elements 68. Furthermore, based on the detected orientation and shape and / or form of one or more interactive elements 68 within the optical effect area 58 and the determined orientation and shape and / or form of the displayed virtual shadow generated within the optical effect area 58, the control system 76 can further determine the portion, amount, and / or area of ​​the virtual shadow that can overlap with one or more interactive elements 68. Specifically, the control system 76 can utilize a combination of 3D mapping technology and shadow mapping technology on the image data of the optical effect area 58 to determine the overlapping portion. In response to determining portions of a virtual shadow that may overlap with one or more interactive elements 68, the control system 76 can generate image data with virtual shadows that exclude overlapping portions, preventing them from being considered part of the virtual shadow. In other words, when displayed, the virtual shadow includes the dark interior portion within the outline of the virtual shadow, excluding the overlapping portion. In this way, the control system 76 can display the virtual shadow in such a way that, when viewed by the customer 54, it appears as if the virtual shadow is behind one or more interactive elements 68 relative to the customer 54's viewpoint.

[0060] The following text describes Figure 4 and Figure 5 Each illustration represents a method or process for operating the attraction system. Any suitable device (e.g., one that coordinates with other system components) is also included. Figure 1 and Figure 2 The processing system 80 of the control system 76 illustrated herein can execute corresponding methods. In one embodiment, each method can be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium (e.g., the memory 78 of the control system 76). For example, each method can be executed at least in part by one or more software components, one or more software applications, etc. Although each method is described using operations in a specific order, additional operations can be performed, the described operations can be performed in a different order than illustrated, and / or some described operations can be skipped entirely or not performed at all.

[0061] Figure 4 It is for operation according to one aspect of this disclosure. Figure 1 The flowchart illustrates an embodiment of a method or process 200 for providing realistic virtual shadow effects via Pepper's Illusion illusion in the attraction system 50. Specifically, as discussed herein, the optical effects system 56 can be operated to provide virtual images including virtual shadows that can complement the appearance of real-world objects (such as interactive element 68) viewed by one or more customers 54.

[0062] At box 202, the processing system can receive sensor data via a sensor, the sensor data including the shape and orientation information of one or more interactive elements in the optical effect area. For example, the sensor may include a camera configured to transmit image data of the optical effect area 58 as sensor data to the control system. The processing system can use imaging techniques to detect (e.g., identify, determine) the edges and / or shape of the interactive elements within the sensor data. Additionally, the processing system can determine the orientation of one or more interactive elements in the optical effect area. For example, the sensor may include a depth sensor or a 3D camera configured to determine the orientation information of one or more interactive elements and transmit the orientation information as sensor data to the control system. In some embodiments, the optical effect system may include a tracking system (such as one or more 3D cameras, one or more motion capture cameras, etc.) configured to detect the orientation of one or more interactive elements in the optical effect area.

[0063] At box 204, the processing system can generate image data based on the shape and orientation information of the interactive element. Specifically, as discussed herein, the processing system can generate a shadow effect by configuring the interior of the determined shape to be darker in color than the surrounding space. For example, the interior of the shape could be black, while the surrounding space could be white. The characteristics of the generated image (such as the size, shape, and orientation of the shape within the image data) can be based on characteristics from the received sensor data (such as the size, shape, and / or orientation of the shape). In other words, the characteristics of the generated image data, including the virtual shadow, can be correlated with the characteristics of the shape and orientation information of the interactive element received via sensor data.

[0064] At box 206, the processing system can transmit image data to display virtual elements corresponding to the shape and orientation information of the interactive elements. Specifically, the processing system can transmit the image data to a display system. The display system can be configured to display the image data in a display area on a screen and / or via a projector. The image data can then be projected toward a beam splitter to be reflected as one or more reflective elements and viewed by a customer in the viewing area. Specifically, as discussed herein, one or more reflective elements are combined with an image (e.g., one or more transmissive elements) that is transmitted through the beam splitter toward the customer's optical effect area. As a result, the combined image creates a virtual shadow effect in which the one or more interactive elements appear to have physical or real shadows projected onto the one or more reflective elements and / or one or more transmissive elements, which appear to physically exist within the optical effect area.

[0065] It should be noted that method 200 can be performed continuously or repeatedly. For example, method 200 can continue to provide real-time image data corresponding to one or more interactive elements within the optical effect area via blocks 202-206. In this way, the display of the virtual shadow effect or the virtual elements reflected via the beam splitter can be continuously adjusted and / or updated to reflect any changes in the orientation or movement of the one or more interactive elements. Therefore, the optical effect system can provide more realistic virtual shadow effects, including virtual shadows that behave as real-world shadows that move and / or change with the movement of the one or more interactive elements.

[0066] Figure 5This is a flowchart of an embodiment of a method or process 300 for operating a sightseeing system 50 to provide realistic virtual shadow effects via Pepper's Illusion, according to one aspect of this disclosure. That is, as discussed herein, an optical effects system 56 can be operated to provide a virtual image including virtual shadows that can complement the appearance of real-world objects (such as interactive element 68) viewed by one or more customers 54.

[0067] At box 302, the processing system can receive sensor data via a sensor, the sensor data including the shape and orientation information of one or more interactive elements in the optical effect area. For example, the sensor may include a camera configured to send image data of the optical effect area as sensor data to the control system. The processing system can use imaging techniques to detect the edges and / or shape of the interactive elements within the sensor data. Additionally, the processing system can determine the orientation of one or more interactive elements within the optical effect area.

[0068] At box 304, the processing system can receive the orientation of the light source. Specifically, the orientation of the light source can be known and stored via the memory of the control system. The processing system can retrieve the orientation of the light source from the memory. The orientation of the light source can be received via a sensor coupled to the light source. The sensor may include a camera configured to perform simultaneous localization and mapping (SLAM) tracking to calculate orientation and / or changes in orientation. Meanwhile, in some embodiments, the optical effects system may include a tracking system (such as one or more 3D cameras, one or more motion capture cameras, etc.) configured to detect the orientation of the light source.

[0069] At box 306, the processing system can generate image data based on the shape and orientation information of the interactive elements and the orientation of the light source. Specifically, as discussed herein, the processing system can generate a shadow effect by configuring the interior of the determined shape to be darker in color than the surrounding space. Furthermore, characteristics of the generated image (such as the size, shape, and orientation of the shape within the image data) can be based on characteristics (such as the size, shape, and / or orientation of the shape) from received sensor data. In other words, the characteristics of the generated image data, including the virtual shadow, can be associated with the characteristics of the shape and orientation information of the interactive elements received via sensor data. In some embodiments, the processing system can determine the degree of curvature of the virtual shadow in the image data based on the orientation of the light source and the orientation of one or more interactive elements. For example, the processing system can utilize or apply one or more image mapping techniques (e.g., image mapping techniques, forward mapping, backward mapping) to the image data based on the spatial relationship between the orientation of one or more interactive elements within the optical effect area and the orientation, orientation, and / or direction of the light source. In this way, via image mapping technology, the processing system takes into account the direction, orientation, angle, or any combination thereof of the light emitted by the light source relative to the orientation of one or more interactive elements within the optical effect area. Therefore, the generated image data includes more realistic virtual shadows that correspond to the orientation of the light source relative to the orientation of one or more interactive elements.

[0070] In some embodiments, the processing system may utilize 3D data and / or shadow mapping techniques to generate image data including virtual shadows. For example, the sensor may include a 3D depth camera, and the processing system may receive 3D image data from the sensor. Furthermore, the processing system may generate (e.g., render) a 3D virtual / digital scene corresponding to an optical effect area. Specifically, the processing system (e.g., including a physics engine) may render physical elements located in the optical effect area (such as one or more interactive elements, one or more light sources, walls, partitions, other physical objects, etc.) as 3D elements within the 3D virtual / digital scene. The corresponding 3D elements may include 3D representations corresponding to real-world physical elements (including one or more interactive elements) in the optical effect area. Additionally, via the virtual / digital 3D scene, the processing system may determine the orientation information of light sources (e.g., whether real-world or virtual / digital) and the orientation information of one or more interactive elements (e.g., and / or other objects within the virtual / digital 3D scene). The processing system may use shadow mapping techniques to determine shadow maps corresponding to the orientations of one or more light sources and one or more interactive elements within the 3D scene. In addition, the processing system can generate image data including virtual shadows based on the shadow map.

[0071] At box 308, the processing system can transmit image data to display virtual elements corresponding to the shape and orientation information of the interactive elements. Specifically, the processing system can transmit the image data to a display system. Additionally, as discussed herein, the display system can be configured to display the image data in a display area on a screen and / or via a projector. The image data can then be projected toward a beam splitter to be reflected as one or more reflective elements and viewed by a customer in the viewing area. Specifically, as discussed herein, one or more reflective elements are combined with an image (e.g., one or more transmissive elements) that is transmitted through the beam splitter toward the customer in an optical effect area. As a result, the combined image creates a virtual shadow effect in which the one or more interactive elements appear to have physical or real shadows projected onto the one or more reflective elements and / or one or more transmissive elements, which appear to physically exist within the optical effect area.

[0072] It should be noted that method 300 can be performed continuously or repeatedly. For example, method 300 can continue to provide real-time image data corresponding to one or more interactive elements within the optical effect area via blocks 302-308. In this way, the display of the virtual shadow effect or the virtual elements reflected via the beam splitter can be continuously adjusted and / or updated to reflect any changes in the orientation or movement of the one or more interactive elements. Thus, the optical effect system can provide more realistic virtual shadow effects, including virtual shadows that behave as real-world shadows that move and / or change with the movement of the one or more interactive elements.

[0073] While only certain features have been illustrated and described herein, many modifications and alterations will occur to those skilled in the art. Therefore, it is to be understood that the appended claims are intended to cover all such modifications and alterations that fall within the true spirit of the invention.

[0074] The techniques presented and claimed herein are referenced and applied to specific examples and material objects that can arguably improve the practical nature of the art, and are therefore not abstract, abstract, or purely theoretical. Furthermore, if any claim appended to this specification contains one or more elements designated as “component for (performing)...(function)” or “step for (performing)...(function)”, such elements are intended to be interpreted in accordance with 35 USC 112(f). However, for any claim containing elements designated in any other manner, such elements are not intended to be interpreted in accordance with 35 U.SC 112(f).

Claims

1. An optical effect system, comprising: A sensor configured to capture sensor data from an optical effect area; A display system configured to display images based on the sensor data; A beam splitter is disposed between the optical effect region and the observation region such that the optical effect region is observable from the observation region through the beam splitter, wherein the beam splitter is positioned to reflect light from the image toward the observation region; and The control system is configured as follows: Determine the characteristics associated with a person or object in the optical effect area from the sensor data; and The image is determined based on the aforementioned characteristics such that when the image is displayed by the display system, it overlaps with the person or object when viewed from the observation area.

2. The optical effect system according to claim 1, wherein, The characteristic is associated with silhouette data corresponding to the shape of the person or object in the optical effect area, and wherein the control system is configured to: The image is determined based on the silhouette data; and The image is displayed via the display system, wherein the image comprises a dynamically darkened silhouette image based on the silhouette data and is reflected from the beam splitter such that when viewed from the viewing area, the dynamically darkened silhouette image overlaps with the person or the object.

3. The optical effect system according to claim 2, wherein, The control system is configured to present the dynamically darkened silhouette image as if it were located in the same place as the person or object in the optical effect area when viewed from the observation area.

4. The optical effect system according to claim 2, wherein, The control system is configured to detect a plurality of characteristics including the characteristics of the person or the object, and wherein the dynamically darkened silhouette image includes a visual representation of the person or the object corresponding to the plurality of detected characteristics, and wherein the plurality of detected characteristics include size, shape, appearance, orientation, movement, orientation, type or any combination thereof.

5. The optical effect system according to claim 2, wherein, The dynamically darkened silhouette image is projected onto a physical wall, and wherein the dynamically darkened silhouette image and the physical wall are configured to be reflected by the beam splitter such that when viewed from the observation area, the dynamically darkened silhouette image and the physical wall overlap with the person or the object.

6. The optical effect system of claim 2, further comprising an illumination effect system, the illumination effect system being configured to maintain the foreground of the optical effect region illuminated more than the background of the optical effect region, wherein, The foreground is closer to the observation area than the background.

7. The optical effect system according to claim 2, wherein, The control system is configured to: The position of the person or object within the optical effect area is received; and Based on the position of the person or object in the optical effect area, the display of the image is changed, so that the dynamically darkened silhouette image is not presented in the observation area.

8. The optical effect system according to claim 2, wherein, The control system is configured to incorporate location data associated with the person or object into the image based on measurements acquired by optical sensors.

9. The optical effect system according to claim 1, wherein, The sensor is located in the same location as the object configured to emit light.

10. The optical effect system of claim 2, comprising an artificial light source positioned in the optical effect region or at a location separated from the optical effect region by the beam splitter.

11. The optical effect system according to claim 10, wherein, The image includes light, and wherein the light is reflected from the beam splitter such that the light is presented as emitted from the artificial light source and, when viewed from the observation area, causes the dynamically darkened silhouette image associated with the person or the object.

12. The optical effect system of claim 1, wherein the display system comprises: A projector configured to project the image onto a surface angled toward the beam splitter, or A backlit display configured to present the image, wherein the backlit display is angled toward the beam splitter.

13. The optical effect system of claim 1, further comprising a control system, the control system being configured to: Generate a three-dimensional (3D) rendering of the optical effect area; Determine the location of a person or object within the 3D rendering; and The image, including a virtual shadow of the person or object, is generated based on the determined orientation of the person or object.

14. The optical effect system according to claim 13, wherein, The control system is configured to generate the image based at least on a determined shadow map of the 3D rendering associated with the orientation of the person or the object, and the position of the digital light source.

15. A method for operating an optical effects system of a scenic spot system, the method comprising: Sensor data is received at the processing system, the sensor data including one or more characteristics of a person or object located within the optical effect area, wherein the sensor data is received from a sensor configured to monitor the optical effect area; Image data is generated at the processing system based on the sensor data for use in the display system, wherein the image data includes virtual shadows having one or more visual characteristics corresponding to one or more characteristics of the person or the object; and The image data is displayed via the processing system, wherein the image data is configured to be reflected via a beam splitter and combined with an image of the optical effect area.

16. The method of claim 15, comprising: The processing system receives first location information associated with the person or the object. The processing system receives second orientation information of the light source associated with the optical effect region; as well as The image data is generated at the processing system based on the association between the first orientation information and the second orientation information.

17. The method according to claim 16, wherein, The light source includes a digital light source, and the sensor data includes three-dimensional (3D) data associated with the optical effect area, wherein the method includes: A 3D digital representation of the optical effect area is generated at the processing system based on the 3D data; The processing system determines the shadow mapping of the optical effect area based on the first orientation information and the second orientation information; and The image data is generated at the processing system based on the shadow mapping.

18. The method according to claim 16, wherein, The light source is a real light source configured to emit light toward the area of ​​the optical effect; Furthermore, the method includes: generating the image data at the processing system by applying image mapping technology based on the spatial relationship between the first azimuth information and the second azimuth information.

19. The method of claim 15, comprising: The processing system transmits instructions to the display system, wherein the instructions are configured to cause the virtual shadow to be displayed on the wall, and wherein the virtual shadow and the wall are configured to be reflected via the beam splitter and combined with the image of the optical effect area.

20. An attraction system for an amusement park, comprising: An optical effects system, comprising: The main stage, configured to accommodate interactive elements; The secondary stage is configured to accommodate displays; A sensor configured to detect one or more first characteristics associated with the interactive element; and The control system includes a processor system configured to: Receive sensor data from the sensor, wherein the sensor data includes one or more of the first characteristics; Generate image data including virtual shadows, wherein the virtual shadows comprise darkened silhouettes of the interactive elements having one or more second characteristics corresponding to the one or more first characteristics; and This causes the image data to be displayed on the secondary stage; and A beam splitter is disposed between the main stage and the viewing area, wherein the beam splitter is configured to reflect the display of the image data toward the viewing area, and wherein the viewing area is positioned to allow customers of the attraction system to view the combination of the reflected display of the image data and the interactive elements.

Images