Interactive Peppers Ghost Effect System and Method

The interactive Pepper's Ghost system addresses the lack of audience interaction in traditional Pepper's Ghost effects by using sensors and controllers to enable guest control over visual effects and props, enhancing engagement and immersion.

JP7875871B2Active Publication Date: 2026-06-18UNIVERSAL CITY STUDIOS LLC
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
UNIVERSAL CITY STUDIOS LLC
Filing Date
2022-01-28
Publication Date
2026-06-18

Smart Images

  • Figure 0007875871000001
    Figure 0007875871000001
  • Figure 0007875871000002
    Figure 0007875871000002
  • Figure 0007875871000003
    Figure 0007875871000003
Patent Text Reader

Abstract

The interactive Pepper's Ghost system includes a sensor configured to detect a parameter indicative of an orientation of the handheld device. The Pepper's Ghost system also includes a controller configured to receive sensor feedback from the sensor corresponding to the parameter indicative of the orientation of the handheld device. The controller is configured to control a Pepper's Ghost visual effect based on the sensor feedback.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application claims priority and the benefit thereof based on U.S. Provisional Patent Application Serial No. 63 / 147,973, entitled "Interactive Pepper's Ghost Effect System And Method", filed on February 10, 2021, the entire disclosure of which is hereby incorporated by reference in its entirety for all purposes.

Background Art

[0002] This section is for introducing the reader to various aspects of technologies that may be related to the various aspects of the present disclosure described and / or claimed below. This discussion is considered to be helpful in showing the reader the background circumstances and facilitating a better understanding of the various aspects of the present disclosure. Accordingly, these descriptions should be understood to be read from the above perspective rather than as an admission of prior art.

[0003] Theme parks, amusement parks, theaters, cinemas, stadiums, and concert halls have been designed to provide guests with a variety of immersive experiences. These entertainment venues can include show attractions (movies, plays, rides, games, etc.) that offer guests an immersive experience. For example, traditional show attractions can create various visual effects from the guest's perspective by utilizing various combinations of physical show elements (or props), staging, and lighting. One commonly used visual effect can be called the Pepper's Ghost illusion. For example, a traditional Pepper's Ghost system can employ a primary stage (first scene), a secondary stage (second scene), and a light beam splitter (e.g., a piece of glass) positioned to combine images from each scene as viewed from the audience's perspective. The image from the second scene is reflected from the beam splitter towards the audience (e.g., reflected from the glass surface), while the image from the first scene can pass through the beam splitter (e.g., through the glass). Stage lighting can be controlled to illuminate the sides of the scene but not the beam splitter. This can enhance the visibility of desired scene features or limit or prevent the audience from observing the beam splitter itself. As a result, an illusion of a physical presence is formed on the primary stage, which is actually just a reflection of the secondary stage. [Overview of the project] [Problems that the invention aims to solve]

[0004] While well-established effects such as the traditional Pepper's Ghost effect are effective optical illusions, it is now recognized that these traditional effects lack meaningful audience interaction. For example, an audience that may include one or more guests generally cannot control the various aspects of a show built around such effects. In other words, the audience is passive in such traditional systems. In today's environment, where guests are accustomed to more interaction (e.g., through video games), such passive interaction can lead to a loss of interest. Furthermore, even in shows that employ audience interaction, it is now recognized that technological limitations can make audience interaction excessively costly, inaccurate, irrelevant, or a combination of these. Therefore, improved show attractions are desired. [Means for solving the problem]

[0005] The following summarizes several embodiments that fall within the same scope as the subject matter of the original claims. These embodiments are not intended to limit the scope of the disclosure, but rather to outline some of the disclosed embodiments. In practice, the disclosure may include a variety of forms that are similar to or different from the embodiments shown below.

[0006] In one embodiment, the interactive Pepper's Ghost system includes a sensor configured to detect a parameter indicating the orientation of a handheld device. The Pepper's Ghost system also includes a controller configured to receive sensor feedback from the sensor corresponding to the parameter indicating the orientation of the handheld device. The controller is configured to control the Pepper's Ghost visual effect based on the sensor feedback.

[0007] In one embodiment, the entertainment system includes a transparent or translucent screen, a plurality of light-emitting elements directed toward the transparent or translucent screen, a handheld device, a sensor configured to monitor the orientation of the handheld device, and a controller configured to receive sensor feedback from the sensor indicating the orientation of the handheld device, the controller being configured to select at least one of the plurality of light-emitting elements based on the sensor feedback and to actuate the at least one light-emitting element to emit light onto the transparent or translucent screen so that a Pepper's Ghost effect is produced from the viewpoint of the handheld device.

[0008] In one embodiment, the interactive Pepper's Ghost system includes a handheld device configured to be held by an operator, a sensor configured to monitor the orientation of the handheld device, a microphone configured to detect voice audio from the operator, a transparent or translucent screen, and a controller. The controller receives first data feedback from the sensor indicating the orientation of the handheld device and is configured to determine the position of the wand on the transparent or translucent screen based on the first data feedback. The controller is also configured to receive second data feedback indicating voice audio from the operator and, based on the second data feedback, determine a voice command from a plurality of available voice commands. The controller is also configured to activate at least one of a plurality of light emitters to emit light at the position on the transparent or translucent screen to produce the Pepper's Ghost effect, based on the position and the voice command determined by the controller.

[0009] These and other features, embodiments, and advantages of the present invention will be better understood by reading the following detailed description while referring to the attached drawings, which indicate the same parts throughout with the same reference numerals. [Brief explanation of the drawing]

[0010] [Figure 1] This is an overview view of the interactive Peppers Ghost system according to the embodiments of this disclosure. [Figure 2] This is an overhead perspective view of the Interactive Peppers Ghost System shown in Figure 1, according to the embodiments of this disclosure. [Figure 3] This is a schematic block diagram showing a control scheme for controlling the interactive Peppers Ghost system shown in Figure 1, according to an aspect of this disclosure. [Figure 4] This is an overhead view of the foldable housing of the Interactive Peppers Ghost System shown in Figure 1, according to the embodiments of this disclosure. [Figure 5] This is a process flow diagram showing a method for operating the Interactive Peppers Ghost System shown in Figure 1 according to an aspect of this disclosure. [Modes for carrying out the invention]

[0011] The following describes one or more specific embodiments of this disclosure. For the sake of brevity, this specification does not describe all features of the embodiments. It should be understood that the development of any such embodiment, as seen in any engineering or design project, will require numerous implementation-specific decisions to achieve the developer's specific objectives, such as compliance with system-related and business-related constraints, which may vary by implementation. Furthermore, while such development efforts can be complex and time-consuming, they should be understood by those skilled in the art who benefit from this disclosure as routine design, fabrication, and manufacturing activities.

[0012] When describing elements of the various embodiments of this disclosure, the articles “a,” “an,” and “the” are intended to mean that there are one or more of these elements. The terms “comprising,” “including,” and “having” are intended to be comprehensive and mean that there may be further elements other than those listed. Furthermore, any reference to “one embodiment” or “a certain embodiment” in this disclosure should not be interpreted as excluding the existence of further embodiments, including the features described.

[0013] This disclosure relates to an interactive Pepper's Ghost system and method for entertainment venues in general (e.g., theme parks, amusement parks, theaters). Specifically, this disclosure relates to a system that controls the Pepper's Ghost effect based on interaction from guests.

[0014] Various entertainment venues can offer guests a wide range of immersive and interactive experiences. For example, an entertainment venue could include a show attraction that utilizes various combinations of physical show elements (or "props") and lighting to produce a variety of visual effects. However, in some conventional embodiments, these show attractions may lack audience interaction. Furthermore, even in conventional show attractions that do employ audience interaction, the interaction may not exert or provide control over the show attraction. For example, the story told by the show attraction may be fixed, and the audience may not be able to meaningfully alter aspects of the story.

[0015] According to this disclosure, an interactive Pepper's Ghost system can enable audience interaction that allows for some control over, for example, aspects of a scene or story. Audience control can be enabled by monitoring the movements of guests (or the movements of devices controlled by guests) and can be propagated or facilitated, at least in part, by the Pepper's Ghost visual effect. According to this disclosure, “Pepper's Ghost” can mean a visual effect made possible by various staging / lighting structures and techniques, including a primary stage (first scene), a secondary stage or darkroom (second scene), and a light beam splitter (e.g., a piece of glass) positioned to combine images from each scene as seen from the guest’s perspective. Images from the second scene (e.g., from a darkroom not directly visible to the audience) can be reflected from the beam splitter towards the audience (e.g., reflected from a glass surface), and images from the first scene can pass through the beam splitter (e.g., through glass). Stage lighting can be controlled to illuminate the sides of the scene and not illuminate the beam splitter. This allows for increased visibility of desired scene features, or limits or prevents the audience from observing the beam splitter itself. As a result, an illusion of a physical presence, which is actually merely a reflection of the secondary stage, is formed on the primary stage.

[0016] The interactive Pepper's Ghost system according to this disclosure includes a controller and a handheld device. The handheld device may be, for example, a confetti cannon, a wand, a key, a console controller, a mobile phone, or other handheld device. The controller can monitor the orientation of the handheld device (and, in some embodiments, the position of the handheld device). In some embodiments, infrared detection can be employed to enable the controller to monitor the orientation of the handheld device. For example, in one embodiment, the handheld device may include an infrared emitter, and the controller may be communicatively coupled to an infrared sensor (or array of infrared sensors) configured to detect infrared radiation emitted from the infrared emitter of the handheld device. In another embodiment, the handheld device may include an infrared reflector, and another infrared emitter may emit infrared radiation toward the infrared reflector of the handheld device, and the controller may be communicatively coupled to an infrared sensor (or array of infrared sensors) configured to detect infrared radiation reflected by the infrared reflector of the handheld device. In yet another embodiment, different aspects of the handheld device (e.g., shape, barcode, reflective coating) can be detected by a camera or the like. Furthermore, a gyroscope and / or accelerometer placed on the handheld device may be used to monitor the orientation and position of the handheld device.

[0017] The controller can determine the orientation of a handheld device, such as a toy magic sword, based on sensor feedback received from an infrared sensor or other sensors (e.g., a camera, gyroscope, accelerometer). For example, the controller can determine the direction in which the handheld device (e.g., a toy magic sword) is pointed or directed. The position of the handheld device can also be determined using infrared detection or other sensor devices, but in some embodiments, the position of the handheld device is fixed so that it is known to other components of the system (e.g., within a predetermined zone). Based on the orientation and position of the handheld device, the controller can control the Pepper's Ghost effect, which simulates a visual effect perceived by the guest, as if it were produced by the handheld device. For example, if the handheld device is a toy magic sword as described above, the controller can control the Pepper's Ghost visual effect to simulate a spell cast by the magic sword. The Pepper's Ghost visual effect will be explained in detail below, but the Pepper's Ghost visual effect can be defined as the illusion that features (e.g., images, objects, items, or props) reflected from another scene, which are not directly visible to the audience positioned to observe the Pepper's Ghost visual effect, are present in the scene.

[0018] An interactive Pepper's Ghost system can include various features that enable the Pepper's Ghost effect. For example, an interactive Pepper's Ghost system can include a stage and a transparent or translucent screen (e.g., a beam splitter) positioned between the handheld device and the stage. Generally, a more transparent screen (e.g., a beam splitter) can enable a more authentic effect than a less transparent screen. For brevity, in some of the following examples, the transparent or translucent screen can be referred to as the “screen.” Generally, the screen is not visible at all or barely visible from the viewpoint of the operator (e.g., a guest) holding the handheld device. In some embodiments, the handheld device, the transparent or translucent screen, and the stage can be arranged in a line or in a straight line. That is, the line of sight from the handheld device, or the guest operating the handheld device, can extend from the position of the handheld device through the transparent or translucent screen into the stage. A darkroom can be placed next to the transparent or translucent screen to offset the line of sight described above. The darkroom may include dark walls and several controllable lights configured to project or guide light toward a transparent or translucent screen. Furthermore, the darkroom may be made invisible to the operator of the handheld device and other guests in the audience. In some embodiments, the controllable lights may be arranged in a grid, and a controller may be able to trigger or activate some of the controllable lights to project or guide light toward a specific area of ​​the transparent or translucent screen based on the sensor feedback described above. The transparent or translucent screen may be positioned at an angle such as 45 degrees to the line of sight described above, and also at a further angle such as 45 degrees to the direction of light provided through the lights positioned in the darkroom.

[0019] As described above, by angling the screen, from the perspective of a guest in or adjacent to the handheld device, the light guided from the darkroom towards the screen appears to correspond to a visual effect occurring on the stage. That is, the light from the darkroom is projected onto the screen between the handheld device and the stage, while the light reflected from the screen appears to the guest as a visual effect occurring on the stage behind the screen, which is either completely invisible or barely visible to the guest. In some embodiments, physical items are placed in the darkroom, and the aforementioned lights placed in the darkroom cause illumination of the physical items and reflection onto the corresponding transparent or translucent screen, thereby giving the impression that the physical items in the darkroom are also present on the stage behind the transparent or translucent screen. In other embodiments, the aforementioned lights can directly simulate the visual effect on the transparent or translucent screen without any other physical items placed in the darkroom.

[0020] According to this disclosure, the handheld device may include a toy cannon that simulates firing confetti, water, or smoke onto a stage behind a transparent or translucent screen. In some embodiments, the stage may include various show elements or props that interact with the Pepper's Ghost effect. For example, the visual effect may simulate a specific appearance or property associated with one of the props (e.g., confetti landing on a chair). In some embodiments, a controller may cause physical effects on the props that correspond to or are linked to the visual effects. For example, a visual effect caused by light from a darkroom, corresponding to the orientation of the handheld device, may simulate the appearance of fire, smoke, steam, electricity, lighting, water, or snow emitted from the handheld device, and the controller may move the props to correspond to these visual effects (e.g., move forward, move backward, move left and right, rotate, break, split, combine). In general, the systems described above allow guests to operate the handheld device to cause a visual Pepper's Ghost effect that simulates guest interaction with the stage, the props on the stage, and the scenes or stories represented by the stage and props.

[0021] In some embodiments, a microphone is employed to capture voice commands from an operator (e.g., a guest) of a handheld device (e.g., a confetti cannon). A controller is communicatively coupled to the microphone and configured to receive data feedback from the microphone. The voice commands can correspond to specific visual effects among a number of available visual effects stored in the controller's memory. For example, a first voice command can cause a first visual effect (e.g., graphics of red, orange, and yellow light or light simulating fire), and a second voice command can cause a second different visual effect (e.g., graphics of blue, white, and gray or light simulating water). Thus, the system causes a Pepper's Ghost visual effect having aesthetic properties (e.g., color) corresponding to the voice command at a position corresponding to the orientation of the handheld device. These and other features will be described in detail below.

[0022] Turning to the drawings, FIG. 1 is a top view of an embodiment of an interactive Pepper's Ghost system 10. In the illustrated embodiment, the system 10 includes an audience compartment 12 in which a handheld device 14 (e.g., a confetti cannon) is disposed, a stage compartment 16 in which show elements 18, 20 (or props) and at least one projector 21 are disposed, a central compartment 22 in which a transparent or translucent screen 24 (hereinafter referred to as the "screen") is disposed, and a darkroom compartment 26 in which effect lights 30 (e.g., LED lights, display screens, television screens) are disposed. As will be described in detail below, the system 10 can utilize the compartments 12, 16, 22, 26 (hereinafter referred to in some instances as "rooms") and corresponding components described above to simulate visual effects within the stage compartment 16 caused by the handheld device 14. That is, the visual effects can be synchronized with the position and orientation of the handheld device 14 such that the position and orientation of the visual effect are aligned with the position and orientation of the handheld device 14 and appear, for example, to originate from the handheld device 14.

[0023] System 10 may also include a controller 32 having a processor 34 (e.g., processing circuitry) and memory 36 (e.g., memory circuitry), an infrared sensor 38 (e.g., a camera), an infrared emitter 40, and an infrared reflector 42. The memory 36 can store instructions that cause the controller 32 to perform various functions when executed by the processor 34. The controller 32, infrared sensor 38, and infrared emitter 40 are shown in the central compartment 22 of System 10 (i.e., adjacent to the screen 24), but it should be understood that they may also be located in other compartments of System 10. Furthermore, if any one of the controller 32, infrared sensor 38, or infrared emitter 40 is located in the central compartment 22, it may be placed in an area that does not substantially obstruct the line of sight from the handheld device 14 through the screen 24 to the stage compartment 16. In one embodiment, the controller 32, infrared sensor 38, and infrared emitter 40 can be small enough to be positioned within the line of sight described above without substantially impairing the experience of the operator of the handheld device 14 (e.g., a guest) or other guests located within the spectator compartment 12.

[0024] In the illustrated embodiment, the infrared emitter 40 can be configured to emit infrared rays toward the handheld device 14, and the infrared reflector 42 on the handheld device 14 can reflect this infrared ray. The infrared reflector 42 can include a mechanism such as a filter that reflects light (e.g., infrared rays) having wavelengths within a specific wavelength range (e.g., from about 700 nanometers to 1 millimeter). The infrared sensor 38 can be configured to detect the reflected infrared rays. In some embodiments, the infrared sensor 38 can include a grid of sensors configured to detect infrared rays. In some embodiments, no infrared reflector is employed in the handheld device 14, and instead, the infrared emitter 40 is disposed in the handheld device 14 so that the infrared rays emitted by the infrared emitter 40 of the handheld device 14 are detected by the infrared sensor 38. In any case, the controller 32 can receive sensor feedback indicating the orientation of the handheld device 14 from the infrared sensor 38. In some embodiments, the sensor feedback can also indicate the position of the handheld device 14 (including, for example, any combination of X, Y, and Z coordinates). However, in the illustrated embodiment, the handheld device 14 is disposed in or within the zone 37 for which the coordinates are known to the controller 32 (e.g., because the zone 37 is disposed at a predetermined known distance 39 from the infrared sensor 38), and thus the approximate position of the handheld device 14 is known and there is no need to monitor this. Other position and orientation monitoring via, for example, a gyroscope, an accelerometer, a shape recognition camera, and a communication signal (e.g., Bluetooth) employed in the controller 32 and / or the handheld device 14 is also possible.

[0025] The controller 32 can control lights 30 positioned in a darkroom 26 that simulate visual effects perceived by guests in the audience compartment 12 when directed towards the screen 24, as if they were occurring within or interacting with the stage 16, based on the sensor feedback described above (e.g., infrared feedback, camera feedback, gyroscope feedback, accelerometer feedback). For example, the lights 30 can be arranged in a grid (e.g., via an array of LED lights). Furthermore, the lights 30 may include an array of screens or LED panels that can provide fine-grained graphic effects (e.g., animated explosions). The controller 32 can use the sensor feedback described above to trigger some of the grid-like lights 30, so that the triggered lights 30 produce visual effects related to the position and orientation of the handheld device 14. For example, a guest may point the handheld device 14 towards a show element 18 in the stage compartment 16 of the system 10. The controller 32 can determine at least the orientation of the handheld device 14 based on the sensor feedback described above. Subsequently, the controller 32 can trigger some of the lights 30 to direct light to specific areas of the screen 24. The screen can be positioned at an angle 41 (for example, an angle of approximately 45 degrees ± 2 degrees) with respect to the line of sight 43 passing through the audience compartment 23, the central compartment 22, and the stage compartment 16. Alternatively, the screen 24 can be positioned at an angle 47 (for example, an angle of approximately 45 degrees ± 2 degrees) with respect to the line of sight 49 from the darkroom compartment 26 to the central compartment 22.

[0026] Light reflected onto the screen 24 from the light 30 in the darkroom (triggered, for example, by the controller 32) can produce a visual effect that makes it appear to the operator of the handheld device 14 as if it were occurring within the stage compartment 16 aligned with the show element 18 to which the handheld device 14 is directed, due to the aforementioned angles 41 and 47 of the screen 24 and the fact that the screen 24 contains transparent or translucent material. Thus, from the viewpoint of the operator of the handheld device 14, or any other guest located within the audience compartment 12 of the system 10, the visual effect is perceived as if it were occurring within the stage compartment 16 and originating from the handheld device 14. As mentioned above, the transparency of the screen 24 material can enhance the authenticity of the visual effect. In addition to the controlled operation of the light 30 within the darkroom compartment 26, the darkroom compartment 26 may include a dark (e.g., black) material that reduces any undesirable light reflection onto the screen 24 (e.g., light other than the light directed to the screen 24 via the light 30 within the darkroom compartment 26).

[0027] In some embodiments, visual effects can also be triggered using a microphone 56 communicatively coupled to a controller 32. For example, the microphone 56 can detect voice commands (e.g., from the operator of the handheld device 14) indicating commands to produce visual effects. The microphone 56 and / or the controller 32 may include speech recognition software configured to determine voice commands and the type of effect associated with those voice commands. Multiple commands and corresponding different visual effects are possible. For example, if the handheld device 14 is an effect cannon, multiple voice or audio commands may correspond to multiple different types of virtual effect materials that the cannon can fire (e.g., water, confetti, fireworks). Visual effects associated with various different types of visual effect materials can be simulated as if they were directed from the handheld device 14 (e.g., the cannon) towards or onto various show elements 18, 20 or other areas of the stage compartment 16. Accordingly, the controller 32 can monitor the orientation of the handheld device 14 and trigger the appropriate light 30 in the darkroom compartment 26 based on the voice command detected by the microphone 56 and the orientation of the handheld device 14 to produce the appropriate visual effect (e.g., water) that the operator perceives as occurring in the appropriate show element 18, 20 or other area within the stage compartment 16. That is, the controller 32 can determine which light 30 to trigger based on orientation monitoring of the handheld device 14 (e.g., via the sensor 38) and can determine when to trigger the light based on audio or voice commands (e.g., via feedback from the microphone 56). In some embodiments, each light 30 may include lights of various colors. For example, each light 30 may include multiple LED lights corresponding to multiple different colors. As described above, different types of different visual effects can be produced in response to different types of different audio or voice commands.A first audio command corresponding to a first spell can produce a first visual effect having a first color or color combination, and a second audio command corresponding to a second spell can produce a second visual effect having a second color or color combination. Thus, the spell (e.g., the desired visual effect) can be determined using feedback from the microphone 56, and the controller 32 can control the lights 30 so that the appropriate (singular or plural) colors corresponding to the determined spell are directed onto the screen 24.

[0028] As described above, at least one projector 21 can be placed in the stage compartment 16. Although two projectors 21 are shown in Figure 1, any number of projectors is possible. The projectors 21 can be configured to illuminate the stage 16 and the corresponding show elements 18, 20 (for example, at all times during a show or attraction). Furthermore, actuation assemblies 50, 52 can be employed to cause movement of the show elements 18. For example, actuation assembly 50 associated with show element 18 may include a motorized track-and-trolley that moves the show element 18 laterally 51 across a track, as shown. Actuation assembly 52 may include a motorized fastener that separates the corresponding show element 20 (for example, via control by a controller 32) so that it is divided into two parts 53, 54. Other actuation assemblies are also possible according to this disclosure.

[0029] Control of show elements 18, 20 (for example, via actuation assemblies 50, 52) can be synchronized with control of lights 30 in the darkroom 26 based on sensor feedback and / or voice commands related to the orientation of the handheld device 14. For example, the controller 32 can simulate visual effects via the lights 30 so that when the show element 18 moves laterally 51 via the actuation assembly 50, it appears as if a visual effect occurs on the show element 18. In one example, a guest could point the handheld device 14 at the show element 18 and give a command intended to move the show element 18 as if the handheld device 14 could control gravity. The controller 32 can receive sensor feedback from an infrared sensor 38 (or some other orientation monitoring sensor) corresponding to the orientation of the handheld device 14 and feedback from the microphone 56 corresponding to the guest's command. The controller 32 can trigger visual effects, such as simulating electricity being emitted from the handheld device 14 toward the show element 18, by activating a portion of the lights 30 to direct light toward a specific area of ​​the screen 24. Furthermore, the controller 32 can instruct the movement of the show element 18 to correspond to visual effects. The information exchange components described above (for example, at least the controller 32, infrared sensor 38, microphone 56, light 30, and show elements 18 and 20) can be connected wirelessly via a network system 59 (for example, an internet system). In addition to or instead of this, some of these components can also be connected by wire.

[0030] Figure 2 is an overhead perspective view of an embodiment of the Interactive Peppers Ghost System 10 of Figure 1. In the illustrated embodiment, as described above, the lights 30 contained in the darkroom compartment 26 of the system 10 can be arranged in a grid 61. Note that the lights 30 (e.g., individual lights, LED arrays or panels, display screens) are shown through the back of the dark walls 63 of the darkroom compartment 26 for clarity. However, it should be understood that the lights 30 are not visible through the back of the dark walls 63, but rather are located inside the darkroom compartment 26 and directed toward the screen 24. In general, the darkroom compartment 26 may include dark walls (e.g., dark walls 63, 84 and 86) that reduce undesirable light reflection onto the screen 24. The system 10 may also include several other walls 88, 90, 92, 94, 96 that define the various compartments 16, 22, 12 of the system 10. In some embodiments, the wall 92 can traverse the stage compartment 16, the central compartment 22 with the screen 24, and the audience compartment 12. In other embodiments, the wall 92 may include three separate walls (or panels) for each of the compartments 16, 22, and 12. Walls 63, 84, 86, 88, 90, 92, 94, and 96 will be described in detail later with reference to the drawings.

[0031] The grid 61 of lights 30 corresponding to the darkroom compartment 26 may include columns C1, C2, and C3, and rows R1, R2, and R3. The first light 60 can be placed in C1, R1, the second light 62 in C2, R1, the third light 64 in C3, R1, the fourth light 66 in C1, R2, the fifth light 68 in C2, R2, the sixth light 70 in C3, R2, the seventh light 72 in C1, R3, the eighth light 74 in C2, R3, and the ninth light 76 in C3, R3. Lights 60, 62, 64, 66, 68, 70, 72, 74, and 76 can be collectively referred to as light 30. Furthermore, each of lights 60, 62, 64, 66, 68, 70, 72, 74, and 76 may include multiple lights having multiple different colors, or a single light capable of emitting multiple different colors. For example, light 60 may emit red, green, and blue light, among other things.

[0032] In the illustrated embodiment, the screen 24 may include a grid 80 corresponding to the grid 61 of the lights 30 in the darkroom compartment 26. For example, by controlling a first light 60 positioned at C1, R1 of the grid 61, the first light 60 can direct light to the corresponding area of ​​the grid 80 associated with the screen 24. Naturally, the grid 80 associated with the screen 24 is invisible and merely corresponds to the physical positions of the various lights 30 in the darkroom compartment 26. Furthermore, the grid 82 in the stage compartment 16 may correspond to the grid 80 of the screen 24 and the grid 61 of the lights 30 in the darkroom compartment 26. Again, the grid 82 in the stage compartment 16 is invisible and merely corresponds to the physical positions of the various lights 30 in the darkroom compartment 26. For example, by controlling the first lights 60 of grid 61 at C1 and R1, light is directed to the corresponding areas of grid 80 on screen 24, and this light is reflected by screen 24 to simulate the visual effect occurring in the corresponding areas of grid 82 on stage compartment 16 as seen by guests in the seating compartment 23. The control of the lights 30 in the darkroom compartment 26 can be done as described above with respect to Figure 1.

[0033] Referring again to Figure 1, only one controller 32 having one processor 34 and memory 36 is shown. However, it should be understood that multiple controllers communicating with each other can also be employed to achieve the effects described above. For example, the controller 32 in Figure 1 could represent any number of controllers such as a first controller configured to receive sensor feedback from an infrared sensor 38 and a microphone 56, a second controller configured to be communicatively coupled to the first controller and to operate various lights 30, and a third controller configured to control the operation of the stage compartment 16 and the corresponding show elements 18, 20. Other control schemes are also conceivable according to this disclosure.

[0034] For example, Figure 3 is a schematic block diagram showing an example of a control scheme 100 for controlling the interactive Peppers Ghost system 10 of Figure 1. Figure 1 shows a single controller 32. However, the single controller 32 can also represent multiple controllers that work together to produce the various effects described with respect to Figure 1. For example, in Figure 3, the "controller 32" can include four independent controller components, including an input manager 102, an LED manager 104, a stage projector manager 106, and a physical object manager 108. Each of the control components (or managers) 102, 104, 106, and 108 can include a dedicated processor and memory. That is, the processor 34 and memory 36 shown in Figure 1 can represent a dedicated processor and memory for each of the control components (or managers) 102, 104, 106, and 108 shown in Figure 3.

[0035] The input manager 102 in Figure 3 can be configured to receive a device orientation input from an infrared sensor 38 (or any other input sensor such as a camera, gyroscope, or accelerometer) and an audio input 112 from a microphone 56. The input manager 102 can determine various control functions based on the inputs 110 and 112 as described above. The input manager 102 can include, for example, a video game machine. The LED manager 104 can be configured to receive data from the input manager 102 based on the processing of the orientation input 110 and the audio input 112 by the input manager 102. For example, the input manager 102 can instruct the LED manager 104 on the orientation of the handheld device 14 in Figure 1 and the actions intended to be performed based on the audio input 112, via the data transmitted to the LED manager 104. As a result, the LED manager 104 can control the appropriate light (LED in the illustrated embodiment) among the lights 30 to simulate the Pepper's Ghost effect according to the orientation input 110 and the audio input 112 as described above. The LED manager 104 can also communicate data to the physical object manager 108 indicating which lights 30 are scheduled to operate or are already operating. The LED manager 104 can also indicate to the physical object manager 108 the type of effect to operate. As a result, the physical object manager 108 can control the show elements 18 and 20 (referred to as physical objects in Figure 3) according to the data received from the LED manager 104. For example, if the effect corresponds to high-pressure water splashes, the object manager 108 can control the props to move in response to the impact of the virtual water flow.

[0036] The input manager 102 can also transmit data to the stage projector manager 106. As described above, one or more stage projectors 21 can be used to illuminate the stage as seen by the operator of the handheld device 14 (e.g., a wand) in Figure 1. In some embodiments, the projectors 21 can be controlled to increase or decrease the brightness of the light emitted from them. Controlling the projectors 21 can enhance the authenticity of the Pepper's Ghost visual effect provided according to the above description. Furthermore, the projectors 21 can be selectively controlled to correspond to various types of spells simulated by the system. For example, a certain spell may darken or make the stage as seen by the guest darker by controlling the projectors 21 to decrease the brightness of the light or to cancel out the light emitted from them. The control scheme described above is an example of various control components (e.g., input manager 102, LED manager 104, stage projector manager 106, physical object manager 108) that can communicate with each other to achieve the desired Peppers ghost effect, as detailed with reference to Figures 1 and 2. However, other schemes are also possible.

[0037] Figure 4 is an overhead perspective view of an embodiment of the foldable housing 150 for the interactive Peppers Ghost System 10 of Figure 1. The foldable housing 150 may include various walls 63, 84, 86, 90, 92, 96 shown in Figure 2, which define various compartments 12, 16, 22, 26 (or rooms) shown in Figure 2. In Figure 4, wall 94 shown in Figure 2 is removed, but in some embodiments, the foldable housing 150 of Figure 4 may also include wall 94 of Figure 2.

[0038] In the embodiment shown in Figure 4, various walls 63, 84, 86, 90, 92, 96 can be connected at the joint 152. Furthermore, wall 92 may include three independent walls (or panels) 154, 156, 158 connected via the joint 152. The joint 152 may include a hinge 160 (represented by a circle in the illustrated embodiment) configured to allow the walls 63, 84, 86, 90, 92, 96 (including the panels 154, 156, 158 of wall 92) to fold relative to each other. In some embodiments, a screen 24 used to generate the Pepper's ghost effect can be removed from the folding housing 150 before the folding housing 150 is folded into a stack. In other embodiments, the screen 24 may be attached to one of the walls 63, 84, 86, 90, 92, 96 or panels 154, 156, 158 and / or may have a size that allows it to be folded into a stack. Furthermore, the sizes and dimensions of the features of the foldable housing 150 and screen 24 in Figure 4 are illustrative only and should not be taken as exact. In some embodiments, all walls 63, 68, 86, 90, 92, 96 and panels 154, 156, 158 may have similar widths (e.g., the distance 170 between two joints 152). The foldable housing 150 (an example of which is shown in Figure 4) can enable the mobility and easy storage of the system.

[0039] Figure 5 is a process flow diagram showing an embodiment of method 200 for operating the interactive Pepper's Ghost System 10 of Figure 1. Method 200 includes detecting the orientation of a handheld device (block 202). For example, as described above, the orientation of a handheld device, such as a toy magic sword, can be monitored via an infrared assembly or other monitoring device (e.g., a shape-detection camera) as described with respect to Figure 1. In addition to or instead of this, the orientation of a handheld device can also be detected using other sensors such as a gyroscope and accelerometer employed in the handheld device. The controller can receive data feedback from one or more of the above-described sensors to determine the orientation of the handheld device (e.g., the direction the handheld device is pointing, or the position or object the handheld device is pointing to).

[0040] Method 200 also includes detecting voice commands from an operator of a handheld device (block 204). For example, as described above, multiple voice commands are possible that correspond to various types of visual effects. The controller described above may include speech recognition software that determines a voice command from among multiple available voice commands. For example, the voice command "fire" may trigger a first visual effect (e.g., an effect that looks like fire or a stream of fire), and the voice command "water" may trigger a second visual effect (e.g., an effect that looks like a stream of water). The voice command can be detected by a microphone, and the controller can receive data feedback from the microphone indicating the voice command.

[0041] Method 200 also includes selecting a visual effect from several available visual effects based on the orientation of the handheld device and voice commands (block 206). For example, as described above, the controller can use voice commands to determine the aesthetics of a visual effect (e.g., fire, smoke, steam, electricity, lighting, water, snow). The controller can use the orientation of the handheld device to determine the location where the visual effect will occur. For example, as described above, the system may include a handheld device, a stage facing the zone of the handheld device (e.g., the audience seating), and a transparent or translucent screen placed between the handheld device and the stage. The operator can point the handheld device towards the stage and / or the location of show elements or props (e.g., physical objects) placed on the stage. The operator can give instructions (e.g., spells). Based on the detected orientation of the handheld device, the controller can activate at least one light placed in a darkroom or compartment to direct the light to the appropriate area of ​​the transparent or translucent screen. Light reflected from a transparent or translucent screen can produce a Pepper's Ghost effect, which simulates a visual effect occurring at the location (or show element) pointed to by the handheld device within the stage area, as seen from the perspective of the handheld device operator.

[0042] Method 200 also includes controlling the aforementioned show elements or props on the stage to correspond to selected visual effects produced by the activation of at least one light in block 208 (block 210). For example, the control of a show element can be synchronized with a visual effect. In practice, a visual effect directed at a show element can be synchronized with the movement of the show element (e.g., lateral movement, forward and backward movement, destruction, splitting, joining). The controller can adjust the activation of at least one light and the movement of the show element so that they occur substantially simultaneously and / or in an order that gives the operator of the handheld device the impression that the visual effect and the movement of the show element were caused by the handheld device and a spell.

[0043] The interactive Peppers Ghost system described above can enable improved audience interaction with show attractions in entertainment venues. Improved audience interaction, which allows audience members (e.g., guests) to control various aspects of the show attraction, can enhance guest attention and entertainment value.

[0044] While only some features of the present invention have been illustrated and described herein, many modifications and changes will come to mind for those skilled in the art. Therefore, it should be understood that the appended claims are intended to cover all such modifications and changes that are part of the actual spirit of the invention.

[0045] The claimed technologies described herein refer to and apply to tangible objects and specific examples of a practical nature that are not abstract, intangible, or purely theoretical, but which certainly improve the art. Furthermore, if any of the claims appended to the end of this specification contain one or more elements designated as "...means for performing [function]" or "...steps for performing [function]," such elements should be interpreted in accordance with 112(f) of the United States Patent Act. On the other hand, any claim containing elements designated in any other form should not be interpreted in accordance with 112(f) of the United States Patent Act. [Explanation of symbols]

[0046] 10. Interactive Peppers Ghost System 12 Passenger compartments 14 Handheld devices 16 Stage Compartments 18 Show elements 20 Show elements 21 Projector 22 Central compartment 24 screens 26 Darkroom Compartments 30 Lights 32 controllers 34 processors 36 memory 38 Infrared Sensor 39 Distance from infrared sensor 40 Infrared Emitter 41 angle 42 Infrared reflector 43 Line of sight 47 angle 49 Line of sight 50 Actuating Assembly 51 Horizontal 52 Actuator Assembly 53 parts 54 parts 56 Mike

Claims

1. It is an interactive Peppers Ghost system, Handheld device and The stage space and The audience space and A transparent or translucent screen is placed between the handheld device and the stage space, A sensor configured to detect a parameter indicating the orientation of the handheld device held by a guest in the aforementioned audience space, Controller and Equipped with, The aforementioned controller, The sensor receives sensor feedback from the sensor corresponding to the parameter indicating the orientation of the handheld device. Based on the sensor feedback, the position of the handheld device in the stage space to which it is directed is determined. The transparent or translucent screen is used to generate the Pepper's Ghost visual effect, and the effect is simulated at the location in the stage space. An interactive Pepper's Ghost system configured in this way.

2. The handheld device includes an infrared emitter configured to direct infrared light towards the handheld device, the handheld device includes an infrared reflector configured to reflect the infrared light, and the sensor includes an infrared sensor configured to detect the infrared light. The interactive Peppers Ghost system according to claim 1.

3. The controller is equipped with a light source that is communicatively coupled to it, and the controller is configured to generate the Pepper's Ghost visual effect by controlling the light source to cause a projection of light onto the transparent or translucent screen. The interactive Peppers Ghost system according to claim 1.

4. The stage space includes show elements arranged therein, and the controller is configured to generate the Pepper's Ghost visual effect such that the effect aesthetically interacts with the show elements from a viewpoint in or adjacent to the handheld device. The interactive Peppers Ghost system according to claim 1.

5. The system comprises an actuator configured to cause the movement of the show element, and the controller is configured to control the actuator based on sensor feedback so that the movement of the show element is synchronized with the effect. The interactive Peppers Ghost system according to claim 4.

6. The light source is communicatively coupled to the controller, the light source includes a plurality of LED lights arranged in a grid, the controller is configured to determine the rows and columns of the grid based on the position, and the controller is configured to activate at least one LED light located within the row and column of the plurality of LED lights, causing the projection of the light from the at least one LED light onto the transparent or translucent screen to produce the Pepper's Ghost visual effect. The interactive Peppers Ghost system according to claim 1.

7. A first room, defined by at least one first wall, is configured to accommodate audience members holding the aforementioned handheld device. A second room, configured to house the transparent or translucent screen of the Interactive Peppers Ghost System, is connected to the first room and is defined by at least one second wall, A third room is configured to accommodate or define the stage space, connected to the second room so as to be arranged in a straight line together with the first room and the second room, and defined by at least one third wall, A fourth room configured to house a light source, connected to the second room, offset from the straight line, and defined by at least one fourth wall, The interactive Peppers Ghost system according to claim 1, comprising:

8. The at least one first wall, the at least one second wall, the at least one third wall, and the at least one fourth wall are connected at the joint via hinges such that the at least one first wall, the at least one second wall, the at least one third wall, and the at least one fourth wall are foldable in a stacked manner. The interactive Peppers Ghost system according to claim 7.

9. It is an entertainment system, The stage space and Handheld device and The audience space and A transparent or translucent screen is placed between the stage space and the handheld device. Multiple light-emitting elements directed towards the transparent or translucent screen, A sensor configured to monitor the orientation of the handheld device held by a guest in the aforementioned audience space, Controller and Equipped with, The aforementioned controller, Receiving sensor feedback from the sensor indicating the orientation of the handheld device, Based on the sensor feedback, the position of the handheld device in the stage space to which it is directed is determined. Based on the aforementioned position, select at least one of the plurality of light-emitting elements, The system is configured to activate at least one of the light-emitting elements to emit light onto the transparent or translucent screen, thereby simulating the Peppers ghost effect at the specified location. Entertainment system.

10. The plurality of light-emitting elements are arranged in a grid, and the controller is Based on the aforementioned position, the rows and columns of the grid are determined, Select at least one of the light-emitting elements located in the aforementioned row and column, The at least one light-emitting element is activated to emit light onto the transparent or translucent screen, thereby simulating the Peppers ghost effect at the specified location. It is structured in such a way. The entertainment system according to claim 9.

11. The controller is equipped with a microphone that is communicatively coupled to it and configured to detect audio or voice commands from the operator of the handheld device, the controller is configured to receive data feedback from the microphone indicating the audio or voice commands, and the controller is configured to control the at least one light-emitting element in response to the data feedback from the microphone. The entertainment system according to claim 9.

12. The folding housing comprises a plurality of foldable walls defining an audience compartment in which the handheld device is located, a central compartment in which the transparent or translucent screen is located, a stage compartment in which the stage space is located or defined, and a darkroom compartment in which the plurality of lights are located, wherein the audience compartment, the central compartment and the stage compartment are arranged in a straight line such that the central compartment is located between the audience compartment and the stage compartment, the darkroom compartment is connected to the central compartment and offset from the straight line, and the plurality of foldable walls are foldable in a stacked manner via hinged joints connecting the plurality of foldable walls. The entertainment system according to claim 11.

13. It is an interactive Peppers Ghost system, The stage space and A handheld device configured to be held by an operator, The audience space and A transparent or translucent screen is placed between the stage space and the handheld device. A sensor configured to monitor the orientation of the handheld device held by the operator within the audience space, A microphone configured to detect voice audio from the operator, Controller and The controller is equipped with, The sensor receives a first data feedback indicating the orientation of the handheld device. Based on the first data feedback described above, the position of the handheld device in the stage space to which it is directed is determined. Receiving a second data feedback indicating the voice audio from the operator, Based on the data feedback described above, a voice command is selected from among several available voice commands. Based on the position determined by the controller and the voice command determined by the controller, at least one of the multiple light-emitting elements is activated, the at least one light-emitting element emits light onto the transparent or translucent screen, and generates a Pepper's Ghost effect to simulate the effect at the position. It is configured in such a way. Interactive Peppers Ghost System.

14. The stage space comprises physical show objects, the controller is configured to control the physical movement of the physical show objects, and the controller synchronizes the physical movement of the physical show objects with the effects. The interactive Peppers Ghost system according to claim 13.

15. The aforementioned controller, From the sensor, a third data feedback is received indicating an additional orientation of the handheld device that is different from the orientation. Based on the third data feedback described above, an additional position in the stage space to which the handheld device is directed, different from the position described above, is determined. Based on the additional position determined by the controller, at least one of the plurality of light emitters is activated, and the at least one additional light emitter emits additional light onto the transparent or translucent screen, generating an additional Pepper's Ghost effect to simulate an additional effect at the additional position. It is structured in such a way. The interactive Peppers Ghost system according to claim 13.

16. The plurality of light-emitting elements are arranged in a grid, and the controller is Based on the first data feedback, the rows and columns of the grid are determined. Select at least one of the light-emitting elements located in the aforementioned row and column, Activating the at least one light-emitting element, the at least one light-emitting element emits the light at the position on the transparent or translucent screen, thereby generating the Pepper's Ghost effect. It is structured in such a way. The interactive Peppers Ghost system according to claim 13.