SYSTEM AND METHOD FOR GENERATING RESPONSE TO INTERACTIONS IN AN INTERACTIVE ENVIRONMENT - Patent application

Abstract

The interaction system (10) includes a portable device (16) configured for use within an interactive environment (14). The portable device (16) includes an input mechanism for initiating the launch of a virtual flying object (70). The interaction system (10) also includes a control system (32) including one or more processors (34). The one or more processors (34) receive data indicative of a position and orientation of the portable device (16) and receive additional data indicative of actuation of the input mechanism. The one or more processors (34) also determine a successful virtual interaction between an interactive physical element (30) and the virtual flying object (28) based on the position and orientation of the portable device 16 during actuation of the input mechanism, and adjust the interactive virtual element (28) displayed on the display screen (26) in response to the successful virtual interaction of the interactive physical element (30).

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Provisional Patent Application No. 63 / 325,412, filed March 30, 2022, and entitled "SYSTEMS AND METHODS FOR PRODUCING RESPONS TO INTERACTIONS WITHIN AN INTERACTIVE ENVIRONMENT," which is incorporated by reference in its entirety and for all purposes. [Background technology]

[0002] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present disclosure. This discussion is believed to be helpful in providing the reader with background to facilitate a better understanding of the various aspects of the present disclosure. As such, these statements should be read in this light, and not as admissions of prior art.

[0003] An amusement park may include a variety of entertainment attractions. Some entertainment attractions may provide guests with an interactive environment. For example, guests may view animated characters on display screens within the interactive environment and provide input to control the movement of the animated characters on the display screens within the interactive environment. Summary of the Invention

[0004] The following summarizes certain embodiments common in scope to the subject matter of the original claims. These embodiments are not intended to limit the scope of the disclosure, but rather to provide merely a brief summary of some disclosed embodiments. Indeed, the disclosure may include a variety of forms that may be similar to or different from the embodiments set forth below.

[0005] In one embodiment, an interaction system includes a portable device configured for use in an interactive environment. The portable device includes an input mechanism for initiating the launch of a virtual flying object. The interaction system also includes a control system including one or more processors. The one or more processors receive data indicative of a position and orientation of the portable device, receive additional data indicative of actuation of the input mechanism, determine a successful virtual interaction between an interactive physical element and the virtual flying object based on the position and orientation of the portable device during actuation of the input mechanism, and adjust an interactive virtual element displayed on a display screen in response to the successful virtual interaction between the interactive physical element and the virtual flying object.

[0006] In one embodiment, an interaction system includes a portable device configured to be carried by a user as the user moves through an interactive environment. The portable device includes an input mechanism for initiating launch of a virtual flying object. The interaction system also includes a control system including one or more processors. The one or more processors receive data indicative of a position and orientation of the portable device, receive additional data indicative of actuation of the input mechanism, and determine a successful virtual interaction of a first type of interaction element with the virtual flying object based on the position and orientation of the portable device during actuation of the input mechanism. The one or more processors also adjust a second type of interaction element in response to a successful virtual interaction of the interactive physical element with the virtual flying object, the first type of interaction element including an interactive physical element and the second type of interaction element including an interactive virtual element, or the first type of interaction element including an interactive virtual element and the second type of interaction element including an interactive physical element.

[0007] In one embodiment, a method includes receiving an indication of actuation of an input mechanism on a portable device to launch a virtual flying object based on a position and orientation of the portable device during actuation of the input mechanism, and determining a success of the virtual interaction between a first type of interaction element and the virtual flying object. The method also includes controlling a second type of interaction element to produce a reaction in response to a success of the virtual interaction between the first type of interaction element and the virtual flying object, where the first type of interaction element includes an interactive physical element and the second type of interaction element includes an interactive virtual element, or the first type of interaction element includes an interactive virtual element and the second type of interaction element includes an interactive physical element.

[0008] These and other features, aspects, and advantages of the present disclosure will be better understood from the following detailed description when read in conjunction with the accompanying drawings, in which like parts are designated with like numerals throughout. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram of an interactive system according to an embodiment. [Diagram 2] 4 is a flow diagram of a method for controlling an interaction element in response to successful targeting of an interaction element by a portable device according to a present embodiment. [Diagram 3] FIG. 2 is a schematic diagram of an interactive system in which successful targeting of an interactive physical element results in a reaction via interactive physical elements and interactive virtual elements, according to an embodiment. [Figure 4] FIG. 1 is a schematic diagram of an interaction system in which successful targeting of interactive physical elements spread throughout a virtual space produces reactions within the virtual space, according to an embodiment of the present invention. [Diagram 5] 1 is a flow diagram of a method for controlling a first interaction element in response to successful targeting of a second interaction element by a portable device according to a present embodiment. [Figure 6]1 is a schematic diagram of an interactive system in which the operation of an interactive virtual element causes a reaction in an interactive physical element, according to an embodiment; [Figure 7] 1 is a schematic diagram of an interactive system showing a virtual flying object as an interactive virtual element according to an embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] One or more specific embodiments are described below. In order to describe these embodiments concisely, not all features of the implementations may be described herein. It should be understood that the development of any such implementation, as in any engineering or design project, requires numerous implementation-specific decisions to be made in order to achieve the developer's particular objectives, such as adhering to system-related and business-related constraints that may vary from implementation to implementation. Moreover, it should be understood that such a development effort may be complex and time-consuming, but would be a routine undertaking of design, fabrication and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0011] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," "the," and "said" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. One or more specific embodiments of the present embodiments described herein will be described below. In order to describe these embodiments concisely, not all features of the implementation may be described herein. It should be noted that the development of any such implementation, as in any engineering or design project, requires numerous implementation-specific decisions to be made to achieve the developer's particular objectives, such as adhering to system-related and business-related constraints that may vary from implementation to implementation. Moreover, such development efforts may be complex and time-consuming, but are routine undertakings of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0012] The present disclosure generally relates to interactive environments that utilize portable devices to provide interactive experiences to guests (e.g., users). In some embodiments, the interactive environments are implemented within amusement park attractions, such as ride attractions where guests are transported in ride vehicles through the interactive environment and / or walk-through attractions where guests walk through the interactive environment. In some embodiments, the amusement park attractions can be hybrid attractions where guests are both transported through the interactive environment (e.g., on a moving walkway) and can also walk through (e.g., along a moving walkway). The interactive environments can also be distributed across multiple different amusement park attractions, such as multiple different ride attractions, walk-through attractions, and / or hybrid attractions. Additionally or alternatively, the interactive environments can be contained within one or more themed areas and / or distributed across multiple different themed areas having a common theme or different themes. Additionally or alternatively, the interactive environment can include a live show (e.g., including performers), and guests in the audience can participate in the live show using the portable devices.

[0013] The portable device can be any of a variety of types of devices configured to be carried, held, and / or worn by a guest. For example, the portable device can include a targeting device (e.g., a blaster gun), a wand, a toy, a figurine, clothing, jewelry, a bracelet, headgear, a medal, glasses, and / or any combination thereof (e.g., a targeting device integrated into a bracelet). In some embodiments, the portable device can be configured to be used by multiple different guests over a period of time. For example, a guest can receive a portable device at an entrance to an interactive environment, use the portable device to participate in the interactive environment as they move through the interactive environment, and return the portable device when they exit the interactive environment. The portable device becomes available again at the entrance to the interactive environment, and another guest can receive the portable device at the entrance to the interactive environment and use the portable device to participate in the interactive environment, and so on.

[0014] As described herein, the portable device can enable the guest to interact with (e.g., control) features within the interactive environment. For example, the portable device can be a targeting device, and the guest can activate an input mechanism (e.g., a trigger switch, a push button) of the portable device to initiate a simulation of firing (e.g., virtual firing) a virtual projectile at an interactive element (e.g., a physical interactive element in a physical, real-world space or a virtual interactive element in a virtual space on a display screen) within the interactive environment. In response, the interactive environment can depict the virtual projectile impacting (e.g., colliding, hitting) the interactive element. For example, the display screen can display a visual (e.g., movie, video) depicting the virtual projectile impacting (e.g., colliding, hitting) the interactive element. In another example, a change in the behavior of the physical interactive element or the presence of special effects (e.g., sound, light, smoke, vibration) in the interactive environment can indicate successful targeting of the physical interactive element.

[0015] Generally, there can be two types of interactive elements: interactive physical elements, which are props or physical objects in the physical real space in the interactive environment, and interactive virtual elements, which are images / animations of virtual objects displayed in the virtual space on the display screen. Interactive physical elements and interactive virtual elements can be dynamic interactive elements that include parts that move around and / or move in the interactive environment / on the display screen. Also, interactive hybrid elements can be interactive physical elements and interactive virtual elements at the same time by having physical parts in the physical real space in the interactive environment and virtual parts displayed in the virtual space on the display screen. "Interactive element" in this specification generally refers to either interactive physical elements, interactive virtual elements, or interactive hybrid elements.

[0016] FIG. 1 illustrates an interaction system 10 for facilitating interaction within an interactive environment 14, according to an embodiment of the present disclosure. The interactive environment 14 may reside within an amusement park attraction or other suitable location. As illustrated, a guest (e.g., a user) 12 may carry or otherwise be associated with a portable device 16 that includes a processor 18, a memory device 20, and additional components 22. The additional components 22 may include input mechanisms (e.g., trigger switches, push buttons), light emitting devices (e.g., light emitting diodes [LEDs]), haptic devices, a display screen, a battery (and battery management system), a speaker, a microphone, an inertial measurement unit, near field communication (NFC) circuitry, and / or ultra-high frequency (UHF) circuitry. The portable device 16 may be used to target and / or interact with interactive elements (e.g., interactive virtual elements, interactive physical elements, and / or interactive hybrid elements).

[0017] The portable device 16 may advantageously be equipped with an ultra-wideband (UWB) tag 24 that allows for monitoring (e.g., continuous monitoring) of the position and / or orientation of the portable device 16 (e.g., relative to a coordinate system and within the interactive environment 14). The UWB tag 24 is also part of UWB circuitry (e.g., a UWB system) that generates and efficiently conveys position and / or orientation data that may enable the interactive environment control system 32 to accurately determine the success of the virtual interaction between the interactive element and the portable device 16 (e.g., successful targeting of the interactive element). It should be understood that any other suitable components (e.g., one or more sensors, such as an accelerometer on the portable device 16 and communication circuitry that transmits data from the sensor to the interactive environment control system 32, one or more sensors, such as imaging sensors / cameras, external to the portable device 16 and within the interactive environment 14) may also be utilized to detect the position and / or orientation of the portable device 16. In some embodiments, the position and / or orientation of the portable device 16 is detected without utilizing light emitters, lasers, or line-of-sight sensing devices.

[0018] The interactive environment 14 may include one or more display screens 26 configured to display interactive virtual elements 28. The interactive virtual elements 28 may include images (e.g., motion pictures, videos) of animated objects such as symbols, coins / prize winnings, vehicles, and / or characters. The interactive virtual elements 28 may move in two dimensions (2D) within a virtual space on the display screens 26. The interactive environment 14 may also include one or more interactive physical elements 30 disposed or embedded within the interactive environment 14. The interactive physical elements 30 may include physical structures, props, vehicles, and / or robots. The interactive physical elements 30 may move in three dimensions (3D) within a physical real space within the interactive environment 14.

[0019] The guest 12 may be presented with interactive elements as the guest 12 moves through the interactive environment 14. For example, an image of an animated object may move across the display screen 26 and / or a robot may move through the interactive environment 14. The guest 12 may use the portable device 16 to virtually interact with (e.g., target) the interactive elements, such as by activating an input mechanism of the portable device 16 to launch a virtual flying object at the interactive element. The virtual flying object may not have a physical embodiment or actual representation (e.g., the virtual flying object may be invisible or undetectable and may not exist in the physical real space and / or in the virtual space). However, in some embodiments, an image of the virtual flying object may be shown on the display screen 26. The interactive element may also respond to the virtual interaction with the virtual flying object by producing a reaction (e.g., moving, stopping, disappearing, ducking, agitating) that provides the guest 12 with feedback regarding the trajectory of the virtual flying object.

[0020] In some embodiments, the interaction system 10 may award points (e.g., achievements) to the guest 12 for each successful "attack" of an interactive element and add these points to the guest profile of the guest 12. In some embodiments, the interactive environment control system 32 (also referred to herein as "control system 32") may track the success of targeting the interactive elements and update (e.g., in real time) the guest profile of the guest 12 as the guest 12 moves through the interactive environment 14. The guest profile and associated award points may be stored in one or more databases 40 accessible to the interactive environment control system 32. In some embodiments, a processor 34 (e.g., the processor 34 of the control system 32) may transfer the award points and / or the final guest profile at the end of an interactive experience to one or more databases 40 for use in future interactive experiences. In this manner, the guest profile of the guest 12 may be maintained and updated across multiple visits to the interactive environment 14.

[0021] The interactive environment control system 32 may be responsible for controlling the interactive physical elements 30 and the interactive virtual elements 28 to produce responses to virtual interactions (also referred to herein as "interactions") between the virtual projectiles launched by the portable device 16 and the interactive elements in the interactive environment 14. For example, the control system 32 may move or otherwise change the interactive elements (e.g., the interactive elements duck and / or move to avoid being targeted) in response to position and / or orientation data indicating that the portable device 16 is aiming at an interactive element before and / or during actuation of an input mechanism.

[0022] The control system 32 may also be responsible for tracking interactions between physical objects (e.g., the portable device 16 and the interactive physical elements 30) and virtual objects (e.g., the interactive virtual elements 28) in the interactive environment 14. As described above, this tracking may involve calculating the trajectory of the virtual flying object (e.g., based on position and / or orientation data during actuation of the input mechanisms and the respective positions of the interactive elements) to determine whether the virtual flying object can reach or has reached a target.

[0023] The control system 32 may include a processor 34, a memory device 36, and communications circuitry 38 to enable it to control features within the interactive environment 14 (e.g., control interactive elements and / or generate special effects within the interactive environment 14) and / or communicate with the portable device 16. The processor 34, the memory device 36, and the communications circuitry 38 may enable the control system 32 to control the movement of the interactive physical elements 30 and the interactive virtual elements 28, track the positions of the interactive physical elements 30 and the portable device 16, access the positions of the interactive virtual elements 28, and calculate / simulate the trajectories of the virtual projectiles.

[0024] The memory device 36 may include one or more tangible, non-transitory computer-readable media that store instructions executable by the processor 34 and / or data (e.g., guest profiles) processed by the processor 34. For example, the memory device 36 may include a random access memory (RAM), a read-only memory (ROM), a rewriteable non-volatile memory such as a flash memory, a hard drive, and / or an optical disk. The processor 34 may also include one or more general-purpose microprocessors, one or more application specific processors (ASICs), one or more field programmable gate arrays (FPGAs), or any combination thereof. Additionally, the memory device 36 may store instructions executable by the processor 34 to perform the methods and control operations for the interaction system 10 described herein.

[0025] Tracking the virtual interaction (between the portable device 16 and the interactive elements) can include mapping physical objects (e.g., the portable device 16 and the interactive physical elements 30) that exist in the physical real space onto the virtual / interaction space. In some embodiments, the virtual space and the interaction space can be the same space. In this case, the interactive virtual elements 28 that exist in the virtual space may not need to be mapped. In some embodiments, the virtual space can be different from the interaction space. In this case, the interactive virtual elements 28 can be mapped from the virtual space to the interaction space.

[0026] Generally, the physical real space refers to a "space" in which only interactions between physical objects (e.g., portable device 16, interactive physical elements 30) and the guest 12 take place. That is, the physical real space is where the guest 12 is physically present. The virtual space refers to a "space" on the display screen 26 that is visible to the guest 12. The image on the display screen 26 may not appear to be two-dimensional (2D). Instead, the image on the display screen 26 may appear to be a three-dimensional (3D) extension of the interactive environment 14 (e.g., an extension of the physical real space and / or an extension connected to the real space). The interaction space is a "space" in which dynamic interactions between physical objects (e.g., portable device 16, interactive physical elements 30) and virtual objects (e.g., virtual flying objects, interactive virtual elements 28) take place. For example, a virtual flying object may "hit" an interactive physical element 30 in the interaction space. In this way, the interaction space allows the guest 12 to interact across the physical real space and the virtual space and to observe such interactions.

[0027] In general, there are various ways to map physical / virtual objects into the interaction space. In one embodiment, mapping the portable device 16 and interactive physical elements 30 from the physical real space to the interaction space can involve tracking the positions of the portable device 16 and interactive physical elements 30 in the physical space via the UWB tag 24 and translating these positions onto the interaction space. In one embodiment, mapping the interactive physical elements 30 and interactive virtual elements 28 from the physical / virtual space to the interaction space can involve accessing pre-programmed positions / movements of the interactive physical elements 30 and interactive virtual elements 28 via the processor 34 of the control system 32 and translating the pre-programmed positions / movements into the interaction space. In this embodiment, the exact positions of the interactive elements can be known without using the UWB tag 24. In one embodiment, mapping the portable device 16 and interactive elements into the interaction space can involve a combination of the above embodiments (e.g., tracking the positions of the portable device 16 and interactive physical elements 30 using the UWB tag 24 and evaluating the pre-programmed positions / movements of the interactive physical elements 30 and interactive virtual elements 28).

[0028] In one embodiment, the UWB tags 24 may be used to track the location of the portable devices 16 and the interactive physical elements 30. In particular, the UWB tags 24 and UWB anchors 44, in communication with the control system 32, may be part of a real-time location tracking system that performs continuous location tracking (e.g., position and / or orientation tracking) within the interactive environment 14. For example, the UWB tags 24 on the portable devices 16 and the interactive physical elements 30 may communicate and transmit positioning data to UWB anchors 44, which may be distributed throughout the interactive environment 14. The UWB anchors 44 may then transmit the positioning data to the control system 32.

[0029] Data from the UWB tag 24 and the UWB anchor 44 may enable the processor 34 to perform trajectory mapping of the virtual projectile (e.g., determine a trajectory, such as a virtual flight path) within the interaction space. The trajectory of the virtual projectile may be used to represent the "hit" location and / or impact angle of the virtual projectile within the interactive environment 14 (e.g., on the display screen 26) to provide a realistic experience to the guest 12. For example, since the virtual projectile is not visible in the physical reality space, when the guest 12 "fires" the virtual projectile at the interactive physics element 30, the arrival of the virtual projectile at the interactive physics element 30 is unknown to the guest 12. However, the trajectory of the virtual projectile may be calculated / simulated within the interaction space, and the mapped location of the interactive physics element 30 may be used to determine the likelihood of a collision. Thus, the success of the virtual interaction (e.g., targeting, aiming, "hitting", "hitting") between the interactive physics element 30 and the virtual projectile within the interaction space may be determined. A successful virtual interaction with the interactive physics element 30 may result in a reaction, and the trajectory of the virtual projectile may affect this reaction. For example, after a virtual projectile "hits," the interactive physics element 30 can collapse in the direction of the "hit."

[0030] In some embodiments, the additional components 22 of the portable device 16 can provide various types of feedback (e.g., special effects) to the guest 12 based on the interaction between the portable device 16 and the interactive elements in the interactive environment 14. For example, the additional components 22 (e.g., lights, haptics, display screen, speakers) can provide respective feedback upon successful targeting of the interactive element and / or upon point allocation to the guest profile. For example, the feedback provided by the additional components 22 can involve vibration / recoil when the virtual projectile is "fired". In another example, the feedback provided by the additional components 22 in response to the virtual projectile "hitting" the interactive virtual element 28 can include a bang sound emitted by the speaker(s). In some embodiments, the additional device(s) providing the feedback / special effects (e.g., lights, haptics, speakers, or a combination thereof) can be distributed throughout the physical real space in the interactive environment 14.

[0031] 2 is a flow diagram of a method 50 for controlling an interaction element in response to successful targeting of an interaction element by a portable device, such as the portable device 16 of FIG. 1, according to an embodiment. The method 50 includes various steps, represented by blocks. It should be noted that at least some steps of the method 50 may be performed as an automated procedure by a system, such as the interaction system 10 of FIG. 1. Although the flow chart shows the steps in a particular order, it should be understood that the steps may be performed in any suitable order, and some steps may be performed simultaneously, where appropriate. Also, steps may be added to or omitted from the method 50. Additionally, some or all of the steps of the method 50 may be performed by the processor 34 of the control system 32 of FIG. 1.

[0032] At block 52, the method 50 may include receiving an indication of activation of an input mechanism on the portable device 16. Activation of the input mechanism may indicate a "launch" of the virtual air vehicle by the portable device 16. Upon activation of the input mechanism / "launch" of the virtual air vehicle, a position and orientation of the portable device 16 may be recorded that may be continuously monitored by UWB circuitry (e.g., UWB tag 24 and UWB anchor 44) and / or other suitable components. The position and orientation of the portable device 16 may be transmitted to the control system 32 for calculation / simulation of the trajectory of the virtual air vehicle.

[0033] At block 54, the method 50 may include determining successful targeting of the interaction element based on the position and orientation of the portable device 16 during actuation of the input mechanism. Determining successful targeting of the interaction element may involve mapping the portable device 16 and the targeted interaction element onto the interaction space. Physics may then be applied to calculate the trajectory of a virtual flying object "fired" by the portable device 16. In some embodiments, it may be unclear which of the multiple interaction elements was targeted. In this case, all interaction elements close to the trajectory of the virtual flying object may be mapped onto the interaction space to determine the likelihood of successful targeting. In some embodiments, a threshold distance (e.g., the distance measured between the virtual flying object and the target at the closest point in the interaction space) may be used to determine successful targeting of the interaction element. For example, the virtual flying object must come within at least one inch of the target to count as a "hit."

[0034] The virtual projectiles may appear to be made of different materials depending on the theme / guest profile of the immersive experience. For example, if the theme of the interactive environment 14 is water / poolside, the portable device 16 may appear as a water gun and the virtual projectiles may appear as water jets / streams on the display screen 26. In this case, water / fluid physics may be applied within the interactive space to calculate / simulate the trajectory of the water-based virtual projectiles.

[0035] At block 56, the method 50 may include controlling the interactive element to produce a reaction upon detection of successful targeting of the interactive element. Controlling the interactive element to produce a reaction to successful targeting may involve generating a signal in the control system 32 that causes the targeted interactive element to change in a manner noticeable to the guest 12. For example, the interactive physical element 30 may stop, fall, jump, and / or vibrate in response to being "hit" by the virtual projectile. Further examples of interactive element reactions to successful targeting by a virtual projectile from the portable device 16 are shown in Figures 3 and 4.

[0036] 3 is a schematic diagram of an interaction system 10 in which successful targeting of an interactive physical element 30 results in a reaction in the interactive physical element 30, according to an embodiment of the present invention. As shown, the interactive environment 14 includes a display screen 26, a vehicle 30A which is an interactive physical element 30, and a blaster gun 16A which is a portable device 16 held by a guest 12. Upon "firing" the virtual projectile, an additional component such as an LED on the blaster gun 16A can instantly (e.g., substantially instantly, such as within milliseconds) generate an effect such as a flash of light. This effect can provide feedback to the guest 12 that the blaster gun 16A has "fired."

[0037] UWB circuitry (e.g., UWB tag 24 and UWB anchor 44) can be used to detect and record the position and orientation of blaster gun 16A and vehicle 30A when the input mechanism is actuated. Continuous (e.g., real-time) monitoring using UWB circuitry can also indicate whether vehicle 30A and / or blaster gun 16A were moving when the trigger was actuated. If so, the speed and / or acceleration of vehicle 30A and / or blaster gun 16A can be calculated. In an embodiment, the position (e.g., position coordinates), orientation, speed and / or acceleration of vehicle 30A and blaster gun 16A can be used to simulate / calculate the trajectory of the virtual projectile and vehicle 30A in the interaction space after the blaster gun 16A is "fired." This simulation / calculation of the trajectory in the interaction space can be used to determine whether the virtual projectile from blaster gun 16A "hit" vehicle 30A.

[0038] The trajectory simulation of the virtual projectile may be accurate enough to determine which part of the vehicle 30A has been "hit." For example, in the illustrated embodiment, the tire of the vehicle 30A has been "hit." In response (e.g., in response to determining that the targeting of the tire of the vehicle 30A has been successful), the vehicle 30A may stop moving (e.g., the tire of the vehicle 30A may appear to be damaged / exploded due to the tire of the vehicle 30A deflating, breaking, or exploding, which may be represented through a physical change in the tire of the vehicle 30A). In addition, the damaged / exploded tire fragments 28A may be represented as interactive virtual elements 28 and shown on the display screen 26 to provide further feedback to the guest 12 that the targeting of the tire of the vehicle 30A has been successful. The stopping of the vehicle 30A and the appearance of the damaged / exploded tire fragments 28A may be accompanied by sound effects emitted from the speaker(s) of the blaster gun 116A and / or throughout the interactive environment 14. For example, these sound effects can include the sound of a car screeching to a halt and the sound of air deflated tires. The sound effects can provide further feedback to guest 12 in response to successful targeting of vehicle 30A. In this manner, guest 12 can experience an immersive experience in which interactive physics element 30 (e.g., vehicle 30A) or a portion thereof (e.g., damaged / exploded tire fragments 28A) moves and / or extends into virtual space (e.g., moves into virtual space represented as interactive virtual element 28) in response to successful targeting of interactive physics element 30.

[0039] 4 is a schematic diagram of an interaction system 10 in which a reaction occurs on an interactive physical element 30 having a virtual component upon successful targeting of the interactive physical element 30 having a virtual component, according to the present embodiment. As shown, the interactive environment 14 includes an interactive physical element 30, a fuse 30B, and an interactive virtual element 28, a firework body 28B, on a display screen 26. Taken together, the fuse 30B and the firework body 28B are a single interactive element (e.g., a firework) that has components in both the physical real space and the virtual space. The fuse 30B appears to extend from the physical real space into the virtual space, where it is "connected" to the firework body 28B. In reality, the firework body 28B is an image that appears on the display screen 26, and the fuse 30B can be a physical fuse adjacent / attached to the display screen 26. The interactive environment 14 also includes a blaster gun 16A, which is a portable device 16 held by the guest 12.

[0040] Activating the input mechanism of the blaster gun 16A "fires" a virtual projectile. The virtual projectile may "hit" the fuse 30B and ignite the fuse 30B (e.g., light one or more lights disposed along the fuse 30B). Ignition of the fuse 30B may cause a spark to appear to travel from the fuse 30B to the firework body 28B on the display screen 26. After the spark reaches the firework body 28B, an image of an exploding firework may appear on the display screen 26 and / or the firework body 28B may disappear from the display screen 26. Thus, successful targeting of a physical component (e.g., the fuse 30B) of a hybrid interaction element (e.g., an interaction element having a physical component and a virtual component) may cause a reaction in the virtual component (e.g., the firework body 28B). In some embodiments, successful targeting of a virtual component of a hybrid interaction element may cause a reaction in the physical component of the hybrid interaction element. Additionally, as described, successful targeting of either the physical or virtual components of the hybrid interaction element can result in a reaction in both the physical and virtual components of the hybrid interaction element (e.g., fuse 30B being lit causing firework body 28B to explode, and fuse 30B being extinguished causing firework body 28B to explode after lighting, such as by physically moving fuse 30B out of the guest 12's field of view).

[0041] In some embodiments, an interactive virtual element (e.g., firework body 28B, firework) associated with an interactive physical element (e.g., fuse 30B) may not be displayed on display screen 26 prior to "hitting" the interactive physical element. Instead, an interactive virtual element may appear on display screen 26 by "hitting" an interactive physical element that appears to connect or extend into the virtual space of display screen 26. In such cases, the interactive physical element and the interactive virtual element may appear to have some connection even though they do not form a hybrid interactive element (e.g., the interactive physical element may be proximate to and / or terminate at display screen 26, and "hitting" one may change the other). In general, the interactive physical element and the interactive virtual element may be coordinated to provide various visual effects, such as a visual effect in which at least a portion of the interactive physical element transitions into the virtual space shown on display screen 26, and / or may provide effects in such a coordinated manner (e.g., coordinated in time and space).

[0042] It will be appreciated that feedback can be provided to guest 12 by special effects emanating from additional components located on blaster gun 16A or distributed throughout interactive environment 14. For example, a bang of blaster gun 16A conveyed by haptic technology that may be part of blaster gun 16A can indicate that a virtual projectile has been "fired," and a firework explosion can be accompanied by a firework explosion sound emitted by a speaker in interactive environment 14.

[0043] 5 is a flow diagram of a method 60 for controlling a second interaction element in response to successful targeting of a first interaction element by a portable device, such as the portable device 16 of FIG. 1, according to an embodiment. The method 60 includes various steps, represented by blocks. It should be noted that at least some steps of the method 60 may be performed as an automated procedure by a system, such as the interaction system 10 of FIG. 1. Although the flow diagram shows the steps in a particular order, it should be understood that the steps may be performed in any suitable order, and some steps may be performed simultaneously, where appropriate. Also, steps may be added to or omitted from the method 60. Additionally, some or all of the steps of the method 60 may be performed by the processor 34 of the control system 32 of FIG. 1.

[0044] At block 62, the method 60 may include receiving an indication of actuation of an input mechanism on the portable device 16. Activation of the input mechanism may indicate a "launch" of the virtual air vehicle by the portable device 16. Upon "launching" of the virtual air vehicle, a position and orientation of the portable device 16 may be recorded that may be continuously monitored by UWB circuitry (e.g., UWB tag 24 and UWB anchor 44) and / or other suitable components. The position and orientation of the portable device 16 may be transmitted to the control system 32 for calculation / simulation of a trajectory of the virtual air vehicle.

[0045] At block 64, method 60 may include determining successful targeting of the first interaction element based on a position and orientation of portable device 16 during actuation of the input mechanism. Determining successful targeting of the first interaction element may include mapping portable device 16 and the first interaction element onto the interaction space. Physics may then be applied to calculate a trajectory of a virtual projectile launched by portable device 16.

[0046] At block 66, the method 60 may include controlling the second interaction element to produce a reaction upon detection of successful targeting of the first interaction element. Controlling the second interaction element to produce a reaction to successful targeting may involve generating a signal in the control system 32 that changes the targeted second interaction element in a manner noticeable to the guest 12. For example, the second interaction element may be an interactive physical element 30 and may be controlled to stop, fall, jump, and / or vibrate within the interactive environment 14 in response to a virtual flying object "hitting" the interactive virtual element 28. Further examples of interaction element reactions to successful targeting by the portable device 16 are shown in Figures 6 and 7.

[0047] 6 is a schematic diagram of an interaction system 10 in which the action of an interactive virtual element 28 causes a reaction in an interactive physical element 30, according to an embodiment of the present invention. As shown, the interactive environment 14 includes a tree 30C, which is an interactive physical element 30, and a cannon 28C, which is an interactive virtual element 28. The cannon 28C can fire a virtual projectile (e.g., a cannonball) at the tree 30C, and in response, the tree 30C can break to indicate successful targeting by the cannon 28C. The display screen 26 can display an image of the virtual projectile moving away from the cannon 28C. However, the virtual projectile is not a prop or a physical object. Thus, the tree 30C breaks to mimic the presence of the virtual projectile in the physical real space.

[0048] In one embodiment, the "firing" of cannon 28C may be triggered by successful targeting of cannon 28C by a virtual projectile "fired" from guest 12's blaster gun 16A. In this manner, a guest's interaction with an interactive virtual object may cause a reaction in physical real space (e.g., the destruction of a tree). In one embodiment, a guest may antagonize a virtual character by "firing" a virtual projectile from blaster gun 16A at the virtual character, causing the virtual character to "fight back" and cause a reaction in interactive physics element 30.

[0049] In some embodiments, the control system 32 does not calculate or simulate the trajectory of the virtual projectile "fired" by the cannon 28C. Instead, the cannon 28C can be pre-programmed to "fire" at the tree 30C, and the tree 30C can be pre-programmed / triggered to break upon "firing" of the cannon 28C. In some embodiments, the tree 30C can be a static object and not track its location using the UWB tag 24. Instead, its coordinates (e.g., location) and state (e.g., whole or broken) can be known to the interaction space prior to the start of the interaction experience. Similarly, the position of the cannon 28C can also be known within the interaction space, since the cannon 28C is an interactive virtual element 28 with a predetermined / pre-programmed range of motion. It should be understood that there can be multiple interactive physical elements 30 that can be controlled to react to a "hit" by a virtual projectile "fired" by the interactive virtual element 28, and / or there can be at least one such movable interactive physical element 30. Additionally or alternatively, the interactive virtual element 28 may move (e.g., in its position and / or its orientation, its aiming) on ​​the display screen 26 such that a virtual projectile "fired" by the interactive virtual element 28 may have different trajectories over time (and which are calculated by the control system 32, e.g., to determine a "hit" on the interactive physical element(s) 30).

[0050] 7 is a schematic diagram of an interaction system 10 in which a response to successful targeting of an interactive virtual element 28 is the addition of points to a guest profile of the guest 12, according to an embodiment of the present invention. As shown, the interactive environment 14 includes a slingshot 16B, which is a portable device 16 held by the guest 12. The interactive environment 14 also includes a dynamic target 28D (e.g., a bird), which is an interactive virtual element 28 on a display screen 26. A virtual flying object 70 (e.g., a pebble) is shown on the display screen 26.

[0051] The trajectory of the virtual flying object 70 can be calculated / simulated based on the position and / or orientation of the slingshot 16B, and the motion of the dynamic target 28D can be known by being pre-programmed and / or mapped into the interaction space. Points can be credited to the guest profile upon determining successful targeting of the dynamic target 28D by the virtual flying object 70.

[0052] In an embodiment, the guest profile may be at least temporarily associated with a theme. For example, the guest profile may have a fire theme. In response to the guest profile having a fire theme, the representation of the virtual projectile 70 on the display screen 26 may be altered to appear, for example, as a burning object. Special effects / feedback provided to the guest 12 may also be influenced by the theme. For example, a light (e.g., one of the add-on pieces) on the slingshot 16B may light up red upon launch of the projectile. Haptic technology within the interactive environment 14 may provide further feedback to successful targeting of the target in the form of heat flashes. In contrast, if the guest profile has an ice theme, the light on the slingshot 16B and throughout the interactive environment 14 may light up blue and the haptic technology may provide a chill.

[0053] While only certain features have been illustrated and described herein, many modifications and changes will occur to those skilled in the art and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

[0054] The technology presented and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that positively improve the art and are therefore not abstract, intangible, or purely theoretical. Moreover, if any claim appended at the end of this specification contains one or more elements designated as "means for (performing) ... (function)" or "step for (performing) ... (function)," such elements are to be construed pursuant to 35 U.S.C. 112(f). On the other hand, for any claim containing an element designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f). [Explanation of symbols]

[0055] 10 Interaction Systems 12 Guests 14 Interaction environment 16 Portable Devices 18 Processors 20 Memory 22 Additional Components 24 UWB Tags 26 Display 28 Interactive Virtual Elements 30 Interactive Physical Elements 32 Interactive Environmental Control System 34 processors 36 Memory 38 Communication Circuits 40 Databases 44 UWB Anchor

Claims

1. 1. An interacting system comprising: a portable device configured for use in the interactive environment, the portable device including an input mechanism for initiating the launch of a virtual projectile; a control system including one or more processors; wherein the one or more processors: receiving data indicative of a position and orientation of the portable device; receiving additional data indicative of actuation of said input mechanism; determining a successful virtual interaction between an interactive physical element and the virtual flying object based on a position and orientation of the portable device during actuation of the input mechanism; adjusting an interactive virtual element displayed on a display screen in response to a successful virtual interaction between the interactive physical element and the virtual flying object. It is configured as follows: An interactive system characterized by:

2. said interactive physical element and said interactive virtual element forming a hybrid interactive element; An interaction system as claimed in claim 1.

3. the interactive physical elements include props that can move within the interactive environment; 2. An interaction system according to claim 1.

4. the interactive virtual element includes a moving image of a portion of the interactive physical element; 2. An interaction system according to claim 1.

5. the one or more processors are configured to determine a success of the virtual interaction between the interactive physical element and the virtual flying object by simulating a trajectory of the virtual flying object based on a position and orientation of the portable device during actuation of the input mechanism.

2. An interaction system according to claim 1.

6. the one or more processors are configured to display the virtual flying object on the display screen; An interaction system as claimed in claim 1.

7. the one or more processors are configured to adjust the interactive virtual element via a movement, a gesture, a retaliatory action, or a combination thereof, performed by the interactive virtual element; 2. An interaction system according to claim 1.

8. the portable device includes a first ultra-wideband (UWB) circuit, the control system includes a second UWB circuit, and the one or more processors are configured to determine a position and orientation of the portable device based on communication between the first UWB circuit and the second UWB circuit. An interaction system as claimed in claim 1.

9. the one or more processors are configured to receive the additional data indicative of actuation of the input mechanism via the communication between the first UWB circuitry and the second UWB circuitry. An interaction system according to claim 8.

10. the one or more processors are configured to adjust the interactive physics element in response to a success of the virtual interaction between the interactive physics element and the virtual flying object.

2. An interaction system according to claim 1.

11. 1. An interacting system comprising: a portable device configured to be carried by a user as the user moves through an interactive environment, the portable device including an input mechanism for initiating the launch of a virtual projectile; a control system including one or more processors; wherein the one or more processors: receiving data indicative of a position and orientation of the portable device; receiving additional data indicative of actuation of said input mechanism; determining a successful virtual interaction between a first type of interaction element and the virtual flying object based on a position and orientation of the portable device during actuation of the input mechanism; adjusting a second type of interaction element in response to a success of the virtual interaction between the first type of interaction element and the virtual flying object. wherein the first type of interactive element comprises an interactive physical element and the second type of interactive element comprises an interactive virtual element, or the first type of interactive element comprises an interactive virtual element and the second type of interactive element comprises an interactive physical element. An interactive system characterized by:

12. the one or more processors are configured to adjust the first type of interaction element in response to a success of the virtual interaction between the first type of interaction element and the virtual flying object. An interaction system according to claim 11.

13. receiving instructions indicating actuation of an input mechanism on the portable device to launch the virtual projectile; determining a successful virtual interaction between a first type of interaction element and the virtual flying object based on a position and orientation of the portable device during actuation of the input mechanism; controlling a second type of interaction element to produce a reaction in response to the successful virtual interaction between the first type of interaction element and the virtual flying object; wherein the first type of interactive element comprises an interactive physical element and the second type of interactive element comprises an interactive virtual element, or the first type of interactive element comprises an interactive virtual element and the second type of interactive element comprises an interactive physical element. A method comprising:

14. The method comprises: detecting a position and orientation of the portable device during operation of the input mechanism using ultra-wideband (UWB) circuitry; translating a position and orientation of the portable device into an interaction space during actuation of the input mechanism; simulating a trajectory of the virtual flying object in the interaction space based on a position and orientation of the portable device during actuation of the input mechanism; determining, based on a trajectory of the virtual flying object in the interaction space, that the virtual flying object has entered a threshold distance of the first type interaction element in the interaction space to indicate a successful virtual interaction between the first type interaction element and the virtual flying object; The method of claim 13, comprising:

15. the first type of interactive element comprises an interactive physical element and the second type of interactive element comprises an interactive virtual element; The method of claim 13.

16. the method including adding points to a user profile of the user in response to the successful virtual interaction between the first type of interaction element and the virtual flying object. The method of claim 13.

17. the method includes generating a feedback effect using an additional component of the portable device in response to actuation of the input mechanism on the portable device; The method of claim 13.

18. The feedback effect includes light, sound, vibration, or a combination thereof.

20. The method of claim 17.

19. the method including generating a feedback effect using an additional component of the portable device in response to a successful virtual interaction between the first type of interaction element and the virtual flying object, the additional component including a light emitter, a speaker, a haptic device, or a combination thereof; The method of claim 13.

20. the method including generating a feedback effect using additional components distributed within the interaction environment in response to a successful virtual interaction between the first type of interaction element and the virtual flying object, the additional components including lights, speakers, haptic devices, or combinations thereof; The method of claim 13.

Images