Systems and methods for generating responses to interactions within interaction environment
Through portable devices and UWB tag technology, the problem of breaking user experience in the interactive environment of multi-scenic spots in the amusement park is solved, and the coherent interactive experience and immersion improvement across attractions is achieved.
Patent Information
- Application Number
- CN202380031404.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-03-28
- Filing Date
- 2023-03-30
- Publication Date
- 2024-11-15
AI Technical Summary
The existing amusement park interactive environment is difficult to provide an immersive and interactive user experience, especially in the interactive environment between multiple different attractions, making it difficult for users to maintain a coherent interactive experience.
The portable device is equipped with a processor and UWB tag. By receiving and processing the location and orientation data of user equipment, the interaction of virtual projectiles and the synchronous response of physical elements is achieved, providing a coherent interactive experience across multiple attractions.
It realizes a coherent interactive experience between multiple amusement park attractions, enhances the immersion and interactivity of users, and provides a realistic immersion experience and reward mechanism through the trajectory of virtual projectiles and the response of physical components.
Smart Images

Figure CN118973678A_ABST
Abstract
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to and the benefit of U.S. Provisional Application No. 63 / 325,412, filed on March 30, 2022, entitled “SYSTEMS AND METHODS FOR PRODUCING RESPONSES TO INTERACTIONS WITHIN AN INTERACTIVE ENVIRONMENT,” which is hereby incorporated by reference in its entirety for all purposes. Background Art
[0002] This section is intended to introduce the reader to various technical aspects that may be related to various aspects of the present disclosure. This discussion is considered to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Accordingly, it should be noted that these statements are to be read from this perspective, rather than as an admission of the prior art.
[0003] An amusement park may include a variety of entertainment attractions. Some entertainment attractions may provide an interactive environment for customers. For example, customers may view animated characters on a display screen within the interactive environment, and customers may provide input to control the movement of the animated characters on the display screen within the interactive environment. Summary of the invention
[0004] The following summarizes certain embodiments that are commensurate in scope with the original claimed subject matter. These embodiments are not intended to limit the scope of the present disclosure, but rather these embodiments are intended only to provide a brief overview of certain disclosed embodiments. In fact, the present disclosure may encompass a variety of forms that may be similar or different from the embodiments set forth below.
[0005] In an embodiment, an interactive system includes a portable device configured for use in an interactive environment. The portable device includes an input mechanism that initiates delivery of a virtual projectile. The interactive system also includes a control system that includes one or more processors. The one or more processors: receive data indicating a position and orientation of the portable device; receive additional data indicating actuation of the input mechanism; determine a successful virtual interaction of an interactive physical element with the virtual projectile based on the position and orientation of the portable device during actuation of the input mechanism; and adjust an interactive virtual element displayed on a display screen in response to the successful virtual interaction of the interactive physical element with the virtual projectile.
[0006] In an embodiment, an interactive system includes a portable device configured to be carried by a user as the user travels through an interactive environment. The portable device includes an input mechanism that initiates delivery of a virtual projectile. Additionally, the interactive system includes a control system that includes one or more processors. The one or more processors: receive data indicating a position and orientation of the portable device, receive additional data indicating actuation of the input mechanism; and determine a successful virtual interaction of a first type of interactive element with the virtual projectile based on the position and orientation of the portable device during actuation of the input mechanism. Additionally, the one or more processors adjust a second type of interactive element in response to the successful virtual interaction of the interactive physical element with the virtual projectile, wherein the first type of interactive element includes an interactive physical element and the second type of interactive element includes an interactive virtual element, or the first type of interactive element includes an interactive virtual element and the second type of interactive element includes an interactive physical element.
[0007] In an embodiment, a method includes: receiving an indication of actuation of an input mechanism on a portable device to launch a virtual projectile based on a position and orientation of the portable device during actuation of the input mechanism; and determining a successful virtual interaction of a first type of interactive element with the virtual projectile. Additionally, the method includes: in response to the successful virtual interaction of the first type of interactive element with the virtual projectile, controlling a second type of interactive element to produce a response, wherein the first type of interactive element includes an interactive physical element and the second type of interactive element includes an interactive virtual element, or the first type of interactive element includes an interactive virtual element and the second type of interactive element includes an interactive physical element. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] These and other features, aspects, and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which like characters represent like parts throughout the drawings, and in which:
[0009] Figure 1 is a schematic diagram of an interactive system according to the present embodiment;
[0010] Figure 2 is a flow chart of a method for controlling an interactive element in response to successful targeting of the interactive element by a portable device according to the present embodiment;
[0011] Figure 3 is a schematic diagram of an interactive system according to the present embodiment in which successful aiming of an interactive physical element generates a response via the interactive physical element and the interactive virtual element;
[0012] Figure 4 is a schematic diagram of an interactive system in which successful targeting of an interactive physical element extended into a virtual space generates a response in the virtual space according to the present embodiment;
[0013] Figure 5 is a flow chart of a method for controlling a first interactive element in response to successful targeting of a second interactive element by a portable device according to the present embodiment;
[0014] Figure 6 is a schematic diagram of an interactive system in which activities of interactive virtual elements generate responses in interactive physical elements according to the present embodiment; and
[0015] Figure 7 is a schematic diagram of an interactive system in which a virtual projectile is shown as an interactive virtual element according to the present embodiment. DETAILED DESCRIPTION
[0016] One or more specific embodiments will be described below. In order to provide a concise description of these embodiments, not all features of the actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer's specific goals, which may vary from implementation to implementation, such as compliance with system-related constraints and business-related constraints. In addition, it should be appreciated that such development efforts can be complex and time-consuming, but will be no more than a routine task of design, fabrication, and manufacturing for those of ordinary skill who benefit from this disclosure.
[0017] When introducing elements of various embodiments of the present disclosure, the articles "a, an", "the" and "said" are intended to mean that there are one or more elements in the elements. The terms "comprise", "include" and "have" are intended to be inclusive, and mean that there may be additional elements in addition to the listed elements. One or more specific embodiments of the present embodiments described herein will be described below. In order to provide a concise description of these embodiments, all features of the actual implementation may not be described in the specification. It should be noted that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer's specific goals that may vary from implementation to implementation, such as compliance with system-related constraints and business-related constraints. In addition, it should be noted that such development efforts can be complex and time-consuming, but for ordinary technicians who benefit from the present disclosure, it will be nothing more than a routine task of design, production and manufacturing.
[0018] The present disclosure generally relates to an interactive environment that provides an interactive experience to a customer (e.g., a user) using a portable device. In an embodiment, the interactive environment is implemented within an amusement park attraction (such as a ride attraction in which a customer is carried through the interactive environment in a ride vehicle and / or a walk-through attraction in which a customer walks through the interactive environment). In an embodiment, the amusement park attraction can be a hybrid attraction in which a customer is both carried (e.g., on a moving walkway) and allowed to walk through the interactive environment (e.g., along a moving walkway). The interactive environment can be distributed (e.g., geographically separated from each other) across multiple different amusement park attractions (such as across multiple different ride attractions, walk-through attractions, and / or hybrid attractions). Additionally or alternatively, the interactive environment can be included in one or more themed areas and / or distributed across multiple different themed areas with a common theme or different themes. Additionally or alternatively, the interactive environment can include a live performance (e.g., with performers), and customers in the audience can use their portable devices to participate in the live performance.
[0019] The portable device may be any of a variety of types of devices configured to be carried, held, and / or worn by a customer. For example, the portable device may include an aiming device (e.g., a blaster), a cane, a toy, a figurine, clothing, jewelry, a bracelet, a helmet, a medal, glasses, and / or any combination thereof (e.g., an aiming device integrated into a bracelet). In an embodiment, the portable device may be configured to be used by multiple different customers over time. For example, a customer may pick up a portable device at the entrance to an interactive environment, use the portable device to participate in the interactive environment as the customer travels through the interactive environment, and then return the portable device when the customer leaves the interactive environment. The portable device may be made available again at the entrance to the interactive environment (e.g., after cleaning), and then another customer may pick up the portable device at the entrance to the interactive environment and use the portable device to participate in the interactive environment, and so on.
[0020] As discussed herein, the portable device may enable a customer to interact with (e.g., control) features within an interactive environment. For example, the portable device may be an aiming device, and the customer may actuate an input mechanism (e.g., a trigger switch, a button) of the portable device to initiate a simulation of delivery (e.g., virtual delivery) of a virtual projectile toward an interactive element within the interactive environment (e.g., a physical interactive element in a physical real-world space or a virtual interactive element in a virtual space on a display screen). In response, the interactive environment may depict the virtual projectile slamming (e.g., "colliding"; "hitting") the interactive element. For example, the display screen may display an image (e.g., a moving image; a video) depicting the virtual projectile slamming (e.g., "colliding"; "hitting") the interactive element. In another example, a change in the behavior of the physical interactive element or the presence of a special effect (e.g., sound, light, smoke, vibration) in the interactive environment may indicate successful aiming of the physical interactive element.
[0021] In general, there can be two types of interactive elements: interactive physical elements, which are props or physical objects in the physical real world space within the interactive environment; and interactive virtual elements, which are images / animations of virtual objects in the virtual space displayed on the display screen. Both interactive physical elements and interactive virtual elements can be dynamic interactive elements that move back and forth and / or contain moving parts in the interactive environment / on the display screen. In addition, by having a physical part in the physical real world space within the interactive environment and a virtual part in the virtual space displayed on the display screen, an interactive hybrid element can be an interactive physical element and an interactive virtual element at the same time. In this article, "interactive element" generally refers to any interactive physical element, interactive virtual element, or interactive hybrid element.
[0022] Figure 1 An interactive system 10 for facilitating interaction within an interactive environment 14 according to an embodiment of the present disclosure is illustrated. The interactive environment 14 may be within an amusement park attraction or other suitable location. As shown, a customer (e.g., user) 12 may carry or otherwise be associated with a portable device 16, which includes a processor 18, a memory device 20, and an additional component 22. The additional component 22 may include an input mechanism (e.g., a trigger switch, a button), a light emitter (e.g., a light emitting diode [LED]), a tactile device, a display screen, a battery (and a battery management system), a speaker, a microphone, an inertial measurement unit, a near field communication (NFC) circuit system, and / or an ultra-high frequency (UHF) circuit system. The portable device 16 may be used to aim at an interactive element (e.g., an interactive virtual element, an interactive physical element, and / or an interactive hybrid element) and / or interact with an interactive element.
[0023] Advantageously, the portable device 16 may be equipped with an ultra-wideband (UWB) tag 24 that enables monitoring (e.g., continuous monitoring) of the position and / or orientation (e.g., relative to a coordinate system; within the interactive environment 14) of the portable device 16. In addition, the UWB tag 24 is part of a UWB circuit system (e.g., a UWB system) that generates position data and / or orientation data and efficiently communicates the position data and / or orientation data, which may enable the interactive environment control system 32 to accurately determine a successful virtual interaction (e.g., successful aiming) of an interactive element with the portable device 16. It should be appreciated that any other suitable components may be utilized to detect the position and / or orientation of the portable device 16 (e.g., one or more sensors on the portable device 16 (such as an accelerometer) and a communication circuit system to send data from the sensor to the interactive environment control system 32; one or more sensors outside the portable device 16 and in the interactive environment 14, such as an imaging sensor / camera). In an embodiment, a light emitter, laser, or line-of-sight sensing device is not utilized to detect the position and / or orientation of the portable device 16.
[0024] The interactive environment 14 may include one or more display screens 26 configured to display interactive virtual elements 28. The interactive virtual elements 28 may include images (e.g., moving images; videos) of animated objects (such as symbols, coins / prizes, vehicles, and / or characters). The interactive virtual elements 28 may move in two dimensions (2D) in a virtual space on the display screen 26. In addition, the interactive environment 14 may include one or more interactive physical elements 30 placed or built into the interactive environment 14. The interactive physical elements 30 may include physical structures, props, vehicles, and / or robots. The interactive physical elements 30 may move in three dimensions (3D) in a physical real-world space within the interactive environment 14.
[0025] As the patron 12 travels through the interactive environment 14, the patron 12 may be presented with interactive elements. For example, an image of an animated object may move across the display screen 26 and / or a robot may move in the interactive environment 14. The patron 12 may use the portable device 16 to virtually interact with (e.g., aim) the interactive elements (such as by actuating an input mechanism on the portable device 16 to launch a virtual projectile toward the interactive element). The virtual projectile may not have a physical embodiment or actual representation (e.g., the virtual projectile may not be seen or sensed; may not exist in physical real-world space and / or in virtual space). However, in an embodiment, an image of the virtual projectile may be shown on the display screen 26. In addition, the interactive element may respond to the virtual interaction with the virtual projectile by generating a response (e.g., moving, stopping, disappearing, ducking, becoming agitated) to provide feedback to the patron 12 about the trajectory of the virtual projectile.
[0026] In an embodiment, the interactive system 10 may award a score (e.g., a performance) to the customer 12 for each successful "hit" at an interactive element, and the score may be added to the customer profile of the customer 12. In an embodiment, the interactive environment control system 32 (also referred to herein as "control system 32") may track successful targeting of interactive elements and update the customer profile of the customer 12 as the customer 12 travels through the interactive environment 14 (e.g., in real time). The customer profile and the associated reward score may be stored in one or more databases 40 accessible by the interactive environment control system 32. In an embodiment, the processor 34 (e.g., the processor 34 of the control system 32) may transfer the reward score and / or the final customer profile to the one or more databases 40 at the end of the interactive experience for use in future interactive experiences. In this way, the customer profile of the customer 12 may be maintained and updated across multiple tours of the interactive environment 14.
[0027] The interactive environment control system 32 may be responsible for controlling the interactive physical elements 30 and the interactive virtual elements 28 to generate responses to virtual interactions (also referred to herein as "interactions") between virtual projectiles released by the portable device 16 and interactive elements in the interactive environment 14. For example, the control system 32 may move or otherwise alter the interactive elements in response to position data and / or orientation data indicating that the portable device 16 is aligned with the interactive elements prior to and / or during actuation of an input mechanism (e.g., the interactive element ducks and / or moves to avoid aiming).
[0028] Additionally, the control system 32 may be responsible for tracking interactions between physical objects (e.g., the portable device 16 and the interactive physical elements 30) and virtual objects (e.g., the interactive virtual elements 28) in the interactive environment 14. As mentioned, this may involve computing a trajectory for a virtual projectile in order to determine whether the virtual projectile can reach or has reached a target (e.g., based on position data and / or orientation data during actuation of the input mechanism and the corresponding position of the interactive element).
[0029] The control system 32 may include a processor 34, a memory device 36, and a communication circuit system 38 to enable the control system 32 to control features within the interactive environment 14 (e.g., control interactive elements and / or generate special effects in the interactive environment 14) and / or communicate with the portable device 16. The processor 34, the memory device 36, and the communication circuit system 38 may enable the control system 32 to control the movement of the interactive physical elements 30 and the interactive virtual elements 28, track the positions of the interactive physical elements 30 and the portable device 16, access the positions of the interactive virtual elements 28, and calculate / simulate the trajectory of the virtual projectile.
[0030] The memory device 36 may include one or more tangible, non-transitory computer-readable media that store instructions executable by the processor 34 and / or store data to be processed by the processor 34 (e.g., a customer profile). For example, the memory device 36 may include a random access memory (RAM), a read-only memory (ROM), a rewritable non-volatile memory such as a flash memory, a hard disk, an optical disk, and / or the like. Additionally, the processor 34 may include one or more general-purpose microprocessors, one or more application-specific processors (ASICs), one or more field-programmable gate arrays (FPGAs), or any combination thereof. Furthermore, the memory device 36 may store instructions that are executable by the processor 34 to perform the methods and control actions described herein for the interactive system 10.
[0031] Tracking virtual interactions between the portable device 16 and the interactive elements may involve mapping physical objects (e.g., the portable device 16 and the interactive physical elements 30) that exist in the physical real world space to the virtual space / interactive space. In an embodiment, the virtual space and the interactive space may be the same space. In this case, the interactive virtual elements 28 that exist in the virtual space may not need to be mapped. In an embodiment, the virtual space may be different from the interactive space. In this case, the interactive virtual elements 28 may be mapped from the virtual space to the interactive space.
[0032] In general, the physical real-world space refers to the 'space' in which only interactions between physical objects (e.g., portable device 16, interactive physical elements 30) and customers 12 occur. That is, the physical real-world space is where the customer 12 physically exists. The virtual space refers to the 'space' seen by the customer 12 on the display screen 26. The image on the display screen 26 may not appear as two-dimensional (2D). Alternatively, the image on the display screen 26 may appear as a three-dimensional (3D) extension of the interactive environment 14 (e.g., an extension of the physical real-world space and / or connected to the physical real-world space). The interactive space is the 'space' in which dynamic interactions between physical objects (e.g., portable device 16, interactive physical elements 30) and virtual objects (e.g., virtual projectiles, interactive virtual elements 28) occur. For example, a virtual projectile can "hit" the interactive physical element 30 in the interactive space. In this way, the interactive space makes it possible for the customer 12 to interact and observe the interaction across the physical real-world space and the virtual space.
[0033] In general, there are various ways to map physical / virtual objects to interactive space. In an embodiment, mapping the portable device 16 and the interactive physical element 30 from the physical real world space to the interactive space may involve tracking the position of the portable device 16 and the interactive physical element 30 in the physical space via the UWB tag 24 and converting the position to the interactive space. In an embodiment, mapping the interactive physical element 30 and the interactive virtual element 28 from the physical / virtual space to the interactive space may involve accessing the pre-programmed position / movement of the interactive physical element 30 and the interactive virtual element 28 via the processor 34 of the control system 32 and converting the pre-programmed position / movement to the interactive space. In this embodiment, the exact position of the interactive element can be known without using the UWB tag 24. In an embodiment, mapping the portable device 16 and the interactive element to the interactive space may involve a combination of the above embodiments (e.g., using the UWB tag 24 to track the position of the portable device 16 and the interactive physical element 30 and evaluating the pre-programmed position / movement of the interactive physical element 30 and the interactive virtual element 28).
[0034] In an embodiment, the UWB tags 24 may be used to track the location of the portable device 16 and the interactive physical element 30. In particular, the UWB tags 24 and the UWB anchors 44 in communication with the control system 32 may be part of a real-time positioning system that performs continuous position tracking (e.g., position and / or orientation tracking) within the interactive environment 14. For example, the UWB tags 24 on the portable device 16 and the interactive physical element 30 may communicate with the UWB anchors 44 that may be distributed throughout the interactive environment 14 to send positioning data. The UWB anchors 44 may then send the positioning data to the control system 32.
[0035] Data from the UWB tag 24 and the UWB anchor 44 may enable the processor 34 to perform trajectory mapping (e.g., determine a trajectory, such as a virtual flight path) for a virtual projectile in the interactive space. The trajectory of the virtual projectile may be used to represent the "hit" location and / or impact angle of the virtual projectile in the interactive environment 14 (e.g., on the display screen 26) to provide a realistic experience to the customer 12. For example, when the customer 12 "shoots" the virtual projectile toward the interactive physical element 30, it is not clear to the customer 12 that the virtual projectile reaches the interactive physical element 30 because the virtual projectile is not visible in the physical real world space. However, the trajectory of the virtual projectile can be calculated / simulated in the interactive space, and the mapped position of the interactive physical element 30 can be used to determine the likelihood of impact. Thus, a successful virtual interaction (e.g., aiming, aligning, "hitting", "impacting") of the interactive physical element 30 with the virtual projectile can be determined in the interactive space. A successful virtual interaction with the interactive physical element 30 may produce a response, which may be affected by the trajectory of the virtual projectile. For example, after being "hit" by a virtual projectile, the interactive physics element 30 may collapse in the direction in which it was "hit".
[0036] In an embodiment, the additional component 22 of the portable device 16 can provide various types of feedback (e.g., special effects) to the customer 12 based on the interaction between the portable device 16 and the interactive elements in the interactive environment 14. For example, the additional component 22 (e.g., a light emitter, a tactile device, a display screen, a speaker) can provide corresponding feedback when the interactive element is successfully aimed and / or when the score is assigned to the customer profile. For example, the feedback provided by the additional component 22 can involve the vibration / recoil when the virtual projectile is "shot". In another example, the feedback provided by the additional component 22 in response to the virtual projectile "hitting" the interactive virtual element 28 can include a bang sound emitted by (one or more) speakers. In an embodiment, (one or more) additional devices (e.g., light emitters, tactile devices, speakers, or combinations thereof) that provide feedback / special effects can be distributed throughout the physical real world space within the interactive environment 14.
[0037] Figure 2 According to the present embodiment, in response to a portable device (such as Figure 1 Flow chart of a method 50 for controlling an interactive element by successfully aiming an interactive element at a portable device 16 of a computer readable medium. The method 50 includes various steps represented by boxes. It should be noted that at least some of the steps of the method 50 may be performed by a system such as Figure 1 Although the flowchart illustrates the steps in a certain order, it should be understood that the steps may be performed in any suitable order and that certain steps may be performed simultaneously where appropriate. Additionally, steps may be added to or omitted from method 50. Furthermore, some of the steps of method 50 may be replaced by Figure 1 The processor 34 of the control system 32 executes.
[0038] In block 52, method 50 may include receiving an indication of actuation of an input mechanism on portable device 16. Actuation of the input mechanism may indicate a "shooting" of a virtual projectile by portable device 16. The position and orientation of portable device 16 (which may be continuously monitored by UWB circuitry (e.g., UWB tag 24 and UWB anchor 44) and / or other suitable components) may be recorded upon actuation of the input mechanism / "shooting" of the virtual projectile. The position and orientation of portable device 16 may be sent to control system 32 in order to calculate / simulate a trajectory of the virtual projectile.
[0039] In box 54, method 50 may include determining successful aiming of an interactive element based on the position and orientation of portable device 16 during actuation of the input mechanism. Determining successful aiming of an interactive element may involve mapping portable device 16 and the aimed interactive element onto an interactive space. Physics may then be applied to calculate the trajectory of a virtual projectile "shot" by portable device 16. In an embodiment, it may not be clear which interactive element out of several interactive elements has been aimed. In this case, all interactive elements in the vicinity of the trajectory of the virtual projectile may be mapped onto the interactive space to determine the likelihood of successful aiming. In an embodiment, a threshold distance (e.g., the distance measured between the virtual projectile and the target at their closest points in the interactive space) may be used to determine successful aiming of an interactive element. For example, a virtual projectile must be within at least one inch of a target to be counted as a "hit."
[0040] Depending on the theme of the immersive experience / customer profile, the virtual projectile may appear to be composed of different materials. For example, if the interactive environment 14 has a water / poolside theme, the portable device 16 may appear like a water blaster and the virtual projectile may appear as a water jet / stream on the display screen 26. In this case, the physics of water / fluids may be applied in the interactive space to calculate / simulate the trajectory of the water-based virtual projectile.
[0041] At block 56, method 50 may include controlling the interactive element to generate a response upon detecting successful aiming of the interactive element. Controlling the interactive element to generate a response to successful aiming may involve generating a signal at control system 32 to change the aimed interactive element in a manner that may be apparent to customer 12. For example, interactive physical element 30 may stop, tip over, bounce, and / or shake in response to being "hit" by a virtual projectile. Figure 3 and Figure 4 More examples of interactive element responses to successful aiming by a virtual projectile from portable device 16 are illustrated in FIG.
[0042] Figure 3 is a schematic diagram of an interactive system 10 in which successful aiming of an interactive physical element 30 produces a response in the interactive physical element 30 according to the present embodiment. As illustrated, the interactive environment 14 includes a display screen 26, a vehicle 30A as an interactive physical element 30, and a blaster 16A as a portable device 16 held by a customer 12. "Firing" a virtual projectile can immediately (e.g., substantially immediately, such as within milliseconds) produce an effect, such as a flash, on the blaster 16A through an additional component (such as an LED). The effect can provide feedback to the customer 12 indicating that the blaster 16A has been "fired."
[0043] The position and orientation of the blaster 16A and the vehicle 30A upon actuation of the input mechanism may be detected and recorded using the UWB circuitry (e.g., UWB tag 24 and UWB anchor 44). In addition, continuous (e.g., real-time) monitoring using the UWB circuitry may indicate whether the vehicle 30A and / or the blaster 16A have moved upon actuation of the trigger. If so, the velocity and / or acceleration of the vehicle 30A and / or the blaster 16A may be calculated. In an embodiment, the position (e.g., position coordinates), orientation, velocity, and / or acceleration of the vehicle 30A and the blaster 16A may be used to simulate / calculate the trajectory of the virtual projectile and the vehicle 30A in the interactive space after the blaster 16A has been "fired". This simulation / calculation of the trajectory in the interactive space may be used to determine whether the vehicle 30A has been "hit" by the virtual projectile from the blaster 16A.
[0044] The virtual projectile trajectory simulation may be accurate enough to determine which portion of the vehicle 30A has been "hit". For example, in the illustrated embodiment, the tire of the vehicle 30A has been "hit". In response (e.g., in response to a determination that the tire of the vehicle 30A has been successfully aimed), the vehicle 30A may stop moving (e.g., due to deflation, tearing, or explosion of the tire of the vehicle 30A, which may be represented via a physical change to the tire of the vehicle 30A; the tire of the vehicle 30A may appear to be damaged / exploded). In addition, fragments of the damaged / exploded tire 28A may be represented as interactive virtual elements 28 and shown on the display screen 26 to provide additional feedback to the customer 12 indicating the successful aiming of the tire of the vehicle 30A. The stopping of the vehicle 30A and the appearance of fragments of the damaged / exploded tire 28A may be accompanied by sound effects emitted from the blaster 116A and / or from (one or more) speakers throughout the interactive environment 14. For example, the sound effects may include the sound of a car stopping quickly and the sound of air escaping from the tire. Sound effects may provide additional feedback to patron 12 in response to successful targeting of vehicle 30A. In this manner, patron 12 may receive an immersive experience in which interactive physical element 30 (e.g., vehicle 30A) or portions thereof (e.g., fragments of damaged / exploded tire 28A) are transferred to and / or expanded into virtual space (e.g., represented as interactive virtual element 28; moved into virtual space) in response to successful targeting of interactive physical element 30.
[0045] Figure 4is a schematic diagram of an interactive system 10 in which successful aiming of an interactive physical element 30 with a virtual component produces a response in the virtual component according to the present embodiment. As illustrated, the interactive environment 14 includes a fuse 30B as the interactive physical element 30 and a firework body 28B as the interactive virtual element 28 on the display screen 26. In summary, the fuse 30B and the firework body 28B are a single interactive element (e.g., a firework) having components in both the physical real-world space and the virtual space. The fuse 30B appears to extend from the physical real-world space into the virtual space, where the fuse 30B is "connected" to the firework body 28B. In reality, the firework body 28B is an image that appears on the display screen 26, and the fuse 30B can be a physical fuse adjacent to / attached to the display screen 26. The interactive environment 14 also includes a blaster 16A as a portable device 16 held by the customer 12.
[0046] Upon actuation of the input mechanism on the blaster 16A, the virtual projectile is "fired." The virtual projectile may "strike" the fuse 30B, thereby lighting it (e.g., illuminating one or more light emitters positioned along the fuse 30B). The illumination of the fuse 30B may cause a spark to appear to cause the fuse 30B to travel upward to the firework body 28B on the display screen 26. After the spark reaches the firework body 28B, an image of an exploding firework may appear on the display screen 26 and / or the firework body 28B may disappear from the display screen 26. Thus, successful targeting of a physical component (e.g., the fuse 30B) of a hybrid interactive element (e.g., an interactive element having both a physical component and a virtual component) may produce a response in a virtual component (e.g., the firework body 28B). In embodiments, the reverse may be true, wherein successful targeting of a virtual component of a hybrid interactive element may produce a response in a physical component of the hybrid interactive element. Furthermore, as described, successful aiming of either a physical or virtual component of the hybrid interactive element may produce a response in both the physical and virtual components of the hybrid interactive element (e.g., fuse 30B illuminates and firework body 28B explodes; fuse 30B illuminates and then disappears (such as by physically moving out of the view of patron 12), and firework body 28B explodes).
[0047] In an embodiment, an interactive virtual element (e.g., firework body 28B; firework) associated with an interactive physical element (e.g., fuse 30B) may not be shown on display screen 26 until “hit” on the interactive physical element. Alternatively, a “hit” on an interactive physical element that may appear connected or extended into virtual space at display screen 26 may cause the interactive virtual element to appear on display screen 26. In such a case, the interactive physical element and the interactive virtual element may not form a hybrid interactive element, but still appear to have some connection (e.g., the interactive physical element approaches and / or terminates at display screen 26; a “hit” on one causes a change to the other). In general, the interactive physical element and the interactive virtual element may be adjusted and / or provide effects in a coordinated (e.g., temporally and spatially coordinated) manner to provide various visual effects, such as a visual effect of at least a portion of an interactive physical element transitioning into virtual space shown on display screen 26.
[0048] It will be appreciated that special effects emitted from add-ons located on blaster 16A or distributed throughout interactive environment 14 may provide feedback to patron 12. For example, a vibration of blaster 16A, delivered via haptic technology that may be part of blaster 16A, may indicate that a virtual projectile has been “fired.” Additionally, the explosion of a firework may be accompanied by the sound of the exploding firework emitted by a speaker in interactive environment 14.
[0049] Figure 5 According to the present embodiment, in response to a portable device (such as Figure 1 Flow chart of a method 60 for controlling a second interactive element by successfully aiming a first interactive element at a portable device 16 of a computer readable medium. The method 60 includes various steps represented by boxes. It should be noted that at least some of the steps of the method 60 may be performed by a system such as Figure 1 Although the flowchart illustrates the steps in a certain order, it should be understood that the steps may be performed in any suitable order and that certain steps may be performed simultaneously where appropriate. Additionally, steps may be added to or omitted from method 60. Furthermore, some of the steps of method 60 may be replaced by Figure 1 The processor 34 of the control system 32 executes.
[0050] In block 62, method 60 may include receiving an indication of an actuation of an input mechanism on portable device 16. The actuation of the input mechanism may indicate a "shoot" of a virtual projectile by portable device 16. The position and orientation of portable device 16 (which may be continuously monitored by UWB circuitry (e.g., UWB tag 24 and UWB anchor 44) and / or other suitable components) may be recorded upon the "shoot" of the virtual projectile. The position and orientation of portable device 16 may be sent to control system 32 in order to calculate / simulate a trajectory of the virtual projectile.
[0051] In block 64, method 60 may include determining successful aiming of the first interactive element based on the position and orientation of portable device 16 during actuation of the input mechanism. Determining successful aiming of the first interactive element may involve mapping the portable device 16 and the first interactive element onto an interactive space. Physics may then be applied to calculate a trajectory of a virtual projectile fired by portable device 16.
[0052] At block 66, method 60 may include controlling the second interactive element to generate a response upon detecting successful aiming of the first interactive element. Controlling the second interactive element to generate a response to successful aiming may involve generating a signal at control system 32 to change the second interactive element in some manner that may be apparent to customer 12. For example, the second interactive element may be an interactive physical element 30 that may be controlled to stop, topple, bounce, and / or shake in interactive environment 14 in response to interactive virtual element 28 being "hit" by a virtual projectile. Figure 6 and Figure 7 More examples of interactive elements responding to successful aiming by portable device 16 are illustrated in FIG.
[0053] Figure 6 is a schematic diagram of an interactive system 10 in which the activity of an interactive virtual element 28 generates a response in an interactive physical element 30 according to the present embodiment. As illustrated, the interactive environment 14 includes a tree 30C as an interactive physical element 30 and a cannon 28C as an interactive virtual element 28. The cannon 28C can fire a virtual projectile (e.g., a cannonball) aimed at the tree 30C, and in response, the tree 30C can break, indicating that it is successfully aimed by the cannon 28C. An image of the virtual projectile leaving the cannon 28C can be displayed on the display screen 26. However, the virtual projectile is not a prop or a physical object. Accordingly, the breaking of the tree 30C can simulate the existence of the virtual projectile in the physical real world space.
[0054] In an embodiment, a "shot" of cannon 28C may be triggered by successfully aiming cannon 28C with a virtual projectile "shot" from blaster 16A of customer 12. In this way, a customer's interaction with an interactive virtual object may produce a response in the physical real world space (e.g., the breaking of a tree). In an embodiment, confronting a virtual character by "shooting" a virtual projectile from blaster 16A at the virtual character may cause the virtual character to "shoot" back, thereby producing a response in interactive physics element 30.
[0055] In an embodiment, the control system 32 does not calculate or simulate the trajectory of the virtual projectile "shot" by the cannon 28C. Alternatively, the cannon 28C may be preprogrammed to "shoot" at the tree 30C, and the tree 30C may be preprogrammed / triggered to break upon the "shooting" of the cannon 28C. In an embodiment, the tree 30C is a static object, and its position may not be tracked by the UWB tag 24. Alternatively, its coordinates (e.g., position) and state (e.g., intact or broken) may be known to the interactive space before the interactive experience begins. Similarly, the position of the cannon 28C may also be known in the interactive space because it is an interactive virtual element 28 with a predetermined / preprogrammed range of motion. It should be appreciated that there may be more than one interactive physical element 30 and / or at least one movable interactive physical element 30 that may be controlled in response to being "hit" by a virtual projectile "shot" by the interactive virtual element 28. Additionally or alternatively, the interactive virtual element 28 can be moved on the display screen 26 (e.g., its position and / or its orientation; its purpose) so that a virtual projectile "shot" by the interactive virtual element 28 can have different trajectories over time (e.g., and calculated by the control system 32 to determine a "hit" on the interactive physical element(s) 30).
[0056] Figure 7 is a schematic diagram of an interactive system 10 according to the present embodiment in which the response to successful aiming of an interactive virtual element 28 is to add a score to the customer profile of the customer 12. As illustrated, the interactive environment 14 includes a slingshot 16B as a portable device 16 held by the customer 12. In addition, the interactive environment 14 includes a dynamic target 28D (e.g., a bird) as an interactive virtual element 28 on the display screen 26. A virtual projectile 70 (e.g., a pebble) is shown on the display screen 26.
[0057] The trajectory of the virtual projectile 70 may be calculated / simulated based on the position and / or orientation of the slingshot 16B. Additionally, the movement of the dynamic target 28D may be known due to being pre-programmed and / or mapped to the interactive space. Upon determining that the dynamic target 28D is successfully aimed at by the virtual projectile 70, a score may be added to the customer profile.
[0058] In an embodiment, a customer profile may be associated with a theme, at least temporarily. For example, a customer profile may have a shooting theme. For example, in response to a customer profile having a shooting theme, the representation of a virtual projectile 70 on display screen 26 may be altered to look like a burning object. Additionally, the special effects / feedback provided to customer 12 may be affected by the theme. For example, a light emitter (e.g., one of the add-ons) on slingshot 16B may light up red when a projectile is fired. Haptic technology in interactive environment 14 may provide additional feedback of successful aiming at a target as a hot flash. In contrast, if a customer profile has an ice theme, light emitters on slingshot 16B and throughout interactive environment 14 may light up blue, and haptic technology may provide cool air.
[0059] Although only certain features have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the disclosure.
[0060] The technology presented and claimed herein is cited and applied to substantial objects and specific examples that demonstrably improve the practical nature of the art, and as such is not abstract, intangible, or purely theoretical. In addition, if any claim attached at the end of this specification contains one or more elements designated as "means for (performing) ... (function)" or "steps for (performing) ... (function)", it is intended that such elements are to be interpreted in accordance with 35 U.S.C. 112(f). However, for any claim containing elements designated in any other manner, it is intended that such elements are not to be interpreted in accordance with 35 U.S.C. 112(f).
Claims
1. An interactive system, comprising: a portable device configured for use in an interactive environment, wherein the portable device includes an input mechanism to initiate delivery of a virtual projectile; as well as A control system comprising one or more processors, wherein the one or more processors are configured to: receiving data indicative of a position and orientation of the portable device; receiving additional data indicative of actuation of the input mechanism; determining a successful virtual interaction of an interactive physics element with the virtual projectile based on the position and the orientation of the portable device during the actuation of the input mechanism; as well as An interactive virtual element displayed on a display screen is adjusted in response to the successful virtual interaction of the interactive physics element with the virtual projectile. 2 . The interactive system according to claim 1 , wherein the interactive physical element and the interactive virtual element form a hybrid interactive element.
3. The interactive system of claim 1, wherein the interactive physical element comprises a prop that can be moved in the interactive environment.
4. The interactive system according to claim 1, wherein the interactive virtual element comprises a dynamic image of a portion of the interactive physical element.
5. The interactive system of claim 1 , wherein the one or more processors are configured to determine the successful virtual interaction of the interactive physics element with the virtual projectile by simulating a trajectory of the virtual projectile based on the position and the orientation of the portable device during the actuation of the input mechanism.
6. The interactive system of claim 1, one or more processors configured to display the virtual projectile on the display screen.
7. The interactive system of claim 1, wherein the one or more processors are configured to adjust the interactive virtual element via a movement, a gesture, a retaliatory action, or a combination thereof performed through the interactive virtual element.
8. An interactive system according to claim 1, wherein the portable device includes a first ultra-wideband (UWB) circuit system, and the control system includes a second UWB circuit system, and the one or more processors are configured to determine the position and the orientation of the portable device based on communication between the first UWB circuit system and the second UWB circuit system.
9. The interactive system of claim 8, wherein the one or more processors are configured to receive the additional data indicative of the actuation of the input mechanism via the communication between the first UWB circuitry and the second UWB circuitry.
10. The interactive system of claim 1, wherein the one or more processors are configured to adjust the interactive physics element in response to the successful virtual interaction of the interactive physics element with the virtual projectile.
11. An interactive system comprising: a portable device configured to be carried by a user as the user travels through an interactive environment, wherein the portable device includes an input mechanism to initiate delivery of a virtual projectile; as well as A control system comprising one or more processors, wherein the one or more processors are configured to: receiving data indicative of a position and orientation of the portable device; receiving additional data indicative of actuation of the input mechanism; determining a successful virtual interaction of a first type of interactive element with the virtual projectile based on the position and the orientation of the portable device during the actuation of the input mechanism; as well as A second type of interactive element is adjusted in response to the successful virtual interaction of an interactive physical element with the virtual projectile, wherein the first type of interactive element comprises an interactive physical element and the second type of interactive element comprises an interactive virtual element, or the first type of interactive element comprises the interactive virtual element and the second type of interactive element comprises the interactive physical element.
12. The interactive system of claim 11, wherein the one or more processors are configured to adjust the first type of interactive element in response to the successful virtual interaction of the first type of interactive element with the virtual projectile.
13. A method comprising: receiving an indication of actuation of an input mechanism on the portable device to launch a virtual projectile; determining a successful virtual interaction of a first type of interactive element with the virtual projectile based on the position and orientation of the portable device during the actuation of the input mechanism; as well as In response to the successful virtual interaction of the first type of interactive element with the virtual projectile, controlling a second type of interactive element to produce a response, wherein the first type of interactive element includes an interactive physical element and the second type of interactive element includes an interactive virtual element, or the first type of interactive element includes the interactive virtual element and the second type of interactive element includes the interactive physical element.
14. The method according to claim 13, comprising: detecting the position and the orientation of the portable device during the actuation of the input mechanism using ultra-wideband (UWB) circuitry; translating the position and the orientation of the portable device during the actuation of the input mechanism into an interaction space; simulating a trajectory of the virtual projectile in the interaction space based on the position and the orientation of the portable device during the actuation of the input mechanism; as well as Based on the trajectory of the virtual projectile in the interaction space, it is determined that the virtual projectile is within a threshold distance range of the first type of interactive element in the interaction space to indicate the successful virtual interaction of the first type of interactive element with the virtual projectile.
15. The method of claim 13, wherein the first type of interactive element comprises the interactive physical element and the second type of interactive element comprises the interactive virtual element.
16. The method according to claim 13, comprising: In response to the successful virtual interaction of the first type of interactive element with the virtual projectile, a score is added to a user profile of the user.
17. The method according to claim 13, comprising: In response to the actuation of the input mechanism on the portable device, a feedback effect is produced using an additional component of the portable device.
18. The method of claim 17, wherein the feedback effect comprises light, sound, vibration, or a combination thereof.
19. The method according to claim 13, comprising: In response to the successful virtual interaction of the first type of interactive element with the virtual projectile, a feedback effect is generated using an additional component of the portable device, wherein the additional component includes a light emitter, a speaker, a haptic device, or a combination thereof.
20. The method according to claim 13, comprising: In response to the successful virtual interaction of the first type of interactive element with the virtual projectile, a feedback effect is generated using additional components distributed in an interactive environment, wherein the additional components include light emitters, speakers, haptic devices, or a combination thereof.
