SYSTEM AND METHOD FOR POSITION TRACKING OF INTERACTIVE DEVICES - Patent application
The interactive device system with multiple antennas and processors enhances amusement park experiences by personalizing interactions based on user input, improving immersion through precise tracking and environmental adjustments.
Patent Information
- Application Number
- JP2025517086
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-09-22
- Filing Date
- 2023-09-21
- Publication Date
- 2025-10-22
AI Technical Summary
Existing amusement park interactive systems provide a uniform user experience without personalized features, lacking the ability to tailor interactions based on individual user input.
An interactive device system utilizing multiple antennas and processors to track position and orientation of interactive devices within an environment, communicating via ultra-wideband signals to an environmental controller for personalized feature adjustments.
Enhances user experience by providing personalized interactions, tracking orientation and position without expensive sensors, and facilitating immersive experiences through adjustable environmental features.
Smart Images

Figure 2025534973000001_ABST
Abstract
Description
[Background technology]
[0001] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present technology, which are described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
[0002] Amusement parks often include interactive areas that include rides and attractions. The interactive areas may include features that provide the same user experience for all users. However, the user experience can be enhanced by providing different or unique features that can be tailored to each user, providing a better experience for each user. It is now recognized that it is desirable to provide different or unique features in interactive areas of an amusement park that provide a different or unique user experience for each user, for example, based on user input. Summary of the Invention
[0003] The following summarizes certain embodiments commensurate with the subject matter of the original claims. These embodiments are not intended to limit the scope of the present disclosure. Indeed, the present disclosure may include a variety of forms that may be similar to or different from the embodiments set forth below.
[0004] In one embodiment, an interactive device includes multiple antennas, one or more transceivers coupled to the multiple antennas, one or more feedback devices, and one or more processors coupled to the one or more transceivers and the one or more feedback devices. The one or more processors can receive signals from a computing device via the one or more transceivers. The one or more processors can also determine a time-of-flight corresponding to reception of the signals by the multiple antennas. The one or more processors can further determine position information, orientation information, or both of the interactive device based on the time-of-flight. The one or more processors can further transmit the position information, orientation information, or both to an environmental controller via the one or more transceivers. The one or more processors can further activate the one or more feedback devices based on the position information, orientation information, or both.
[0005] In one embodiment, a method includes transmitting, using a transmitter, a first ultra-wideband (UWB) signal to be received by multiple antennas of an interactive device employed within the interactive environment. The method also includes receiving, using a receiver, a second UWB signal indicative of location information, orientation information, and an interactive device ID associated with the interactive device employed within the interactive environment. Further, the method includes, using one or more processors, updating one or more features within the interactive environment based on the location information, orientation information, and interactive device ID.
[0006] In one embodiment, the interactive system includes an environmental controller having a transceiver that transmits signals. The interactive system also includes a plurality of interactive devices. Each interactive device of the plurality of interactive devices includes a plurality of antennas, one or more transceivers, and one or more processors. The one or more processors of each interactive device are configured to receive signals from the one or more transceivers via the respective interactive device's multiple antennas. The one or more processors of each interactive device are also configured to determine a time of flight of the signals based on reception of the signals via the multiple antennas. Further, the one or more processors of each interactive device are configured to determine position information and orientation information based on the time of flight of the signals. Further, the one or more processors of each interactive device are configured to transmit the position information and orientation information via the multiple antennas to the environmental controller, and the environmental controller is configured to adjust one or more features of the amusement park upon receipt of the position information and orientation information.
[0007] These and other features, aspects, and advantages of the present disclosure will be better understood from the following detailed description when read in conjunction with the accompanying drawings, in which like reference characters refer to like elements throughout. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a schematic diagram of an interactive device system that tracks position information, orientation information, or both to provide a customizable user experience, according to an aspect of the present disclosure. [Figure 2] FIG. 2 is a block diagram illustrating the interactive device system of FIG. 1 according to an aspect of the present disclosure. [Figure 3] 2 is a data flow diagram illustrating communication between an interactive device and an environmental controller of the interactive device system of FIG. 1 according to an embodiment of the present disclosure. [Figure 4]FIG. 1 is a block diagram illustrating an interactive device having multiple transceivers communicating with an external transceiver via multiple antennas, according to an aspect of the disclosure. [Figure 5] FIG. 1 is a block diagram illustrating an interactive device having a transceiver that communicates with an external transceiver via multiple antennas, according to an aspect of the disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0009]
[0013] The following description will discuss one or more specific embodiments of the present disclosure. In the interest of brevity in describing these embodiments, not all features of an actual implementation may be described herein. It should be understood that the development of any such implementation, as in any engineering or design project, requires numerous implementation-specific decisions to achieve the developer's particular objectives, including compliance with system- and business-related constraints that may vary from implementation to implementation. Moreover, it should be understood that such a development effort might be complex and time-consuming, but would be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.
[0010] In some environments, such as attractions within an amusement park (e.g., amusement rides, performance shows, and games), users may have access to tools that provide an immersive experience within the amusement park. The user's interaction with the tools may be recorded to provide the user with certain benefits, such as points. To provide a more desirable experience (e.g., a more immersive or user-friendly experience), it may be advantageous to utilize an interactive tool with multiple antennas located at different locations.
[0011] The present disclosure relates to an interactive device system that performs position and / or orientation tracking of an interactive device utilized within an interactive environment based on signals transmitted from an external transceiver (e.g., via antennas) to multiple antennas disposed on the interactive device. Generally, the antennas of the interactive device are disposed at different locations on the interactive device (e.g., on one or more surfaces, such as one or more interior surfaces, one or more exterior surfaces, or both). Thus, each antenna can receive a signal transmitted by the external transceiver during a time period related to the distance between the respective antenna and the external transceiver. A processor of the interactive device receives signals via the multiple antennas associated with the one or more transceivers and determines a time of flight indicating the time the antenna received the signal. For example, the time of flight information can indicate a first timestamp corresponding to the transmission of a signal by the transceiver via its antenna and a second timestamp corresponding to the reception of the signal by the transceiver or receiver via its antenna (e.g., a timestamp corresponding to the reception of the signal by each interactive device, and a difference between the timestamps corresponding to the reception of the signal, etc.). The processor may communicate a signal (e.g., via ultra-wideband (UWB) communications) to an external controller (e.g., an environmental controller) including position information (e.g., three-dimensional Cartesian and polar coordinates), orientation information (e.g., the direction a particular position of the interactive device is facing, the degree of roll, pitch, and / or yaw of the interactive device), or both based on the determined time of flight, thereby causing the environmental controller to adjust one or more characteristics of the interactive environment. In some embodiments, the interactive device may be a wearable device, a handheld device, or any of a variety of devices configured to be otherwise carried (e.g., held or worn) by a user.For example, the interactive device can be a wand, a helmet, a bracelet, a headband, a head-mounted display (e.g., including a headband or other structure that supports a head-mounted display on a user's head, or configured to couple to such a structure, and configured to display images for visualization by a user wearing the head-mounted display, thereby providing an augmented reality [AR], virtual reality [VR], or mixed reality (both AR and VR) experience to the user wearing the head-mounted display), or other apparatus. Additionally or alternatively, in some embodiments, the interactive device can be an interactive tool such as a projectile launcher, including a slingshot, a bow, a catapult, a blaster gun, a water hose, or other device capable of emitting, shooting, or projecting virtual or physical projectiles, fluids, or light for use within the interactive environment. In either case, the orientation and position information can be used to determine whether the virtual or physical projectiles and projectile launchers are aimed at or otherwise interacting with one or more features of the interactive environment. Accordingly, the disclosed interactive device systems (e.g., flying object systems) can provide a more desirable user experience. Additionally, the use of multiple antennas can facilitate tracking of orientation and / or position information without the use of expensive and / or relatively power-intensive sensors, such as inertial measurement units (IMUs).
[0012] With this in mind, FIG. 1 is a schematic diagram illustrating a perspective view of an interactive environment 10 including an interactive device system 12 having an interactive device 14. As shown, the interactive environment 10 includes a user 16 holding the interactive device 14. Although only one user 16 and one interactive device 14 are shown, other embodiments of the interactive device system 12 can include any number of interactive devices 14 (e.g., 1 or more, 2 or more, 3 or more, 4 or more, 5 or more, 5 or more, etc.) and any number of users 16 (e.g., 1 or more, 2 or more, 3 or more, 4 or more, 5 or more, 5 or more). Generally, as will be described in more detail with respect to FIG. 2, the interactive device 14 can include an electronic device having a processor and communication circuitry that communicates with an environmental controller 18 via wireless or wired communication. Generally, the environmental controller 18 is also an electronic device (e.g., a computing device) having a processor and communication circuitry, such as a server, desktop computer, laptop, mobile device, and smartphone. For example, the interactive device 14 may transmit signals indicative of data to the environmental controller 18 via an antenna using ultra-wideband (UWB) communications (e.g., at frequencies between 3.1 gigahertz (GHz) and 10.6 GHz), radio frequency identification (RFID) beacons and / or tags (e.g., at approximately 433 megahertz (MHz) or frequencies between 860 and 960 MHz), or Wi-Fi (e.g., at approximately 2.4 GHz or 5 GHz). The interactive device 14 may include a trigger 20 that the user 16 may select, pull, or otherwise actuate to cause the interactive device 14 to release, shoot, or launch a projectile 22, such as a virtual projectile (e.g., a virtual laser beam, a virtual fluid stream, a virtual arrow, a virtual cannonball, etc.) or a physical projectile (e.g., a foam part, a fluid stream, etc.).In general, the interactive device 14 may include an interactive tool such as a projectile launcher (e.g., slingshot, bow, catapult), a blaster gun, a water hose, or any other suitable device capable of releasing, shooting, or firing virtual or physical projectiles for use within the interactive environment 10.
[0013] In general operation, the environmental controller 18 may use a transceiver to communicate, transmit, or otherwise output a signal (e.g., a signal indicative of information) via one or more antennas to multiple antennas (not shown) on the interactive device 14 to facilitate tracking of the location, orientation, and usage of the interactive device 14. For example, the environmental controller 18 may transmit a signal to the antenna of the interactive device 14 (e.g., via the antenna of the interactive device 14) while the interactive device 14 is in proximity to the interactive device 14 (e.g., within UWB range, such as within 5 m (meters), 10 m, 50 m, and 100 m), which the interactive device 14 may use to determine location information, orientation information, or both. The signal may include a transmitter ID, such as a pattern or set of alphanumeric characters and / or symbols that generally indicate the particular transceiver transmitting the signal. In some embodiments, the environmental controller 18 (e.g., the transceiver of the environmental controller 18) may transmit a signal via the antenna periodically or based on a specific trigger condition (e.g., the user 16 selecting, pulling, or otherwise activating a trigger 20). In either case, the processor of the interactive device 14 can determine time data, such as time-of-flight, corresponding to the receipt of the signal by each antenna. That is, the processor of the interactive device 14 can determine that a first antenna received a data signal from a transmitter (i.e., a data signal transmitted by an antenna associated with the transmitter) during a first time period, and that a second antenna received a data signal from the transmitter during a second time period. As a result, the processor of the interactive device 14 can determine location information, orientation information, or both, for the interactive device 14 based on the time data corresponding to the receipt of the signal by each antenna.
[0014] For example, the processor of the interactive device 14 may determine the angular tilt 24 (e.g., roll, yaw, and / or pitch) of the interactive device 14 relative to one or more axes. That is, the processor may determine the amount to which the interactive device 14 is tilted left / right and / or up / down relative to a normal orientation. Additionally or alternatively, the processor may also determine the relative direction in which the interactive device 14 is facing. That is, the interactive environment 10 includes one or more features, such as virtual features (e.g., characters or targets displayed on a display screen or projected via an augmented reality device) or physical features (e.g., physical targets, other users in the interactive environment, barriers, characters in the environment). The relative direction may indicate whether a particular end (e.g., a projectile firing end) of the interactive device 14 is aimed at one or more of the features. As a result, the interactive device 14 may transmit signals to the environment controller 18 indicative of orientation and position information indicative of the tilt 24.
[0015] Additionally or alternatively, the processor may determine position information, such as the relative position of the interactive device 14 within the interactive environment. For example, the processor may determine three-dimensional Cartesian and polar coordinates of the interactive device 14, etc. In some embodiments, the position information may include a location within the interactive environment 10 where the interactive device 14 is being utilized (e.g., fired or aimed). For example, this location may correspond to a safe or no-firing zone (e.g., having a virtual character intended to prevent the user 16 from aiming or firing projectiles 22), a zone with a barrier (e.g., a physical or virtual barrier) that reflects or deflects projectiles 22, etc.
[0016] In either case, the interactive device 14 may communicate one or more signals indicating positional and / or orientation information to the environmental controller 18. As a result, the environmental controller 18 may update the interactive system 10 based on the positional and / or orientation information corresponding to the position and / or orientation of the interactive device 14. For example, in an embodiment in which the interactive device 14 is a projectile launcher, the environmental controller 18 may determine whether the interactive device 14 is aimed at the feature 26 (e.g., a target) based on the angular tilt 24 and / or distance 28 between the interactive device 14 and the feature 26. As another non-limiting example, the environmental controller 18 may determine whether the projectile 22 corresponding to the interactive device 14 is capable of hitting a portion 30 of the feature 26. In either case, interactions between users 16 and interactive devices 14 and / or features 26 within interactive environment 10 may be tracked and / or recorded by updating data stored in a database or other accessible storage component to include a record of interactions with interactive device 14, awarding points to users 16 based on their use of interactive device 14, tracking the progress of users 16 when using interactive device 14, tracking the performance of users 16 when using interactive device 14, etc.
[0017] The interactive devices 14 and the environmental controller 18 may each include specific processing circuitry, memory circuitry, and communication circuitry to perform the operations described herein. To illustrate this, FIG. 2 is a block diagram of an interactive device system 12 including one or more interactive devices 14 and an environmental controller 18. In some embodiments, one or more interactive devices 14 may each include a processor 32, memory 34, and communication circuitry 36 to enable the one or more interactive devices 14 to communicate with the environmental controller 18. The various functional blocks shown in FIG. 2 may include hardware elements (including circuitry), software elements (including machine-executable instructions), or a combination of both hardware and software elements (which may be referred to as logic). The processor 32, memory 34 and / or non-volatile storage, communication circuitry 36, and / or feedback device 38 may each be communicatively coupled to one another directly or indirectly (e.g., through or via another component, a communication bus, or a network) to send and / or receive signals indicative of data from one another. It should be noted that FIG. 2 is only one example of a particular implementation and is intended to illustrate the types of components that may be present within the interactive device 14 and / or environmental controller 18.
[0018] The interactive device 14 may also include game input / output control elements 40, which may include input triggers, buttons, joysticks, control pads, or other selectable features, and / or features similar to the feedback devices 38 (e.g., speakers, displays, lighting devices, haptic devices, etc.). The game input / output 40 may provide trigger conditions to the environment controller 18, which may facilitate particular game elements within the interactive environment 10 by causing the environment controller 18 to track the position and / or orientation of the interactive device 14. Generally, the trigger conditions may indicate an interaction between a user and the interactive device 14. For example, the trigger condition may indicate whether the user is pulling a trigger on the interactive device 14 (e.g., trigger 20 described with respect to FIG. 1 ) (e.g., in embodiments in which the interactive device 14 is a projectile launcher). As another non-limiting example, the trigger condition may indicate a direction of movement or a particular movement of the shareable device (e.g., a user waving a wand in a particular pattern). As another non-limiting example, the trigger condition may indicate a user pressing a particular button on the game input / output 40. In this manner, the environmental controller 18 may utilize trigger conditions to enable tracking of the interactive device 14 .
[0019] For example, the communications circuitry 36 may include one or more communications circuitry 36 for a personal area network (PAN), such as an ultra-wideband (UWB) or BLUETOOTH® network, a local area network (LAN) or wireless local area network (WLAN), such as a network employing one of the IEEE 802.11x family of protocols (e.g., WI-FI®), and / or any standards associated with the 3rd Generation Partnership Project (3GPP), including, for example, a third generation (3G) cellular network, a universal mobile telecommunications system (UMTS), a fourth generation (4G) cellular network, a long term evolution (LTE®) cellular network, a long term evolution license assisted access (LTE-LAA) cellular network, a fifth generation (5G) cellular network, and / or a new radio (NR) cellular network, a sixth generation (6G) or higher cellular network, a satellite network, and a non-terrestrial network. Specifically, communications circuitry 36 may include one or more communications circuitry using cellular communications standards such as 5G, including the millimeter wave (mmWave) frequency range (e.g., 24.25-300 gigahertz (GHz)), which defines and / or enables a frequency range used for wireless communications. In some embodiments, communications circuitry 36 may include transmitters and / or receivers supporting transmission and reception of various wireless signals via one or more antennas. For example, communications circuitry 36 may include multiple transmitters, multiple receivers, multiple transceivers, and / or multiple antennas suitable for various communications standards.
[0020] As shown, the interactive device 14 may include one or more transceivers 42. In some embodiments, all or a portion of the transceiver 42 may be located within the processor 32. The transceiver 42 may support the transmission and reception of various wireless signals via one or more antennas 50 and may therefore include a transmitter 46 and a receiver 48. Accordingly, the transceiver 42, transmitter 46, and receiver 48 may receive signals via the one or more antennas 50. Generally, as described in further detail below, the transmitter 46 and receiver 48 may enable communication with the environmental controller 18. For example, the transmitter 46 of the interactive device 14 may transmit a signal to the environmental controller 18 via the antenna 50 indicating the interactive device ID 44, location information, and / or orientation information of the interactive device 14.
[0021] To enable the environmental controller 18 to communicate with one or more interactive devices 14, the environmental controller 18 may include a processor 52, a memory 54, and communications circuitry 56. In some embodiments, the environmental controller 18 may scan for signals including a transmitter ID 60 and / or transmit such signals to the interactive devices 14 (e.g., periodically or based on a particular trigger condition, such as activation of a trigger 20 of the interactive device 14). For example, the environmental controller 18 may use the communications circuitry 56 to scan for signals from the interactive devices 14 indicating an interactive device ID 44, location information, orientation information, or a combination thereof. Generally, the interactive device ID 44 may include a set of alphanumeric characters and / or symbols (e.g., an interactive device ID) that identify a particular interactive device 14. In some embodiments, the communications circuitry 56 may use any suitable type of communications, such as Bluetooth or Wi-Fi. Generally, the processor 52 may include similar components and perform similar functions as those described with respect to the processor 32, and the communications circuitry 56 may include similar components and perform similar functions as those described with respect to the communications circuitry 36. The memory 54 of the environment controller 18 may store a transmitter ID 60 that identifies a particular transmitter 62. Additionally, the memory 54 may store game information 68 that generally identifies, characterizes, or stores historical information related to the features 26 of the interactive environment 10.
[0022] In some embodiments, the environmental controller 18 may determine an interaction between the interactive device 14 and the user 16 and further transmit, output, or otherwise provide instructions that cause the interactive device 14 to provide feedback indicative of the interaction. That is, the instructions may activate one or more feedback devices 38 of the interactive device 14 (e.g., visual feedback devices (e.g., light emitting elements such as diodes, display screens), audio feedback devices (e.g., speakers), tactile elements, etc.) based on the position information, orientation information, or a combination thereof received by the environmental controller 18. In some embodiments, the memory 54 may store a user profile that includes specific user preferences (e.g., graphics, images, and other visual, audio, and tactile patterns previously selected by the user) that the user can provide to enhance the user's immersion in the interactive environment. For example, a user may prefer that the interactive device present a particular color scheme (e.g., blue), and the light(s) (representing feedback device 38) on interactive device 14 may light up in a color (e.g., blue) corresponding to the color scheme upon a successful hit or when interactive device 14 is aiming at a feature as described herein (e.g., red when aiming at a friendly character in the interactive environment, green when aiming at a target for point awarding).
[0023] As shown, the environmental controller 18 may include one or more transceivers 58. In some embodiments, all or a portion of the transceiver 58 may be located within the processor 52. The transceiver 58 may transmit and receive various wireless signals via one or more antennas 66 and may therefore include a transmitter 62 and a receiver 64. Accordingly, the transceiver 58, transmitter 62, and receiver 64 may receive signals via the one or more antennas 66. Generally, the transmitter 62 and receiver 64 enable communication with the interactive device 14 via the transmitter 46 and receiver 48 of the interactive device 14. For example, the transmitter 62 of the environmental controller 18 may transmit a signal indicative of a transmitter ID 60 to the interactive device 14. Specifically, the receiver 48 of the interactive device 14 may receive the signal indicative of the transmitter ID 60 via the antenna 50. Furthermore, the receiver 64 may receive a signal indicative of the interactive device ID 44, location information, and / or orientation information transmitted by the transmitter 46 of the interactive device 14 via the antenna 50 via the antenna 66. In this manner, the interactive device 14 and the environmental controller 18 may be communicatively coupled. As described in further detail below, communicatively coupling the interactive device 14 and the environmental controller 18 may facilitate tracking position and / or orientation information of the interactive device 14 as it is used within the interactive environment 10.
[0024] In some embodiments, the interactive device system 12 may include multiple transceivers 58 and multiple interactive devices 14. For example, the interactive device system 12 may include two, three, four, five, or more than five transceivers 58 and two, three, four, five, or more than five interactive devices 14. In such embodiments, it may be advantageous to dedicate a subset of the transceivers 58 to a subset of the interactive devices 14. That is, a first subset of the transceivers 58 may communicate with only a first subset of the interactive devices 14 (e.g., via a first frequency range), and a second subset of the transceivers 58 may communicate with only a second subset of the interactive devices 14 (e.g., via a second frequency range). In some embodiments, the environmental controller 18 may determine the subset of the transceivers 58 and / or the subset of the interactive devices 14 statically (e.g., a predetermined subset) or dynamically (e.g., as the interactive devices 14 are activated within the interaction environment). Additionally, in some embodiments, an interactive device 14 may be brought from the communication range of a first environmental controller 18 into the communication range of a second environmental controller 18, such as when a user moves to a different room, stage, or other location within an amusement park attraction. In such an embodiment, the second environmental controller 18 may assign a new subset of transceivers 58 to the interactive device 14. In this manner, the user's experience is improved by reducing the likelihood of communication interruptions between the interactive device 14 and the interactive device system 12 (e.g., having one or more environmental controllers 18 and / or transceivers 58 in different rooms, stages, or other locations within an amusement park).
[0025] To further illustrate the techniques disclosed herein, Figure 3 is a data flow diagram illustrating a method 70 for tracking position and orientation information for an interactive device 14. In general, certain process blocks performed in method 70 may be performed by processor 32 of interactive device 14 or processor 52 of environmental controller 18. For simplicity, however, the actions described below are described with respect to interactive device 14 rather than processor 32, and with respect to environmental controller 18 rather than processor 52. Furthermore, certain process blocks may be performed in a different order than that shown, and in fact, in some embodiments, certain process blocks may be skipped entirely.
[0026] As shown in the depicted embodiment, at process block 72, the interactive device 14 transmits a signal (e.g., a data signal) indicative of a trigger instruction 74 (e.g., a trigger instruction signal). Generally, the interactive device 14 may transmit the signal indicative of the trigger instruction 74 based on an interaction between the user 16 and the interactive device 14. For example, the interactive device 14 may transmit the signal indicative of the trigger instruction 74 in response to a user pulling the trigger 20 of the interactive device 14 (e.g., in an embodiment in which the interactive device 14 is a blaster gun). As another non-limiting example, the trigger instruction 74 may indicate a direction or particular movement of the interactive device 14 towards any feature 26 of the interactive environment, a particular pattern (e.g., to mimic a spell being cast by a wand), etc.
[0027] As shown in the illustrated embodiment, in process block 76, the environmental controller 18 communicates or otherwise transmits to the interactive device 14 (e.g., via the antenna 66 of the environmental controller 18) a signal indicating a transmitter identifier (ID) 60 (e.g., a transmitter ID signal) (e.g., in response to receiving a trigger instruction 74 from the interactive device 14). Generally, the transmitter ID 60 may include a set of alphanumeric characters or symbols that identify a particular transmitter 62. As described in further detail below, the interactive device 14 may utilize the transmitter ID 60 or other information contained within a signal transmitted, communicated, or otherwise output by the transceiver 42 of the interactive device 14 (e.g., via the antenna 50) to determine location information 88, orientation information, or both, corresponding to the interactive device 14. Note that in some embodiments, the transmitter ID 60 may be transmitted after receiving the trigger instruction 74. For example, the interactive device 14 may transmit a signal indicating the trigger instruction 74 after a user pulls the trigger 20 of the interactive device 14 and the environmental controller 18 communicates the transmitter ID 60 in response to receiving the trigger ID 60. In this manner, method 70 may conserve the amount of computational resources that interactive device 14 might otherwise use for other processes by selectively transmitting a signal indicating the transmitter ID 60 that interactive device 14 will use to perform a particular process. However, in some embodiments, environmental controller 18 may also communicate a signal indicating the transmitter ID 60 to interactive device 14 (e.g., periodically or otherwise) without receiving a trigger instruction 74.
[0028] As shown in the illustrated embodiment, at process block 78, the interactive device 14 receives a signal indicative of the transmitter ID 60 via the multiple antennas 50 of the interactive device 14. Then, at process block 80, the interactive device 14 determines location information 88 and / or orientation information 90 based on the receipt of the transmitter ID. Generally, the interactive device 14 may determine a time-of-flight corresponding to the time when a signal (e.g., a signal indicative of the transmitter ID 60) was transmitted by the antenna 66 and / or received by each of the antennas 50. Thus, the time-of-flight may vary based on the distance between the antenna 66 and each antenna 50. Thus, the time-of-flight for each antenna 50 may correspond to or otherwise be associated with a particular position and / or orientation of the interactive device 14. In some embodiments, the interactive device 14 may determine the time-of-flight of the transmitter ID 60 using timestamps corresponding to the transmission and reception of the transmitter ID 60. For example, the transmitter ID 60 may be transmitted as a signal including a first timestamp corresponding to a first time when the signal was transmitted. Additionally, upon receiving the signal including the transmitter ID 60 and the timestamp, the interactive device 14 may generate a second timestamp corresponding to a second time at which the signal was received. Thus, the difference between the second timestamp (e.g., of the second timestamp) and the first timestamp (e.g., of the first timestamp) may indicate the time-of-flight of the signal transmitted by the environmental controller 18.
[0029] For example, the interactive device 14 may access first reference data (e.g., a lookup table) that indicates the orientation of the interactive device 14 corresponding to a particular time range for each antenna 50. Additionally or alternatively, the interactive device 14 may access reference data that indicates the position of the interactive device 14 corresponding to a particular time range for each antenna 50. For example, the reference data may indicate the spatial or tilt arrangement of the antennas 50 on one or more surfaces of the interactive device 14. In some embodiments, the interactive device 14 may store a model that indicates the relationship between the position, orientation, and / or relative time at which the antenna 50 received the transmitter ID 60. In any event, the interactive device 14 may determine the position information 88 and / or orientation information 90 based on the received signals transmitted by the environmental controller 18 via the antennas 66.
[0030] As shown in the illustrated embodiment, in process 82, the interactive device 14 transmits one or more signals to the environment controller 18 indicating an interactive device ID 86 (e.g., an interactive device ID signal), location information 88 (e.g., a location signal), and / or orientation information 90 (e.g., an orientation signal). In some embodiments, one or more of the interactive device ID 86, location information 88, and / or orientation information 90 may be transmitted in a single signal. Generally, the interactive device ID 86 may indicate a particular interactive device 14, thereby enabling the environment controller 18 to determine the particular interactive device 14 that is interacting with the interactive environment 10. The location information 88 may include coordinates (e.g., three-dimensional Cartesian coordinates, two-dimensional Cartesian coordinates, polar coordinates, etc.) or another representation of the position of the interactive device 14 in space. The orientation information 90 may include aim information, such as data indicating the direction in which the interactive device 14 is aiming. In some embodiments, orientation information 90 may include roll, yaw, and / or pitch information, such as data indicative of the tilt of interactive device 14 (e.g., the degree to which the device is flipped or twisted relative to a neutral position).
[0031] As shown in the depicted embodiment, at process block 92, the environmental controller 18 may update game information based on the interactive device ID 44, the location information 88, and / or the orientation information 90. Generally, updating game information may include adjusting a particular feature 26, awarding points (e.g., updating information stored in a database), activating a feedback device 38, or sending a notification to a user device (e.g., a mobile device). In some embodiments, the environmental controller 18 may determine a user profile paired with the interactive device 14 based on the interactive device ID 44. For example, the environmental controller 18 may determine that the location information 88 indicates that the user 16 is within a no-fire zone and that the orientation information 90 indicates that the user 16 is aiming the interactive device 14. Accordingly, the environmental controller 18 may cause the feedback device 38 to output an audio message (e.g., "watch yourself, soldier," "hey! I'm on your side," etc.). Additionally or alternatively, the environment controller 18 may cause the features 26 to attempt to avoid the aim of the interactive device 14 (e.g., cause a display showing a virtual character to move away from or jump out of the direction of aim of the interactive device 14). In one embodiment, updating the game information may include determining a number of successful interactions between the interactive device 14 and the features 26 in the interactive environment 10. For example, each feature 26 may be a target that the user 16 desires to hit with a projectile (e.g., a virtual projectile) fired by the interactive device 14. Accordingly, updating the game information may include storing a number indicating the number of successful hits scored by the user 16. In one embodiment, updating the game information may include activating one or more features (e.g., physical features controlled by mechanical actuation) located within the interactive environment.For example, the environmental controller 18 may send control signals that cause a physical feature, such as a mechanical flower, to stand up or fall down (e.g., stand up if the projectile is water) when hit by the corresponding projectile.
[0032] As another non-limiting example, the environmental controller 18 may determine that the trigger 20 of the interactive device 14 has been pulled. Accordingly, the environmental controller 18 may cause the display of the interactive device system 12 to depict a projectile at a location corresponding to the position information 88 and the orientation information 90. In some embodiments, the environmental controller 18 may access user information, such as a game profile associated with the user 16, and generate an effect on the display corresponding to the particular user profile settings. For example, the game profile may indicate that the user 16 selected water as a projectile. Accordingly, the display may depict water being emitted from the interactive device 14. Further, in such an embodiment, the environmental controller 18 may adjust the feature 26 based on the type of projectile. For example, if the environmental controller 18 determines that the user 16 has fired a flame projectile at a feature 26 that is a flower, the display may depict the flower burning. As another non-limiting example, if the environment controller 18 determines that the user 16 has fired a water projectile at a feature 26 that is a flower, the display may show the flower coming to life and / or growing in the water. In this manner, the environment controller 18 may utilize the position information 88 and / or orientation information 90 to provide an immersive experience for the user 16 within the interactive environment 10 by aligning the feature with the user 16.
[0033] In one embodiment, the environmental controller 18 may communicate additional information to the interactive device 14 based on updated game information that causes the interactive device 14 to adjust its operation overall. That is, the environmental controller 18 may communicate additional information to the interactive device 14, such as updated status information that generally modifies the amount of data transmitted by the interactive device 14. Modifying the amount of data transmitted by the interactive device 14 may include transmitting additional data including trigger conditions, position information 88, orientation information 90, or a combination thereof.
[0034] For example, the environmental controller 18 may receive a trigger condition, position information 88, orientation information 90, or a combination thereof, that indicates a particular interaction between the user 16 and the interactive environment 10. The particular interaction may include the interactive device 14 firing a projectile at the feature 26, achieving a certain amount of points, moving the interactive device 14 within the range of the feature 26, or otherwise interacting with the interactive environment 10. As a result, the environmental controller 18 may determine that the particular interaction corresponds to the activation of a particular mode (e.g., an operational mode) of the interactive device, and therefore may send updated status information to the interactive device 14 that causes the interactive device 14 to operate in accordance with the particular mode.
[0035] As a non-limiting example, a mode may include a "power-up mode." Thus, if the environmental controller 18 determines that the interactive device 14 has interacted with a feature 26 associated with the power-up mode, the environmental controller 18 may send updated status information indicating the power-up mode to the interactive device 14. The interactive device 14 may receive the updated status information and adjust its operation according to the power-up mode. For example, the interactive device 14 may send a trigger condition indicating the power-up mode when the trigger 20 is pulled. Thus, after receiving a trigger instruction indicating the power-up mode, the environmental controller 18 may cause the display of the interactive device system 12 to display an image of a projectile corresponding to the power-up mode. For example, the environmental controller 18 may cause the display to show a relatively large projectile, a projectile with a flame effect, and the like, being fired by the interactive device 14. Another example mode may be a "stuck trigger mode," which causes the interactive device 14 to send additional trigger conditions corresponding to repeated or extended trigger pulls of the trigger 20 that do not actually correspond to how the user is pulling the trigger 20. Another example mode may include a "shaky device mode" that makes it difficult for the user 16 to hit a target with the interactive device 14 by causing the interactive device 14 to transmit adjusted position information 88 and / or orientation information 90 (i.e., introducing noise into the position information 88 and / or orientation information 90) that may obscure the actual position information 88 and / or actual orientation information 90.
[0036] In one embodiment, updating the game information may include determining whether the interactive device 14 is pointed toward a particular feature 26. For example, in an embodiment in which the interactive device 14 is a flashlight, the environment controller 18 may determine whether a beam emitted by the flashlight is aimed toward a feature 26, such as a virtual character. Thus, if the environment controller 18 determines that the beam is aimed toward the virtual character, it may update the game information to cause the display to show a gesture performed by the virtual character corresponding to the beam (e.g., the virtual character covering its eyes or moving away from the direction of the beam to avoid it). In this manner, tracking the position information 88 and orientation information 90 may enhance the user 16's sense of immersion within the interactive environment 10.
[0037] As described herein, the interactive device 14 may include multiple antennas 50 and multiple transceivers 42. For example, in one embodiment, a first transceiver 42 may control a first antenna 50, and a second transceiver 42 may control a second antenna 50. To illustrate this, FIG. 4 shows a schematic diagram of the interactive device 14 having multiple transceivers 42a, 42b, 42c, 42d, and 42e (e.g., collectively 42) receiving signals 100a, 100b, 100c, 100d, and 100e (e.g., collectively 100) via respective antennas 50a, 50b, 50c, 50d, and 50e (e.g., collectively 50). The signals 100 may include data such as a transmitter ID 60 (e.g., as described with respect to FIGS. 2 and 3), and the signals 100 are transmitted by the transceivers 58 via the antenna 66 of the environmental controller 18. As described herein, the interactive device 14 can determine the position and / or orientation of the interactive device 14 based on when the transceiver 42 received the signal 100 (e.g., the transmitter ID 60). That is, the transmitter ID 60 can include a timestamp corresponding to when the transmitter ID 60 was transmitted by the transceiver 58. Specifically, each antenna 50 can be located at a different location on the interactive device 14 (e.g., on the top surface of the interactive device 14, the bottom surface of the interactive device 14, on an opposite side of the interactive device 14, etc.). For example, the antennas 50 can be spaced such that the antenna pitch and / or the spacing between the antennas is different (e.g., irregular). In such an embodiment, the memory 34 of the interactive device 14 can store pitch information indicating a pitch corresponding to each antenna 50 (e.g., a first pitch corresponding to a first antenna and a second pitch corresponding to a second antenna, etc.). In some embodiments, the memory 34 can store position information associated with each antenna 50, such as the distance between one or more antennas 50 and / or the location of each antenna 50 on the interactive device.During operation, the processor 32 can receive signals 100 from each transceiver 42 and determine time-of-flight information (e.g., data indicative of the time point corresponding to receipt of the signal 100) for each antenna 50. Note that while five antennas 50 and five transceivers 42 are shown, the interactive device 14 can include any number of antennas 50 and / or transceivers 42. For example, the interactive device 14 can include two, three, four, five, six, seven, or more antennas 50 and one, two, three, four, five, six, or more than six transceivers 42. That is, the interactive device 14 can include multiple, but fewer transceivers 42 than the number of antennas 50. Thus, the transceiver 42 can operate more than one antenna at a given time, but fewer than the total number of antennas. Note that including fewer antennas 50 and / or transceivers 42 can reduce the cost of the interactive device 14 and the computational resources utilized by the processor 32. One such example is shown and described with respect to FIG.
[0038] In some embodiments, the interactive device 14 may include one transceiver 42 that controls the operation of multiple antennas 50. To illustrate this, FIG. 5 shows a schematic diagram of an interactive device 14 having a transceiver 42 receiving signals 100a, 100b, 100c, 100d, and 100e (e.g., collectively 100) via respective antennas 50a, 50b, 50c, 50d, and 50e (e.g., collectively 50). Generally similar to the aspects described above, the signals 100 may include a transmitter ID 60. Furthermore, each antenna 50 may be located at a different location on the interactive device 14 (e.g., the top of the interactive device 14, the bottom of the interactive device 14, both sides of the interactive device 14, etc.). During operation, the processor 32 may activate particular antennas 50 via the transceivers 42 (e.g., activate each transceiver 42 in a predetermined sequence or periodically), receive signals 100 from each transceiver 42, and determine data indicative of a time point corresponding to the receipt of the signal 100 by each antenna 50. Note that a ratio of transceivers 42 to antennas 50 of less than one may reduce costs associated with the interactive device 14. However, as described herein, the interactive device 14 may nevertheless determine position information 88 and / or orientation information 90 that may be utilized by the environmental controller 18.
[0039] In embodiments in which a single transceiver 42 controls multiple antennas 50, the transceiver 42 may cycle through the antennas 50 one at a time using techniques such as time division multiplexing. For example, the transceiver 42 may couple to a first antenna 50a and receive a first signal 100a via the first antenna 50a, and the processor 32 may determine time-of-flight information associated with the first antenna 50a. The transceiver 42 may then couple to a second antenna 50b and receive a second signal 100b via the second antenna 50b, and the processor 32 may determine time-of-flight information associated with the second antenna 50b.
[0040] In some embodiments, there may be multiple transceivers 42 and more antennas 50 than transceivers 42. Thus, the multiple transceivers 42 may cycle through the multiple antennas 50. For example, a first transceiver 42 may be coupled to a first antenna 50a, and a second transceiver 42 may be coupled to a second antenna 50b. The first transceiver 42 may receive a signal 100 via the first antenna 50a, and the second transceiver 42 may receive the signal 100 via the second antenna 50b. As a result, the processor 32 may determine first time-of-flight information associated with the first antenna 50a and second time-of-flight information associated with the second antenna 50b. Next, the first transceiver 42 may be coupled to a third antenna 50c, and the second transceiver 42 may be coupled to a fourth antenna 50d. The first transceiver 42 can receive the signal 100 via the third antenna 50c, and the second transceiver 42 can receive the signal 100 via the fourth antenna 50d. As a result, the processor 32 can determine first time-of-flight information associated with the first antenna 50a and second time-of-flight information associated with the fourth antenna 50d. In this manner, the transceivers 42 can cycle through their respective antennas 50.
[0041] It is noted that, although embodiments are generally described herein in which interactive device 14 is an interactive tool such as a blaster gun or a projectile device, in some embodiments interactive device 14 can also be a wearable device 14, such as a helmet, bracelet, headband, head-mounted display, or other type of wearable device. In embodiments in which interactive device 14 includes a structure with a curved surface, such as a bracelet or a headband (which can support or be part of a head-mounted display), each antenna 50 can be positioned at a different position along the curved surface of interactive device 14. Thus, the curved surface can aid or cause a change in the time-of-flight of each antenna 50. It is presently recognized that such embodiments can facilitate tracking of a user's head orientation (e.g., whether the user is looking up, down, at feature 26, or at other users) and / or the user's position within interactive environment 10.
[0042] Additionally, while the discussion herein above generally relates to communication via signals such as UWB signals, the techniques described herein may also utilize data-over-sound (DOS) techniques to determine position information 88 and / or orientation information 90 corresponding to interactive device 14. For example, one or more of antennas 50 may be replaced with a microphone. Thus, in such an embodiment, the microphone may detect a particular sound associated with a particular area of interactive environment 10 (e.g., sound emitted by a speaker at a fixed or otherwise known location within interactive environment 10) and provide this sound to processor 32 (or processor 52) to enable processor 12 (or processor 52) to determine the location of interactive device 14 within interactive environment 10.
[0043] Accordingly, this disclosure relates to techniques for tracking position information 88 and orientation information 90 corresponding to an interactive device 14. Generally, these techniques include an interactive device 14 including multiple antennas 50 arranged at different locations. For example, the antennas 50 may be arranged in an array on one or more surfaces of the interactive device 14. In some embodiments, the antennas 50 may be spaced such that the antenna pitch and / or spacing between the antennas varies (e.g., is irregular). One or more transceivers 42 may receive, via one or more antennas, a signal (e.g., including a transmitter ID 60) transmitted by a transceiver 58 via an antenna 66 of the transceiver 58 that is external to the interactive device 14. A processor 32 of the interactive device 14 may determine the time of flight of information by each antenna 50 of the interactive device 14 based on a first timestamp associated with the transmission of the signal and a second timestamp associated with the reception of the signal. As a result, the processor 32 can determine position information 88, orientation information 90, or both, corresponding to the interactive device 14 and communicate signals indicative of this information (e.g., the position information 88, the orientation information 90, or both) to the environment controller 18, which controls features 26 within the interactive environment 10 in which the interactive device 14 is utilized. In this manner, the disclosed interactive device system 12 can enhance a user's sense of immersion by providing feedback (e.g., adjustment of features 26, awarding points, activation of feedback devices 38) corresponding to interactions between the user and the interactive environment 10.
[0044] While only certain features of the present disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the present disclosure.
[0045] The technology shown and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that will materially improve the art, and thus are not abstract, intangible, or purely theoretical. Furthermore, where any claim appended at the end of this specification contains one or more elements designated as "means for [performing] ... [function]" or "step for [performing] ... [function]," such elements are to be construed pursuant to 35 U.S.C. 112(f). Conversely, for any claim containing elements designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f).
Claims
1. 1. An interactive device comprising: A plurality of antennas; one or more transceivers coupled to the plurality of antennas; one or more feedback devices; one or more processors coupled to the one or more transceivers and the one or more feedback devices; wherein the one or more processors receiving a signal from a computing device via said one or more transceivers; determining a time of flight corresponding to reception of the signals by the plurality of antennas; determining position information, orientation information, or both, of the interactive device based on the time of flight; transmitting the position information, the orientation information, or both to an environmental controller via the one or more transceivers; activating the one or more feedback devices based on the position information, the orientation information, or both; It is configured as follows: An interactive device characterized by:
2. the signal comprises an ultra-wideband (UWB) signal; The interactive device of claim 1 .
3. the plurality of antennas includes three or more antennas; The interactive device of claim 1 .
4. the one or more processors are configured to transmit, via the one or more transceivers, data indicative of an interaction between the interactive device and an interactive environment to the environmental controller; The interactive device of claim 1 .
5. the one or more processors are configured to, after receiving a user identifier, transmit an interactive device identifier to the environmental controller via the one or more transceivers; The interactive device of claim 1 .
6. the time of flight includes a timestamp corresponding to transmission of the signal by the computing device; The interactive device of claim 1 .
7. the antennas are arranged in an array on a surface of the interactive device; The interactive device of claim 1 .
8. the interactive device comprises a plurality of transceivers including the transceiver, a first transceiver of the plurality of transceivers configured to receive the signal via a first antenna of the plurality of antennas, and a second transceiver of the plurality of transceivers configured to receive the information via a second antenna of the plurality of antennas; The interactive device of claim 1 .
9. the time period corresponding to receipt of the information includes a time-of-flight measurement of the information transmitted by a transceiver different from the interactive device; The interactive device of claim 1 .
10. the orientation information includes aiming information of the interactive device; The interactive device of claim 1 .
11. the orientation information includes roll information of the interactive device; The interactive device of claim 1 .
12. 1. An interactive device method, comprising: transmitting, using a transmitter, a first ultra-wideband (UWB) signal to be received by a plurality of antennas of interactive devices utilized within the interaction environment; receiving, using a receiver, a second UWB signal indicative of location information, orientation information, and an interactive device identifier associated with the interactive device utilized within the interaction environment; updating, using one or more processors, one or more features within the interactive environment based on the location information, the orientation information, and the interactive device identifier; A method comprising:
13. updating the one or more features in the interactive environment using the one or more processors retrieving a user profile based on the interactive device identifier; updating the user profile based on the location information and the orientation information; 13. The method of claim 12, comprising:
14. updating the one or more features in the interactive environment using the one or more processors determining, based on the position information and the orientation information, that the interactive device is aiming at a feature depicted on a display of the interactive environment; updating the display in response to determining that the interactive device is aiming at the feature depicted on the display screen; 13. The method of claim 12, comprising:
15. the orientation information indicating the direction the interactive device is facing, the degree of roll, pitch, yaw, or any combination thereof; The method of claim 12.
16. 1. An interactive system comprising: an environmental controller including a transceiver configured to transmit a signal; Multiple interactive devices and wherein each interactive device of the plurality of interactive devices includes a plurality of antennas, one or more transceivers, and one or more processors, the one or more processors of each interactive device: receiving signals from the one or more transceivers via the plurality of antennas of each interactive device; determining a time of flight of the signal based on reception of the signal via the plurality of antennas; determining position and orientation information based on the time of flight of the signal; transmitting the position information and the orientation information to the environmental controller via the plurality of antennas; and wherein the environmental controller is configured to adjust one or more characteristics of an amusement park upon receiving the location information and the orientation information. An interactive system characterized by:
17. the environmental controller is configured to adjust the one or more characteristics of the amusement park by adjusting one or more images displayed on a display of the amusement park; 17. An interactive system according to claim 16.
18. the one or more features include one or more feedback devices disposed on the plurality of interactive devices; 17. An interactive system according to claim 16.
19. each interactive device of the plurality of interactive devices stores a respective interactive device identifier, and the one or more processors are configured to transmit the interactive device identifier after receiving the signal; 17. An interactive system according to claim 16.
20. the environmental controller is configured to regulate one or more physical features of the amusement park by activating the one or more physical features of the amusement park; 17. An interactive system according to claim 16.