INTERACTIVE OBJECT SYSTEM AND METHOD

Abstract

The interactive object system includes an interactive object and a source of electromagnetic radiation, such as an external source. A power harvesting device in the interactive object receives and harvests power from the electromagnetic radiation to power a special effects system of the interactive object. In some embodiments, the interactive object includes retroreflective material that reflects electromagnetic radiation of the same or different wavelength as the electromagnetic radiation from which power is harvested. The interactive object system can detect the reflected electromagnetic radiation and use the electromagnetic radiation to trigger one or more additional actions associated with the interactive object.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This disclosure claims priority to and the benefit of U.S. Provisional Patent Application No. 63 / 010,385, filed April 15, 2020, and entitled “INTERACTIVE OBJECT SYSTEMS AND METHODS,” the disclosure of which is incorporated by reference for all purposes.

[0002] The present disclosure relates generally to objects used in interactive environments such as gaming environments or amusement parks. In particular, embodiments of the present disclosure relate to passively powered interactive objects that use power harvesting to facilitate interactive effects. [Background technology]

[0003] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present disclosure. This discussion is believed to be helpful in providing the reader with background to facilitate a better understanding of the various aspects of the present disclosure. As such, these statements should be read in this light, and not as admissions of prior art.

[0004] In recent years, it has become common for amusement parks to create immersive environments that include props, media, and special effects that enhance the guest's experience and support a particular narrative of the environment. In some immersive environments, it is the fun of the guest to have their own devices, such as props or toys, that interact with the environment in various ways. In one example, a guest may wish to use a handheld device to interact with the immersive environment to generate certain effects that simulate effects in movies or games. However, handheld objects may be relatively small and have limited capacity for on-board power and / or internal effects components. Furthermore, such devices may not be able to interact with the immersive environment to generate these effects to produce many and / or various effects, and may be independent of user input (e.g., a user turning an effect on and off). Thus, it is now recognized that it would be desirable to have interactive objects that can generate changing special effects in an immersive environment. Summary of the Invention

[0005] The following summarizes certain embodiments common in scope to the subject matter of the original claims. These embodiments are not intended to limit the scope of the disclosure, but rather to provide merely a brief summary of some disclosed embodiments. Indeed, the disclosure may include a variety of forms that may be similar to or different from the embodiments set forth below.

[0006] According to one embodiment, an interactive object system includes an infrared light emitter that emits infrared light, and an interactive object. The interactive object includes a housing, at least a portion of an exterior surface of the housing includes a reflector assembly that partially transmits and partially reflects the infrared light. The interactive object further includes an optical power harvesting device configured to receive the infrared light through the reflector assembly and harvest power from the received infrared light, and a special effects system disposed in or on the housing and receiving power from the optical energy harvesting device to activate one or more effects of the interactive object. The interactive object system further includes a detector that detects the infrared light reflected from the reflector assembly, and a controller that controls operation of the infrared light emitter and receives data indicative of the reflected infrared light from the detector.

[0007] According to another embodiment, a method includes emitting a first electromagnetic radiation within an area using a first light source, detecting the electromagnetic radiation reflected from a retroreflective material disposed on an interactive object within the area, determining a location of the retroreflective material based on the detected electromagnetic radiation, and emitting a second electromagnetic radiation toward the location using a second light source and using power harvested from the second electromagnetic radiation to activate a special effect of the interactive object.

[0008] According to another embodiment, an interactive object is provided that includes a power harvesting device that harvests power from electromagnetic radiation and a housing with the power harvesting device disposed therein. The housing includes a reflector assembly and a special effects system that is powered by harvested power from the power harvesting device, the reflector assembly transmits electromagnetic radiation to the power harvesting device through a first portion of the reflector assembly and reflects the electromagnetic radiation from a second portion of the reflector assembly to an external detector, the first portion including a transmissive material and the second portion including a retroreflective material. The interactive object also includes a special effects system that is powered by harvested power from the power harvesting device.

[0009] According to another embodiment, an interactive object is provided that includes a power harvesting device that harvests power from electromagnetic radiation and a housing with the power harvesting device disposed therein. The housing includes a reflector assembly that transmits electromagnetic radiation of a first wavelength to the power harvesting device and reflects electromagnetic radiation of a second wavelength to an external detector, the first wavelength and the second wavelength being different. The interactive object also includes a special effects system that is powered by harvested power from the power harvesting device. [Brief description of the drawings]

[0010] These and other features, aspects and advantages of the present invention will be better understood when the following detailed description is read in conjunction with the accompanying drawings, in which like parts are designated with like numerals throughout.

[0011] [Figure 1] 1 is a schematic diagram of an embodiment of an interactive object system according to the present technology; [Diagram 2] 1 is a schematic diagram of features of an embodiment of an interactive object system according to the present technology; [Diagram 3] FIG. 1 is a schematic diagram of a reflector assembly according to the present technology. [Figure 4] FIG. 1 is a schematic diagram of a reflector assembly according to the present technology. [Diagram 5]1 is a flow diagram of a method for activating special effects on an interactive object using an interactive object system in accordance with the present technology. [Figure 6] 1 is a schematic diagram of an embodiment of an interactive object that can be used with an interactive object system in accordance with the present technology. [Figure 7] 1 is a flow diagram of a method for activating special effects on an interactive object using an interactive object system. [Figure 8] 1 is a flow diagram of a method for activating special effects on an interactive object using an interactive object system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] One or more specific embodiments are described below. In order to describe these embodiments concisely, not all of the features of the implementations are described herein. It should be understood that the development of any such implementation, as in any engineering or design project, requires numerous implementation-specific decisions to be made in order to achieve the developer's particular objectives, such as adhering to system-related and business-related constraints that may vary from implementation to implementation. Moreover, it should be understood that such a development effort may be complex and time-consuming, but would be a routine undertaking of design, fabrication and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0013] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," "the," and "said" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. One or more specific embodiments of the present embodiments described herein will be described below. In order to briefly describe these embodiments, not all features of the implementations are described herein. It should be noted that the development of any such implementation, as in any engineering or design project, requires numerous implementation-specific decisions to be made to achieve the developer's particular objectives, such as adhering to system-related and business-related constraints that may vary from implementation to implementation. Moreover, such development efforts may be complex and time-consuming, but are routine undertakings of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0014] Guests of an immersive or themed environment may enjoy carrying or wearing themed handheld objects such as swords, stuffed animals, hats, wands, jewelry, or other props. These objects may have a degree of interactivity, but typically the interaction is provided by an external device that recognizes the object (e.g., image recognition) and activates an external action based on this recognition. In such configurations, the objects may be implemented as relatively inexpensive passive devices, with more complex and expensive interaction elements external to or outside the passive device. The challenge with managing interactions using such unpowered passive devices is that no feedback or effects occur on or within the passive device. While guest feedback systems may be positioned as fixed elements of the environment, the ability to generate feedback in or on the passive device may deepen immersion in the themed environment.

[0015] Embodiments of the present disclosure relate to special effects for handheld or other interactive objects that possess no or only a relatively low-power internal power source and are passively powered using light or other electromagnetic energy harvested from an external source. Power harvesting can be used to power the interactive object's self-contained special effects system or other feedback system of the device. In some implementations, providing an external power source allows the interactive object to eliminate visible power buttons or actuation features and heavy or expensive power sources. Furthermore, the power source is managed by an interactive object system that can activate the supply of power to certain interactive objects in the environment (and not others) and / or at timing controlled by the system (e.g., in conjunction with external effects or interactions) such that effects experienced by the user visually, audibly, tactilely, or otherwise arise from the user's own interactive objects, thereby enhancing the immersive experience.

[0016] One or more built-in special effects systems operate passively as part of the interactive object system, directing electromagnetic radiation (which may be in the invisible wavelength range) to the interactive object to activate its special effects or other feedback systems. In contrast to systems that harvest power from the user's motion, the disclosed embodiments facilitate activation of the interactive object's special effects independent of the user harvesting sufficient motion-based power, thereby allowing users of various abilities and interests to enjoy the immersive environment and participate in group stories directed by the control system. Passive power harvesting also provides maintenance benefits, as users do not need to worry about changing batteries before interacting with the immersive environment. Additionally, the interactive object system can incorporate an electromagnetic radiation source that can be focused to a location narrow enough so that only the desired interactive object or set of interactive objects is powered. In some embodiments, the interactive object can include a marker, such as a retroreflective marker detectable in the environment, that can be used to direct electromagnetic energy to the interactive object's location.

[0017] In some embodiments, such objects can be props or toys used within an interactive environment to increase variability in special effect control by using power harvesting. The use of power harvesting allows the user to move freely within the immersive environment while the interactive object receives power to activate built-in special effects. Additionally, while embodiments of the present disclosure are described in the context of toys, props, or handheld objects, it should be understood that the disclosed embodiments can also be used with other types of objects. Such objects can include wearable objects such as clothing, jewelry, bracelets, headgear, glasses, and the like. The objects can also be props or scenery items within the immersive environment. The immersive environment can be an environment such as an amusement park, an entertainment complex, a retail store, and the like.

[0018] Some aspects of the present disclosure may be better understood with reference to FIG. 1 , which generally illustrates how an interactive object control system 10 may be integrated within an immersive environment according to an embodiment. As illustrated, the system 10 includes one or more emitters 14 (which may be all or part of an emission subsystem having one or more emitters and associated control circuitry) configured to emit electromagnetic radiation of one or more wavelengths (e.g., light such as infrared light, ultraviolet light, visible light, or radio waves). The system 10 also includes a detector 16 (which may be all or part of a detection subsystem having one or more sensors or cameras, etc., and associated control circuitry) configured to detect electromagnetic radiation reflected as a result of the emission, as described in more detail below. The system 10 also includes a control unit 18 communicatively coupled to the emitters 14 and the detector 16 for controlling the operation of the emitters 14 and the detector 16 (the emission subsystem and the detection subsystem) and for performing various signal processing routines resulting from the emission, reflection, and detection processes.

[0019] As shown, the interactive object control system 10 may include an interactive object 20 (shown as a handheld object) that includes a housing 22 having an exterior surface 24 formed at least in part from a material that allows electromagnetic radiation of a particular wavelength used to power built-in special effects to pass therethrough and be received by internal power harvesting circuitry of a power harvesting device housed on or within the interactive object 20. In some embodiments, the interactive object may also include retroreflective markers 26 disposed on or within the exterior surface 24. Although a single interactive object 20 is shown in the illustrated embodiment, it should be understood that the system 10 may be used with one or more interactive objects 20 within an immersive environment.

[0020] In some embodiments, the emitter 14 is present (e.g., spaced apart) outside the interactive object 20. The emitter 14 is operable to emit electromagnetic radiation, represented for illustrative purposes by an expanding electromagnetic radiation beam 28, to selectively illuminate, bathe or flood an area 30 with electromagnetic radiation. In some embodiments, the electromagnetic radiation beam 28 may represent multiple light beams (electromagnetic radiation beams) emitted from different sources 31 (any part of an emission subsystem that includes one or more emitters 14) of one or more emitters 14. For example, the source 31 may be a visible light source, an infrared light source, etc. that emits electromagnetic radiation of a desired wavelength. Furthermore, the emitter 14 may include one or more sources 31 of different types, such as light emitting diodes, laser diodes, etc. In general, the electromagnetic radiation beam 28 is intended to represent any form of electromagnetic radiation that can be used in accordance with the present embodiments, such as in the form of light (e.g., infrared light, visible light, UV) and / or other bands of the electromagnetic spectrum (e.g., radio waves, etc.). However, it is now recognized that in some embodiments it may be desirable to use particular bands of the electromagnetic spectrum depending on various factors. For example, in one embodiment it may be desirable to use a form of electromagnetic radiation that is invisible to the human eye or outside the range of human hearing so that the electromagnetic radiation used for tracking does not interfere with the guest's experience. Additionally, it is now recognized that certain forms of electromagnetic radiation, such as light of particular wavelengths (e.g., infrared light), may be more desirable than other forms depending on the particular environmental setting (e.g., whether the environmental setting is "dark" or whether people are expected to cross the beam path).

[0021] The area 30 may correspond to all or a portion of an amusement park attraction area or immersive environment, such as a stage show, a ride vehicle boarding area, and a waiting area outside the entrance to a ride or show. In one embodiment, the emitters 14 are fixed in place within the environment, while the interactive objects 20 are free to move within the environment and move within the area 30 to receive electromagnetic radiation 28. Thus, the interactive objects 20 can be detected (e.g., located within the area 30), tracked, and powered to activate one or more special effects resulting from the interactive objects 20 via the emitted and detected electromagnetic radiation 28 of the interactive object control system 10.

[0022] As generally disclosed herein, activation of the special effects of the interactive object 20 is controlled by a control unit 18 which drives the emitter 14. This activation can be indiscriminate, such that the emitter 14 continuously emits electromagnetic radiation of the appropriate wavelength or frequency corresponding to the power harvesting circuitry, such that any interactive object located within the area 30 and facing the emitter 14 is passively powered to activate the special effects. In some embodiments, activation can be selective, such that the control unit 18 identifies or detects the interactive object 20 and upon identification or detection, drives the emitter 14 to direct energy of the operating wavelength to the interactive object 20, such that activation of the special effects in the interactive object 20 can be turned on or off depending on a desired narrative or user action, as disclosed in more detail herein.

[0023] 2 is a schematic diagram of the system 10 illustrating an example of interactions between an interactive object 20 and various components of the system 10 that are external to the interactive object 20. In the illustrated example, the interactive object 20 includes retroreflective markers 26 that reflect electromagnetic radiation 28 of a particular wavelength that is detected by the detector 16. However, it should be understood that in some implementations the retroreflective markers 26 may not be present. Additionally or alternatively, the disclosed detection or location of the interactive object 20 shown herein may involve a sensor 32 (e.g., a proximity sensor, an optical sensor, an image sensor) of the system that provides position or movement data of the interactive object 20.

[0024] In operation, electromagnetic radiation 28 from emitter 14 (shown as electromagnetic radiation 28a) serves as a power source for interactive object 20, which further uses this harvested power to activate one or more built-in special effects in special effects system 36, which may include light, sound, fluid, haptic, or other special effects that arise from interactive object 20 upon activation. Special effects system 36 is part of interactive object 20 and may be partially contained within or on housing 22, and may also include one or more features disposed on or visible from exterior surface 24 to enable a user to observe or experience an activated special effect. Such features may include light sources, speakers, haptic feedback devices, ports that emit special effect material (smoke, confetti, fluid), and / or actuatable elements that move in response to activation.

[0025] In the illustrated embodiment, the retroreflective marker 26 operates to reflect electromagnetic radiation 28 (shown as incident electromagnetic radiation 28b and reflected electromagnetic radiation 28c) back towards the detector 16, which can be used to identify or track the interactive object 20. Because the retroreflective marker 26 retroreflects such that a cone of reflected electromagnetic radiation 28 is incident on the detector 16, the control unit 18 can further correlate the center of the cone, where the reflected electromagnetic radiation is most intense, to a point source of reflection. The control unit 18 can identify and track the location of this point source based on this correlation, or can identify and monitor the pattern of reflection by the retroreflective marker 26 over time as part of tracking the interactive object 20. As described, the emitter 14 and detector 16 operate under the direction of the control unit 18. In one embodiment, the location of the interactive object 20 within the cone of electromagnetic radiation 28 triggers the operation of the emitter 14 to drive a light source that emits a beam of electromagnetic radiation corresponding to the operating wavelength of the power harvesting device 38. In other embodiments, the wavelength or wavelengths reflected by retroreflective markers 26 also correspond to wavelengths used to harvest power by power harvesting device 38. In this manner, the detected wavelengths used to locate and track interactive object 20 are also used to passively power the interactive object's built-in special effects.

[0026] The power harvesting device 38 may include an optical cell that responds to a particular wavelength of electromagnetic radiation. The optical cell may include a Wi-Charge device (Wi-Charge, Inc., Milwaukee, Wis.) light. The power harvesting device may include a thermophotovoltaic (TPV) based power harnessing circuit. Photovoltaic (PV) based power harnessing circuits may also be used, depending on the frequency utilized for a particular application. In one embodiment, the operating electromagnetic radiation 28 is provided by a laser source in an emitter 14 that may be focused to provide relatively high power. The near-infrared laser light penetrates the material 54, allowing the laser photons to be harnessed for power. The laser is focused and emitted at a precise location in the material 54, allowing significant power transfer to be achieved. The resulting power may be utilized to perform a myriad of internal operations of the interactive object 20, including, but not limited to, computation (e.g., under command from the object controller 39), sensing, data transmission and reception, and sound, light, and movement via the special effects system 36.

[0027] In operation, the detector 16 of the system 10 can function to detect the retro-reflected electromagnetic radiation beam 28 from the retro-reflective marker 26 and provide data related to the detection to the control unit 18 for processing. The detector 16 can operate to specifically identify the marker 26 based on the specific designated wavelength of the emitted and reflected electromagnetic radiation, thus avoiding the problem of false detection. For example, the detector 16 can be specifically configured to detect electromagnetic radiation of a specific wavelength (e.g., corresponding to that emitted by the emitter 14) through the use of physical electromagnetic radiation filters, signal filters, and the like. Additionally, the detector 16 can utilize a specific configuration of optical detection capabilities and electromagnetic radiation filters to capture substantially only the retro-reflected electromagnetic radiation. In embodiments where the retro-reflected wavelength is the same as the wavelength that harvests power, the detection of the retro-reflection can also serve as confirmation that the operating wavelength of the electromagnetic radiation 28 has impinged on the interactive object 20.

[0028] For example, detector 16 may be configured to detect wavelengths of electromagnetic radiation that are retroreflected by retroreflective markers 26 while filtering out wavelengths of electromagnetic radiation that are not retroreflected by markers 26, including the wavelengths of interest. As an example, detector 16 may be a camera having multiple electromagnetic radiation capture capabilities (e.g., charge-coupled device (CCD) and / or complementary metal-oxide semiconductor (CMOS) sensors corresponding to pixels) to generate a signal from received electromagnetic radiation. In one example embodiment, detector 16 may be an amp® high dynamic range (HDR) camera system available from Contrast Optical Design and Engineering, Inc. of Albuquerque, New Mexico.

[0029] The control unit 18, which drives the emitters 14 and receives and processes data from the detectors 16, may include one or more processors 40 and one or more memories 42, which may generally be referred to herein as "processing circuitry." As specific, non-limiting examples, the one or more processors 40 may include one or more application specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), one or more general purpose processors, or any combination thereof. Additionally, the one or more memories 42 may include volatile memory, such as random access memory (RAM), and / or non-volatile memory, such as read only memory (ROM), an optical drive, a hard disk drive, or a solid state drive. In some embodiments, the control unit 18 may form at least a portion of a control system configured to coordinate the operation of various amusement park features, such as amusement park attractions and control systems. It should be understood that subsystems of the system 10 may include similar features. In one example, the special effects system 36 may include processing capabilities via a processor 48 and a memory 50. Additionally, if an object controller 39 is present, it may include integrated processing and memory components.

[0030] It should be noted that the placement of the emitter(s) 14, detector(s) 16, control unit 18, and other features may vary based on application specific considerations and the manner in which the control unit 18 interfaces with the ions. In an embodiment of the system 10, the emitter 14 and the sensor or detector 16 are integral features such that the operational surface associated with the detector 16 essentially overlaps the operational surface associated with the emitter 14. That is, the detector 16 is substantially co-located with the emitter 14, which may be desirable due to the retroreflection of the markers 26, although the present disclosure is not necessarily limited to this configuration. For example, as discussed above, retroreflection may be associated with a cone of reflection with the highest intensity at the center. Thus, the detector 16 may be positioned within an area where the intensity of the retroreflective marker's cone of reflection is lower than its center but still detectable by the detector 16. As a non-limiting example, in some embodiments, the emitter 14 and the detector 16 may be concentric or co-located. However, the detector 16 (eg, an infrared camera) may be located at a different position relative to the emitter 14, which may include an infrared light bulb, one or more diode emitters, a laser, or a similar source.

[0031] As illustrated herein, the interactive object 20 allows electromagnetic radiation 28 to pass through a portion of the housing 22 from the exterior surface 24 to impinge on the appropriate circuitry of the power harvesting device 38. In some embodiments, the interactive object 20 includes a reflector assembly 52 disposed on or within the housing 22, for example, to form a portion of the exterior surface 24. In some embodiments, at least a portion (e.g., a first portion) of the reflector assembly 52 is formed from a material 54 (e.g., a transparent material) that is transparent to electromagnetic radiation at least in the wavelength range for power harvesting. In this manner, the electromagnetic radiation 28 used to harvest power can penetrate the material 54 of the housing 22 (or the reflector assembly 52 coupled to the housing 22) to reach the appropriate power harvesting device 38. In specific examples, the power harvesting is infrared power harvesting (e.g., 750-1200 nm for near infrared light) and the material 54 is transparent or nearly transparent to infrared light (e.g., transmits at least 50% of infrared light). In other embodiments, the power harvesting circuitry may be disposed on or within the exterior surface 24 such that electromagnetic radiation directly contacts the power harvesting device 38. The material 54 may be glass or a clear plastic, such as poly(methyl methacrylate), that is transparent to visible and near infrared light. In this manner, the material 54 may allow internally illuminated components of the special effects system 36 to be visible. The material 54 may be opaque to visible light, such as a semiconductor material (e.g., silicon, germanium).

[0032] A portion (e.g., a second portion) of the reflector assembly 52 can include a retroreflective marker 26. In some embodiments, the emitter 14 is configured to emit an electromagnetic radiation beam 28 at a frequency that corresponds to the material of the retroreflective marker 26 (e.g., that the retroreflective elements of the marker 26 can reflect). In some embodiments, the retroreflective marker 26 reflects wavelengths that are transmitted by the transparent material 54. In this manner, a single wavelength (or range of wavelengths) can be used to both transfer power and detect the interactive object 20. In some embodiments, the wavelength (or range of wavelengths) used for both power transfer is different from the retroreflected wavelength or wavelengths.

[0033] For example, the retroreflective markers 26 may include a coating of retroreflective material disposed on or within the exterior surface 24, or a solid piece of material bonded to the housing 22 of the object 20. As a more specific, but non-limiting example, the retroreflective material may include spherical and / or prismatic reflective elements incorporated into the reflective material to enable retroreflection to occur. Also, in some embodiments, there may be many such retroreflective markers 26, which may be arranged in a particular pattern stored in memory 42 to enable further processing, analysis, and execution of control routines by the control unit 18 (e.g., a control system).

[0034] The retroreflective marker 26 can reflect a large portion of the electromagnetic radiation (e.g., infrared, ultraviolet, visible wavelengths, or radio waves, etc.) incident from the electromagnetic radiation beam 28 back towards the detector 16 within a relatively well-defined cone having a central axis and at an angle substantially the same as the angle of incidence. This reflection facilitates identification of the location of the retroreflective marker 26 by the system 10 and correlation with various information (e.g., patterns, possible locations) stored in the memory 42. The control unit 18 can then use this location information (obtained based on the reflected electromagnetic radiation) to perform various analysis and / or control routines, such as determining whether to trigger or otherwise control the external special effects system 60. Thus, the system 10 can coordinate special effects operated through harvested power with external special effects provided by the external special effects system 60. In this manner, feedback at the interactive object 20 can enhance effects within an immersive environment.

[0035] 3 and 4 show examples of reflector assembly 52 arrangements. FIG. 3 is a schematic top view of an example of reflector assembly 52 in which retroreflective markers 26 form an annular body around transparent material 54. The material 54 in the center of the annular body can be either transparent material, infrared transparent material of the same wavelength (or frequency) as retroreflective markers 26 (~850nm-940nm), or transparent material of other selected wavelengths (e.g., 1050nm, 1300nm, 1550nm, 1720nm). Visible light emission can also be achieved by implementing transparent material 54 as a transparent or semi-transparent material layer. Transmissive material 54 and retroreflective markers 26 can be coplanar or arranged as adjacent layers (e.g., transmissive material 54 arranged adjacent to retroreflective markers 26 on the upper or lower side). Additionally, the transmissive material 54 and the retroreflective markers 26 may be positioned to have equal or unequal cross-sectional areas in the reflector assembly 52. ​​In one embodiment, the transmissive material 54 and the retroreflective markers 26 form adjacent halves of the reflector assembly 52.

[0036] 4 is a side view of reflector assembly 52 in which a single material 70 is both retroreflective and transmissive / transparent at different wavelengths such that the reflector assembly can transmit desired frequencies and reflect others. Reflector assembly 52 can utilize frequency-specific anti-reflective (AR) coatings or materials to allow transmission (shown as electromagnetic radiation beam 28a) at selected wavelengths (e.g., 1550 nm) while allowing reflection (shown as electromagnetic radiation beams 28b, 28c) at other desired wavelengths (e.g., 850 nm). It should be understood that the arrangements of FIGS. 3-4 are shown by way of example, and that reflector assembly 52 can be implemented as a layer or coating, in any form that maintains a desired level of reflectivity, and according to the particular shape and geometry of interactive object 20.

[0037] 5 is a process flow diagram of a method 80 for powering an interactive object 20. The method 80 may include steps stored as instructions in memory 42 and executable by one or more processors 40 of the control unit 18. It should be noted that in some embodiments, the steps of the method 80 may be performed in a different order than shown, or may be omitted entirely. Also, some of the illustrated blocks may be performed in combination with each other.

[0038] In the illustrated embodiment, the method 80 includes emitting electromagnetic radiation in an area using one or more emitters (block 82). A portion of the emitted electromagnetic radiation is picked up by interactive objects in the area and used to activate integral feedback of the interactive objects, such as special effects (block 84). A portion of the emitted electromagnetic radiation is also reflected by retroreflective materials of the interactive objects (block 86). Based on the location of the reflected electromagnetic radiation received by a detector of the system, the location of the interactive objects and / or a movement pattern of either the interactive objects can be detected (block 88). For example, in one embodiment, a controller can monitor the movement patterns of the retroreflective markers to identify a pattern associated with a particular downstream action. Additionally, the controller can use some characteristics of the retroreflective markers (e.g., number or position on the interactive object) to identify the holder or type of interactive object and select or activate a downstream action based on factors including the identification information, and the location and / or the movement pattern.

[0039] For example, a downstream action may be the activation of an external special effect based on the detected position and / or movement pattern of the interactive object (block 90). As an example, the interactive object is a sword, and drawing the sword from a wall activates a lighting effect on the sword in response to a drawing sound and associated wall effects such as a change in the shape or color of the wall. The wall may be a fixed element of the immersive environment that may support more complex effects, and the lighting effect on the sword may be retained even when the wall is removed to further the illusion. The system 10 may operate to selectively activate integral special effects or feedback of the interactive object in conjunction with the external special effects.

[0040] In another example shown in FIG. 6, the interactive object 20 can include user-specific interaction effects. The interactive object 20, shown here as a sword 100, has a reflector assembly 52 implemented as a point located at the sword tip 108. The reflector assembly 52 allows electromagnetic radiation to penetrate the sword tip 108 to allow the power harvesting device 38 to harvest power. In one embodiment, the exterior surface 24 of the housing 22 that is not part of the reflector assembly 52 (e.g., the grip portion) is opaque to electromagnetic radiation that passively powers the interactive object 20. In this manner, the sword 100 is directional such that the sword 100 is passively powered when pointed toward a source of electromagnetic radiation in a particular manner. In other embodiments, the reflector assembly 52 can form a larger portion (or all) of the exterior surface 24. In such an embodiment, the interactive object 20 can be powered when pointed at various angles relative to the emitter.

[0041] The sword 100 includes a special effects system 36 that controls built-in special effects, shown here as a plurality of light sources 114, 116. The first light source 114 may be an LED light source of a first color and the second light source may be an LED light source of a second color. In one embodiment, an object controller 39 is operative to receive control signals that control the operation of the special effects system 36 to selectively activate the light sources 114, 116 in a particular pattern or sequence. In one example, the sword 100 includes an array 124 of individual pressure or grip sensors 126 that provide pressure information to the object controller 39 (via internal communication leads 128). The array may be a capacitive or force sensitive resistor array of at least 16 or at least 256 individual sensors.

[0042] The object controller 39 can use signals from the array 124 under passive power to perform calibration based on sensor data indicative of a particular user's characteristic grip biometric. This calibration process can activate feedback via the special effects system 36 (e.g., activation of the light sources 114, 116, activation of the speaker 130, activation of the haptic feedback elements 132 in a pattern associated with adapting the sword 100 to the particular user). Additionally, the object controller 39 can store this calibration information. In an environment where the sword 100 does not receive passive power, it can be inactive to a compatible or non-compatible user. However, in an immersive environment, the sword 100 can receive sufficient passive power to recognize its compatible user and provide special effects for the compatible user (e.g., green light, clear tone) that are different from special effects (e.g., red light, unpleasant sound) for non-compatible users who have a grip biometric that differs from that of the compatible user. In this way, the user can experience that their particular object 20 is adapted to them. During each use while receiving passive power, the object 20 can generate a special effect associated with a compatible user when the compatible user holds the object. It should be understood that other biometric identifiers can also be used. In one embodiment, the system 10 can receive facial recognition data (e.g., from the sensor 32 operating as a camera). When the facial recognition data matches the object recognition data (e.g., from the reflector assembly configuration or the unique reflective wavelength band of the object 20), the control unit 18 can activate the emitter 14 to emit electromagnetic radiation that powers the interactive object 20.

[0043] 7 is a process flow diagram of a method 150 for powering an interactive object having multiple available special effects. As discussed above, these effects can be selectively activated based on sensors integrated into the interactive object. Additionally or alternatively, the special effects can also be activated based on the position or movement patterns of the interactive object.

[0044] The method 150 includes emitting electromagnetic radiation within an area using one or more emitters (block 152). A portion of the emitted electromagnetic radiation is reflected and detected by a retroreflective material of the interactive object (block 154). Based on the detected portion of the electromagnetic radiation received by the detector of the system, a position of the interactive object and / or a movement pattern of any of the interactive objects can be determined (block 158). For example, in one embodiment, the controller can identify a first movement pattern of the retroreflective marker and drive the emitter to further emit electromagnetic radiation of a first wavelength (block 160). The interactive object includes a first power harvesting device powered by the electromagnetic radiation of the first wavelength, and passive power received by the first power harvesting device further causes activation of a first special effect of the interactive object coupled to the first power harvesting device (block 162). In another example, the controller can identify a second movement pattern of the retroreflective marker and drive the emitter to further emit electromagnetic radiation of a second wavelength (block 164). The interactive object includes a second power harvesting device that is powered by electromagnetic radiation at a second wavelength rather than the first wavelength. Similarly, the first power harvesting device is not powered by electromagnetic radiation at the second wavelength. The passive power received by the second power harvesting device further activates a second special effect of the interactive object coupled to the second power harvesting device (block 166). An external controller can affect the activated special effect of the interactive object through selective activation or adjustment of the wavelength of the emitter.

[0045] FIG. 8 is a process flow diagram of a method 170 for powering an interactive object triggered by detection of a retroreflective material on the interactive object. The method 170 includes emitting electromagnetic radiation in an area using a source, such as a first emitter (block 172). A portion of the emitted electromagnetic radiation is reflected and detected by the retroreflective material of the interactive object (block 174). Based on the detected portion of the electromagnetic radiation received by the detector of the system, the location of the retroreflective material of the interactive object and / or any movement patterns of the interactive object can be determined (block 176). The emitter (using the same or different emission sources) can be focused based on the location of the detected material (block 178). In some embodiments, this focusing can include estimating a location based on a known spatial relationship between the detected retroreflective material and a transparent portion of a reflector assembly on the interactive object. The emitter emits focused electromagnetic radiation (block 180), from which power is harvested to operate the special effect (block 182).

[0046] In one example, the focusing emitter can be an emitter with one or more sources configured to emit a combination of discrete near-infrared (NIR) frequencies (e.g., 800 nm to 2500 nm) to achieve multiple functionalities. The desired reflected frequency (e.g., 850 nm) can be utilized to identify the reflector location. Reflection and tracking can be achieved through a passive NIR emitter, and the reflection can be tracked through camera-based computer vision. The reflector location tracked by computer vision is utilized to activate an NIR laser of the same or different frequency as the reflected frequency. The NIR laser can be further focused, e.g., targeted and manipulated, to the reflector location or the coordinated interactive object location through the use of technologies such as scanning micromirrors or non-mechanical beam manipulation methods such as steerable electro-evanescent optical refractors (SEEORs). The final utilization of discrete NIR frequencies versus reflected frequencies depends on the usage scenario and the intended application function. Both approaches can provide similar functionality, with the discrete approach adding potential additional methods of device-to-device communication (e.g., data, identification, response triggers). Another additional benefit of discrete frequencies is that they can enhance the safety of the present invention. For example, in the 850 nm region, NIR reflectivity may be desirable for compatibility with existing systems, but laser emitters intended to power devices at these frequencies may not be desirable. In this case, using a discrete frequency NIR laser, for example at least 1550 nm, allows power transmission at the intended intensity as the frequencies are reflected from the eye. The use of NIR lasers allows for high passive power transmission with enhanced focusing capabilities, resulting in selective power transmission to only one or a portion of interactive objects in an area while not powering other interactive objects in the same area.

[0047] While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

[0048] The technology presented and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that positively improve the art and are therefore not abstract, intangible, or purely theoretical. Moreover, if any claim appended at the end of this specification contains one or more elements designated as "means for [performing] ... [function]" or "step for [performing] ... [function]," such elements are to be construed pursuant to 35 U.S.C. 112(f). On the other hand, for any claim containing an element designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f). [Explanation of symbols]

[0049] 14 Emitter 16 Detectors 18 Control Unit 20 Interactive Objects 22 Housing 24 Housing outer surface 26 Retroreflective markers 28A, 28B, 28C Electromagnetic radiation 32 Sensors 36 Special Effects System 38 Power Harvesting Device 39 Object Controller 40 processors 42 Memory 48 processors 50 Memory 52 Reflector Assembly 60 External special effects system

Claims

1. 1. An interactive object system comprising: an infrared light emitter that emits infrared light; An interactive object, comprising: a housing, at least a portion of an exterior surface of the housing including a reflector assembly that partially transmits and partially reflects the infrared light; an optical power harvesting device configured to receive the infrared light through the reflector assembly of the housing and harvest power from the received infrared light; a special effects system disposed within or on the housing and receiving power from the optical power harvesting device to activate one or more effects on the interactive object; an interactive object including a detector for detecting infrared light reflected from the reflector assembly; a controller that controls operation of the infrared light emitter and receives data from the detector indicative of the reflected infrared light; An interactive object system comprising:

2. the housing of the interactive object includes a wand, and the reflector assembly is disposed at a tip of the wand. The system of claim 1 .

3. the infrared light emitter includes a first infrared light source emitting the infrared light in a first wavelength range and a second infrared light source emitting further infrared light in a second wavelength range; The system of claim 1 .

4. The second infrared light source is a near-infrared laser. The system of claim 3.

5. The infrared light is in the range of 800 nm to 1550 nm. The system of claim 3.

6. The first wavelength range and the second wavelength range are different. The system of claim 3.

7. the controller is programmed to activate the second infrared light source based on the data indicative of the reflected infrared light from the detector. The system of claim 3.

8. the first infrared light source is operated continuously; The system of claim 7.

9. the reflected infrared light is in the same wavelength range as the received infrared light from which the optical power harvesting device harvests power. The system of claim 1 .

10. the reflected infrared light is in the range of about 850 nm to about 940 nm, and the received infrared light at the optical power harvesting device is at least 1000 nm. The system of claim 9.

11. the special effects system includes a haptic feedback device, the haptic feedback device configured to operate in response to the optical power harvesting device harvesting power from the received infrared light. The system of claim 1 .

12. the special effects system includes a light source configured to be operative in response to the optical power harvesting device harvesting power from the received infrared light to emit light from the housing. The system of claim 1 .

13. The special effects system comprises: a plurality of sensors disposed on the exterior surface of the interactive object in areas corresponding to grip portions; an object controller disposed on or within the housing; The object controller comprises: receiving signals from the plurality of sensors; identifying a gripping force of a user holding the interactive object based on the signal; generating a control signal to the special effects system based on the identified grip force; It is programmed to The system of claim 1 .

14. the special effects system further comprising a haptic feedback device, a light source, or both, operable in response to the generated control signal; The system of claim 13.

15. the reflector assembly includes a material that is at least partially opaque to visible light and transmits the infrared light; The system of claim 1 .

16. 1. An interactive object method comprising: emitting a first electromagnetic radiation in an area using a first light source; detecting the electromagnetic radiation reflected from a retroreflective material in the area, the retroreflective material being disposed on an interactive object; determining a location of the retroreflective material based on the detected electromagnetic radiation; emitting a second electromagnetic radiation toward the location using the first light source or a second light source and using power harvested from the second electromagnetic radiation to activate a special effect of the interactive object; The method includes:

17. The first light source is an infrared light source, and the second light source is an infrared laser light source.

17. The method of claim 16.

18. focusing the second light source to emit the second electromagnetic radiation based on the location.

17. The method of claim 16.

19. focusing the second light source includes focusing the second light source onto a portion of the interactive object based on a known relationship between the location of the retroreflective material and a location of a material on the interactive object that transmits the second electromagnetic radiation to reach a power harvesting device to activate the special effect of the interactive object.

20. The method of claim 18.

20. An interactive object, comprising: a power harvesting device for harvesting power from electromagnetic radiation; a housing having the power harvesting device disposed therein, the housing comprising a reflector assembly that transmits the electromagnetic radiation to the power harvesting device through a first portion of the reflector assembly and reflects the electromagnetic radiation from a second portion of the reflector assembly to an external detector, the first portion comprising a transmissive material and the second portion comprising a retroreflective material; a special effects system operated by the harvested power from the power harvesting device; An interactive object comprising:

Images