Interactive object systems and methods

Abstract

To provide interactive object systems.SOLUTION: An interactive object system includes an interactive object 20 and a source of electromagnetic radiation, e.g., an external source. A power harvesting device 38 of the interactive object 20 receives and harvests power from the electromagnetic radiation to power a special effect system of the interactive object 20. In an embodiment, the interactive object 20 includes a retroreflective material that reflects electromagnetic radiation, which may be of the same wavelength as or a different wavelength than the electromagnetic radiation from which power is harvested. The interactive object system detects the reflected electromagnetic radiation, which may be used to trigger one or more additional actions related to the interactive object 20.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This disclosure claims priority and the benefit thereof to U.S. Provisional Patent Application No. 63 / 010,385, entitled "Interactive Object Systems And Methods", filed on April 15, 2020, the disclosure of which is incorporated by reference in its entirety for all purposes.

[0002] This disclosure relates generally to objects used in interactive environments such as game environments or amusement parks. Specifically, embodiments of the present disclosure relate to passively powered interactive objects that use power harvesting to facilitate interaction effects.

Background Art

[0003] This section is intended to introduce the reader to various aspects of technologies that may be related to various aspects of the present disclosure. This discussion is thought to be helpful in showing the reader the background circumstances and promoting a better understanding of the various aspects of the present disclosure. Accordingly, these descriptions should be read from the above perspective rather than as an admission of prior art.

[0004] In recent years, amusement parks have generally been moving towards creating immersive environments that include props, media, and special effects to enhance the guest experience and support a particular story of the environment. In some immersive environments, part of the fun for guests is having their own devices, such as props or toys, that interact with the environment in various ways. In one example, a guest may desire to use a handheld device to interact with the immersive environment to generate specific effects that simulate the effects of a movie or game. However, handheld objects are relatively small and may have limited power and / or capacity for internal effects components. Further, such devices may not be able to interact with the immersive environment to generate these effects and produce many and / or various effects, and may be independent of user input (e.g., the user turning effects on and off). Thus, there is currently a recognized desire to have interactive objects that can generate changing special effects in an immersive environment. SUMMARY OF THE INVENTION

[0005] Some embodiments within the same scope as the subject matter of the original claims are summarized below. These embodiments are not intended to limit the scope of the present disclosure, but rather are merely intended to provide an overview of some of the disclosed embodiments. In fact, the present disclosure can include various forms that may be similar to or different from the embodiments shown below.

[0006] According to one embodiment, an interactive object system includes an infrared light emitter that emits infrared light and an interactive object. The interactive object includes a housing, and at least a part of the outer surface of the housing includes a reflector assembly that partially transmits and partially reflects infrared light. The interactive object further includes a photovoltaic power harvesting device configured to receive infrared light through the reflector assembly and harvest power from the received infrared light, and a special effect system disposed within or on the housing that receives power from the light energy harvesting device and activates one or more effects of the interactive object. The interactive object system further includes a detector that detects the infrared light reflected from the reflector assembly, and a controller that controls the operation of the infrared light emitter and receives data indicating the reflected infrared light from the detector.

[0007] According to another embodiment, a method includes emitting first electromagnetic radiation into an area using a first light source, detecting the electromagnetic radiation reflected from a retroreflective material disposed on an interactive object within the area, determining the position of the retroreflective material based on the detected electromagnetic radiation, emitting second electromagnetic radiation toward the position using a second light source, and activating a special effect of the interactive object using the power harvested from the second electromagnetic radiation.

[0008] According to another embodiment, an interactive object is provided that includes a power harvesting device for harvesting power from electromagnetic radiation and a housing within which the power harvesting device is disposed. The housing includes a reflector assembly and a special effect system that is actuated by the harvested power from the power harvesting device. The reflector assembly transmits electromagnetic radiation to the power harvesting device through a first portion of the reflector assembly and reflects electromagnetic radiation from a second portion of the reflector assembly to an external detector. The first portion includes a transmissive material and the second portion includes a retroreflective material. The interactive object also includes a special effect system that is actuated by the harvested power from the power harvesting device.

[0009] According to another embodiment, an interactive object is provided that includes a power harvesting device for harvesting power from electromagnetic radiation and a housing within which the power harvesting device is disposed. The housing includes a reflector assembly that transmits electromagnetic radiation of a first wavelength to the power harvesting device and reflects electromagnetic radiation of a second wavelength to an external detector, where the first wavelength is different from the second wavelength. The interactive object also includes a special effect system that is actuated by the harvested power from the power harvesting device.

[0010] These and other features, aspects, and advantages of the present invention will be better understood by reading the following detailed description while referring to the accompanying drawings in which like parts are designated by like reference numerals throughout.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Best Mode for Carrying Out the Invention

[0012] Hereinafter, one or more specific embodiments will be described. For the sake of brevity in describing these embodiments, not all implementation features are described herein. It should be understood that in any such implementation development, as seen in any engineering or design project, numerous implementation-specific decisions must be made to achieve the individual goals of the developer, such as compliance with system-related and business-related constraints that may vary depending on the implementation. Further, although such development efforts can be complex and time-consuming, they should be understood as routine endeavors of design, fabrication, and manufacture for those skilled in the art who benefit from the present disclosure.

[0013] When introducing elements of various embodiments of the present disclosure, articles such as "a", "an", "the", and "said" are to be taken to mean that these elements are present one or more than one. The terms "comprising", "including", and "having" are intended to be inclusive and mean that additional elements other than the recited elements may exist. Hereinafter, one or more specific embodiments of the present embodiments described herein will be described. For the sake of brevity in describing these embodiments, not all implementation features are described herein. It should be noted that in any such implementation development seen in any engineering or design project, numerous implementation-specific decisions must be made to achieve the specific objectives of the developer, such as compliance with system-related and business-related constraints that may vary depending on the implementation. Furthermore, although such development efforts can be complex and time-consuming, they are routine endeavors of design, fabrication, and manufacturing for those skilled in the art who benefit from the present disclosure.

[0014] Guests in immersive or themed environments can enjoy carrying handheld objects along the theme, such as swords, stuffed animals, hats, wands, jewels, or other props, or wearing such costume elements. These objects can have a certain degree of interactivity, but usually, the interaction is brought about by an external device that recognizes the object (e.g., image recognition) and activates an external action based on this recognition. In such a configuration, the object can be implemented as a relatively inexpensive passive device, and more complex and expensive interaction elements can exist outside or on the outside of the passive device. The problem with using such unpowered passive devices to manage the interaction is that no feedback or effect occurs on or within the passive device. Although a guest feedback system can be positioned as a fixed element of the environment, the ability to generate feedback within or on the passive device can enhance the degree of immersion in the themed environment.

[0015] Embodiments of the present disclosure relate to special effects of a handheld object or other interactive object that holds only a powerless or relatively low-power internal power source and is passively powered using light energy or other electromagnetic energy harvested from an external source. Power harvesting can be used to power a built-in special effects system or other feedback system of an interactive object. In some implementations, by providing an external power source, an interactive object can eliminate a visible power button or activation feature and a heavy or expensive power source. Further, the power source can be controlled by an interactive object system that activates the supply of power to a particular interactive object in the environment (and does not supply power to other objects) such that the effects experienced by the user occur visually, auditorily, tactilely, or otherwise from the user's own interactive object to enhance the immersive experience, and / or (e.g., in relation to external effects or interactions) at a timing controlled by the system.

[0016] One or more built-in special effect systems operate passively as part of an interactive object system that directs electromagnetic radiation (which can be in a non-visible wavelength range) at an interactive object to activate its special effect or other feedback system. The disclosed embodiments facilitate the activation of the special effects of an interactive object regardless of whether a user harvests sufficient motion-based power, as opposed to systems that harvest power from a user's movement, thereby enabling users with various abilities and interests to enjoy an immersive environment and participate in a group story directed by a control system. Also, passive power harvesting offers maintenance advantages, and the user does not need to worry about battery replacement prior to interacting with the immersive environment. Further, the interactive object system can incorporate an electromagnetic radiation source that can be focused to a sufficiently narrow location so that only a desired interactive object or a set of interactive objects is powered. In one embodiment, the interactive object can include markers such as a retroreflective marker detectable within the environment that can be used to direct electromagnetic energy at the location of the interactive object.

[0017] In one embodiment, such an object can be a prop or toy used within an interactive environment to increase the variability of special effect control by using power harvesting. The use of power harvesting allows a user to freely move within the immersive environment while the interactive object is receiving power to activate its built-in special effect. Further, while the embodiments of the present disclosure are described in the context of toys, props, or handheld objects, it should be understood that the disclosed embodiments can also be used with other types of objects. Such objects can include wearable objects such as clothing, jewelry, bracelets, headgear, glasses, etc. Also, the object can be a prop or scenic item within the immersive environment. The immersive environment can be an environment such as an amusement park, a complex entertainment facility, a retail store, etc.

[0018] Some aspects of the present disclosure can be better understood by referring to FIG. 1, which generally shows a method by which an interactive object control system 10 can be integrated into an immersive environment according to this embodiment. As shown, system 10 includes one or more emitters 14 configured to emit electromagnetic radiation of one or more wavelengths (e.g., light such as infrared light, ultraviolet light, visible light, or radio waves) (which can be all or part of an emission subsystem having one or more emission devices and associated control circuits). System 10 also includes a detector 16 configured to detect electromagnetic radiation reflected as a result of the emission (which can be all or part of a detection subsystem having one or more sensors or cameras, etc. and associated control circuits), as will be described in more detail below. System 10 also includes a control unit 18 communicatively coupled to the emitter 14 and the detector 16 to control the operation of the emitter 14 and the detector 16 (emission subsystem and detection subsystem) and execute various signal processing routines resulting from the emission, reflection, and detection processes.

[0019] As shown, the interactive object control system 10 can include an interactive object 20 (shown as a handheld object) having a housing 22 with an outer surface 24 formed at least in part from a material that allows a particular wavelength of electromagnetic radiation used to power the built-in special effects to pass through and be received by an internal power harvesting circuit of a power harvesting device housed on or within the interactive object 20. In certain embodiments, the interactive object can also include a retroreflective marker 26 disposed on or within the outer surface 24. Although the illustrated embodiment shows a single interactive object 20, it should be understood that system 10 can be used with one or more interactive objects 20 within the immersive environment.

[0020] In one embodiment, the emitter 14 is external to the interactive object 20 (e.g., spaced apart). The emitter 14 emits electromagnetic radiation, represented by an electromagnetic radiation beam 28 that expands for purposes of illustration, and operates to selectively illuminate, immerse, or flood the area 30 with electromagnetic radiation. In some embodiments, the electromagnetic radiation beam 28 can represent a plurality of light beams (electromagnetic radiation beams) emitted from different sources 31 of one or more emitters 14 (all parts of the emission subsystem including one or more emitters 14). For example, the source 31 can be a visible light source, an infrared light source, etc., that emits electromagnetic radiation of a desired wavelength. Further, the emitter 14 can include one or more sources 31 of different types, such as light emitting diodes, laser diodes, etc. Generally, the electromagnetic radiation beam 28 is intended to represent electromagnetic radiation in any form that can be used according to this embodiment, such as in the form of light (e.g., infrared light, visible light, UV) and / or other bands of the electromagnetic spectrum (e.g., radio waves, etc.). However, it is also recognized that currently, in some embodiments, it may be desirable to use a specific band of the electromagnetic spectrum depending on various factors. For example, in one embodiment, it may be desirable to use electromagnetic radiation in a form that is not visible to the human eye or outside the human audible range so that the electromagnetic radiation used for tracking does not interfere with the guest experience. Further, it is currently recognized that depending on a particular environmental setting (e.g., whether the environmental setting is "dark" or whether people are expected to cross the beam path), a particular form of electromagnetic radiation, such as light of a particular wavelength (e.g., infrared light), may be more desirable than other forms.

[0021] Area 30 can correspond to all or part of an amusement park attraction area or immersive environment, such as a stage show, a vehicle ride area, and a waiting area outside the entrance of a ride or show. In one embodiment, while emitter 14 is fixed in place within the environment, interactive object 20 moves freely within the environment and moves through area 30 to receive electromagnetic radiation 28. Thus, by detecting (e.g., locating within area 30), tracking, and powering interactive object 20, one or more special effects resulting from interactive object 20 can be actuated via the emitted and detected electromagnetic radiation 28 of interactive object control system 10.

[0022] As disclosed generally herein, the actuation of the special effects of interactive object 20 is controlled by control unit 18 that drives emitter 14. This actuation can be indiscriminate such that emitter 14 continuously emits electromagnetic radiation of an appropriate wavelength or frequency corresponding to a power harvesting circuit, and any interactive object located within area 30 and facing emitter 14 passively receives power to actuate the special effects. In one embodiment, as disclosed in more detail herein, the actuation can be selective such that control unit 18 identifies or detects interactive object 20 and drives emitter 14 upon identification or detection to direct energy of an actuation wavelength at interactive object 20 so that the actuation of the special effects in interactive object 20 can be turned on or off in response to a desired story or user action.

[0023] FIG. 2 is a schematic diagram of system 10 showing an example of the interaction between interactive object 20 and various components of system 10 that exist outside of interactive object 20. In the illustrated example, interactive object 20 includes a retroreflective marker 26 that reflects electromagnetic radiation 28 of a specific wavelength detected by detector 16. However, it should be understood that in some implementations, retroreflective marker 26 may not be present. In addition to or instead of this, the disclosed detection or localization of interactive object 20 as shown herein can also involve a sensor 32 (e.g., proximity sensor, optical sensor, image sensor) of a system that provides position or movement data of interactive object 20.

[0024] During operation, electromagnetic radiation 28 from emitter 14 (shown as electromagnetic radiation 28a) functions as the power source for interactive object 20, and interactive object 20 further uses this harvested power to activate one or more built-in special effects of special effect system 36, which can include light, sound, fluid, tactile, or other special effects generated from interactive object 20 during operation. Special effect system 36 is part of interactive object 20 and can be partially included within or on housing 22, and can also include one or more features disposed on or visible from outer surface 24 to enable the user to observe or experience the activated special effects. Such features can include light sources, speakers, tactile feedback devices, ports that emit special effect materials (smoke, confetti, fluid), and / or movable elements that move in response to activation.

[0025] In the illustrated embodiment, the retroreflective marker 26 is operative to retroreflect electromagnetic radiation 28 (shown as incident electromagnetic radiation 28b and reflected electromagnetic radiation 28c) toward the detector 16, and this electromagnetic radiation 28 can be used to identify or track the interactive object 20. The retroreflection by the retroreflective marker 26 is such that a cone of reflected electromagnetic radiation 28 is incident on the detector 16, so that the control unit 18 can further correlate the center of the cone where the reflected electromagnetic radiation is most powerful to the point source of the reflection. The control unit 18 can identify and track the position of this point source based on this correlation, or can identify and monitor over time the pattern of the reflection by the retroreflective marker 26 as part of the tracking of the interactive object 20. As described, the emitter 14 and the detector 16 operate in accordance with the instructions of the control unit 18. In one embodiment, the position of the interactive object 20 within the cone of the electromagnetic radiation 28 triggers the operation of the emitter 14 to drive a light source that emits an electromagnetic radiation beam corresponding to the operating wavelength of the power harvesting device 38. In other embodiments, one or more wavelengths reflected by the retroreflective marker 26 also correspond to the wavelengths used for power harvesting by the power harvesting device 38. Thus, the detection wavelength used to identify and track the position of the interactive object 20 is also used for the passive powering of the built-in special effects of the interactive object.

[0026] The power harvesting device 38 can include an optical cell that responds to a specific wavelength of electromagnetic radiation. The optical cell can include light from a Wi-Charge device (Wi-Charge, Milwaukee, Wisconsin). The power harvesting device can include a thermophotovoltaic (TPV)-based power harnessing circuit. Depending on the frequency utilized for a particular application, a photovoltaic (PV)-based power harnessing circuit can also be utilized. In certain embodiments, the operating electromagnetic radiation 28 is provided by a laser source of the emitter 14 that can be focused to supply relatively high power. By transmitting near-infrared laser light through the material 54, the laser photons can be utilized as power. Since the laser is focused and emitted at the exact location of the material 54, a significant amount of power transmission can be achieved. The resulting power can be utilized to perform numerous internal operations of the interactive object 20, including but not limited to calculations (e.g., under commands from the object controller 39), sensing, data transmission and reception, and sound, light, and motion via the special effects system 36.

[0027] During operation, the detector 16 of the system 10 can function to detect the electromagnetic radiation beam 28 retroreflected from the retroreflective marker 26 and provide data related to the detection to the control unit 18 for processing. The detector 16 can operate to specifically identify the marker 26 based on a specific designated wavelength of the emitted and reflected electromagnetic radiation, thus avoiding problems of false detection. For example, the detector 16 can be specifically configured to detect electromagnetic radiation of a specific wavelength (e.g., corresponding to that emitted by the emitter 14) through the use of physical electromagnetic radiation filters and signal filters. Additionally, the detector 16 can utilize a specific configuration of optical detection functions and electromagnetic radiation filters to substantially capture only the retroreflected electromagnetic radiation. In embodiments where the retroreflective wavelength is the same as the wavelength for harvesting power, the detection of retroreflection can also serve as confirmation that the operating wavelength of the electromagnetic radiation 28 has impinged on the interactive object 20.

[0028] For example, detector 16 can be configured to detect the wavelength of the electromagnetic radiation retroreflected by the retroreflective marker 26 while filtering the wavelengths of electromagnetic radiation that are not retroreflected by the marker 26, including the wavelength of interest. As an example, detector 16 can be a camera having a plurality of electromagnetic radiation capture functions (e.g., charge-coupled device (CCD) and / or complementary metal-oxide semiconductor (CMOS) sensors corresponding to pixels) for generating a signal from the received electromagnetic radiation. In one example embodiment, detector 16 can be an amp® high dynamic range (HDR) camera system commercially available from Contrast Optical Design and Engineering of Albuquerque, New Mexico.

[0029] The control unit 18 that drives the emitter 14 and receives and processes data from the detector 16 can include one or more processors 40 and one or more memories 42, which can generally be referred to herein as a "processing circuit". As a specific non-limiting example, the one or more processors 40 can include one or more application specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof. Also, the one or more memories 42 can include volatile memories such as random access memory (RAM), and / or non-volatile memories such as read-only memory (ROM), optical drives, hard disk drives, or solid state drives. In some embodiments, the control unit 18 can form at least a portion of a control system configured to coordinate the operation of various amusement park features such as amusement park attractions and control systems. It should be understood that the subsystems of the system 10 can also include similar features. In one example, the special effects system 36 can include processing capabilities via a processor 48 and a memory 50. Further, if an object controller 39 is present, the object controller 39 can include integrated processing and memory components.

[0030] Note that the arrangement of one or more emitters 14, one or more detectors 16, the control unit 18, and other features can vary based on application-specific considerations and how the control unit 18 interacts with the ions. In embodiments of the system 10, the emitter 14 and the sensor or detector 16 are an integral feature such that the operative face associated with the detector 16 substantially overlaps the operative face associated with the emitter 14. That is, the detector 16 is located at substantially the same position as the emitter 14, which is considered desirable due to the retroreflectivity of the marker 26. However, the present disclosure is not necessarily limited to this configuration. For example, as described above, the retroreflectivity can be associated with a cone of reflection where the highest intensity is at the center. Thus, the detector 16 can be positioned within an area where the intensity of the cone of reflection of the retroreflective marker is lower than its center but can still be detected by the detector 16. As a non-limiting example, in some embodiments, the emitter 14 and the detector 16 can be arranged concentrically or co-located. However, the detector 16 (e.g., an infrared camera) can also be positioned at a different location relative to the emitter 14, which can include an infrared bulb, one or more diode emitters, a laser, or a similar source.

[0031] As shown in this specification, the interactive object 20 enables electromagnetic radiation 28 to pass through a part of the outer surface 24 of the housing 22 and impinge on the appropriate circuitry of the power harvesting device 38. In certain embodiments, the interactive object 20 includes a reflector assembly 52 disposed on or within the housing 22 so as to form, for example, a part of the outer surface 24. In certain embodiments, at least a part (e.g., a first part) of the reflector assembly 52 is formed from a material 54 (e.g., a transmissive material) that passes electromagnetic radiation within at least the wavelength range for power harvesting. In this way, the electromagnetic radiation 28 used for power harvesting can penetrate the material 54 of the housing 22 (or the reflector assembly 52 coupled to the housing 22) and reach the appropriate power harvesting device 38. By way of example, the power harvesting is infrared power harvesting (e.g., 750 - 1200 nm for near infrared light), and the material 54 is transmissive or substantially transmissive to infrared light (e.g., passes at least 50% of the infrared light). In other embodiments, the power harvesting circuitry can be disposed on or within the outer surface 24 such that the electromagnetic radiation is in direct contact with the power harvesting device 38. The material 54 can be a glass or transparent plastic that passes visible and near infrared light, such as poly(methyl methacrylate). In this way, the material 54 can make the internally illuminated components of the special effect system 36 visible. The material 54 can be one that does not pass visible light, such as a semiconductor material (e.g., silicon, germanium).

[0032] A part of the reflector assembly 52 (e.g., the second part) can include the retroreflective marker 26. In some embodiments, the emitter 14 is configured to emit an electromagnetic radiation beam 28 at a frequency corresponding to the material of the retroreflective marker 26 (e.g., the retroreflective element of the marker 26 can reflect). In some embodiments, the retroreflective marker 26 reflects the wavelength transmitted by the transmissive material 54. In this way, both power transmission and detection of the interactive object 20 can be performed using a single wavelength (or wavelength range). In some embodiments, the wavelength (or wavelength range) used for both power transmission is different from the one or more wavelengths that are retroreflectively reflected.

[0033] For example, the retroreflective marker 26 can include a coating of retroreflective material disposed on or within the outer surface 24, or a solid piece of material coupled to the housing 22 of the object 20. More specifically but non - limitingly, the retroreflective material can include spherical and / or prismatic reflective elements incorporated into the reflective material to enable the generation of retroreflection. Also, in some embodiments, a plurality of such retroreflective markers 26 can be present, and they can be arranged in a specific pattern stored in the memory 42 to enable further processing, analysis, and execution of control routines by the control unit 18 (e.g., the control system).

[0034] The retroreflective marker 26 can retroreflect most of the electromagnetic radiation (e.g., infrared, ultraviolet, visible wavelength, radio wave, etc.) incident from the electromagnetic radiation beam 28 towards the detector 16 at an angle substantially the same as the angle of incidence within a relatively well-defined cone range having a central axis. This reflection facilitates the identification of the position of the retroreflective marker 26 by the system 10 and the correlation with various information (e.g., patterns, possible positions) stored in the memory 42. Thereafter, the control unit 18 can utilize this position information (acquired based on the reflected electromagnetic radiation) to execute various analysis routines and / or control routines, and determine, for example, whether to trigger or otherwise control an external special effects system 60. Thus, the system 10 can coordinate the special effects operating through the power taken and the external special effects provided by the external special effects system 60. In this way, the feedback in the interactive object 20 can enhance the effects in the immersive environment.

[0035] Figures 3 and 4 show an example arrangement of the reflector assembly 52. FIG. 3 is a schematic top view of an example of the reflector assembly 52 in which the retroreflective marker 26 forms an annular body around the transmissive material 54. The material 54 in the central portion of the annulus can be composed of either a transparent material, an infrared transmissive material having the same wavelength (or frequency) as the retroreflective marker 26 (~850 nm to 940 nm), or a transmissive material of another selected wavelength (e.g., 1050 nm, 1300 nm, 1550 nm, 1720 nm). Also, visible light emission can be achieved by implementing the transmissive material 54 as a transparent or translucent material layer. The transmissive material 54 and the retroreflective marker 26 can be present on the same plane or arranged as adjacent layers (e.g., the transmissive material 54 is arranged above or below adjacent to the retroreflective marker 26). Further, the transmissive material 54 and the retroreflective marker 26 can be arranged such that their respective cross-sectional areas in the reflector assembly 52 are equal or unequal. In one embodiment, the transmissive material 54 and the retroreflective marker 26 form adjacent halves of the reflector assembly 52.

[0036] FIG. 4 is a side view of a reflector assembly 52 in which a single material 70 is both retroreflective and transmissive / transparent at different wavelengths so that the reflector assembly can transmit a desired frequency and reflect other frequencies. The reflector assembly 52 utilizes a frequency-specific anti-reflection (AR) coating or material to enable transmission at a selected wavelength (e.g., 1550 nm) (shown as electromagnetic radiation beam 28a), while enabling reflection at other desired wavelengths (e.g., 850 nm) (shown as electromagnetic radiation beams 28b, 28c). The arrangement of FIGS. 3-4 is shown as an example, and it should be understood that the reflector assembly 52 can be implemented in any shape as a layer or coating to maintain a desired level of reflectivity, according to the specific shape and geometric properties of the interactive object 20.

[0037] FIG. 5 is a process flow diagram of a power supply method 80 for the interactive object 20. The method 80 can include steps stored as instructions in the memory 42 and executable by one or more processors 40 of the control unit 18. Note that in some embodiments, the steps of the method 80 can be executed in an order different from the illustrated order, or can be completely omitted. Also, some of the illustrated blocks can be executed in combination with each other.

[0038] In the illustrated embodiment, method 80 includes the step of emitting electromagnetic radiation into an area using one or more emitters (block 82). A portion of the emitted electromagnetic radiation is captured by an interactive object within the area and used to activate an integrated feedback of the interactive object, such as a special effect (block 84). Also, a portion of the emitted electromagnetic radiation is reflected by a retroreflective material of the interactive object (block 86). Based on the position of the reflected electromagnetic radiation received by a detector of the system, the position of the interactive object and / or any movement pattern of the interactive object can be detected (block 88). For example, in one embodiment, a controller can monitor the movement pattern of a retroreflective marker to identify a pattern associated with a particular downstream action. Further, the controller can use some characteristics of the retroreflective marker (e.g., a number or position on the interactive object) to identify the holder or type of the interactive object and select or activate a downstream action based on factors including the identification information, as well as the position and / or movement pattern.

[0039] For example, the downstream action can be the activation of an external special effect based on the detected position and / or movement pattern of the interactive object (block 90). As an example, the interactive object is a sword, and when the sword is drawn from a wall, a lighting effect of the sword activates in response to a related wall effect such as a pulling sound and a change in the shape or color of the wall. The wall can be a fixed element of an immersive environment that can support more complex effects, and the lighting effect of the sword can be retained even when away from the wall to enhance the illusion. System 10 can operate to selectively activate an integrated special effect or feedback of the interactive object in conjunction with the external special effect.

[0040] In another example shown in FIG. 6, the interactive object 20 can include user-specific interaction effects. Here, the interactive object 20 shown as the sword 100 has a reflector assembly 52 implemented as a point located at the sword tip 108. The reflector assembly 52 allows electromagnetic radiation to penetrate the sword tip 108 so that the power harvesting device 38 can harvest power. In some embodiments, the outer surface 24 (e.g., the grip portion) of the housing 22 that is not part of the reflector assembly 52 does not allow the electromagnetic radiation that passively powers the interactive object 20 to pass through. In this way, the sword 100 has a directivity such that when the sword 100 is oriented in a specific manner towards the electromagnetic radiation source, the sword 100 is passively powered. In other embodiments, the reflector assembly 52 can form a larger portion (or all) of the outer surface 24. In such embodiments, the interactive object 20 can be powered when oriented at various angles with respect to the emitter.

[0041] The sword 100 includes a special effect system 36 that controls built-in special effects, shown here as a plurality of light sources 114, 116. The first light source 114 can be an LED light source of a first color, and the second light source can be an LED light source of a second color. In some embodiments, the object controller 39 operates to receive a control signal that controls the operation of the special effect system 36 and selectively activate the light sources 114, 116 in a specific pattern or sequence. In one example, the sword 100 includes an array 124 of individual pressure or grip sensors 126 that provide pressure information to the object controller 39 (via the internal communication lead 128). The array can be a capacitive or force-sensitive resistor array consisting of at least 16 or at least 256 individual sensors.

[0042] The object controller 39 can perform calibration based on sensor data indicating characteristic grip biometric measurements of a particular user using signals from the array 124 under passive power. This calibration process can activate feedback via the special effects system 36 (e.g., activation of the light sources 114, 116, the speaker 130, and the tactile feedback element 132 in patterns related to fitting the sword 100 to a particular user). Further, the object controller 39 can store this calibration information. The sword 100 can be inactive for a fitted or non-fitted user in an environment that does not receive passive power. However, in an immersive environment, the sword 100 can receive sufficient passive power to recognize its fitted user and provide special effects (e.g., green light, clear tone) for the fitted user that are different from special effects (e.g., red light, unpleasant sound) for a non-fitted user having a grip biometric measurement different from that of the fitted user. In this way, the user can experience that their particular object 20 fits them. The object 20 can generate special effects related to the fitted user when the fitted user holds the object during each use while receiving passive power. It should be understood that other biometric identifiers can also be used. In one embodiment, the system 10 can receive face recognition data (e.g., from a sensor 32 operating as a camera). When the face recognition data matches object recognition data (e.g., from a reflector assembly configuration or the object 20's unique reflected wavelength band), the control unit 18 can activate the emitter 14 to emit electromagnetic radiation that powers the interactive object 20.

[0043] FIG. 7 is a process flow diagram of a power supply method 150 for an interactive object having a plurality of available special effects. As described above, these effects can be selectively activated based on sensors integrated into the interactive object. In addition to or instead of this, the special effects can also be activated based on the position or movement pattern of the interactive object.

[0044] Method 150 includes the step of emitting electromagnetic radiation into the area using one or more emitters (block 152). A portion of the emitted electromagnetic radiation is reflected and detected by the retroreflective material of the interactive object (block 154). Based on the detected portion of the electromagnetic radiation received by the detector of the system, the position of the interactive object and / or any movement pattern of the interactive object can be determined (block 158). For example, in one embodiment, the controller can identify a first movement pattern of the retroreflective marker and drive the emitter to emit electromagnetic radiation of a first wavelength (block 160). The interactive object includes a first power harvesting device powered by electromagnetic radiation of the first wavelength, and the passive power received by the first power harvesting device further causes the activation of a first special effect of the interactive object coupled to the first power harvesting device (block 162). In another example, the controller can identify a second movement pattern of the retroreflective marker and drive the emitter to emit electromagnetic radiation of a second wavelength (block 164). The interactive object includes a second power harvesting device powered by electromagnetic radiation of the second wavelength rather than the first wavelength. Similarly, the first power harvesting device is not powered by electromagnetic radiation of the second wavelength. The passive power received by the second power harvesting device further activates a second special effect of the interactive object coupled to the second power harvesting device (block 166). The external controller can affect the special effects activated by the interactive object through selective activation or adjustment of the wavelength of the emitter.

[0045] FIG. 8 is a process flow diagram of a power supply method 170 for an interactive object triggered by detection of a retroreflective material on the interactive object. Method 170 includes the step of emitting electromagnetic radiation into an area using a source such as, for example, a first emitter (block 172). A portion of the emitted electromagnetic radiation is reflected and detected by the retroreflective material of the interactive object (block 174). Based on the detected portion of the electromagnetic radiation received by the detector of the system, the position of the retroreflective material of the interactive object and / or any movement pattern of the interactive object can be determined (block 176). The emitter can be focused based on the position of the detected material (using the same emission source or a different emission source) (block 178). In certain embodiments, this focusing can include estimating the position based on a known spatial relationship between the detected retroreflective material and the transmissive portion of the reflector assembly on the interactive object. The emitter emits focused electromagnetic radiation (block 180), from which power to activate a special effect is harvested (block 182).

[0046] In one example, the focusing emitter can be an emitter having one or more sources configured to emit a combination of discrete near-infrared (NIR) frequencies (e.g., 800 nm to 2500 nm) to achieve multiple functionalities. The position of the reflector can be identified using a desired reflection frequency (e.g., 850 nm). Reflection and tracking can be achieved through a passive NIR emitter, and the reflection can be tracked through camera-based computer vision. The position of the reflector tracked by computer vision is utilized to activate an NIR laser at the same or a different frequency than the reflection frequency. The NIR laser is further focused, e.g., targeted and operated, at the position of the reflector or the position of the adjusted interactive object through the use of techniques such as a scanning micromirror or non-mechanical beam steering methods such as a steerable electro-evanescent optical refractor (SEEOR). Ultimately, whether to utilize discrete NIR frequencies or the reflection frequency depends on the use scenario and the functionality of the intended application. Any of the techniques can provide similar functionality, and in the discrete approach, potential additional methods of device-to-device communication (e.g., data, identification, response triggers) are added. Another further advantage of discrete frequencies is that the safety of the present invention can be enhanced. For example, in the 850 nm region, NIR reflectivity may be desirable for compatibility with existing systems, but laser emitters intended to supply device power at these frequencies may not be desirable. In this case, for example, using an NIR laser with a discrete frequency of at least 1550 nm allows for power transmission at the intended intensity because the frequency reflects from the eye. The use of an NIR laser enables high passive power transmission with enhanced focusing capabilities, resulting in the ability to selectively transmit power to one or only some of the interactive objects within an area and not power other interactive objects within the same area.

[0047] In this specification, only some features of the present invention have been illustrated and described, but many modifications and changes will occur to those skilled in the art. Therefore, it should be understood that the appended claims are intended to cover all such modifications and changes that fall within the true spirit of the present invention.

[0048] The technology shown and claimed in this specification refers to and is applied to tangible things and specific examples of a practical nature that surely improve the technical field, and thus are not abstract, intangible, or purely theoretical. Further, if any claim appended to the end of this specification includes one or more elements designated as "means for [performing]... [function]" or "steps for [performing]... [function]", such elements should be construed in accordance with 35 U.S.C. § 112, paragraph 6. On the other hand, for any claim that includes elements designated in any other form, such elements should not be construed in accordance with 35 U.S.C. § 112, paragraph 6.

Explanation of Reference Numerals

[0049] 14 Emitter 16 Detector 18 Control Unit 20 Interactive Object 22 Housing 24 Outer Surface of Housing 26 Retroreflective Marker 28A, 28B, 28C Electromagnetic Radiation 32 Sensor 36 Special Effect System 38 Power Harvesting Device 39 Object Controller 40 Processor 42 Memory 48 Processor 50 Memory 52 Reflector Assembly 60 External Special Effect System

Claims

1. An interactive object system comprising: An infrared light emitter that emits infrared light; An interactive object, A housing, at least a part of the outer surface of the housing includes a reflector assembly that partially transmits and partially reflects the infrared light; A photovoltaic power harvesting device configured to receive the infrared light through the reflector assembly of the housing and harvest power from the received infrared light; A special effect system disposed within or on the housing, receiving power from the photovoltaic power harvesting device and activating one or more effects of the interactive object; An interactive object including: A detector for detecting the infrared light reflected from the reflector assembly; A controller for controlling the operation of the infrared light emitter and receiving data indicating the reflected infrared light from the detector; An interactive object system comprising the above.

2. The housing of the interactive object includes a wand, and the reflector assembly is disposed at the tip of the wand. The system according to Claim 1.

3. The infrared light emitter includes a first infrared light source that emits infrared light in a first wavelength range and a second infrared light source that emits additional infrared light in a second wavelength range. The system according to Claim 1.

4. The second infrared light source is a near-infrared laser. The system according to Claim 3.

5. The infrared light is in the range of 800 nm to 1550 nm. The system according to Claim 3.

6. The first wavelength range and the second wavelength range are different. The system according to Claim 3.

7. The controller is programmed to activate the second infrared light source based on the data indicating the reflected infrared light from the detector. The system according to Claim 3.

8. The first infrared light source operates continuously. The system according to Claim 7.

9. The reflected infrared light is in the same wavelength range as the received infrared light from which the photovoltaic power harvesting device harvests power. The system according to Claim 1.

10. The reflected infrared light is in the range of about 850 nm to about 940 nm, and the received infrared light in the photovoltaic power harvesting device is at least 1000 nm. The system according to claim 9.

11. The special effect system includes a haptic feedback device configured to operate in response to the photovoltaic power collection device collecting power from the received infrared light. The system according to claim 1.

12. The special effect system includes a light source configured to operate in response to the photovoltaic power collection device collecting power from the received infrared light and emit light from the housing. The system according to claim 1.

13. The special effect system includes a plurality of sensors disposed on the outer surface of the interactive object in a region corresponding to the grip portion, an object controller disposed on or within the housing, and is programmed to receive signals from the plurality of sensors, identify the grip strength of a user holding the interactive object based on the signals, generate a control signal to the special effect system based on the identified grip strength. The system according to claim 1.

14. The special effect system further includes a haptic feedback device, a light source, or both, that operate in response to the generated control signal. The system according to claim 13.

15. The reflector assembly includes a material that passes infrared light and at least partially blocks visible light. The system according to claim 1.

16. An interactive object method comprising: emitting first electromagnetic radiation into an area using a first light source; detecting the electromagnetic radiation reflected from a retroreflective material within the area, the retroreflective material being disposed on an interactive object; determining the position of the retroreflective material based on the detected electromagnetic radiation; emitting second electromagnetic radiation toward the position using the first light source or a second light source, and operating a special effect of the interactive object using power collected from the second electromagnetic radiation.

17. The first light source is an infrared light source and the second light source is an infrared laser light source. The method according to claim 16.

18. including the step of focusing the second light source to emit the second electromagnetic radiation based on the position The method according to claim 16.

19. The step of focusing the second light source includes the step of focusing on a part of the interactive object based on a known relationship between the position of the retroreflective material and the position of the material on the interactive object that transmits the second electromagnetic radiation to reach the power harvesting device and activate the special effect of the interactive object. The method according to claim 18.

20. An interactive object, a power harvesting device that harvests power from electromagnetic radiation, a housing in which the power harvesting device is disposed, the housing comprising a reflector assembly, the reflector assembly transmitting the electromagnetic radiation to the power harvesting device through a first part of the reflector assembly and reflecting the electromagnetic radiation from a second part of the reflector assembly to an external detector, the first part including a transmissive material and the second part including a retroreflective material, the housing; a special effect system actuated by the harvested power from the power harvesting device; An interactive object comprising.

Images