System and method for optical performance captured animated figure with real-time reactive projected media

Abstract

To provide a system and a method for optical performance captured animated figure using real-time reactive projected media.SOLUTION: A reactive media system includes: a motion control system having an animated figure with a body and actuators configured to adjust a figure portion of the body in response to interactive data received from one or more interactive data sources; and a media control system having a tracking camera configured to generate signals indicative of a current position and orientation of the figure portion based on a set of trackers coupled to the figure portion. The media control system includes a media controller configured to receive the signals, determine the current position and orientation based on the signals, and generate data indicative of images to be projected onto an external surface of the figure portion having the current position and orientation. The media control system also includes media controller configured to determine the current position and orientation on the basis of the received signal and to generate data indicating an image to be projected onto an external surface of a figure part having the current position and orientation.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application claims priority and the benefit thereof to U.S. Provisional Patent Application No. 62 / 956,468, entitled "SYSTEMS AND METHODS FOR OPTICAL PERFORMANCE CAPTURED ANIMATED FIGURE WITH REAL - TIME REACTIVE PROJECTED MEDIA", filed on January 2, 2020, the entire disclosure of which is hereby incorporated by reference for all purposes.

Background Art

[0002] This section is intended to introduce the reader to various aspects of technologies that may be related to various aspects of the technology described and / or claimed below. This discussion is thought to be helpful in showing the reader the background circumstances and facilitating a better understanding of the various aspects of the present disclosure. Accordingly, these descriptions should not be construed as an admission of prior art and should be read from the above perspective.

[0003] Amusement parks and other entertainment venues include, among many attractions, anime figures that entertain amusement park guests, especially for or alongside ride experiences. Some of the anime figures can be brought to life by projection mapping that projects a predetermined appearance onto the conventional anime figure. For example, certain anime figures can be visually complemented with a recorded or fixed set of images that can coordinate with the pre-programmed movement of the anime figure. Such technology provides higher entertainment value than a flat display surface, but it is currently recognized that further progress can be made to make guests more immersed in a particular attraction, ride, or interactive experience. For example, some of the anime figures have a projector disposed therein that generates unrealistic backlighting or glow through internal or rear projection through the translucent projection surface of the anime figure. Therefore, it is currently recognized that it is desirable to provide anime figures with the ability to look more lifelike and harmonize contextually with the environment in a realistic and convincing manner.

Summary of the Invention

Means for Solving the Problems

[0004] The following summarizes some embodiments that are within the same scope as the subject matter of the original claims. These embodiments do not limit the scope of the present disclosure; rather, they merely outline some of the disclosed embodiments. In fact, the present disclosure can include various forms that may be similar to or different from the embodiments shown below.

[0005] In one embodiment, a responsive media system for an entertainment attraction includes a movement control system including an anime figure having a main body and a set of actuators configured to adjust a figure portion of the main body in response to interactive data received from one or more interactive data sources. The movement control system also includes a set of trackers coupled to the figure portion of the main body. The responsive media system includes a media control system including a tracking camera configured to generate a signal indicative of a current position and a current orientation of the figure portion based on the set of trackers. The media control system includes a media controller coupled to the tracking camera and configured to receive the signal indicative of the current position and the current orientation. The media control system is also configured to determine the current position and the current orientation based on the signal and generate data indicative of an image to be projected onto an outer surface of the figure portion having the current position and the current orientation. The media control system also includes a projector communicably coupled to the media controller. The projector is configured to receive the data indicative of the image from the media controller and project the image onto the outer surface of the figure portion having the current position and the current orientation.

[0006] In one embodiment, a method of operating a responsive media system for an entertainment attraction includes receiving dialogue data from one or more dialogue data sources of the entertainment attraction via a figure controller of an anime figure, and generating a dialogue response of the anime figure based on the dialogue data via the figure controller. The method includes instructing, via the figure controller, an actuator disposed within the anime figure to execute the dialogue response by moving at least a portion of the body of the anime figure. The method also includes receiving, via the media controller, sensor feedback indicating a current position and orientation of the body of the anime figure from a tracking camera coupled to the media controller. The tracking camera is configured to sense the current position and orientation based on at least one tracker hidden on the body of the anime figure. Further, the method includes generating, via the media controller, a set of images to be projected onto an outer surface of the body of the anime figure having the current position and orientation, and instructing, via the media controller, a projector to contour map the set of images onto the outer surface of the body having the current position and orientation.

[0007] In one embodiment, a responsive media system for an entertainment attraction includes one or more dialogue data sources configured to generate dialogue data that changes over time, and a motion control system including an animated figure disposed within the entertainment attraction. The animated figure includes a figure portion that includes movable joints. The motion control system also includes a set of actuators disposed within the figure portion and configured to actuate the movable joints. The motion control system further includes a figure controller communicatively coupled to the set of actuators and the one or more dialogue data sources. The figure controller is configured to determine a dialogue response of the animated figure corresponding to the current state of the animated figure based on dialogue data from the one or more dialogue data sources. The dialogue response includes actuating the movable joints. The figure controller is also configured to instruct the set of actuators to execute the dialogue response. Additionally, the responsive media system includes a set of trackers coupled to the figure portion of the animated figure. The set of trackers enables a media control system of the responsive media system to project an image onto an outer surface of the figure portion of the animated figure in synchronization with the dialogue response of the motion control system.

[0008] These and other features, aspects, and advantages of the present disclosure will be better understood when the following detailed description is read with reference to the accompanying drawings in which like parts are designated with like reference numerals throughout.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, one or more specific embodiments of the present disclosure will be described. For the sake of brevity in describing these embodiments, not all implementation features may be described herein. It should be understood that in any such implementation development found in any engineering or design project, numerous implementation-specific decisions must be made to achieve a developer's specific objectives, such as compliance with system-related and business-related constraints that may vary depending on the implementation. Furthermore, although such development efforts can be complex and time-consuming, it should be understood that for those skilled in the art who benefit from the present disclosure, they are routine endeavors in design, fabrication, and manufacturing.

[0011] When introducing elements of various embodiments of the present disclosure, articles such as "a," "an," and "the" are intended to mean that these elements are present one or more. The terms "comprising," "including," and "having" are intended to be inclusive and mean that additional elements other than the recited elements may exist. Also, references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be construed as precluding the existence of additional embodiments that also include the described features.

[0012] This embodiment relates to a responsive media system for entertainment attractions such as an attraction where a projector of a media control system projects an image onto the outer surface of an anime figure. The anime figure can respond to any suitable number of interactive data sources or data streams, including the current state of the anime figure, control instructions from an artificial intelligence (AI) engine, the actions or passive characteristics of a guest, and the actions of performers on the backstage or on stage. Thus, the responsive media system can provide a guest with a more dynamic and immersive experience where the anime figure closely resembles an actual person or character than was achievable prior to this technology. Specifically, by performing projection mapping on the outer surface of the anime figure, the anime figure can appear more lifelike than some anime figure systems that generate an appearance with unnatural or ethereal illumination by projecting an image internally through the translucent surface of the anime figure. As described herein, the responsive media system can reduce or eliminate unnatural backlighting by leveraging external tracking of the anime figure (e.g., via optical performance capture or optical motion capture) to dynamically generate an image and provide it on the outer surface of the anime figure. In practice, some anime figures can include an internal projector within their body, so the internal projector does not move relative to the anime figure and thus there is no need to track the figure or movement. As a further advantage, by placing the projector external to the anime figure, it becomes possible to accommodate complex or numerous actuators within the space of the anime figure that might otherwise inhibit or physically interfere with conventional internal projection mapping techniques.

[0013] More specifically, to enhance the naturalness of the anime figure, a tracker can be attached to the anime figure so that the tracking camera of the media control system can identify the movement, position, and orientation of the anime figure in real time via optical performance capture or optical motion capture. Since the media control system can operate independently of the anime figure (for example, by not relying on position information, speed information, and / or acceleration information regarding the actuators of the anime figure), it can generate dynamic projection images at a realistic frame rate that mimics a living character, such as by presenting patterns, colors, and / or movements that are indistinguishable from the anime figure, and adapt them onto the interactive anime figure. As will be appreciated, the media control system of some embodiments can generate and update a skeletal model of the anime figure based on feedback from the tracking camera. The skeletal model generally represents movable parts such as the operable joints of the anime figure and is dynamically updated to represent the current three-dimensional position (including, for example, x, y, and z coordinates), orientation, and scale (for example, the pose of the anime figure) of the anime figure or a part thereof. Accordingly, the media control system utilizes the skeletal model to generate and project an image that accurately conforms to the current position and orientation of the reactive and / or interactive anime figure. Accordingly, the reactive media system provides a motion control system with an anime figure that responds to interaction data and a media control system that responds to the mechanical performance of the anime figure. Accordingly, as will be described below, these two closed control loops provide improved system performance based on the optical motion capture of the anime figure and can present an attractive character to the guest regardless of the mechanical positioning of the anime figure.

[0014] As shown in FIG. 1, the reactive media system 8 of the entertainment attraction 10 includes an anime figure 12 that receives an image 14 (e.g., projection content) from a projector 16 (e.g., an external projector, an optical projector with a lens) of the media control system 20. In this embodiment, the entertainment attraction 10 is a show set having a stage ceiling 22, a stage floor 24, and a scenic object 26 disposed between the stage ceiling 22 and the stage floor 24. The show set may also include any suitable stage lighting device 30, such as the lighting fixtures or devices shown in the figure. According to the present technology, a plurality of guests 34 can observe and / or interact with the anime figure 12 from the guest area 32 of the entertainment attraction 10. Although the reactive media system 8 is shown as being present within a stage-type environment, it should be understood that it can be used to entertain guests 34 in any suitable entertainment environment, such as a dark ride, an outdoor arena, and an environment adjacent to the vehicle path of a vehicle carrying guests 34.

[0015] Note that the projector 16 is located outside the anime figure 12. Therefore, by using the sealed volume inside the anime figure 12, it becomes possible to accommodate components other than the projector 16, such as some of the operating systems described later. In the illustrated embodiment, the projector 16 is arranged in front of the anime figure 12 and is blocked from the view of the guest 34 by the overhanging portion 36 of the stage ceiling 22. Note that the overhanging portion 36 can alternatively be a curtain, or it should be recognized that the entertainment attraction 10 can take any other suitable form that enables the guest 34 to observe the anime figure 12. In other embodiments, the projector 16 can also be arranged behind the guest 34. In any case, in the present embodiment, the projector 16 faces the image 14 on the outer surface 40 of the main body 42 of the anime figure 12 corresponding to the head 44 of the anime figure 12. Therefore, the media control system 20 can supply a realistic and attractive pattern to the head 44 from a hidden location, thereby providing an immersive and interactive experience for the guest 34. In practice, as described above, the media control system 20 of the reactive media system 8 can make the anime figure 12 look more like a real object than an internally projected anime figure because it does not cause unnatural internal light emission of the anime figure 12 that can be generated by some internally arranged projectors of the anime figures.

[0016] As will be appreciated herein, in some embodiments, the anime figure 12 is part of a motion control system 50 (e.g., a figure control system, a prop control system) that operates independently of the media control system 20. For example, the motion control system 50 can receive interaction data from any suitable reactive and / or interactive data source, which will be described in more detail below. Accordingly, the anime figure 12 can utilize the interaction data to dynamically update or modify its interaction with the entertainment attraction 10 and / or the guests 34 inside it. It should be understood that the motion control system 50 can command the actuator to adjust the position of any suitable component of the entertainment attraction 10 visible to the guest 34. Also, as will be described in more detail below with reference to FIGS. 2 and 3, the motion control system 50 can generate interactive and / or reactive responses based on suitable interaction data and command the actuators of the anime figure 12 and / or the motion control system 50 to execute the interactive and / or reactive responses in real time. As will be described later, the reactive media system 8 can adjust the operation of any interactive or actuatable component of the stage lighting device 30 and / or the scenic object 26 to provide a response that coordinates with the response of the anime figure 12 to the interaction data source. Further, the motion control system 50 can control an actuatable motion device 66 (e.g., an actuatable motion base) physically coupled to the anime figure 12. The actuatable motion device 66 can be any suitable motion generation assembly that can move the anime figure 12 in the lateral, longitudinal, and / or vertical directions (e.g., translate, rotate). However, in other embodiments, it should be understood that the actuatable motion device 66 can be a suspension system and / or a flight system coupled to the anime figure 12 from above the stage floor 24, or can include such a system.Accordingly, the suspension system and / or flight system of the operable motion device 66 can include any suitable actuator designed to move the anime figure 12 in the lateral, longitudinal, and / or vertical directions.

[0017] In this embodiment, the motion control system 50 includes a tracker 60 (e.g., a trackable marker) disposed on the rear surface 62 of the anime figure 12. As recognized herein, the tracker 60 can be disposed on or within any suitable surface of the anime figure 12 that causes the tracker 60 to be hidden from the guest's view. The tracker 60 enables the tracking camera 64 of the media control system 20 to sense or resolve the position and orientation of the anime figure 12 within the entertainment attraction 10 via optical performance capture or optical motion capture techniques, etc. The tracking camera 64 can be made less visible or hidden from the view of the guest 34 in any suitable manner, such as by being disposed on the stage ceiling 22 or hidden within the scenic object 26. Accordingly, as understood, the projector 16 can provide the image 14 to the anime figure 12 in synchronization with the actual current position and orientation (e.g., pose) of the anime figure 12 without relying on position information, velocity information, and / or acceleration information from the actuators of the anime figure 12, providing an improved show quality with less delay and enhanced realism. In other embodiments, the media control system 20 can verify the positioning and operation of the projector 16 based on actuator-derived information from the motion control system 50.

[0018] It should be understood that the reactive media system 8 can include any suitable number of projectors 16, trackers 60, and tracking cameras 64. For example, a plurality of anime figures 12 can be included within one entertainment attraction 10. Thus, when a plurality of anime figures 12 are provided that a guest 34 can view from one side of the show set, the reactive media system 8 can include at least one projector 16 for each anime figure 12. However, currently, the particular infrastructure of the reactive media system 8 is movable within the light region of at least one tracking camera 64 and movable within the projection cone of at least one projector 16 to receive the image 14 without substantial redesign or reconfiguration of the reactive media system 8, enabling any number of anime figures 12 to be moved. In other words, according to the present disclosure, when additional anime figures 12 are placed within the entertainment attraction 10 with trackers 60, the reactive media system 8 can easily detect and accommodate these additional anime figures 12. In other embodiments, a plurality of projectors 16 can be provided to supply content to multiple sides of a single anime figure 12, such as an anime figure 12 that a guest 34 can approach from multiple parts of the show set. Also, some embodiments of the anime figure 12 can include at least two trackers 60 so that a tracking camera 64 can resolve the relative positions of at least two trackers 60 for efficient tracking of the anime figure 12, but it should be understood that the position of a single tracker 60 can be varied to enable resolution of the position of the anime figure 12 using a less complex system.

[0019] FIG. 2 shows an embodiment of a responsive media system 8 of an entertainment attraction 10 that includes a media control system 20 and a motion control system 50, and an example of an interactive data source 70 that includes a guest sensor 72. In this embodiment, the guest sensor 72 collects guest input from any of the guests 34 within the guest area 32. As recognized herein, guest input is one form of interactive data that the anime figure 12 can utilize to respond adaptively to the current state of the anime figure 12 or the entertainment attraction 10. In this embodiment, the guest sensor 72 can be any suitable device that collects data from or regarding the guest 34 as interactive data. In some embodiments, the guest input collected by the guest sensor 72 can include active input and / or passive input. For example, the anime figure 12 can respond to the macroscopic gestures of the guest 34 by implementing gesture recognition. The anime figure 12 can respond to the determined position, orientation, features, and / or height of the guest 34 as passive input. Also, in some embodiments, the guest sensor 72 includes physical input devices such as buttons, levers, and knobs. Further, it should be understood that the guest sensor 72 can collect any suitable visual data, auditory data, tactile input, data from an interactive guest device (e.g., smartphone, tablet), identification information from a guest's armband, and input from a guest's interactive toy, etc.

[0020] As described above, based on these dialogue data, the motion control system 50 can generate interactive and / or reactive responses that the anime figure 12 should execute, and then instruct the actuators of the anime figure 12 to execute the interactive and / or reactive responses. As a specific non-limiting example, the motion control system 50 can determine that the dialogue data includes a guest input indicating that a guest 34 greeted the anime figure 12 physically and / or verbally from the end of the guest area 32. Then, the motion control system 50 can dynamically instruct the anime figure 12 to execute an interactive physical response to the greeting of the guest 34. For example, the motion control system 50 can control the anime figure 12 to rotate towards the guest 34 while waving the arms of the anime figure 12. As another specific example of an interactive response, the motion control system 50 can approach the determined position of the guest 34 (e.g., via an operable motion device 66 disposed below the anime figure 12), tilt the head 44 of the anime figure 12, and control the anime figure 12 to respond to the guest input by, for example, showing a gesture of paying attention to or making eye contact with the guest 34 having a specific height.

[0021] Based on an understanding of the general operation of these reactive media systems 8, this specification provides further description regarding some embodiments of specific components of the reactive media system 8. For example, FIG. 3 is a block diagram of a reactive media system 8 showing a media control system 20 that can operate to externally supply content or images to the anime figure 12 without communicably coupling to the motion control system 50. In other words, the media control system 20 does not directly transmit or receive communication signals with the motion control system 50. However, as will be described later, an interactive data source 70 can be communicably coupled upstream of both the media control system 20 and the motion control system 50 to enable cooperation between the media control system 20 and the motion control system 50 without mutual communication between the control systems 20, 50. Further, in some embodiments, a network device 90 such as a switch or hub can be communicably coupled directly downstream of the interactive data source 70 to facilitate efficient communication between the interactive data source 70 and the control systems 20, 50. However, it should be understood that the network device 90 can be omitted, multiple network devices 90 can be implemented, or any other suitable data management device can be utilized to facilitate the supply of data from the interactive data source 70 to the control systems 20, 50. In the illustrated embodiment, the anime figure 12 includes a figure processor 100 and a figure memory 104, which can collectively form all or part of the figure controller 102 of the motion control system 50. The anime figure 12 also includes a tracker 60 disposed on the body 42 of the anime figure 12 such that the tracking camera 64 of the media control system 20 can sense the position, orientation, or pose of the anime figure 12. The tracker 60 can be an active element that can each emit an individual signal to the tracking camera 64. For example, the tracker 60 can emit any other suitable signal that cannot be detected by the guest 34 and can be distinguished by the tracking camera 64, such as infrared, electromagnetic energy.Alternatively, the tracker 60 can be a passive element (e.g., a reflector, a pigment portion) that does not emit a signal and enables the tracking camera 64 to accurately distinguish the anime figure 12 and / or other parts of the entertainment attraction 10.

[0022] Furthermore, the anime figure 12 is attached with any suitable actuator 106 that enables the anime figure 12 to move as if it were real and alive (e.g., walking, translating, rotating, pivoting, lip synchronize). The actuator 106 can include, for example, servo motors, hydraulic cylinders, and linear actuators that are arranged and coupled to show the relative movement between respective parts of the anime figure 12. For example, a set of respective actuators 106 can be arranged to perform movements of the arms of the anime figure 12, movements of the articulating jaws of the anime figure 12, and operations of the figure parts (e.g., the head 44, the arm parts, the torso, the leg parts) of the anime figure 12. As described above, the dialogue data source 70 can include any suitable data source that provides a data set changing over time as dialogue data 109. Thus, in some embodiments of the dialogue data source 70 including an input sensor or a guest sensor 72 (e.g., a depth camera, an input device, a motion sensor), the guest sensor 72 can sense the interaction between the guest and the anime figure 12 and relay dialogue data indicating the guest's interaction to the figure controller 102. In any case, the figure controller 102 can command the actuator 106 to dynamically operate the anime figure 12 so as to adapt in response immediately to any suitable dialogue data 109 that can change over time based on the dialogue data 109 from the dialogue data source 70, as will be described in more detail below.

[0023] The interactive data source 70 communicably coupled to the figure controller 102 (e.g., via a wireless or wired communication path) can include any one or more suitable components that generate interactive data 109 and transmit it to the figure controller 102 and / or the media controller described below. For example, the interactive data source 70 can include a dedicated game engine or computer device that dynamically generates instructions executable by the anime figure controller 102 to modify the movement of the anime figure 12 within the entertainment attraction 10. In some embodiments, the dedicated game engine can be embedded as a suitable module within the anime figure controller 102. In some embodiments, the interactive data 109 provided by the interactive data source 70 includes inputs or instructions received from the normal state monitoring system of the movement control system 50, the global or main control system of the entertainment attraction 10, and computer devices associated with the technicians of the entertainment attraction 10. In addition to or instead of this, as a further example, the interactive data 109 can also include time data, weather data, social media data, stock market data, vehicle location data, or any suitable data stream that can change over time. Therefore, it should be understood that the anime figure 12 can adaptively respond to any suitable number of interactive data sources 70. In fact, the interactive data 109 provided by the interactive data source 70 selectively includes any suitable (single or plural) stream of input information that can be constant and / or change over time so that the anime figure controller 102 can dynamically control the operation of the anime figure 12. Therefore, the movement control system 50 can execute a figure feedback loop that modifies or verifies the operation of the anime figure 12 based on the interactive data 109.

[0024] In some embodiments, the interaction data source 70 can include a guest sensor 72 that includes any combination of components suitable for resolving guest interactions. In fact, it is currently recognized that guest interactions can be sensed by any suitable optical, mechanical, electromechanical, electromagnetic, auditory, pressure, and / or temperature transducer or sensor of any kind. As a specific non-limiting example, the guest sensor 72 can include any suitable number of computer vision sensors (e.g., cameras), depth cameras, light detection and ranging (LIDAR) devices, motion sensors, audio recording and / or processing devices, touch capacitive sensors, optical sensors, pressure or floor mat sensors, radio frequency (RF) sensors that receive RF signals for uniquely identifying user wearable devices having radio frequency identification (RFID) tags, etc., or combinations thereof. That is, the guest sensor 72 can include any suitable component or transducer that generates a signal based on monitoring the guest 34 within the guest area 32. The motion control system 50 is shown as including the guest sensor 72 external to the body 42 of the animatronic figure 12, but it should be understood that other embodiments of the motion control system 50 can include all or part of the guest sensor 72 disposed within the body 42 of the animatronic figure 12. In other embodiments, the interaction data source 70 of the motion control system 50 can be enabled to allow the animatronic figure 12 to adaptively respond to any other suitable (singular or plural) source of interaction data 109 without including the guest sensor 72.

[0025] As shown in the illustration, the present embodiment of the media control system 20 includes a projector 16, four tracking cameras 64, a camera network device 110, and a media controller 112. The media controller 112 is communicatively coupled to an interactive data source 70 (e.g., via a network device 90) to determine, for example, whether a source that brings about a guest input or another change in the interactive data 109 has been received, so that it can dynamically respond to the physical environment of the entertainment attraction 10. Also, as shown in the present embodiment, the media control system 20 can be communicatively separated from the motion control system 50. That is, while the motion control system 50 is independent of the media control system 20, the media control system 20 follows or depends on the anime figure 12. Therefore, the media control system 20 provides the anime figure 12 with the operational freedom to adaptively respond to the interactive data 109 substantially in real time (e.g., within microseconds or milliseconds of the interaction), while monitoring or tracking the movement of the anime figure 12 and projecting immersive patterns or images onto the anime figure 12 also substantially in real time. Therefore, the media control system 20 simultaneously executes a media feedback loop that corrects or verifies the image projected onto the anime figure 12 while the motion control system 50 is executing a figure feedback loop. The media control system 20 utilizes the tracking cameras 64 suitably arranged within the entertainment attraction 10 to identify or pinpoint the tracker 60 of the anime figure 12 via optical motion capture technology in order to collect information regarding the current position and orientation of the anime figure 12. The type or configuration of the tracking cameras 64 can be individually selected to correspond to the type of the tracker 60. In summary, when using an active element as the tracker 60, the tracking cameras 64 can be designed to receive signals from the active element and sense the position of the anime figure 12. When using a passive element as the tracker 60, the tracking cameras 64 can be designed to identify the passive elements on the outer surface 40 of the anime figure 12.The positioning of these trackers 60 facilitates adjustment of the projection onto the anime figure 12 in different orientations, together with the geometric or skeletal model of the anime figure 12.

[0026] The tracking camera 64 of the illustrated embodiment is communicatively coupled to a camera network device 110 that relays to the media controller 112 a signal indicative of the current (e.g., including x, y, and z coordinates) three-dimensional position, orientation, and scale (e.g., pose of the anime figure 12) of the anime figure 12 or a portion thereof. Thus, the camera network device 110 is a network switch or sensor hub that integrates multiple information streams from the tracking camera 64 for efficient processing by the media controller 112. The media controller 112 includes a media processor 114 and a media memory 116 that cooperate to determine, generate, and / or adjust a dynamic pattern or image to be overlaid on the anime figure 12 at the current position and orientation of the anime figure 12. As a result, the media controller 112 can instruct the projector 16 to project a dynamic image onto the anime figure 12. The image can be rendered on demand in its entirety based on the current pose (e.g., position, orientation, and scale) of the anime figure 12. In a low complexity configuration, the image can be generated by adapting a pre-recorded video stream to the current pose of the anime figure 12. According to the present disclosure, the media controller 112 can be any suitable media generator or game engine with high processing power and low latency. Thus, it should be understood that the media controller 112 can generate, substantially in real time, an image to be projected onto the anime figure 12 based on sensor data received from the tracking camera 64. In fact, the media controller 112 can maintain a skeletal model or algorithm representing the anime figure 12 and its operable parts (e.g., jaws, hands, feet, joints). The media controller 112 can update the skeletal model to represent the actual current position and orientation of the anime figure 12 based on the sensor data and then generate an image to be projected onto the anime figure 12 having this current position and orientation.

[0027] The projector 16 can include a projector processor 120 and a projector memory 122 that facilitate the presentation of an image or a dynamic pattern on the anime figure 12. The projector processor 120 generally receives data indicating an image from the media controller 112 and then instructs the light source within the projector 16 to output the image through a lens. The projector 16 can be made movable or operable to follow and cooperate with the anime figure 12 based on commands received from the media controller 112, such as commands. Alternatively, the projector 16 can be fixed. In either case, the media controller 112 can determine the current silhouette of the anime figure 12 or the shape of the target figure portion that is scheduled to receive the projected image based on the updated skeleton model, and then instruct the projector 16 to provide the image on the silhouette. Accordingly, it should be understood that the projector 16 can block or mask portions of the anime figure 12, such as the hat of the anime figure 12, and scenic objects 26 that exist behind the anime figure 12 relative to the projector 16, which are not designed to receive the image 14 of the anime figure 12 and / or the entertainment attraction 10.

[0028] Each of the processors 100, 114, 120 is any suitable processor capable of executing instructions for implementing the techniques of the present disclosure, such as a general - purpose processor, a system - on - chip (SoC) device, an application - specific integrated circuit (ASIC), a processor of a programmable logic controller (PLC), a processor of an industrial personal computer (IPC), or some other similar processor configuration. These instructions are encoded in a program or code stored in a tangible non - transient computer - readable medium such as the memories 104, 116, 122 and / or other storage circuits or storage devices. Accordingly, the figure processor 100 is coupled to the figure memory 104, the media processor 114 is coupled to the media memory 116, and the projector processor 120 is coupled to the projector memory 122.

[0029] This embodiment of the reactive media system 8 also includes a show control system 130 that adjusts additional output devices of the entertainment attraction 10 based on the interaction data source 70. For example, the show controller 132 of the show control system 130 is communicatively coupled between the network device 90 and one or more lighting output devices 134, audio output devices 136, and / or venue-specific special effect output devices 138 (e.g., fog machines, vibration generators, operable parts of the scenic object 26). The lighting output device 134 can include stage lighting devices 30 (including, for example, lighting fixtures) and any other light-generating components of the entertainment attraction 10. Also, the audio output device 136 can include any suitable speaker or noise generator designed to output sound based on instructions from the show controller 132. Accordingly, the show controller 132 can adjust the presentation of the output devices 134, 136, 138 to correspond to the interactive and / or reactive responses of the anime figure 12 and the media control system 20 based on the interaction data 109 received from the interaction data source 70.

[0030] As one specific example of the present technology, FIG. 4 is a side cross-sectional view of the head 44 of the anime figure 12 having the tracker 60 on the rear surface 62 of the main body 42 with respect to the projector 16. The tracker 60 is an active tracker (e.g., infrared light-emitting diode) in this embodiment, and thus is connected to a circuit 150 coupled or integrated with the power supply 152 of the anime figure 12. The power supply 152 can be the main power supply of the anime figure 12 or an independent power supply that solely supplies power to the tracker 60. Generally, the tracker 60 utilizes electrical energy from the power supply 152 to emit an individual signal for resolution by the tracking camera 64. For example, the first tracker 160 among the trackers 60 can emit a first signal having a first unique identification signal (e.g., frequency, signature, signal characteristics). The second tracker 162 and the third tracker 164 among the trackers 60 can also emit their respective unique identification signals. The tracker 60 can enhance the trackability of the anime figure 12 by, for example, being distributed around the curved portion 166 of the head 44 of the main body 42 so that the tracking camera 64 can resolve the head 44 from multiple sides (e.g., top surface, rear surface) of the anime figure 12.

[0031] Furthermore, the tracker 60 can extend a protruding distance 170 from the curved portion 166 of the anime figure 12. Since the signal emitted by the tracker 60 can pass through a specific material, the tracker 60 having the protruding distance 170 can be hidden by the clothing (e.g., wig, hat, fur) of the anime figure 12 that hides the tracker 60 and can further contribute to the realism of the anime figure 12. On the other hand, in the illustrated embodiment, the anime figure 12 includes a wig 171 having a gap 172 (e.g., aperture, opening, round hole) formed to cover the tracker 60, which further facilitates the transmission of the signal from the tracker 60 to the tracking camera 64 described above. That is, the gap 172 can be a relatively small opening formed through the wig 171 that does not interfere with the signal while allowing the remaining portion of the wig 171 to efficiently hide the tracker 60. Although three trackers 60 are shown, it should be understood that any suitable number of trackers 60, such as one, two, five, ten, or more, can be included or hidden within the anime figure 12. Alternatively, the tracker 60 can be present on the same plane as the outer surface of the anime figure 12 or embedded within the outer surface as will be described later with reference to FIG. 5.

[0032] In this embodiment, the anime figure 12 also includes a set of actuators 106 for moving the head 44 of the anime figure 12. For example, the actuator 106 can be operably coupled to a multi-directional support 173, shown as a universal joint 174 (e.g., a U-joint, a universal coupling device) having a pivot bar assembly 175, so as to be similar to or accurately reflect the movement of a human neck. Specifically, the multi-directional support 173 can provide the anime figure 12 with multiple degrees of freedom of movement by enabling the head 44 to move along a head nod axis 178, a head swivel axis 180, and / or a head tilt axis 182 based on a selective force 176 provided by the actuator 106. It should be understood that within the anime figure 12, any suitable support element or support structure having any suitable range and direction of movement can be included to be actuated by any suitable actuator 106, either inside or outside the anime figure 12.

[0033] Furthermore, the anime figure 12 of the present embodiment includes a joint jaw 184 (e.g., a movable jaw) that can move along the jaw movement axis 186 based on movements such as those of the jaw actuator 188 among the actuators 106. Accordingly, the jaw actuator 188 moves the joint jaw 184 along the jaw movement axis 186 based on an instruction from the figure controller 102 (e.g., via adjustment of the connecting link 190 coupled between the joint jaw 184 and the pivot crank 192 on the jaw actuator 188), enabling the anime figure 12 to appear to be speaking (e.g., moving its mouth in synchronization with the voice of the audio output device 136) and to exhibit various facial expressions. In addition to or instead of this, the anime figure 12 can also include articulated foreheads, eyebrows, ears, and / or any other movable features that contribute to the realism of a particular person or character. Furthermore, it should be understood that the joint jaw 184 and / or any other joint components of the anime figure 12 can be operated based on a selective force 176 applied by any suitable single or multiple actuators 106.

[0034] FIG. 5 is a side cross-sectional view of another embodiment of the head 44 of the anime figure 12 with the tracker 60 attached to the front surface 200 of the head 44. The tracker 60 can be a passive element distinguishable by the tracking camera 64. In some embodiments, the passive element is shaped as a rounded cylinder or a light-emitting diode, but it should be understood that the passive element can have any other suitable shape, including spherical and rectangular prism shapes. As shown, the first tracker 202 is disposed on the forehead portion 204 of the anime figure 12, the second tracker 206 is disposed on the nose portion 208 of the anime figure 12, and the third tracker 210 is disposed on the jaw portion 212 of the anime figure 12. By including the third tracker 210 in the jaw portion 212, the anime figure 12 enables the media control system 20 to efficiently analyze the movement of the articulating jaw 184 relative to the nose portion 208 and / or the forehead portion 204. For example, the media control system 20 can monitor the relative distance between the second tracker 206 and the third tracker 210 and determine the current position of the articulating jaw 184 relative to the nose portion 208 from this distance. Also, although the anime figure 12 is shown as including a wig 171, it should be understood that any suitable costume element can be coupled to the anime figure 12. As described above, if the wig 12 or other costume elements are designed to cover the first tracker 202 and / or other trackers 60, these costume elements can form a gap 172 that allows for more efficient resolution of the tracker 60 through the costume element.

[0035] The anime figure 12 can also include a translucent layer 220 disposed to cover the body of the anime figure 12, thus providing the desired appearance (e.g., skin) to the anime figure 12 while enabling a tracking camera to resolve the position of the tracker 60 through the translucent layer 220. The translucent layer 220 can be formed of any suitable material that enables resolution of the tracker 60 through the translucent layer 220, such as materials including cloth, plastic, silicone, and rubber. Thus, in some embodiments, the tracker 60 can be hidden from the guest's view by disposing the tracker 60 below the translucent layer 220 or in the same plane (e.g., the same height) as the translucent layer 220. Although FIGS. 4 and 5 are described as having an active element as the tracker 60 and a passive element as the tracker 60, respectively, it should be understood that the active element and / or the passive element can be attached to any suitable portion of the anime figure 12.

[0036] As described above, the media control system 20 operates the projector 16 to supply one or more images 14 or projection contents onto the outer surface 40 of the anime figure 12 based on the determined actual position and orientation of the anime figure 12. As a specific example, FIG. 6 is a front perspective view of the image 14 provided on the head 44 of the main body 42 of the anime figure 12. Specifically, an exemplary embodiment of the image 14 includes a pattern similar to the face of a specific character. For example, eyebrows, eyes, nose, lips, and / or wrinkles can be projected onto the head 44. Further, in FIG. 6, since the anime figure 12 is wearing a clothing element 250 shown as a hat, the media controller 112 and / or the projector 16 can identify the contour 252 of the outer surface 40 of the anime figure 12 formed by the clothing element 250 (e.g., via projection masking). In addition to or instead of this, in other embodiments, the costume element 250 can include a wig, jewels, a scarf, and the like. At this time, the projector 16 directs the image 14 to a target portion or figure portion of the outer surface 40 of the anime figure 12. As described above and as will be further described in detail below, the media control system 20 monitors the movement of the anime figure 12 such as the articulating jaw 184 and projects a realistic image corresponding to the specific actual shape of the head 44 at any given time onto the head 44 (or the face portion thereof) of the anime figure 12.

[0037] As another example, FIG. 7 is a front perspective view of another embodiment of the image 14 that the projector 16 of the media control system 20 can provide on the outer surface 40 of the anime figure 12. As shown, the image 14 provides the anime figure 12 with a character, non-human, or fantastical appearance such as the appearance of an owl. In some embodiments, the outer surface 40 of the head 44 can be textured to complement the image 14. Also, in some embodiments, it should be understood that the image 14 can include supernatural, fantastical, or non-human images and / or effects such as flames, smoke, deformation, and color morphing.

[0038] Based on the characteristics of these reactive media systems 8, this specification further describes the operation of the components of the reactive media system 8 that allow the guest 34 to enjoy through the anime figure 12 to which the image 14 is adapted in real time. For example, FIG. 8 is a flowchart showing an embodiment of a process 300 in which the motion control system 50 controls the anime figure 12 to respond to the dialogue data 109 from the dialogue data source 70. The steps shown in the process 300 are for ease of explanation, and additional steps can be executed, specific steps can be omitted, and the illustrated steps can be executed in a different order or in parallel when appropriate, and are not intended to limit the scope of the present disclosure. The process 300 can represent start code or instructions stored in a non-transitory computer-readable medium (e.g., the figure memory 104) and executed by, for example, the figure processor 100 of the figure controller 102 of the motion control system 50. The figure processor 100 is communicatively coupled to other components of the reactive media system 8 via a network such as a wired or wireless network and can transmit and receive the instructions and signals described below.

[0039] In the presently disclosed embodiment, the figure controller 102 that executes process 300 starts a show or display by receiving (block 304) one or more suitable streams of interactive data 109 from an interactive data source 70, such as a dedicated game engine, a normal state monitoring system of the movement control system 50, a global or main control system of the entertainment attraction 10, instructions from a computer device associated with a technician of the entertainment attraction 10, and / or sensor signals from a guest sensor 72 indicating the movement or position of at least one guest 34. In practice, as described above, the interactive data 109 can also include time data, weather data, social media data, stock market data, vehicle position data, and / or any suitable data stream that can change over time. For example, the figure controller 102 can receive time data from the interactive data source 70 indicating that a particular character performance should be presented. As another example, the figure controller 102 can receive instructions from the dedicated game engine indicating adjustment instructions for a character performance. As a further example, the figure controller 102 can receive sensor signals from a guest sensor 72 that can transmit sensor signals in response to continuously detecting a particular movement or sound from the guest 34. In such an embodiment, the guest sensor 72 can scan an RFID tag worn by each guest 34 and transmit identification information from the RFID tag to the figure controller 102 as a sensor signal.

[0040] Furthermore, the figure controller 102 can determine one or more operations based on the dialogue data 109 received from each dialogue data source 70 (block 306). That is, the figure controller 102 can receive a plurality of different dialogue data sources 70 that may or may not include guest input and respond to them simultaneously. For example, the figure controller 102 can perform suitable anime figure control operations based on the dialogue data 109 received from sources such as a game engine, a computer device related to the technician of the entertainment attraction 10, and a state monitoring system of the motion control system 50. As a specific example, in response to receiving corresponding dialogue data 109 from a computer device related to the technician, the figure controller 102 can adjust the anime figure 12 from providing a simple show experience (including movements below a threshold value) to providing a detailed show performance (including movements above a threshold value). As another example, in response to receiving weather data indicating that a weather change is imminent, the figure controller 102 can adjust the character or show performance to interact with the weather change (e.g., recognize the presence of sun, rain, snow).

[0041] In an embodiment of receiving guest input, the operation determined by the figure controller 102 can include determining that the guest has performed a specific operation (e.g., corresponding to an active input) and / or determining that the guest has a specific set of qualifications (e.g., corresponding to a passive input). As examples of specific operations that can be detected as guest input by the guest sensor 72, the figure controller 102 can determine that the guest 34 has moved within a threshold distance from the anime figure 12, waved a hand, spoken, pressed a button, picked up a specific object, pointed a device (e.g., a flashlight, a laser pointer, a replica weapon) at a target part of the anime figure 12, etc. As examples of a specific set of qualifications sensed as guest input by the guest sensor 72, the figure controller 102 can determine the height of each guest 34, determine the average height of the group of guests 34, obtain the profile information of each guest from a database based on the identification information of the RFID tag, identify that a specific guest 34 is wearing clothing of a target color, etc. In fact, according to the present technology, it should be understood that the figure controller 102 can determine any suitable information regarding the guest 34 and specific operations of the guests within the guest area 32 that affect the interaction between the guest 34 and the anime figure 12.

[0042] Furthermore, the figure controller 102 can generate an interactive response to be executed by the anime figure 12 as a reaction to the operation of the entertainment attraction 10 (block 310). That is, the figure controller 102 can react to the current state, operation, and position of the entertainment attraction 10 and / or the guest 34 inside it by substantially calculating the interactive response to the interactive data 109 in real time, so as to enhance the immersion of the guest in the entertainment attraction 10. As an example, the figure controller 102 can receive an input indicating that a guest 34 has uttered the name of the assigned anime figure 12 from a specific position within the guest area 32. At this time, the figure controller 102 moves the articulating jaw 184 so that the anime figure 12 waves at the guest 34 at a specific position and the anime character says "Hi to you too", while the show control system 130 can determine that causing the audio output device 136 of the entertainment attraction 10 to output the utterance "Hi to you too" is an interactive response.

[0043] When a dialogue response is determined, figure controller 102 according to process 300 instructs actuator 106 of anime figure 12 to execute the dialogue response (block 312). Media control system 20 simultaneously forms dynamic image 14 on anime figure 12 in response to the current pose of anime figure 12 as will be described later with reference to FIG. 9. Note that show controller 132, based on dialogue data source 70, can also control any other output device of entertainment attraction 10, including stage lighting device 30 (e.g., lighting fixture) or other lighting output device 134, audio output device 136, and venue-specific special effect output device 138 (e.g., smoke machine, air generator), etc., to complement the dialogue response of anime figure 12. As an example, in response to a guest 34 pointing a flashlight at anime figure 12, show controller 132 can instruct stage lighting device 30 to dim the lighting, while figure controller 102 can instruct actuator 106 to raise both arms of anime figure 12. As another example, in response to guest 34 entering a specific area of guest area 32 (e.g., sensed by the light curtain, pressure mat, or depth camera of guest sensor 72), figure controller 102 can also instruct actuator 106 to move anime figure 12 closer to this specific area.

[0044] After the execution of the interactive response, the figure controller 102 returns to block 304 and can continue to receive the dialogue data 109 so that the motion control system 50 continuously operates the anime figure 12 during the operation time of the entertainment attraction 10. However, other embodiments can also implement a show cycle that adjusts or stops in response to specific predetermined conditions being met, such as the threshold time having elapsed, a threshold number of interactive responses having been executed, each guest 34 having exited the guest area 32, a new or subsequent vehicle entering the guest area 32, etc. Therefore, in such cases, the motion control system 50 protects the operation and wear of the anime figure 12 until the next show cycle is started.

[0045] FIG. 9 is a flowchart of an embodiment of a process 350 in which the media control system 20 dynamically maps the image 14 onto the anime figure 12. As described above with respect to the process 300 of FIG. 8, the steps of the process 350 are also not limiting. The process 350 can represent start code or instructions stored in a non-transitory computer-readable medium (e.g., the media memory 116) and executed by, for example, the media processor 114 of the media controller 112 of the media control system 20. It should be understood that the media processor 114 is communicatively coupled to other components of the reactive media system 8 via a network such as a wired or wireless network and can transmit and receive the instructions and signals described below.

[0046] To start process 350 (block 352), media controller 112 can receive a signal (e.g., sensor feedback) indicating the current pose (e.g., current position, current orientation, and / or current scale) of the anime figure 12 from one or more tracking cameras 64 (block 354). Media controller 112 can receive the signal from tracking camera 64 through camera network device 110 that facilitates efficient calculations within media controller 112. As described above, anime figure 12 includes a tracker 60 hidden on or within anime figure 12 that enables tracking camera 64 to identify the current pose of anime figure 12 without receiving or relying on position information, velocity information, and / or acceleration information from actuator 106 of anime figure 12. Such a configuration, combined with the efficient scanning speed of tracking camera 64 and the frame rate of projector 16, enables anime figure 12 to closely resemble a living character or person by reacting to interactive data 109 with a short delay time or latency.

[0047] Alternatively, media controller 112 can be coupled to actuator 106 or figure controller 102 to receive position information, velocity information, and / or acceleration information and utilize this information to verify the detected pose of anime figure 12. In fact, media controller 112 can obtain a lead time for generating projectable images by predicting the future movement of anime figure 12 based on the received position information. Media controller 112, which operates predictively, can generate a plurality of image sets 14 each corresponding to a specific future interactive reaction of anime figure 12. Thus, media controller 112 can select one of the previously generated sets of projection content to enable media control system 20 to instantaneously provide an appropriate image (e.g., pattern) when a given sequence of movements of anime figure 12 is realized.

[0048] Media controller 112 that executes process 350 updates the skeletal model 360 of the anime figure based on the signal from tracking camera 64 (block 356). The skeletal model 360 can include any suitable data structure and / or statistical model maintained within media controller 112 that represents the movable or actuatable parts of the anime figure, as well as the current position and orientation of the actuatable parts. Thus, media controller 112 can continuously update skeletal model 360 to represent the actual current pose (e.g., position, orientation, and scale) of anime figure 12.

[0049] In some situations where a particular actuatable joint or part of anime figure 12 is not operating, media controller 112 updates skeletal model 360 to indicate the non-operating state of the particular actuatable part while reacting to the current position of tracker 60, enabling image 14 to be adaptively fitted to anime figure 12 that is partially non-operating. That is, in such situations, media controller 112 that executes process 350 can ensure that a set of images suitable for the non-operating parts of anime figure 12 is generated by generating a suitable image corresponding to the actual pose of anime figure 12. In contrast, some projection mapping systems that follow a pre-programmed scene (e.g., via recorded media) project an image onto the expected position of a given movable part of a conventional anime figure, and thus the image may not match the conventional anime figure when a given movable part stops operating, which may degrade the guest experience.

[0050] Accordingly, the media controller 112 generates data representing an image 14 to be projected onto the anime figure 12 having the current pose based on the skeletal model 360 (block 362). The image 14 is generated on-the-fly or in real time so as to specifically correspond to the current state or pose of the anime figure 12, as opposed to a predetermined or recorded image. Also, the data representing the image 14 and / or the current pose of the anime figure 12 can be stored in the media memory 116 for a predetermined period of time.

[0051] Also, the media controller 112 instructs the projector 16 to provide (e.g., contour map) the image 14 onto the anime figure 12 having the current pose (block 364). As recognized herein, the media control system 20 performs contour mapping or contour-focus mapping with the skeletal model 360 to direct the selectively designed image 14 in a lifelike manner onto the target figure portion of the anime figure 12. For example, the media controller 112 can generate a set of contour-mapped patterns precisely focused on a specific spatial relationship of the anime figure 12 by generating an image 14 adjusted to a specific position and orientation of the anime figure 12 and instructing the projector 16 to output the image 14. In essence, the media controller 112 provides the instruction of block 364 by sending the data representing the image 14 to the projector 16 without accompanying another command signal, thereby further limiting the latency time of the media control system 20. Accordingly, the components of the media control system 20 cooperate to adaptively analyze the anime figure 12 and dynamically adapt the image 14 to the instantaneous pose of the anime figure 12 that can respond to the interactive data source 70 and / or interact with the guest 34 at any time. Accordingly, the media controller 112 can return to block 354 to continue receiving sensor signals and continue executing the process 350.

[0052] Furthermore, the media control system 20 can monitor the performance and / or normality of the anime figure 12. For example, currently, it is recognized that the media control system 20 can perform normality monitoring of the anime figure 12 based on the determined performance of the anime figure 12 over a certain period of time. That is, at a specific point in time during the show cycle, a specific image set is projected onto the anime figure 12 (e.g., baseline performance evaluation), and if after a certain period of time, the media control system 20 adjusts (e.g., displaces) this image set more for a specific point in time in a subsequent show cycle than for threshold adjustment (e.g., current performance evaluation), the media control system 20 can generate an alert indicating the difference between iterations of the show cycle. For example, if as a result of the head 44 of the anime figure 12 being unintentionally modified or deteriorated, the left ear of the anime figure 12 disappears and no projection is performed via the projector 16, the media control system 20 can alert the operator to the deterioration. As another example, if a specific part of the anime figure 12, such as the tilt or rotation of the head 44, was moving during the first show cycle but is not moving during the second show cycle (e.g., corresponding to the modified skeleton model 360), the media control system 20 can output an alert indicating the non-operating part of the anime figure 12. In these situations, the media controller 112 can output an alert indicating the deterioration state and / or a change in the perceived non-characteristic behavior. In some cases, the reactive media system 8 can be designed to stop the operation of the media control system 20 and / or the motion control system 50 in response to the alert. In other cases, the media controller 112 can provide an alert in response to determining that the performance of the anime figure 12 is slightly affected (e.g., having a skeleton model deviation higher than a first threshold and lower than a second higher threshold) and continue to cycle through the process 350. Therefore, it should be understood that the present media control system 20 can operate as a quality evaluation tool for quantifying the performance of the motion control system 50 and the anime figure 12 over a certain period of time.

[0053] Accordingly, the technical effect of the disclosed reactive media system includes a motion control system with anime figures that dynamically responds to interactive data such as game engines, normality monitoring systems, background performance, and guest and / or technician input to provide an attractive and realistic experience for guests of entertainment attractions. Specifically, the motion control system can include one or more interactive data sources that provide interactive data, such as guest sensors that sense the active actions and / or passive qualities of guests as guest input, and a figure controller that generates an interactive response based on the interactive data. Accordingly, the figure controller instructs the actuators within the anime figure's body to execute the interactive response, such as by manipulating the articulating jaw or other movable parts of the body. Further, the reactive media system includes a media control system having a tracking camera, a media controller, and a projector. As recognized herein, the anime figure is attached with a trackable marker that enables the media controller to receive sensor feedback indicating the current position, orientation, and scale of the movable parts of the anime figure from the tracking camera. Accordingly, the media controller can dynamically generate an image set or align these images to the specific position, orientation, and scale of the movable parts of the anime figure without relying on information derived from the actuators of the anime figure. The media controller can then instruct the projector to project map the images in real time onto the outer surface of one or more figure parts of the anime figure to present an immersive and attractive life-sized anime figure for an improved guest experience with improved runtime and / or reliability.

[0054] In this specification, only some features of the present disclosure have been illustrated and described, but many modifications and changes will occur to those skilled in the art. Therefore, it should be understood that the appended claims are intended to cover all such modifications and changes that fall within the true spirit of the present disclosure. It should also be understood that any features illustrated or described with respect to the above-described figures can be combined in any suitable form.

[0055] The technology claimed and shown in this specification refers to and is applicable to tangible objects and specific examples of a practical nature that reliably improve the art, and thus are not abstract, intangible, or purely theoretical. Further, if any claim appended at the end of this specification includes one or more elements designated as "means for [performing]... [function]" or "step for [performing]... [function]", such elements should be construed in accordance with 35 U.S.C. § 112(f). On the other hand, for any claim that includes elements designated in any other form, such elements should not be construed in accordance with 35 U.S.C. § 112(f).

Description of Reference Numerals

[0056] 8 Reaction-Type Media System 10 Entertainment Attraction 12 Anime Figure 14 Image 16 Projector 20 Media Control System 22 Stage Ceiling 24 Stage Floor 26 Landscape Object 30 Stage Lighting Device 32 Guest Area 34 Guest 40 Outer Surface of the Main Body of the Anime Figure 42 Main Body of the Anime Figure 44 Head of the Anime Figure 50 Motion Control System 60 Tracker 62 Rear Surface of the Anime Figure 64 Tracking Camera 66 Operable Motion Device

Claims

1. 1. A responsive media system for an entertainment attraction, comprising: A motion control system; A media control system; The motion control system comprises: an animated figure having a body and a set of actuators configured to adjust figure portions of the body in response to interaction data received from one or more interaction data sources; a set of trackers coupled to the figure portion of the body; the media control system comprising: a tracking camera configured to generate signals indicative of a current position and a current orientation of the figure part based on the set of trackers; coupled to the tracking camera; receiving a signal indicative of said current position and said current orientation; determining the current position and the current orientation based on the signals; generating data indicative of an image to be projected onto an exterior surface of said figure part having said current position and said current orientation; a media controller configured to a projector communicatively coupled to the media controller; the projector is configured to receive data indicative of the image from the media controller and to project the image onto the exterior surface of the figure portion having the current position and the current orientation. A responsive media system comprising:

2. the one or more interaction data sources configured to generate the interaction data as input data that changes over time and is responsive to a current state of the animated figure; The responsive media system of claim 1 .

3. The one or more interaction data sources include a guest sensor configured to generate a sensor signal indicative of a guest input as the interaction data, and the motion control system includes a figure controller coupled to the guest sensor and the set of actuators, the figure controller comprising: determining the guest input based on the sensor signal from the guest sensor; generating an interactive response of said animated figure to said guest input; instructing the set of actuators to perform the interactive response; The responsive media system of claim 1 configured to:

4. the guest sensor includes a transducer that transmits the sensor signal indicative of the guest input based on monitoring a guest area of ​​the entertainment attraction. The responsive media system of claim 3 .

5. The guest sensor includes an optical transducer, a mechanical transducer, an electromechanical transducer, an electromagnetic transducer, an acoustic transducer, a pressure transducer, or a temperature transducer. The responsive media system of claim 3 .

6. a show controller communicatively coupled to the guest sensors and to at least one output device disposed within the entertainment attraction, the show controller configured to control the at least one output device to provide an output coordinated with the interactive response of the animated figure, the at least one output device including an optical output device, an audio output device, or both; The responsive media system of claim 3 .

7. the one or more interaction data sources including a guest sensor configured to detect guest input from a guest of the entertainment attraction as the interaction data, the guest input including a position, movement or action of the guest detectable by the guest sensor; The responsive media system of claim 1 .

8. the media control system is configured to project the image onto the exterior surface of the figure portion without receiving position, velocity or acceleration information from the set of actuators of the anime figure. The responsive media system of claim 1 .

9. each tracker in the set of trackers is an active element integrated into a power circuit of the animated figure and configured to emit an individual signal, and the tracking camera is configured to receive and distinguish the individual signals from each tracker in the set of trackers such that the media controller can resolve the current position and the current orientation of the figure part; The responsive media system of claim 1 .

10. each tracker in the set of trackers is a passive element concealed on or within a surface of the figure portion of the anime figure, and the tracking camera is configured to visually distinguish each tracker in the set of trackers such that the media controller can resolve the current position and the current orientation of the figure portion. The responsive media system of claim 1 .

11. the figure portion includes an actuatable portion of a character coupled to a support structure of the character; The responsive media system of claim 1 .

12. The figure part is a head, an arm, a torso or a leg of the main body of the anime figure. The responsive media system of claim 11 .

13. the media control system includes a plurality of tracking cameras including the tracking camera, the plurality of tracking cameras being coupled to a camera network device coupled to the media controller; The responsive media system of claim 1 .

14. the figure portion of the animated figure includes a face portion of the body having a movable jaw with at least one degree of freedom, the projector is configured to project at least a portion of the image onto the movable jaw, a portion of the set of actuators is configured to actuate the movable jaw, and the motion control system is configured to command the portion of the set of actuators to actuate the movable jaw in response to the interaction data. The responsive media system of claim 1 .

15. 1. A method of operating a responsive media system for an entertainment attraction, comprising: receiving interaction data from one or more interaction data sources of the entertainment attraction via a figure controller of the animated figure; generating, via the figure controller, an interactive response for the animated figure based on the interaction data; instructing, via the figure controller, an actuator disposed within the animated figure to perform the interactive response by moving at least a portion of a body of the animated figure; receiving sensor feedback via the media controller from a tracking camera coupled to the media controller and configured to sense a current position and orientation of the body of the anime figure based on at least one tracker concealed on the body of the anime figure; generating, via the media controller, a set of images to be projected onto an exterior surface of the body of the animated figure having the current position and orientation; instructing the projector, via the media controller, to contour map the image set onto the exterior surface of the body having the current position and orientation; The method according to claim 1, further comprising:

16. the one or more interaction data sources include a dedicated game engine of the animated figure, a health monitoring system of the entertainment attraction, a master control system of the entertainment attraction, a computer device associated with a technician of the entertainment attraction, or a guest sensor located within the entertainment attraction; The method of claim 15.

17. the one or more interaction data sources include a guest sensor, and the interaction data includes guest input indicative of an active movement of a guest or a passive disposition of the guest; The method of claim 15.

18. The step of generating the interactive response based on the interaction data includes: analyzing the guest input to determine at least one aspect of the guest input including an audible output of the guest, a detectable movement of the guest, or both; generating said interactive response substantially in real time based on each aspect of said at least one aspect of said guest input; 20. The method of claim 17, comprising:

19. determining, via the media controller, a baseline performance rating for the animated figure based on a first movement of the animated figure during a first time period; determining, via the media controller, a current performance rating for the animated figure based on a second movement of the animated figure during a second subsequent time period; comparing, via the media controller, the current performance assessment to the baseline performance assessment; in response to determining that the current performance rating is outside a threshold from the baseline performance rating, outputting an alert via the media controller indicating a deterioration state of the animated figure; 16. The method of claim 15, comprising:

20. The step of generating a set of images to be projected comprises: storing, via the media controller, a skeletal model of the animated figure, including joints and movable parts of the animated figure; updating the skeletal model via the media controller to correspond to the current position and orientation of the animated figure based on the sensor feedback from the tracking camera; generating, via the media controller, the set of images to be projected based on the updated skeletal model in substantially real time; 16. The method of claim 15, comprising:

21. determining, via the media controller, that a particular one of the actuators located within the animated figure is disabled based on the sensor feedback from the tracking camera; updating, via the media controller, a skeletal model of the animated figure stored within the media controller to indicate that the particular actuator is disabled; generating, via the media controller, the set of images to be projected based on the updated skeletal model; 16. The method of claim 15, comprising:

22. 1. A responsive media system for an entertainment attraction, comprising: one or more interaction data sources configured to generate time-varying interaction data; A motion control system; The motion control system comprises: an anime figure disposed within the entertainment attraction, the anime figure including a figure portion including a movable joint; a set of actuators disposed within the figure portion and configured to actuate the moveable joints; a figure controller communicatively coupled to the set of actuators and to the one or more interaction data sources; said figure controller comprising: determining an interactive response for the animated figure that corresponds to a current state of the animated figure based on the interaction data from the one or more interaction data sources, the interactive response including actuating the moveable joint; instructing the set of actuators to perform the interactive response; The reactive media system is configured as follows: and a set of trackers coupled to the figure portion of the animated figure, the set of trackers enabling a media control system of the responsive media system to project images onto an exterior surface of the figure portion of the animated figure in synchronization with the interactive responses of the motion control system. A responsive media system comprising:

23. The media control system includes: a tracking camera configured to sense a current position and a current orientation of the animated figure based on the set of trackers; a media controller coupled to the tracking camera and configured to generate content to be projected onto a portion of the animated figure based on the current position and the current orientation of the animated figure; a projector coupled to the media controller; the projector is configured to receive data indicative of the content and to project the content onto the animated figure having the current position and the current orientation.

23. The responsive media system of claim 22.

24. the projector is configured to move in coordination with the current position and the current orientation of the animated figure based on instructions from the media controller.

24. The responsive media system of claim 23.

25. the set of trackers includes a first tracker located on the moveable joint of the figure part and a second tracker located on a different part of the anime figure different from the moveable joint, the set of trackers enabling the media control system to determine a current distance between the moveable joint and the different part of the anime figure.

23. The responsive media system of claim 22.

26. the one or more interaction data sources include a guest sensor configured to sense input indicative of an interaction between a guest of the entertainment attraction and the animated figure as the interaction data.

23. The responsive media system of claim 22.

27. the motion control system includes an additional animated figure having an additional figure portion, and the responsive media system includes an additional set of trackers coupled to the additional figure portion to enable the media control system to project an additional image onto the additional figure portion.

23. The responsive media system of claim 22.

28. the motion control system comprises an actuatable motion device physically coupled to the animated figure and communicatively coupled to the figure controller, and the interactive response includes commanding the actuatable motion device to move the animated figure in at least one direction relative to a stage or a ground of the entertainment attraction.

23. The responsive media system of claim 22.

29. the actuatable motion device includes an actuatable motion device disposed below the animated figure; 30. The responsive media system of claim 28.

Images