Systems and methods for optical performance capture anime figures using real-time responsive projected media

Abstract

A responsive media system (8) includes a motion control system (50) having an animated figure (12) including a body and actuators configured to adjust figure portions of the body in response to interaction data received from one or more interaction data sources. The responsive media system includes a media control system (20) having a tracking camera (64) configured to generate signals indicative of the current position and orientation of the figure portion based on a set of trackers (60) coupled to the figure portion. The media control system includes a media controller configured to receive the signals, determine the current position and orientation based on the signals, and generate data indicative of an image to be projected onto the exterior surface of the figure portion having the current position and orientation. The media control system also includes a projector (16) configured to receive data from the media controller and project the image onto the exterior surface.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Provisional Patent Application No. 62 / 956,468, filed January 2, 2020, and entitled "SYSTEMS AND METHODS FOR OPTICAL PERFORMANCE CAPTURED ANIMATED FIGURE WITH REAL-TIME REACTIVE PROJECTED MEDIA," which is incorporated herein by reference in its entirety for all purposes. [Background technology]

[0002] This section is intended to introduce the reader to various aspects of the art that may be related to various aspects of the present technology described and / or claimed below. This discussion is believed to be helpful in providing the reader with background to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0003] Amusement parks and other entertainment venues include, among other attractions, animated figures that entertain park guests who are queuing up for or within a ride experience. Some animated figures can be brought to life by projection mapping, which traditionally directs a predetermined appearance onto the animated figure. For example, certain animated figures can be visually complemented with a canned or fixed set of images that can be coordinated with the preprogrammed movements of the animated figure. While such technology provides greater entertainment value than a flat display surface, it is now recognized that advancements can be made to further immerse guests in a particular attraction, ride, or interactive experience. For example, some animated figures have projectors located within them that create unrealistic backlighting or glows via internal or rear projection through the translucent projection surface of the animated figure. Thus, it is now recognized that it is desirable to make animated figures appear more lifelike and provide them with the ability to contextually blend in with their environment in a realistic and convincing way. Summary of the Invention [Means for solving the problem]

[0004] The following summarizes certain embodiments common in scope to the subject matter of the original claims. These embodiments are not intended to limit the scope of the disclosure, but rather to provide merely a brief summary of some disclosed embodiments. Indeed, the disclosure may include a variety of forms that may be similar to or different from the embodiments set forth below.

[0005] In one embodiment, a responsive media system for an entertainment attraction includes a motion control system including an animated figure having a body and a set of actuators configured to adjust a figure portion of the body in response to interactive data received from one or more interactive data sources. The motion control system also includes a set of trackers coupled to the figure portion of the body. The responsive media system includes a media control system including a tracking camera configured to generate a signal indicative of a current position and a current orientation of the figure portion based on the set of trackers. The media control system includes a media controller coupled to the tracking camera and configured to receive the signal indicative of the current position and the current orientation. The media control system is also configured to determine the current position and current orientation based on the signal and generate data indicative of an image to be projected onto an outer surface of the figure portion having the current position and the current orientation. The media control system also includes a projector communicatively coupled to the media controller. The projector is configured to receive the data indicative of the image from the media controller and to project the image onto the outer surface of the figure portion having the current position and the current orientation.

[0006] In one embodiment, a method of operating a responsive media system of an entertainment attraction includes receiving, via a figure controller of the animated figure, interaction data from one or more interaction data sources of the entertainment attraction, and generating, via the figure controller, an interactive response of the animated figure based on the interaction data. The method includes instructing, via the figure controller, an actuator disposed within the animated figure to perform the interactive response by moving at least a portion of a body of the animated figure. The method also includes receiving, via the media controller, sensor feedback indicative of a current position and orientation of the body of the animated figure from a tracking camera coupled to the media controller. The tracking camera is configured to sense the current position and orientation based on at least one tracker concealed on the body of the animated figure. The method also includes generating, via the media controller, a set of images to be projected onto an exterior surface of the body of the animated figure having a current position and orientation, and instructing, via the media controller, a projector to contour map the set of images onto the exterior surface of the body having the current position and orientation.

[0007] In one embodiment, a responsive media system for an entertainment attraction includes one or more interaction data sources configured to generate interaction data that changes over time, and a motion control system including an animated figure disposed within the entertainment attraction. The animated figure includes a figure portion including a movable joint. The motion control system also includes a set of actuators disposed within the figure portion and configured to actuate the movable joint. The motion control system also includes a figure controller communicatively coupled to the set of actuators and the one or more interaction data sources. The figure controller is configured to determine an interactive response for the animated figure that corresponds to a current state of the animated figure based on the interaction data from the one or more interaction data sources. The interactive response includes actuating the movable joint. The figure controller is also configured to command the set of actuators to perform the interactive response. Additionally, the responsive media system includes a set of trackers coupled to the figure portion of the animated figure. The set of trackers enables a media control system of the responsive media system to project images onto an exterior surface of the figure portion of the animated figure in synchronization with the interactive response of the motion control system.

[0008] These and other features, aspects, and advantages of the present disclosure will be better understood from the following detailed description when read in conjunction with the accompanying drawings, in which like parts are designated with like numerals throughout. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram illustrating an embodiment of an entertainment attraction or experience having a responsive media system controlling a projection mapping image displayed on an anime figure in accordance with an embodiment of the present disclosure. [Diagram 2] FIG. 1 is a schematic diagram illustrating an embodiment of a reactive media system including a guest sensor that allows an animated figure to react to guest input, according to an embodiment of the present disclosure. [Diagram 3]FIG. 3 is a block diagram of an embodiment of the responsive media system of FIG. 1 or FIG. 2 that enables an animated figure to react to an interaction data source based, for example, on a media control system that detects the movement and position of the animated figure, in accordance with an embodiment of the present disclosure. [Figure 4] FIG. 2 is a schematic cross-sectional view of an embodiment of the head of the anime figure of FIG. 1 with articulating jaws and a rear-mounted tracker, in accordance with an embodiment of the present disclosure. [Diagram 5] FIG. 2 is a schematic cross-sectional view of an embodiment of the head of the anime figure of FIG. 1 having a trackable tracker attached to its front, in accordance with an embodiment of the present disclosure. [Figure 6] FIG. 2 is a front perspective view of an embodiment of facial features projection mapped onto the head of the anime figure of FIG. 1 in accordance with an embodiment of the present disclosure. [Figure 7] 2 is a front perspective view of another embodiment of facial features projection mapped onto the head of the anime figure of FIG. 1 in accordance with an embodiment of the present disclosure. [Figure 8] 4 is a flow diagram of an embodiment of a process by which a motion control system controls the animated figure of FIG. 1 to respond to the interaction data source of FIG. 3 according to an embodiment of the present disclosure. [Figure 9] FIG. 2 is a flow diagram of an embodiment of a process by which a media control system dynamically projects images onto the animated figure of FIG. 1 that can respond to an interaction data source at any time, according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] One or more specific embodiments of the present disclosure will be described below. In order to describe these embodiments concisely, not all features of the implementations may be described herein. It should be understood that the development of any such implementation, as in any engineering or design project, requires numerous implementation-specific decisions to be made to achieve the developer's particular objectives, such as compliance with system-related and business-related constraints that may vary from implementation to implementation. Moreover, it should be understood that such development efforts may be complex and time-consuming, but would be a routine undertaking of design, fabrication and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0011] When introducing elements of various embodiments of the disclosure, the articles "a," "an," and "the" are intended to mean the presence of one or more of the element. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. It should also be understood that references to "one embodiment" or "an embodiment" of the disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also contain the recited features.

[0012] The present embodiment relates to a responsive media system for entertainment attractions, such as attractions where a projector of a media control system directs images onto the exterior of an animated figure, where the animated figure responds to any suitable number of interactive data sources or streams, which may include the current state of the animated figure, control commands from an artificial intelligence (AI) engine, guest actions or passive qualities, and backstage or on-stage performer actions. Thus, the responsive media system can provide guests with a dynamic and immersive experience in which the animated figure more closely resembles a real person or character than was achievable prior to the present technology. In particular, by performing projection mapping on the exterior of the animated figure, the animated figure can appear more lifelike than some animated figure systems that create an unnatural or ethereal luminous appearance by projecting images internally through the translucent surface of the animated figure. As described herein, the responsive media system can reduce or eliminate unnatural backlighting by utilizing external tracking of the animated figure (e.g., via optical performance capture or optical motion capture) to dynamically generate and provide images onto the exterior of the animated figure. In fact, some anime figures may contain an internal projector within their body, so that the internal projector does not move relative to the anime figure and therefore does not need to track the figure or its movements. As an added benefit, placing the projector external to the anime figure allows the space within the anime figure to accommodate complex or numerous actuators that may otherwise impede or physically interfere with conventional internal projection mapping techniques.

[0013] More specifically, to enhance the naturalness of the anime figure, the anime figure may be fitted with a tracker that allows a tracking camera of the media control system to identify the movement, position and orientation of the anime figure in real time via optical performance capture or optical motion capture. Because the media control system may operate independently of the anime figure (e.g., by not relying on position, velocity and / or acceleration information regarding the actuators of the anime figure), the media control system may dynamically generate and fit projected images onto the interactive anime figure at realistic frame rates that mimic a live character, such as by presenting patterns, colors and / or movements that appear indistinguishable from the anime figure. As will be appreciated, the media control system of some embodiments may generate and update a skeletal model of the anime figure based on feedback from the tracking camera. The skeletal model generally represents the movable parts, such as the actuatable joints, of the anime figure and is dynamically updated to represent the current three-dimensional position (e.g., including x, y and z coordinates), orientation and scale of the anime figure or a portion thereof (e.g., the pose of the anime figure). Thus, the media control system utilizes the skeletal model to generate and project images that precisely fit the current position and orientation of the reactive and / or interactive anime figure. Thus, the responsive media system provides a motion control system with an animated figure that responds to interaction data, and a media control system that responds to the mechanical performance of the animated figure. Thus, as described below, these two closed control loops provide improved system performance based on optical motion capture of the animated figure to provide an engaging character presentation to the guest regardless of the mechanical positioning of the animated figure.

[0014] As shown in FIG. 1, the responsive media system 8 of the entertainment attraction 10 includes an animated figure 12 that receives an image 14 (e.g., projected content) from a projector 16 (e.g., external projector, optical projector with lens) of a media control system 20. In this embodiment, the entertainment attraction 10 is a show set having a stage ceiling 22, a stage floor 24, and scenery objects 26 disposed between the stage ceiling 22 and the stage floor 24. The show set may also include any suitable stage lighting device 30, such as the lighting fixture or device shown. In accordance with the present technology, a number of guests 34 may view and / or interact with the animated figure 12 from a guest area 32 of the entertainment attraction 10. Although the responsive media system 8 is shown as being in a stage type environment, it should be understood that the responsive media system 8 may be utilized to entertain the guests 34 in any suitable entertainment environment, such as a dark ride, an outdoor arena, and an environment adjacent to the ride path of a ride vehicle carrying the guests 34.

[0015] It should be noted that the projector 16 is external to the animated figure 12, thus allowing the use of sealed volumes within the animated figure 12 to accommodate components other than the projector 16, such as certain actuation systems, as described below. In the illustrated embodiment, the projector 16 is positioned in front of the animated figure 12 and is obscured from view by the guest 34 by an overhang 36 in the stage ceiling 22. It should be recognized that the overhang 36 could instead be a curtain, or the entertainment attraction 10 could take any other suitable form that allows the guest 34 to observe the animated figure 12. In other embodiments, the projector 16 could be positioned behind the guest 34. In either case, in this embodiment, the projector 16 directs the image 14 onto an exterior surface 40 of the body 42 of the animated figure 12, which corresponds to the head 44 of the animated figure 12. Thus, the media control system 20 can provide realistic and attractive patterns to the head 44 from a hidden location, thereby providing an immersive and interactive experience for the guest 34. In fact, as described above, the media control system 20 of the responsive media system 8 can make the animated figure 12 appear more lifelike than an internally projected animated figure because it does not produce the unnatural internal illumination of the animated figure 12 that some internally projected animated figures can produce.

[0016] As will be appreciated herein, in some embodiments, the animated figure 12 is part of a motion control system 50 (e.g., a figure control system, a prop control system) that operates independently of the media control system 20. For example, the motion control system 50 may receive interaction data from any suitable reactive and / or interactive data source, as described in more detail below. Thus, the animated figure 12 may utilize the interaction data to dynamically update or modify the entertainment attraction 10 and / or its interaction with the guest 34 therein. It should be appreciated that the motion control system 50 may command actuators to adjust the position of any suitable component of the entertainment attraction 10 visible to the guest 34. Additionally, as will be described in more detail below with reference to FIGS. 2 and 3, the motion control system 50 may generate interactive and / or reactive responses based on the suitable interaction data and command the actuators of the animated figure 12 and / or the motion control system 50 to execute the interactive and / or reactive responses in real time. As described below, the responsive media system 8 can coordinate the operation of any interactive or actuatable components of the stage lighting 30 and / or scenery objects 26 to provide responses to the interaction data source that are coordinated with the responses of the animated figure 12. Additionally, the motion control system 50 can control an actuatable motion device 66 (e.g., an actuatable motion base) physically coupled to the animated figure 12. The actuatable motion device 66 can be any suitable motion generating assembly capable of moving (e.g., translating, rotating) the animated figure 12 laterally, longitudinally, and / or vertically. However, it should be understood that in other embodiments, the actuatable motion device 66 can be or include a suspension and / or flight system coupled to the animated figure 12 from above the stage floor 24.Thus, the suspension and / or flight systems of the actuatable motion device 66 may include any suitable actuators designed to move the animated figure 12 laterally, longitudinally, and / or vertically.

[0017] It is noted that in this embodiment, the motion control system 50 includes a tracker 60 (e.g., a trackable marker) disposed on a rear surface 62 of the animated figure 12. As will be appreciated herein, the tracker 60 may be disposed on or within any suitable surface of the animated figure 12 that allows the tracker 60 to be hidden from view of the guests. The tracker 60 enables a tracking camera 64 of the media control system 20 to sense or resolve the position and orientation of the animated figure 12 within the entertainment attraction 10, such as via optical performance capture or optical motion capture techniques. The tracking camera 64 may be obscured or hidden from view of the guests 34 in any suitable manner, such as by being disposed on the stage ceiling 22 or hidden within the scenery objects 26. Thus, it will be appreciated that the projector 16 may provide the image 14 to the animated figure 12 in sync with the actual current position and orientation (e.g., pose) of the animated figure 12 without relying on position, velocity, and / or acceleration information from the actuators of the animated figure 12 to provide improved show quality with less latency and increased realism. In other embodiments, media control system 20 can verify the positioning and movement of projector 16 based on actuator-derived information from motion control system 50 .

[0018] It should be understood that the responsive media system 8 can include any suitable number of projectors 16, trackers 60, and tracking cameras 64. For example, multiple animated figures 12 can be included within one entertainment attraction 10. Thus, if multiple animated figures 12 are provided that can be viewed by guests 34 from one side of a show set, the responsive media system 8 can include at least one projector 16 for each animated figure 12. However, it is presently recognized that the particular infrastructure of the responsive media system 8 allows for any number of animated figures 12 that are movable within the optical field of at least one tracking camera 64 and within the projection cone of at least one projector 16 to receive images 14 without substantial redesign or reconfiguration of the responsive media system 8. In other words, according to the present disclosure, when additional animated figures 12 equipped with trackers 60 are placed within the entertainment attraction 10, the responsive media system 8 can easily detect and accommodate these additional animated figures 12. In other embodiments, multiple projectors 16 may be provided to provide content to multiple sides of a single animated figure 12, such as an animated figure 12 that can be accessed by guests 34 from multiple parts of a show set. Also, while some embodiments of the animated figure 12 may include at least two trackers 60 such that the tracking camera 64 can resolve the relative positions of the at least two trackers 60 for efficient tracking of the animated figure 12, it should be understood that the position of a single tracker 60 may be varied to allow for resolution of the position of the animated figure 12 using a less complex system.

[0019] FIG. 2 illustrates an embodiment of the responsive media system 8 of the entertainment attraction 10 including the media control system 20 and the motion control system 50, and an example of an interaction data source 70 including a guest sensor 72. In this embodiment, the guest sensor 72 collects guest input from any guest 34 in the guest area 32. As recognized herein, the guest input is a form of interaction data that the animated figure 12 can utilize to adaptively respond to the current state of the animated figure 12 or the entertainment attraction 10. In this embodiment, the guest sensor 72 can be any suitable device that collects data from or about the guest 34 as interaction data. In some embodiments, the guest input collected by the guest sensor 72 can include active and / or passive input. For example, the animated figure 12 can respond to macroscopic gestures of the guest 34 by implementing gesture recognition. As a passive input, the animated figure 12 can respond to the determined position, orientation, features, and / or height of the guest 34. Also, in some embodiments, the guest sensor 72 includes physical input devices such as buttons, levers, and knobs. Further, it should be understood that the guest sensors 72 may collect any suitable visual data, auditory data, tactile input, data from an interactive guest device (e.g., smartphone, tablet), identification information from a guest armband, input from a guest interactive toy, and the like.

[0020] As described above, the motion control system 50 can generate interactive and / or reactive responses for the animated figure 12 to perform based on the interaction data and then command the actuators of the animated figure 12 to perform the interactive and / or reactive responses. As a specific, non-limiting example, the motion control system 50 can determine that the interaction data includes guest input indicating that one guest 34 has physically and / or verbally greeted the animated figure 12 from an edge of the guest area 32. The motion control system 50 can then dynamically command the animated figure 12 to perform an interactive physical response to the guest 34's greeting. For example, the motion control system 50 can control the animated figure 12 to rotate to face the guest 34 while waving the arms of the animated figure 12. As another specific example of an interactive response, the motion control system 50 may also control the animated figure 12 to respond to guest input by approaching a determined location of the guest 34 (e.g., via an actuatable motion device 66 positioned below the animated figure 12), tilting the head 44 of the animated figure 12 to appear to look at or make eye contact with a guest 34 having a particular height, and so on.

[0021] With an understanding of these general operations of the reactive media system 8 in mind, further description will be provided herein regarding certain embodiments of specific components of the reactive media system 8. For example, FIG. 3 is a block diagram of a reactive media system 8 illustrating a media control system 20 operable to externally provide content or images to the animated figure 12 without being communicatively coupled to the motion control system 50. In other words, the media control system 20 does not directly send or receive communication signals to or from the motion control system 50. However, as described below, an interaction data source 70 may be communicatively coupled upstream of both the media control system 20 and the motion control system 50 to enable coordination between the media control system 20 and the motion control system 50 without intercommunication between the control systems 20, 50. Additionally, in some embodiments, a network device 90, such as a switch or hub, may be communicatively coupled directly downstream of the interaction data source 70 to facilitate efficient communication between the interaction data source 70 and the control systems 20, 50. However, it should be understood that the network device 90 may be omitted, multiple network devices 90 may be implemented, or any other suitable data management device may be utilized to facilitate the provision of data from the interaction data source 70 to the control system 20, 50. In the illustrated embodiment, the animated figure 12 includes a figure processor 100 and a figure memory 104, which collectively may form all or part of a figure controller 102 of the motion control system 50. The animated figure 12 also includes trackers 60 disposed on the body 42 of the animated figure 12 to enable a tracking camera 64 of the media control system 20 to sense the position and orientation or pose of the animated figure 12. The trackers 60 may be active elements, each capable of emitting a separate signal to the tracking camera 64. For example, the trackers 60 may emit infrared, electromagnetic energy, or any other suitable signal that is undetectable by the guest 34 and distinguishable by the tracking camera 64.Alternatively, the tracker 60 may be a passive element (e.g., a reflector, a pigmented portion) that does not emit a signal but allows the tracking camera 64 to accurately distinguish it from other parts of the animated figure 12 and / or entertainment attraction 10.

[0022] Additionally, the animated figure 12 is fitted with any suitable actuators 106 that enable the animated figure 12 to move in a realistic and lifelike manner (e.g., walking, translating, rotating, pivoting, lip synchronized). The actuators 106 may include servo motors, hydraulic cylinders, linear actuators, and the like, each positioned and coupled to indicate relative movement between respective portions of the animated figure 12. For example, each set of actuators 106 may be positioned to cause arm movement of the animated figure 12, articulated jaw movement of the animated figure 12, manipulation of figure portions (e.g., head 44, arms, torso, legs) of the animated figure 12, and the like. As discussed above, the interaction data source 70 may include any suitable data source that provides a time-varying data set as the interaction data 109. Thus, in some embodiments of the interaction data source 70 that includes an input sensor or guest sensor 72 (e.g., depth camera, input device, motion sensor), the guest sensor 72 may sense an interaction between the guest and the animated figure 12 and relay interaction data indicative of the guest interaction to the figure controller 102. In either case, the figure controller 102 can command the actuators 106 to dynamically manipulate the animated figure 12 to instantly respond to and adapt to any suitable interaction data 109, which may change over time, based on the interaction data 109 from the interaction data source 70, as described in more detail below.

[0023] The interaction data source 70, communicatively coupled to the figure controller 102 (e.g., via a wireless or wired communication path), may include any one or more suitable components that generate and transmit the interaction data 109 to the figure controller 102 and / or the media controller, described below. For example, the interaction data source 70 may include a specialized game engine or computing device that dynamically generates instructions that the animated figure controller 102 can execute to cause the animated figure 12 to modify its movement within the entertainment attraction 10. In some embodiments, the specialized game engine may be embedded within the animated figure controller 102 as a suitable module thereof. In some embodiments, the interaction data 109 provided by the interaction data source 70 includes inputs or instructions received from a computing device associated with a health monitoring system of the motion control system 50, a global or master control system of the entertainment attraction 10, and a technician of the entertainment attraction 10. Additionally or alternatively, by way of further example, the interaction data 109 may include time of day data, weather data, social media data, stock market data, ride location data, or any suitable data stream that may change over time. It should be appreciated, therefore, that the animated figure 12 may adaptively respond to any suitable number of interaction data sources 70. Indeed, the interaction data 109 provided by the interaction data sources 70 may include any suitable stream(s) of input information that may be selectively constant and / or time-varying to enable the animated figure controller 102 to dynamically control the movement of the animated figure 12. Thus, the motion control system 50 may implement a figure feedback loop that modifies or validates the movement of the animated figure 12 based on the interaction data 109.

[0024] Also, in some embodiments, the interaction data source 70 may include a guest sensor 72 that includes any combination of components suitable for resolving guest interactions. Indeed, it is presently recognized that guest interactions may be sensed by any suitable optical, mechanical, electromechanical, electromagnetic, acoustic, pressure and / or temperature transducers or sensors of any type. As specific, non-limiting examples, the guest sensor 72 may include any suitable number of computer vision sensors (e.g., cameras), depth cameras, light detection and ranging (LIDAR) devices, motion sensors, audio recording and / or processing devices, touch capacitance sensors, light sensors, pressure or floor mat sensors, radio frequency (RF) sensors that receive uniquely identifying RF signals from user wearable devices having radio frequency identification (RFID) tags, and the like, or combinations thereof. That is, the guest sensor 72 may include any suitable components or transducers that generate signals based on monitoring the guests 34 within the guest area 32. Although the motion control system 50 is shown as including a guest sensor 72 external to the body 42 of the animated figure 12, it should be understood that other embodiments of the motion control system 50 may include all or a portion of the guest sensor 72 located within the body 42 of the animated figure 12. In other embodiments, the interaction data source 70 of the motion control system 50 may not include a guest sensor 72, but may enable the animated figure 12 to adaptively respond to any other suitable source(s) of interaction data 109.

[0025] As shown, this embodiment of the media control system 20 includes a projector 16, four tracking cameras 64, a camera network device 110, and a media controller 112. The media controller 112 is communicatively coupled to an interaction data source 70 (e.g., via a network device 90) such that the media controller 112 can dynamically react to the physical environment of the entertainment attraction 10, such as by determining whether guest input or a source that results in another change in the interaction data 109 is received. Also, as shown in this embodiment, the media control system 20 can be communicatively separate from the motion control system 50. That is, the motion control system 50 is independent of the media control system 20, while the media control system 20 follows or relies on the animated figure 12. Thus, the media control system 20 provides the animated figure 12 with the operational freedom to adaptively respond to the interaction data 109 in substantially real-time (e.g., within microseconds or milliseconds of interaction), while monitoring or tracking the motion of the animated figure 12 and projecting immersive patterns or images onto the animated figure 12, also in substantially real-time. Thus, while the motion control system 50 is executing the figure feedback loop, the media control system 20 simultaneously executes a media feedback loop that modifies or verifies the image projected on the animated figure 12. The media control system 20 utilizes a tracking camera 64 suitably positioned within the entertainment attraction 10 to identify or pinpoint the tracker 60 of the animated figure 12 via optical motion capture techniques to gather information regarding the current position and orientation of the animated figure 12. The type or configuration of the tracking camera 64 can be individually selected to correspond to the type of tracker 60. In summary, when an active element is used as the tracker 60, the tracking camera 64 can be designed to receive a signal from the active element to sense the position of the animated figure 12. When a passive element is used as the tracker 60, the tracking camera 64 can be designed to identify a passive element on the outer surface 40 of the animated figure 12.The positioning of these trackers 60, together with the geometric or skeletal model of the anime figure 12, facilitates the adjustment of the projection onto the anime figure 12 in different orientations.

[0026] The tracked camera 64 in the illustrated embodiment is communicatively coupled to a camera network device 110 that relays signals indicative of the current (e.g., including x, y, and z coordinates) three-dimensional position, orientation, and scale (e.g., the pose of the anime figure 12) of the anime figure 12 or a portion thereof to a media controller 112. The camera network device 110 is thus a network switch or sensor hub that consolidates multiple information streams from the tracked camera 64 for efficient processing by the media controller 112. The media controller 112 includes a media processor 114 and a media memory 116 that cooperate to determine, generate, and / or adjust a dynamic pattern or image to be overlaid on the anime figure 12 at the current position and orientation of the anime figure 12. As a result, the media controller 112 can instruct the projector 16 to project a dynamic image on the anime figure 12. The image can be rendered entirely on demand based on the current pose (e.g., position, orientation, and scale) of the anime figure 12. In a low-complexity configuration, the image can be generated by adapting a pre-recorded video stream to the current pose of the anime figure 12. In accordance with the present disclosure, the media controller 112 may be any suitable media generator or game engine having high processing power and low latency. It should therefore be appreciated that the media controller 112 may generate images to be projected onto the animated figure 12 in substantially real-time based on sensor data received from the tracking camera 64. In practice, the media controller 112 may maintain a skeletal model or algorithm representing the animated figure 12 and its actuatable portions (e.g., jaw, limbs, joints). Based on the sensor data, the media controller 112 may update the skeletal model to represent the actual current position and orientation of the animated figure 12, and thereafter generate images to be projected onto the animated figure 12 having this current position and orientation.

[0027] The projector 16 may include a projector processor 120 and a projector memory 122 that facilitate the presentation of an image or dynamic pattern on the animated figure 12. The projector processor 120 typically receives data indicative of an image from the media controller 112 and then commands a light source within the projector 16 to output the image through a lens. The projector 16 may be movable or actuable to follow and coordinate with the animated figure 12, such as based on commands received from the media controller 112. Alternatively, the projector 16 may be fixed. In either case, the media controller 112 may determine, based on an updated skeletal model, the shape of the current silhouette or target figure portion of the animated figure 12 that is to receive the projected image, and then command the projector 16 to provide the image on the silhouette. It should therefore be understood that the projector 16 may block or mask portions of the animated figure 12 and / or entertainment attraction 10 that are not designed to receive the image 14, such as the wig of the animated figure 12 and scenery objects 26 that are behind the animated figure 12 relative to the projector 16.

[0028] Each of the processors 100, 114, 120 is any suitable processor capable of executing instructions to perform the techniques of this disclosure, such as a general purpose processor, a system on chip (SoC) device, an application specific integrated circuit (ASIC), a processor in a programmable logic controller (PLC), a processor in an industrial PC (IPC), or any other similar processor configuration. These instructions are encoded in a program or code stored in a tangible, non-transitory computer readable medium, such as memory 104, 116, 122 and / or other storage circuitry or storage device. Thus, figure processor 100 is coupled to figure memory 104, media processor 114 is coupled to media memory 116, and projector processor 120 is coupled to projector memory 122.

[0029] This embodiment of the responsive media system 8 also includes a show control system 130 that adjusts further output devices of the entertainment attraction 10 based on the interaction data source 70. For example, a show controller 132 of the show control system 130 is communicatively coupled between the network device 90 and one or more lighting output devices 134, audio output devices 136, and / or venue-specific special effects output devices 138 (e.g., fog machines, vibration generators, actuable portions of the scenery objects 26). The lighting output devices 134 may include the stage lighting devices 30 (including, for example, light fixtures) and any other light-generating components of the entertainment attraction 10. The audio output devices 136 may also include any suitable speaker or noise-generating device designed to output sound based on commands from the show controller 132. Thus, the show controller 132 may adjust the presentation of the output devices 134, 136, 138 to correspond to the interactive and / or reactive responses of the animated figures 12 and the media control system 20 based on the interaction data 109 received from the interaction data source 70.

[0030] As one particular example of the present technology, FIG. 4 is a side cross-sectional view of the head 44 of the anime figure 12 having a tracker 60 on a rear surface 62 of the body 42 relative to the projector 16. The tracker 60 is an active tracker (e.g., an infrared light emitting diode) in this embodiment, and is thus connected to a circuit 150 that is coupled to or integrated with a power source 152 of the anime figure 12. The power source 152 may be the main power source of the anime figure 12 or may be a separate power source that solely powers the tracker 60. In general, the trackers 60 utilize electrical energy from the power source 152 to emit individual signals for resolution by the tracking camera 64. For example, a first one of the trackers 60, a first tracker 160, may emit a first signal having a first unique identification signal (e.g., frequency, signature, signal characteristics). A second one of the trackers 60, a second tracker 162, and a third one of the trackers 60, a third tracker 164, may also emit their own unique identification signals. The trackers 60 may be distributed around the curved portion 166 of the head 44 of the body 42, thereby enhancing the trackability of the animated figure 12, such as by enabling the tracking cameras 64 to resolve the head 44 from multiple sides (e.g., top, back) of the animated figure 12.

[0031] Additionally, the tracker 60 may extend a protruding distance 170 from the curved portion 166 of the animated figure 12. It should be noted that because the signal emitted by the tracker 60 can pass through certain materials, the tracker 60 with the protruding distance 170 may be hidden by the costume (e.g., wig, hat, fur) of the animated figure 12 that hides the tracker 60, further contributing to the realism of the animated figure 12. Meanwhile, in the illustrated embodiment, the animated figure 12 includes a wig 171 having a gap 172 (e.g., aperture, opening, round hole) formed over the tracker 60 that further facilitates the transmission of signals from the tracker 60 to the tracking camera 64 described above. That is, the gap 172 may be a relatively small opening formed through the wig 171 that does not interfere with the signal while allowing the remainder of the wig 171 to effectively hide the tracker 60. Also, although three trackers 60 are shown, it should be understood that any suitable number of trackers 60 may be included or hidden within the anime figure 12, such as one, two, five, ten or more trackers 60. Alternatively, the trackers 60 may be flush with or embedded within the exterior surface of the anime figure 12, as described below with reference to FIG.

[0032] In this embodiment, the anime figure 12 also includes a set of actuators 106 for moving the head 44 of the anime figure 12. For example, the actuators 106 may be operatively coupled to a multi-directional support 173, shown as a universal joint 174 (e.g., U-joint, universal coupling device) having a pivot bar assembly 175, to resemble or mirror the movement of a human neck. In particular, the multi-directional support 173 may provide multiple degrees of freedom of movement to the anime figure 12 by allowing the head 44 to move along a head nod axis 178, a head pivot axis 180, and / or a head tilt axis 182 based on selective forces 176 provided by the actuators 106. It should be understood that any suitable support elements or structures having any suitable ranges and directions of movement may be included within the anime figure 12 to be actuated by any suitable actuator 106, either internal or external to the anime figure 12.

[0033] Additionally, the animated figure 12 of this embodiment includes an articulating jaw 184 (e.g., a movable jaw) that can move along a jaw movement axis 186, such as based on movement by a jaw actuator 188 of the actuators 106. The jaw actuator 188 can thus move the articulating jaw 184 along the jaw movement axis 186 based on commands from the figure controller 102 (e.g., via adjustment of a connecting link 190 coupled between the articulating jaw 184 and a pivot crank 192 on the jaw actuator 188) to enable the animated figure 12 to appear to speak (e.g., move its mouth in sync with audio from the audio output device 136), show various facial expressions, and the like. Additionally or alternatively, the animated figure 12 can include an articulated forehead, eyebrows, ears, and / or any other movable features that contribute to the realism of a particular figure or character. It should further be understood that the articulating jaw 184 and / or any other articulated components of the animated figure 12 can be manipulated based on selective forces 176 applied by any suitable single or multiple actuators 106.

[0034] 5 is a side cross-sectional view of another embodiment of the head 44 of the anime figure 12 with a tracker 60 attached to the front 200 of the head 44. The tracker 60 may be a passive element distinguishable by the tracking camera 64. In some embodiments, the passive element is shaped as a rounded cylinder or a light emitting diode, but it should be understood that the passive element may have any other suitable shape, including spherical and rectangular prism shapes, and the like. As shown, a first tracker 202 is disposed on the forehead portion 204 of the anime figure 12, a second tracker 206 is disposed on the nose portion 208 of the anime figure 12, and a third tracker 210 is disposed on the chin portion 212 of the anime figure 12. By including the third tracker 210 on the chin portion 212, the anime figure 12 allows the media control system 20 to efficiently analyze the movement of the articulating jaw 184 relative to the nose portion 208 and / or forehead portion 204. For example, the media control system 20 can monitor the relative distance between the second tracker 206 and the third tracker 210 and determine from this distance the current position of the articulating jaw 184 relative to the nose portion 208. Also, while the animated figure 12 is shown including a wig 171, it should be understood that any suitable costume element can be coupled to the animated figure 12. As discussed above, when the wig 12 or other costume elements are designed to cover the first tracker 202 and / or other trackers 60, the costume elements can form gaps 172 that allow for more efficient resolution of the trackers 60 through the costume elements.

[0035] The anime figure 12 may also include a translucent layer 220 disposed over the body of the anime figure 12, thus providing the anime figure 12 with a desired appearance (e.g., skin) while allowing the tracking camera to resolve the position of the tracker 60 through the translucent layer 220. The translucent layer 220 may be formed of any suitable material that allows for resolution of the tracker 60 through the translucent layer 220, such as materials including cloth, plastic, silicone, rubber, and the like. Thus, in some embodiments, the tracker 60 may be hidden from view of the guest by being disposed below or flush with (e.g., at the same height as) the translucent layer 220. Although FIG. 4 illustrates the tracker 60 as having an active element and FIG. 5 illustrates the tracker 60 as having a passive element, it should be understood that the active and / or passive elements may be attached to any suitable portion of the anime figure 12.

[0036] As discussed above, the media control system 20 operates the projector 16 to provide one or more images 14 or projected content onto the outer surface 40 of the anime figure 12 based on the determined position and orientation of the actual anime figure 12. As a particular example, FIG. 6 is a front perspective view of an image 14 provided on the head 44 of the body 42 of the anime figure 12. Specifically, an exemplary embodiment of the image 14 includes a pattern resembling a particular character's face. For example, eyebrows, eyes, nose, lips, and / or wrinkles may be projected onto the head 44. Additionally, in FIG. 6, the anime figure 12 is wearing a costume element 250, shown as a hat, such that the media controller 112 and / or projector 16 can identify (e.g., via projection masking) a contour 252 of the outer surface 40 of the anime figure 12 formed by the costume element 250. Additionally or alternatively, in other embodiments, the costume element 250 may include a wig, jewelry, scarf, and the like. At this time, projector 16 directs image 14 at a target or figure portion of exterior surface 40 of animated figure 12. As noted above, and as described in more detail below, media control system 20 can monitor the movement of animated figure 12's articulating jaws 184, etc., to project a realistic image onto animated figure 12's head 44 (or facial portion thereof) that corresponds to the particular actual shape of head 44 at any given time.

[0037] 7 is a front perspective view of another embodiment of an image 14 that projector 16 of media control system 20 can provide on exterior surface 40 of animated figure 12. As shown, image 14 provides animated figure 12 with a character, non-human or fantastical appearance, such as the appearance of an owl. In some embodiments, exterior surface 40 of head 44 can be textured to complement image 14. It should also be appreciated that in some embodiments image 14 can include supernatural, fantastical or non-human imagery and / or effects, such as fire, smoke, deformations and color morphing.

[0038] With these features of the responsive media system 8 in mind, further description is provided herein regarding the operation of the components of the responsive media system 8 that entertain guests 34 via the animated figure 12 whose image 14 is adapted in real time. For example, FIG. 8 is a flow diagram illustrating an embodiment of a process 300 in which the motion control system 50 controls the animated figure 12 to respond to interaction data 109 from the interaction data source 70. The steps illustrated in the process 300 are for ease of description and are not intended to limit the scope of the disclosure, as additional steps may be performed, certain steps may be omitted, and the illustrated steps may be performed in a different order or in parallel, where appropriate. The process 300 may represent start code or instructions stored in a non-transitory computer readable medium (e.g., the figure memory 104) and executed by, for example, the figure processor 100 of the figure controller 102 of the motion control system 50. The figure processor 100 may be communicatively coupled to other components of the responsive media system 8 via a network, such as a wired or wireless network, to send and receive instructions and signals as described below.

[0039] In the presently illustrated embodiment, the figure controller 102 executing the process 300 initiates a show or display by receiving (block 304) one or more suitable streams of interaction data 109 from an interaction data source 70, such as instructions from a specialized game engine, a health monitoring system of the motion control system 50, a global or main control system of the entertainment attraction 10, a computer device associated with a technician of the entertainment attraction 10, and / or a sensor signal from a guest sensor 72 indicative of the movement or position of at least one guest 34. Indeed, as discussed above, the interaction data 109 may also include time data, weather data, social media data, stock market data, ride location data, and / or any suitable data stream that may change over time. For example, the figure controller 102 may receive time data from the interaction data source 70 indicating that a particular character performance should be presented. As another example, the figure controller 102 may receive instructions from a specialized game engine indicative of adjustment instructions for the character performance. As a further example, the figure controller 102 may receive a sensor signal from a guest sensor 72 that may transmit a sensor signal continuously or in response to detecting a particular movement or sound from the guest 34. In such an embodiment, the guest sensor 72 can scan the RFID tag worn by each guest 34 and transmit identification information from the RFID tag as a sensor signal to the figure controller 102 .

[0040] Further, the figure controller 102 can determine one or more actions based on the interaction data 109 received from each interaction data source 70 (block 306). That is, the figure controller 102 can receive and respond to multiple different interaction data sources 70 simultaneously, which may or may not include guest input. For example, the figure controller 102 can execute suitable animated figure control actions based on the interaction data 109 received from a game engine, a computing device associated with a technician of the entertainment attraction 10, a status monitoring system of the motion control system 50, and the like. As a particular example, the figure controller 102 can adjust the animated figure 12 from providing a detailed show performance (e.g., including movements above a threshold) to providing a simple show experience (e.g., including movements below a threshold) in response to receiving corresponding interaction data 109 from a computing device associated with the technician. As another example, the figure controller 102 can adjust the character or show performance to interact with the weather change (e.g., recognize the presence of sun, rain, snow) in response to receiving weather data indicating that a weather change is approaching.

[0041] In embodiments receiving guest input, the actions determined by the figure controller 102 may include determining that the guest has performed a particular action (e.g., corresponding to an active input) and / or determining that the guest has a particular set of qualities (e.g., corresponding to a passive input). As examples of particular actions that may be detected as guest input by the guest sensor 72, the figure controller 102 may determine that the guest 34 has moved within a threshold distance of the animated figure 12, waved, spoke, pressed a button, picked up a particular object, aimed a device (e.g., a flashlight, a laser pointer, an imitation weapon) at a target portion of the animated figure 12, etc. As examples of particular sets of qualities that may be sensed as guest input by the guest sensor 72, the figure controller 102 may determine the height of each guest 34, determine the average height of a group of guests 34, retrieve profile information for each guest from a database based on the identification information of the RFID tag, identify a particular guest 34 as wearing clothing of a target color, etc. Indeed, it should be understood that in accordance with the present technology, the figure controller 102 can determine any suitable information regarding the guest 34 and the particular actions of the guest within the guest area 32 that affect the guest 34's interaction with the animated figure 12.

[0042] Additionally, the figure controller 102 can generate an interactive response for the animated figure 12 to perform in response to the action of the entertainment attraction 10 (block 310). That is, the figure controller 102 can react to the current state, action, and location of the entertainment attraction 10 and / or the guests 34 therein in a manner that enhances the guest's immersion within the entertainment attraction 10 by calculating the interactive response to the interaction data 109 in substantially real-time. As an example, the figure controller 102 can receive an input from a particular location within the guest area 32 indicating that one guest 34 has uttered the name of the assigned animated figure 12. The figure controller 102 can then determine that the interactive response is for the animated figure 12 to wave at the guest 34 at the particular location and move the articulating jaws 184 in a manner that corresponds to the animated character saying "Hi to you too," while causing the show control system 130 to output the utterance "Hi to you too" to the audio output device 136 of the entertainment attraction 10.

[0043] Once the interactive response is determined, the figure controller 102 following the process 300 commands the actuators 106 of the animated figure 12 to execute the interactive response (block 312). The media control system 20 simultaneously forms the image 14 on the animated figure 12 in response to the current pose of the animated figure 12 as described below with reference to FIG. 9. It should be understood that the show controller 132 may also simultaneously control any other output devices of the entertainment attraction 10, including the stage lighting device 30 (e.g., lighting fixtures) or other lighting output devices 134, audio output devices 136, and venue specific special effects output devices 138 (e.g., smoke machines, air generators), based on the interaction data source 70 to complement the interactive response of the animated figure 12. As an example, in response to one of the guests 34 pointing a flashlight at the animated figure 12, the show controller 132 may command the stage lighting device 30 to dim the lights while the figure controller 102 commands the actuators 106 to raise the arms of the animated figure 12. As another example, in response to a guest 34 entering a particular region of the guest area 32 (e.g., as sensed by a light curtain, pressure mat, or depth camera of the guest sensor 72), the figure controller 102 may instruct the actuator 106 to move the animated figure 12 closer to the particular region.

[0044] After performing the interactive response, the figure controller 102 can return to block 304 to continue receiving the interaction data 109 such that the motion control system 50 continues to move the animated figure 12 during the operating time of the entertainment attraction 10. However, it should be understood that other embodiments may implement a show cycle that adjusts or stops in response to certain predetermined conditions being met, such as a threshold amount of time having elapsed, a threshold number of interactive responses having been performed, each guest 34 exiting the guest area 32, a new or subsequent ride vehicle entering the guest area 32, etc. Thus, in such cases, the motion control system 50 preserves the movement and wear of the animated figure 12 until the next show cycle is initiated.

[0045] 9 is a flow diagram of an embodiment of a process 350 by which the media control system 20 dynamically maps an image 14 onto an animated figure 12. As described above with respect to the process 300 of FIG. 8, the steps of the process 350 are also not limiting. The process 350 may represent start code or instructions stored in a non-transitory computer readable medium (e.g., the media memory 116) and executed by, for example, the media processor 114 of the media controller 112 of the media control system 20. It should be understood that the media processor 114 may be communicatively coupled to other components of the responsive media system 8 via a network, such as a wired or wireless network, to send and receive instructions and signals as described below.

[0046] To begin process 350 (block 352), the media controller 112 may receive signals (e.g., sensor feedback) from one or more tracking cameras 64 indicative of the current pose (e.g., current position, current orientation, and / or current scale) of the animated figure 12 (block 354). The media controller 112 may receive signals from the tracking cameras 64 through a camera network device 110 that facilitates efficient computations within the media controller 112. As described above, the animated figure 12 includes a tracker 60 concealed on or within the animated figure 12 that allows the tracking camera 64 to identify the current pose of the animated figure 12 without receiving or relying on position, velocity, and / or acceleration information from the actuators 106 of the animated figure 12. Such a configuration, combined with the efficient scanning speed of the tracking cameras 64 and the frame rate of the projector 16, allows the animated figure 12 to closely resemble a live character or person by reacting to the interaction data 109 with a short latency or delay.

[0047] Alternatively, the media controller 112 may be coupled to the actuators 106 or the figure controller 102 to receive position, velocity and / or acceleration information and utilize this information to validate the detected pose of the animated figure 12. In effect, the media controller 112 may obtain lead time for generating projectable images by predicting future movements of the animated figure 12 based on the received position information. The media controller 112 operating predictively may generate multiple sets of images 14, each corresponding to a particular future interactive response of the animated figure 12. Thus, the media controller 112 may select one of a set of previously generated projection content to enable the media control system 20 to instantaneously provide an appropriate image (e.g., a pattern) when a given sequence of movements of the animated figure 12 is realized.

[0048] The media controller 112 executing process 350 updates a skeletal model 360 of the anime figure based on signals from the tracking camera 64 (block 356). The skeletal model 360 may include any suitable data structures and / or statistical models maintained within the media controller 112 that represent the movable or actuatable parts of the anime figure and the current positions and orientations of the actuatable parts. Thus, the media controller 112 may continually update the skeletal model 360 to represent the actual current pose (e.g., position, orientation and scale) of the anime figure 12.

[0049] In some situations where a particular actuatable joint or portion of the animated figure 12 is not actuated, the media controller 112 can update the skeletal model 360 to indicate the non-actuated state of the particular actuatable portion while reacting to the current position of the tracker 60, allowing the images 14 to be adaptively adapted to the partially non-actuated animated figure 12. That is, in such situations, the media controller 112 executing the process 350 can ensure that an appropriate set of images is generated for the non-actuated portion of the animated figure 12 by generating suitable images that correspond to the actual pose of the animated figure 12. In contrast, some projection mapping systems that follow pre-programmed scenes (e.g., via recorded media) project images at the expected location of a given actuated portion of a conventional animated figure, and thus may detract from the guest experience when the given actuated portion is no longer actuated, as the images do not match the conventional animated figure.

[0050] Thus, the media controller 112 generates (block 362) data indicative of an image 14 to be projected onto the animated figure 12 having its current pose based on the skeletal model 360. The image 14 is generated on the fly or in real-time to specifically correspond to the current state or pose of the animated figure 12, as opposed to a predetermined or recorded image. Additionally, the image 14 and / or the data indicative of the current pose of the animated figure 12 may be stored in the media memory 116 for a predetermined period of time.

[0051] The media controller 112 also instructs the projector 16 to provide (e.g., contour mapping) the image 14 on the animated figure 12 having the current pose (block 364). As recognized herein, the media control system 20 performs contour mapping or contour-focus mapping with the skeletal model 360 to lifelike-direct the selectively designed image 14 onto the target figure portion of the animated figure 12. For example, the media controller 112 can generate a contour-mapped pattern set precisely focused on a particular spatial relationship of the animated figure 12 by generating images 14 aligned to a particular position and orientation of the animated figure 12 and instructing the projector 16 to output the images 14. In essence, the media controller 112 provides the instructions of block 364 by sending data representing the image 14 to the projector 16 without a separate instruction signal, which can further limit the latency of the media control system 20. Thus, the components of the media control system 20 cooperate to adaptively analyze the animated figure 12 and dynamically adapt the image 14 to the instantaneous pose of the animated figure 12, which can respond to the interaction data source 70 and / or interact with the guest 34 at any point in time. Thus, the media controller 112 can return to block 354 to continue receiving sensor signals and continue executing process 350.

[0052] Additionally, media control system 20 may monitor the performance and / or health of animated figure 12. For example, it is now recognized that media control system 20 may perform health monitoring of animated figure 12 based on the determined performance of animated figure 12 over a period of time. That is, if a particular set of images is projected onto animated figure 12 at a particular point in time during a show cycle (e.g., a baseline performance assessment), and after a period of time media control system 20 adjusts (e.g., displaces) this set of images for a subsequent show cycle particular point in time by more than a threshold adjustment (e.g., a current performance assessment), media control system 20 may generate an alert indicating a difference between iterations of the show cycle. For example, if head 44 of animated figure 12 is unintentionally modified or degraded such that the left ear of animated figure 12 is no longer present and no longer projected via projector 16, media control system 20 may alert an operator of the degradation. As another example, if a particular portion of the animated figure 12, such as a tilt or rotation of the head 44, was moving during a first show cycle but is not moving during a second show cycle (e.g., corresponding to a modified skeletal model 360), the media control system 20 may output an alert indicating the non-moving portion of the animated figure 12. In these circumstances, the media controller 112 may output an alert indicating a degraded state and / or a sensed change in uncharacteristic behavior. In some cases, the responsive media system 8 may be designed to halt operation of the media control system 20 and / or the motion control system 50 in response to an alert. In other cases, the media controller 112 may provide an alert in response to determining that the performance of the animated figure 12 is only slightly affected (e.g., has a skeletal model deviation above a first threshold and below a second, higher threshold) and continue to cycle through the process 350. It should thus be appreciated that the present media control system 20 may operate as a quality assessment tool to quantify the performance of the motion control system 50 and the animated figure 12 over a period of time.

[0053] Thus, the technical effect of the disclosed responsive media system includes a motion control system having an animated figure that dynamically responds to interaction data, such as input from a game engine, a health monitoring system, background performers, guests, and / or technicians, to provide an engaging and realistic experience for guests of an entertainment attraction. Specifically, the motion control system can include one or more interaction data sources that provide interaction data, such as guest sensors that sense active movements and / or passive qualities of the guest as guest input, and a figure controller that generates an interactive response based on the interaction data. Thus, the figure controller commands actuators in the body of the animated figure to perform the interactive response, such as by manipulating articulating jaws or other movable parts of the body. Additionally, the responsive media system includes a media control system having a tracked camera, a media controller, and a projector. As recognized herein, the animated figure is fitted with trackable markers that enable the media controller to receive sensor feedback from the tracked camera that indicates the current position, orientation, and scale of the movable parts of the animated figure. Thus, the media controller can dynamically generate a set of images without relying on information derived from the actuators of the animated figure, or align these images to the particular positions, orientations and scales of the movable parts of the animated figure. The media controller can then instruct the projector to present an immersive, engaging and lifelike animated figure for improved guest enjoyment with increased uptime and / or reliability by projection mapping the images in real time onto the exterior surfaces of one or more figure parts of the animated figure.

[0054] Although only certain features of the disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is therefore to be understood that the appended claims are intended to cover all such modifications and changes that comply with the true spirit of the disclosure. It is to be understood that any of the features illustrated or described with respect to the above figures may be combined in any suitable manner.

[0055] The technology presented and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that positively improve the art and are therefore not abstract, intangible, or purely theoretical. Moreover, if any claim appended at the end of this specification contains one or more elements designated as "means for [performing] ... [function]" or "step for [performing] ... [function]," such elements are to be construed pursuant to 35 U.S.C. 112(f). On the other hand, for any claim containing an element designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f). [Explanation of symbols]

[0056] 8. Responsive Media Systems 10. Entertainment Attractions 12 Anime Figures 14 images 16 Projector 20 Media Control System 22 Stage Ceiling 24 Stage Floor 26 Landscape Objects 30 Stage Lighting Equipment 32 Guest Area 34 Guests 40. Outer surface of anime figure body 42 Anime figure body 44 Anime figure head 50 Motion Control System 60 Tracker 62 Anime figure back 64 Tracking Camera 66 Operable Motion Devices

Claims

1. 1. A responsive media system for an entertainment attraction, comprising: A motion control system; A media control system; The motion control system comprises: an animated figure having a body and a set of actuators configured to adjust figure portions of the body in response to interaction data received from one or more interaction data sources; a set of trackers coupled to a first surface of the figure portion of the body, each tracker configured to emit a respective sensor signal; the media control system comprising: A tracking camera and a media controller communicatively coupled to the tracking camera; a projector communicatively coupled to the media controller; The tracking camera includes: receiving the respective sensor signals from the set of trackers; determining positions of the set of trackers relative to each other, relative to the tracking camera, or both based on receiving the respective sensor signals; generating a state signal indicative of a current position and a current orientation of the figure part based on the positions of the set of trackers; The media controller is configured as follows: receiving the status signal indicative of the current position and the current orientation of the figure portion; determining the current position and the current orientation of the figure portion based on the state signals; generating data indicative of an image to be projected onto at least a second surface, different from the first surface, of the figure part having the current position and the current orientation, the second surface including an outer surface of the figure part; the projector is configured to receive data indicative of the image from the media controller and to project the image onto the second surface of the figure portion having the current position and the current orientation. A responsive media system comprising:

2. The one or more interaction data sources include a guest sensor configured to generate a guest sensor signal indicative of a guest input as the interaction data, and the motion control system includes a figure controller coupled to the guest sensor and the set of actuators, the figure controller comprising: determining the guest input based on the guest sensor signal from the guest sensor; generating an interactive response of said animated figure to said guest input; instructing the set of actuators to perform the interactive response; The responsive media system of claim 1 configured to:

3. The guest sensor includes at least an optical transducer, a mechanical transducer, an electromechanical transducer, an electromagnetic transducer, an acoustic transducer, a pressure transducer, or a temperature transducer; The responsive media system of claim 2 .

4. a show controller communicatively coupled to the guest sensors and to at least one output device disposed within the entertainment attraction, the show controller configured to control the at least one output device to provide an output coordinated with the interactive response of the animated figure, the at least one output device including an optical output device, an audio output device, or both; The responsive media system of claim 2 .

5. the one or more interaction data sources configured to generate the interaction data as input data that changes over time and is responsive to a current state of the animated figure; The responsive media system of claim 1 .

6. the one or more interaction data sources including a guest sensor configured to detect guest input from a guest of the entertainment attraction as the interaction data, the guest input including a position, movement or action of the guest detectable by the guest sensor; The responsive media system of claim 1 .

7. the media control system is configured to project the image onto the second surface of the figure portion without receiving position, velocity or acceleration information from the set of actuators of the anime figure. The responsive media system of claim 1 .

8. each tracker in the set of trackers is positioned within a surface of the figure portion of the animated figure hidden from view of a guest, and each tracker is configured to emit the respective sensor signal through the surface for receipt by the tracking camera; The responsive media system of claim 1 .

9. the figure portion includes an actuatable portion of the character coupled to a support structure of the character; The responsive media system of claim 1 .

10. the media control system includes a plurality of tracking cameras including the tracking camera, the plurality of tracking cameras being coupled to a camera network device coupled to the media controller; The responsive media system of claim 1 .

11. the figure portion of the animated figure includes a face portion of the body having a movable jaw with at least one degree of freedom, the projector is configured to project at least a portion of the image onto the movable jaw, a portion of the set of actuators is configured to actuate the movable jaw, and the motion control system is configured to command the portion of the set of actuators to actuate the movable jaw in response to the interaction data. The responsive media system of claim 1 .

12. the respective sensor signals emitted by each tracker in the set of trackers include a unique identifier, and the tracking camera is configured to distinguish each tracker in the set of trackers from one another based on the unique identifiers of the respective sensor signals to determine a position of the set of trackers relative to one another, relative to the tracking camera, or both. The responsive media system of claim 1 .

13. the anime figure includes a translucent layer disposed over the body, the set of trackers and the first surface being disposed below the translucent layer; The responsive media system of claim 1 .

14. the media controller is configured to generate data indicative of a further image to be projected onto the second surface. The responsive media system of claim 1 .

15. 1. A responsive media system for an entertainment attraction, comprising: one or more interaction data sources configured to generate time-varying interaction data; A motion control system; The motion control system comprises: an anime figure including a figure portion including a movable joint, the figure being disposed within the entertainment attraction; a set of actuators disposed within the figure portion and configured to actuate the moveable joints; a figure controller communicatively coupled to the set of actuators and to the one or more interaction data sources; said figure controller comprising: determining an interactive response for the animated figure that corresponds to a current state of the animated figure based on the interaction data received from the one or more interaction data sources, the interactive response including actuating the moveable joints; instructing the set of actuators to perform the interactive response; The reactive media system is configured as follows: a set of trackers coupled to the figure portion of the animated figure; A media control system; The media control system further comprises: visually distinguishing each tracker in the set of trackers to obtain a visualization of the set of trackers; determining a respective position of each tracker in the set of trackers based on the visualization of the set of trackers; generating a signal indicative of a current position and a current orientation of the animated figure based on the respective positions of each tracker in the set of trackers. A tracking camera configured as follows: communicatively coupled to the tracking camera; receiving the signal from the tracking camera indicative of the current position and the current orientation of the animated figure; generating content to be projected onto a portion of the animated figure based on the current position and the current orientation of the animated figure and the interactive response; a media controller configured to wherein the media controller is configured to identify non-moving portions of the animated figure based on the determined respective positions of each tracker in the set of trackers, and to adjust the generated content based on the identified non-moving portions. A responsive media system comprising:

16. the media control system includes a projector communicatively coupled to the media controller, the projector configured to receive data indicative of the content from the media controller and to project the content onto the animated figure having the current position and the current orientation; The responsive media system of claim 15.

17. the projector is configured to move in coordination with the current position and the current orientation of the animated figure based on instructions from the media controller.

17. The responsive media system of claim 16.

18. the motion control system comprises an actuatable motion device physically coupled to the animated figure and communicatively coupled to the figure controller, and the interactive response includes commanding the actuatable motion device to move the animated figure in at least one direction relative to a stage or a ground of the entertainment attraction. The responsive media system of claim 15.

19. the actuatable motion device is positioned at least partially below the animated figure; 20. The responsive media system of claim 18.

20. the set of trackers includes a first tracker located on the moveable joint of the figure part and a second tracker located on a different part of the anime figure different from the moveable joint, the tracking camera is configured to determine a first position of the first tracker and a second position of the second tracker, determine a current distance between the first tracker and the second tracker based on the first position relative to the second position, and generate the signal indicative of the current position and the current orientation of the anime figure based on the current distance. The responsive media system of claim 15.

21. the one or more interaction data sources include a guest sensor configured to sense input indicative of an interaction between a guest of the entertainment attraction and the animated figure as the interaction data. The responsive media system of claim 15.

22. each tracker in the set of trackers is hidden within a surface of the figure portion of the animated figure, and the tracking camera is configured to visually distinguish each tracker in the set of trackers through the surface to obtain the visualization of the set of trackers. The responsive media system of claim 15.

23. the media controller is configured to generate the signals indicative of the current position and the current orientation of the animated figure without using position, velocity and / or acceleration information from an actuator of the animated figure. The responsive media system of claim 15.

24. the figure controller is configured to switch from a detailed control instruction set to a simple control instruction set based on the interaction data, the detailed control instruction set including a greater number of movements of the animated figure than the simple control instruction set; The responsive media system of claim 15.

Images