Amusement park show effect system
The amusement park system uses actuators and projectors synchronized by controllers to create lifelike animated figures that emulate target images and audio, addressing the challenge of creating immersive environments with reduced complexity and cost.
Patent Information
- Application Number
- JP2025539942
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-29
- Filing Date
- 2024-01-04
- Publication Date
- 2026-01-28
AI Technical Summary
Existing amusement park systems lack the ability to create immersive environments with lifelike animated figures that can realistically mimic different appearances and interactions, leading to increased costs and complexity in implementing multiple separate figures for varied looks.
An amusement park system that includes actuators to adjust the shape of animated figures, projectors to display images, and controllers to synchronize movements and projections, allowing the figures to emulate target images and audio feedback for a realistic appearance and interaction.
The system enhances the realism of animated figures by adjusting their shape and projected images to mimic various appearances and sounds, reducing the need for multiple figures and lowering operational complexity and costs.
Smart Images

Figure 2026503275000001_ABST
Abstract
Description
[Technical Field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Provisional Patent Application Serial No. 63 / 478,725, filed January 6, 2023, entitled "SHOW EFFECT SYSTEM FOR AN AMUSEMENT PARK," which is incorporated herein by reference in its entirety for all purposes. [Background technology]
[0002] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present technology, which are described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
[0003] Amusement parks and other entertainment venues everywhere can use special effects to help immerse guests in the ride or attraction experience. Immersive environments can include three-dimensional (3D) props and sets, robotic or mechanical elements, and / or display surfaces for presenting media. Immersive environments can also include audio effects, smoke effects, and / or motion effects. Thus, immersive environments can include a combination of dynamic and static elements. Special effects can enable amusement parks to offer creative ways to entertain guests, such as by believably simulating real-world elements. Summary of the Invention
[0004]
[0013] The following summarizes certain embodiments commensurate in scope with the originally claimed subject matter. These embodiments are not intended to limit the scope of the claimed subject matter, but rather to provide a brief outline of possible forms of the subject matter. Indeed, the subject matter may include a variety of forms that may be similar to or different from the embodiments set forth below.
[0005] In one embodiment, an amusement park system includes an animated figure having one or more actuators configured to adjust a shape of a surface, the amusement park system further includes a projector configured to project an image onto the surface, and a controller configured to determine a target image, command one of the one or more actuators to operate to adjust the shape of the surface based on the target image, generate an output image based on the target image, and command the projector to project the output image onto the surface.
[0006] In one embodiment, a non-transitory computer-readable medium includes processor input instructions that, when executed by the processor, are configured to cause the processor to determine a target image; determine a target facial shape for the animated figure based on the target image; instruct adjustment of one or more actuators of the animated figure based on the target facial shape to adjust the shape of a surface of the animated figure; generate image data based on the target image; and send the image data to a projector and instruct the projector to project an output image based on the image data onto the surface of the animated figure.
[0007] In one embodiment, an amusement park system includes an animated figure having one or more actuators, one or more sensors configured to capture a first image of the person, a projector configured to project a second image onto the animated figure, and a controller communicatively coupled to the one or more sensors, wherein the controller is configured to receive sensor data from the one or more sensors indicative of the first image of the person, command one or more actuators of the animated figure to operate based on the sensor data to adjust a shape of the animated figure's face, generate a second image based on the first image, and cause the projector to project the second image onto the animated figure's face with the shape adjusted based on the sensor data to mimic the person's appearance.
[0008] These and other features, aspects, and advantages of the present disclosure will be better understood from the following detailed description when read in conjunction with the accompanying drawings, in which like reference characters refer to like elements throughout. [Brief explanation of the drawings]
[0009] [Figure 1] 1 is a schematic diagram of an embodiment of an amusement park system according to aspects of the present disclosure. [Figure 2] 1 is a perspective view of an embodiment of a show effects system operative to present animated figures having a realistic appearance, in accordance with aspects of the present disclosure; FIG. [Figure 3] 1 is a perspective view of an embodiment of a show effects system operative to present animated figures having a realistic appearance, in accordance with aspects of the present disclosure; FIG. [Figure 4] 1 is a perspective view of an embodiment of a show effects system operative to present animated figures having a realistic appearance, in accordance with aspects of the present disclosure; FIG. [Figure 5]1 is a flowchart of an embodiment of a method for operating a show effects system to present realistic-looking animated figures in accordance with aspects of the present disclosure. [Figure 6] 1 is a flowchart of an embodiment of a method for operating an animated figure to output an audio effect, according to aspects of the present disclosure. [Figure 7] 1 is a flowchart of an embodiment of a method for operating a show effects system to present realistic-looking animated figures in accordance with aspects of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0010] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean the presence of one, two, or more of the element. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. Furthermore, references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also contain the recited features.
[0011] One or more specific embodiments of the present disclosure will be described below. In the interest of brevity in describing these embodiments, not all features of an implementation may be described herein. It should be understood that the development of any such implementation, as in any engineering or design project, requires numerous implementation-specific decisions to achieve the developer's particular objectives, including compliance with system- and business-related constraints that may vary from implementation to implementation. Moreover, it should be understood that such a development effort might be complex and time-consuming, but would be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.
[0012] Embodiments of the present disclosure relate to amusement park systems. Amusement parks can include various attraction systems having features that can entertain guests of the amusement park, such as rides (e.g., roller coasters, water rides, drop towers), performance shows, and walkways. The amusement park can also include a show effects system configured to operate to present various effects, such as visual and / or audio effects, to guests. For example, the show effects system can be part of an attraction system and can present special effects to guests within the attraction system, such as in ride cars of the attraction system, in queues for the attraction system, and in audience seats for the attraction system. Additionally or alternatively, the show effects system can be external to any attraction system and can present show effects to guests, such as in walkways, dining areas, and souvenir shops of the amusement park. The show effects system can provide an immersive environment for guests to enjoy.
[0013] The special effects provided by the show effects system may include, for example, an animated figure (e.g., a robot). The animated figure may be movable or stationary. To enhance the immersive experience provided to guests, it may be desirable to give the animated figure a realistic appearance. For example, a projector may be operated to project an image onto the animated figure. The image may create a more lifelike appearance for the animated figure, presenting the animated figure in a realistic (e.g., lifelike) and believable manner.
[0014] Accordingly, embodiments of the present disclosure relate to a show effects system that operates to improve the realistic appearance of an animated figure. In some embodiments, a target image representing a desired appearance of the animated figure can be determined. The shape of the animated figure can be adjusted based on the target image, and an output image can be projected onto the animated figure based on the target image. Thus, the shape of the animated figure and the projection onto the animated figure can cooperate to cause the appearance of the animated figure to more closely emulate the target image. For example, the show effects system can operate to adjust the facial appearance of the animated figure. Facial actuators can be operated to adjust the facial shape of the animated figure. An image can then be projected onto the surface of the face having the adjusted facial shape. As a result, the facial appearance with the adjusted facial shape and the projected facial image can closely mimic the target image. As an example, the target image can be of a real-world element, such as a captured image of an object or person (e.g., a guest). Thus, the appearance of the animated figure can be made more realistic and lifelike.
[0015] In addition to providing a more realistic appearance for the animated figure, adjusting the shape of the animated figure and the image projected onto the animated figure can enable the animated figure to more realistically emulate different looks. For example, the appearance of the animated figure can be adjusted to provide realistic and believable imitation of different people with different facial profiles (e.g., face shape, facial features, facial structure, facial dimensions). Thus, a single animated figure can be operated to emulate different looks. In this manner, the cost and / or complexity associated with implementing multiple separate animated figures dedicated to providing different visual looks can be reduced.
[0016] With this in mind, FIG. 1 is a schematic diagram of an embodiment of an amusement park system 50. As one example, the amusement park system 50 can be part of an attraction system, such as rides (e.g., roller coasters, dark rides), performance shows, and meet and greets. As another example, the amusement park system 50 can be part of a dining area, waiting areas, walkways, shopping (e.g., gift shops), or any other suitable portion of an amusement park. The amusement park system 50 can include a guest area 52 in which guests can be located. For example, the guest area 52 can include ride vehicles 54 that can move and change position, location, and / or orientation within the amusement park system 50. Additionally or alternatively, the guest area 52 can also include a guest path 56 (e.g., a moving path, a stationary path) that guests use to navigate through the amusement park system 50 (e.g., walking on a stationary path, walking on a moving path, or standing on a moving path), such as outside the ride vehicles 54. Guest area 52 may further include a spectator area 58 (e.g., bleachers), which may include seating and / or standing areas where guests may be located. Indeed, guest area 52 may include any suitable features for accommodating guests within amusement park system 50.
[0017] The amusement park system 50 may also include a show effects system 60 configured to provide entertainment to guests in the guest area 52. For example, the show effects system 60 may include an animated figure 62 having movers 64 (e.g., electromechanical, mechanical, electromechanical, pneumatic, hydraulic) operable to move or orient the animated figure 62 (e.g., the entire animated figure 62), e.g., to rotate and / or translate the animated figure 62. The animated figure 62 may also include actuators 66 operable to move different portions (e.g., arms, torso) of the animated figure 62 relative to one another. For example, the actuators 66 may be used to adjust the shape of the animated figure 62. The animated figure 62 may also include an audio output device 68 (e.g., a speaker) configured to provide sound effects and further provide a realistic (e.g., lifelike) presentation of the animated figure 62. For example, the sound effects may include spoken words simulating speaking actions of the animated figure 62.
[0018] The show effects system 60 may also include a projector 70 (e.g., an external projector, an optical projector with a lens) that may be hidden or invisible to guests in the guest area 52 to help provide an immersive environment. The projector 70 may perform projection mapping onto a surface 72 of the animated figure 62. Guests in the guest area 52 may view the surface 72 and an image projected onto the surface 72 via the projector 70, which may provide an attractive texture that matches the geometry or contours of the surface 72 (e.g., formed via the actuators 66). In practice, the surface 72 may include a non-flat profile onto which an image may be projected to provide a lifelike or realistic appearance for the animated figure 62.
[0019] The show effects system 60 may further include, or be communicatively coupled to, a controller 74 (e.g., an electronic controller, a programmable control, an automated controller, a cloud computer system, a control circuit) configured to operate to enhance the realistic depiction of the animated figures 62. The controller 74 may include a memory 76 and a processor 78 (e.g., processing circuitry). The memory 76 may include volatile memory, such as random access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM), an optical drive, a hard disk drive, a solid-state drive, or any other non-transitory computer-readable medium containing instructions (e.g., processor input instructions) to operate the components of the amusement park system 50. The processor 78 may be configured to execute such instructions. For example, the processor 78 may include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof.
[0020] For example, the controller 74 can be communicatively coupled to the projector 70 and configured to instruct the projector 70 to control the projection mapping onto the animated figure 62. In one embodiment, the controller 74 can send image data to the projector 70 and instruct the projector 70 to use the image data to projection map an image onto the animated figure 62. The image projected onto the animated figure 62 can provide a realistic appearance of the animated figure 62. As an example, the image data sent by the controller 74 can correspond to a profile, such as the contour, geometry, shape, outline, surface area, and volume, of the surface 72 of the animated figure 62, such that an image projected based on the image data provides a realistic appearance of the animated figure 62.
[0021] Additionally, in some embodiments, a controller 74 may be communicatively coupled to the movers 64 and / or the actuators 66. The controller 74 may be configured to command the movers 64 to move the animated figures 62 within the amusement park system 50. The controller 74 may also be configured to command the actuators 66 to adjust the shape of the animated figures 62. As an example, operation of the movers 64 and / or the actuators 66 via commands from the controller 74 may adjust the positioning of the surface 72 relative to the projector 70. The controller 74 may adjust the image projected onto the surface 72 by the projector 70 in response to the adjusted positioning of the surface 72 relative to the projector 70. In this manner, the controller 74 may synchronize the output of the image with the movement of the animated figures 62 to maintain a desired (e.g., realistic (e.g., lifelike)) appearance of the animated figures 62.
[0022] The controller 74 may be communicatively coupled to sensors 80, such as optical sensors (e.g., cameras, color sensors), position sensors (e.g., laser scanners, light detection and ranging sensors), etc., and may be configured to receive sensor data (e.g., captured images, position data) from the sensors 80 and act based on the sensor data. For example, the sensors 80 may be configured to monitor the positioning and / or orientation of the animated figures 62, such as relative to the projector 70, and transmit sensor data indicative of the positioning and / or orientation to the controller 74. The controller 74 may then instruct the projector 70 to project images onto the surface 72 in a desired (e.g., realistic, life-like) manner (e.g., based on the positioning and / or orientation of the surface 72). In further or alternative embodiments, the sensors 80 may monitor parameters of the amusement park system 50, such as operation time, parameters of guests in the guest area 52 (e.g., interactions between the guests and the animated figures 62), parameters of other props in the amusement park system 50, other suitable parameters, or any combination thereof. As a result, controller 74 can instruct mover 64 and / or actuator 66 to adjust animated figure 62 and / or projector 70 to adjust the image projected onto surface 72 based on sensor data indicative of the parameters.
[0023] In some embodiments, the controller 74 can determine a target appearance for the animated figure 62. For example, the controller 74 can receive target images 75 such as people, animals, and aliens. As one example, the controller 74 can receive the target image 75 by retrieving the target image 75, such as a computer-generated character, from storage (e.g., memory 76). As another example, the controller 74 can determine the appearance of an object in the surrounding environment (e.g., a guest in the guest area 52) via a sensor 80 (e.g., a camera such as a high-pixel camera or a z-depth camera capable of determining three-dimensional images) and determine the target image 75 based on this appearance. As a further example, the controller 74 can receive user input indicating the target image 75. The user input can include a selection of the target image 75 from a group of possible target images 75 and / or a user-created or modified image.
[0024] The controller 74 can command the movers 64 and / or actuators 66 to adjust the positioning, orientation, and / or profile of the animated figure 62 based on the target appearance. The controller 74 can generate image data based on the target appearance and send the image data to the projector 70 so that an output image 77 can be projected onto the surface 72. The act of moving the animated figure 62 (e.g., adjusting the position, orientation, and / or profile of the animated figure 62) and the act of projecting the output image 77 onto the animated figure 62 can coordinately adjust the appearance of the animated figure 62 toward the target appearance. Thus, the movement of the animated figure 62 and the projection of the output image 77 onto the animated figure 62 can collectively cause the animated figure 62 to emulate the target appearance, providing a realistic appearance to, for example, a guest.
[0025] Additionally or alternatively, the controller 74 may command the operation of the audio output device 68 to enhance the realistic effects provided by the animated figure 62. For example, the controller 74 may command coordination or synchronization between the visual appearance of the animated figure 62 and the audio effects provided by the animated figure 62 to present the animated figure 62 more realistically. In some embodiments, a sensor 80 may record audio feedback from an audio source, such as the voice of a guest in the guest area 52 or an actor hidden from view, and transmit sensor data indicative of the audio feedback to the controller 74. The controller 74 may determine characteristics of the audio feedback and command the audio output device 68 to output audio effects based on the characteristics to emulate the audio source (e.g., the guest or actor). In other words, the controller 74 may command the audio output device 68 to use characteristics of the audio feedback provided by the audio source to generate additional audio effects that appear to be generated by the audio source. Thus, the operation of the audio output device 68 may present the animated figure 62 more realistically. Additionally, the audio (e.g., audio input and / or audio output) may be correlated to some other operation related to the animated figure 62. For example, particular audio may be correlated to particular positions of movers 64 and / or actuators 66. Similarly, particular audio may be correlated to particular images projected onto surface 72. Such correlations may be identified by algorithms or look-up tables that facilitate realistic associations between audio and visual aspects. For example, a human's face may assume particular shapes when certain words are spoken with particular intensity (indicated by audio), and these shapes may be mimicked via movement of movers 64 and / or actuators 66 and accentuated by the images projected onto surface 72.As a specific example, to simulate the animated figure 62 coughing, the controller 74 can instruct the audio output device 68 to emit a coughing sound, as well as instruct the actuator 66 to expand the mouth of the animated figure 62 and instruct the projector 70 to project an output image 77 that simulates the opening of the mouth.
[0026] 2 is a perspective view of an embodiment of a portion of the show effects system 60 in which the controller 74 commands the movement of the animated figure 62 in a first configuration 100. For purposes of visualizing the interior of the animated figure 62, certain portions of the animated figure 62, such as an outer cover or outer layer, are not shown. In the illustrated embodiment, the animated figure 62 includes one or more facial actuators (e.g., a subset of the actuators 66, such as the microactuators of FIG. 1) communicatively coupled to the controller 74. The facial actuators may be internal to the animated figure 62 and may be surrounded by the outer cover of the animated figure 62 at the face 102 of the animated figure 62. For example, the outer cover may provide the appearance of skin for the animated figure 62 and may form the facial shape (e.g., facial profile, facial geometry, facial structure) of the animated figure 62 by establishing the shape of the outer cover to enable positioning and / or actuation of the facial actuators. It can be flexible so as to be
[0027] The controller 74 can command the facial actuators to operate (e.g., stretch, contract, rotate) to adjust the shape or profile of the face 102 to form a desired facial shape or the like (e.g., based on a target appearance). For example, the controller 74 can command the operation of a first facial actuator 104 to adjust the structure of a forehead area 106 of the animated figure 62 (e.g., a frontal bone shape), command the operation of a second facial actuator 108 to adjust the structure of an eye area 110 of the animated figure 62 (e.g., an orbital bone shape), command the operation of a third facial actuator 112 to adjust the structure of a cheek area 114 of the animated figure 62 (e.g., a cheekbone shape), command the operation of a fourth facial actuator 116 to adjust the structure of a cheek area 118 of the animated figure 62 (e.g., a cheekbone shape), command the operation of a fifth facial actuator 120 to adjust the structure of a nose area 122 of the animated figure 62 (e.g., a nose cartilage shape), and / or command the operation of any other suitable actuators to adjust the structure of the face 102 of the animated figure 62. It should be noted that although the techniques described herein primarily refer to adjusting the appearance of the face 102 of the animated figure 62, similar techniques can also be used to adjust the appearance of any other portion of the animated figure 62, such as other portions of the animated figure 62's head, portions of the torso, and portions of the appendages.
[0028] As an example, the controller 74 can command the facial actuators 104, 108, 112, 116, 120 to actuate relative to one another to adjust the shape of the face 102. For example, each facial actuator 104, 108, 112, 116, 120 can be dynamically coupled to a base 117 that establishes a foundation for the face 102, and the controller 74 can command any of the facial actuators 104, 108, 112, 116, 120 to act along the base 117 in a direction parallel to a first axis 124 (e.g., a vertical axis), in a direction parallel to a second axis 126 (e.g., a horizontal axis), in a direction parallel to a third axis 128 (e.g., a longitudinal axis), or any combination thereof. As an example, in the first configuration 100 (which can be compared to the second configuration 150 of FIG. 3 ), the first facial actuator 104 can be positioned at a relatively low position along a direction parallel to the first axis 124, the second facial actuator 108 can be positioned relatively close to each other along a direction parallel to the second axis 126, the third facial actuator 112 can be positioned at a relatively high position along a direction parallel to the first axis 124 and relatively close to each other along a direction parallel to the second axis 126, and / or the fourth facial actuator 116 can be positioned at a relatively high position along a direction parallel to the first axis 124 and relatively close to each other along a direction parallel to the second axis 126. Additionally or alternatively, controller 74 may command any of facial actuators 104, 108, 112, 116, 120 to rotate about an axis extending parallel to first axis 124, an axis extending parallel to second axis 126, and / or an axis extending parallel to third axis 128, etc., to adjust the shape of face 102. In practice, controller 74 may command facial actuators 104, 108, 112, 116, 120 to rotate in any manner suitable for adjusting face 102 to a desired facial shape.
[0029] 3 is a perspective view of an embodiment of a portion of show effects system 60 in which controller 74 commands the movement of animated figure 62 in second configuration 150. As an example, controller 74 can command the actuation of facial actuators (e.g., 104, 108, 112, 116, 120) relative to one another to transition animated figure 62 from first configuration 100 of FIG. 2 to exemplary second configuration 150 of FIG. 3. For example, the controller 74 may command the first facial actuators 104 to actuate upward (e.g., in a positive direction) in a direction parallel to the first axis 124, command the second facial actuators 108 to actuate away from each other in a direction parallel to the second axis 126, command the third facial actuators 112 to actuate downward (e.g., in a negative direction) in a direction parallel to the first axis 124 and away from each other in a direction parallel to the second axis 126, and / or command the fourth facial actuators 116 to actuate downward in a direction parallel to the first axis 124 and away from each other in a direction parallel to the second axis 126, to transition the animated figure 62 to the second configuration 150. Such actuation of the facial actuators 104, 108, 112, 116, 120 may adjust the shape or facial configuration of the face 102 of the animated figure 62. For example, the portion of the outer cover extending from one of the third facial actuators 112 to the other of the third facial actuators 112 and / or the portion of the outer cover extending from one of the fourth facial actuators 116 to the other of the fourth facial actuators 116 may expand as a result of the third facial actuators 112 being actuated away from one another in a direction parallel to the second axis 126, thereby increasing the dimensions of the face 102 extending from the third facial actuators 112 and / or at the fourth facial actuator 116. This may result in adjusting the shape of the surface 72 of the animated figure 62 onto which the image is projected.
[0030] In one embodiment, controller 74 can be configured to command facial actuators 104, 108, 112, 116, 120 to actuate independently of one another. As one example, controller 74 can command first facial actuator 104 to actuate (e.g., in a direction parallel to first axis 124) and command fifth facial actuator 120 to cease actuation or remain deactivated. As another example, controller 74 can command one of first facial actuators 104 to actuate (e.g., in a direction parallel to first axis 124) and command the other actuator of first facial actuator 104 to cease actuation or remain deactivated. Thus, controller 74 can better control the actuation of facial actuators 104, 108, 112, 116, 120 to adjust the facial shape of animated figure 62 more finely (e.g., with more granularity).
[0031] While the illustrated embodiment uses facial actuators 104, 108, 112, 116, and 120 to adjust the facial shape of the animated figure 62, further or alternative embodiments may use other components, such as other types of actuators. As one example, the facial actuators 104, 108, 112, 116, and 120 may rotate to adjust their positioning and thereby change the facial shape. As another example, the animated figure 62 may include bladders positioned in various areas of the face 102, and the facial shape may be adjusted by adjusting the size of the bladders via inflation and / or deflation (e.g., adding fluid into or removing fluid from the bladders) to change the size of different portions of the face 102. The controller 74 may be communicatively coupled to such components to command operation of the components to form a desired facial shape for the animated figure 62.
[0032] FIG. 4 is a perspective view of an embodiment of the show effects system 60. In the illustrated embodiment, the face 102 of the animated figure 62 has a facial shape 168 established through the positioning of facial actuators 104, 108, 112, 116, and 120. For example, the facial shape 168 may include any of a variety of available facial shapes 168, such as an oval, a rectangle, a diamond, a triangle, a heart, a circle, another suitable facial shape, or any facial shape that may be intermediate between these facial shapes. The animated figure 62 includes an external cover 170 positioned over the facial actuators and base to hide the facial actuators from view of guests and maintain a desired appearance of the animated figure 62. A controller 74 can instruct the projector 70 to perform projection mapping onto the external cover 170. In this manner, the external cover 170 can provide a surface 72 onto which an image, such as an image of a human face, is projected. In one embodiment, the controller 74 can determine target pixels (e.g., color, hue, intensity) for each portion of the face 102, determine a positioning of the animated figure 62, such as the location of different portions of the face 102 in a coordinate system, and generate image data that, when communicated with the projector, enables the projector 70 to project the target pixels onto each portion of the face 102 based on the positioning of the animated figure 62. Such operation can accommodate not only the shape of the face 102 but also the position of the face 102, such that the controller 74 can command operation of the projector 70 to align the projected image with the face 102. In practice, the controller 74 can command the projector 70 to adjust the image projected onto the face 102 based on various movements, such as rotational movements of the animated figure 62, which can move the face 102 within the coordinate system to maintain a desired appearance of the animated figure 62 to the guest.
[0033] Each of Figures 5-7 illustrates a respective method or process associated with the operation of the show effects system described herein. In some embodiments, each of these methods may be performed by a single respective component or system, such as a controller (e.g., a processor). In further or alternative embodiments, the operations of one of these methods may be performed by multiple components or systems. Additional operations may also be performed with respect to the methods described. Furthermore, some operations of the illustrated methods may be eliminated, modified, and / or performed in a different order. Furthermore, the operations of any of the respective methods may be performed in parallel with one another, e.g., simultaneously and / or in response to one another.
[0034] 5 is a flowchart of an embodiment of a method 200 of operating a show effects system to present a realistic-looking animated figure. At block 202, a target image may be determined. In some embodiments, the target image may be retrieved from storage, e.g., selected from a group of different available images. In further or alternative embodiments, the target image may be determined based on sensor data, which may include captured images of objects (e.g., people). For example, to mimic the guest's appearance, an image (e.g., still image, video) of the guest may be captured to determine a target image corresponding to the guest's appearance.
[0035] In block 204, a target face shape can be determined based on the target image. The target face shape can represent the geometric appearance of the face and can correspond to the positioning and / or dimensions of different facial features relative to one another, such as the length of the face, the width of the forehead, the width of the cheekbones, and / or the width of the jawline. In one embodiment, there can be one or more available face shapes (e.g., rectangular, diamond, heart, oval), and one of these face shapes can be selected based on the target image. In further or alternative embodiments, a specific face shape can be generated. In either case, facial features in the target image can be identified and the positions of the facial features relative to one another can be determined. The target face shape can then be determined based on the positioning of the facial features relative to one another.
[0036] In block 206, one or more facial actuators of the animated figure may be adjusted based on the target facial shape. For example, the facial actuator(s) may be activated based on the target facial shape (e.g., a target shape associated with detected audio or audio output). In one embodiment, a respective position for each facial actuator may be determined. For example, the respective positions of the facial actuators may be predetermined for a given facial shape, and each facial actuator may be activated at a specific position mapped to the target facial shape. Additionally or alternatively, other techniques may be used to adjust the animated figure based on the target facial shape. For example, respective air bladders may be inflated and / or deflated based on the target facial shape. As a result, the facial shape of the animated figure may be adjusted toward the target facial shape.
[0037] At block 208, image data can be generated based on the target image. The image data can be generated to provide an image corresponding to the target image projected onto the animated figure. In some embodiments, the image data can be generated via machine learning methods such as a generative adversarial network, which can employ competing discriminative and generative networks. The generative network can create images via initial image data, and the discriminative network can classify the images created by the generative algorithm as either real or fake, such as during a calibration mode or calibration phase. For example, during a calibration mode, the generative network can generate image data using a first model or algorithm to create images, and the discriminative network can classify the images created by the generative network as fake or real using a second model or algorithm. The generative network can adjust the first model in response to the discriminative network correctly classifying an image created by the generative network (e.g., a fake image) as fake, and use the adjusted first model to create additional images in an attempt to have the discriminative network misclassify the additional images as real. In some embodiments, the identification network can adjust the second model in response to misclassifying an image created by the generative network as fake and attempt to correctly classify the image. The generative network can then create subsequent images and attempt to have the identification network misclassify the subsequent images using the adjusted second model. Thus, the first model and / or the second model can be continually adjusted during the calibration mode, improving the first model used by the generative network to create more realistic images. After the calibration mode is completed (e.g., after a threshold amount of iterations in which the identification network misclassifies images has occurred), image data can be generated to obtain a final model for creating the image. The generative network can then use the first model to generate image data based on the target image.As an example, the image data may include facial features positioned relative to one another based on the target image, e.g., the relative positioning of the facial features in the image data may be proportional to the relative positioning of corresponding facial features in the target image, such that the image projected onto the animated figure may have a similar appearance to the target image.
[0038] In block 210, image data can be sent to a projector, which can use the image data to present an output image on the animated figure. For example, an image can be projected onto a face having a facial shape established via a facial actuator. In this manner, the facial shape of the animated figure and the output image projected onto the animated figure can collectively correspond to the target image, so that the animated figure has a similar appearance to the target image. As an example, the target image can include an image of a real-world entity, such as a person. Thus, an animated figure emulating the target image through an adjusted facial shape and projected output image can also have a realistic appearance.
[0039] Method 200 can also be performed to make an animated figure appear to be moving. For example, a target image (e.g., a series of images) corresponding to the animated figure's movements, such as eye movements, mouth movements, or cheek movements, can be determined (e.g., generated based on captured images of a real-world entity), and the facial shape of the animated figure and / or the output image projected onto the animated figure can be adjusted based on such target image. That is, an updated target facial shape and / or an updated target image can be determined based on the target image, and facial actuators of the animated figure and / or projector can be operated according to the updated target facial shape and / or updated target image. Such execution of method 200 can enable the animated figure to provide the appearance of movement without having to implement additional components, such as separate actuators or linkages, dedicated to causing the animated figure's physical movement.
[0040] 6 is a flowchart of an embodiment of a method 230 for operating an animated figure to provide audio effects. At block 232, audio data can be received. In some embodiments, the audio data can be received as sensor data from a sensor, such as a microphone, that can capture audio feedback and transmit sensor data having audio data indicative of the audio feedback. For example, the audio data can represent words spoken by a character, such as a guest or actor (e.g., a voice actor providing entertainment via the animated figure).
[0041] At block 234, audio characteristics of the audio data may be identified. Such audio characteristics may include tone, pitch, timbre, cadence, or pace (e.g., words spoken per time interval), etc. The audio characteristics may be specific to the audio source providing the audio data, thereby enabling the received audio data to be distinguished from other audio data, such as audio data indicative of audio feedback provided by other audio sources.
[0042] At block 236, an audio output device of the animated figure can be operated based on the audio characteristics. As an example, the audio output device can be operated to provide audio effects according to the audio characteristics. For example, words spoken by a character can be detected, and based on the detected words, audio effects can be generated that mimic the character's unique voice speaking other words (e.g., predetermined lines, newly generated lines). Thus, the animated figure can appear to speak in the manner of the character. In this way, in addition to mimicking the visual appearance of the character (e.g., via facial actuators, via output images), the animated figure can be operated to mimic sounds provided by the character, thereby further mimicking the character in a realistic and believable manner.
[0043] In block 238, the visual appearance of the animated figure can be adjusted in coordination with the operation of the audio output device. As an example, the actuation of facial actuators and / or the adjustment of the output image can be associated with each corresponding audio effect (e.g., a particular word) to be provided by the audio output device. For example, during the output of the audio effect, the facial actuators and / or the output image can be actuated to present mouth movements (e.g., opening and closing the mouth), eye movements, cheek movements, etc. As an example, a target image representing the appearance of the animated figure can be determined and / or updated based on the actuation of the audio output device (e.g., an elongated facial shape with an output image of an open mouth can be determined as a target image to mimic a cough). Thus, in response to determining that the audio output device should provide an audio effect, corresponding actuation of the facial actuators and / or corresponding adjustment of the output image can be performed. Thus, the animated figure's realistic appearance can be enhanced by visually appearing to provide the audio effect.
[0044] 7 is a flowchart of a method 260 of operating a show effects system to present a realistic-looking animated figure. At block 262, image data is generated based on a target image using the techniques described herein. For example, the image data can be generated to correspond to the target image and to match the facial shape of the animated figure.
[0045] At block 264, a position and / or orientation of the animated figure can be determined. The position and / or orientation of the animated figure can indicate a position and / or orientation of a surface relative to a projector configured to project an image onto the surface. For example, the position and / or orientation can include a position and / or orientation of the animated figure within a coordinate system (e.g., a virtual coordinate system).
[0046] At block 266, the generated image data is adjusted based on the positioning and / or orientation of the animated figure. As one example, the image data may be adjusted to correspond to the guest's perspective of the animated figure at the positioning and / or orientation of the animated figure. For example, certain virtual elements of the image data, such as facial features, may be tilted or moved to correspond to the appearance of the animated figure as seen by the guest at the positioning and / or orientation of the animated figure. The guest's position and / or orientation may be known based on the location of a designated observation area, and / or the guest's position and / or orientation may be monitored so that the image data and / or the animated figure's movement are updated as the relative positioning and / or orientation changes.
[0047] In block 268, the adjusted image data can be sent to a projector and the projector can be instructed to present an output image on the animated figure using the adjusted image data. The output image projected on the animated figure can be presented in a more desirable manner based on the guest's viewpoint at the positioning and / or orientation of the animated figure. For example, a realistic imitation of the target image through the animated figure can be maintained.
[0048] For example, an animated figure may include various facial features positioned and / or oriented on its face. An output image may be projected onto the animated figure to maintain the position and / or orientation of the facial features on its face when the animated figure changes facial orientation. In other words, the relative positioning and / or orientation between the facial features and the face may appear relatively constant to provide the appearance that the facial features of the animated figure are changing orientation with the animated figure's face. In practice, to provide a realistic appearance for the animated figure, portions of the target image may be mapped to corresponding facial portions. Image data may be adjusted to allow the output image to be projected onto the animated figure based on the mapping of portions of the target image to corresponding facial portions. Thus, a desired appearance for the animated figure based on the target image may be maintained when the position and / or orientation of the animated figure is adjusted.
[0049] While only certain features of the present disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the present disclosure.
[0050] The technology shown and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that will materially improve the art, and thus are not abstract, intangible, or purely theoretical. Furthermore, if any claim appended at the end of this specification contains one or more elements designated as "means for (performing) ... (function)" or "step for (performing) ... (function)," such elements are to be construed pursuant to 35 U.S.C. 112(f). Conversely, for any claim containing elements designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f). [Explanation of symbols]
[0051] 50 Amusement Park System 52 Guest Area 54 Vehicles 56 Guest Routes 58 Spectator Area 60 Show Effects System 62 Animated Figures 64 Mova 66 Actuator 68 Audio Output 70 Projector 72 Surface 74 Control System 75 Target Image 76 memory 77 Output image 78 processors 80 sensors
Claims
1. 1. An amusement park system, comprising: an animated figure including one or more actuators configured to adjust the shape of a surface; a projector configured to project an image onto the surface; A controller; wherein the controller determining a target image; commanding an actuator of the one or more actuators to operate to adjust the shape of the surface based on the target image; generating an output image based on the target image; instructing the projector to project the output image onto the surface; an amusement park system configured to perform operations including:
2. one or more sensors communicatively coupled to the controller; the one or more sensors are configured to capture an image of an object and transmit sensor data indicative of the image of the object to the controller; The amusement park system of claim 1 , wherein the controller is configured to determine the target image based on the sensor data.
3. The amusement park system of claim 1 , wherein the controller is configured to determine the target image by retrieving the target image from storage.
4. 2. The amusement park system of claim 1, wherein the animation figure includes a base, and the controller is configured to adjust the range of operation of the one or more actuators by commanding the one or more actuators to operate along the base to adjust the shape of the surface.
5. 5. The amusement park system of claim 4, wherein the animation figure includes an exterior cover that encases and conceals the base and the one or more actuators, the exterior cover including the surface onto which the projector is configured to project the output image.
6. The amusement park system of claim 1 , wherein the animated figure includes an audio output device, and the controller is configured to command the audio output device to provide an audio effect.
7. one or more sensors communicatively coupled to the controller, the one or more sensors configured to detect the audio feedback and transmit sensor data indicative of the audio feedback to the controller, the controller comprising: identifying an audio characteristic based on the sensor data; instructing the audio output device to provide the audio effect based on the audio characteristics to simulate the audio feedback; The amusement park system of claim 6 configured to perform operations including:
8. 8. The amusement park system of claim 7, wherein the controller is configured to actuate a subset of the one or more actuators to adjust the shape of the surface based on the audio effect provided by the audio output device.
9. A non-transitory computer-readable medium containing processor input instructions that, when executed by a processor, determining a target image; determining a target facial shape for an animated figure based on the target image; commanding adjustment of one or more actuators of the animated figure based on the target facial shape to adjust the shape of the surface of the animated figure; generating image data based on the target image; transmitting the image data to a projector and instructing the projector to project an output image based on the image data onto the surface of the animated figure; 10. A non-transitory computer-readable medium configured to cause the processor to perform operations including:
10. 10. The non-transitory computer-readable medium of claim 9, wherein the processor input instructions, when executed by the processor, are configured to cause the processor to select the target facial shape from one or more facial shapes based on the target image.
11. 11. The non-transitory computer-readable medium of claim 10, wherein each facial shape of the one or more facial shapes is associated with a respective corresponding position of the one or more actuators, and the processor input instructions, when executed by the processor, are configured to cause the processor to output instructions to adjust the at least one actuator of the one or more actuators of the animated figure by commanding at least one actuator of the one or more actuators to actuate a respective corresponding position associated with the target facial shape.
12. 10. The non-transitory computer-readable medium of claim 9, wherein the processor input instructions, when executed by the processor, are configured to cause the processor to determine the target image based on images of an object captured by one or more sensors.
13. The processor input instructions, when executed by the processor, receiving audio data indicative of audio feedback captured by one or more sensors; identifying an audio characteristic of the audio data; outputting instructions to an audio output device of the animated figure to provide an audio effect based on the audio characteristics to simulate the audio feedback; 10. The non-transitory computer-readable medium of claim 9 configured to cause the processor to perform operations including:
14. The processor input instructions, when executed by the processor, determining a position and / or orientation of said animated figure; adjusting the image data based on the positioning and / or orientation of the animated figure to provide adjusted image data; transmitting the adjusted image data to the projector and outputting instructions to the projector to adjust the output image projected onto the surface of the animated figure based on the adjusted image data; 10. The non-transitory computer-readable medium of claim 9 configured to cause the processor to perform operations including:
15. The non-transitory computer-readable medium of claim 14 , wherein the positioning and / or orientation of the animated figure includes a relative positioning and / or orientation between the surface of the animated figure and the projector.
16. 10. The non-transitory computer-readable medium of claim 9, wherein the processor input instructions, when executed by the processor, are configured to cause the processor to command the one or more actuators to act along a base of the animated figure to adjust a shape of the surface of the animated figure.
17. 1. An amusement park system, comprising: an animated figure including one or more actuators; one or more sensors configured to capture a first image of the person; a projector configured to project a second image onto the animated figure; a controller communicatively coupled to the one or more sensors; wherein the controller receiving sensor data from the one or more sensors indicative of the first image of the person; commanding the one or more actuators of the animated figure to operate based on the sensor data to adjust the shape of the animated figure's face; generating the second image based on the first image; causing the projector to project the second image onto the face of the animated figure with a shape adjusted based on the sensor data to mimic the appearance of the person; an amusement park system configured to perform operations including:
18. 18. The amusement park system of claim 17, wherein the one or more actuators include one or more initially actuated actuators, and the controller is configured to command the one or more further actuators to actuate based on the sensor data to adjust dimensions of the face extending from the one or more initially actuated actuators to one or more further actuators.
19. The controller determining a target face shape based on the sensor data; commanding the one or more actuators to operate to adjust the facial shape based on the target facial shape; 20. The amusement park system of claim 17 configured to perform operations including:
20. The animated figure includes an audio output device, and the controller includes: activating the audio output device to provide an audio effect; commanding the one or more actuators to operate in coordination with the audio effect; 18. The amusement park system according to claim 17, configured as follows: