Performance effect system for amusement park

Abstract

An amusement park system includes an animated image having one or more actuators configured to adjust a shape of a surface. The amusement park system also includes a projector configured to project an image onto the surface; and a controller configured to determine a target image, instruct an actuator of the one or more actuators to actuate based on the target image to adjust the shape of the surface, generate an output image based on the target image, and instruct the projector to project the output image onto the surface.

Description

Cross-reference to related applications

[0001] This application claims priority to and the benefit of U.S. Provisional Application Serial No. 63 / 478,725, filed January 6, 2023, entitled “SHOWEFFECT SYSTEM FOR AN AMUSEMENT PARK,” which is hereby incorporated by reference in its entirety for all purposes. Background Art

[0002] This section is intended to introduce the reader to various aspects of the technology that may be related to the various aspects of the technology presented, which are described and / or claimed below. It is believed that this discussion will help provide the reader with background information to promote a better understanding of the various aspects of the present disclosure. Therefore, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0003] Throughout amusement parks and other entertainment venues, special effects can be used to help immerse patrons in the experience of a ride or attraction. The immersive environment can include three-dimensional (3D) props and scenery, robotic or mechanical elements, and / or display surfaces that present media. In addition, the immersive environment can include audio effects, smoke effects, and / or motion effects. Thus, the immersive environment can include a combination of dynamic and static elements. Special effects can enable amusement parks to provide creative ways to entertain patrons, such as by simulating real-world elements in a convincing manner. Summary of the Invention

[0004] Certain embodiments commensurate in scope with the originally claimed subject matter are summarized below. These embodiments are not intended to limit the scope of the claimed subject matter, but rather these embodiments are intended merely to provide a brief overview of possible forms of the subject matter. Indeed, the subject matter may encompass a wide variety of forms that may be similar to or different from the embodiments set forth below.

[0005] In one embodiment, an amusement park system includes an animated character having one or more actuators configured to adjust the shape of a surface. The amusement park system further includes a projector configured to project an image onto the surface; and a controller configured to determine a target image, instruct an actuator of the one or more actuators to actuate based on the target image to adjust the shape of the surface, generate an output image based on the target image, and instruct the projector to project the output image onto the surface.

[0006] In one embodiment, a non-transitory computer-readable medium includes processor input instructions that, when executed by a processor, are configured to cause the processor to: determine a target image, determine a target facial shape of an animated figure based on the target image, instruct adjustment of one or more actuators of the animated figure based on the target facial shape to adjust the shape of a surface of the animated figure, generate image data based on the target image, and transmit the image data to a projector and instruct the projector to project an output image onto the surface of the animated figure based on the image data.

[0007] In one embodiment, an amusement park system includes: an animated figure having one or more actuators; one or more sensors configured to capture a first image of a person; a projector configured to project a second image onto the animated figure; and a controller communicatively coupled to the one or more sensors. The controller is configured to receive sensor data indicative of the first image of the person from the one or more sensors, instruct the one or more actuators of the animated figure to actuate based on the sensor data to adjust the shape of the face of the animated figure, generate the second image based on the first image, and cause the projector to project the second image onto the face of the animated figure to mimic the appearance of the person, the face of the animated figure having the adjusted shape based on the sensor data. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] These and other features, aspects, and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which like reference numerals refer to like parts throughout, and in which:

[0009] Figure 1 is a schematic diagram of an embodiment of an amusement park system according to an aspect of the present disclosure;

[0010] Figure 2 is a perspective view of an embodiment of a performance effects system according to an aspect of the present disclosure, the performance effects system operating to present an animated character having a realistic appearance;

[0011] Figure 3 is a perspective view of an embodiment of a performance effects system according to an aspect of the present disclosure, the performance effects system operating to present an animated character having a realistic appearance;

[0012] Figure 4 is a perspective view of an embodiment of a performance effects system according to an aspect of the present disclosure, the performance effects system operating to present an animated character having a realistic appearance;

[0013] Figure 5is a flowchart of an embodiment of a method for operating a performance effect system to present an animated character with a realistic appearance according to an aspect of the present disclosure;

[0014] Figure 6 is a flowchart of an embodiment of a method for operating an animated character to output an audio effect according to an aspect of the present disclosure; and

[0015] Figure 7 The present invention is a flowchart of an embodiment of a method for operating a performance effect system to present an animated character with a realistic appearance according to an aspect of the present disclosure. DETAILED DESCRIPTION

[0016] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "said" are intended to mean that there are one or more of the recited elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. Additionally, it should be understood that references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

[0017] One or more specific embodiments of the present disclosure are described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation may be described in this specification. It will be appreciated that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Furthermore, it will be appreciated that such development work may be complex and time-consuming, but will be no more than a routine task of design, fabrication, and manufacturing for a person of ordinary skill having the benefit of this disclosure.

[0018] Embodiments of the present disclosure are directed to systems for amusement parks. An amusement park may include various attraction systems, such as rides (e.g., roller coasters, water rides, drop towers), performances, walkways, and the like, which have features that can entertain patrons at the amusement park. An amusement park may also include a show effects system that is configured to operate to present various effects, such as visual effects and / or audio effects, to patrons. For example, the show effects system may be part of an attraction system and may present special effects to patrons within the attraction system, such as within a ride vehicle of the attraction system, at a queue for the attraction system, in an auditorium of the attraction system, and the like. Additionally or alternatively, the show effects system may be external to any attraction system and may present show effects to patrons, for example, in aisles, dining areas, souvenir shops, and the like of the amusement park. The show effects system may provide an immersive environment for patrons to entertain them.

[0019] Special effects provided by the show effects system may include, for example, animated characters (e.g., robots). The animated characters may be movable or stationary. It may be desirable to provide the animated characters with a realistic appearance to enhance the immersive experience provided to patrons. For example, a projector may be operated to project an image onto the animated characters. The image may create a more realistic appearance of the animated characters, thereby presenting the animated characters in a realistic (e.g., lifelike) and convincing manner.

[0020] Therefore, embodiments of the present disclosure are directed to a performance effects system that operates to improve the realistic appearance of an animated character. In some embodiments, a target image representing the desired appearance of the animated character can be determined. The shape of the animated character can be adjusted based on the target image, and an output image can be projected onto the animated character based on the target image. Therefore, the shape of the animated character and the projection onto the animated character can work together to make the appearance of the animated character more closely simulate the target image. For example, the performance effects system can be operated to adjust the appearance of the face of the animated character. Facial actuators can be operated to adjust the facial shape of the face of the animated character. The image can then be projected onto the surface of the face with the adjusted facial shape. Therefore, the appearance of the face with the adjusted facial shape and the projected facial image can closely mimic the target image. By way of example, the target image can be an image of a real-world element, such as a captured image of an object or person (e.g., a customer). Therefore, the appearance of the animated character can be more realistic and lifelike.

[0021] In addition to providing a more realistic appearance for an avatar, adjusting the avatar's shape and the image projected onto it allows the avatar to more realistically simulate different appearances. For example, the avatar's appearance can be adjusted to provide a realistic and convincing imitation of different people with different facial features (e.g., facial shape, facial features, facial structure, facial dimensions). Thus, a single avatar can be manipulated to simulate different appearances. In this way, the cost and / or complexity associated with implementing multiple separate avatars dedicated to providing different visual appearances can be reduced.

[0022] In view of the above, Figure 1 is a schematic diagram of one embodiment of an amusement park system 50. As an example, the amusement park system 50 may be part of an attraction system such as rides (e.g., roller coasters, dark rides), shows, meet and greets, and the like. As another example, the amusement park system 50 may be part of a dining area, a waiting area, a sidewalk, a shopping area (e.g., a gift shop), or any other suitable portion of an amusement park. The amusement park system 50 may include a customer area 52 in which patrons may be located. For example, the customer area 52 may include a ride vehicle 54 that can move and change its position, location, and / or orientation within the amusement park system 50. Additionally or alternatively, the customer area 52 may include a customer path 56 (e.g., a moving path, a fixed path), such as outside of the ride vehicle 54, that patrons use to navigate (e.g., walk on a fixed path, walk on a moving path, or stand) through the amusement park system 50. The customer area 52 may further include an audience area 58 (e.g., an auditorium) that may include seating and / or standing areas where customers may be located. In fact, the customer area 52 may include any suitable features for accommodating customers within the amusement park system 50.

[0023] The amusement park system 50 may also include a show effects system 60 configured to provide entertainment to patrons in the patron area 52. For example, the show effects system 60 may include an animated character 62 having a propeller 64 (e.g., an electric, motorized, electromechanical, pneumatic, or hydraulic propeller) that can be actuated to cause movement or orientation of the animated character 62 (e.g., the entire animated character 62), such as by rotating and / or translating the animated character 62. The animated character 62 may also include an actuator 66 that can be actuated to move different parts (e.g., arms, torso) of the animated character 62 relative to one another. For example, the actuator 66 may be used to adjust the shape of the animated character 62. The animated character 62 may also include an audio output device 68 (e.g., a speaker) configured to provide sound effects and further provide a realistic (e.g., lifelike) presentation of the animated character 62. For example, the sound effects may include spoken words to simulate the speech of the animated character 62.

[0024] The show effects system 60 may also include a projector 70 (e.g., an external projector, an optical projector with a lens) that may be concealed or hidden from patrons in the patron area 52 and to facilitate providing an immersive environment. The projector 70 may project onto a surface 72 of the animated character 62. The surface 72 and the image projected onto the surface 72 via the projector 70 may be visible to patrons in the patron area 52 and may provide an articulated texture (e.g., as formed via the actuator 66) that matches the geometry or contour of the surface 72. In practice, the surface 72 may include a non-planar contour onto which an image may be projected to provide a realistic or authentic appearance to the animated character 62.

[0025] The show effects system 60 may further include or be communicatively coupled to a controller 74 (e.g., an electronic controller, a programmable control, an automated controller, a cloud computing system, a control circuit module) configured to operate to enhance the realistic depiction of the animated character 62. The controller 74 may include a memory 76 and a processor 78 (e.g., a processing circuit module). The memory 76 may include volatile memory such as random access memory (RAM) and / or non-volatile memory such as read-only memory (ROM), an optical drive, a hard drive, a solid-state drive, or any other non-transitory computer-readable medium containing instructions for operating the components of the amusement park system 50. The processor 78 may be configured to execute such instructions. For example, the processor 78 may include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof.

[0026] The controller 74 may, for example, be communicatively coupled to the projector 70 and configured to instruct the projector 70 to control projection mapping onto the animated figure 62. In one embodiment, the controller 74 may transmit image data to the projector 70 and instruct the projector 70 to project an image onto the animated figure 62 using the image data. The image projected onto the animated figure 62 may provide a realistic appearance of the animated figure 62. By way of example, the image data transmitted by the controller 74 may be adapted to the contours of the surface 72 of the animated figure 62 (such as the outline, geometry, shape, contour lines, surface area, volume, etc.) so that the image projected based on the image data provides a realistic appearance of the animated figure 62.

[0027] Additionally, in one embodiment, the controller 74 can be communicatively coupled to the propeller 64 and / or communicatively coupled to the actuator 66. The controller 74 can be configured to instruct the propeller 64 to move the animated figure 62 within the amusement park system 50. The controller 74 can also be configured to instruct the actuator 66 to adjust the shape of the animated figure 62. By way of example, operation of the propeller 64 and / or the actuator 66 via instructions from the controller 74 can adjust the position of the surface 72 relative to the projector 70. In response to the adjusted position of the surface 72 relative to the projector 70, the controller 74 can adjust the image projected by the projector 70 onto the surface 72. In this manner, the controller 74 can synchronize the output of the image with the movement of the animated figure 62 to maintain a desirable (e.g., realistic (e.g., lifelike)) appearance of the animated figure 62.

[0028] The controller 74 can be communicatively coupled to a sensor 80, such as an optical sensor (e.g., a camera, a color sensor), an orientation sensor (e.g., a laser scanner, a light detection and ranging sensor), and can be configured to receive sensor data (e.g., captured imagery, orientation data) from the sensor 80 and to operate based on the sensor data. For example, the sensor 80 can be configured to monitor the position and / or orientation of the animated character 62, such as relative to the projector 70, and transmit sensor data indicating the position and / or orientation to the controller 74. The controller 74 can then instruct the projector 70 to project the image onto the surface 72 in a desired (e.g., realistic, lifelike) manner (e.g., based on the position and / or orientation of the surface 72). In additional or alternative embodiments, the sensor 80 can monitor parameters of the amusement park system 50, such as the time of operation, parameters of patrons in the patron area 52 (e.g., interactions between patrons and the animated character 62), parameters of another prop of the amusement park system 50, another suitable parameter, or any combination thereof. Controller 74 may then instruct thrusters 64 and / or actuators 66 to adjust animated figure 62 and / or instruct projector 70 to adjust the image projected onto surface 72 (based on the sensor data indicative of the parameters).

[0029] In one embodiment, the controller 74 may determine a target appearance for the animated avatar 62. For example, the controller 74 may receive a target image 75, such as a person, an animal, an alien, and the like. As an example, the controller 74 may receive the target image 75 by retrieving the target image 75 (such as a computer-generated character) from a storage device (e.g., memory 76). As another example, the controller 74 may determine the appearance of an object in the surrounding environment (e.g., a customer in the customer area 52) via a sensor 80 (e.g., a camera, such as a high-resolution camera that can determine a three-dimensional image or a z-depth camera), and the controller 74 may determine the target image 75 based on the appearance. As another example, the controller 74 may receive user input indicating the target image 75. The user input may include the selection of the target image 75 from a collection of possible target images 75 and / or from an image created or modified by the user.

[0030] Based on the target appearance, the controller 74 can instruct the pushers 64 and / or actuators 66 to adjust the position, orientation, and / or profile of the animated figure 62. The controller 74 can also generate image data based on the target appearance and transmit the image data to the projector 70 for projection of the output image 77 onto the surface 72. Such operations for moving the animated figure 62 (e.g., adjusting its position, its orientation, and / or its profile) and for projecting the output image 77 onto the animated figure 62 can coordinately adjust the appearance of the animated figure 62 toward the target appearance. Thus, the movement of the animated figure 62 and the projection of the output image 77 onto the animated figure 62 can collectively cause the animated figure 62 to simulate the target appearance, such as to provide a realistic appearance to the customer.

[0031] Controller 74 may additionally or alternatively direct the operation of audio output device 68 to enhance the realism provided by animated character 62. For example, controller 74 may direct the coordination or synchronization of the visual appearance of animated character 62 with the audio effects provided by animated character 62 to more realistically present animated character 62. In one embodiment, sensor 80 may record audio feedback from an audio source (such as the voice of a customer in customer area 52 or an actor hidden from view), and sensor 80 may transmit sensor data indicative of the audio feedback to controller 74. Controller 74 may determine characteristics of the audio feedback and, based on the characteristics, direct audio output device 68 to output an audio effect that simulates the audio source (e.g., a customer or actor). In other words, controller 74 may use the characteristics of the audio feedback provided by the audio source to direct the generation of additional audio effects that may appear to be generated by the audio source. Thus, operation of audio output device 68 may further realistically present animated character 62. Furthermore, audio (e.g., audio input and / or audio output) may be correlated with certain other manipulations related to animated character 62. For example, certain audio may be correlated with certain positions of pusher 64 and / or actuator 66. Similarly, certain audio may be correlated with specific images projected onto surface 72. Such correlations may be identified by an algorithm or lookup table that facilitates realistic correlations between audio and visual aspects. For example, when a human speaks certain words at certain intensities (as indicated by the audio), the human face may assume certain shapes, and those shapes may be mimicked via operation of pusher 64 and / or actuator 66 and emphasized by the images projected onto surface 72. As a specific example, to mimic an animated character 62 coughing, in addition to instructing audio output device 68 to emit a coughing sound, controller 74 may also instruct actuator 66 to extend the mouth portion of animated character 62 and instruct projector 70 to project output image 77 that mimics the opening of the mouth portion.

[0032] Figure 2 is a perspective view of one embodiment of a portion of a performance effects system 60 in which a controller 74 directs operation of an animated character 62 in a first configuration 100. For purposes of visualization of the interior of the animated character 62, certain portions of the animated character 62 (such as an exterior covering or layer) are not shown. In the illustrated embodiment, the animated character 62 includes one or more facial actuators (e.g., Figure 1The facial actuators may be a subset of the actuators 66, such as microactuators. The facial actuators may be internal to the avatar 62, and the face 102 of the avatar 62 may be surrounded by an outer covering of the avatar 62. For example, the outer covering may provide the appearance of the skin of the avatar 62, and the outer covering may be flexible so that positioning and / or actuation of the facial actuators can establish the shape of the outer covering, thereby forming the facial shape (e.g., facial contours, facial geometry, facial structure) of the avatar 62.

[0033] Controller 74 may instruct facial actuators to actuate (e.g., extend, retract, rotate) to thereby adjust the shape or contour of face 102, such as to form a desired facial shape (e.g., based on a target appearance). For example, controller 74 may instruct operation of first facial actuator 104 to adjust the structure of forehead region 106 of avatar 62 (e.g., frontal bone shape), instruct operation of second facial actuator 108 to adjust the structure of eye region 110 of avatar 62 (e.g., orbital bone shape), instruct operation of third facial actuator 112 to adjust the structure of cheek region 114 of avatar 62 (e.g., cheekbone shape), instruct operation of fourth facial actuator 116 to adjust the structure of jaw region 118 of avatar 62 (e.g., mandible shape), instruct operation of fifth facial actuator 120 to adjust the structure of nose region 122 of avatar 62 (e.g., nasal cartilage shape), and / or instruct operation of any other suitable actuators to adjust the structure of face 102 of avatar 62. Although the techniques discussed herein primarily relate to adjusting the appearance of the face 102 of the animated character 62, it should be noted that similar techniques may be used to adjust the appearance of any other portion of the animated character 62, such as another portion of the head of the animated character 62, a portion of the torso, a portion of an appendage, and so forth.

[0034] As an example, the controller 74 may direct the facial actuators 104, 108, 112, 116, 120 to actuate relative to each other to adjust the shape of the face 102. For example, each facial actuator 104, 108, 112, 116, 120 may be dynamically coupled to a base 117 that establishes a foundation for the face 102, and the controller 74 may direct any of the facial actuators 104, 108, 112, 116, 120 to actuate along the base 117 in a direction parallel to a first axis 124 (e.g., a vertical axis), in a direction parallel to a second axis 126 (e.g., a lateral axis), in a direction parallel to a third axis 128 (e.g., a longitudinal axis), or in any combination thereof. By way of example, in a first configuration 100 (which may be associated with Figure 3126 ), the controller 74 may direct any of the facial actuators 104, 108, 112, 116, 120 to actuate in a rotational direction (e.g., about an axis extending parallel to the first axis 124, an axis extending parallel to the second axis 126, and / or an axis extending parallel to the third axis 128) to adjust the shape of the face 102. Indeed, the controller 74 may direct the facial actuators 104 , 108 , 112 , 116 , 120 to actuate in any suitable manner to adjust the face 102 to a desired facial shape.

[0035] Figure 3 is a perspective view of one embodiment of a portion of the performance effects system 60, wherein the controller 74 directs operation of the animated character 62 in the second configuration 150. By way of example, the controller 74 may direct actuation of the facial actuators (e.g., 104, 108, 112, 116, 120) relative to each other to move the animated character 62 from Figure 2 The first configuration 100 transitions to Figure 3120 , the animated character 62 may be in the second configuration 150. For example, the controller 74 may instruct the first facial actuator 104 to actuate upward (e.g., positive) in a direction parallel to the first axis 124, instruct the second facial actuator 108 to actuate away from each other in a direction parallel to the second axis 126, instruct the third facial actuator 112 to actuate downward (e.g., negative) in a direction parallel to the first axis 124 and away from each other in a direction parallel to the second axis 126, and / or instruct the fourth facial actuator 116 to actuate downward in a direction parallel to the first axis 124 and away from each other in a direction parallel to the second axis 126 to transition the animated character 62 to the second configuration 150. Such actuation of the facial actuators 104, 108, 112, 116, 120 may adjust the shape or facial shape of the face 102 of the animated character 62. For example, a portion of the cover extending from one of third facial actuators 112 to another of third facial actuators 112 and / or extending from one of fourth facial actuators 116 to another of fourth facial actuators 116 may expand (as a result of actuation of third facial actuators 112 away from each other in a direction parallel to second axis 126), thereby increasing the size of face 102 extending from third facial actuator 112 and / or at fourth facial actuator 116. As a result, the shape of surface 72 of animated character 62 onto which the image is projected may be adjusted.

[0036] In one embodiment, controller 74 may be configured to instruct facial actuators 104, 108, 112, 116, and 120 to actuate independently of one another. For example, controller 74 may instruct first facial actuator 104 to actuate (e.g., in a direction parallel to first axis 124) and instruct fifth facial actuator 120 to pause actuation or remain in a non-actuated state. For another example, controller 74 may instruct one of first facial actuators 104 to actuate (e.g., in a direction parallel to first axis 124) and instruct another of first facial actuators 104 to pause actuation or remain in a non-actuated state. Thus, the actuation of facial actuators 104, 108, 112, 116, and 120 may be better controlled by controller 74 to more finely (e.g., more meticulously) adjust the facial shape of avatar 62.

[0037] While facial actuators 104, 108, 112, 116, 120 are used in the illustrated embodiment to adjust the facial shape of avatar 62, the use of other components, such as other types of actuators, may be used in additional or alternative embodiments. As an example, facial actuators 104, 108, 112, 116, 120 may be rotated to adjust positioning and change facial shape. As another example, avatar 62 may include air bladders positioned at various areas of face 102, and the size of the air bladders may be adjusted via inflation and / or deflation (e.g., adding and removing fluid from the air bladders) to change the size of different portions of face 102, thereby adjusting the facial shape. Controller 74 may be communicatively coupled to such components and direct their operation to form a desired facial shape for avatar 62.

[0038] Figure 4 is a perspective view of one embodiment of a performance effects system 60. In the illustrated embodiment, the face 102 of the animated character 62 has a facial shape 168 established through the positioning of the facial actuators 104, 108, 112, 116, and 120. For example, the facial shape 168 can include any of a variety of available facial shapes 168, such as an oval, a rectangle, a diamond, a triangle, a heart, a circle, another suitable facial shape, or any facial shape intermediate to the aforementioned facial shapes. The animated character 62 includes an external covering 170 positioned over the facial actuators and the base, thereby hiding the facial actuators from the customer's view to maintain the desired appearance of the animated character 62. The controller 74 can instruct the projector 70 to project images onto the external covering 170. In this manner, the external covering 170 provides a surface 72 onto which an image, such as an image of a human face, is projected. In one embodiment, the controller 74 may determine a target pixel (e.g., color, hue, intensity) for each portion of the face 102, determine the location of the avatar 62 (e.g., the location of the different portions of the face 102 within a coordinate system), and generate image data that, when communicated to the projector, enables the projector 70 to project the target pixel onto each portion of the face 102 based on the location of the avatar 62. Such operations may be adapted to the location of the face 102 as well as the shape of the face 102, enabling the controller 74 to direct the operation of the projector 70 and the alignment of the projected image with the face 102. In practice, the controller 74 may direct the projector 70 to adjust the image projected onto the face 102 based on various movements of the avatar 62 that may move the face 102 within the coordinate system, such as rotational movements, to maintain the desired appearance of the avatar 62 to the customer.

[0039] Figure 5-7Each of the diagrams in the accompanying drawings is a corresponding method or process associated with the operation of the performance effects system described herein. In one embodiment, each of the methods may be performed by a single corresponding component or system, such as by a controller (e.g., a processor). In additional or alternative embodiments, multiple components or systems may perform the operations for a single one of the methods. It should also be noted that additional operations may be performed for the described methods. In addition, certain operations of the depicted methods may be removed, modified, and / or performed in a different order. Still further, the operations of any of the corresponding methods may be performed in parallel with each other, such as at the same time and / or in response to each other.

[0040] Figure 5 2 is a flow chart of one embodiment of a method 200 for operating a performance effects system to present an animated character having a realistic appearance. At block 202, a target image may be determined. In one embodiment, the target image may be retrieved from a storage device, such as selected from a collection of different available images. In additional or alternative embodiments, the target image may be determined based on sensor data, which may include a captured image of an object (e.g., a person). For example, an image (e.g., a still image, a video) of a customer may be captured, and a target image corresponding to the customer's appearance may be determined so as to mimic the customer's appearance.

[0041] At block 204, a target facial shape may be determined based on the target image. The target facial shape may represent the geometric appearance of the face and correspond to the relative positioning and / or dimensions of various facial features (such as facial length, forehead width, cheekbone width, and / or jawline width) relative to one another. In one embodiment, one or more available facial shapes may be present (e.g., a rectangle, a diamond, a heart, an oval), and one of these facial shapes may be selected based on the target image. In additional or alternative embodiments, a specific facial shape may be generated. In either case, facial features of the target image may be identified, and the relative positioning of the facial features may be determined. The target facial shape may then be determined based on the relative positioning of the facial features.

[0042] At block 206, one or more facial actuators of the avatar may be adjusted based on the target facial shape. For example, the facial actuator(s) may be actuated based on the target facial shape (e.g., a target shape associated with the detected audio or audio output). In one embodiment, a corresponding position of each facial actuator may be determined. For example, the corresponding position of the facial actuator(s) may be predefined for a predetermined facial shape, and each facial actuator may be actuated to its specific orientation, which is mapped to the target facial shape. Additionally or alternatively, the avatar may be adjusted based on the target facial shape using another technique. For example, corresponding airbags may be inflated and / or deflated based on the target facial shape. As a result, the facial shape of the avatar may be adjusted toward the target facial shape.

[0043] At block 208, image data may be generated based on the target image. The image data may be generated to provide an image corresponding to the target image, such as that projected onto an animated figure. In one embodiment, the image data may be generated using machine learning techniques, such as a generative adversarial network that may use a competing discriminant network and a generative network. The generative network may create an image using initial image data, and the discriminant network may classify the image created by the generative algorithm as real or fake, such as during a calibration mode or phase. For example, during calibration mode, the generative network may use a first model or algorithm to generate image data to create the image, and the discriminant network may use a second model or algorithm to classify the image created by the generative network as fake or real. In response to the discriminant network correctly classifying an image created by the generative network (e.g., a fake image) as fake, the generative network may adjust the first model and use the adjusted first model to create additional images in an attempt to cause the discriminant network to incorrectly classify the additional image as real. In one embodiment, in response to incorrectly classifying an image created by the generative network as fake, the discriminant network may adjust the second model and attempt to correctly classify the image. The generative network can then create subsequent images and attempt to cause the discriminative network to incorrectly classify the subsequent images using the adjusted second model. Thus, the first model and / or the second model can be continuously adjusted during the calibration mode, and the first model used by the generative network can be improved to create more realistic images. Upon completion of the calibration mode (e.g., after a threshold number of iterations have occurred in which the discriminative network incorrectly classifies an image), a final model can be obtained for generating image data to create the image. The generative network can then use the first model to generate image data based on the target image. As an example, the image data can include facial features positioned relative to each other based on the target image. For example, the relative positioning of facial features of the image data can be proportional to the relative positioning of corresponding facial features of the target image so that the image projected onto the animated character can have an appearance similar to the target image.

[0044] At block 210, the image data may be transmitted to a projector, and the projector may use the image data to render an output image onto an animated character. For example, the image may be projected onto a face having a facial shape established by a facial actuator. In this manner, the facial shape of the animated character and the output image projected onto the animated character may collectively correspond to a target image, so that the animated character has an appearance similar to the target image. As an example, the target image may include an image of a real-world entity, such as a person. Therefore, the animated character, which simulates the target image through the adjusted facial shape and the projected output image, may also have a realistic appearance.

[0045] Method 200 can also be performed to cause an animated character to appear to move. For example, a target image (e.g., a series of images) corresponding to the animated character's movements (e.g., eye movement, mouth movement, cheek movement) can be determined (e.g., generated based on captured images of a real-world entity), and the animated character's facial shape and / or the output image projected onto the animated character can be adjusted based on such target image. That is, an updated target facial shape and / or an updated target image can be determined based on the target image, and the animated character's facial actuators and / or projector can be operated according to the updated target facial shape and / or the updated target image. Such execution of method 200 can enable the animated character to provide the appearance of movement without having to implement additional components, such as separate actuators or linkages, specifically for causing the physical movement of the animated character.

[0046] Figure 6 2 is a flow chart of one embodiment of a method 230 for operating an animated character to provide an audio effect. At block 232, audio data may be received. In one embodiment, the audio data may be received as sensor data from a sensor (such as a microphone) that captures audio feedback and transmits the sensor data with audio data indicative of the audio feedback. For example, the audio data may indicate words spoken by a person, such as a customer or an actor (e.g., a voice actor providing entertainment via the animated character).

[0047] At block 234, audio characteristics of the audio data may be identified. Such audio characteristics may include pitch, timbre, rhythm or speed (e.g., words spoken per time interval), and the like. The audio characteristics may be unique to the audio source providing the audio data and, therefore, may distinguish the received audio data from other audio data (such as audio data indicating audio feedback provided by another audio source).

[0048] At block 236, the audio output device of the avatar can be operated based on the audio characteristics. By way of example, the audio output device can be operated based on the audio characteristics to provide audio effects. For example, words spoken by a person can be detected, and audio effects can be generated based on the detected words to mimic the unique voice of the person speaking other words (e.g., a predetermined dialogue, a newly generated dialogue). Thus, the avatar can appear to have the speaking habits of the person. In this way, in addition to mimicking the visual appearance of the person (e.g., via facial actuators, via output images), the avatar can also be operated to mimic the voice provided by the person, thereby further mimicking the person in a realistic and convincing manner.

[0049] At block 238, the visual appearance of the avatar may be adjusted in coordination with the operation of the audio output device. For example, actuation of facial actuators and / or adjustment of the output image may be associated with a corresponding audio effect (e.g., a specific word) to be provided by the audio output device. For example, the facial actuators and / or output image may be operated to exhibit mouth movement (e.g., opening / closing the mouth), eye movement, cheek movement, etc. during the output of the audio effect. For example, a target image representing the avatar's appearance may be determined and / or updated based on the operation of the audio output device (e.g., an elongated facial shape with an open mouth in the output image may be determined as the target image for simulating a cough). Therefore, in response to determining that an audio effect is to be provided by the audio output device, corresponding actuation of the facial actuators and / or corresponding adjustment of the output image may be implemented. As a result, the avatar may also visually appear to be providing the audio effect, thereby increasing the avatar's realistic appearance.

[0050] Figure 7 2 is a flow chart of a method 260 for operating a performance effects system to render an animated character with a realistic appearance. At block 262, image data is generated based on a target image using the techniques discussed herein. For example, the image data may be generated to correspond to the target image and to accommodate the facial shape of the animated character.

[0051] At block 264, the position and / or orientation of the animated figure may be determined. The position and / or orientation of the animated figure may indicate the position and / or orientation of the surface relative to a projector configured to project an image onto the surface. For example, the position and / or orientation may include the position and / or orientation of the animated figure within a coordinate system (e.g., a virtual coordinate system).

[0052] At block 266, the generated image data is adjusted based on the position and / or orientation of the avatar. By way of example, the image data can be adjusted to accommodate the customer's perspective of the avatar with respect to the position and / or orientation of the avatar. For example, certain virtual elements of the image data (such as facial features) can be angled or moved to correspond to the appearance of the avatar that the customer might see with respect to the position and / or orientation of the avatar. The customer's position and / or orientation can be known based on the location of the designated viewing area, and / or the customer's position and / or orientation can be monitored so that changes in relative position and / or orientation result in manipulation of the avatar and / or updating of the image data.

[0053] At block 268, the adjusted image data may be transmitted to the projector, instructing the projector to render an output image onto the animated figure using the adjusted image data. The output image projected onto the animated figure may be rendered in a more desirable manner based on the customer's perspective on the position and / or orientation of the animated figure. For example, a realistic imitation of the target image via the animated figure may be maintained.

[0054] For example, an animated character may include various facial features that are positioned and / or oriented on its face. As the animated character rotates its face, the output image may be projected onto the animated character to maintain the position and / or orientation of the facial features on the face. In other words, the relative position and / or orientation between the facial features and the face may appear to be relatively fixed, such as to provide the appearance that the facial features of the animated character are rotating with the animated character's face. In fact, portions of the target image may be mapped to corresponding portions of the face to provide the realistic appearance of the animated character. The image data may be adjusted so that the output image can be projected onto the animated character based on the mapping of portions of the target image to corresponding portions of the face. Therefore, as the position and / or orientation of the animated character are adjusted, the desired appearance of the animated character based on the target image can be maintained.

[0055] While only certain features of the disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the disclosure.

[0056] The technology presented and claimed herein is cited and applied to substantial objects and specific examples that arguably improve the practical nature of this art, and therefore is not abstract, intangible, or purely theoretical. Further, if any claim appended to the end of this specification contains one or more elements designated as "means for (performing) ... (function)" or "step for (performing) ... (function)", it is intended that such elements be interpreted under 35 U.S.C. § 112(f). However, for any claim containing elements designated in any other manner, it is intended that such elements not be interpreted under 35 U.S.C. § 112(f).

Claims

1. An amusement park system, comprising: an animated character comprising one or more actuators configured to adjust a shape of a surface; a projector configured to project an image onto the surface; as well as A controller configured to perform operations comprising: Determine the target image; instructing an actuator of the one or more actuators to actuate based on the target image to adjust the shape of the surface; generating an output image based on the target image; and The projector is instructed to project the output image onto the surface.

2. The amusement park system of claim 1 , comprising one or more sensors communicatively coupled to the controller, wherein: The one or more sensors are configured to capture an image of an object and transmit sensor data indicative of the image of the object to the controller, and The controller is configured to determine the target image based on the sensor data.

3. The amusement park system according to claim 1, wherein: The controller is configured to determine the target image by retrieving the target image from a storage device.

4. The amusement park system according to claim 1, wherein: The animated figure includes a base, and the controller is configured to cause adjustment of the extent of actuation of the one or more actuators by instructing the one or more actuators to actuate along the base to adjust the shape of the surface.

5. The amusement park system according to claim 4, wherein: The animated figure includes an outer covering that surrounds and conceals the base and the one or more actuators, wherein the outer covering includes the surface onto which the projector is configured to project the output image.

6. The amusement park system according to claim 1, wherein: The animated character includes an audio output device, and the controller is configured to instruct the audio output device to provide an audio effect.

7. The amusement park system of claim 6, comprising one or more sensors communicatively coupled to the controller, wherein: The one or more sensors are configured to detect audio feedback and transmit sensor data indicative of the audio feedback to the controller, and the controller is configured to perform operations comprising: identifying audio characteristics based on the sensor data; and The audio output device is instructed to provide the audio effect based on the audio characteristic to simulate the audio feedback.

8. The amusement park system according to claim 7, wherein: The controller is configured to actuate a subset of the one or more actuators based on the audio effect provided by the audio output device to adjust the shape of the surface.

9. A non-transitory computer-readable medium comprising processor input instructions, the processor input instructions being configured to cause the processor to perform operations when executed by a processor, the operations comprising: Determine the target image; determining a target facial shape of the animated character based on the target image; instructing adjustment of one or more actuators of the animated character based on the target facial shape to adjust a shape of a surface of the animated character; generating image data based on the target image; as well as The image data is transmitted to a projector, and the projector is instructed to project an output image onto the surface of the animated figure based on the image data.

10. The non-transitory computer readable medium of claim 9, wherein: The processor input instructions, when executed by the processor, are configured to cause the processor to select the target facial shape from one or more facial shapes based on the target image.

11. The non-transitory computer readable medium of claim 10, wherein: Each of the one or more facial shapes is associated with a corresponding corresponding orientation of the one or more actuators, and the processor input instructions, when executed by the processor, are configured to cause the processor to output instructions to adjust at least one of the one or more actuators of the animated character by instructing at least one of the one or more actuators of the animated character to actuate to a corresponding corresponding orientation associated with the target facial shape.

12. The non-transitory computer readable medium of claim 9, wherein: The processor input instructions, when executed by the processor, are configured to cause the processor to determine the target image based on images of an object, the images being captured by one or more sensors.

13. The non-transitory computer readable medium of claim 9, wherein: The processor input instructions, when executed by the processor, are configured to cause the processor to perform operations comprising: receiving audio data indicative of audio feedback captured by one or more sensors; identifying audio characteristics of the audio data; and Based on the audio characteristics, an instruction is output to an audio output device of the animated character to provide an audio effect to simulate the audio feedback.

14. The non-transitory computer readable medium of claim 9, wherein: The processor input instructions, when executed by the processor, are configured to cause the processor to perform operations comprising: determining a position and / or orientation of the animated character; adjusting the image data based on the position and / or orientation of the animated character to provide adjusted image data; and The adjusted image data is transmitted to the projector, and an instruction is output to the projector to adjust the output image projected onto the surface of the animated figure based on the adjusted image data.

15. The non-transitory computer readable medium of claim 14, wherein: The positioning and / or orientation of the animated figure includes the relative positioning and / or orientation between the surface of the animated figure and the projector.

16. The non-transitory computer readable medium of claim 9, wherein: The processor input instructions, when executed by the processor, are configured to cause the processor to instruct the one or more actuators to actuate along the base of the animated figure to adjust the shape of the surface of the animated figure.

17. An amusement park system comprising: an animated character, the animated character comprising one or more actuators; one or more sensors configured to capture a first image of a person; a projector configured to project a second image onto the animated figure; as well as a controller communicatively coupled to the one or more sensors, wherein the controller is configured to perform operations comprising: receiving sensor data indicative of the first image of the person from the one or more sensors; instructing the one or more actuators of the animated character to actuate based on the sensor data to adjust a shape of the face of the animated character; generating the second image based on the first image; and The projector is caused to project the second image onto the face of the animated character to mimic the appearance of the person, the face of the animated character having the shape adjusted based on the sensor data.

18. The amusement park system according to claim 17, wherein: The one or more actuators include one or more initially actuated actuators, and the controller is configured to instruct one or more additional actuators to actuate based on the sensor data to adjust the size of the face extending from the one or more initially actuated actuators to the one or more additional actuators.

19. The amusement park system according to claim 17, wherein: The controller is configured to perform operations comprising: determining a target facial shape based on the sensor data; and Actuation of the one or more actuators is directed based on the target facial shape to adjust the shape of the face.

20. The amusement park system according to claim 17, wherein: The animated character includes an audio output device, and the controller is configured to: operating the audio output device to provide an audio effect; and The one or more actuators are instructed to actuate in coordination with the audio effect.

Images