Smooth server for processing user interactions controlling interactive assets

Abstract

An amusement park spot system 10 includes an interactive asset 16 and a smoothing server 34. The smoothing server stores a model data set 40 associated with an interactive asset 16. The smoothing server 34 is configured to receive an unfiltered data stream 82 representing a user interaction attempting to control the interactive asset 16, and to determine whether the interactive asset 16 is capable of responding to the user interaction based on the unfiltered data stream 82 and the model data set 40. In response to determining that the interactive asset 16 is capable of responding to the user interaction, the smoothing server 34 processes the unfiltered data stream 82 to generate a processed data stream 96 and selects one or more actions performed with the interactive asset 16 in response to the user interaction. The smoothing server 34 sends instructions to the controller 20 to cause the interactive asset 16 to perform the one or more selected actions 94 in accordance with the processed data stream 96.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of U.S. Provisional Application Serial No. 63 / 348,726, filed on June 3, 2022, entitled “SMOOTHING SERVER FOR PROCESSINGUSER INTERACTIONS TO CONTROL AN INTERACTIVE ASSET,” which is incorporated herein by reference in its entirety for all purposes. Background Art

[0002] This section is intended to introduce the reader to various aspects of the technology that may be related to the various aspects of the technology presented, which are described and / or claimed below. It is believed that this discussion is helpful in providing the reader with background information to promote a better understanding of the various aspects of the present disclosure. Therefore, it should be understood that these statements are to be read in this light, and not as an admission of prior art.

[0003] An amusement park or theme park includes various features to provide entertainment to patrons. For example, an amusement park may include different attraction systems (such as roller coasters, motion simulators, drop towers, show performances, interactive video game systems, etc.). In some cases, an attraction system may include one or more interactive assets. As used herein, an "interactive asset" refers to a physical or virtual object that is dynamically controlled based on the interaction of a user (such as a patron or performer). Summary of the invention

[0004] Certain embodiments commensurate in scope with the originally claimed subject matter are summarized below. These embodiments are not intended to limit the scope of the claimed subject matter, but rather, these embodiments are intended only to provide a brief overview of possible forms of the subject matter. Indeed, the subject matter may encompass a wide variety of forms that may be similar or different from the embodiments set forth below.

[0005] In one embodiment, an amusement park attraction system includes: an interactive asset; a controller communicatively coupled to the interactive asset; and a smooth server communicatively coupled to the controller and at least one input device. The smooth server includes a memory configured to store a model data set associated with the interactive asset. The smooth server includes a processor configured to receive an unfiltered data stream representing a user interaction of a user attempting to control the interactive asset from the at least one input device. The processor is configured to determine whether the interactive asset is capable of responding to the user interaction represented in the unfiltered data stream based on the unfiltered data stream and the model data set. In response to determining that the interactive asset is not capable of responding to the user interaction, the processor is configured to send instructions to the controller to cause the interactive asset to implement preprogrammed themed actions. In response to determining that the interactive asset is capable of responding to the user interaction, the processor is configured to process the unfiltered data stream to generate a processed data stream and select one or more actions for the interactive asset to perform in response to the user interaction. The smooth server is also configured to send instructions to the controller to cause the interactive asset to implement the one or more selected actions according to the processed data stream.

[0006] In one embodiment, a method of operating a smooth server of an amusement park attraction system includes: receiving an unfiltered data stream representing a user interaction of a user attempting to control an interactive asset from at least one input device of the amusement park attraction system. The method includes analyzing the unfiltered data stream based on a model data set associated with the interactive asset to determine whether the interactive asset is capable of responding to the user interaction represented in the unfiltered data stream. In response to determining that the interactive asset is capable of responding to the user interaction, the smooth server processes the unfiltered data stream to generate a processed data stream. The smooth server also selects from the model data set one or more actions from a plurality of actions defined in the model data set for the interactive asset, wherein the one or more selected actions are associated with the user interaction represented in the processed data stream. The smooth server also sends instructions to a controller of the interactive asset to cause the interactive asset to implement the one or more selected actions in response to the user interaction in a real-time manner according to the processed data stream.

[0007] In one embodiment, a non-transitory computer-readable medium stores instructions executable by a processor of a smoothing server of an amusement park attraction system. The instructions include instructions for receiving an unfiltered data stream representing a user interaction of a user attempting to control an interactive asset from at least one input device of the amusement park attraction system. The instructions include instructions for determining that the unfiltered data stream includes data that exceeds a limit value defined in a model data set associated with the interactive asset, and in response, replacing the data of the unfiltered data stream with the limit value defined in the model data set. The instructions include instructions for determining that the unfiltered data stream includes irregular data, and in response, introducing additional data to the unfiltered data stream to smooth the irregular data and produce a processed data stream. The instructions include instructions for selecting one or more actions from a plurality of actions defined in the model data set for the interactive asset, wherein the one or more selected actions are associated with the user interaction represented in the processed data stream; and instructions for sending a command to a controller of the interactive asset to cause the interactive asset to implement the one or more selected actions according to the processed data stream. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] These and other features, aspects and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which like characters represent like parts throughout the drawings, and in which:

[0009] Figure 1 is a schematic diagram of an embodiment of an attraction system including a smooth server and interactive assets according to an aspect of the present disclosure;

[0010] Figure 2 is a flow chart of one embodiment of a process according to an aspect of the present disclosure by which a smoothing server provides instructions to a controller of an interactive asset to perform one or more actions based on analysis and / or processing of an unfiltered data stream; and

[0011] Figure 3 is a flow diagram of one embodiment of a process by which a smoothing server processes an unfiltered data stream to generate a processed data stream and selects one or more actions to be performed by an interactive asset according to an aspect of the present disclosure. DETAILED DESCRIPTION

[0012] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements besides the listed elements. Additionally, it should be understood that references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

[0013] One or more specific embodiments of the present disclosure will be described below. In an effort to provide a concise description of these embodiments, all features of an actual implementation may not be described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. In addition, it should be appreciated that such development work may be complex and time consuming, but will be no more than a routine task of design, fabrication, and manufacturing for a person of ordinary skill who benefits from the present disclosure.

[0014] As noted, an amusement park may include an attraction system having one or more interactive assets that are dynamically controlled based on user input. For example, an interactive asset may include a virtual character of an interactive video game system, the parameters of the virtual character (e.g., position, movement, appearance) being determined and modified at least in part based on user interactions received from one or more input devices to control the virtual character. In another example, an interactive asset may include a physical robotic device having parameters (e.g., position, movement, appearance) that are determined and modified at least in part based on user interactions received from one or more input devices to control the robotic device. As another example, an interactive asset may include a physical ride vehicle having one or more input devices (e.g., a mounted steering wheel, accelerator, pedals), wherein the parameters of the ride vehicle (e.g., position, heading, movement) are determined and modified at least in part based on user interactions received from the one or more input devices.

[0015] However, it is currently recognized that in some situations, certain received user interactions may not cause the interactive asset to perform as designed or intended. For example, a user may provide interactions corresponding to movements and / or orientations that exceed the technical limits or capabilities of the interactive asset. In this case, controlling the interactive asset based on such user input may result in damage to the interactive asset. Additionally, certain user interactions may correspond to actions that exceed the desired creative intent of the interactive asset. In this case, controlling the interactive asset in a manner dictated by the user interaction may cause the interactive asset to appear or behave in a manner that is contrary to the theme or "look-and-feel" of the interactive asset. Furthermore, in order for the user experience to be immersive and enjoyable, the interactive asset should respond to the user input in real time with minimal delay between the user providing the interaction and the interactive asset performing the corresponding action.

[0016] In view of the foregoing, the embodiments presented are directed to systems and methods for a smooth server for processing user interactions associated with the control of an interactive asset. The smooth server is generally designed to receive an unfiltered data stream of user interactions from one or more input devices, and is designed to process the unfiltered data stream to select appropriate actions (e.g., effects, movements, changes in orientation) to be performed corresponding to the received interactions. The smooth server then provides instructions to the controller of the interactive asset for performing the selected actions according to the processed data stream. The smooth server ensures that the actions that the interactive asset is instructed to perform comply with the technical and / or operational limitations of the interactive asset and the creative and / or thematic intent of the interactive asset. For situations where the received unfiltered data stream of user input includes irregular data, the smooth server may generate additional data points to enhance the data from the unfiltered data stream so that when the interactive asset performs an action, it is instructed to move in a smooth, continuous manner. In addition, the smooth server is designed to process the unfiltered data stream and provide appropriate instructions to the controller of the interactive asset for controlling the interactive asset in real time, which can achieve a more immersive user experience. As used herein, "real time" refers to the interactive asset responding to user interactions without a delay that is perceptible to the user. For example, in some embodiments, the latency (eg, total response time) may be less than 50 milliseconds (ms), less than 30 ms, less than 25 ms, or between 20 ms and 25 ms.

[0017] Considering the previous content, Figure 11 is a schematic diagram of an embodiment of an attraction system 10 for an amusement park. The attraction system 10 enables users 12 (e.g., patrons, performers) positioned within a participation area 14 to provide user interactions (e.g., user inputs) that result in corresponding actions performed by an interactive asset 16. For the illustrated embodiment, the interactive asset 16 is illustrated as a physical robotic interactive asset, wherein the position, movement, and / or appearance of the interactive asset 16 is dynamically adjusted in real time based on the interactions received from the user 12. In other embodiments, the interactive asset 16 may be another physical interactive asset, such as a ride vehicle, an interactive special effects display (e.g., a wall of lights, a water fountain), or any other suitable dynamically controlled device. In some embodiments, the attraction system 10 may additionally or alternatively include one or more output devices 18, such as displays, indicator lights, special / physical effects devices, speakers, haptic feedback devices, and tactile feedback devices. It may also be appreciated that in some embodiments, the interactive asset 16 may be a virtual interactive asset 16, such as a video game character presented within a virtual environment on at least one of the output devices 18 (e.g., a display or a projector) of the attraction system 10. In some embodiments, one or more of output devices 18 may be controlled in conjunction with interactive assets 16 to provide a more immersive and enjoyable experience for user 12. In some embodiments, one or more of output devices 18 may be positioned in or around engagement zone 14.

[0018] for Figure 1, the attraction system 10 includes at least one controller 20 that is communicatively coupled to the interactive assets 16 and / or output devices 18 via a suitable wired or wireless data connection. In some embodiments, each of the output devices 18 and the interactive asset 16 includes a respective controller, while in other embodiments, at least a portion of the interactive assets 16 and / or the output devices 18 may be controlled by a common controller. For the illustrated embodiment, the controller 20 includes a memory 22 configured to store instructions, and a processing circuit system 24 (also referred to herein as a "processor") configured to execute the stored instructions based on control signals or instructions received by the controller 20 to control the operation of the interactive assets 16 and / or the output devices 18 (as discussed below). The memory 22 may include volatile memory (such as random access memory (RAM)) and / or non-volatile memory (such as read-only memory (ROM), an optical drive, a hard disk drive, a solid-state drive), or any other non-transitory computer-readable medium that includes instructions for operating the attraction system 10 (such as for controlling the movement of the interactive assets 16). Processing circuitry 24 may be configured to execute such instructions. For example, processing circuitry 24 may include one or more application specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), one or more general purpose processors, or any combination thereof.

[0019] for Figure 1 , the attraction system 10 includes a plurality of input devices 26 designed to receive interactions of the users 12. The input devices 26 may include any suitable device capable of receiving or determining information regarding the interactions of the users 12 within the engagement area 14, including, but not limited to, cameras, microphones, accelerometers, weight sensors, buttons, joysticks, game controllers, and joysticks. As used herein, an "interaction" refers to one or more actions or activities (e.g., movements, sounds, facial expressions, button presses, joystick movements) performed by the user 12 with the intent to elicit a response from the attraction system 10. For the illustrated embodiment, the input devices 26 include a collection of sensors 28 positioned about the engagement area 14 of the attraction system 10, and user input devices 30 (e.g., user interface devices) worn by the users 12. These input devices 26 are generally configured to measure or detect events occurring within the engagement area 14 that indicate an interaction of the users 12 with the attraction system 10.

[0020] for Figure 1, sensors 28 may include one or more visible light cameras, one or more infrared (IR) cameras, one or more light detection and ranging (LIDAR) devices, or other suitable ranging and / or imaging devices. In some embodiments, these sensors 28 may be used to determine the orientation or position of user 12, the posture or gesture of user 12, the movement of user 12, the actions of user 12, or other relevant information about the interaction of user 12 within engagement zone 14. In certain embodiments, at least a portion of these sensors 28 may include an integrated controller capable of pre-processing the captured data into a volumetric model or skeletal model of user 12. In some embodiments, sensors 28 may include one or more cameras that measure and collect facial movements and facial expressions of user 12.

[0021] Additionally, for Figure 1 In the embodiment illustrated in FIG. 1 , the input device 26 includes at least one radio frequency (RF) sensor 32 disposed near (e.g., above, below, or adjacent to) the engagement zone 14. The RF sensor 32 is configured to detect an embedded radio frequency identification (RFID) tag, a Bluetooth® tag, or a user input device 30. The RF signal is received by a user input device 26, a Wi-Fi device, or other suitable wireless communication device. During operation, the user input device 30 provides a signal to the RF sensor 32 indicating a parameter (e.g., position, motion, orientation) of the user input device 30, and can also uniquely identify the user 12 and / or the user input device 30. In some embodiments, the user input device 30 can be a wearable user input device (e.g., a bracelet, a headband, glasses, a watch), while in other embodiments, the user input device 30 can be a handheld user input device (e.g., a sword, a torch, a pen, a wand, a scepter, a ball, a smartphone). In some embodiments, multiple input devices 26 (e.g., sensors 28 and user input devices 30) work together to measure or detect interactions of the user 12.

[0022] Additionally, the attraction system 10 includes a smooth server 34 that is communicatively coupled between the input device 26 and the controller 20. The data connections between the input device 26 and the smooth server 34, between the smooth server 34 and the controller 20, and between the controller 20 and the interactive asset 16 and / or the output device 18 can be independently implemented using suitable wired or wireless network connections. The smooth server 34 is generally designed and implemented to receive an unfiltered data stream of input data from the input device 26 representing user interactions, designed and implemented to process the unfiltered data stream to determine appropriate actions for the interactive asset 16 to perform in response to these user interactions, and designed and implemented to provide instructions to the controller 20 for performing the actions (based on the user input). For the illustrated embodiment, the smooth server 34 includes a memory 36 that stores instructions and the unfiltered data stream (when it is received), and includes a processing circuit system 38 (also referred to herein as a "processor") configured to execute the stored instructions during operation. Memory 36 may include volatile memory (such as RAM) and / or non-volatile memory (such as ROM, optical drive, hard drive, solid state drive), or any other non-transitory computer-readable medium including instructions for operating attraction system 10, such as for analyzing and processing unfiltered data streams to select actions to perform with respect to interactive assets 16. Processing circuitry 38 may include one or more ASICs, one or more FPGAs, one or more general purpose processors, or any combination thereof.

[0023] for Figure 1 , the memory 36 of the smoothing server 34 also stores a model data set 40 used by the smoothing server 34 during analysis and processing of the unfiltered data stream received from the input device 26. The model data set 40 may include operating rules 42 that define the technical and / or operational limits of the interactive asset 16. For example, the operating rules may define appropriate ranges for operating parameters (e.g., velocity, acceleration, displacement, orientation, voltage, power, pressure, flow rate, positioning, movement, and / or motion envelopes) associated with the desired operation of various components (e.g., joints, motors, actuators, pistons, appendages) of the interactive asset 16.

[0024] Model data set 40 may also include creative intent rules 44 that define the creative and / or thematic intent of interactive asset 16. That is, operational rules 42 define the operational capabilities and limitations of interactive asset 16, while creative intent rules 44 define the "look and feel" of interactive asset 16 so that the character represented by interactive asset 16 behaves in a manner that is faithful to the expected thematic representation of that character in other media (e.g., movies, video games, comic books). Figure 1, creative intent rules may constrain the movement of the illustrated robotic interactive asset 16 to allow movement of only one portion of the interactive asset 16 (e.g., one arm, one leg, torso) at a time, such that the interactive asset 16 moves in a "robotic" manner that is intended by the user 12 and corresponds to the thematic presentation of the character represented by the interactive asset 16. Creative intent rules may also define actions for the interactive asset 16, and the user interactions that trigger each of those actions. For example, a creative intent rule may define that in response to receiving a series of inputs in an unfiltered data stream indicating that the user 12 has performed a certain interaction (e.g., waving), the interactive asset 16 is to perform one or more response actions (e.g., a waving mirrored with the movement of the user 12, combined with a verbal greeting of "Hello world!").

[0025] for Figure 1 , model data set 40 includes limit values ​​46 that define maximum and minimum values ​​associated with desired operation of various components (e.g., joints, motors, actuators, pistons, appendages) of interactive asset 16 in accordance with both operation rules 42 and creative intent rules 44. That is, in some embodiments, limit values ​​46 of model data set 40 are determined at least in part based on operation rules 42 and creative intent rules 44. For example, in some embodiments, suitable machine learning techniques may be applied to automatically determine (e.g., generate, identify) at least a portion of limit values ​​46 that comply with both operation rules 42 and creative intent rules 44 associated with interactive asset 16. For example, these limit values ​​46 may define what is referred to as an “envelope” of interactive asset 16, which indicates a range of values ​​that define all acceptable movements and / or actions of interactive asset 16.

[0026] Based on the model data set 40, the smooth server 34 analyzes and processes the unfiltered data stream received from the input device 26 to determine one or more actions that the interactive asset 16 should perform in response to the interaction of the user 12 represented in the data stream. During processing, the smooth server 34 may also modify at least a portion of the unfiltered data stream to ensure that the one or more actions will be performed by the interactive asset 16 in accordance with the operation rules 42, creative intent rules 44 and / or limit values ​​46 of the model data set 40. The smooth server 34 then provides instructions to the controller 20 for performing the one or more response actions based on the processed data stream, so that the interactive asset 16 responds to the user's actions in a real-time manner while complying with the operation rules 42, creative intent rules 44 and limit values ​​46 associated with the interactive asset 16.

[0027] Figure 2is a flow chart illustrating one embodiment of a process 60 by which the smooth server 34 provides instructions to the controller 20 of the interactive asset 16 based on analysis and / or processing of the unfiltered data stream in response to the interaction of the user 12. The process 60 may be implemented as computer-readable instructions stored in the memory 36 and executed by the processor 38 of the smooth server 34 during operation. Figure 1 60 is discussed with reference to the elements illustrated in FIG. In other embodiments, according to the present disclosure, process 60 may include additional steps, fewer steps, repeated steps, etc. It can be appreciated that in order for the user experience to be immersive, the smoothing server 34 analyzes and processes the unfiltered data stream and cooperates with the controller 20 to affect the response made by the interactive asset 16 in real time.

[0028] for Figure 2 , process 60 begins with smooth server 34 receiving (block 62) an unfiltered data stream from at least one of input devices 26 representing an interaction by user 12 attempting to control interactive asset 16. Process 60 continues with smooth server 34 determining (block 64) based on an initial analysis of the unfiltered data stream whether interactive asset 16 is able to respond to the interaction by user 12 in compliance with model dataset 40 associated with interactive asset 16. For example, smooth server 34 may compare the unfiltered data stream to one or more of operation rules 42 of operation rules 42 of model dataset 40, one or more of creative intent rules 44 of model dataset 40, and / or one or more of limit values ​​46 of model dataset 40. As discussed below, in some cases, if the unfiltered data stream includes a limited number (e.g., less than a threshold number) of values ​​that exceed the rules and / or limits of model dataset 40, interactive asset 16 may still be able to respond by modifying these values ​​during processing of the data stream. However, in other cases, the data stream may include more than a predetermined threshold amount of values ​​that exceed the rules and / or limits of the model dataset 40, or may include values ​​that exceed the rules or limits of the model dataset 40 by more than a predetermined threshold amount, or may include data indicating actions that are not permitted to be performed within the operating rules 42 and / or creative intent rules 44 of the interactive asset 16, and in response, the smoothing server 34 may determine (in decision box 66) that the interactive asset 16 is unable to respond to the interaction of the user 12.

[0029] for Figure 2, when the smooth server 34 determines (in decision block 66) that the interactive asset 16 is not able to respond to the interaction of the user 12, then the smooth server 34 instructs (block 68) the controller 20 of the interactive asset 16 to implement a preprogrammed themed action (e.g., a preprogrammed action that is thematically appropriate for the interactive asset 16) in response to the interaction of the user 12. That is, rather than merely filtering or ignoring the interactions indicated by the unfiltered data stream, the smooth server 34 may instead instruct the interactive asset 16 to provide a response to the user indicating that the user interaction exceeds what the character represented by the interactive asset 16 can handle, wherein the response is true to the creative and / or thematic intent of the character. For example, in response to determining in blocks 64 and 66 that the user's interaction corresponds to a substantial number of orientations, movements, actions, etc. that exceed a certain velocity or acceleration limit defined in the model data set 40 for the interactive asset 16, in block 68, the smooth server 34 may instruct Figure 1 , the robot interactive asset 16 illustrated in FIG. 1 raises his hand to express annoyance, and provides a topic-appropriate dialogue response (e.g., “Oh my goodness, you humans really like to dance!”). In another example, in response to determining in blocks 64 and 66 that the user's interaction corresponds to inappropriate content (e.g., inappropriate language or gestures) that is contrary to the creative intent rules 44 of the model dataset 40, the smoothing server 34 may instruct Figure 1 Rather than allowing the interactive asset 16 to potentially repeat or mirror inappropriate content, the robotic interactive asset 16 illustrated in FIG. 1 raises his hand to express a warning and provides a topic-appropriate dialog response (e.g., "I can't do that—they'll tear me apart!"). After instructing the controller 20 to perform the preprogrammed topic action, the smoothing server 34 returns to block 62 to receive additional data from the unfiltered data stream.

[0030] for Figure 2 In the embodiment illustrated in FIG. 1 , when the smoothing server 34 determines (in decision block 66) that the interactive asset 16 is responsive to the interaction of the user 12, the smoothing server 34 then processes (block 70) the unfiltered data stream based on the model data set 40 to generate a processed data stream and selects one or more actions responsive to the interaction of the user 12. Figure 3Discuss an example process by which the smooth server 34 may process an unfiltered data stream. Generally speaking, the processed data stream generated by the smooth server 34 includes only data (e.g., parameters for actions) that comply with the operation rules 42, creative intent rules 44, and / or limit values ​​46 defined by the model data set 40 associated with the interactive asset 16. The smooth server 34 then instructs (block 72) the controller 20 to implement a selected response based on the processed data stream. For example, in some embodiments, the smooth server 34 may provide the controller 20 with instructions (e.g., commands, control signals) to perform one or more actions (e.g., move, jump, swing a sword) with respect to the interactive asset 16, and, along with these instructions, provide a processed data stream defining the parameters (e.g., position, start / end points, orientation, route, acceleration, speed) for each of these actions.

[0031] Figure 3 is a flow chart illustrating one embodiment of a process 80 by which the smooth server 34 processes an unfiltered data stream to generate a processed data stream and selects one or more actions to be performed by the interactive asset 16. The process 80 may be implemented as computer-readable instructions stored in the memory 36 and executed by the processor 38 of the smooth server 34 during operation. Figure 1 80 is discussed with reference to the elements illustrated in FIG. In other embodiments, according to the present disclosure, process 80 may include additional steps, fewer steps, repeated steps, etc. As noted above, in order for the user experience to be immersive, smoothing server 34 analyzes and processes the unfiltered data stream and cooperates with controller 20 to affect the response made by interactive asset 16 in real time.

[0032] for Figure 3 In the embodiment illustrated in FIG. 8 , an unfiltered data stream 82 provided by an input device 26 of an attraction system 10 is received by a smoothing server 34. At a decision block 84, the smoothing server 34 compares the data included in the unfiltered data stream with the limit values ​​46 of the model data set 40 to determine whether the data stream includes data that exceeds these limits. When the smoothing server 34 determines that the data stream includes data that exceeds the limit, then the smoothing server 34 replaces (block 86) the corresponding data in the data stream that exceeds the limit value (as defined in the limit values ​​46 of the model data set 40). In this manner, the smoothing server 34 ensures that the resulting processed data stream can only include data values ​​within the envelope defined by the limit values ​​46 of the model data set 40. When the smoothing server 34 determines in the decision block 84 that the data stream does not include data that exceeds the limit, or after the smoothing server 34 replaces the data that exceeds the limit in block 86, the smoothing server 34 can proceed to the next step in the process 80.

[0033] for Figure 3 , at decision block 88, process 80 continues with smoothing server 34 analyzing the data stream to determine whether it includes irregular data. For example, smoothing server 34 may analyze a particular portion of the data stream (such as a collection of data points representing movement of user input device 30 within engagement zone 14 per unit of time) and determine that the data represents movement that is irregular, lacks continuity, or does not define a continuous curve. When smoothing server 34 determines in decision block 88 that the data stream includes such irregular data, then smoothing server 34 may respond by introducing (block 90) additional data points to the data stream to smooth or otherwise modify the irregular data and enhance the continuity and / or smoothness of the data (which results in interactive asset 16 being controlled in a smoother and more realistic manner). When smoothing server 34 determines in decision block 88 that the data stream does not include irregular data, or after smoothing server 34 smoothes the irregular data in block 90, smoothing server 34 proceeds to the next step in process 80.

[0034] for Figure 3 , process 80 continues with smooth server 34 comparing the processed data stream to model data set 40 (block 92) and selecting one or more actions defined in model data set 40 based on the comparison. For example, as explained above, in some embodiments, creative intent rules 44 of model data set 40 may define a plurality of different actions that interactive asset 16 is capable of performing. These creative intent rules 44 may also define restrictions on each of these actions (e.g., which actions may be performed in concert, which actions must be performed individually, which actions may only be performed through a specific user interface device), as well as what user interactions trigger each action. For example, a creative intent rule may define a user interaction in which a user's foot is lifted from the ground by less than 10 centimeters (cm) as triggering a "small hop" action, and a user interaction in which a user's foot is lifted from the ground by more than 10 cm as triggering a different "large jump" action performed by interactive asset 16. By comparing the user interactions indicated by the data stream with the user interactions defined in model data set 40 as triggers for actions for interactive asset 16, smooth server 34 selects one or more appropriate actions 94 to be performed in response to the user interactions. In some embodiments, the smooth server 34 may also process the data stream to isolate parameters for each of the selected actions. For example, the smooth server 34 may indicate within the processed data stream 96 which data corresponds to which selected action, so that the processed data stream 96 informs the controller 20 of the corresponding parameters associated with each of the selected actions 94. In some embodiments, the selected actions 94 may be provided to the controller 20 as part of the processed data stream 96.

[0035] Although only certain features of the disclosed embodiments have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is therefore to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the disclosure.

[0036] The technology presented and claimed herein is cited and applied to specific examples and substantial objects that arguably improve the practical nature of the art, and thus is not abstract, intangible, or purely theoretical. Further, if any claim appended to the end of this specification contains one or more elements designated as "a means for [performing] ... [function]" or "a step for [performing] ... [function]," it is intended that such elements be interpreted in accordance with 35 U.S.C. 112(f). However, for any claim containing elements designated in any other manner, it is intended that such elements not be interpreted in accordance with 35 U.S.C. 112(f).

Claims

1. An amusement park attraction system, comprising: at least one input device; Interactive assets; a controller communicatively coupled to the interactive asset; as well as a smooth server communicatively coupled to the controller, wherein the smooth server comprises: a memory configured to store a model data set associated with the interactive asset; and a processor configured to: receiving, from at least one input device, an unfiltered data stream representing user interactions of a user attempting to control the interactive asset; determining, based on the unfiltered data stream and the model data set, whether the interactive asset is responsive to the user interaction represented in the unfiltered data stream; In response to determining that the interactive asset is unable to respond to the user interaction, sending instructions to the controller to cause the interactive asset to perform a preprogrammed themed action; and In response to determining that the interactive asset is capable of responding to the user interaction, processing the unfiltered data stream to generate a processed data stream and selecting one or more actions for the interactive asset to perform in response to the user interaction, and sending instructions to the controller for causing the interactive asset to implement the one or more selected actions in accordance with the processed data stream.

2. The amusement park attraction system as claimed in claim 1, wherein: The at least one input device comprises: a camera, a light detection and ranging (LIDAR) device, a wearable user input device, or a handheld user input device, or any combination thereof.

3. The amusement park attraction system as claimed in claim 1, wherein: The interactive assets include virtual interactive assets or physical interactive assets presented on at least one output device of the amusement park attraction system.

4. The amusement park attraction system as claimed in claim 1, wherein: The model data set includes a first set of operating rules defining technical or operational limitations of the interactive asset.

5. The amusement park attraction system as claimed in claim 4, wherein: The model data set includes a second set of creative intent rules defining creative or thematic constraints for the interactive asset.

6. The amusement park attraction system as claimed in claim 5, wherein: To determine whether the interactive asset is responsive to the user interaction represented in the unfiltered data stream, the processor is configured to: comparing the unfiltered data stream to the set of operational rules and the set of creative intent rules; as well as The interactive asset is determined to be responsive to the user interaction when the unfiltered data stream complies with the set of creative intent rules and the set of operational rules of the model dataset.

7. The amusement park attraction system of claim 5, wherein: The model data set includes a set of limit values, wherein at least a portion of the set of limit values ​​is generated based on the set of creative intent rules and the set of operational rules for the interactive asset.

8. The amusement park attraction system of claim 7, wherein: To process the unfiltered data stream to generate the processed data stream, the processor is configured to: A determination is made that the unfiltered data stream includes data that exceeds a limit value in the set of limit values ​​of the model data set, and in response, the data of the unfiltered data stream is replaced with the limit value defined in the model data set.

9. The amusement park attraction system of claim 1, wherein: To process the unfiltered data stream to generate the processed data stream, the processor is configured to: It is determined that the unfiltered data stream includes irregular data, and in response, additional data is introduced into the unfiltered data stream to smooth the irregular data.

10. The amusement park attraction system of claim 1, wherein: To process the unfiltered data stream to generate the processed data stream, the processor is configured to: determining that the unfiltered data stream includes data that exceeds a limit value defined in the model data set, and in response, replacing the data of the unfiltered data stream with the limit value defined in the model data set; as well as It is determined that the unfiltered data stream includes irregular data, and in response, additional data is introduced into the unfiltered data stream to smooth the irregular data.

11. The amusement park attraction system of claim 1, wherein: To select the one or more actions, the processor is configured to: The one or more actions from a plurality of actions defined within the model dataset are selected from the model dataset, wherein the one or more selected actions are associated with the user interaction represented within the processed data stream.

12. A method of operating a smooth server of an amusement park attraction system, the method comprising: receiving, from at least one input device of the amusement park attraction system, an unfiltered data stream representing user interactions of a user attempting to control an interactive asset; analyzing the unfiltered data stream based on a model data set associated with the interactive asset and determining that the interactive asset is responsive to the user interaction represented in the unfiltered data stream; as well as In response to determining that the interactive asset is capable of responding to the user interaction: processing the unfiltered data stream to generate a processed data stream representing the user interactions; selecting from the model data set one or more actions from a plurality of actions defined in the model data set for the interactive asset, wherein the one or more selected actions are associated with the user interaction represented in the processed data stream; as well as Instructions are sent to a controller of the interactive asset to cause the interactive asset to perform the one or more selected actions in response to the user interaction in real time based on the processed data stream.

13. The method of claim 12, comprising: receiving, from the at least one input device of the amusement park attraction system, an additional unfiltered data stream representing additional user interactions by the user attempting to control the interactive asset; analyzing the additional unfiltered data stream based on the model data set associated with the interactive asset to determine that the interactive asset is incapable of responding to the additional user interaction; as well as In response to determining that the interactive asset is unable to respond to the additional user interaction, additional instructions are sent to the controller of the interactive asset to cause the interactive asset to perform a preprogrammed themed action.

14. The method of claim 12, wherein: The model data set includes: a set of operating rules defining technical or operational limitations of the interactive asset; a set of creative intent rules defining creative or thematic constraints for the interactive asset; and A set of limit values ​​defining minimum and maximum allowed values ​​for one or more parameters of the interactive asset.

15. The method of claim 14, wherein: Prior to receiving the unfiltered data stream, the method comprises: The set of limit values ​​is determined from the set of operational rules and the set of creative intent rules using machine learning techniques.

16. The method of claim 14, wherein: Processing the unfiltered data stream to generate the processed data stream includes: A determination is made that the unfiltered data stream includes data that exceeds a limit value in the set of limit values ​​of the model data set, and in response, the data of the unfiltered data stream is replaced with the limit value defined in the model data set.

17. The method of claim 12, wherein: Processing the unfiltered data stream to generate the processed data stream includes: It is determined that the unfiltered data stream includes irregular data, and in response, additional data is introduced into the unfiltered data stream to smooth the irregular data.

18. A non-transitory computer readable medium storing instructions executable by a processor of a smooth server of an amusement park attraction system, the instructions comprising instructions to: receiving, from at least one input device of the amusement park attraction system, an unfiltered data stream representing user interactions of a user attempting to control an interactive asset; determining that the unfiltered data stream includes data that exceeds a limit value defined in a model data set associated with the interactive asset, and in response, replacing the data of the unfiltered data stream with the limit value defined in the model data set; determining that the unfiltered data stream includes irregular data, and in response, introducing additional data into the unfiltered data stream to smooth the irregular data and produce a processed data stream representative of the user interactions; selecting one or more actions from a plurality of actions defined in the model data set for the interactive asset, wherein the one or more selected actions are associated with the user interaction represented in the processed data stream; as well as A command is sent to a controller of the interactive asset to cause the interactive asset to perform the one or more selected actions based on the processed data stream.

19. The non-transitory computer readable medium of claim 18, wherein: After receiving the unfiltered data stream, the instructions include instructions for: The unfiltered data stream is analyzed based on the model data set to determine that the interactive asset is responsive to the user interaction represented in the unfiltered data stream based on the model data set associated with the interactive asset.

20. The non-transitory computer readable medium of claim 18, wherein: To select the one or more actions, the instructions include instructions for: identifying the user interaction from the processed data stream; as well as The one or more actions are selected from the plurality of actions defined within the model dataset, wherein the one or more selected actions are associated with identified user interactions within a set of creative intent rules of the model dataset.

Images