Smoothing server that processes user interactions to control interactive assets

Abstract

An amusement park attraction system 10 includes an interactive asset 16 and a smoothing server 34. The smoothing server stores a model data set 40 associated with the interactive asset 16. The smoothing server 34 is configured to receive an unfiltered data stream 82 representative of a user's interaction attempting to control the interactive asset 16 and determine whether the interactive asset 16 can respond to the user's interaction based on the unfiltered data stream 82 and the model data set 40. In response to determining that the interactive asset 16 can respond to the user interaction, the smoothing server 34 processes the unfiltered data stream 82 to generate a processed data stream 96 and selects one or more actions 94 that the interactive asset 16 should perform in response to the user interaction. The smoothing server 34 sends a command to the controller 20 to cause the interactive asset 16 to perform one or more selected actions 94 according to the processed data stream 96.

Description

Technical Field

[0001] 〔Cross - Reference to Related Applications〕 This application claims the benefit of U.S. Provisional Patent Application Serial No. 63 / 348,726, filed on June 3, 2022, entitled "SMOOTHING SERVER FOR PROCESSING USER INTERACTIONS TO CONTROL AN INTERACTIVE ASSET", which is hereby incorporated by reference in its entirety for all purposes.

Background Art

[0002] This section is for introducing to the reader various aspects of technologies that may be related to the various aspects of the technology described and / or claimed below. This discussion is thought to be helpful in showing the reader the background circumstances and facilitating a better understanding of the various aspects of the present disclosure. Accordingly, these descriptions should be understood to be read from the above perspective rather than as an admission of prior art.

[0003] Amusement parks or theme parks include various features that provide entertainment to guests. For example, an amusement park can include different attraction systems such as roller coasters, motion simulators, drop towers, performance shows, and interactive video game systems. In some cases, an attraction system can include one or more interactive assets. As used herein, "interactive assets" means physical or virtual objects that are dynamically controlled based on user interactions such as guests or performers.

Summary of the Invention

[0004] The following summarizes some embodiments that are within the same scope as the original claimed subject matter. These embodiments are not intended to limit the scope of the claimed subject matter, but rather are merely intended to provide an overview of possible forms of the subject matter. Indeed, the subject matter may include various forms that may be similar to or different from the embodiments shown below.

[0005] In one embodiment, an amusement park attraction system includes an interactive asset, a controller communicatively coupled to the interactive asset, and a smoothing server communicatively coupled to the controller and at least one input device. The smoothing server includes a memory configured to store a model data set associated with the interactive asset. The smoothing server includes a processor configured to receive from the at least one input device an unfiltered data stream representing user interactions of a user attempting to control the interactive asset. The processor is configured to determine, based on the unfiltered data stream and the model data set, whether the interactive asset can respond to the user interactions represented in the unfiltered data stream. In response to determining that the interactive asset cannot respond to the user interactions, the processor is configured to send to the controller an instruction to cause a pre-programmed theme action to occur on the interactive asset. In response to determining that the interactive asset can respond to the user interactions, the processor is configured to process the unfiltered data stream to generate a processed data stream and select one or more actions for the interactive asset to perform in response to the user interactions. The smoothing server is further configured to send to the controller an instruction to cause the interactive asset to perform the one or more selected actions according to the processed data stream.

[0006] In one embodiment, a method of operating a smoothing server of an amusement park attraction system includes receiving an unfiltered data stream representing user interactions of a user attempting to control an interactive asset from at least one input device of the amusement park attraction system. The method includes analyzing the unfiltered data stream to determine whether the interactive asset can respond to the user interactions represented in the unfiltered data stream based on a model data set related to the interactive asset. In response to determining that the interactive asset can respond to the user interactions, the smoothing server processes the unfiltered data stream to generate a processed data stream. The smoothing server also selects, from a plurality of actions defined in the model data set for the interactive asset, one or more actions related to the user interactions represented in the processed data stream. Further, the smoothing server transmits, to a controller of the interactive asset, an instruction to cause the one or more selected actions to be instantiated in real time in response to the user interactions according to the processed data stream.

[0007] In one embodiment, a non-transitory computer-readable medium stores instructions executable by a processor of a smoothing server of a theme park attraction system. The instructions include instructions to receive, from at least one input device of the theme park attraction system, an unfiltered data stream representing user interactions of a user attempting to control an interactive asset. The instructions include instructions to determine that the unfiltered data stream includes data that exceeds a limit value defined in a model data set associated with the interactive asset, and in response, replace the data of the unfiltered data stream with the limit value defined in the model data set. The instructions include instructions to determine that the unfiltered data stream includes abnormal data, and in response, introduce additional data into the unfiltered data stream to smooth the abnormal data to result in a processed data stream. The instructions include instructions to select, from a plurality of actions defined within a model data set of the interactive asset, one or more actions associated with the user interactions represented in the processed data stream, and instructions to send commands to a controller of the interactive asset to effectuate one or more selected actions according to the processed data stream.

[0008] These and other features, aspects, and advantages of the present disclosure will be better understood when the following detailed description is read with reference to the accompanying drawings in which like parts are designated with like reference numerals throughout.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

[0010] When introducing elements of various embodiments of the present disclosure, articles such as "a", "an", and "the" are intended to mean that these elements exist in one or two or three or more. The terms "comprising", "including", and "having" are intended to be inclusive and mean that additional elements other than the recited elements may exist. Also, references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be construed as excluding the existence of additional embodiments that also include the described features.

[0011] Hereinafter, one or more specific embodiments of the present disclosure will be described. For the sake of brevity in describing these embodiments, not all implementation features are described herein. It should be understood that in any such implementation development found in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints that may vary depending on the implementation. Furthermore, although such development efforts can be complex and time-consuming, they are understood to be routine endeavors of design, fabrication, and manufacture for those skilled in the art who benefit from the present disclosure.

[0012] As described above, the amusement park can include an attraction system having one or more interactive assets that are dynamically controlled based on user input. For example, an interactive asset can include a virtual character of an interactive video game system in which parameters (e.g., position, movement, appearance) are at least partially determined and modified based on user interaction for controlling the virtual character received from one or more input devices. As another example, an interactive asset can include a physical robotic device having parameters (e.g., position, movement, appearance) that are at least partially determined and modified based on user interaction for controlling the robotic device received from one or more input devices. As another example, an interactive asset can include a physical vehicle having one or more input devices (e.g., attached wheels, throttle, pedals) in which parameters (e.g., position, orientation, movement) are at least partially determined and modified based on user interaction received from one or more input devices.

[0013] However, currently, it is recognized that in some situations, user interactions may be received that do not result in the interactive asset being designed or functioning as intended. For example, a user may perform an interaction corresponding to a position and / or movement that exceeds the technical limits or capabilities of the interactive asset. In this case, if the interactive asset is controlled based on such user input, there is a risk of damage to the interactive asset. Also, among user interactions, there are those corresponding to operations that exceed the desired creative intent of the interactive asset. In this case, if the interactive asset is controlled as specified by the user interaction, the appearance or operation of the interactive asset may become contrary to the "look & feel" or theme of the interactive asset. Furthermore, for the user experience to be immersive and enjoyable, the interactive asset should respond to user input in real time by minimizing the delay from when the user performs an interaction until the interactive asset executes the corresponding action.

[0014] Based on these, the present embodiment relates to a system and method for a smoothing server that processes user interactions related to the control of interactive assets. Generally, a smoothing server is designed to receive an unfiltered data stream of user interactions from one or more input devices, process the unfiltered data stream, and select a suitable action to be performed (e.g., a change in position, movement, effect) corresponding to the received interaction. Then, the smoothing server instructs the controller of the interactive asset to execute the action selected according to the processed data stream. The smoothing server ensures that the action instructed for the interactive asset to execute conforms to the technical and / or operational limits of the interactive asset, as well as the creative and / or thematic intent of the interactive asset. In a situation where the received unfiltered data stream of user input contains erratic data, the smoothing server can generate additional data points to enhance the data from the unfiltered data stream so that the interactive asset is instructed to move smoothly and continuously when executing an action. Further, the streaming server is designed to process the unfiltered data stream and provide instructions suitable for enabling an immersive user experience by controlling the interactive asset in real time to the controller of the interactive asset. As used herein, "real time" means that the interactive asset responds to user interactions without a perceptible delay to the user. For example, in some embodiments, this delay (e.g., total response time) can be less than 50 milliseconds (ms), less than 30 ms, less than 25 ms, or between 20 ms and 25 ms.

[0015] Based on these, FIG. 1 is a schematic diagram of an embodiment of an amusement park attraction system 10. The attraction system 10 enables a user 12 (e.g., a guest, a performer) located within a participation area 14 to perform a user interaction (e.g., a user input) that results in a corresponding action by an interactive asset 16. In the illustrated embodiment, the interactive asset 16 is shown as a physical robot - type interactive asset, and the position, movement, and / or appearance of the interactive asset 16 are dynamically adjusted in real - time based on the interaction received from the user 12. In other embodiments, the interactive asset 16 can be another physical interactive asset such as a ride vehicle, an interactive special - effect display (e.g., a wall of light, a water jet), or any other suitable dynamically - controlled device. In some embodiments, in addition to or instead of this, the attraction system 10 can also include one or more of output devices 18 such as displays, indicator lights, special / physical effect devices, speakers, tactile feedback devices, and haptic feedback devices. In some embodiments, it can also be understood that the interactive asset 16 can be a virtual interactive asset such as a video game character presented within at least one virtual environment of the output devices 18 (e.g., a display or a projector) of the attraction system 10. In some embodiments, in order to provide a more immersive and enjoyable experience to the user 12, one or more of the output devices 18 can be controlled in conjunction with the interactive asset 16. In some embodiments, one or more of the output devices 18 can be arranged within or around the participation area 14.

[0016] In the embodiment shown in FIG. 1, the attraction system 10 includes at least one controller 20 communicatively coupled to the interactive asset 16 and / or the output device 18 via a suitable wired or wireless data connection. In some embodiments, each of the output device 18 and the interactive asset 16 includes its own controller, while in other embodiments, at least a portion of the output device 18 and / or the interactive asset 16 can be controlled by a common controller. In the illustrated embodiment, the controller 20 includes a memory 22 configured to store instructions, and a processing circuit 24 (also referred to herein as a “processor”) configured to execute the stored instructions to control the operation of the interactive asset 16 and / or the output device 18 based on instructions or control signals received by the controller 20 as described below. The memory 22 can include volatile memory such as random access memory (RAM), and / or non-volatile memory such as read-only memory (ROM), an optical drive, a hard disk drive, a solid state drive, or any other non-transitory computer-readable medium including instructions for operating the attraction system 10 to control the operation of the interactive asset 16 and the like. The processing circuit 24 can be configured to execute such instructions. For example, the processing circuit 24 can include one or more application specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), one or more general purpose processors, or any combination thereof.

[0017] In the embodiment shown in FIG. 1, the attraction system 10 includes a plurality of input devices 26 designed to receive the interaction of the user 12. The input devices 26 can include any suitable device capable of receiving or determining information regarding the interaction of the user 12 within the participation area 14, including but not limited to cameras, microphones, accelerometers, weight sensors, buttons, levers, game controllers, and joysticks. As used herein, "interaction" means one or more actions or activities (e.g., movement, sound, expression, button presses, joystick movements) that the user 12 intends to elicit a response from the attraction system 10. In the illustrated embodiment, the input devices 26 include a series of sensors 28 disposed around the participation area 14 of the attraction system 10, and a user input device 30 (e.g., a user interface device) worn by the user 12. Generally, these input devices 26 are configured to measure or detect events indicating the interaction of the user 12 with the attraction system 10 occurring within the participation area 14.

[0018] In the embodiment shown in FIG. 1, the sensors 28 can include one or more visible light cameras, one or more infrared (IR) cameras, one or more light detection and ranging (LIDAR) devices, or other suitable ranging and / or imaging devices. In some embodiments, these sensors 28 can be used to determine the location or position of the user 12, the posture or pose of the user 12, the movement of the user 12, the actions of the user 12, or any other relevant information regarding the interaction of the user 12 within the participation area 14. In some embodiments, at least a portion of these sensors 28 can include an integrated controller capable of preprocessing the captured data into volumetric models or skeletal models of the user 12. In some embodiments, the sensors 28 can include one or more cameras that measure and collect the facial movements and expressions of the user 12.

[0019] Also, in the embodiment shown in FIG. 1, the input device 26 includes at least one radio frequency (RF) sensor 32 disposed near the participation area 14 (e.g., above, below the participation area 14, adjacent to the participation area 14). The RF sensor 32 is configured to receive an RF signal from an embedded radio frequency identification (RFID) tag, a Bluetooth® device, a Wi-Fi device, or other suitable wireless communication device of the user input device 30. The user input device 30 provides a signal indicating the parameters (e.g., position, movement, orientation) of the user input device 30 to the RF sensor 32 during operation, and can also uniquely identify the user 12 and / or the user input device 30. In some embodiments, the user input device 30 can be a wearable user input device (e.g., a bracelet, a headband, glasses, a watch), and in other embodiments, the user input device 30 can be a handheld user input device (e.g., a sword, a torch, a pen, a staff, a ball, a smartphone). In some embodiments, a plurality of input devices 26 (e.g., the sensor 28 and the user input device 30) cooperate with each other to measure or detect the interaction of the user 12.

[0020] The attraction system 10 also includes a smoothing server 34 communicatively coupled between the input device 26 and the controller 20. The data connection between the input device 26 and the smoothing server 34, the data connection between the smoothing server 34 and the controller 20, and the data connection between the controller 20 and the interactive asset 16 and / or the output device 18 can each be implemented independently using a suitable wired or wireless network connection. The smoothing server 34 generally receives an unfiltered data stream of input data representing user interactions from the input device 26, processes the unfiltered data stream to determine suitable actions for the interactive asset 16 to perform in response to these user interactions, and is designed and implemented to provide the controller 20 with instructions to execute actions according to the user input. In the illustrated embodiment, the smoothing server 34 includes a memory 36 that stores instructions and such a data stream when the unfiltered data stream is received, and a processing circuit 38 (also referred to herein as a "processor") configured to execute the stored instructions during operation. The memory 36 can include volatile memory such as RAM, and / or non-volatile memory such as ROM, an optical drive, a hard disk drive, a solid state drive, or any other non-transitory computer-readable medium including instructions to operate the attraction system 10 such as analyzing and processing the unfiltered data stream to select actions for the interactive asset 16 to perform. The processing circuit 38 can include one or more ASICs, one or more FPGAs, one or more general-purpose processors, or any combination thereof.

[0021] In the embodiment shown in FIG. 1, the memory 36 of the smoothing server 34 also stores a model data set 40 that is used by the smoothing server 34 during the analysis and processing of the unfiltered data stream received from the input device 26. The model data set 40 can include operational rules 42 that define the technical and / or operational limits of the interactive asset 16. For example, the operational rules can define suitable ranges of operational parameters (e.g., speed, acceleration, displacement, orientation, voltage, power, pressure, flow rate, positioning, movement, and / or envelope of actions) related to the desired operation of various components of the interactive asset 16 (e.g., joints, motors, actuators, pistons, appendages).

[0022] The model dataset 40 can also include creative intent rules 44 that define the creative and / or thematic intent of the interactive asset 16. That is, while the action rules 42 define the operational capabilities and limitations of the interactive asset 16, the creative intent rules 44 define the "look and feel" of the interactive asset 16 such that the character represented by the interactive asset 16 behaves in a manner faithful to the expected thematic behavior of that character in other media (e.g., movies, video games, comic books). In the example of FIG. 1, the creative intent rules can constrain the movement of the illustrated robotic interactive asset 16 such that only a part of the interactive asset 16 (e.g., one arm, one leg, torso) moves at a time so that the interactive asset 16 moves in a "robotic" manner corresponding to the thematic presentation of the character represented by the interactive asset 16 expected by the user 12. The creative intent rules can also define the actions of the interactive asset 16 and the user interactions that trigger each of these actions. For example, the creative intent rules can define that in an unfiltered data stream, in response to receiving a series of inputs indicating that the user 12 has performed a particular interaction (e.g., waved a hand), the interactive asset 16 performs one or more response actions (e.g., waves a hand while mimicking the movement of the user 12 and says "Hello World!").

[0023] In the embodiment shown in FIG. 1, the model data set 40 includes limit values 46 that define the maximum and minimum values related to the desired operations of various components (e.g., joints, motors, actuators, pistons, appendages) of the interactive asset 16 in accordance with both the operation rules 42 and the creative intent rules 44. That is, in some embodiments, the limit values 46 of the model data set 40 are at least partially determined based on the operation rules 42 and the creative intent rules 44. For example, in some embodiments, suitable machine learning techniques can be applied to automatically determine (e.g., generate, identify) at least a portion of the limit values 46 that comply with both the operation rules 42 and the creative intent rules 44 related to the interactive asset 16. For example, these limit values 46 can define what is referred to as an "envelope" of the interactive asset 16, which indicates range values that define all acceptable movements and / or actions of the interactive asset 16.

[0024] Based on the model data set 40, the smoothing server 34 analyzes and processes the unfiltered data stream received from the input device 26 to determine one or more actions that the interactive asset 16 should perform in response to the interaction of the user 12 represented in the data stream. During processing, the smoothing server 34 can also modify at least a portion of the unfiltered data stream to ensure that the interactive asset 16 performs one or more actions in accordance with the operation rules 42, the creative intent rules 44, and / or the limit values 46 of the model data set 40. Thereafter, the smoothing server 34 provides the controller 20 with instructions to perform one or more response actions according to the processed data stream so that the interactive asset 16 responds in real time to the user's actions while respecting the operation rules 42, the creative intent rules 44, and the limit values 46 related to itself.

[0025] FIG. 2 is a flow diagram showing an embodiment of a process 60 in which a smoothing server 34 gives instructions to a controller 20 of an interactive asset 16 in response to an interaction of a user 12 based on the analysis and / or processing of an unfiltered data stream. The process 60 can be implemented as computer-readable instructions stored in a memory 36 and executed by a processor 38 of the smoothing server 34 during operation. The process 60 will be described with reference to the elements shown in FIG. 1. In other embodiments, the process 60 can also include additional steps, fewer steps, and repetitions of steps, etc., in accordance with the present disclosure. Note that the smoothing server 34 analyzes and processes an unfiltered data stream so that the user experience is immersive, and it can be understood that the smoothing server 34 collaborates with the controller 20 to affect the response by the interactive asset 16 in real time.

[0026] In the embodiment shown in FIG. 2, process 60 begins with smoothing server 34 receiving from at least one of input devices 26 an unfiltered data stream representing the interaction of user 12 attempting to control interactive asset 16 (block 62). Process 60 proceeds to smoothing server 34 determining, based on an initial analysis of the unfiltered data stream, whether interactive asset 16 can respond to the interaction of user 12 according to model data set 40 associated with interactive asset 16 (block 64). For example, smoothing server 34 can compare the unfiltered data stream to one or more of operation rules 42, one or more of creative intent rules 44, and / or one or more of limit values 46 of model data set 40. As will be described below, in some cases, if the unfiltered data stream contains only a limited number (e.g., less than a threshold number) of values that exceed the limits and / or rules of model data set 40, interactive asset 16 can continue to respond by correcting these values during the data stream processing. However, in other cases, the data stream may contain more than a predetermined threshold number of values that exceed the limits and / or rules of model data set 40, or may contain more than a predetermined threshold amount of values that exceed the limits or rules of model data set 40, or may contain data indicating actions not permitted within operation rules 42 and / or creative intent rules 44 of interactive asset 16, in response to which smoothing server 34 can determine in decision block 66 that interactive asset 16 cannot respond to the interaction of user 12.

[0027] In the embodiment shown in FIG. 2, when the smoothing server 34 determines in the determination block 66 that the interactive asset 16 cannot respond to the interaction of the user 12, the smoothing server 34 commands the controller 20 of the interactive asset 16 to cause a pre-programmed theme action (for example, a pre-programmed action preferably themed for the interactive asset 16) to occur in response to the interaction of the user 12 (block 68). That is, the smoothing server 34 not only simply filters or ignores the interaction indicated by the unfiltered data stream, but also commands the interactive asset 16 to provide the user with a response faithful to the creative and / or thematic intent of the character, indicating that the interaction of the user has exceeded the range that the character represented by the interactive asset 16 can handle. For example, in response to determining in blocks 64 and 66 that the user's interaction corresponds to a significant number of positions, movements, actions, etc. that exceed a specific speed or acceleration limit defined in the model data set 40 of the interactive asset 16, the smoothing server 34 can command the robotic interactive asset 16 shown in FIG. 1 in block 68 to raise both hands and perform a thematically appropriate dialogue response (for example, "Oh my, you humans do like to dance!") expressing frustration. In another example, in response to determining in blocks 64 and 66 that the user's interaction is not likely to cause the interactive asset 16 to repeat or mimic inappropriate content, but rather corresponds to inappropriate content (for example, inappropriate expressions or gestures) that violates the creative intent rules 44 of the model data set 40, the smoothing server 34 can command the robotic interactive asset 16 shown in FIG. 1 to raise both hands and perform a thematically appropriate dialogue response (for example, "I can't do that - they would disassemble me for sure!") expressing concern.After instructing the controller 20 to execute a pre-programmed theme action, the smoothing server 34 returns to block 62 and receives additional data from the unfiltered data stream.

[0028] In the embodiment shown in FIG. 2, when the smoothing server 34 determines in the determination block 66 that the interactive asset 16 can respond to the interaction of the user 12, it processes the unfiltered data stream based on the model data set 40 (block 70) to generate a processed data stream, and selects one or more actions in response to the interaction of the user 12. An example of a process in which the smoothing server 34 can process the unfiltered data stream will be described below with reference to FIG. 3. Generally, the processed data stream generated by the smoothing server 34 includes only data (e.g., parameters for actions) that conform to the limit value 46 defined by the operation rule 42, the creative intention rule 44, and / or the model data set 40 related to the interactive asset 16. Thereafter, the smoothing server 34 instructs the controller 20 to effectuate the selected response in accordance with the processed data stream (block 72). For example, in some embodiments, the smoothing server 34 can provide the controller 20 with a processed data stream that defines the parameters (e.g., position, start point / end point, orientation, route, acceleration, speed) of each of these actions, along with instructions (e.g., commands, control signals) for the interactive asset 16 to perform one or more actions (e.g., move, jump, swing a sword).

[0029] FIG. 3 is a flow diagram showing an embodiment of a process 80 in which a smoothing server 34 processes an unfiltered data stream to generate a processed data stream and selects one or more actions for an interactive asset 16 to perform. The process 80 can be implemented as computer-readable instructions stored in a memory 36 and executed by a processor 38 of the smoothing server 34 during operation. The process 80 will be described with reference to the elements shown in FIG. 1. In other embodiments, the process 80 can also include additional steps, fewer steps, and repetitions of steps, etc., in accordance with the present disclosure. As described above, the smoothing server 34 analyzes and processes an unfiltered data stream so that the user experience is immersive, and in cooperation with the controller 20, can be understood to affect the response by the interactive asset 16 in real time.

[0030] In the embodiment shown in FIG. 3, the smoothing server 34 receives an unfiltered data stream 82 provided by the input device 26 of the attraction system 10. In decision block 84, the smoothing server 34 compares the data contained in the unfiltered data stream with the limit values 46 of the model data set 40 to determine whether the data stream contains data that exceeds these limits. If the smoothing server 34 determines that the data stream contains data that exceeds the limit, it replaces the data that exceeds the limit of this data stream with the corresponding exceeded limit value defined by the limit value 46 of the model data set 40 (block 86). In this way, the smoothing server 34 ensures that the resulting processed data stream contains only data values within the envelope defined by the limit values 46 of the model data set 40. If the smoothing server 34 determines in decision block 84 that the data stream does not contain data that exceeds the limit, or after replacing the data that exceeds the limit in block 86, it can proceed to the next step of process 80.

[0031] In the embodiment shown in FIG. 3, process 80 proceeds to determination block 88 where smoothing server 34 determines whether the data stream contains abnormal data. For example, smoothing server 34 analyzes a particular portion of the data stream, such as a series of data points representing the movement of user input device 30 within participation area 14 over a unit of time, and can determine that the data representing the movement is irregular, lacks continuity, or does not define a continuous curve. If smoothing server 34 determines in determination block 88 that the data stream contains such abnormal data, it can respond by introducing additional data points into the data stream (block 90) in order to smooth or otherwise modify the abnormal data to enhance the continuity and / or smoothness of the data so that interactive asset 16 is controlled more smoothly and realistically. If smoothing server 34 determines in determination block 88 that the data stream does not contain abnormal data, or after smoothing the abnormal data in block 90, process 80 proceeds to the next step.

[0032] In the embodiment shown in FIG. 3, process 80 proceeds such that smoothing server 34 compares the processed data stream with model data set 40 (block 92) and selects one or more actions defined in model data set 40 based on the comparison. For example, as described above, in some embodiments, the creative intent rules 44 of model data set 40 can define multiple different actions that interactive asset 16 can perform. These creative intent rules 44 can further define the limits of each of these actions (e.g., which actions can be performed together, which actions must be performed individually, which actions can only be performed using a particular user interface device), and what user interactions trigger each action. For example, the creative intent rule can define a user interaction where the user's foot rises less than 10 centimeters (cm) from the floor as a trigger for the "hop" action, and a user interaction where the user's foot rises more than 10 centimeters from the floor as a trigger for an explicit "jump" action by interactive asset 16. Smoothing server 34 selects one or more suitable actions 94 to be performed in response to the user interaction by comparing the user interaction indicated by the data stream with the user interactions defined within model data set 40 as triggers for the actions of interactive asset 16. In some embodiments, smoothing server 34 can further process the data stream to separate the parameters of each selected action. For example, smoothing server 34 can indicate within processed data stream 96 which data corresponds to which selected action such that processed data stream 96 provides the respective parameters associated with each selected action 94 to controller 20. In some embodiments, the selected actions 94 can be provided to controller 20 as part of processed data stream 96.

[0033] In this specification, only some features of the disclosed embodiments are illustrated and described, but many modifications and changes will occur to those skilled in the art. Therefore, it should be understood that the appended claims cover all such modifications and changes that fall within the actual spirit of this disclosure.

[0034] The technology claimed and shown in this specification refers to and applies to tangible things and specific examples of an actual nature that surely improve this technical field and thus are not abstract, intangible, or purely theoretical. Further, if any claim appended at the end of this specification includes one or more elements designated as "means for [performing]... [function]" or "steps for [performing]... [function]", such elements should be construed in accordance with 35 U.S.C. § 112(f). On the other hand, for any claim that includes elements designated in any other form, such elements should not be construed in accordance with 35 U.S.C. § 112(f).

Description of Reference Numerals

[0035] 10 Attraction system 12 User 14 Participation area 16 Interactive asset 18 (Single or plural) Output device 20 Controller 22 Memory 24 Processing circuit 26 Input device 28 Sensor 30 User input device 32 Radio frequency (RF) sensor 34 Smoothing server 36 Memory 38 Processing circuit 40 Model data set 42 Operation rule 44 Creative intention rule 46 Limit value

Claims

1. An amusement park attraction system, comprising: at least one input device; an interactive asset; a controller communicatively coupled to the interactive asset; a smoothing server communicatively coupled to the controller; wherein the smoothing server includes a memory configured to store a model data set related to the interactive asset, and a processor, and the processor is configured to: receive, from at least one input device, an unfiltered data stream representing a user interaction of a user attempting to control the interactive asset; based on the unfiltered data stream and the model data set, determine whether the interactive asset can respond to the user interaction represented in the unfiltered data stream; in response to determining that the interactive asset cannot respond to the user interaction, send, to the controller, an instruction to cause a pre-programmed theme action to occur on the interactive asset; in response to determining that the interactive asset can respond to the user interaction, process the unfiltered data stream to generate a processed data stream, select one or more actions that the interactive asset should perform in response to the user interaction, and send, to the controller, an instruction to cause the interactive asset to perform the one or more selected actions according to the processed data stream; configured as such; An amusement park attraction system, characterized by the above.

2. The at least one input device includes a camera, a light detection and ranging (LiDAR) device, a wearable user input device, a handheld user input device, or any combination thereof. The amusement park attraction system according to Claim 1.

3. The interactive asset includes a physical interactive asset or a virtual interactive asset presented on at least one output device of the amusement park attraction system. The amusement park attraction system according to Claim 1.

4. The model dataset includes a first set of operating rules that define the technical or operating limits of the interactive asset. The amusement park attraction system according to claim 1.

5. The model dataset includes a second set of creative intent rules that define the creative or thematic limits of the interactive asset. The amusement park attraction system according to claim 4.

6. The processor is configured to determine whether the interactive asset can respond to the user interaction represented in the unfiltered data stream by comparing the unfiltered data stream with the set of operating rules and the set of creative intent rules, and determining that the interactive asset can respond to the user interaction if the unfiltered data stream complies with the set of operating rules and the set of creative intent rules of the model dataset. The amusement park attraction system according to claim 5, configured as such.

7. The model dataset includes a set of limit values, and at least a part of the set of limit values is generated based on the set of operating rules and the set of creative intent rules of the interactive asset. The amusement park attraction system according to claim 5.

8. The processor is configured to process the unfiltered data stream to generate a processed data stream by determining that the unfiltered data stream includes data that exceeds a certain limit value among the set of limit values of the model dataset, and in response thereto, replacing the data in the unfiltered data stream with the limit value defined in the model dataset. The amusement park attraction system according to claim 7, configured as such.

9. The processor is configured to process the unfiltered data stream to generate a processed data stream by determining that the unfiltered data stream includes abnormal data, and in response thereto, introducing additional data into the unfiltered data stream to smooth the abnormal data. The amusement park attraction system according to claim 1, configured as described above.

10. The processor is configured to process the unfiltered data stream to generate a processed data stream, determine that the unfiltered data stream contains data exceeding a limit value defined in the model data set, and in response thereto, replace the data in the unfiltered data stream with the limit value defined in the model data set, determine that the unfiltered data stream contains abnormal data, and in response thereto, introduce additional data into the unfiltered data stream to smooth the abnormal data, The amusement park attraction system according to claim 1, configured as described above.

11. The processor is configured to select the one or more actions, select, from a plurality of actions defined in the model data set, the one or more actions related to the user interaction represented in the processed data stream, The amusement park attraction system according to claim 1, configured as described above.

12. A method for operating a smoothing server of an amusement park attraction system, comprising: receiving an unfiltered data stream representing a user interaction of a user attempting to control an interactive asset from at least one input device of the amusement park attraction system; analyzing the unfiltered data stream based on a model data set related to the interactive asset to determine that the interactive asset can respond to the user interaction represented in the unfiltered data stream; in response to determining that the interactive asset can respond to the user interaction, processing the unfiltered data stream to generate a processed data stream representing the user interaction. Selecting, from a plurality of actions defined within the model dataset for the interactive asset, one or more actions related to the user interaction represented within the processed data stream; Sending, to a controller of the interactive asset, an instruction to cause the one or more selected actions to be instantiated in real time on the interactive asset in response to the user interaction according to the processed data stream; A method comprising the above.

13. Receiving, from at least one input device of the amusement park attraction system, a further unfiltered data stream representing further user interaction of the user attempting to control the interactive asset; Analyzing the further unfiltered data stream to determine, based on the model dataset related to the interactive asset, that the interactive asset is unable to respond to the further user interaction; In response to determining that the interactive asset is unable to respond to the further user interaction, sending, to a controller of the interactive asset, an additional instruction to cause a pre-programmed thematic action to be instantiated on the interactive asset; The method according to claim 12, comprising the above.

14. The model dataset comprises: A set of operating rules defining technical or operational limits of the interactive asset; A set of creative intent rules defining creative or thematic limits of the interactive asset; A set of limit values defining minimum and maximum allowable values of one or more parameters of the interactive asset; The method according to claim 12, comprising the above.

15. Before receiving the unfiltered data stream, the method comprises: Determining the set of limit values from the set of operating rules and the set of creative intent rules using machine learning techniques; The method according to claim 14.

16. Processing the unfiltered data stream to generate a processed data stream comprises: Determining that the unfiltered data stream includes data exceeding a certain limit value among the series of limit values of the model data set, and in response thereto, replacing the data of the unfiltered data stream with the limit value defined in the model data set The method according to claim 14 **Claim 17** Processing the unfiltered data stream to generate a processed data stream includes Determining that the unfiltered data stream includes abnormal data, and in response thereto, introducing additional data into the unfiltered data stream to smooth the abnormal data The method according to claim 12 **Claim 18** A non-transitory computer-readable medium storing instructions executable by a processor of a smoothing server of an amusement park attraction system, the instructions comprising Instructions to receive an unfiltered data stream representing user interaction of a user attempting to control an interactive asset from at least one input device of the amusement park attraction system Determining that the unfiltered data stream includes data exceeding a limit value defined in a model data set related to the interactive asset, and in response thereto, replacing the data of the unfiltered data stream with the limit value defined in the model data set Determining that the unfiltered data stream includes abnormal data, and in response thereto, introducing additional data into the unfiltered data stream to smooth the abnormal data and resulting in a processed data stream representing the user interaction Instructions to select one or more actions related to the user interaction represented in the processed data stream from a plurality of actions defined in the model data set of the interactive asset Instructions to send a command to cause the one or more selected actions to be executed according to the processed data stream to a controller of the interactive asset A non-transitory computer-readable medium comprising

19. After receiving the unfiltered data stream, the instructions Analyze the unfiltered data stream based on the model data set, and based on the model data set related to the interactive asset, determine that the interactive asset can respond to the user interaction represented in the unfiltered data stream. Instructions included, The non-transitory computer-readable medium according to claim 18.

20. The instructions are for selecting the one or more actions Instructions for identifying the user interaction from the processed data stream, and Instructions for selecting, from a plurality of actions defined in the model data set, the one or more actions related to the identified user interaction within a series of creative intent rules of the model data set. The non-transitory computer-readable medium according to claim 18, comprising

Images