System and method for providing a performance effect using detectable marks
The show effects system uses detectable markers to track movements and trigger corresponding effects in real time, addressing the lack of immersive interactions in amusement park attractions, enhancing the experience through interactive and engaging show effects.
Patent Information
- Application Number
- CN202380036899.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-06-21
- Filing Date
- 2023-04-24
- Publication Date
- 2024-12-06
AI Technical Summary
Existing amusement park attractions lack immersive and interactive show effects that can be triggered in real time without the need for patrons or performers to carry or use props, leading to a less engaging experience.
A show effects system that applies detectable markers, such as UV-based markers, to patrons or performers, using cameras to track their movements and trigger corresponding show effects in real time through a control system, allowing for interactive and immersive experiences without the use of tangible objects.
Enables real-time generation of show effects that enhance the experience by allowing patrons and performers to control the environment interactively, providing a more immersive and engaging experience.
Smart Images

Figure CN119095656A_ABST
Abstract
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to and the benefit of U.S. Provisional Application No. 63 / 336,121, filed on April 28, 2022, entitled “SYSTEMS AND METHODS FOR PROVIDING A SHOW EFFECT USING A DETECTABLE MARKER,” which is hereby incorporated by reference in its entirety for all purposes. Background Art
[0002] This section is intended to introduce the reader to various aspects of the technology that may be related to various aspects of the present technology, which are described and / or claimed below. This discussion is considered to be helpful in providing the reader with background information to promote a better understanding of the various aspects of the present disclosure. Therefore, it should be understood that these statements are to be read from this perspective rather than as admissions of prior art.
[0003] Throughout amusement parks and other entertainment venues, show components can be used to help immerse patrons in the experience of a ride, attraction, show, or performance. Show components may include three-dimensional (3D) props and scenery pieces, mechanical components, electrical components, chemical components, and / or display surfaces that present media. In some cases, patrons may provide input that triggers a show component to provide a show effect. Summary of the invention
[0004] Certain embodiments commensurate in scope with the originally claimed subject matter are summarized below. These embodiments are not intended to limit the scope of the claimed subject matter, but rather, these embodiments are intended only to provide a brief overview of possible forms of the subject matter. Indeed, the subject matter may encompass a variety of forms that may be similar or different from the embodiments set forth below.
[0005] In one embodiment, a show effect system may include: an applicator configured to apply a detectable marker; a camera configured to generate image data representing an environment with a detectable marker; and a control system communicatively coupled to the camera and including a processor and a memory, wherein the memory stores instructions executable by the processor. The detectable marker may include an ultraviolet (UV) component having a detectable wavelength range corresponding to UV-A, UV-B, or UV-C. The processor may execute instructions that cause the processor to determine movement of the detectable marker based on the image data and determine that the movement of the detectable marker corresponds to target movement. The processor may also identify a show effect that may be associated with the target movement and trigger the generation of the show effect in the environment.
[0006] In one embodiment, the performance effect method may include applying a mark to a customer via an applicator, wherein the mark includes a chemical component detectable in a wavelength range between 10 and 400 nanometers. The method may then use one or more processors to receive image data from a camera configured to record image data in a wavelength range between 10 and 400 nanometers. The image data may include a mark in the environment. The method may also use one or more processors to identify a specific representation of the mark within the image data and determine the movement of the mark based on the image data. The method may also use one or more processors to determine that the movement of the mark corresponds to a target movement, and identify a performance effect associated with the target movement. The method may then use one or more processors to generate a performance effect in the environment.
[0007] In one embodiment, a show effect system may include a control system including a processor and a memory. The memory stores instructions executable by the processor, and the instructions are configured to cause the processor to receive image data including a tag applied to a customer or performer in an environment. The tag may include an ultraviolet (UV) component. The processor may also determine the movement of the tag based on the image data and determine that the movement of the tag corresponds to a target movement. The processor may then identify a show effect associated with the target movement and trigger the generation of the show effect in the environment. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] These and other features, aspects, and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which like characters refer to like parts throughout the drawings, and in which:
[0009] Figure 1 is a schematic diagram of an embodiment of an attraction system that may be used in an amusement park according to an aspect of the present disclosure;
[0010] Figure 2 According to one aspect of the present disclosure, a customer Figure 1 A schematic illustration of an attraction system triggering a show effect in a ride attraction;
[0011] Figure 3 According to one aspect of the present disclosure, a customer Figure 1 A schematic illustration of the attraction system triggering the performance effects during the performance;
[0012] Figure 4 According to one aspect of the present disclosure, Figure 1 A close-up view of an embodiment of an applicator used in an attraction system of; and
[0013] Figure 5 According to one aspect of the present disclosure, Figure 1A flowchart of an embodiment of a process of generating a performance effect by a scenic spot system. DETAILED DESCRIPTION
[0014] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements described. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements besides the listed elements. Additionally, it should be understood that references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted to exclude the existence of additional embodiments that also incorporate the recited features.
[0015] One or more specific embodiments of the present disclosure will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation may be described in the specification. It should be recognized that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. In addition, it should be recognized that such development efforts may be complex and time-consuming, but will be no more than a routine task of design, fabrication, and manufacturing for a person of ordinary skill who benefits from the present disclosure.
[0016] The present disclosure generally relates to systems and methods for providing show effects, such as in an amusement park. An amusement park may include a variety of features, such as rides (e.g., roller coasters), theatrical performances, set designs, performers, and / or decorative elements, to entertain patrons. Show effects may be used to supplement or complement features to provide patrons with a more immersive, interactive, and / or unique experience. For example, show effects may be presented to emulate real-world elements to present a more realistic atmosphere to patrons. In another example, show effects may be presented to create fictional characters, fantasy worlds, and / or special effects (e.g., spells, magic) to construct a storyline or environment for patrons.
[0017] Embodiments of the present disclosure relate to a show effects system that operates to present one or more show effects in real time (e.g., real time or near real time) based on the detection of a detectable marker. The term 'real time' or 'near real time' may mean processing input data within milliseconds so that feedback (e.g., a show effect) can be created almost instantaneously. As described herein, the show effects system can track a detectable marker, determine that the movement of the detectable marker corresponds to an associated movement for activating a show effect, and trigger the generation of the show effect in real time.
[0018] Advantageously, in one embodiment, customers can create show effects during a tour of a ride without the customer carrying or otherwise disposing of props or tangible objects. Alternatively, a customer can enter a ride and receive a detectable marker from an applicator. Customers can also learn about different show effects that can be activated within the ride and the associated motions for activating the show effects. The show effects system can track the detectable markers, determine that the customer has performed the associated motions (e.g., based on the movement pattern of the detectable markers) for activating the show effects, and then trigger the show effects. For example, one of the customers can receive a detectable marker on his hand and wave his hand in a certain pattern during the ride to activate the show effects. As such, customers can efficiently and effectively control certain aspects of the ride, such as the generation of show effects, without the use of props or tangible objects. In this way, the show effects can appear to be created in real time due to the movement of the customer, and thus enhance the customer's experience within the ride. Therefore, the show effects system can provide an immersive and interactive environment for customers on the ride.
[0019] In one embodiment, the show effects system and performers can create an interactive show experience for customers. For example, the performer can receive a detectable marker from an applicator. The performer can be part of a show or performance that uses show effects to create a unique storytelling experience for customers. For example, the performer can receive a small number of detectable markers, such as three detectable markers located on the performer's face, hands, and feet. Advantageously, the show effects system can use a small number of detectable markers positioned to create a more detailed skeletal tracking system for the performer instead of a larger number of markers. The show effects system can then track the movement of the small number of detectable markers on the performer to create a show effect for the show. Limiting the number of markers tracked by the show effects system can limit the variability of the show effects system, reduce response time (e.g., low latency), and / or reduce processing power. As such, the show effects system can operate in real time to create a fascinating experience for customers. Therefore, performers and show effects systems can use show effects to promote storytelling or enhance experience for customers.
[0020] Additionally or alternatively, patrons may participate in the show by triggering certain show effects during the show. That is, patrons may receive detectable markers at the audience area prior to the show. During the show, performers may request patrons to move their hands in a certain manner (e.g., motion, pattern), which may trigger the generation of show effects to aid the storytelling of the show. In this manner, patrons may create unique show effects to complement performers or shows by using detectable markers without the use of props or tangible objects. In this manner, the show effects system may create interactive and / or immersive shows for patrons. Thus, the detectable markers and show effects system may together provide a unique and / or responsive presentation of show effects to patrons of the amusement park.
[0021] Considering the above, Figure 1 is a schematic diagram of an embodiment of an attraction system 50 that may be used in an amusement park. For example, the attraction system 50 may include a first attraction system 50a and a second attraction system 50b. The first attraction system 50a may include a roller coaster, a motion simulator, a water ride, a walk-through attraction (e.g., a maze), etc., and the second attraction system 50b may include a performance area, a show area, an entertainment area, a rehearsal area, etc. The first attraction system 50a may include a customer area 52 in which various patrons 54 may be located. The customer area 52 may include an open space, such as a walkable area (e.g., a queue or line) in which patrons may enter the attraction system 50, exit the attraction system 50, or otherwise navigate through the attraction system 50.
[0022] The customer area 52 may also include an applicator 56, which may be used to apply a detectable marker to one or more of the customers 54. The detectable marker may be applied to a body part of the customer 54 in the form of a powder, liquid, gel, stamp, etc. For example, the applicator 56 may be a stamp that an operator or customer 54 may grasp and manipulate to apply the detectable marker to the hand of the customer 54. In another example, the applicator 56 may be a hand sanitizer dispenser that the customer 54 may actuate (e.g., pump) to apply the detectable marker. In yet another example, the applicator 56 may be a hidden or invisible applicator that may be particularly useful in high throughput rides to quickly apply the detectable marker to the customer 54. The detectable marker may be an invisible marker including an ultraviolet (UV) component, such as a UV powder, UV liquid, UV paint, or UV polymer. The detectable marker may be invisible to the customer 54 (e.g., invisible to the human eye; substantially invisible in ambient lighting), but may be detected by the show effect system to trigger the generation of the show effect 58a within the first attraction system 50a. For example, a hand sanitizer dispenser may include any fluid, including hand sanitizer, that is mixed with a UV component for the customer to actuate and apply a detectable mark. The detectable mark may also be applied to the skin or clothing of the customer 54, and may also be temporary and removable from the customer 54 via water and / or soap (e.g., hand washing). Although it may be preferred in some cases that the customer 54 does not carry an object to provide input to trigger the show effect 58a, it should be recognized that the detectable mark may be applied to an object (e.g., a prop, a toy, a wearable device) carried by the customer 54.
[0023] The customer area 52 may also include a display or monitor that educates the customer 54 about one or more show effects 58a associated with and / or available in the first attraction system 50a. The show effects 58a may include light effects, movable objects (e.g., physical props such as robots), smoke effects, audio effects, water effects, digital effects, display effects (e.g., including displayed animated characters), etc. The show effects 58a may be related to the theme of the first attraction system 50a to promote the storytelling aspects of the first attraction system 50a and / or create an immersive experience for the customer 54. For example, the first attraction system 50a may be related to an underwater adventure, and the show effects 58a may involve spraying water, puffs of smoke, sirens, etc. Although the illustrated embodiment shows the show effects 58a located outside of the customer area 52, the show effects 58a may be located at least partially within the customer area 52.
[0024] Referring back to the display or monitor of the customer area 52, the customer 54 can view the video on the display to understand one or more movements associated with one or more performance effects 58a. For example, the display may include a virtual tour guide (e.g., an animated character) to teach the customer 54 about different performance effects 58a associated with the first attraction system 50a and / or available in the first attraction system 50a. After the presentation, the virtual tour guide can practice the performance effect 58a with the customer 54. That is, the display may also include a camera 60 to identify a detectable mark on the customer 54 and detect the movement of the detectable mark. For example, the customer 54 can wave at the virtual tour guide in the display, and the virtual tour guide can wave back in response to the customer's wave. In another example, the customer 54 can move their hands in a throwing motion to throw a virtual ball to the virtual tour guide. As such, the customer 54 can understand how to trigger the generation of the performance effect 58a in the first attraction system 50a. In some embodiments, the display can generate the performance effect 58a to welcome the customer 54 to the first attraction system 50a or to entertain the customer 54 in the customer area 52.
[0025] In some embodiments, the first scenic spot system 50a may include a camera 60 to generate image data (e.g., moving image data, such as video data) of the first scenic spot system 50a. The camera 60 may be a UV camera that can generate image data in the UV portion of the electromagnetic spectrum at wavelengths below 400 nanometers (nm). The camera 60 may also be a digital camera with a UV filter or any suitable filter for detecting light at wavelengths below 400nm. The camera 60 may transmit the image data to a control system 62 for processing (e.g., image analysis, machine learning). The control system 62 may receive the image data of the first scenic spot system 50a and process the image data to identify one or more detectable markers within the first scenic spot system 50a.
[0026] The control system 62 may include a memory 64 and a processing circuitry 66. The memory 64 may include a volatile memory such as a random access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM), an optical drive, a hard drive, a solid-state drive, or any other non-transitory computer-readable medium including instructions for operating the attraction system 50. The memory 64 may also include a database of detectable indicia (e.g., characteristics such as shape, color / wavelength, size, number), one or more associated motions, and associated show effects 58 of the attraction system 50. The processing circuitry 66 may be configured to execute such instructions. For example, the processing circuitry 66 may include one or more application specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), one or more general purpose processors, or any combination thereof.
[0027] The control system 62 may further determine one or more motions (e.g., movement patterns; gestures) associated with the detectable markers and one or more corresponding performance effects 58a of the first attraction system 50a. As such, the control system 62 may detect the motion of one or more detectable markers that may be associated with the performance effect 58a, and in response, automatically trigger the generation of the performance effect 58a. For example, the control system 62 may receive image data with one or more detectable markers from the camera 60. The control system 62 may identify the one or more detectable markers, determine the motion of one of the detectable markers, and determine whether the motion corresponds to an expected input (e.g., a stored motion; a target motion; a target input) to trigger the generation of the performance effect 58a within the first attraction system 50. For example, the control system 62 may search a database or any suitable storage component that may store (one or more) motions and (one or more) performance effects 58a (e.g., associated with each other; in a lookup table; in a library). If the motion corresponds to one of the stored motions, the control system 62 may trigger the generation of the associated or corresponding (one or more) performance effects 58.
[0028] In one embodiment, the control system 62 may implement image recognition techniques such as secondary imaging, template matching, etc. to distinguish the detectable marker from any transferred annotation within the first scenic spot system 50a (e.g., based on the shape of the transferred annotation in the image data). For example, the customer 54 may cover both hands with the detectable marker, and then transfer part of the detectable marker to another object (e.g., body part, clothing, customer) by touching the object (e.g., before the detectable marker has completely dried). As a more specific example, when in the customer area 52, the customer 54 may receive a detectable marker with a UV component (e.g., powder) via a hand sanitizer dispenser. The customer 54 may touch their face before the hand sanitizer has completely dried and transfer part of the detectable marker to their face. The control system 62 may be trained (e.g., machine learning, image recognition) to identify a certain shape of the detectable marker and / or a certain movement associated with the detectable marker. For example, the control system 62 may specifically look for the shape of the hand and / or a certain movement associated with the hand (e.g., waving) to activate the performance effect 58a. As another example, the control system 62 may specifically look for a known shape of a stamp and / or a certain motion associated with a hand (e.g., waving) to activate the performance effect 58a. As such, the control system 62 may identify a detectable marker, determine the motion of the detectable marker, and trigger the performance effect 58a based on the motion of the detectable marker.
[0029] In one embodiment, the first attraction system 50a may also include a ride 68 (e.g., a ride attraction), which may have a vehicle 70 (e.g., a ride vehicle). The ride 68 may include, for example, a roller coaster, a water ride, a motion simulator, a dark ride, etc. To this end, the vehicle 70 may move (e.g., translate, rotate, pivot) around a motion base and / or along a track of the first attraction system 50a. However, it should be appreciated that the vehicle 70 may remain stationary within the first attraction system 50a. One or more customers 54 may be positioned in the vehicle 70. As an example, a customer 54 may enter the vehicle 70 from the customer area 52 and / or leave the vehicle 70 to the customer area 52 to move between the customer area 52 and the ride 68. The ride 68 may provide entertainment to the customer 54, such as by providing the customer 54 with a certain sense of movement through the movement of the vehicle 70. Additionally or alternatively, the show effect 58a may provide entertainment to the customer 54 positioned in the vehicle 70, such as by providing various visual and / or audio effects. In this manner, the show effects 58a may be controlled for the entertainment of patrons 54 in the patron area 52 and / or ride 68.
[0030] In certain embodiments, the control system 62 may be communicatively coupled to the show effect 58a and the ride 68 to facilitate the storytelling aspects of the first attraction system 50a and / or to create an immersive experience for the customer 54. For example, the control system 62 may control the movement of the vehicle 70 within the first attraction system 50a and / or the various outputs provided by the show effect 58a. In one embodiment, the control system 62 may set, adjust, and / or change one or more parameters of the show effect 58a, such as to control the appearance of the show effect 58a. As an example, the control system 62 may adjust the appearance of the show effect 58 by adjusting the intensity, color, and / or illuminated area associated with the light effect. Further, the control system 62 may adjust the movement and / or speed of the vehicle 70. The control system 62 may simultaneously (e.g., in a coordinated manner) adjust both the appearance of the show effect 58 and the movement and / or speed of the vehicle 70 to create an immersive experience, such as to make the show effect 58a appear to move or travel in a certain manner relative to the vehicle 70. For example, the first attraction system 50a may provide a show effect 58a including a monster (e.g., a physical prop or on a display) chasing the ride vehicle 70, and the patrons 54 may move their bodies to move the detectable marker in a manner that causes the control system 62 to create additional show effects 58a against the monster (e.g., performing a striking motion so that the control system 62 simulates a lightning strike near the monster via light effects or on a display; performing an undulating wave motion so that the control system simulates a tsunami wave to knock down the monster in the physical space or on the display; performing a lift and hold motion so that the control system 62 stops the monster in the physical space or on the display; performing a throwing motion so that the control system 62 displays a visual representation of the thrown object hitting the monster on the display). The control system 62 may also adjust the appearance of the show effect 58a in any other suitable manner to provide a specific experience for the patrons 54 in the vehicle 70 and / or the patron area 52 via the show effect 58a. It should be appreciated that the control system 62 may use the movement of the detectable marker to control the movement and / or velocity of the vehicle 70 and the show effect 58a. Thus, the show effects system (which may be considered to include the control system 62, the camera 60, the applicator 56, the vehicle 70, and / or the components that provide / output the show effects 58a) may provide an immersive and interactive experience for the patrons 54 in the first attraction system 50a.
[0031] In one embodiment, the attraction system 50 may include a second attraction system 50b, which may consist of a performance (e.g., a show, a rehearsal, a concert) performed by one or more performers 74 in a performance area 72. The second attraction system 50b may include its own applicator 56 in the performance area 72, which may apply detectable markers to one or more performers 74. In one embodiment, the performer 74 may receive one or more detectable markers on a part of their body for use in generating a performance effect 58b of a component of the performance. For example, the performer 74 may receive detectable markers on both their hands and feet. The camera 60 may generate image data of the performance area 72 and transmit the image data to the control system 62 for image processing (e.g., image recognition, machine learning). In another example, the performer 74 may receive one or more detectable markers to control a more sophisticated performance effect 58b that may benefit from additional points. For example, the performance effect 58b may include a monster with limbs that can be controlled by the performer 74. It may be beneficial to place detectable markers on the hands and feet of performers 74 and to associate the movement of the detectable markers with the movement of the monster to provide a realistic performance. That is, the performance effect system can track four markers rather than the entire skeletal system of performers 74 (e.g., the performer may have multiple markers on each limb). This relatively simplified tracking method may allow detectable markers to be efficiently applied to performers 74 and detectable markers to be efficiently applied to multiple different performers 74 (e.g., with different body shapes and sizes) over time. In this way, the control system 62 may provide accurate and / or realistic live performance effects 58b in real time (e.g., with low latency) in response to the movement of performers 74. As described herein, performance effects 58b may also include light effects, movable objects, smoke effects, audio effects, water effects, sound effects, display effects, etc. For example, show effects 58 may also include one or more three-dimensional props and scenery pieces, mechanical elements, and / or display surfaces presenting media that may be controlled by performer(s) 74 to impart movement to detectable markers located on performer(s) 74. Although show effects 58 b are located outside of performance area 72 in the illustrated second attraction system 50 b, show effects 58 b may be located at least partially within performance area 72 and / or audience area 76.
[0032] In certain embodiments, customers 54 located in the audience area 76 can create performance effects 58b to enhance the performance. That is, the second attraction system 50b may include various audience areas 76 where customers 54 can be located to watch or participate in the performance. In one embodiment, the audience area 76 may include an open space, such as an auditorium where customers 54 can sit, stand or otherwise watch the performance, a walkable area (e.g., a queue or team) where customers 54 can enter the second attraction system 50b, leave the second attraction system 50b or otherwise walk through the second attraction system 50b. Customers 54 in the audience area 76 can receive their own detectable markers via the applicator 56. Then, the detectable marker can be tracked by the camera 60 to trigger the creation of the performance effect 58b during the performance. For example, the audience area 76 may include twenty customers 54. In one embodiment, each customer 54 can receive a detectable marker. As such, the control system 62 can find and track twenty detectable markers corresponding to the customers 54 in the audience area 76 (e.g., only twenty detectable markers, not the skeletal system of each customer in the audience area). In another example, customers 54 in the audience area 76 can create certain show effects 58b (e.g., spells, distractions, objects) to fight or help monsters controlled by the performers 74. In this way, the show effects system can create an improved show experience for the customers 54.
[0033] It should be recognized that Figure 1 The layout and arrangement of the first attraction system 50a and the second attraction system 50b in the embodiment are merely exemplary, and any of the various attraction systems may be arranged in any suitable manner. In addition, any of the various attraction systems may be controlled and / or include a show effects system. In addition, certain components of the show effects system may be shared between attraction systems (e.g., the applicator 56 applies a detectable mark to the patrons 54 of multiple attraction systems), and / or corresponding components of the show effects system may be provided for each attraction system in the attraction system (e.g., one or more cameras 60 are provided for one attraction system and one or more cameras are provided for another attraction system). In practice, the control system 62 may be shared between attraction systems / communicate with an attraction system or may be dedicated to its own attraction system.
[0034] Considering the above, Figure 2is an example illustration of a patron 54 triggering the generation of a show effect 58a within a first attraction system 50a. For example, the patrons 54 in the first attraction system 50a may each have one or more detectable markers that the patron 54 may move in a certain motion to trigger the generation of the show effect 58a. The first attraction system 50a may include a camera 60 that captures image data and transmits the image data to a control system for processing. The control system may identify the one or more detectable markers within the image data and determine a motion of the one or more detectable markers that may or may not correspond to an associated show effect 58a (e.g., one or more of the available show effects 58a).
[0035] In view of the foregoing, the first attraction system 50a may include a ride facility 68 having a vehicle 70 and two customers 54 (e.g., a left customer 54a, a right customer 54b). The customer 54 may have received or applied a detectable marker 90 in the customer area 52 or before entering the vehicle 70. In the illustrated embodiment, the detectable marker 90 may be a point on the hands of the customers 54a, 54b. In other embodiments, the detectable marker 90 may be any suitable size, shape, or detectable wavelength of the UV spectrum (e.g., UV-A, UV-B, UV-C). The detectable marker 90 may also be placed on different parts of the customer 54 (e.g., such as feet, faces, fingers). In another example, customers 54 in different seats of the vehicle 70 and / or on different vehicles 70 may receive a detectable marker 90 on different positions of their hands or on different hands (e.g., right, left), so that the show effect system may distinguish between different customers, vehicles, and / or groups of customers 54. In another example, the show effects system can distinguish between customers 54 by applying (e.g., instructing the applicator 56 to apply; programming the applicator 56 to automatically rotate / dispense throughout) different detectable marks 90 that are detectable at different wavelengths. In another example, the customer 54 can receive a detectable mark 90 that can include a different number of dots, shapes, and / or patterns (e.g., defined or prescribed dots, shapes, and / or patterns, including quick response [QR] codes, bar codes, alphanumeric codes). It should be appreciated that the applicator 56 can be configured to detect existing detectable marks 90 on the customer 54 (e.g., via a camera on the applicator 56) to facilitate the application of different detectable marks 90 to the customer 54 and / or prevent the application of two detectable marks 90 to a single customer 54. These differences in the detectable marks 90 applied to different customers 54 can enable the show effects system to identify the corresponding movement of the detectable marks 90 and provide personalized responses / show effects 58a to the customer 54. For example, each of the patrons 54 may have a personalized avatar (or other personalized features), and the control system may control the avatar (or other personalized features) based on input from the corresponding patron 54. Because the show effects system tracks the detectable markers 90 rather than the entire skeletal system of the patron 54, the system may be quickly able to distinguish between different patrons 54 within the first attraction system 50a and generate responses in real time in response to detecting a trigger / input. In this way, the show effects system may utilize relatively few inputs (e.g., multiple trackers, patron attributes), which may improve efficiency and response time.
[0036] The control system may determine the motion 72a, 72b associated with the respective customers 54a, 54b by tracking the motion of the associated detectable marker 90. For example, the control system may determine the position of the detectable marker 90 that may indicate the respective customers 54a, 54b. The control system may trigger the generation of a show effect 58a associated with the position of the detectable marker 90. For example, the two customers 54a, 54b may move their hands with the detectable marker 90 in different motions to trigger different show effects 58. The left customer 54a may move their hands in a downward motion 72a, and the right customer 54b may move their hands in an upward motion 72b. The control system may determine the motion by tracking the detectable marker 90. The control system may distinguish between the two motions and trigger the creation of different show effects based on the different motions. For example, the downward motion created by the left customer 54a may trigger the generation of the show effect 58a, while the upward motion created by the right customer 54b may not trigger any show effect 58a. In the illustrated embodiment, downward motion may trigger the generation of a ghost (e.g., on a display screen), and upward motion may not trigger any performance effect. The generated performance effect 58a (such as a ghost) may be displayed as being close to the left customer 54a based on the position of the detectable mark 90. The right customer 54b may move their hands to scratch their heads in an upward motion instead of generating a performance effect 58a. Therefore, the control system may distinguish between successful attempts (e.g., the movement matches the library of movements and corresponding performance effects) and unsuccessful attempts (e.g., the movement does not match the library) when creating a performance effect 58a, and generate a successful performance effect 58a that is closest to the detectable mark 90 that triggers the performance effect 58a (e.g., the detectable mark 90 that is closer to the triggering performance effect 58a relative to other detectable marks 90). It should also be recognized that the two movements may trigger the creation of different performance effects (e.g., downward motion generates a ghost, and upward motion turns on the light). Furthermore, two movements simultaneously (eg, substantially simultaneously) or in certain orders (eg, one after the other) may trigger a coordinated performance effect (eg, downward movement creates a ghost, and upward movement causes the ghost to fly away).
[0037] Figure 3is an example illustration of a performer 74 using a show effect 58b to create an immersive and interactive show. For example, the performer 74 may use an applicator 56 to apply a detectable marker 90, and the camera 60 of the second attraction system 50b may track the marker 90. In the illustrated embodiment, the performer 74 may apply the detectable marker 90 to a foot or shoe. However, the performer 74 may apply the detectable marker 90 to a hand, face, or any suitable body part. When the detectable marker 90 is applied to the performer 74, depending on the show and / or the associated show effect 58b, the detectable marker 90 may include one or more shapes (e.g., dots, squares) having one or more UV wavelengths. For example, the performer 74 may control an animated image (e.g., a real physical image; a virtual image on a display screen), such as a wizard, a shark, a monster, a superhero, etc. It may be beneficial to apply multiple detectable markers 90 to the performer 74 so that the performer 74 can control one or more different parts of the animated image individually and / or more finely. For example, if the performer 74 waves their right hand with one of the detectable markers 90 and kicks their right foot with one of the detectable markers, the control system may cause the animated avatar to also move their right hand and their right foot (e.g., mimicking the performer 74). It should be appreciated that the performer 74 may cause any of a variety of show effects 58b (e.g., not just mimicking the performer 74; waving their right hand causes the color of a light to change, kicking their right foot causes a sound effect, etc.). The show effects system may not be calibrated to the height or size of the performer 74 as some skeletal systems are, but rather the show effects system disclosed herein may associate one or more detectable markers 90 with one or more body parts of the performer and one or more corresponding body parts of an animated avatar (or other show effect 58b). Thus, the show effects system may trigger the show effects 58b in real time with low latency control of the animated avatar or other show effect 58b.
[0038] The show effects system can associate the movement of the performer 74 with the show effects 58b by tracking one or more detectable markers 90 on the performer 74. For example, the camera 60 can capture image data of the performer 74, and the control system can identify the detectable markers 90 on the performer's feet. In the illustrated embodiment, the performer 74 can move the foot with the detectable marker 90 in a kicking motion (such as kicking a ball). Thus, the control system can determine that the detectable marker 90 travels through the space (e.g., as indicated by the image data) in a manner that matches (e.g., substantially matches) a stored kicking motion (e.g., a target kicking motion; in the library). The control system can also determine and identify that the stored kicking motion can be associated with a specific show effect 58b (e.g., via the library), such as a football flying through the performance area 72 and / or the audience area 76. As such, the show effects system can generate a performer-directed show effect 58b in response to identifying the movement of the detectable marker 90 (e.g., a kicking motion with the detectable marker 90) and the corresponding show effect 58b.
[0039] In another example, the performance may be set in a fantasy or virtual world. Performer 74 may be an animated image (such as a warrior) presented on a display screen, stepping through a forest. The performance effects system may track the body parts of performer 74 via detection of detectable markers 90 to control one or more limbs of the animated image or accurately track or follow the movement of performer 74. Additionally or alternatively, performance area 72 may have one or more 3D props, physical props, electrical components, chemical components and / or displays to facilitate the storytelling aspects of the performance. For example, performer 74 may control a warrior being chased through a forest by a monster. As such, it may be beneficial for the performance effects system to associate one or more body parts of performer 74 to one or more body parts of a warrior. Detectable markers 90 may be placed on the feet, hands and / or head of performer 74, which may be used to control similar body parts of a warrior. When a warrior is presented as running through a forest, performer 74 may perform evasive movements so that the warrior appears to evade (e.g., is presented as evading) one or more trees of a fantasy world. Thus, the performance effects system can provide real-time performance effects 58b in response to the movements of the performer 74.
[0040] Additionally or alternatively, the customers 54 in the audience area 76 may also create performance effects 58b during the performance. For example, the customers 54 may receive detectable markers 90 through the applicators 56 in the audience area 76. The performer 74 may request the customer 54 (or the customer 54 may be prompted in any suitable manner) to create a certain movement with detectable markers 90 as part of the performance. For example, the performer 74 may teach the customer 54 how to create a spell, shoot an arrow, and / or perform other attacks as part of the performance. In another example, the customer 54 may fight the performer 74 in the fantasy world by moving the detectable markers 90 in some way that causes the performance effects system to create and / or present additional monsters or obstacles for the performer 74 to avoid or confront. Therefore, the performance may allow the performer 74 and the customer 54 to interact with both the physical and digital worlds to create an immersive experience for the customer 54.
[0041] Figure 4 is an example illustration of an embodiment of an applicator 56 that can be used to apply a detectable mark 90 to a customer 54 and / or a performer 74. In the illustrated embodiment, the applicator 56 may include one or more holes 92 that can output the detectable mark 90 to the customer 54 or the performer 74. For example, the performer 74 can place a hand over one or more holes 92 so that the detectable mark 90 is strategically applied to one side of the hand. As shown, the applicator 56 is configured to form a detectable mark 90 with three points on the palm, although the detectable mark 90 may include any number of points or separate areas (e.g., 1, 2, 3, 4, 5 or more) in any suitable arrangement. In another example, the customer 54 can place the hand over the hole 92 and receive a single point on the back of the hand. In one embodiment, the applicator 56 may also include a slot 94 that can receive and accommodate the hand to facilitate the application of the detectable mark 90. For example, the customer 54 can place the hand into the slot 94, and then the detectable mark 90 is applied to the hand positioned in the slot 94. The applicator 56 may also apply the detectable marker 90 to the customer 54 as the customer 54 walks by and / or stands near one or more apertures 92. The applicator 56 may apply the detectable marker 90 to one individual at a time or to multiple individuals simultaneously.
[0042] The detectable marker 90 may be a liquid, gel, stamp, or powder with a UV component (e.g., powder, chemical) detectable by the camera 60. The detectable marker 90 may be a single point with a single UV wavelength or multiple points with one or more UV wavelengths. As such, the detectable marker 90 may be distinguished by the camera 60 (e.g., UV-A, UV-B, UV-C). For example, the customer 54 may place their hand in the slot 94 of the applicator 56 to receive a spray of powder with a detectable marker 90 of a certain wavelength. The detectable marker 90 may also be placed on any body part of the customer 54 or the performer 74. For example, the detectable marker 90 may be placed on the hand, face, foot, arm, leg, or any suitable position. In addition, the placement of the detectable marker 90 may not need to be precise, because the camera 60 may identify the detectable marker 90 and associate movement, rather than creating or mapping the entire skeletal system. The shape or size of the detectable marker 90 may not need to be precise, because the performance effects system may use image recognition or machine learning technology to identify the marker 90. For example, the customer 54 may accidentally receive a semicircle instead of a full circle as the detectable mark 90. The show effect system may use image recognition technology and / or machine learning (e.g., the machine learning model is trained and / or updated over time) to identify the semicircle as the detectable mark 90. In another example, the show effect system may determine the movement of the semicircular detectable mark 90 and associate the movement with the show effect 58 as explained herein. The show effect system may then further trigger the generation of the show effect 58 based on the movement of the semicircular mark 90.
[0043] In one embodiment, the applicator 56 may be a container, such as a bottle, of a lotion or hand sanitizer for the customer 54 or performer 74 to apply the detectable marker 90 themselves. For example, the customer 54 may apply a hand sanitizer having a UV component as the detectable marker 90. As such, the customer 54 may coat both hands with the detectable marker 90. In another embodiment, the applicator 56 may be a hidden or invisible applicator. For example, the applicator 56 may be an element in an attraction, a restraint (e.g., a lapbar or seat belt) of a vehicle 70, an armrest, etc. For example, a customer may touch and / or approach (e.g., approach) an object, such as a baseball, a storybook, a wand, or a hat, to apply the detectable marker 90. The object may be applied inconspicuously (e.g., unknown to the customer 54 and / or not perceived by the customer 54) via the spitting of a powder or application of another substance to a body part (e.g., a hand, foot, face) of the customer 54 with the detectable marker 90. In this way, the applicator 56 may facilitate the storytelling aspect of a ride or show. In yet another embodiment, the applicator 56 may be a stamp that may be applied to the customer 54 by an operator or by the customer 54. In yet another embodiment, the applicator 56 may be a makeup kit that may be used to apply the detectable mark 90 to the face or other body part of the performer 74.
[0044] The applicator 56 may also include one or more reservoirs containing detectable markers 90 and / or UV compositions (e.g., powders, gels, liquids). The UV composition may allow the detectable markers 90 to be detected by the camera 60 (e.g., a UV camera) at different wavelengths (e.g., UV-A, UV-B, UV-C) to distinguish between different body parts of the patrons 54 or patrons 54 and / or performers 74. For example, different groups of patrons 54 entering the attraction may receive detectable markers 90 with different UV compositions, which may correspond to different teams on the ride 68. The camera 60 may look for the exact wavelength to distinguish between the patrons 54. As such, groups of patrons 54 may fight, compete, work together, etc. during the ride 68. In this way, the patrons 54 may have a more interactive experience on the ride 68. In another embodiment, the patrons 54 and / or performers 74 may have personalized avatars (e.g., avatars, animated characters) that may be controlled by the show effects 58. As such, it may be beneficial for a show effects system to associate the detected wavelength of the detectable marker 90 with a personalized avatar of the patron 54 or to associate the detected wavelength with an animated image of the performer 74. Thus, the patron 54 and / or performer 74 may enter an environment having the ability to trigger a show effect 58 without having to bring, carry, or touch / manipulate a prop or something tangible.
[0045] In one embodiment, the detectable marker 90 can be a non-toxic material and invisible to the human eye. Although the illustrated embodiment describes a detectable marker 90 comprising a UV powder, the detectable marker 90 can include an infrared (IR) powder, a liquid, a gel, or any other suitable component that can be invisible to the human eye. In another embodiment, the detectable marker 90 can be a visible marker, such as a stamp, a sticker, a label, or any suitable marker to track the movement of the customer 54 or the performer 74. For example, the detectable marker 90 can be a small stamp from an ink pad that can be applied by an operator to promote the storytelling aspect of the environment. The environment can be a train station, and the customer 54 can receive the stamp as a ticket to board the train. As such, it can be beneficial for the customer 54 to receive a visible marker to advance the story. The system can track the visible marker and the movement that can be associated with the visible marker.
[0046] Figure 51 is an example method 120 for identifying a detectable marker 90 in image data and generating a performance effect 58 based on the movement of the marker 90. For example, a customer 54 may receive a detectable marker 90 through an applicator 56 in a customer area 52 to create a performance effect 58. In another example, a performer 74 may receive a detectable marker 90 on their hand to create a performance effect 58 (e.g., control an animated character) during a performance. As described herein, the detectable marker 90 may include a UV component that can be identified by a camera 60.
[0047] The method 120 includes various steps represented by boxes. It should be noted that the method 120 can be performed by a control system such as Figure 1 The method 120 may be performed as an automated process by a control system 62 of the system. Although the flowchart illustrates the steps in a certain order, it should be understood that the steps may be performed in any suitable order and, where appropriate, certain steps may be performed simultaneously. In addition, certain steps or portions of the method 120 may be performed by separate systems or devices.
[0048] At block 122, the control system 62 may receive image data from the camera 60 from the ride 68, the customer area 52, the performance area 72, and / or the audience area 76. For example, the camera 60 may be placed within the ride 68 and capture image data of a vehicle 70 with one or more customers 54 as it travels through the ride 68. In another example, the camera 60 may be placed within the performance area 72 and / or the audience area 76 and capture image data of performers 74 and / or customers 54. As such, the camera 60 may establish one or more detectable markers 90 within the image data.
[0049] At box 124, the control system 62 may identify the detectable marker 90 within the image data. For example, the detectable marker 90 may be one or more points of a size, shape, wavelength, pattern, etc. that may be applied by the applicator 56. If the customer 54 and / or the performer 74 coats their hands with the detectable marker 90, the shape of the detectable marker 90 may be their hands. As such, the control system 62 may use machine learning and / or image recognition techniques to identify one or more hands present within the environment. In another example, the camera 60 may detect certain wavelengths of the detectable marker 90, such as UV-B. As such, the control system 62 may identify the shape and wavelength of the detectable marker 90 within the image data. In certain embodiments, the customer 54 and / or the performer 74 may often unintentionally transfer the detectable marker 90 to other parts of their body, to other people, or within the environment. For example, the customer 54 may apply a lotion with the detectable marker 90 and touch their face before the lotion has completely dried. As such, the customer 54 may transfer part of the detectable marker 90 to their face. The control system 62 may use secondary template imaging techniques to identify the detectable marker 90 and filter out (e.g., discard, ignore) the transferred portion. In another example, the performer 74 may receive the detectable marker 90 shaped as a circle. However, the applicator 56 may apply an incomplete circle (e.g., a half circle, a quarter circle), such as if the reservoir is depleted of detectable marker material. The control system 62 may be able to identify the detectable marker 90 by utilizing image recognition techniques to estimate a circle or complete a circle and / or by classifying an incomplete circle as a circle (e.g., the training set includes incomplete circles) via machine learning techniques.
[0050] At block 126, the control system 62 may determine the movement of the marker 90. The control system 62 may track the detectable marker 90 to determine the movement. For example, the customer 54 may receive the detectable marker 90 on the left hand. The customer 54 may move the left hand in a pattern, motion, or movement. The control system 62 may track the detectable marker 90 on the left hand as customer input. In another example, the performer 74 may receive one or more detectable markers 90 on one or more body parts. The control system 62 may track the movement of the one or more detectable markers 90 as performer input.
[0051] At box 128, the control system 62 may determine whether the motion is associated or corresponds to the expected input (e.g., stored motion; target motion; target input). For example, the control system 62 may include a database of expected inputs and corresponding performance effects 58. The control system 62 may further associate the attraction system (e.g., the first attraction system 50a, the second attraction system 50b) with the corresponding performance effects 58a, 58b. For example, the first attraction system 50a may be associated with a fantasy dragon world, and the expected input and / or corresponding performance effects may also be associated with the dragon world. Customers 54 in the environment may wave their hands with detectable markers 90 to trigger the dragon to blow fire. Customers 54 may shake their hands to help break the dragon eggs. In another example, the attraction system may be associated with a football game, and as such, the expected input and / or corresponding performance effects may be associated with kicking and blocking a football. The control system 62 may analyze the image data to determine whether the motion matches the expected input and is thus associated with and / or causes any performance effect 58. As such, the control system 62 may check the database for any expected input that matches the motion, movement, or pattern received at block 126 .
[0052] In some embodiments, the control system 62 may determine that the motion may not be associated with an expected input for triggering the show effect 58. As such, the system may not generate the show effect 58. For example, the customer 54 may leave a residual mark (e.g., a portion of a UV composition) on the carrier 70. The movement of the residual mark may not be associated with the motion and therefore may not cause the show effect 58. In another example, the customer 54 may move the detectable mark 90 in a motion that may not be recognized by the control system 62. For example, the customer 54 may move their hand to scratch their head. This upward movement may not be recognized by the control system 62 as matching any expected input, and therefore, the control system 62 may ignore the movement and may not trigger the show effect 58. The process may return to box 122 to receive image data from the camera 60.
[0053] In one embodiment, the control system 62 may determine that the motion corresponds to an expected input. At block 130, the control system 62 may generate a performance effect 58 based on the motion of the indicia 90. For example, the customer 54 may move their hand in a downward motion, and the control system 62 may associate the downward motion with triggering the generation of the performance effect 58. Figure 2 , downward movement of the detectable marker 90 can create a phantom. Tracking of the detectable marker 90 can limit the variability of the show effects system and allow the show effects system to accurately and quickly distinguish between successful and unsuccessful movements. In this way, the show effects system can respond to triggers in real time, thereby creating an immersive experience for the patrons 54. The patrons 54 and performers 74 can be collectively referred to as users or participants of the show effects system.
[0054] Although only certain features of the present invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is therefore to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention. Figure 1-5 Rather, any features shown and described may be combined in any suitable manner.
[0055] The technology presented and claimed herein is cited and applied to substantial objects and specific examples that demonstrably improve the practical nature of the art, and as such is not abstract, intangible, or purely theoretical. In addition, if any claim appended to the end of this specification contains one or more elements designated as "a means for (performing) ... (function)" or "a step for (performing) ... (function)", it is intended that such elements are to be interpreted in accordance with 35 U.S.C. 112(f). However, for any claim containing elements designated in any other manner, it is intended that such elements are not to be interpreted in accordance with 35 U.S.C. 112(f).
Claims
1. A performance effect system, comprising: an applicator configured to apply a detectable marker, wherein the detectable marker comprises an ultraviolet (UV) component having a detectable wavelength range corresponding to UV-A, UV-B, or UV-C; a camera configured to generate image data representing the environment having the detectable marker; and a control system communicatively coupled to the camera and comprising a processor and a memory, wherein the memory stores instructions executable by the processor, and wherein the instructions are configured to cause the processor to: determining movement of the detectable marker based on the image data; determining that the movement of the detectable marker corresponds to target movement; identifying a performance effect associated with the target motion; and Triggering the generation of the performance effect in the environment.
2. The performance effect system according to claim 1, wherein: The detectable mark comprises a single point on a patron or performer in the environment.
3. The performance effect system according to claim 1, wherein: The detectable marks include a plurality of points on patrons or performers in the environment.
4. The performance effect system according to claim 1, wherein: The applicator is configured to apply the detectable mark to a hand of a patron or performer.
5. The performance effect system according to claim 1, wherein: The applicator includes a container of lotion or hand sanitizer; and The lotion or the hand sanitizer is configured to be applied by a customer to coat one or more hands of the customer.
6. The performance effect system according to claim 1, wherein: The applicator is configured to apply the detectable mark such that a first customer receives the detectable mark having the UV component at a first wavelength and a second customer receives the detectable mark having the UV component at a second wavelength, and the instructions are configured to cause the processor to distinguish the first customer from the second customer based on the image data indicative of the first wavelength and the second wavelength.
7. The performance effect system according to claim 1, wherein: The instructions are configured to cause the processor to apply an image recognition algorithm to identify a particular representation of the detectable marker in the image data.
8. The performance effect system according to claim 1, wherein: The applicator is configured to apply the detectable marker having a shape, and the instructions are configured to cause the processor to apply a machine learning algorithm to identify the detectable marker in the image data when the detectable marker has the shape or a similar shape.
9. The performance effect system according to claim 1, wherein: The performance effects include light effects, sound effects, movement of physical objects, smoke effects, water effects, display effects, or any combination thereof.
10. The performance effect system according to claim 1, wherein: The performance effect includes changes to the animated character presented on the display screen.
11. The performance effect system according to claim 1, wherein: The marker comprises a powder or a liquid.
12. A performance effect method, comprising: applying a marking to a customer via an applicator, wherein the marking comprises a chemical composition detectable in a wavelength range between 10 and 400 nanometers; receiving, using one or more processors, image data from a camera configured to record image data in the wavelength range between 10 and 400 nanometers, wherein the image data represents the marker in an environment; identifying, using the one or more processors, a particular representation of the marker within the image data; determining, using the one or more processors, motion of the marker based on the image data; determining, using the one or more processors, that the movement of the marker corresponds to target movement; identifying, using the one or more processors, a dramatic effect associated with the target motion; and The one or more processors are used to generate the performance effect in the environment.
13. The performance effect method according to claim 12, wherein: The mark is a temporary mark applied to the skin or clothing of the customer.
14. The performance effect method according to claim 12, wherein: The marking includes a first portion on the customer's left hand and a second portion on the customer's right hand, wherein the first portion includes the chemical component detectable in a first region of the wavelength range and the second portion includes the chemical component detectable in a second region of the wavelength range.
15. The performance effect method according to claim 12, wherein: Identifying the marker includes isolating a shape of the marker within the image data using the one or more processors.
16. The performance effect method according to claim 12, comprising: identifying, using the one or more processors, respective specific representations of additional markers within the image data; as well as The one or more processors are used to ignore the corresponding particular representation of the additional marker based on the shape of the additional marker by not generating any additional performance effects in the environment based on the additional marker.
17. The performance effect method according to claim 12, comprising: applying additional indicia to additional customers via the applicator; identifying, using the one or more processors, respective specific representations of the additional indicia within the image data; determining, using the one or more processors, additional motion of the additional marker based on the image data; determining, using the one or more processors, that the additional motion of the additional marker corresponds to additional target motion; identifying, using the one or more processors, an additional performance effect associated with the additional target motion; as well as The one or more processors are used to generate the additional performance effects in the environment.
18. A performance effect system, comprising: A control system comprising a processor and a memory, wherein the memory stores instructions executable by the processor, and the instructions are configured to cause the processor to: receiving image data representing a tag applied to a patron or performer in an environment, wherein the tag includes an ultraviolet (UV) component; determining a motion of the marker based on the image data; determining that the movement of the marker corresponds to target movement; identifying a performance effect associated with the target motion; and Triggering the generation of the performance effect in the environment.
19. The show effects system of claim 18, comprising an applicator configured to apply the indicia to the patron or the performer.
20. The performance effect system according to claim 18, wherein: The marking comprises a specified size, a specified pattern, a detectable wavelength between 10 and 400 nanometers, or any combination thereof.
