Performance effect system for amusement park scenic spot system

Abstract

A system (50) for a scenic spot includes a sensor (76) configured to capture an image (77) of a real-world environment and a control system (70) communicatively coupled to the sensor (76). The control system (70) is configured to receive the image (77) captured by the sensor (76), identify real-world elements of the image (77), generate image data comprising virtual elements corresponding to the real-world elements, and transmit the image data for presentation in the scenic spot.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority to and the benefit of U.S. Provisional Application No. 63 / 398,054, filed on August 15, 2022, and entitled “SHOW EFFECT SYSTEM FORAMUSEMENT PARK ATTRACTION SYSTEM,” which is incorporated herein by reference in its entirety for all purposes. Background Art

[0002] This section is intended to introduce the reader to various aspects of the technology that may be related to the various aspects of the technology presented, which are described and / or claimed below. It is believed that this discussion is helpful in providing the reader with background information to promote a better understanding of the various aspects of the present disclosure. Therefore, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0003] Throughout amusement parks and other entertainment venues, special effects can be used to help immerse customers in the experience of a ride or attraction. An immersive environment may include three-dimensional (3D) props and scenery pieces, robotic or mechanical elements, and / or display surfaces that present media. In addition, an immersive environment may include audio effects, smoke effects, and / or motion effects. Thus, an immersive environment may include a combination of dynamic and static elements. However, the operation and implementation of special effects may be complex. For example, it may be difficult to operate certain elements of special effects in a desirable manner to create an immersive environment. With the growing sophistication and complexity of modern ride attractions, and the corresponding growth expected among customers, improved and more creative attractions are desirable, including ride attractions with special effects for providing an immersive environment. Summary of the invention

[0004] Certain embodiments commensurate in scope with the originally claimed subject matter are summarized below. These embodiments are not intended to limit the scope of the claimed subject matter, but rather these embodiments are intended only to provide a brief overview of possible forms of the subject matter. Indeed, the subject matter may encompass a wide variety of forms that may be similar or different from the embodiments set forth below.

[0005] In one embodiment, a system for an attraction includes: a sensor configured to capture an image of a real-world environment and a control system communicatively coupled to the sensor. The control system is configured to receive the image captured by the sensor, identify real-world elements of the image, generate image data including virtual elements corresponding to the real-world elements, and transmit the image data for presentation in the attraction.

[0006] In one embodiment, a non-transitory computer-readable medium includes instructions that, when executed by a processing circuit module, cause the processing circuit module to: receive a captured image, identify a first type or a first group density of real-world elements in the captured image, generate image data having virtual elements corresponding to the first type or the first group density, and output the image data for presentation.

[0007] In one embodiment, a system includes: a display configured to present an image and a control system configured to perform operations, the operations including: receiving an image of a real-world environment, identifying visual characteristics of real-world objects in the image, generating image data including virtual objects corresponding to the visual characteristics of the real-world objects and additional virtual objects, and transmitting the image data to the display. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] These and other features, aspects and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which like characters represent like parts throughout the drawings, and in which:

[0009] Figure 1 is a schematic diagram of an embodiment of an amusement park system according to an aspect of the present disclosure;

[0010] Figure 2 is a schematic diagram of an embodiment of an amusement park system according to an aspect of the present disclosure;

[0011] Figure 3 is a schematic diagram of an embodiment of a performance effect system configured to present an image according to an aspect of the present disclosure;

[0012] Figure 4 is a schematic diagram of an embodiment of a performance effect system configured to present an image according to an aspect of the present disclosure;

[0013] Figure 5 is a schematic diagram of an embodiment of a performance effect system configured to present an image according to an aspect of the present disclosure;

[0014] Figure 6 is a flow chart of a method or process for operating a performance effects system to present an image according to an aspect of the present disclosure;

[0015] Figure 7 is a flow chart of a method or process for operating a performance effects system to present an image according to an aspect of the present disclosure; and

[0016] Figure 8 is a flowchart of a method or process for operating a performance effects system to present an image according to one aspect of the present disclosure. DETAILED DESCRIPTION

[0017] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements besides the listed elements. Additionally, it should be understood that references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

[0018] One or more specific embodiments of the present disclosure will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation may be described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. In addition, it should be appreciated that such development work may be complex and time consuming, but will be no more than a routine task of design, fabrication, and manufacturing for a person of ordinary skill who benefits from the present disclosure.

[0019] Embodiments of the present disclosure are directed to systems for amusement parks. An amusement park may include various attraction systems having features that can entertain customers at the amusement park, such as rides (e.g., roller coasters, water rides, drop towers), performances, walkways, and the like. The amusement park also includes a show effects system configured to operate to present various effects (such as visual effects and / or audio effects) to customers. For example, the show effects system may be part of an attraction system and present special effects to customers within the attraction system (such as customers within a ride vehicle of the attraction system, customers at a queue of the attraction system, customers in an auditorium of the attraction system, and the like). Additionally or alternatively, the show effects system may be external to any attraction system and may present show effects, for example, to customers at passages, dining areas, souvenir shops, and the like of the amusement park. The show effects system may provide an immersive environment for customers to entertain them.

[0020] It may be desirable to present more realistic show effects to customers in order to provide a more realistic environment and improve the experience provided to customers. For example, it may be desirable to display digital or virtual elements or objects that are similar to real-world elements or objects of the surrounding environment. In this way, the show effects system can provide an environment that more closely reflects the surrounding real-world environment. Therefore, the show effects system can create a more realistic environment for customers and improve the immersive experience provided by the show effects system.

[0021] Therefore, embodiments of the present disclosure are directed to a performance effect system that can receive a captured image of a real-world environment and present an image based on the captured image. For example, the performance effect system may include a control system that can identify one or more real-world elements of the captured image. The control system may then generate image data with virtual elements corresponding to the one or more real-world elements identified. For example, corresponding to the one or more real-world elements identified may include imitating, representing, modeling, simulating and / or supplementing the one or more real-world elements identified. The control system may transmit the image data to a device (such as a projector and / or a display device) to present an image based on the image data. In some embodiments, modeling (e.g., simulating) the real-world elements via virtual elements may enable the presented image to closely represent the real-world environment associated with the captured image. For example, the virtual element image presented by the performance effect system may have an appearance similar to the appearance of the captured image of the real-world element. Additionally or alternatively, the virtual element may correspond to detected features (e.g., characteristics, visual characteristics) of the real-world elements within the captured image, such as density, movement, size, geometry (e.g., shape), color, etc. Thus, the virtual elements may correspond to the characteristics of the real-world elements and thus appear visually similar to the real-world elements, although in some embodiments the virtual elements may not match the type of the real-world elements. Thus, the images may blend into the real-world environment and may provide a seamless transition between the real-world environment and the effects provided by the show effects system. Thus, the show effects system may provide the customer with a more realistic and / or immersive environment that corresponds to the real-world environment.

[0022] Considering the previous content, Figure 1 is a schematic diagram of an embodiment of an amusement park system 50. As an example, the amusement park system 50 can be part of an attraction system, such as a ride facility (e.g., a roller coaster, a hidden ride facility), a show, and the like. As another example, the amusement park system 50 can be part of a dining place, a waiting area, a walkway, a shopping place (e.g., a gift shop), or any other suitable part of an amusement park. The amusement park system 50 may include a customer area 52 in which customers can be located. For example, the customer area 52 may include a ride vehicle 54 that can move and change its position, location, and / or orientation within the amusement park system 50. The customer area 52 may additionally or alternatively include a navigation path 56 (such as outside the ride vehicle 54) used by customers to navigate (e.g., walk) through the amusement park system 50. The customer area 52 may also include an auditorium 58, which may include an arrangement (such as a seating area and / or a standing area) in which customers can be located. In fact, the customer area 52 may include any suitable features to accommodate customers within the amusement park system 50.

[0023] The amusement park system 50 may also include a show effect system 60 configured to provide entertainment to customers in the customer area 52. For example, the show effect system 60 may include a display 62 configured to present an image 64 visible to the customer. The display 62 may be a light emitting diode (LED) display, a liquid crystal display (LCD), a plasma display, an electronic paper display, a cathode ray tube (CRT) display, etc. configured to output an image. Additionally or alternatively, the display 62 may include a projector configured to output an image onto a surface for presentation to the customer. The display 62 may be part of a prop, such as an animated character, a structure (e.g., a wall, ceiling, floor), or any other suitable part of the amusement park system 50. Customers may view the image 64 output by the display 62. Thus, the show effect system 60 may provide visual effects to the customer. By way of example, the image 64 output by the display 62 may include virtual or digital elements corresponding to real-world elements to immerse the customer in a realistic or semi-realistic environment. By way of further example, the images 64 output by the display 62 may include virtual or digital elements that mimic or simulate real-world elements to immerse the customer in a realistic or semi-realistic environment.

[0024] In addition, the display 62 may include a receiver and / or a transceiver configured to receive image data. In particular, the display 62 may receive image data from the control system 70 via a transmitter and / or a transceiver (e.g., the processing circuit module 74, via a transmitter and / or a transceiver). In some embodiments, the display 62 may be communicatively coupled to the receiver and / or the transceiver. Thus, the display 62 may receive data via a communicatively coupled receiver and / or transceiver. For example, the control system 70 may send image data to the display 62 via a transmitter and / or a transceiver, and the display 62 may receive the image data via a communicatively coupled receiver and / or a transceiver.

[0025] The show effects system 60 may also be configured to provide other types of effects to customers. For example, the show effects system 60 may also include an audio emitter 68 (such as a speaker) to provide audio effects that supplement the image 64 provided by the display 62. In one example, the image 64 provided by the display 62 may simulate rain and lightning, and the audio effects provided by the audio emitter 68 may simulate thunder. In this example, the display 62 and the audio emitter 68 may jointly provide a realistic storm environment to customers. The show effects system 60 may additionally include other types of show effect features and / or components, such as fog emitters, fans, lighting, animated characters, props, actuation members, aroma diffusers, flame emitters, smoke emitters, fireworks, water emitters, and the like.

[0026] The show effect system 60 may also include a control system 70 (e.g., a controller, an automation controller, a programmable controller, an electronic controller, a control circuit module), which is configured to operate components of the show effect system 60, such as the display 62 and / or the audio transmitter 68. The control system 70 may include a memory 72 and a processing circuit module 74. The memory 72 may include a volatile memory (such as a random access memory (RAM)) and / or a non-volatile memory (such as a read-only memory (ROM), an optical drive, a hard drive, a solid-state drive) or any other non-transitory computer-readable medium including instructions for operating the amusement park system 50. The processing circuit module 74 may be configured to execute such instructions. For example, the processing circuit module 74 may include one or more application specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof. In addition, the control system 70 may include a transmitter and / or a transceiver configured to transmit image data. In particular, the control system 70 may transmit (e.g., output, send) image data to the display 62 via the transmitter and / or the transceiver. In some embodiments, the control system 70 (e.g., the processing circuit module 74) can be communicatively coupled to the transmitter, transceiver, and / or receiver. Thus, the control system 70 can send (e.g., output, transmit) data via the communicatively coupled transmitter and / or transceiver, and / or receive data via the communicatively coupled receiver and / or transceiver. For example, the control system 70 can send image data via the communicatively coupled transmitter and / or transceiver (e.g., to the display 62), and / or receive image data via the communicatively coupled receiver and / or transceiver (e.g., from the sensor 76).

[0027] In addition, the control system 70 may, for example, operate the display 62 to control the image 64 output by the display 62. In an embodiment, the control system 70 may transmit image data to the display 62 for output as the image 64. For example, the control system 70 may transmit image data to cause the display 62 to output an image 64 corresponding to a real-world element in the surrounding environment of the show effects system 60 and / or the customer area 52. As another example, the control system 70 may transmit image data to cause the display 62 to output an image 64 that mimics or simulates a real-world element in the surrounding environment of the show effects system 60 and / or the customer area 52. In an embodiment, the control system 70 may identify the real-world element in the surrounding environment, generate image data including a virtual element (e.g., a primary virtual element) that corresponds to (e.g., represents, mimics, models, simulates, supplements the real-world element), and transmit the image data to the display 62 to cause the display 62 to output the image 64 based on the image data. Thus, the image 64 presented by the display 62 may include a virtual element that corresponds to (e.g., mimics, represents, models, simulates, supplements the real-world element). By way of example, the imitation of real-world elements via virtual elements can make the image 64 appear to blend into the surrounding environment from the customer's perspective. In this way, customers can be immersed in an environment that seamlessly transitions between the environment provided by the show effects system 60 (e.g., a virtual environment) and the real-world environment surrounding the amusement park system 50. Therefore, the environment provided by the show effects system 60 can appear more realistic. For example, a customer transitioning from an outdoor portion of a queue may not fully realize that the indoor imagery provided by the display 62 is not an outdoor environment, because real weather and / or foliage patterns can be simulated in the generated imagery based on the detection of outdoor conditions. This allows the introduction of desired artifacts (e.g., a sun or moon with human features, or flying pigs flying through an otherwise realistic sky) in a simulated environment that feels consistent with a real outdoor environment.

[0028] The show effects system 60 may include a sensor 76 communicatively coupled to the control system 70. The sensor 76 may be configured to provide data (e.g., sensor data) indicative of the surrounding environment to the control system 70. For example, the sensor 76 may include an optical sensor (such as a camera) configured to capture an image 77 (e.g., one or more images) of the surrounding environment, and the data provided to the control system 70 may include the captured image 77. In some embodiments, the sensor 76 may detect characteristics associated with the surrounding environment (e.g., cloud and / or foliage shape, movement, and corresponding positioning). In particular, the sensor 76 may detect the temperature of the surrounding environment (e.g., heat), the amount of light (e.g., sunlight), the frequency and / or wavelength of electromagnetic radiation, moisture (e.g., humidity), pressure, or any combination thereof. For example, the sensor 76 may include a temperature sensor and / or a light sensor. In such embodiments, the sensor 76 may detect the temperature of the surrounding environment. , moisture, sound, atmospheric pressure, The control system 70 may be provided with data that may indicate weather conditions (e.g., rainy, sunny, hot, cold, cloudy) of the surrounding environment. Additionally or alternatively, the control system 70 may receive characteristics associated with the surrounding environment from an external source, such as weather conditions, time of day, time of year (e.g., season), temperature, or any combination thereof. The external source may be, for example, a weather service, an external database, a global positioning service (GPS), a network time protocol (NTP), or any combination thereof.

[0029] continue Figure 1, the control system 70 may identify one or more real-world elements within the captured image 77 and generate image data based on the identified real-world elements. The real-world elements may include any aspect of the environment captured by the sensor 76 or detected in the data output of the sensor 76 (e.g., the data output of the sensor may include the image 77). The real-world elements may be categorized by the type of the real-world element, where the type of the real-world element may include plants (e.g., trees, flowers), animals, people, man-made structures (e.g., buildings, roads, bridges), terrain (e.g., mountains, hills, rocks, sand), or other aspects of the real world. As an example, as described herein, the control system 70 may determine the type of the real-world element (e.g., a tree) in the captured image 77 and generate image data (e.g., a computer-generated graphic of the tree), the image data including the virtual element in the image 64 having an appearance matching the type of the real-world element. Additionally or alternatively, in some embodiments, the control system 70 may identify (e.g., determine) characteristics and / or features associated with the identified real-world element from the captured imagery 77, and generate image data based on the identified characteristics and / or features of the real-world element, the image data including the virtual element having virtual characteristics (e.g., visual characteristics). As an example, the control system 70 may identify the real-world element as including a tree, and identify one or more characteristics (e.g., visual patterns) associated with the tree, such as the size, shape, movement, coloring, etc. of the tree. As in this example, the control system 70 may identify the characteristics as being relatively tall, swaying (e.g., such as being moved by the wind), and / or relatively thin along the trunk of the tree. Furthermore, the control system 70 may generate image data including the virtual element, the virtual element having virtual characteristics similar to the identified characteristics associated with the real-world element. In other words, the virtual element may include a stylized rendering of the real-world element such that the overall pattern and / or characteristics of the virtual element match the detected pattern and / or characteristics of the real-world element, even though the virtual element may be of a different type than the real-world element. Continuing with this example, the virtual element may include a dinosaur with a long neck, and the dinosaur may include visual patterns and / or characteristics that correspond to the identified characteristics of the tree associated with the captured image 77 (e.g., relatively tall, swaying, and / or relatively thin). Thus, the displayed image 64 may include a virtual element (such as a dinosaur) having an appearance similar to the identified real-world element (such as a tree). In another example, cloud shapes and arrangements may be mimicked by depictions of butterflies. As an additional example, additionally or alternatively, the virtual element may include a dinosaur with a long neck, and the dinosaur's long neck may correspond to the identified characteristics of the tree associated with the captured image 77 (e.g., relatively tall) (e.g., the dinosaur may then also be depicted touching and / or eating leaves from a tree having a size similar to the tree from the captured image 77).In another example, the control system may be able to use object detection and / or recognition to identify objects from the image 77 captured by the sensor 76. Further, the control system 70 may instruct an output in addition to or alternative to a visual output based on the identification of certain objects (e.g., certain objects within the image 77). For example, if the control system identifies a rose (e.g., identifies a rose in the image 77), the control system 70 may instruct the scent diffuser to emit the scent of the rose. As another example, if the control system identifies a tree (e.g., identifies a tree within the image 77) in which many leaves are being blown by the wind, the control system 70 may instruct the audio transmitter 68 to output the sound of the leaves of the tree being blown by the wind.

[0030] Artificial intelligence, learning algorithms, and the like may be used to generate graphics that closely resemble real-world elements. As another example, the control system 70 may determine the number or density of real-world elements within the captured image 77 (e.g., the density of groups of clouds, rocks, mountains, or foliage) and generate image data that includes a similar number or density of virtual elements contained within the image 64. In this way, the control system 70 may utilize machine vision to present an image 64 with virtual elements that may closely correspond to the appearance of the real-world environment, as indicated by the image 77 received from the sensor 76. In some embodiments, the control system 70 may utilize characteristics associated with the surrounding environment (e.g., received and / or detected characteristics) in combination with the captured image 77 to generate image data. The characteristics may enhance the generated image data and provide an increase in the similarity between the surrounding environment and the resulting image 64 and / or the virtual elements contained within the image 64. Therefore, the virtual characteristics of the image 64 may more closely correspond to the actual physical characteristics (e.g., reality, appearance, real-life experience) of the surrounding environment (e.g., real-world environment). The control system 70 may also be configured to operate the audio transmitters 68 and other components of the show effects system 60 based on data received from the sensors 76, such as to provide audio effects to patrons to simulate aspects of the surrounding environment.

[0031] In one embodiment, the control system 70 may also include a user interface (UI) 78 through which a user (such as an operator, customer, technician, etc. of the amusement park system 50) can interact to operate the control system 70. For example, the user can use the UI 78 to adjust the image 64 output by the display 62 and / or the audio effects output by the audio emitter 68. By way of example, the user can change the appearance of the virtual element corresponding to (e.g., mimicking, representing, modeling, simulating, supplementing the real-world element), such as by changing the virtual element to a different type and / or category corresponding to (e.g., mimicking, representing, modeling, simulating, supplementing) the real-world element, changing the number of virtual elements, changing other virtual elements (e.g., secondary virtual elements) that do not correspond to (e.g., mimicking, representing, modeling, simulating, supplementing) the determined real-world element, etc. The category of the real-world element may include a specific category of the type of the real-world element. For example, the category of the real-world element tree may include birch trees, maple trees, and / or orange trees. In this way, the control system 70 can adjust the image data provided to the display 62 based on the interaction with the UI 78 to change the image 64 output by the display 62, such as to change the appearance of virtual elements of the image 64 generated based on the data received from the sensor 76. Thus, the control system 70 can also be configured to provide a more customizable experience for the customer. As a specific example, when the generated environment mimics the lighting, trees, and other environmental features of the real external environment, certain graphics (e.g., a unique tree or bird graphic) can be displayed, which achieves the goal of the themed environment (e.g., to enhance the narrative).

[0032] Figure 2is a schematic diagram of an amusement park system 50 having a show effects system 60 and a customer area 52. In the illustrated embodiment, the customer area 52 includes a plurality of customers 100. The customer area 52 may, for example, be part of an attraction system having theme elements (e.g., props) of a simulated environment. For example, the customer area 52 may include a passage (such as a queue) through which the customer 100 may navigate within the attraction system. In an embodiment, the attraction system may include an outdoor area and an indoor area through which the passage may extend. In the outdoor area, the customer may be in a real-world outdoor environment 101. In the indoor area, the customer may be immersed in a virtual or simulated environment provided by the show effects system 60. As an example, the show effects system 60 may present an image 102 that corresponds to (e.g., mimics, represents, models, simulates, supplements) a real-world outdoor environment 101 and realistically depicts a digital scene with real-world elements of the real-world outdoor environment 101. Thus, the respective environments associated with the outdoor area and the indoor area may seamlessly blend with one another to provide the appearance that the patrons 100 are still immersed in the real-world outdoor environment 101 as they navigate the indoor areas of the amusement park system 50. For example, as the patrons 100 transition from the outdoor area to the indoor area, the images 102 created and / or presented by the show effects system 60 may provide the patrons 100 with the impression that they are still in the outdoor area while also providing graphical elements of particular interest (e.g., animated birds in a graphical sky that mimics a real sky). Although the present disclosure discusses generating image data, generating images 102, and / or displaying images 102 that correspond to (e.g., mimic, represent, model, simulate, supplement) the real-world outdoor environment 101 via the show effects system 60, it should be noted that the images 102 provided by the show effects system 60 may correspond to (e.g., mimic, represent, model, simulate, supplement) any other suitable real-world environment, such as a group of people, a room within a building or other structure, and the like.

[0033] In the illustrated embodiment, the image 102 output by the display 62 provides a digital scene that simulates the appearance of an outdoor sky. For example, the virtual elements of the image 102 may include virtual clouds 104 and additional virtual elements, such as a virtual sun 106. Therefore, in order to simulate a realistic depiction of the virtual clouds 104 and the virtual sun 106, the image 102 may be output at a position above the patron 100. In this way, the patron 100 may see the virtual clouds 104 and the virtual sun 106 as being located at realistic positions corresponding to the outdoor sky, thereby providing a realistic appearance that the image 102 is part of the real-world outdoor environment 101 rather than a projection via the show effects system 60. As an example, the display 62 may be a portion of a wall, a screen, a portion of a ceiling, or any other suitable portion of the amusement park system 50 located above the patron 100. In additional or alternative embodiments, such as an embodiment in which the image 102 may simulate different real-world elements, the image 102 may be output at an orientation that is in any other suitable relationship to the patron 100. For example, images 102 corresponding to (eg, mimicking, representing, modeling, simulating, supplementing) real life underwater or subterranean elements may be located below patron 100 , such as via a display located on top of patron 100 .

[0034] The control system 70 may transmit image data to the display 62 to output an image 102 having virtual clouds 104 and / or a virtual sun 106 that are presented in a particular manner to correspond to the real-world outdoor environment 101. For example, the control system 70 may receive data from the sensor 76, such as data including captured imagery 77 of the real-world outdoor environment 101 (e.g., the sky). The control system 70 may receive the captured imagery 77 and determine the class of real-world clouds included in the captured imagery 77. For example, machine learning may allow the control system 70 to identify cloud classes that change throughout the day. The control system 70 may then generate image data that causes the display 62 to output an image 102 that includes virtual clouds 104 of the same class as the class of real-world clouds identified in the captured imagery 77 received from the sensor 76. Additionally or alternatively, the control system 70 may generate image data (e.g., image data corresponding to the image 102), and the control system may then instruct the display 62 to output 102 based on the image data. Additionally or alternatively, the control system 70 may determine the population density of real-world clouds or the number of real-world clouds in a particular area in the captured imagery 77, and the control system 70 may generate image data that causes the display 62 to output an image 102 having virtual clouds 104 distributed at a similar population density. The control system 70 may also determine the orientation of the real-world sun and / or the orientation of the real-world clouds relative to the real-world sun in the captured imagery 77, and the control system 70 may generate image data that causes the display 62 to output an image 102 having virtual clouds 104 and / or virtual sun 106 positioned in a similar manner relative to each other. Thus, the virtual clouds 104 may correspond to (e.g., mimic, represent, model, simulate, supplement) the appearance of real-world clouds, and the image 102 visible to the customer 100 may more closely portray the sky of the real-world outdoor environment 101. Additionally, in some embodiments, the control system 70 may receive and / or determine (e.g., using machine learning) updated one or more characteristics associated with one or more real-world elements based on updated received data from the sensor 76 including updated captured imagery 77 of the real-world outdoor environment 101. For example, the control system 70 may identify an updated position of the real-world element based on the updated data from the sensor 76, and determine a corresponding updated position of a virtual element associated with the real-world element. Additionally, the control system 70 may modify the image data by modifying the position of the virtual element (e.g., with respect to the digital scene) so that the updated position of the virtual element corresponds to (e.g., matches, mimics, models, simulates) an updated position (e.g., updated characteristic) of the real-world element identified within the captured imagery 77.

[0035] As briefly discussed herein, in some embodiments, the sensor 76 may detect characteristics (e.g., physical characteristics) associated with the real-world outdoor environment 101. In particular, the sensor 76 may detect the temperature (e.g., heat), the amount of light (e.g., sunlight), moisture (e.g., humidity), pressure, or any combination thereof of the real-world outdoor environment 101. For example, the sensor 76 may include a temperature sensor and / or a light sensor. In such embodiments, the sensor 76 may detect the temperature of the real-world outdoor environment 101 and / or the amount of light in the real-world outdoor environment 101. Data associated with the detected temperature and / or the detected amount of light may be provided by the sensor 76 to the control system 70. Thus, the control system 70 may receive data from the sensor 76 that may indicate weather conditions (e.g., rainy, sunny, hot, cold, cloudy) associated with the real-world outdoor environment 101. Additionally or alternatively, the control system 70 may receive characteristics associated with the real-world outdoor environment 101 from an external source, such as weather conditions, time of day, time of year (e.g., season), temperature, or any combination thereof. The external source may be, for example, a weather service, a database, a global positioning service (GPS), a network time protocol (NTP), or any combination thereof, communicatively coupled to the show effects system 60 .

[0036] In addition, the control system 70 may utilize characteristics associated with the real-world outdoor environment 101 (e.g., received and / or detected characteristics) in conjunction with the imagery 77 to generate the image 102. The characteristics may enhance the generated image 102 and provide an increase in the similarity between the real-world outdoor environment 101 and the resulting image 102 and / or virtual elements contained within the image 102. As a result, the virtual characteristics of the image 102 may more closely correspond to the actual physical characteristics (e.g., reality, appearance, real-life experience) of the real-world outdoor environment 101, and the image 102 visible to the patron 100 may more closely portray aspects of the real-world outdoor environment 101.

[0037] By displaying virtual elements based on the image 77 of the real-world outdoor environment 101, the show effects system 60 can immerse the patron 100 in a more realistic environment representing the real-world outdoor environment 101. Additionally, the show effects system 60 can portray a more desirable image to the patron 100 by generating virtual elements rather than, for example, directly depicting the image 77 captured by the sensor 76. For example, the image 77 captured by the sensor 76 may include various real-world elements that may not be desirable for display to the patron 100. With respect to the captured image 77 of the outdoor sky, such real-world elements may include, for example, aircraft, animals, elements within the amusement park (e.g., from a nearby attraction system) (e.g., fog, lighting), and the like. Thus, the image 102 provided by the show effects system 60 can more desirably portray the real-world outdoor environment 101 to immerse the patron 100 in a realistic environment.

[0038] Although the present disclosure discusses adjusting the virtual clouds 104 and / or virtual sun 106 of the output image in the embodiments described herein, any other virtual elements may be adjusted in additional or alternative embodiments. For example, the appearance of the moon in the image may be adjusted based on the determined appearance of the moon in the captured image 77 (e.g., illumination, crater appearance), the appearance of precipitation in the image may be adjusted based on the determined precipitation occurring in the captured image 77 (e.g., type of precipitation, size of precipitation), the appearance of a humanoid object (e.g., robot) in the image may be adjusted based on the determined appearance of the customer 100 in the captured image 77 (e.g., facial features), the appearance of trees in the image may be adjusted based on the type and / or population density of the trees in the captured image 77, and so on.

[0039] Additionally, in some embodiments, the show effects system 60 may utilize characteristics associated with the real-world outdoor environment 101 (e.g., received and / or detected characteristics) to modify the image 102 and / or virtual elements of the image 102 presented to the customer 100. For example, the control system 70 may receive data indicating that the physical characteristics (e.g., current physical characteristics, real-time physical characteristics) of the real-world outdoor environment 101 are that the environment is relatively hot and sunny (e.g., via a temperature and / or light sensor). As a result, the show effects system 60 may adjust the image 102 and / or virtual elements in the image 102 based on the received physical characteristics. As an example, the virtual elements of the image 102 may include a humanoid figure, and the show effects system 60 may depict the humanoid figure as squinting, sweating, fanning itself, shielding itself, speaking about the hot weather environment, or any combination thereof.

[0040] Additionally or alternatively, as briefly discussed herein, the show effects system 60 may include an animated character (e.g., a prop, a robot) visible to the patrons 100 within the amusement park system 50. Thus, in some embodiments, the show effects system 60 may utilize characteristics associated with the real-world outdoor environment 101 (e.g., received and / or detected characteristics) to operate (e.g., control, send instructions to, actuate) an animated character presented to the patrons 100. For example, the control system 70 may receive data indicating that the physical characteristics (e.g., current physical characteristics, real-time physical characteristics) of the real-world outdoor environment 101 are that the environment is relatively hot and sunny (e.g., via a temperature and / or light sensor). As a result, the show effects system 60 may operate the animated character based on the received physical characteristics. As an example, the animated character may be operated to squint, fan itself, shield itself, comment on the hot weather environment, or any combination thereof.

[0041] Thus, the show effects system 60 may present images with virtual elements that correspond to (e.g., mimic, represent, model, simulate, supplement any suitable real-world elements) any suitable real-world elements to immerse the customer 100 in a particular environment. In addition, certain virtual elements may be modified to increase interest and immersion in the narrative. For example, a graphic sun may be realistically illustrated based on lighting detected within a real outdoor environment, and also illustrated to include features indicating the presence of a human face. Additionally or alternatively, virtual elements may be used to make the environment different from a real outdoor environment, where being different from a real outdoor environment may include being opposite to a real outdoor environment. For example, the sun may be presented when it is actually dark outside, or the moon may be presented when it is actually not visible in the outdoor sky.

[0042] Figure 3is a schematic diagram of an embodiment of a show effects system 60. The show effects system 60 may cause the presentation of different images of a real-world outdoor environment for viewing by a customer. For example, the control system 70 may cause the display 62 to output a first image 130, a second image 132, and a third image 134. Each of the images 130, 132, 134 may include a virtual cloud 104 and a virtual sun 106, and the virtual cloud 104 may have different appearances in the images 130, 132, 134. The first image 130 may include a first virtual cloud 104A of a first category and a first population density. For example, the first virtual cloud 104A may include a cumulus class cloud arranged at a relatively low population density. The second image 132 may include a second virtual cloud 104B of a first category and a second population density, such as a cumulus class cloud arranged at a relatively medium population density. The third image 134 may include a third virtual cloud 104C of a second category and a third population density, such as a stratus class cloud arranged at a relatively high population density. In each of the images 130 , 132 , 134 , the virtual sun 106 may be centered on the display 62 .

[0043] In one embodiment, the control system 70 may cause the display 62 to output the images 130, 132, 134 based on the data received from the sensor 76. For example, the control system 70 may identify one or more visual characteristics associated with the real-world elements in the imagery 77. For example, the control system 70 may identify the cloud category (e.g., cumulus, stratus, cirrus, cirrocumulus, cumulonimbus, altocumulus, altocumulus, stratocumulus) in the imagery 77 received from the sensor 76. The cloud category may indicate various characteristics of the appearance of the cloud, such as whether the cloud is fluffy, opaque, transparent, wispy, powdery, etc. The control system 70 may also identify other visual characteristics, such as the relative color, shape, and / or size of the real-world clouds in the imagery 77. The control system 70 may also identify the population density of the real-world clouds in the imagery 77. The control system 70 may then generate image data to cause the display 62 to output one of the images 130, 132, 134 in which the virtual cloud 104 has the identified visual characteristics (such as category, color, shape, size, population density, or any combination thereof, as identified from the received imagery 77). In one embodiment, the control system 70 may dynamically modify the generated image data based on the imagery 77 received from the sensor 76. For example, the control system 70 may determine a change (e.g., an increase) in the population density of clouds in the received imagery 77 and generate image data reflecting the identified change (e.g., by increasing the number of clouds in the presented image). Similarly, the control system 70 may determine a change in the category of clouds in the received imagery 77 and generate image data reflecting the change in the category of clouds. In this way, the control system 70 may provide updated image data to facilitate the presentation of an image that may more closely correspond to (e.g., mimic, represent, model, simulate, supplement) the received imagery 77. However, narrative goals may be achieved by modifying the images 130, 132, 134. For example, even in dense cloud cover, virtual clouds 104 may be rendered in a manner such that virtual sun 106 remains visible.

[0044] The control system 70 may maintain the presentation of the virtual sun 106 in each of the images 130, 132, 134. In other words, the control system 70 may generate image data that causes the display 62 to present the virtual sun 106 regardless of the real-world clouds identified in the imagery 77 received from the sensor 76 and / or regardless of whether the real-world sun is contained within the received imagery 77. In additional or alternative embodiments, the control system 70 may generate image data that causes the virtual clouds 104 to be superimposed on the virtual sun 106, thereby at least partially obscuring the visibility of the virtual sun 106. In such embodiments, the image data generated by the control system 70 may cause the virtual sun 106 to be partially visible through the virtual clouds 104, such as by providing some illumination of the virtual sun 106 through the virtual clouds 104. The control system 70 may also generate image data that causes the display 62 to output an image that appears to show movement of the virtual clouds 104 and / or the virtual sun 106. Thus, the image presented by the display 62 may more realistically portray the appearance of the sky over time.

[0045] Figure 4 1 is a schematic diagram of an embodiment of a show effects system 60 that causes presentation of a fourth image 160, a fifth image 162, and a sixth image 164 to a customer. The images 160, 162, 164 may have different digital scene appearances. The fourth image 160 and the fifth image 162 may depict a real-world outdoor environment at different times of the day. As an example, the fourth image 160 may show a real-world outdoor environment at night time, and the fifth image 162 may show a real-world outdoor environment at day time. For example, the control system 70 may determine the time of the day based on data received from the sensor 76, such as via a timer that directly indicates the time of the day and / or via an image 77 that may indicate the time of the day (e.g., based on the amount of lighting provided in the image 77). In order to depict the real-world outdoor environment at night time, the control system 70 may cause the display 62 to present a darker sky in the fourth image 160, along with the stars 166. To depict a real-world outdoor environment during daylight hours, the control system 70 may cause the display 62 to present a brighter sky, along with differently colored virtual clouds 104 (eg, a red hue to depict illumination of the virtual clouds 104 by a rising sun).

[0046] In one embodiment, the control system 70 may also cause the appearance of the virtual sun 106 to adjust in different images. As an example, the control system 70 may cause the virtual sun 106 to have an increased size in the fifth image 162 (e.g., compared to the size of the virtual sun 106 in the fourth image 160). Additionally, the control system 70 may cause the virtual cloud 104 to obscure the virtual sun 106 in the sixth image 164 (e.g., completely reduce the visibility of the virtual sun 106). The obscuring of the virtual sun 106 may be based on the detected real-world outdoor environment and / or based on the operation of the amusement park system. For example, in response to a determination that the operation of the amusement park system is suspended (e.g., movement of a ride vehicle is stopped for maintenance or when a customer is boarding or disembarking from a ride vehicle), the control system 70 may obscure the virtual sun 106 (as shown in the sixth image 164) to relate to the theme in which the amusement park system is powered by the virtual sun 106. In other images, the control system 70 may also adjust other appearances of the virtual sun 106 (e.g., as output by the display 62), such as the brightness (e.g., lighting, luminosity) and / or altitude positioning of the virtual sun 106. Adjustments to the appearance of the virtual sun 106 may also provide a realistic depiction of the real-world outdoor environment by changing the appearance of other virtual elements besides the virtual clouds 104 to correspond to (e.g., mimic, represent, model, simulate, supplement) the real-world outdoor environment.

[0047] In additional or alternative embodiments, the control system 70 may cause the display 62 to output any of the images 130, 132, 134, 160, 162, 164 based on user input (such as via the UI 78). For example, the user input may indicate a cloud category and / or a cloud population density, and the control system 70 may generate and output image data to cause the display 62 to present an image according to the user-indicated cloud category and / or the user-indicated cloud population density (such as regardless of the determined cloud category and / or determined cloud population density of the imagery 77 received from the sensor 76). The control system 70 may also adjust (e.g., modify) other parameters of the image based on the user input, such as the time of day presented in the image and / or the appearance of the virtual sun 106. Thus, the control system 70 may cause the display 62 to present an image based on a combination of the user input and the determined parameters. In this manner, the virtual environment can gradually transition from an environment associated with a real-world outdoor environment to an environment consistent with the narrative. For example, when it is raining in the real world outdoor environment, the virtual environment may transition from the appearance of rain to a sunny day to give the impression of experiencing the ride on a sunny day which more appropriately fits the theme of the ride.

[0048] In some embodiments, the control system 70 may utilize characteristics associated with the real-world outdoor environment (e.g., received and / or detected characteristics) in conjunction with the imagery 77 and / or user input to output any of the images 130, 132, 134, 160, 162, 164. The characteristics may enhance the generated image and provide an increase in the similarity between the real-world outdoor environment and the resulting image and / or virtual elements contained within the image. Thus, the virtual characteristics of the image may more closely correspond to the actual physical characteristics of the real-world outdoor environment (e.g., reality, appearance, real-life experience), and the image visible to the customer may more closely portray aspects of the real-world outdoor environment.

[0049] Figure 5 is a schematic diagram of an embodiment of a performance effects system 60. The control system 70 of the illustrated performance effects system 60 may utilize machine learning (e.g., supervised machine learning, unsupervised machine learning) to generate image data that causes the display 62 to present an image. As used herein, machine learning refers to algorithms and statistical models that the control system 70 can use to perform specific tasks without using explicit instructions (but instead relying on patterns and reasoning). In particular, machine learning generates mathematical models based on data (e.g., sample or training data, historical data) in order to make predictions or decisions (without being explicitly programmed to perform tasks). For example, machine learning can be used to generate image data based on images 77 received from a sensor 76. The control system 70 can generate image data based on received images 77 (such as by determining cloud categories and / or cloud group density) using patterns associated with machine learning.

[0050] In one embodiment, supervised machine learning can be implemented, such as when a specific known example exists (which is related to the future prediction that the control system 70 will be assigned to generate tasks). In supervised machine learning, the mathematical model of a collection of data contains both inputs and expected outputs. The data is called "training data" and is essentially a collection of training examples. Each training example has one or more inputs and expected outputs, also known as supervisory signals. In the mathematical model, each training example is represented by an array or vector (sometimes referred to as a feature vector), and the training data is represented by a matrix. Through iterative optimization of the objective function, the supervised learning algorithm learns a function that can be used to predict the output associated with the new input. The optimal function will allow the algorithm to correctly determine the output for inputs that are not part of the training data. An algorithm that improves the accuracy of its output or prediction over time is considered to have learned to perform the task. Supervised learning algorithms include classification and regression. Classification algorithms are used when the output is limited to a finite set of values, and regression algorithms are used when the output can have any numerical value within a range. Additionally, similarity learning is an area of ​​supervised machine learning that is closely related to regression and classification, but the goal is to learn from examples using a similarity function that determines the extent to which two objects are similar or related.

[0051] Additionally or alternatively, in some scenarios, it may be beneficial for the control system 70 to utilize unsupervised learning (e.g., when a particular output type is unknown). An unsupervised learning algorithm takes a set of data containing only inputs and finds structure in the data, such as clustering or grouping of data points. The algorithm thus learns from test data that has not yet been labeled, classified, or categorized. As opposed to responding to feedback, an unsupervised learning algorithm identifies commonalities in the data and reacts based on the presence or absence of such commonalities in each new piece of data.

[0052] As a result of the implementation of machine learning, the control system 70 may include a machine learning model 190, which may be stored, for example, in a memory of the control system 70. The control system 70 may also include an image generation circuit module 192, which may be part of a processing circuit module of the control system 70. The control system 70 may use the machine learning model 190 and the image generation circuit module 192 to cause (e.g., instruct) the display 62 to output the image 102 as desired. By way of example, the machine learning model 190 may receive the image 77 from the sensor 76 as input and determine various parameters from the image 77, such as real-world cloud category and / or real-world cloud group density. The machine learning model 190 may provide the determined parameters as output to the image generation circuit module 192. The image generation circuit module 192 may generate image data based on the parameters received from the machine learning model 190. For example, the image generation circuit module 192 may generate image data with a virtually generated cloud corresponding to a cloud category, cloud appearance, and / or cloud group density as determined by the machine learning model 190. Thus, the virtual elements of the image data may correspond to (e.g., mimic, represent, model, simulate, supplement) real-world elements of the imagery 77 provided by the sensor 76. The display 62 may receive the image data generated via the image generation circuit module 192 and output an image 102 for presentation based on the image data. In this way, the control system 70 may utilize the machine learning model 190 to cause the display 62 to automatically (e.g., without user input) present the image 102 based on the imagery 77 received from the sensor 76.

[0053] Additionally or alternatively, in some embodiments, the control system 70 may utilize physical characteristics associated with the real-world outdoor environment (e.g., characteristics received and / or detected as described herein) in conjunction with the imagery 77 to generate the image 102 (e.g., automatically). The characteristics may enhance the generated image 102 and provide an increase in the similarity between the real-world outdoor environment and the resulting image 102 and / or virtual elements contained within the image 102. As a result, the virtual characteristics of the image 102 may more closely correspond to the actual physical characteristics (e.g., reality, appearance, real-life experience) of the real-world outdoor environment, and the image 102 visible to the customer may more closely portray aspects of the real-world outdoor environment.

[0054] Described below Figure 6-8Each of the diagrams in the method is associated with the operation of the performance effects system 60. In one embodiment, each of the methods described may be performed by a single corresponding component or system, such as by the control system 70 (e.g., the processing circuit module 74). In additional or alternative embodiments, multiple components or systems may perform the operation of a single method in the method. It should also be noted that with respect to the described method, additional operations may be performed. In addition, certain operations of the depicted method may be removed, modified and / or performed in a different order. Still further, the operations of any of the methods in the corresponding methods may be performed in parallel with each other, such as being performed at the same time and / or in response to each other.

[0055] Figure 6 2 is a flow chart of an embodiment of a method 210 for operating a performance effects system to present an image. At block 212, a captured image of a real-world environment may be received, such as from a sensor (e.g., an optical sensor). For example, the image may include one or more images of an outdoor environment surrounding the performance effects system (such as a view of the sky). At block 214, real-world elements of the captured image may be identified. By way of example, the category of the real-world element (e.g., the category of surrounding foliage or clouds in the sky), the appearance of the real-world element (e.g., color, size, shape, visual characteristics), and / or population density (e.g., the number of trees or clouds within the captured image) may be identified.

[0056] At box 216, image data may be generated to provide virtual elements that correspond to the appearance of real-world elements identified from the captured image (e.g., mimic, represent, model, simulate, supplement the appearance of real-world elements identified from the captured image). As an example, the virtual elements of the image data may be stylized to correspond to the appearance of the real-world elements, such as based on the recognized category of the real-world elements (e.g., oak, fir) or other appearance characteristics (e.g., leaf coloring). As another example, the population density of virtual elements in the image data may be based on the population density of real-world elements in the captured image. That is, the number of real-world elements in the captured image may correspond to the population density of real-world elements. In one embodiment, the captured image may be determined to lack a target real-world element. In response, the generated image data may also lack virtual elements corresponding to the target real-world element. Therefore, the virtual elements of the image data may more closely correspond to the current real-world element indicated by the captured image.

[0057] Additionally or alternatively, in some embodiments, image data may be generated to provide a virtual element including a virtual characteristic based on an identified characteristic associated with a real-world element identified from the captured imagery. As discussed herein, characteristics and / or features associated with an identified real-world element may be identified (e.g., determined) from the captured imagery. In addition, the virtual characteristics of the virtual element may be based on the identified characteristics. As an example, the identified real-world element may include a cloud, and the identified characteristics of the cloud may include a relative size measurement of the cloud within the captured imagery, the density of the cloud, the color of the cloud, and / or the movement of the cloud. In addition, the generated image data may include a virtual element having virtual characteristics similar to the identified characteristics associated with the cloud, although the virtual element may not match the type of the real-world element. Continuing with this example, the virtual element may include a group of butterflies having a size, density, color, and / or movement similar to the size, density, color, and / or movement of the cloud. Thus, the displayed image generated by the image data may include a virtual element (such as the group of butterflies) having an appearance similar to an identified real-world element (such as a cloud).

[0058] In one embodiment, the image data may be newly generated, such as without using pre-existing image data. That is, each virtual element may be newly generated based on the captured image without utilizing a preset virtual element (e.g., a previously generated virtual element). In additional or alternative embodiments, the image data may be generated by modifying an existing image (e.g., a pre-recorded image, a stock image). For example, an existing image may include preset virtual elements, and the preset virtual elements may be adjusted based on real-world elements identified from the captured image. For example, a virtual model of a tree or cloud may be provided, and the coloring may be adjusted based on the coloring detected in the real environment. In either embodiment, the virtual elements of the image data may be filled based on the identified type and / or category, the identified population density, and / or any other suitable parameter associated with the captured image. For example, a percentage of the total number of pixels of the image data and / or the number of pixels may be assigned to a virtual element based on the captured image.

[0059] The generated image data may also provide virtual elements that appear to interact with each other and / or with other aspects of the digital scene. By way of example, the virtual elements of the image data may include trees and / or clouds that cast shadows based on the positioning of the trees and / or clouds with respect to the remainder of the digital scene and / or based on the direction of lighting in the digital scene. Such digital content may be generated programmatically. For example, the image data may be initially generated to include virtual elements to correspond to (e.g., mimic, represent, model, simulate, supplement) the captured imagery, and the image data may then be modified to adjust the appearance of the virtual elements. Therefore, the image data initially generated based on the captured imagery may be further improved to make the virtual elements appear more realistic.

[0060] At box 218, the generated image data (e.g., with programmatically generated digital content) can be transmitted for presentation (e.g., display) in a ride environment or other attraction. As an example, the image data can be transmitted to a display so that the display presents an image based on the image data. The presented image can include virtual elements that correspond to (e.g., mimic, represent, model, simulate, supplement) real-world elements of the captured imagery. As a result, the image in the attraction can appear to match, blend or integrate with the real-world environment and provide a more realistic image based on the detected real-world conditions. In some embodiments, the image data may include modifications to provide elements of interest (e.g., virtual trees may be depicted with human characteristics or may be depicted as moving animatedly, despite the absence of such movement in the actual outdoor environment).

[0061] Figure 7 2 is a flow chart of an embodiment of a method 240 for operating a performance effects system to present an image. For example, method 240 may be performed to enhance image data generated via method 210. At box 242, image data may be generated based on captured imagery, and virtual elements of the image data may correspond to (e.g., mimic, represent, model, simulate, supplement) real-world elements of the captured imagery, such as via the techniques described above. At box 244, additional parameters may be received. Additional parameters may include time of day, precipitation conditions, temperature, humidity, and the like. Additional parameters may be received via sensors and / or via other sources, such as from the Internet and / or from user input.

[0062] At block 246, the generated image data may be updated based on the additional parameters. As an example, the lighting of virtual elements (such as the intensity of the lighting), the direction of the lighting (e.g., to simulate the positioning of the sun), the color of the lighting, etc. may be adjusted. As another example, additional virtual elements corresponding to precipitation (e.g., rain, snow, sleet, and the like) may be added based on the identified presence of precipitation in the real-world environment. As a further example, other adjustments may be made to the image data, such as distortion of virtual elements in the image (e.g., to simulate a hazy appearance during increased temperature conditions, to simulate a wet and / or polluted environment), the addition of other virtual elements (e.g., fog, lightning, stars) that may not be present in the captured imagery, and the like. The updates made to the image data may therefore be based on additional information that may not directly correspond to (e.g., mimic, represent, model, simulate, supplement) real-world elements of the captured imagery, but may nonetheless facilitate providing a realistic representation of the real-world environment. At block 248, after the image data is updated, the updated image data may be transmitted to a display to present an image based on the updated image data.

[0063] Additionally or alternatively, the generated image data may be updated based on received and / or detected physical properties associated with the real-world environment. For example, data may be received indicating that the physical properties of the real-world environment (e.g., current physical properties, real-time physical properties) are that the environment is relatively cold and dark. As a result, the image data (e.g., virtual elements of the image data) may be updated based on the received physical properties. As an example, the virtual elements of the image data may include a humanoid figure, and the virtual elements may be updated to depict the humanoid figure as shivering and / or speaking about a cold and / or dark weather environment. In this way, the display of the image data (e.g., virtual elements) may more closely correspond to actual real-life aspects of the real-world environment.

[0064] As briefly discussed herein, in some embodiments, an animated character (e.g., a prop, a robot) may be operated based on received and / or detected physical properties associated with a real-world environment. As an example, data may be received indicating that the physical properties of the real-world environment (e.g., current physical properties, real-time physical properties) are that the environment is relatively cold and dark. As a result, the animated character may be operated based on the received physical properties. As an example, the animated character may be operated to shiver and / or comment on a cold and / or dark weather environment. In this way, the show effects system may more closely correspond to the real-life aspects of the real-world environment.

[0065] It should be noted that methods 210, 240 can be continuously performed so that image data can be dynamically generated for transmission to present an image. Thus, an image presented (e.g., via a display) based on the image data can be continuously updated (such as based on newly captured imagery) to more closely correspond to (e.g., mimic, represent, model, simulate, supplement) a real-world environment. For example, the appearance of a virtual element can be adjusted over time based on detected real-world elements of captured imagery.

[0066] In addition, the appearance of the virtual elements may also be based on other parameters that are not directly related to the detected parameters of the real-world environment. As an example, the virtual elements may be stylized based on the theme of the attraction system and / or the amusement park in which the show effects system is implemented. For example, a first virtual element presented by a first show effects system may have a more cartoon-like appearance, and a second virtual element presented by a second show effects system may have a more realistic appearance. In fact, even if the same captured image may be received by different show effects systems, the virtual elements presented by the show effects systems may look different from each other. In other words, virtual elements generated based on the same type and / or category and / or the same population density associated with the captured image may have different appearances for different show effects systems. Therefore, the images presented by each show effects system can be more suitable for its specific implementation.

[0067] Figure 8 2 is a flow chart of an embodiment of a method 270 for operating a performance effects system to generate a machine learning model to be used to render an image based on captured imagery. At block 272, training data associating input images with corresponding output real-world element parameters is received. The training data may, for example, include a first number of input images that may be manually assigned to real-world element parameters. For example, each input image may be an image of the sky, and the real-world element parameters may include cloud categories and / or cloud group density.

[0068] At block 274, a machine learning model may be generated based on the training data. As an example, characteristics of the input imagery, such as raw pixel data (e.g., pixel coloring), may be identified to determine a relationship between such characteristics and associated real-world element parameters. Thus, an algorithm defining the relationship between the characteristics and the real-world element parameters may be determined and established in the machine learning model.

[0069] At box 276, additional input images may be received to further train the machine learning model. That is, the additional input images may be used to determine whether the generated machine learning model operates appropriately to generate real-world element parameters. For this purpose, such additional input images may be different from the input images and may not include the assigned real-world element parameters. In one embodiment, the second number of additional input images used to adjust the machine learning model (e.g., 100 images, 200 images, 300 images) may be less than the first number of input images used to initially establish the machine learning model (e.g., 700 images, 800 images, 900 images, 1000 images). In an alternative embodiment, the second number of additional input images may be the same as or greater than the first number of input images.

[0070] At box 278, the machine learning model is used to identify additional real-world element parameters corresponding to the additional input imagery. That is, the additional input imagery may be used as input to the machine learning model, and the machine learning model may generate additional real-world element parameters as output for the additional input imagery. The additional real-world element parameters may then be analyzed (such as manually by a user) to determine whether the generated additional real-world element parameters are accurate.

[0071] At block 280, feedback indicating whether the additional real-world element parameters are accurately identified may be received. For example, a user may provide user input regarding whether the corresponding additional real-world element parameters have been accurately identified for each additional input image. The feedback may, for example, confirm that the additional real-world element parameters have been accurately identified, indicate that the additional real-world element parameters have not been accurately identified, and / or directly indicate accurate real-world element parameters.

[0072] At block 282, the machine learning model may then be updated based on the feedback. As one example, in response to receiving feedback that additional real-world element parameters associated with the additional input imagery have not been accurately identified, the algorithm of the machine learning model may be adjusted so that the machine learning model can more closely identify accurate additional real-world element parameters associated with the additional input imagery. As another example, in response to receiving feedback that additional real-world element parameters associated with the additional input imagery have been accurately identified, the algorithm of the machine learning model may be maintained more robustly (e.g., less susceptible to adjustments) so that the real-world element parameters can be similarly identified for similar imagery. In this way, the machine learning model may be updated based on the received feedback to identify real-world element parameters that can more accurately reflect subsequently received imagery.

[0073] Although only certain features of the present disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is therefore to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the present disclosure.

[0074] The technology presented and claimed herein is cited and applied to specific examples and substantial objects that demonstrably improve the practical nature of the art, and is therefore not abstract, intangible, or purely theoretical. Further, if any claim appended to the end of this specification contains one or more elements designated as "a component for (performing) ... (function)" or "a step for (performing) ... (function)", it is intended that such elements are to be interpreted in accordance with 35 U.S.C. 112(f). However, for any claim containing elements designated in any other manner, it is intended that such elements are not to be interpreted in accordance with 35 U.S.C. 112(f).

Claims

1. A system for a tourist attraction, the system comprising: a sensor configured to capture an image of a real-world environment; as well as a control system communicatively coupled to the sensor, wherein the control system is configured to: receiving the image captured by the sensor; identifying real-world elements of the image; generating image data including virtual elements corresponding to the real-world elements; as well as The image data is transmitted for presentation in the scenic spot.

2. The system of claim 1, wherein: The real-world elements include clouds or branches, wherein the control system is configured to identify the category of the clouds or branches; and wherein the image data includes the virtual elements, and the virtual elements include virtual clouds or virtual branches of the category identified from the image.

3. The system of claim 1, wherein: The control system is configured to determine a population density of the real-world elements in the imagery; and wherein the image data includes the virtual elements corresponding to the population density.

4. The system of claim 1, wherein: The image data comprises data corresponding to a digital scene, and wherein the control system is configured to: modifying the image data by modifying the position of the virtual element with respect to the digital scene; and The image data is transmitted after modifying the image data.

5. The system of claim 1, wherein: The control system is configured to determine parameters of the real-world elements of the imagery using a machine learning model; and wherein the image data includes the virtual elements based on the parameters.

6. The system of claim 1, wherein: The control system is configured as follows: determine the time of day; and The lighting of the virtual element is modified based on the time of day.

7. The system of claim 1, comprising a display in the attraction, wherein: The control system is configured to transmit the image data to the display for presentation of an image based on the image data.

8. A non-transitory computer readable medium comprising instructions which, when executed by a processing circuit module, cause the processing circuit module to: receiving the captured image; identifying a first category or a first group density of real-world elements in the captured imagery; generating image data having virtual elements corresponding to the first category or the first group density; and The image data is output for presentation.

9. The non-transitory computer readable medium of claim 8, wherein: The instructions, when executed by the processing circuit module, cause the processing circuit module to: generate the image data with additional virtual elements.

10. The non-transitory computer readable medium of claim 9, wherein: When the instructions are executed by the processing circuit module, the processing circuit module: receiving additional captured images; identifying a second category or a second population density of the real-world elements in the additional captured imagery; generating updated image data having an updated virtual element corresponding to the second category or the second population density and maintaining the appearance of the additional virtual element; and The updated image data is output.

11. The non-transitory computer readable medium of claim 8, wherein: When the instructions are executed by the processing circuit module, the processing circuit module: receiving training data that associates input images with corresponding classes or corresponding population densities; and A machine learning model is generated based on the training data.

12. The non-transitory computer readable medium of claim 11, wherein: When the instructions are executed by the processing circuit module, the processing circuit module: receiving additional input images; using the machine learning model to identify additional corresponding categories or additional corresponding group densities of the additional input images; receiving feedback indicating whether the additional corresponding category or the additional corresponding group density is accurately identified; and The machine learning model is updated based on the feedback.

13. The non-transitory computer readable medium of claim 11, wherein: The instructions, when executed by the processing circuit module, cause the processing circuit module to: use the machine learning model to identify the first category or the first population density of the real-world elements in the captured image.

14. The non-transitory computer readable medium of claim 8, wherein: The instructions, when executed by the processing circuit module, cause the processing circuit module to: identify the presence of precipitation in a real-world environment; and wherein the image data includes an additional virtual element corresponding to the precipitation.

15. A system for a tourist attraction, comprising: a display configured to present an image; as well as A control system configured to perform operations comprising: receiving an image of a real-world environment; identifying visual characteristics of real-world objects in the imagery; generating image data including a virtual object corresponding to the visual characteristic of the real-world object and an additional virtual object; and The image data is transmitted to the display.

16. The system of claim 15, wherein: The virtual object comprises a virtual cloud, and wherein the additional virtual object comprises a virtual sun.

17. The system of claim 16, wherein: The image includes a first image, and the control system is configured to perform operations including: receiving a second image of the real-world environment; determining that a second visual characteristic of the real-world object in the second image is different from the visual characteristic of the real-world object in the first image; and Updated image data is generated by modifying the image data based on the second visual characteristic.

18. The system of claim 15, wherein: The real-world objects include clouds and branches and leaves, and wherein the image data includes virtual clouds corresponding to the visual characteristics of the clouds, and wherein the image data includes virtual branches and leaves corresponding to the visual characteristics of the branches and leaves.

19. The system of claim 18, wherein: The visual characteristics of the clouds include the category of the clouds, the population density of the clouds, or both.

20. The system of claim 15, comprising a ride vehicle, wherein: The display is configured to present the image to customers in the ride vehicle.

Images