Show effect system for amusement park attraction system

Abstract

A system for an attraction includes a sensor configured to capture images of a real-world environment and a control system communicatively coupled to the sensor, wherein the control system is configured to receive the images captured by the sensor, identify real-world elements in the images, generate image data including virtual elements that correspond to the real-world elements, and transmit the image data for presentation in the attraction.

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims priority to and the benefit of U.S. Provisional Application No. 63 / 398,054, filed August 15, 2022, entitled "SHOW EFFECT SYSTEM FOR AMUSEMENT PARK ATTRACTION SYSTEM," which is incorporated herein by reference in its entirety for all purposes. [Background technology]

[0002] This section is intended to introduce the reader to various aspects of the art that may be related to various aspects of the present technology, which are described and / or claimed below. The discussion herein is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0003] Throughout amusement parks and other entertainment venues, special effects can be used to immerse guests in the ride or attraction experience. Immersive environments can include three-dimensional (3D) props and set elements, robotic or mechanical elements, and / or display surfaces presenting media. Additionally, immersive environments can include audio effects, smoke effects, and / or motion effects. Thus, immersive environments can include a combination of dynamic and static elements. However, implementing and operating special effects can be complex. For example, it can be difficult to get certain elements of the special effects to operate in a desired manner to create an immersive environment. With the increasing sophistication and complexity of modern ride attractions and corresponding increases in guest expectations, improved and more creative attractions are desired, including ride attractions with special effects that provide immersive environments. Summary of the Invention

[0004] Certain embodiments within the scope of the originally claimed subject matter are summarized below. These embodiments are not intended to limit the scope of the claimed subject matter; rather, these embodiments are intended only to provide a brief summary of possible forms in which the subject matter can be implemented. Indeed, the subject matter may encompass a variety of forms that may be similar to or different from the embodiments set forth below.

[0005] In one embodiment, a system for an attraction includes a sensor configured to capture images of a real-world environment and a control system communicatively coupled to the sensor, wherein the control system is configured to receive the images captured by the sensor, identify real-world elements in the images, generate image data including virtual elements that correspond to the real-world elements, and transmit the image data for presentation in the attraction.

[0006] In one embodiment, a non-transitory computer-readable medium includes instructions that, when executed by a processing circuit, cause the processing circuit to receive a captured image, identify a first type or a first population density of real-world elements in the captured image, generate image data having virtual elements corresponding to the first type or first population density, and output the image data for presentation.

[0007] In one embodiment, the system includes a display configured to present an image and a control system configured to perform operations including receiving an image of a real-world environment, identifying visual characteristics of real-world objects in the image, generating image data including virtual objects corresponding to the visual characteristics of the real-world objects and additional virtual objects, and transmitting the image data to the display.

[0008] These and other features, aspects, and advantages of the present disclosure will become better understood from the following detailed description when taken in conjunction with the accompanying drawings, in which like reference numerals refer to like elements throughout. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic diagram of an embodiment of an amusement park system according to one aspect of the present disclosure. [Figure 2] 1 is a schematic diagram of an embodiment of an amusement park system according to an aspect of the present disclosure. [Figure 3] 1 is a schematic diagram of an embodiment of a show effects system configured to present images, according to an aspect of the present disclosure. [Figure 4] 1 is a schematic diagram of an embodiment of a show effects system configured to present images, according to an aspect of the present disclosure. [Figure 5] 1 is a schematic diagram of an embodiment of a show effects system configured to present images, according to an aspect of the present disclosure. [Figure 6] 1 is a flowchart of a method or process for operating a show effects system to present images, according to one aspect of the present disclosure. [Figure 7] 1 is a flowchart of a method or process for operating a show effects system to present images, according to one aspect of the present disclosure. [Figure 8] 1 is a flowchart of a method or process for operating a show effects system to present images, according to one aspect of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0010] When introducing elements of various embodiments of the invention, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. In addition, it should be understood that references to "one embodiment" or "one embodiment" of the invention are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

[0011] One or more specific embodiments of the present disclosure are described below. In the interest of providing a concise description of these embodiments, not all features of an actual implementation will be described herein. It will be understood that, as with any engineering or design project, the development of any such actual implementation will require numerous implementation-specific decisions to be made to achieve the developer's particular goals, which may vary from implementation to implementation, including compliance with system- and business-related constraints. It will further be appreciated that such a development effort, while potentially complex and time-consuming, would be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0012] Embodiments of the present disclosure are directed to an amusement park system. The amusement park may include various attraction systems, such as rides (e.g., roller coasters, water rides, drop towers), performance shows, walkways, and the like, each having features that can entertain guests of the amusement park. The amusement park may also include a show effects system configured to operate to present various effects, such as visual and / or audio effects, to guests. For example, the show effects system may be part of the attraction system and present special effects to guests within the attraction system, such as guests in the attraction system's ride cars, in the attraction system's queues, in the attraction system's halls, and the like. Additionally or alternatively, the show effects system may be external to any attraction system and may present show effects to guests, for example, in the amusement park's tracks, dining areas, souvenir shops, and the like. The show effects system may provide an immersive environment for entertaining guests.

[0013] To provide a more realistic environment and enhance the experience provided to the guest, it may be desirable to present more realistic show effects to the guest. For example, it may be desirable to display digital or virtual elements or objects that resemble real-world elements or objects in the surrounding environment. In this manner, the show effects system may provide an environment that more closely reflects the surrounding real-world environment. In this manner, the show effects system may establish a more realistic environment for the guest and enhance the immersive experience provided by the show effects system.

[0014] Accordingly, embodiments of the present disclosure are directed to a show effects system capable of receiving captured images of a real-world environment and presenting images based on the captured images. For example, the show effects system can include a control system capable of identifying one or more real-world elements in the captured image. The control system can then generate image data having virtual elements corresponding to the identified one or more real-world elements. For example, corresponding to the identified one or more real-world elements can include mimicking, representing, modeling, simulating, and / or complementing the identified one or more real-world elements. The control system can transmit image data to a device, such as a projector and / or display device, to present an image based on the image data. In some embodiments, modeling (e.g., simulating) the real-world elements via the virtual elements allows the presented image to closely represent the real-world environment associated with the captured image. For example, the virtual element image presented by the show effects system can have a similar appearance to the captured image of the real-world element. Additionally or alternatively, the virtual elements may correspond to detected characteristics (e.g., characteristics, visual properties) of the real-world elements in the captured image, such as density, movement, size, geometry (e.g., shape), color, etc. In this manner, the virtual elements may correspond to the characteristics of the real-world elements and thus appear visually similar to the real-world elements, although in some embodiments, the virtual elements may not match the type of real-world element. Thus, the images may blend into the real-world environment, providing a seamless transition between the real-world environment and the effects provided by the show effects system. In this manner, the show effects system may provide guests with a more realistic and / or immersive environment that corresponds to the real-world environment.

[0015] With the foregoing in mind, FIG. 1 is a schematic diagram of an embodiment of an amusement park system 50. As one example, the amusement park system 50 may be part of an attraction system, such as rides (e.g., roller coasters, dark rides), performance shows, etc. As another example, the amusement park system 50 may be part of a dining area, waiting areas, walkways, shopping (e.g., gift shops), or any other suitable portion of an amusement park. The amusement park system 50 may include a guest area 52 in which guests may be located. For example, the guest area 52 may include ride vehicles 54 that may move and change position, location, and / or orientation within the amusement park system 50. The guest area 52 may additionally or alternatively include a navigation path 56 used by guests to navigate (e.g., walk) throughout the amusement park system 50, such as outside the ride vehicles 54. The guest area 52 may further include seating 58, which may include locations in which guests may be located, such as seating areas and / or standing areas. Indeed, guest area 52 may include any suitable features for accommodating guests within amusement park system 50 .

[0016] The amusement park system 50 may also include a show effects system 60 configured to provide entertainment to guests in the guest area 52. For example, the show effects system 60 may include a display 62 configured to present images 64 viewable to guests. The display 62 may be a light-emitting diode (LED) display, a liquid crystal display (LCD), a plasma display, an electronic paper display, a cathode ray tube (CRT) display, or the like configured to output images. Additionally or alternatively, the display 62 may include a projector configured to output images onto a surface for presentation to guests. The display 62 may be part of a prop, such as an animated figure, a structure (e.g., a wall, ceiling, floor), or other suitable part of the amusement park system 50. Guests may view the images 64 output by the display 62. In this manner, the show effects system 60 may provide visual effects to guests. As an example, the images 64 output by the display 62 may include virtual or digital elements corresponding to real-world elements to immerse guests in a realistic or semi-realistic environment. As a further example, the images 64 output by the display 62 may include virtual or digital elements that mimic or simulate real-world elements to immerse the guest in a real or semi-realistic environment.

[0017] Further, display 62 may include a receiver and / or transceiver configured to receive image data. In particular, display 62 may receive image data from control system 70 (e.g., from processing circuitry 74 via a transmitter and / or transceiver). In some embodiments, display 62 may be communicatively coupled to a receiver and / or transceiver. Thus, display 62 may receive data via the communicatively coupled receiver and / or transceiver. For example, control system 70 may transmit image data to display 62 via the transmitter and / or transceiver, and display 62 may receive the image data via the communicatively coupled receiver and / or transceiver.

[0018] The show effects system 60 can also be configured to provide other types of effects to guests. For example, the show effects system 60 can also include an audio emitter 68, such as a speaker, to provide audio effects that complement the images 64 provided by the displays 62. In one example, the images 64 provided by the displays 62 can simulate rain and lightning, and the audio effects provided by the audio emitter 68 can simulate thunder. In this example, the displays 62 and the audio emitter 68 can collectively provide guests with a realistic stormy environment. The show effects system 60 can also include other types of show effect features and / or components, such as fog emitters, fans, lights, animated figures, props, actuating members, fragrance diffusers, flame emitters, smoke emitters, pyrotechnics, water emitters, etc.

[0019] The show effects system 60 may further include a control system 70 (e.g., a controller, automation controller, programmable controller, electronic controller, control circuitry) configured to operate components of the show effects system 60, such as the display 62 and / or the audio emitter 68. The control system 70 may include a memory 72 and processing circuitry 74. The memory 72 may include volatile memory, such as random access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM), an optical drive, a hard disk drive, a solid-state drive, or any other non-transitory computer-readable medium containing instructions for operating the amusement park system 50. The processing circuitry 74 may be configured to execute such instructions. For example, the processing circuitry 74 may include one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more general-purpose processors, or any combination thereof. The control system 70 may further include a transmitter and / or transceiver configured to transmit image data. In particular, the control system 70 can transmit (e.g., output, transmit) image data to the display 62 via a transmitter and / or transceiver. In some embodiments, the control system 70 (e.g., processing circuitry 74) can be communicatively coupled to a transmitter, transceiver, and / or receiver. Thus, the control system 70 can transmit (e.g., output, transmit) data via a communicatively coupled transmitter and / or transceiver and / or receive data via a communicatively coupled receiver and / or transceiver. For example, the control system 70 can transmit image data (e.g., to the display 62) via a communicatively coupled transmitter and / or transceiver and / or receive image data (e.g., from the sensor 76) via a communicatively coupled receiver and / or transceiver.

[0020] Further, the control system 70 can, for example, operate the display 62 to control the images 64 output by the display 62. In one embodiment, the control system 70 can transmit image data to the display 62 for output as the images 64. For example, the control system 70 can transmit the image data to cause the display 62 to output images 64 that correspond to real-world elements in the surrounding environment of the show effects system 60 and / or the guest area 52. As a further example, the control system 70 can transmit the image data to cause the display 62 to output images 64 that mimic or simulate the real-world elements in the surrounding environment of the show effects system 60 and / or the guest area 52. In one embodiment, the control system 70 identifies the real-world elements in the surrounding environment, generates image data including virtual elements (e.g., primary virtual elements) that correspond to (e.g., represent, mimic, model, simulate, complement) the real-world elements, transmits the image data to the display 62, and causes the display 62 to output the images 64 based on the image data. Thus, the images 64 presented by the displays 62 may include virtual elements that correspond to (e.g., mimic, represent, model, simulate, complement) real-world elements. By way of example, the mimicry of real-world elements via virtual elements may cause the images 64 to appear to blend into the surrounding environment from the guest's perspective. In this manner, guests may be immersed in an environment that seamlessly transitions between the environment provided by the show effects system 60 (e.g., a virtual environment) and the real-world environment surrounding the amusement park system 50. Thus, the environment provided by the show effects system 60 may appear more realistic. For example, because real weather and / or foliage patterns may be mimicked in the image generated based on the detection of outdoor conditions, guests transitioning from an outdoor portion of the queue may not be fully aware that the indoor image provided by the displays 62 is not an outdoor environment.This makes it possible to introduce desired illusions (e.g., a sun or moon with human features, or flying pigs passing through other realistic skies) in a mimicked environment that feels consistent with a real outdoor environment.

[0021] The show effects system 60 may include a sensor 76 communicatively coupled to the control system 70. The sensor 76 may be configured to provide data indicative of the surrounding environment (e.g., sensor data) to the control system 70. For example, the sensor 76 may include an optical sensor, such as a camera, configured to capture images 77 (e.g., one or more images) of the surrounding environment, and the data provided to the control system 70 may include the captured images 77. In some embodiments, the sensor 76 may detect characteristics associated with the surrounding environment (e.g., the shape, movement, and respective positions of clouds and / or leaves). In particular, the sensor 76 may detect the temperature (e.g., heat), amount of light (e.g., sunlight), frequency and / or wavelength of electromagnetic radiation, moisture (e.g., humidity), pressure, or any combination thereof, of the surrounding environment. For example, the sensor 76 may include a temperature sensor and / or a light sensor. In such embodiments, the sensor 76 may detect the temperature, moisture, sound, atmospheric pressure, amount of light (e.g., intensity, brightness), and / or other characteristics of the surrounding environment. Such data (e.g., data related to temperature and / or light levels) may be provided to control system 70. In this manner, control system 70 may provide data that may be indicative of weather conditions (e.g., rainy, sunny, hot, cold, cloudy) of the surrounding environment. Additionally or alternatively, control system 70 may receive characteristics related to the surrounding environment, such as weather conditions, time of day, time of year (e.g., season), temperature, or any combination thereof, from an external source. The external source may be, for example, a weather service, an external database, a global positioning service (GPS), a network time protocol (NTP), or any combination thereof.

[0022] Continuing with FIG. 1 , control system 70 can identify one or more real-world elements in captured image 77 and generate image data based on the identified real-world elements. The real-world elements can include any aspect of the environment captured by sensor 76 or detected in the data output of sensor 76 (e.g., the data output of the sensor can include image 77). The real-world elements can be categorized by real-world element type, where the type of real-world element can include plants (e.g., trees, flowers), animals, people, man-made structures (e.g., buildings, roads, bridges), terrain (e.g., mountains, hills, rocks, sand), or other aspects of the real world. As an example, as described herein, control system 70 can determine the type of real-world element (e.g., a tree) in captured image 77 and generate image data including a virtual element (e.g., computer-generated graphics of a tree) having an appearance that matches the type of real-world element in image 64. Additionally or alternatively, in some embodiments, the control system 70 can identify (e.g., determine) properties and / or characteristics associated with the identified real-world elements from the captured image 77 and generate image data including virtual elements having virtual properties (e.g., visual properties) based on the identified properties and / or characteristics of the real-world elements. As an example, the control system 70 can identify the real-world elements as including a tree and identify one or more properties (e.g., visual patterns) associated with the tree, such as the tree's size, shape, movement, color, etc. As in this example, the control system 70 can identify properties such as being relatively tall, swaying (e.g., being moved by wind, etc.), and / or being relatively thin along the tree's trunk. Furthermore, the control system 70 can generate image data including virtual elements having virtual properties similar to the specified properties associated with the real-world elements. In other words, the virtual elements can include a stylized rendering of the real-world elements such that the overall pattern and / or characteristics of the virtual elements match the detected pattern and / or characteristics of the real-world elements, although the virtual elements can be of a different type than the real-world elements.Continuing with this example, the virtual element may include a long-necked dinosaur, where the dinosaur may include visual patterns and / or characteristics that correspond to identified characteristics associated with a tree in the captured image 77 (e.g., relatively tall, swaying, and / or relatively thin). In this manner, the displayed image 64 may include a virtual element, such as a dinosaur, that has a similar appearance to an identified real-world element, such as a tree. In another example, the shape and arrangement of a cloud may be mimicked by a depiction of a butterfly. As a further example, in addition or alternatively, the virtual element may include a long-necked dinosaur, where the dinosaur's long neck may correspond to an identified characteristic associated with a tree in the captured image 77 (e.g., relatively tall) (e.g., the dinosaur may then be further depicted as reaching for and / or eating leaves from a tree of similar size to the tree from the captured image 77). In another example, the control system may use object detection and / or identification to enable the sensor 76 to identify an object from the captured image 77. Furthermore, the control system 70 may command an output in addition to or in lieu of a visual output based on the identification of a particular object (e.g., a particular object in the image 77). For example, if the control system identifies a rose (e.g., identifies a rose in image 77), control system 70 can instruct the fragrance diffuser to emit a rose scent. As another example, if the control system identifies a tree with many leaves blowing in the wind (e.g., identifies the tree in image 77), control system 70 can instruct audio emitter 68 to output the sound of leaves blowing in the wind.

[0023] Artificial intelligence, learning algorithms, and the like can be used to generate graphics that closely resemble real-world elements. As another example, the control system 70 can determine the amount or density of real-world elements in the captured image 77 (e.g., population density of clouds, rocks, mountains, or leaves) and generate image data including a similar amount or density of virtual elements included in the image 64. In this manner, the control system 70 can use machine vision to present the image 64 having virtual elements that closely correspond to the appearance of the real-world environment as indicated by the image 77 received from the sensor 76. In some embodiments, the control system 70 can generate image data using characteristics associated with the surrounding environment (e.g., received and / or detected characteristics) in combination with the captured image 77. The characteristics can enhance the generated image data, providing increased similarity between the surrounding environment and the resulting image 64 and / or virtual elements included in the image 64. In this manner, the virtual characteristics of the image 64 can more closely correspond to the actual physical characteristics (e.g., reality, appearance, real-life experience) of the surrounding environment (e.g., the real-world environment). The control system 70 may also be configured to operate the audio emitters 68 and other components of the show effects system 60 based on data received from the sensors 76, such as to provide guests with audio effects that simulate aspects of the surrounding environment.

[0024] In one embodiment, the control system 70 also includes a user interface (UI) 78 with which a user, such as an operator, guest, or technician of the amusement park system 50, can interact to operate the control system 70. For example, a user can utilize the UI 78 to adjust the images 64 output by the display 62 and / or the audio effects output by the audio emitter 68. As an example, a user can change the appearance of virtual elements that correspond to (e.g., mimic, represent, model, simulate, complement) real-world elements, for example, by modifying the virtual elements to correspond to (e.g., mimic, represent, model, simulate, complement) different types and / or classes of real-world elements, modifying the amount of virtual elements, modifying other virtual elements (e.g., secondary virtual elements) that do not correspond to (e.g., mimic, represent, model, simulate, complement) the determined real-world element, etc. A class of real-world elements can include a particular variety of a type of real-world element. For example, a class of real-world elements, such as trees, can include birch trees, maple trees, and / or orange trees. In this manner, control system 70 can adjust the image data provided to display 62 based on interactions with UI 78 to modify image 64 output by display 62, such as changing the appearance of virtual elements of generated image 64 based on data received from sensors 76. Accordingly, control system 70 can also be configured to provide a more customizable experience for guests. As a specific example, the generated environment can mimic the lighting, trees, and other environmental features of a real exterior environment while displaying specific graphics (e.g., unique tree or bird graphics) that achieve the goals of the themed environment (e.g., further deepen the narrative).

[0025] FIG. 2 is a schematic diagram of an amusement park system 50 having a show effects system 60 and a guest area 52. In the illustrated embodiment, the guest area 52 includes a plurality of guests 100. The guest area 52 can be part of an attraction system having, for example, themed elements (e.g., props) that simulate an environment. For example, the guest area 52 can include a path, such as a queue, along which the guests 100 can move through the attraction system. In one embodiment, the attraction system can include outdoor and indoor areas along which the path can extend. In the outdoor area, passengers can be present in a real-world outdoor environment 101. In the indoor area, passengers can be immersed in a virtual or simulated environment provided by the show effects system 60. As an example, the show effects system 60 can present imagery 102 that corresponds to (e.g., mimics, represents, models, simulates, complements) the real-world outdoor environment 101, realistically depicting a digital scene with real-world elements of the real-world outdoor environment 101. Thus, the respective environments associated with the outdoor and indoor areas may blend seamlessly into one another to provide the appearance of immersion for the guest 100 in a real-world outdoor environment 101 while navigating the indoor areas of the amusement park system 50. For example, as the guest 100 transitions from the outdoor area to the indoor area, the imagery 102 created and / or presented by the show effects system 60 may give the guest 100 the impression that they are still in an outdoor area while providing a graphical element of special interest (e.g., an animated bird in a graphical sky that mimics a real sky).While this disclosure describes generating image data, generating images 102, and / or displaying images 102 that correspond to (e.g., mimic, represent, model, simulate, complement) a real-world outdoor environment 101 via a show effects system 60, it should be noted that the images 102 provided by the show effects system 60 may correspond to (e.g., mimic, represent, model, simulate, complement) any other suitable real-world environment, such as a crowd of people, a room within a building or other structure, etc.

[0026] In the illustrated embodiment, the image 102 output by the display 62 provides a digital scene that simulates the appearance of an outdoor sky. For example, the virtual elements of the image 102 may include virtual clouds 104 and additional virtual elements, such as a virtual sun 106. Thus, to simulate a realistic depiction of the virtual clouds 104 and the virtual sun 106, the image 102 may be output at a location located above the guest 100. In this manner, the guest 100 may see the virtual clouds 104 and the virtual sun 106 as being positioned in a realistic location corresponding to the outdoor sky, thereby providing a realistic appearance that the image 102 is part of the real-world outdoor environment 101 rather than being a projection via the show effects system 60. By way of example, the display 62 may be part of a wall, screen, ceiling portion, or any other suitable portion of the amusement park system 50 located above the guest 100. In additional or alternative embodiments, such as embodiments in which the image 102 can simulate different real-world elements, the image 102 may be output at a location in any other suitable relationship to the guest 100. For example, an image 102 corresponding to (e.g., imitating, representing, modeling, simulating, complementing) an actual underwater or underground element may be positioned below the guest 100, such as via a display above which the guest 100 is positioned.

[0027] The control system 70 can transmit image data to the display 62 to output an image 102 having virtual clouds 104 and / or a virtual sun 106 presented in a particular manner corresponding to the real-world outdoor environment 101. For example, the control system 70 can receive data from the sensor 76, such as data including a captured image 77 of the real-world outdoor environment 101 (e.g., the sky). The control system 70 can receive the captured image 77 and determine the class of real-world clouds included in the captured image 77. For example, through machine learning, the control system 70 can identify cloud classes that change throughout the day. The control system 70 can then generate image data that causes the display 62 to output a captured image 102 including virtual clouds 104 of the same class as the real-world clouds identified in the captured image 77 received from the sensor 76. Additionally or alternatively, the control system 70 can generate image data (e.g., image data corresponding to the image 102), and the control system can then instruct the display 62 to output the image 102 based on the image data. Additionally or alternatively, control system 70 can determine the population density of real-world clouds or the amount of real-world clouds in a particular area in captured image 77, and control system 70 can generate image data that causes display 62 to output image 102 having virtual clouds 104 distributed at a similar population density. Control system 70 can further determine the position of the real-world sun and / or the relative position of the real-world sun to the real-world clouds in captured image 77, and control system 70 can generate image data that causes display 62 to output image 102 having virtual clouds 104 and / or virtual sun 106 positioned relative to one another in a similar manner. Thus, virtual clouds 104 can correspond to (e.g., mimic, represent, model, simulate, complement) the appearance of real-world clouds, and image 102 viewed by guest 100 can more closely depict the sky of real-world outdoor environment 101.Further, in some embodiments, the control system 70 may receive and / or determine (e.g., using machine learning) updated one or more characteristics associated with one or more real-world elements based on updated received data, including an updated captured image 77 of the real-world outdoor environment 101 from the sensors 76. For example, the control system 70 may identify updated positions of the real-world elements based on the updated data from the sensors 76 and determine corresponding updated positions of virtual elements associated with the real-world elements. Further, the control system 70 may modify the image data by modifying the positions of the virtual elements (e.g., with respect to the digital scene) such that the updated positions of the virtual elements correspond to (e.g., match, mimic, model, simulate) the updated positions (e.g., updated characteristics) of the real-world elements identified in the captured image 77.

[0028] As generally described herein, in some embodiments, the sensors 76 may detect characteristics (e.g., physical characteristics) associated with the real-world outdoor environment 101. In particular, the sensors 76 may detect the temperature (e.g., heat), the amount of light (e.g., sunlight), the moisture (e.g., humidity), the pressure, or any combination thereof, of the real-world outdoor environment 101. For example, the sensors 76 may include a temperature sensor and / or a light sensor. In such embodiments, the sensors 76 may detect the temperature of the real-world outdoor environment 101 and / or the amount of light in the real-world outdoor environment 101. Data related to the detected temperature and / or the detected amount of light may be provided to the control system 70 by the sensors 76. In this manner, the control system 70 may receive data from the sensors 76 that may be indicative of weather conditions (e.g., rainy, sunny, hot, cold, cloudy) associated with the real-world outdoor environment 101. Additionally or alternatively, the control system 70 may receive characteristics associated with the real-world outdoor environment 101, such as weather conditions, time of day, time of year (e.g., season), temperature, or any combination thereof, from an external source. The external source may be, for example, a weather service, a database, a global positioning service (GPS), a network time protocol (NTP), or any combination thereof communicatively coupled to the show effects system 60 .

[0029] Additionally, control system 70 may utilize characteristics associated with real-world outdoor environment 101 (e.g., received and / or detected characteristics) in combination with image 77 to generate image 102. The characteristics may enhance the generated image 102 and provide increased similarity between the real-world outdoor environment 101 and the resulting image 102 and / or virtual elements included within image 102. In this manner, the virtual characteristics of image 102 may correspond more closely to the actual physical characteristics (e.g., reality, appearance, immersive experience) of real-world outdoor environment 101, and image 102 viewed by guest 100 may more closely depict aspects of real-world outdoor environment 101.

[0030] By displaying virtual elements based on images 77 of the real-world outdoor environment 101, the show effects system 60 can immerse the guests 100 in a more realistic environment that represents the real-world outdoor environment 101. Furthermore, the show effects system 60 can portray a more desirable image to the guests 100 by generating virtual elements rather than directly depicting, for example, images 77 captured by sensors 76. For example, images 77 captured by sensors 76 may include various real-world elements that may not be desirable to display to the guests 100. For an image 77 capturing an outdoor sky, such real-world elements may include, for example, aircraft, animals, amusement park elements (e.g., from a nearby attraction system) (e.g., fog, lighting), etc. In this manner, the images 102 provided by the show effects system 60 can more desirablely portray the real-world outdoor environment 101, immersing the guests 100 in a realistic environment.

[0031] While this disclosure describes adjusting the virtual clouds 104 and / or the virtual sun 106 in the output image in the embodiments described herein, in additional or alternative embodiments, any other virtual elements may be adjusted. For example, the appearance of the moon in the image may be adjusted based on the determined appearance (e.g., illumination, appearance of craters) of the moon in the captured image 77, the appearance of precipitation in the image may be adjusted based on the determined precipitation (e.g., precipitation class, precipitation magnitude) occurring in the captured image 77, the appearance of a humanoid object (e.g., a robot) in the image may be adjusted based on the determined precipitation (e.g., precipitation class, precipitation magnitude) occurring in the captured image 77, the appearance of a humanoid object (e.g., a robot) in the image may be adjusted based on the determined appearance (e.g., facial features) of the guest 100 in the captured image 77, the appearance of trees in the image may be adjusted based on the class and / or population density of trees in the captured image 77, etc.

[0032] Additionally, in some embodiments, show effects system 60 can utilize characteristics (e.g., received and / or detected characteristics) associated with real-world outdoor environment 101 to modify images 102 and / or virtual elements of images 102 presented to guests 100. For example, control system 70 can receive data indicating that physical characteristics (e.g., current physical characteristics, real-time physical characteristics) of real-world outdoor environment 101 are relatively hot and sunny (e.g., via temperature and / or light sensors). As a result, show effects system 60 can adjust images 102 and / or virtual elements in images 102 based on the received physical characteristics. As an example, the virtual elements of images 102 can include a human-like figure, and show effects system 60 can depict the human-like figure squinting, sweating, fanning itself, casting shade, talking about the hot weather environment, or any combination thereof.

[0033] Additionally or alternatively, as generally described herein, the show effects system 60 may include animated figures (e.g., props, robots) viewable by guests 100 in the amusement park system 50. Thus, in some embodiments, the show effects system 60 may utilize characteristics (e.g., received and / or detected characteristics) associated with the real-world outdoor environment 101 to operate (e.g., control, send commands, activate) the animated figures presented to guests 100. For example, the control system 70 may receive data indicating that the physical characteristics (e.g., current physical characteristics, real-time physical characteristics) of the real-world outdoor environment 101 are relatively hot and sunny (e.g., via temperature and / or light sensors). As a result, the show effects system 60 may operate the animated figures based on the received physical characteristics. By way of example, the animated figures may be operated to squint, fan themselves, shade themselves, comment on the hot weather environment, or any combination thereof.

[0034] In this manner, the show effects system 60 can present images having virtual elements that correspond to (e.g., mimic, represent, model, simulate, or complement) any suitable real-world element to immerse the guest 100 in a particular environment. Furthermore, certain virtual elements can be modified to enhance interest and immersion in the narrative. For example, a graphical sun can be realistically depicted based on the lighting detected in the real outdoor environment and can be depicted to include features suggestive of the presence of a human face. Additionally or alternatively, virtual elements can be utilized to create environments that differ from the real outdoor environment, including environments that are the opposite of the real outdoor environment. For example, the sun can be presented when it is actually dark outside, or the moon can be presented when the moon is not actually visible in the outdoor sky.

[0035] FIG. 3 is a schematic diagram illustrating an embodiment of a show effects system 60. The show effects system 60 can present different images of a real-world outdoor environment for viewing by guests. For example, the control system 70 can cause the display 62 to output a first image 130, a second image 132, and a third image 134. Each of the images 130, 132, and 134 can include a virtual cloud 104 and a virtual sun 106, and the virtual cloud 104 can have a different appearance in the images 130, 132, and 134. The first image 130 can include a first virtual cloud 104A of a first class and a first population density. For example, the first virtual cloud 104A can include a cumulus-class cloud arranged at a relatively low population density. The second image 132 can include a second virtual cloud 104B of a first class and a second population density, such as a cumulus-class cloud arranged at a relatively medium population density. The third image 134 may include a third virtual cloud 104C of a second class and a third population density, such as a stratus class of clouds arranged at a relatively high population density. In each of the images 130, 132, 134, the virtual sun 106 may be centered on the display 62.

[0036] In one embodiment, the control system 70 may cause the display 62 to output images 130, 132, 134 based on data received from the sensor 76. For example, the control system 70 may identify one or more visual characteristics associated with real-world elements in the image 77. For example, the control system 70 may identify a cloud class (e.g., cumulus, stratus, cirrus, cumulonimbus, altocumulus, altostratus, stratus) in the image 77 received from the sensor 76. The cloud class may indicate various characteristics of the cloud's appearance, such as whether the cloud is fluffy, opaque, transparent, wispy, or powdery. The control system 70 may also identify other visual characteristics, such as the relative color, shape, and / or size of the real-world clouds in the image 77. The control system 70 may also identify the population density of the real-world clouds in the image 77. The control system 70 can then generate image data to cause the display 62 to output one of the images 130, 132, 134, including the virtual cloud 104 having the identified visual characteristics, such as class, color, shape, size, population density, or any combination thereof, as identified from the received image 77. In one embodiment, the control system 70 can dynamically modify the generated image data based on the image 77 received from the sensor 76. For example, the control system 70 can determine a change (e.g., an increase) in cloud population density in the received image 77 and generate image data that reflects the identified change (e.g., by increasing the number of clouds in the presented image). Similarly, the control system 70 can determine a change in cloud class in the received image 77 and generate image data that reflects the change in cloud class. In this manner, the control system 70 can provide updated image data to facilitate the presentation of an image that can more closely correspond to (e.g., mimic, represent, model, simulate, or complement) the received image 77. However, narrative goals can be achieved by modifying the images 130, 132, 134.For example, even in the case of dense cloud cover, the virtual clouds 104 may be presented such that the virtual sun 106 is still visible.

[0037] Control system 70 can maintain the presentation of virtual sun 106 in each of images 130, 132, 134. In other words, control system 70 can generate image data that causes display 62 to present virtual sun 106 regardless of real-world clouds identified in image 77 received from sensor 76 and / or regardless of whether the real-world sun is included in the received image 77. In additional or alternative embodiments, control system 70 can generate image data that at least partially obscures the visibility of virtual sun 106 by superimposing virtual cloud 104 on top of virtual sun 106. In such embodiments, the image data generated by control system 70 can make virtual sun 106 partially visible through virtual cloud 104, such as by providing some illumination of virtual sun 106 through virtual cloud 104. Control system 70 can further generate image data that causes display 62 to output images that appear to show movement of virtual cloud 104 and / or virtual sun 106. Thus, the image presented by display 62 can more realistically depict the appearance of the sky over time.

[0038] FIG. 4 is a schematic diagram of an embodiment of show effects system 60 that causes a fourth image 160, a fifth image 162, and a sixth image 164 to be presented to guests. Images 160, 162, and 164 can have the appearance of different digital scenes. Fourth image 160 and fifth image 162 can depict real-world outdoor environments at different times of day. As an example, fourth image 160 can depict a real-world outdoor environment at night, while fifth image 162 can depict a real-world outdoor environment at daytime. For example, control system 70 can determine the time of day based on data received from sensor 76, such as via a timer that directly indicates the time of day and / or via image 77 that can indicate the time of day (e.g., based on the amount of lighting provided in image 77). To depict a real-world outdoor environment at night, control system 70 can cause display 62 to present a darker sky with stars 166 in fourth image 160. To depict a daytime, real-world outdoor environment, control system 70 can cause display 62 to present a brighter sky along with a different coloration of virtual clouds 104 (e.g., a red hue to depict illumination of virtual clouds 104 by a rising sun).

[0039] In one embodiment, the control system 70 may also adjust the appearance of the virtual sun 106 in the different images. As an example, the control system 70 may cause the virtual sun 106 to have an increased size in the fifth image 162 compared to the virtual sun 106 in the fourth image 160. Additionally, the control system 70 may cause the virtual clouds 104 to obscure the virtual sun 106 (e.g., completely reduce the visibility of the virtual sun 106) in the sixth image 164. The obscuring of the virtual sun 106 may be based on a detected real-world outdoor environment and / or based on the operation of the amusement park system. For example, in response to determining that the operation of the amusement park system has been suspended (e.g., because amusement ride vehicles have been stopped for repairs or while guests are boarding or disembarking), the control system 70 may obscure the virtual sun 106, as shown in the sixth image 164, to correlate with the theme of the amusement park system being powered by the virtual sun 106. Control system 70 may also adjust other aspects of virtual sun 106 (e.g., as output by display 62), such as the brightness (e.g., illumination, luminance) and / or elevation position of virtual sun 106 in other images. Adjusting the appearance of virtual sun 106 may further provide a realistic depiction of a real-world outdoor environment by changing the appearance of other virtual elements in addition to virtual clouds 104 to correspond to (e.g., mimic, represent, model, simulate, complement) the real-world outdoor environment.

[0040] In additional or alternative embodiments, control system 70 may cause display 62 to output any of images 130, 132, 134, 160, 162, 164 based on user input, such as via UI 78. For example, the user input may indicate a cloud class and / or cloud population density, and control system 70 may generate and output image data to cause display 62 to present an image according to the user-indicated cloud class and / or user-indicated cloud population density, regardless of the determined cloud class and / or determined cloud population density of image 77 received from sensor 76. Control system 70 may further adjust (e.g., modify) other parameters of the image, such as the appearance of virtual sun 106 and / or the time of day presented in the image, based on the user input. In this manner, control system 70 may cause display 62 to present an image based on a combination of the user input and the determined parameters. In this manner, the virtual environment may gradually transition from one that correlates to a real-world outdoor environment to an environment that is consistent with a narrative. For example, if it is raining in a real-world outdoor environment, the virtual environment may transition from a rainy appearance to a sunny day, giving the impression of experiencing the ride on a sunny day that better matches the theme of the ride.

[0041] In some embodiments, control system 70 can utilize characteristics associated with the real-world outdoor environment (e.g., received and / or detected characteristics) in combination with image 77 and / or user input to output any of images 130, 132, 134, 160, 162, 164. The characteristics can enhance the generated image and provide increased similarity between the real-world outdoor environment and the resulting image and / or virtual elements included within the image. In this manner, the virtual characteristics of the image can more closely correspond to the actual physical characteristics (e.g., reality, appearance, immersion) of the real-world outdoor environment, and the image viewed by the guest can more closely depict aspects of the real-world outdoor environment.

[0042] FIG. 5 is a schematic diagram of one embodiment of a show effects system 60. The control system 70 of the illustrated show effects system 60 can utilize machine learning (e.g., supervised machine learning, unsupervised machine learning) to generate image data that causes the display 62 to present images. As used herein, machine learning refers to algorithms and statistical models that the control system 70 can use to perform specific tasks without using explicit instructions, relying instead on patterns and inference. In particular, machine learning generates mathematical models based on data (e.g., sample data or training data, historical data) to make predictions or decisions without being explicitly programmed to perform a task. For example, machine learning can be used to generate image data based on images 77 received from a sensor 76. The control system 70 can use patterns associated with machine learning to generate image data based on the received images 77, such as by determining cloud class and / or cloud population density.

[0043] In one embodiment, supervised machine learning can be implemented, such as when specific known examples exist that correlate with the future predictions the control system 70 is tasked with generating. In supervised machine learning, a mathematical model of a data set includes both inputs and a desired output. This data, called "training data," is essentially a set of training examples. Each training example has one or more inputs and a desired output, also known as a supervisory signal. In the mathematical model, each training example is represented by an array or vector, also called a feature vector, and the training data is represented by a matrix. Supervised learning algorithms learn a function that can be used to predict outputs associated with new inputs by iteratively optimizing an objective function. The optimal function allows the algorithm to correctly determine outputs for inputs not included in the training data. An algorithm whose output or prediction accuracy improves over time is considered to have learned to perform its task. Supervised learning algorithms include classification and regression. Classification algorithms are used when the output is limited to a limited set of values, while regression algorithms are used when the output can have any value within a range. Furthermore, similarity learning is a branch of supervised machine learning closely related to regression and classification, but whose goal is to learn from examples using a similarity function that determines the degree to which two objects are similar or related.

[0044] Additionally or alternatively, in some situations, it may be beneficial for the control system 70 to utilize unsupervised learning (e.g., when the specific output type is not known). An unsupervised learning algorithm takes a data set containing only inputs and finds structure in the data, such as groupings or clustering of data points. Thus, the algorithm learns from test data that has not been labeled, classified, or categorized. Instead of reacting to feedback, an unsupervised learning algorithm identifies commonalities in the data and reacts based on the presence or absence of such commonalities in each new piece of data.

[0045] As a result of the machine learning implementation, the control system 70 may include a machine learning model 190, which may be stored, for example, in a memory of the control system 70. The control system 70 may also include an image generation circuit 192, which may be part of the processing circuitry of the control system 70. The control system 70 may use the machine learning model 190 and the image generation circuit 192 to cause (e.g., instruct) the display 62 to output the image 102 as desired. As an example, the machine learning model 190 may receive as input the image 77 from the sensor 76 and determine various parameters from the image 77, such as a real-world cloud class and / or a real-world cloud population density. The machine learning model 190 may provide the determined parameters as an output to the image generation circuit 192. The image generation circuit 192 may generate image data based on the parameters received from the machine learning model 190. For example, the image generation circuit 192 may generate image data having a virtually generated cloud corresponding to the cloud class, cloud appearance, and / or cloud population density as determined by the machine learning model 190. In this manner, the virtual elements of the image data may correspond to (e.g., mimic, represent, model, simulate, complement) real-world elements of the image 77 provided by the sensor 76. The display 62 may receive the image data generated via the image generation circuitry 192 and output an image 102 for presentation based on the image data. In this manner, the control system 70 may utilize the machine learning model 190 to automatically (e.g., without user input) present the image 102 on the display 62 based on the image 77 received from the sensor 76.

[0046] Additionally or alternatively, in some embodiments, control system 70 can utilize physical characteristics associated with the real-world outdoor environment (e.g., received and / or detected characteristics as described herein) in combination with image 77 to (e.g., automatically) generate image 102. The characteristics can enhance the generated image 102 and provide increased similarity between the real-world outdoor environment and the resulting image 102 and / or virtual elements included within image 102. In this manner, the virtual characteristics of image 102 can more closely correspond to the actual physical characteristics (e.g., reality, appearance, immersive experience) of the real-world outdoor environment, and image 102 as viewed by a guest can more closely depict aspects of the real-world outdoor environment.

[0047] Each of Figures 6-8, described below, illustrates a respective method or process associated with the operation of show effects system 60. In one embodiment, each method may be performed by a single respective component or system, such as control system 70 (e.g., processing circuitry 74). In additional or alternative embodiments, multiple components or systems may perform the operations for a method. It should also be noted that additional operations may be performed with respect to the depicted methods. Also, certain operations of the depicted methods may be eliminated, modified, and / or performed in a different order. Furthermore, any operations of the respective methods may be performed in parallel with one another, e.g., simultaneously and / or in response to one another.

[0048] 6 is a flowchart of one embodiment of a method 210 for operating a show effects system to present images. At block 212, captured images of a real-world environment may be received, such as from a sensor (e.g., an optical sensor). For example, the images may include one or more images of an outdoor environment surrounding the show effects system, such as a view of the sky. At block 214, real-world elements of the captured image may be identified. By way of example, the class of the real-world element (e.g., the class of clouds in the sky or the class of surrounding foliage), the appearance (e.g., color, size, shape, visual characteristics) and / or population density (e.g., the amount of clouds or trees in the captured image) of the real-world element may be identified.

[0049] In block 216, image data can be generated to provide virtual elements that correspond to (e.g., mimic, represent, model, simulate, complement) the appearance of the real-world elements identified from the captured image. As one example, the virtual elements in the image data can be stylized to correspond to the appearance of the real-world elements, such as based on the identified class (e.g., oak tree, fir tree) or other appearance characteristics (e.g., leaf coloration) of the real-world elements. As another example, the population density of the virtual elements in the image data can be based on the population density of the real-world elements in the image. That is, the amount of the real-world elements in the captured image can correspond to the population density of the real-world elements. In one embodiment, the captured image can be determined to be free of the target real-world elements. Accordingly, the generated image data can also be free of virtual elements that correspond to the target real-world elements. Thus, the virtual elements in the image data can more closely correspond to the current real-world elements shown by the captured image.

[0050] Additionally or alternatively, in some embodiments, the image data can be generated to provide virtual elements that include virtual characteristics based on identified properties associated with real-world elements identified from the captured image. As discussed herein, properties and / or characteristics associated with the identified real-world elements can be identified (e.g., determined) from the captured image. Furthermore, the virtual properties of the virtual elements can be based on the identified properties. As an example, the identified real-world elements can include clouds, and the identified properties of the clouds can include measurements of the relative size of the clouds, the density of the clouds, the color of the clouds, and / or the movement of the clouds in the captured image. Furthermore, the generated image data can include virtual elements that have virtual properties similar to the identified properties associated with the clouds, although the virtual elements may not match the type of real-world element. Continuing with this example, the virtual elements can include a flock of butterflies that have a size, density, color, and / or movement similar to the clouds. In this manner, the displayed image obtained from the image data can include a virtual element, such as a group of butterflies, that has a similar appearance to an identified real-world element, such as a cloud.

[0051] In one embodiment, the image data can be newly generated without using existing image data. That is, each virtual element can be newly generated based on the captured image without using pre-defined virtual elements (e.g., previously generated virtual elements). In an additional or alternative embodiment, the image data can be generated by modifying an existing image (e.g., a prepared image, a stock image). For example, the existing image can include pre-defined virtual elements, which can be adjusted based on real-world elements identified from the captured image. For example, a virtual model of a tree or cloud can be provided, and the coloring can be adjusted based on coloring detected in the real environment. In either embodiment, the virtual elements of the image data can be implemented based on identified types and / or classes, identified population densities, and / or any other suitable parameters related to the captured image. For example, the amount of pixels and / or a percentage of the total amount of pixels in the image data can be assigned to the virtual elements based on the captured image.

[0052] The generated image data can also provide virtual elements that appear to interact with each other and / or other aspects of the digital scene. By way of example, the virtual elements of the image data can include trees and / or clouds that cast shadows based on the position of the trees and / or clouds relative to the rest of the digital scene and / or based on the direction of lighting in the digital scene. Such digital content can be procedurally generated. For example, the image data can first be generated to include virtual elements that correspond to (e.g., mimic, represent, model, simulate, complement) a captured image, and the image data can then be modified to adjust the appearance of the virtual elements. In this manner, the image data generated based on the initially captured image can be further refined to make the virtual elements appear more realistic.

[0053] In block 218, the generated image data (e.g., comprising procedurally generated digital content) can be transmitted for presentation (e.g., display) in a ride environment or other attraction. As an example, the image data can be transmitted to a display, causing the display to present an image based on the image data. The presented image can include virtual elements that correspond to (e.g., mimic, represent, model, simulate, complement) real-world elements in the image. Thus, the image in the image can appear to match, integrate, or merge with the real-world environment, providing a more realistic image based on detected real-world conditions. In some embodiments, the image data can include modifications to provide elements of interest (e.g., a virtual tree can be depicted with human features or animated despite the absence of such movement in a real outdoor environment).

[0054] 7 is a flowchart of an embodiment of a method 240 for operating a show effects system to present images. For example, method 240 can be performed to enhance image data generated via method 210. At block 242, image data can be generated based on the captured image data, and virtual elements of the image data can correspond to (e.g., mimic, represent, model, simulate, complement) real-world elements of the captured image, such as via the techniques described above. At block 244, additional parameters can be received. The additional parameters can include time of day, precipitation conditions, temperature, humidity, and others. The additional parameters can be received via sensors and / or other sources, such as from the internet and / or from user input.

[0055] In block 246, the generated image data can be updated based on additional parameters. As one example, lighting of virtual elements, such as lighting intensity, lighting direction (e.g., to simulate the position of the sun), lighting color, etc., can be adjusted. As another example, additional virtual elements corresponding to precipitation, such as rain, snow, or sleet, can be added based on the identified presence of precipitation in the real-world environment. As a further example, other adjustments can be made to the image data, such as distorting virtual elements in the image (e.g., to simulate a hazy appearance during elevated temperatures, to simulate a humid and / or polluted environment), or adding other virtual elements (e.g., fog, lightning, stars) that may not be present in the captured image. Thus, updates made to the image data can be based on supplemental information that does not directly correspond to (e.g., mimic, represent, model, simulate, or complement) real-world elements in the captured image, but that facilitate providing a realistic representation of the real-world environment. In block 248, once the image data is updated, the updated image data can be sent to a display to present an image based on the updated image data.

[0056] Additionally or alternatively, the generated image data may be updated based on received and / or detected physical characteristics associated with the real-world environment. For example, data may be received indicating that the physical characteristics (e.g., current physical characteristics, real-time physical characteristics) of the real-world environment are relatively cold and dark. As a result, the image data (e.g., virtual elements of the image data) may be updated based on the received physical characteristics. As an example, the virtual elements of the image data may include a human-like figure, and the virtual elements may be updated to depict the human-like figure shivering and / or talking about the cold and / or dark weather environment. In this manner, the display of the image data (e.g., virtual elements) may more closely correspond to actual, real-world aspects of the real-world environment.

[0057] As generally described herein, in some embodiments, an animated figure (e.g., a prop, a robot) may act based on received and / or detected physical characteristics related to a real-world environment. As one example, data may be received indicating that the physical characteristics (e.g., current physical characteristics, real-time physical characteristics) of the real-world environment are relatively cold and dark. As a result, the animated figure may act based on the received physical characteristics. As one example, the animated figure may be acted to shiver and / or comment on the cold and / or dark weather environment. In this manner, the show effects system may more closely respond to aspects of the real-world environment.

[0058] It should be noted that methods 210, 240 can be performed continuously to enable dynamic generation of image data for transmission to present the image. Thus, the image presented (e.g., via a display) based on the image data can be continuously updated to more closely correspond to (e.g., mimic, represent, model, simulate, complement) the real-world environment based on newly captured images, etc. For example, the appearance of virtual elements can be adjusted over time based on detected real-world elements in captured images.

[0059] Furthermore, the appearance of the virtual elements can also be based on other parameters not directly related to the detected parameters of the real-world environment. As an example, the virtual elements can be stylized based on the theme of the amusement park and / or attraction system in which the show effects system is implemented. For example, a first virtual element presented by a first show effects system can have a more cartoon-like appearance, while a second virtual element presented by a second show effects system can have a more realistic appearance. In fact, even though the same captured image can be received by different show effects systems, the virtual elements presented by the show effects systems can appear different from each other. In other words, virtual elements generated based on the same type and / or class and / or the same population density associated with the captured image can have different appearances for different show effects systems. Thus, the images presented by each show effects system can be tailored to its particular implementation.

[0060] 8 is a flowchart of one embodiment of a method 270 of operating a show effects system to generate a machine learning model utilized to present images based on captured images. At block 272, training data is received that associates input images with corresponding output real-world element parameters. The training data may include, for example, a first quantity of input images that may be manually assigned to real-world element parameters. For example, each input image may be an image of sky, and the real-world element parameters may include cloud class and / or cloud population density.

[0061] In block 274, a machine learning model can be generated based on the training data. As an example, characteristics of an input image, such as raw pixel data (e.g., pixel coloration), can be identified, and a relationship between such characteristics and associated real-world element parameters can be determined. In this manner, an algorithm that defines the relationship between the characteristics and the real-world element parameters can be determined and established in the machine learning model.

[0062] At block 276, additional input images can be received to further train the machine learning model. That is, the additional input images can be used to determine whether the generated machine learning model operates appropriately to generate real-world element parameters. As such, such additional input images can be different from the input images and may not include the assigned real-world element parameters. In one embodiment, the second amount of additional input images (e.g., 100, 200, 300 images) used to adjust the machine learning model can be less than the first amount of input images (e.g., 700, 800, 900, 1,000 images) used to initially establish the machine learning model. In alternative embodiments, the second amount of additional input images can be the same as or greater than the first amount of input images.

[0063] In block 278, the machine learning model can be used to identify additional real-world element parameters corresponding to the additional input images. That is, the additional input images can be used as inputs to the machine learning model, and the machine learning model can generate the additional real-world element parameters as outputs for the additional input images. The additional real-world element parameters can then be analyzed, such as manually analyzed by a user, to determine whether the generated additional real-world element parameters are accurate.

[0064] At block 280, feedback indicating whether the additional real-world element parameters have been accurately identified may be received. For example, a user may provide user input regarding whether each additional real-world element parameter has been accurately identified for each additional input image. The feedback may, for example, confirm that the additional real-world element parameters have been accurately identified, indicate that the additional real-world element parameters have not been accurately identified, and / or directly indicate the accurate real-world element parameters.

[0065] In block 282, the machine learning model can then be updated based on the feedback. As one example, in response to receiving feedback that the additional real-world element parameters associated with the additional input images have not been accurately identified, the algorithm of the machine learning model can be adjusted so that the machine learning model can more closely identify the accurate additional real-world element parameters associated with the additional input images. As another example, in response to receiving feedback that the additional real-world element parameters associated with the additional input images have been accurately identified, the algorithm of the machine learning model can be kept more robust (e.g., less susceptible to adjustment) so that real-world element parameters are similarly identified for similar images. In this manner, the machine learning model can be updated based on the received feedback to identify real-world element parameters that can more accurately reflect subsequently received images.

[0066] While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art, and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the disclosure.

[0067] The approaches presented and claimed herein refer to and apply substantial objects and specific embodiments of a practical nature that clearly improve the art of the present invention, and are therefore not abstract, intangible, or theoretical in nature. Furthermore, to the extent that any claim appended to the end of this specification contains one or more elements designated as "means for 'performing' a 'function'" or "steps for 'performing' a 'function,'" such elements shall be construed in accordance with 35 U.S.C. 112(f). However, for any claim containing elements designated in any other manner, such elements shall not be construed in accordance with 35 U.S.C. 112(f). [Explanation of symbols]

[0068] 62 Display 70 Control System 76 Sensors 77 images 101 Real World External Environment

Claims

1. It is a system for attractions, A sensor configured to capture an image of the real-world environment, A control system that is communicatively coupled to the aforementioned sensor, Equipped with, The control system is The image captured by the sensor is received, Identify the population density associated with one or more real-world clouds depicted in the image of the real-world environment, Identify one of several cloud classes, and the cloud class is associated with one or more real-world clouds. Based on the population density and the cloud class, image data is generated that includes one or more virtual clouds that visually correspond to one or more real-world clouds. The image data is transmitted, and a virtual image is presented in the attraction based on the image data. A system configured in such a way.

2. The system according to claim 1, wherein the control system is configured to identify a real-world leaf depicted in the image and to identify a class of the real-world leaf, and the image data includes data for providing virtual leaves that visually correspond to the real-world leaf based on the class of the real-world leaf identified from the image.

3. The aforementioned image data includes data corresponding to a digital scene, and the control system is Identify the positional changes of one or more real-world clouds, Based on identifying the positional changes of the one or more real-world clouds, the image data is modified by correcting the positions of the one or more virtual clouds relative to the digital scene so that they visually correspond to the one or more real-world clouds. The system according to claim 1, configured as follows.

4. The system according to claim 1, wherein the control system is configured to determine the visual characteristics of the one or more real-world clouds in the image, and the image data includes the one or more virtual clouds that visually correspond to the one or more real-world clouds based on the visual characteristics.

5. The control system is Determine the time period related to the aforementioned image, Based on the aforementioned time period, the illumination, color, or both of the one or more virtual clouds are modified. The system according to claim 1, configured as follows.

6. The system according to claim 1, wherein the attraction is equipped with a display, the control system is configured to transmit the image data to the display, and the display is configured to display the image of one or more virtual clouds in the attraction based on the image data.

7. The system according to claim 4, wherein the visual characteristics include the color, size, transparency, movement, or shape of one or more real-world clouds.

8. The system according to claim 1, wherein the plurality of cloud classes include a cottony cloud class, an opaque cloud class, a faint cloud class, a powdery cloud class, or any combination thereof.

9. A non-temporary computer-readable medium containing instructions, wherein, when the instructions are executed by a processing circuit, the processing circuit receives, Receive the captured image, To identify the first population density of one or more real-world clouds depicted in the captured image, Identify a first cloud class of the one or more real-world clouds depicted in the captured image, Based on the first population density and the first cloud class, image data is generated having one or more virtual clouds that visually correspond to one or more real-world clouds. The image data is output in order to display one or more virtual clouds. Non-temporary computer-readable media.

10. The non-temporary computer-readable medium according to claim 9, wherein when the instruction is executed by the processing circuit, it causes the processing circuit to generate the image data having one or more additional virtual clouds.

11. When the aforementioned instruction is executed by the processing circuit, the processing circuit will: To identify a second population density of one or more additional real-world clouds depicted in the captured image, Identify a second cloud class of the one or more additional real-world clouds depicted in the captured image, Based on the second population density and the second cloud class, the image data is generated having one or more additional virtual clouds that visually correspond to the one or more additional real-world clouds. The non-temporary computer-readable medium according to claim 10.

12. When the aforementioned instruction is executed by the processing circuit, the processing circuit will: The input image is given training data that associates it with the corresponding population density and corresponding cloud class of one or more real-world clouds depicted within the input image. A machine learning model is generated based on the aforementioned training data. The non-temporary computer-readable medium according to claim 9.

13. When the aforementioned instruction is executed by the processing circuit, the processing circuit will: Receive additional input images, Using the machine learning model, identify additional corresponding population densities and additional corresponding cloud classes for one or more additional real-world clouds in the additional input images. To receive feedback indicating whether the additional corresponding population density and the additional corresponding cloud class have been accurately identified, The machine learning model is updated based on the aforementioned feedback. The non-temporary computer-readable medium according to claim 12.

14. The non-temporary computer-readable medium according to claim 12, wherein, when the instruction is executed by the processing circuit, the processing circuit uses the machine learning model to identify the first population density and the first cloud class of the one or more real-world clouds depicted in the captured image.

15. The non-temporary computer-readable medium according to claim 9, wherein, when the instruction is executed by the processing circuit, the processing circuit causes the processing circuit to identify the presence of precipitation in a real-world environment related to the captured image, and the image data includes additional virtual elements that visually correspond to the precipitation.

16. It is a system, A display configured to present an image, A control system configured to perform an operation, Equipped with, The aforementioned operation is, Receiving images of the real world environment, Identifying the cloud class of one or more real-world clouds depicted in the aforementioned image, To identify the visual characteristics of the one or more real-world clouds depicted in the image, Based on the cloud class and the visual characteristics, generate image data including one or more virtual clouds that visually correspond to one or more real-world clouds, and additional virtual objects, and To transmit the aforementioned image data to the display, A system that includes this.

17. The system according to claim 16, wherein the additional virtual object includes a virtual moon.

18. The aforementioned image includes a first image, and the control system is Receiving a second image of the aforementioned real-world environment, Identifying additional visual characteristics of the one or more real-world clouds depicted in the second image, It is determined that the additional visual characteristics of the one or more real-world clouds depicted in the second image are different from the visual characteristics of the one or more real-world clouds depicted in the first image, and Based on the aforementioned additional visual characteristics, updated image data is generated by modifying the one or more virtual clouds in the image data. The system according to claim 17, configured to perform an operation including the operation.

19. The system according to claim 16, wherein the visual characteristics of the one or more real-world clouds include the cloud class, the cloud population density, or both.

20. The system according to claim 16, comprising a vehicle, wherein the display is configured to present the image to a guest inside the vehicle.

21. It is a system for attractions, A camera configured to capture images of the environment, A processing system that is communicatively coupled to the aforementioned camera, Equipped with, The processing system is The density of real-world clouds in the captured image is detected, Based on the density, image data is generated by allocating a portion of the total number of pixels in the image data to a virtual cloud. A command is generated to transmit the image data for presentation in the aforementioned attraction. A system configured in such a way.

22. The system according to claim 21, wherein some of the pixels of the total number of pixels in the image data assigned to the virtual cloud correspond to the detected density of the real-world cloud in the captured image.

23. The system according to claim 21, wherein the processing system is further configured to identify a class of the real-world cloud based on the captured image, and the virtual cloud includes visual characteristics associated with the class identified from the captured image.

24. The system according to claim 23, wherein the class includes one of the following: a cottony cloud class, an opaque cloud class, a faint cloud class, or a powdery cloud class.

25. The system according to claim 21, wherein the density of the real-world cloud in the captured image corresponds to the amount of the real-world cloud in a portion of the environment monitored by the camera.

26. The image data includes data corresponding to a digital scene, and the processing system is By correcting the position of the virtual cloud relative to the digital scene, the image data is modified. The system is configured to modify the aforementioned image data and then generate additional commands to transmit the image data for presentation at the attraction. The system according to claim 21.

27. The processing system is configured to use a machine learning model to determine the parameters of the real-world clouds in the image. The image data includes the virtual cloud based on the parameters, The system according to claim 21.

28. The system according to claim 21, wherein the processing system is configured to identify the visual characteristics of the real-world cloud in the captured image, and the virtual cloud includes additional visual characteristics that visually correspond to the real-world cloud when presented in the attraction.

29. The system according to claim 28, wherein the visual characteristics include the color, size, transparency, movement, or shape of the real-world cloud.

30. The system according to claim 21, wherein the attraction is equipped with a display, and the display is configured to receive the image data and to present an image in the attraction based on the image data.

31. A non-temporary computer-readable medium containing instructions, wherein, when the instructions are executed by a processing circuit, the processing circuit receives, The camera receives the captured image, The density of real-world clouds in the captured image is detected. Based on the density, image data is generated by allocating a portion of the total number of pixels in the image data to a virtual cloud. To display the image data, output the aforementioned image data. Non-temporary computer-readable media.

32. The non-temporary computer-readable medium according to claim 31, wherein, when the instruction is executed by the processing circuit, the processing circuit causes the processing circuit to generate the image data having the virtual cloud and additional virtual elements.

33. When the aforementioned instruction is executed by the processing circuit, the processing circuit will: Receive additional captured images, To detect additional real-world cloud density in the aforementioned additional captured images, Based on the aforementioned additional density, additional image data is generated by allocating an additional portion of the total number of pixels in the additional image data to the virtual cloud. To output the aforementioned additional image data, The non-temporary computer-readable medium according to claim 31.

34. When the aforementioned instruction is executed by the processing circuit, the processing circuit will: The system receives training data that associates the input image with the corresponding density of real-world clouds within the input image. A machine learning model is generated based on the aforementioned training data. The non-temporary computer-readable medium according to claim 31.

35. When the aforementioned instruction is executed by the processing circuit, the processing circuit will: Receive additional input images, Using the machine learning model, identify the additional corresponding density of the real-world clouds in the additional input image. To receive feedback indicating whether the aforementioned additional corresponding density has been accurately identified, The machine learning model is updated based on the aforementioned feedback. The non-temporary computer-readable medium according to claim 34.

36. It is a system, A display configured to present an image, A processing system configured to perform an operation, Equipped with, The aforementioned operation is, Receiving images of the real world environment, To detect the density of multiple real-world clouds in the aforementioned image, Based on the density, image data is generated by allocating some of the pixels from the total number of pixels in the image data to multiple virtual clouds, and To transmit the aforementioned image data to the display, A system that includes this.

37. The system according to claim 36, wherein the processing system is configured to perform an operation that includes identifying the visual characteristics of the plurality of real-world clouds in the image, and the plurality of virtual clouds include additional visual characteristics that visually correspond to the visual characteristics.

38. The aforementioned image includes a first image, and the processing system is Receiving a second image of the aforementioned real-world environment, It is determined that the second visual characteristics of the second plurality of real-world clouds in the second image are different from the visual characteristics of the plurality of real-world clouds in the first image, and By modifying the image data based on the second visual characteristics, updated image data is generated. The system according to claim 37, configured to perform an operation including the operation.

39. The system according to claim 38, wherein each of the aforementioned visual characteristics and the second visual characteristic includes a cloud class, population density, or both.

40. The system according to claim 36, comprising a vehicle, wherein the display is configured to present the image to a guest inside the vehicle.

Images