Systems and methods for generating augmented reality and virtual reality images

Abstract

To provide enhanced thrill factors and components of interest in amusement park attractions.SOLUTION: A ride system includes at least one ride vehicle. The at least one ride vehicle is configured to receive a ride passenger. The ride system includes electronic goggles configured to be worn by the ride passenger. The electronic goggles include a camera and a display. The ride system includes a computer graphics generation system communicatively coupled to the electronic goggles, and configured to generate streaming media of a real world environment on the basis of image data captured via the camera of the electronic goggles, generate one or more virtual augmentations superimposed on the streaming media of the real world environment, and transmit the streaming media of the real world environment along with the one or more superimposed virtual augmentations to be displayed on the display of the electronic goggles.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The subject matter disclosed herein relates to amusement park attractions and, more particularly, to providing enhanced thrill and interest factors in amusement park attractions. [Background technology]

[0002] Amusement and / or theme parks may include a variety of entertainment attractions, restaurants, and rides that serve to provide enjoyment for park visitors (e.g., families and / or people of all ages). For example, attractions may include traditional children's rides, such as merry-go-rounds, as well as traditional thrill-seeker rides, such as roller coasters. Currently, it is recognized that adding interest and thrill factors to such attractions can be difficult and limited. Previously, for example, besides providing increasingly complex systems of steep, twisting, and winding roller coaster tracks, the thrill factors of such roller coasters and / or other similar thrill rides may be limited to the existing course or physics of the thrill ride itself. It is now recognized that it would be desirable to include interest and thrill factors in such attractions in a flexible and efficient manner over the prior art. Summary of the Invention [Problem to be solved by the invention]

[0003] Certain embodiments commensurate with the scope of the present disclosure are summarized below. These embodiments are not intended to limit the scope of the disclosure; rather, these embodiments are intended only to provide a brief summary of possible forms of the present disclosure. Indeed, the present embodiments may encompass a variety of forms that may be similar to or different from the embodiments set forth below. [Means for solving the problem]

[0004] In one embodiment, a ride system includes at least one ride vehicle. The at least one ride vehicle is configured to receive ride passengers. The ride system includes electronic goggles configured to be worn by the ride passengers. The electronic goggles include a camera and a display. The ride system includes a computer graphics generation system communicatively connected to the electronic goggles, configured to generate streaming media of a real-world environment based on image data captured via the camera of the electronic goggles, generate one or more virtual augmentations superimposed on the streaming media of the real-world environment, and transmit the streaming media of the real-world environment together with the one or more superimposed virtual augmentations for display on the display of the electronic goggles.

[0005] In a second embodiment, a wearable electronic device includes goggles. The goggles include one or more displays disposed within a front frame of the goggles, one or more cameras configured to capture images of a real-world environment associated with a theme park ride, and processing circuitry. The processing circuitry is configured to transmit images of the real-world environment to a computer graphics generation system and to receive signals from the computer graphics generation system. The signals include a video stream of a virtualization of the real-world environment, as well as at least one augmented reality (AR) image or at least one virtual reality (VR) image included in the video stream. The processing circuitry is also configured to cause the one or more displays to display the video stream.

[0006] In a third embodiment, a method includes receiving real-time data via a computer graphics generation system. Receiving the real-time data includes receiving a real-time video data stream from electronic goggles during a cycle of an amusement park ride. The method also includes generating a virtualization of a real-world environment of the amusement park based on the received real-time video data stream, overlaying augmented reality (AR) or virtual reality (VR) images on the virtualization of the real-world environment, and transmitting the overlaid AR or VR images along with the virtualization of the real-world environment to the electronic goggles during a cycle of the amusement park ride.

[0007] In a fourth embodiment, a method includes receiving real-time image data via processing circuitry of electronic goggles. Receiving real-time image data includes receiving a real-time video data stream captured via one or more cameras of the electronic goggles during cycling of a theme park ride. The method also includes generating a virtualization of a real-world environment of the theme park ride based on the captured real-time image data, overlaying an augmented reality (AR) or virtual reality (VR) image on the virtualization of the real-world environment, and displaying the overlaid AR or VR image with the virtualization of the real-world environment via a display of the electronic goggles during cycling of the theme park ride.

[0008] These and other features, aspects, and advantages of the present disclosure will become better understood from a reading of the following detailed description when taken in conjunction with the accompanying drawings, in which like reference numerals represent like parts throughout. [Brief explanation of the drawings]

[0009] [Figure 1] 1 illustrates an embodiment of an amusement park including one or more attractions according to the present embodiments. [Figure 2]FIG. 1 illustrates an embodiment of an augmented reality (AR) or virtual reality (VR) goggle and computer graphics generation system according to the present embodiments. [Figure 3] 3 is a perspective view of the thrill ride of FIG. 1 including various AR and VR images provided through the AR / VR goggles of FIG. 2 according to embodiments; [Figure 4] 3 is a flowchart illustrating an embodiment of a process useful for creating an AR, VR, or mixed reality experience during a ride by using the computer graphics generation system of FIG. 2 , according to an embodiment. [Figure 5] 3 is a flowchart illustrating an embodiment of a process useful for creating an AR, VR, or mixed reality experience while riding a vehicle by using the AR / VR goggles of FIG. 2 , according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] One or more specific embodiments of the present disclosure are described below. In the interest of providing a concise description of these embodiments, not all features of an actual implementation are described herein. It should be understood that in developing any such actual implementation, as with any engineering or design project, many implementation-specific decisions must be made to achieve the developer's particular goals, including compliance with system-related and business-related constraints. Moreover, it should be understood that such a development effort may be complex and time-consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0011] The present embodiments relate to systems and methods for providing an augmented reality (AR), virtual reality (VR), mixed reality (e.g., a combination of AR and VR) experience, or a combination thereof, as part of an attraction such as a thrill ride in an amusement park or theme park. In certain embodiments, each ride passenger may be provided with a pair of electronic goggles or glasses to wear while cycling on the thrill ride. The electronic goggles may facilitate an AR experience, a VR experience, or a combination of both experiences. Thus, the electronic goggles may be referred to as AR / VR goggles. Specifically, in one embodiment, the electronic goggles include at least two cameras, each corresponding to a respective viewpoint (e.g., right-eye and left-eye view) of a ride passenger, and may be used to capture real-time video data (e.g., video captured during use and transmitted substantially in real time) of the ride passenger and / or the thrill ride's real-world environment (e.g., physical amusement park views). The electronic goggles may also include a display. For example, the electronic goggles may include at least two displays, one for each eye of the ride passenger using the electronic goggles.

[0012] In certain embodiments, a computer graphics generation system may be included. The computer graphics generation system may receive real-time video data (e.g., live video transmitted substantially in real time) from the electronic goggles and render a video stream of the real-world environment along with various AR, VR, or combined AR and VR (AR / VR) graphical images to the respective displays of each of the ride passengers' electronic goggles during the ride's ride. For example, in one embodiment, the computer graphics generation system may render AR / VR graphical images to the electronic goggles based on, for example, the position or location of the passenger's ride vehicle along the roller coaster track during the ride's ride, a predetermined distance traveled by the passenger's ride vehicle during the ride's ride, or after a predetermined time has passed within the ride's ride. In this manner, by using the electronic goggles and the graphics generation system to create an AR, VR, or mixed reality experience, the electronic goggles and the computer graphics generation system may enhance the thrill factor of the ride, thereby enhancing the passenger's experience when riding the ride. However, it should be understood that the techniques described herein are not limited to applications in thrill rides and / or amusement park attractions, but may be extended to any of a variety of applications, such as, for example, medical applications (e.g., image-guided surgery, non-invasive imaging analysis), engineering design applications (e.g., engineering model development), manufacturing, construction, and maintenance applications (e.g., product manufacturing, new building construction, automobile repair), academic and / or vocational training applications, athletic applications (e.g., bodybuilding and weight loss models), television (TV) applications (e.g., weather and news), and the like.

[0013] With the above in mind, it may be useful to describe an embodiment of an amusement park, such as exemplary amusement park 10 as shown in FIG. 1 . As shown, amusement park 10 may include thrill rides 12, amusement park facility shopping mall 14 (e.g., restaurants, souvenir shops, etc.), and additional entertainment attractions 16 (e.g., a Ferris wheel, dark rides, or other attractions). In certain embodiments, thrill rides 12 may include roller coasters or other similar thrill rides and, therefore, may further include a closed-loop track or closed-loop track system 18 (e.g., several miles of track 18). Track 18 may be provided as infrastructure over which passenger ride vehicles 20 may traverse, for example, as ride passengers 22, 24, 26, 28 ride thrill rides 12. Thus, track 18 may define the motion of ride vehicle 20. However, in alternative embodiments, for example, the track 18 may be replaced by a controlled path, in which case the movement of the vehicle 20 may be controlled via an electronic, magnetic, or other similar system infrastructure other than the track 18. While the passenger vehicle 20 is shown as a four-passenger vehicle, it should be understood that in alternative embodiments, the passenger vehicle 20 may include any number of passenger spaces (e.g., 1, 2, 4, 8, 10, 20, or more spaces) to accommodate single or multiple groups of vehicle passengers 22, 24, 26, 28.

[0014] As the passenger ride vehicle 20 travels along the track 18, the ride passengers 22, 24, 26, 28 may be presented with a moving tour of the scenery (e.g., the facility 14, additional entertainment attractions 16, etc.) of the area surrounding or near the thrill ride 12. For example, this may include the surrounding environment of the thrill ride 12 (e.g., buildings that completely or partially surround the thrill ride 12). While the ride passengers 22, 24, 26, 28 may find the thrill ride 12 to be a very enjoyable experience, in certain embodiments it may be useful to enhance the experience of the ride passengers 22, 24, 26, 28 when they ride the thrill ride 12, for example, by enhancing the thrill factor of the thrill ride 12. Specifically, instead of capturing only a physical view of the facilities 14 (e.g., restaurants, souvenir shops, etc.), additional entertainment attractions 16 (e.g., a Ferris wheel or other attraction), or other visitors or pedestrians within the amusement park 10, it would be useful to provide an augmented reality (AR) or virtual reality (VR) experience to ride passengers 22, 24, 26, 28 as the ride vehicle 20 moves along the track 18.

[0015] 2 , for example, each of ride passengers 22, 24, 26, 28 may wear a set of electronic goggles 34, which in certain embodiments may include AR / VR glasses. In other embodiments, electronic goggles 34 may be included as part of a helmet, a sun visor, a headband, a set of blindfolds, one or more eye patches, and / or other headwear or eyewear wearable by ride passengers 22, 24, 26, 28. As shown, electronic goggles 34 may be communicatively connected to a computer graphics generation system 32 (e.g., within amusement park 10) via a wireless network 48 (e.g., wireless local area network (WLAN), wireless wide area network (WWAN), near field communication (NFC)). The electronic goggles 34 may be used to create the hyper-realistic environment 30, which may include an AR experience, a VR experience, a mixed reality (e.g., a combination of AR and VR) experience, a computer-assisted reality experience, a combination thereof, or other similar hyper-realistic environment for the vehicle passengers 22, 24, 26, 28 as they ride the thrill ride 12. Specifically, the vehicle passengers 22, 24, 26, 28 may wear the electronic goggles 34 for the duration of the ride such that the vehicle passengers 22, 24, 26, 28 feel completely surrounded by the environment 30 and perceive the environment 30 as a real-world physical environment. Specifically, as will be further understood, the environment 30 may be a real-time video in which one or more AR or VR images 45 (e.g., virtual augmentations) are electronically merged with a real-world image 44 that the vehicle passengers 22, 24, 26, 28 can view even without wearing the electronic goggles 34. The term "real-time" refers to images being acquired and / or provided in a time frame that is substantially close to the time at which they are actually observed.

[0016] In certain embodiments, the electronic goggles 34 may be any of a variety of wearable electronic devices that may be useful for creating AR, VR, and / or other computer-based experiences to enhance the thrill factor of the thrill ride 12 and, in turn, the experience of the ride passengers 22, 24, 26, 28 while riding the thrill ride 12. It should be appreciated that the eyeglass embodiments of the electronic goggles 34 as discussed herein are distinct from and may offer many advantages over traditional devices such as head-mounted displays (HMDs) and / or heads-up displays (HUDs). For example, as will be further appreciated, the electronic goggles 34 may include a number of orientation and position sensors (e.g., accelerometers, magnetometers, gyroscopes, global positioning system (GPS) receivers) that may be used to track the position, orientation, and movement of the ride passengers 22, 24, 26, 28 during their cycle of the thrill ride 12.

[0017] Similarly, features (e.g., geometric aspects or markings) of the electronic goggles 34 may be monitored by a monitoring system (e.g., one or more cameras) to determine the position, location, orientation, etc. of the electronic goggles 34 and, therefore, the position, location, orientation, etc. of the person wearing them. Furthermore, the vehicle passengers 22, 24, 26, 28 may also be monitored by a monitoring system 33 (e.g., a camera) that is communicatively connected to the computer graphics generation system 32 and may be used to identify the position, location, orientation, etc. of the vehicle passengers 22, 24, 26, 28. The vehicle 20 may also include one or more sensors (e.g., weight sensors, mass sensors, motion sensors, ultrasonic sensors) that assist the graphics generation system 32 in monitoring each vehicle passenger 22, 24, 26, 28 in order to determine the viewpoint of each vehicle passenger 22, 24, 26, 28. It will be further appreciated that the electronic goggles 34 may include separate cameras (e.g., cameras 40 and 42) and separate displays (displays 37 and 38) such that data relating to the respective perspectives of each eye of the vehicle passengers 22, 24, 26, 28 can be captured by the electronic goggles 34. Not all of these advantages can be obtained using devices such as traditional HMDs and / or HUDs.

[0018] In certain embodiments, to support the generation of the environment 30, the electronic goggles 34 may include processing circuitry, such as a processor 35 and a memory 36. The processor 35 may be operatively connected to the memory 36 to execute instructions for implementing the techniques disclosed herein, generating a real-world image 44 merged with one or more AR / VR images 45 to enhance the thrill factor of the thrill ride 12 and, in turn, enhance the experience of the ride passengers 22, 24, 26, 28 while riding the thrill ride. These instructions may be encoded in a program or code stored in a tangible, non-transitory computer-readable medium, such as the memory 36 and / or other storage. The processor 35 may be a general-purpose processor, a system-on-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration.

[0019] In certain embodiments, as further shown, the electronic goggles 34 may also include a pair of displays 37 and 38 (e.g., which may be located in front of the frame of the electronic goggles 34 where eyeglass lenses would otherwise be seen), one for each eye of the vehicle passengers 22, 24, 26, 28. In another embodiment, an integrated display may be utilized. Each of the displays 37 and 38 may each include an opaque liquid crystal display (LCD), an opaque organic light-emitting diode (OLED) display, or other similar display useful for displaying real-time images 44 and AR / VR graphical images 45 to the vehicle passengers 22, 24, 26, 28. In another embodiment, each of the displays 37 and 38 may include, for example, a see-through LCD or a see-through OLED display that serves to enable ride passengers 22, 24, 26, 28 to view the real-world imagery 44 and AR / VR graphical imagery 45 appearing on their respective displays 37 and 38 while maintaining the ability to view the actual physical, real-world environment (e.g., amusement park 10) through their respective displays 37 and 38.

[0020] Each of the cameras 40 and 42 may correspond to a respective viewpoint of a respective ride passenger 22, 24, 26, 28 and may be used to capture real-time video data (e.g., live video) of the real-world environment. In some embodiments, a single camera may be utilized. Specifically, in the illustrated embodiment, the cameras 40 and 42 of the goggles 34 may be used to capture real-time images of the real-world physical environment (e.g., the physical amusement park 10) as perceived by each of the ride passengers 22, 24, 26, 28 from the viewpoint of each of the ride passengers 22, 24, 26, 28. As will be further appreciated, the electronic goggles 34 may then transmit the real-time video data captured via each of the cameras 40 and 42 to the computer graphics generation system 32 for processing (e.g., wirelessly via one or more communication interfaces included within the electronic goggles 34). However, in another embodiment, the real-time video data captured via each of the cameras 40 and 42 may be processed on-board the electronic goggles 34 by the processor 35. Additionally, the electronic goggles 34 may transmit orientation data, position data, viewpoint data (e.g., focal length, orientation, attitude, etc.), motion tracking data, etc., acquired and / or derived based on data acquired from orientation and position sensors (e.g., accelerometers, magnetometers, gyroscopes, global positioning system (GPS) receivers, etc.), motion tracking sensors (e.g., electromagnetic and solid-state motion tracking sensors), and others that may be included in the electronic goggles 34.

[0021] In particular embodiments, the computer graphics generation system 32, which may also include processing circuitry such as a processor 46 (e.g., a general-purpose processor or other processor) and a memory 47, as described above, may process real-time video data (e.g., live data), orientation and position data, and / or viewpoint data received from the electronic goggles 34 or the monitoring system 33. Specifically, the computer graphics generation system 32 may use this data to generate a frame of reference for aligning the real-time video data with the generated real-world image 44 and the AR / VR graphical image 45. Specifically, using the generated frame of reference based on the orientation data, position data, viewpoint data, motion tracking data, etc., the graphics generation system 32 may then render a view of the real-world image 44 that is temporally and spatially consistent with what each vehicle passenger 22, 24, 26, 28 would perceive if they were not wearing the electronic goggles 34. The graphics generation system 32 may continuously (e.g., in real time) update the rendering of the real-world image to reflect changes in the orientation, position, and / or movement of each vehicle passenger 22, 24, 26, 28.

[0022] For example, in certain embodiments, the graphics generation system 32 may render images (e.g., real-world images 44 and AR / VR images 45) at a real-time rate of about 20 frames per second (FPS) or more, about 30 FPS or more, about 40 FPS or more, about 50 FPS or more, about 60 FPS or more, about 90 FPS or more, or about 120 FPS or more. Additionally, the graphics generation system 32 may generate real-world images 44 for each of the respective electronic goggles 34 worn by the respective vehicle passengers 22, 24, 26, 28 (e.g., adjusted for the respective orientations, positions, and viewpoints of the respective vehicle passengers 22, 24, 26, and 28).

[0023] In certain embodiments, as described above, the computer graphics generation system 32 may also generate and render one or more AR / VR graphical images 45 that are overlaid on the real-world image 44 to create a complete AR, VR, mixed reality, and / or other computer-based experience for the ride passengers 22, 24, 26, 28. For example, in certain embodiments, the computer graphics generation system 32 may utilize one or more of the discussed video merging and / or optical merging techniques to overlay the AR / VR graphical images 45 on the real-world image 44, allowing the ride passengers 22, 24, 26, 28 to perceive the real-world physical environment of the amusement park 10 (e.g., provided as video data rendered via their respective displays 37 and 38) along with the AR / VR graphical images 45 (e.g., virtual augmentation) as the passenger ride vehicle 20 travels along the track 18. Specifically, as described above with respect to rendering the real-world image 44, the graphics generation system 32 can render a view of the AR / VR graphical image 45 that is temporally and spatially aligned with the real-world image 44, such that the real-world image 44 appears as a background overlaid with the AR / VR graphical image 45. In practice, the model can provide computer-generated images for every available viewpoint and can provide a particular image to the electronic goggles 34 for display based on the detected orientation of the electronic goggles 34.

[0024] In certain embodiments, graphics generation system 32 may generate one or more brightness, lighting, or shading models and / or other photorealistic rendering models to generate real-world images 44 and AR / VR graphical images 45 that are adjusted to closely reflect the contrast and brightness of real-world physical environments (e.g., sunny days, partly cloudy days, cloudy days, evenings, nights) when rendering real-world images 44 and AR / VR graphical images 45. For example, to enhance the photorealism of real-world images 44 and AR / VR graphical images 45, graphics generation system 32, in some embodiments, may receive weather-related data from one or more weather forecasting and / or prediction systems (e.g., Global Forecast System, Doppler radar, etc.). Graphics generation system 32 may then use the weather-related data or other similar data to adjust the contrast, brightness, and / or other lighting effects of real-world images 44 and / or AR / VR graphical images 45.

[0025] In another embodiment, the graphics generation system 32 can adjust the contrast, brightness, and / or other lighting effects of the real-world image 44 and / or the AR / VR graphical image 45 based on lighting detected from one or more optical sensors included in the electronic goggles 34 or based on real-time video data captured by the cameras 40, 42. Additionally, as described above, the graphics generation system 32 can continuously (e.g., in real time) update the rendering of the AR / VR graphical image 45 to reflect changes in the orientation, position, viewpoint, and / or movement of each of the vehicle passengers 22, 24, 26, 28. For example, as further understood with respect to FIG. 3 , the graphics generation system 32 can render, on the respective displays 37 and 38 of each of the respective goggles 34 worn by each of the vehicle passengers 22, 24, 26, 28, the AR / VR graphical image 45 adjusted for the changing positions, viewpoints, and movements of each of the vehicle passengers 22, 24, 26, 28.

[0026] As will be further appreciated, the graphics generation system 32 can also generate the AR / VR graphical imagery 45 simultaneously as the passenger vehicle 20 traverses predetermined points along the track 18. Thus, in certain embodiments, the graphics generation system 32 can use the received position, viewpoint, and movement data, in addition to GPS or geographic information system (GIS) data, to derive, for example, an illumination map of the thrill ride 12 and track 18, as well as the environment surrounding the thrill ride 12 during its entire cycle. The graphics generation system 32 can then use this map to introduce the AR / VR graphical imagery 45 at certain predetermined points (e.g., location-, distance-, or time-based points) as the passenger vehicle 24 travels along the track 18. Furthermore, in certain embodiments, the graphics generation system 32 can use video or image data captured by the cameras 40, 42 to determine the location of the vehicle 20 and when to introduce the AR / VR graphical imagery 45. For example, the graphics generation system 32 may execute one or more geometric recognition algorithms (e.g., shape or object recognition) or photometric recognition algorithms (e.g., face recognition or specific object recognition) to determine the position or location of the vehicle 20 and the viewpoint positions of the vehicle passengers 22, 24, 26, 28.

[0027] 3 shows various examples of AR / VR imagery 45 that can be generated by the graphics generation system 32, or in another embodiment, by the goggles 34. Specifically, as shown in FIG. 3 , during a cycle of the thrill ride 12, the graphics generation system 32 can render a real-world image 44 as well as various AR / VR graphical images 45 through each of the electronic goggles 34 of each of the passengers 22, 24, 26, 28 (e.g., via their respective displays 37 and 38). For example, as shown, the real-world imagery 44 can include rendered images of other visitors or objects, including, for example, the track 18, the facility 14, and / or other passengers or objects that the passengers 22, 24, 26, 28 can see while riding the thrill ride 12, even if the passengers 22, 24, 26, 28 are not wearing the electronic goggles 34. However, as discussed above with respect to FIG. 2, in certain embodiments, it may be helpful to enhance the thrill factor of the thrill ride 12 by rendering various AR / VR graphical images 45 on the respective displays 37 and 38 of the electronic goggles 34 of each of the ride passengers 22, 24, 26, 28.

[0028] 3, the graphics generation system 32 may render an AR / VR graphical image 45 (illustrated by dashed lines), which may include, for example, an AR / VR image of a secondary mall 49 of the amusement park property, an AR / VR image of one or more fictional characters 50, an AR / VR image of a breach 52 in the track 18, and / or additional AR / VR images 54, 56, and 58. As shown in FIG. 3, in one embodiment, the AR / VR image 50 may include an image of a monster or other similar fictional character appearing (e.g., from the perspective of the ride passengers 22, 24, 26, 28 while wearing electronic goggles 34) to occlude a portion of the track 18 as the passenger ride vehicle 20 travels along the track 18. It should be appreciated that in addition to AR / VR graphical images 45 that include added imagery (e.g., virtual augmentations), the graphics generation system 32 may also render certain AR / VR graphical images 45 that include the removal of one or more real-world physical objects that are no longer visible to the ride passengers 22, 24, 26, 28 while wearing the electronic goggles 34. For example, an AR / VR image of the facility 49 may appear in the real-world environment where the attraction 16 is located.

[0029] As mentioned above, in certain embodiments, the graphics generation system 32 may render the AR / VR graphical image 45 based on, for example, the position or location of the passenger vehicle 20 along the trajectory 18 at any given time during the cycle of the thrill ride 12, a predetermined distance traveled by the passenger vehicle 20 during the cycle of the thrill ride 12, or after a predetermined amount of time has passed. For example, in one embodiment, once the passenger vehicle travels to point 60 (e.g., defined by a certain distance 62 or location on the trajectory 18), the ride passengers 22, 24, 26, 28 may, through the electronic goggles 34, view an AR / VR image of a fictional character 50 blocking a location on the trajectory 18 that the passenger vehicle 20 has not yet traveled during the given cycle of the thrill ride 12. Similarly, when the passenger vehicle 20 travels to a point 62 (e.g., defined by a certain distance 62 or location on the track 18), the vehicle passengers 22, 24, 26, 28 can view, through the electronic goggles 34, an AR / VR image of a breach 52 in the track 18, such that the passenger vehicle 20 encounters a location where the track 18 is no longer supported (e.g., a broken track appears).

[0030] Furthermore, in certain embodiments, the illumination map generated by the graphics generation system 32 enables the graphics generation system 32 to include one or more detection and / or trigger points (e.g., trigger points for introducing AR / VR imagery 45) at every mile of the track 18, every yard of the track 18, every foot of the track 18, every inch of the track 18, every centimeter of the track 18, or every millimeter of the track 18. In this manner, the graphics generation system 32 can detect with sufficient accuracy and capability when to begin rendering the AR / VR graphical imagery 45 based on the position or location, distance traveled, and / or elapsed time during the cycle of the thrill ride 12. Furthermore, the additional AR / VR images 54, 56 illustrate that one or more of the AR / VR graphical images 45 appear to the ride passengers 22, 24, 26, 28 in an interactive (e.g., overlapping or touching) manner. Similarly, AR / VR image 58 may appear outside the line of sight or perspective of vehicle passengers 22, 24, 26, 28 (e.g., out of sight), but may nevertheless be perceived by any of vehicle passengers 22, 24, 26, 28 when looking in the direction of AR / VR image 58. Note that completely different images may be presented to each of vehicle passengers 22, 24, 26, 28, such that one or more of vehicle passengers 22, 24, 26, 28 experience a partially or completely different ride experience or even ride theme.

[0031] In certain embodiments, as described above with respect to FIG. 2 , the graphics generation system 32 can render real-world images 44 and AR / VR images 45 on each of the displays 37 and 38 of the electronic goggles 34 worn by each of the vehicle passengers 22, 24, 26, and 28, such that each of the vehicle passengers 22, 24, 26, and 28 can perceive real-world images 44 (e.g., facility 14, thrill ride 12, etc.) and AR / VR images 45 (e.g., AR / VR images or virtual augmentations 49, 50, 52, 54, 56, and 58) that are temporally and spatially aligned with their respective fields of view, thereby creating a photorealistic effect as the passenger vehicle 20 moves along the track 18. Furthermore, in another embodiment, in addition to the AR / VR image 45 (e.g., AR / VR image or virtual augmentation 49, 50, 52, 54, 56, and 58), the graphics generation system 32 can also trigger one or more sound effects, haptic feedback effects, olfactory effects, etc. that can occur simultaneously with the appearance of the AR / VR image 45 on the electronic goggles 34. In some embodiments, the graphics generation system 32 is integrated with the electronic goggles 34.

[0032] In this manner, by providing the electronic goggles 34 and graphics generation system 32 to create an AR, VR, and / or other computer-aided reality experience, the electronic goggles 34 and graphics generation system 32 can enhance the thrill factor of the thrill ride 12 and, therefore, the experience that the ride passengers 22, 24, 26, 28 have while riding the thrill ride 12. Furthermore, by providing the electronic goggles 34, such as AR / VR glasses, as opposed to larger, more cumbersome devices such as traditional head-mounted displays (HMDs), the ride passengers 22, 24, 26, 28 can have greater freedom of movement and a more photorealistic experience. For example, each of the ride passengers 22, 24, 26, 28 can see each of the other ride passengers 22, 24, 26, 28, as well as the passenger's ride vehicle 20 itself, even when wearing the electronic goggles 34. Furthermore, because the electronic goggles 34 can include separate cameras 40, 42 and separate displays 37, 38, data relating to the respective viewpoints of the eyes of each of the vehicle passengers 22, 24, 26, 28 can be captured by the electronic goggles 34. Thus, the graphics generation system 32 can render real-world images 44 and AR / VR images 45 that match the respective viewpoints of the vehicle passengers 22, 24, 26, 28 on the displays 37, 38 of the electronic goggles 34. Such advantages cannot be obtained using devices such as conventional HMDs.

[0033] Referring now to FIG. 4, a flow diagram illustrates an embodiment of a process 64 useful for creating AR, VR, and / or other computer-based experiences during thrill rides, for example, using the computer graphics generation system 32 shown in FIG. 2. Process 64 may represent start code or instructions stored in a non-transitory computer-readable medium (e.g., memory 47) and executed by a processor 46 included in, for example, the computer graphics generation system 32. Process 64 may begin with the processor 46 receiving and analyzing real-time captured image data (block 66). For example, the processor 46 may receive real-time video data (e.g., live video) captured by the cameras 40, 42 of the electronic goggles 34. Process 64 may then proceed to the processor 46 generating a visualization of a real-world environment (e.g., amusement park 10) based on the real-time captured image data (block 68). For example, the processor 46 may generate a video data stream of the real-world environment (e.g., amusement park 10) to be displayed on the displays 37, 38 of the electronic goggles 34.

[0034] Process 64 may then proceed to processor 46 overlaying (block 70) or superimposing one or more augmented or virtual reality images onto the generated visualization of the real-world environment. For example, processor 46 may generate a video data stream of real-world image 44 (e.g., facility 14, thrill ride 12) and overlay or superimpose AR / VR image 45 (e.g., AR / VR images or virtual augmentations 49, 50, 52, 54, 56, and 58) onto real-world image 44 using one or more video merging and / or optical merging techniques. As described above, in certain embodiments, processor 46 of graphics generation system 32 may render AR / VR graphical image 45 based on the position or location of passenger ride vehicle 20 along trajectory 18 at any given time during a cycle of thrill ride 12, a predetermined distance traveled by passenger ride vehicle 20 during a cycle of thrill ride 12, or after a predetermined time has elapsed. In another embodiment, the graphics generation system 32 may perform one or more geometric or photometric recognition algorithms on the video or image data captured by the cameras 40, 42 to determine the location of the ride 20 and when to introduce the AR / VR graphical image 45. The process 64 then concludes with the processor 46 transmitting (block 72) the augmented or virtual reality image data (e.g., the AR / VR image 45) overlaid on top of the real-world environment data (e.g., the real-world image 44) to be displayed on the displays 37, 38 of the electronic goggles 34, thereby enhancing the thrill factor of the thrill ride 12 and, therefore, the experience of the ride passengers 22, 24, 26, 28 while riding the thrill ride 12.

[0035] Similarly, FIG. 5 illustrates a flow diagram of an embodiment of a process 74 useful for generating AR, VR, and / or other computer-based experiences during a thrill ride, for example, using the electronic goggles 34 shown in FIG. 2 . The process 74 may include code or instructions stored in a non-transitory computer-readable medium (e.g., memory 36) and executed by a processor 35 included in, for example, the electronic goggles 34. The process 74 may begin with the processor 35 receiving and analyzing (block 76) real-time captured image data. For example, the processor 35 may receive real-time video data (e.g., live video) captured by the cameras 40, 42 of the electronic goggles 34. The process 74 may then proceed to generating (block 78) a visualization of a real-world environment based on the real-time captured image data. For example, the processor 35 may generate a video data stream of the real-world environment (e.g., the amusement park 10) for display on the displays 37 and 38 of the AR / VR goggles 34.

[0036] Process 74 may then proceed to processor 35 overlaying (block 80) or superimposing one or more augmented or virtual reality images onto the generated visualization of the real-world environment. For example, processor 35 may generate a video data stream of real-world image 44 (e.g., facility 14, thrill ride 12, etc.) and overlay or superimpose AR / VR image 45 (e.g., AR / VR images or virtual augmentations 49, 50, 52, 54, 56, and 58) onto real-world image 44 using one or more video merging and / or optical merging techniques. For example, the processor 35 of the electronic goggles 34 may render the AR / VR image 45 (e.g., AR / VR images or virtual augmentations 49, 50, 52, 54, 56, and 58) based on the position and orientation of the vehicle passengers 22, 24, 26, 28, the position and location of the passengers' vehicle 20, the passage of a predetermined time, geometric or photometric recognition of specific features within the video and image data captured by the cameras 40, 42, or based on one or more user-selectable settings applied by the vehicle passengers 22, 24, 26, 28, for example, before or during a cycle of the thrill ride 12. Processing 74 then concludes with the processor 35 causing the respective displays 37 and 38 of the electronic goggles 34 to display (block 82) augmented or virtual reality image data (e.g., AR / VR image 45) overlaid with real-world environmental data (e.g., real-world image 44), thereby enhancing the thrill factor of the thrill ride 12 and enhancing the experience of the ride passengers 22, 24, 26, 28.

[0037] A technical effect of the present embodiments is a system and method for providing an augmented reality (AR), virtual reality (VR), mixed reality (e.g., a combination of AR and VR) experience, or a combination thereof, as part of a thrill ride in an amusement park or theme park. In certain embodiments, each ride passenger may be provided with a set of electronic goggles (e.g., AR / VR glasses) to wear while cycling along the thrill ride. Specifically, the electronic goggles may include at least two cameras, each of which may correspond to a respective viewpoint of the ride passenger and may be used to capture real-time video data (e.g., live video) of the ride passenger and / or the thrill ride's real-world environment (e.g., a physical amusement park). The electronic goggles may also include at least two displays, one for each eye of the ride passenger. In certain embodiments, a computer graphics generation system may be included. The computer graphics generation system may render a video stream of the real-world environment, along with various AR / VR graphical imagery, onto the respective displays of each ride passenger's electronic goggles during the thrill ride. For example, in one embodiment, the graphics generation system 32 may render AR / VR graphical images to the electronic goggles based on the position or location of the passenger's vehicle along the trajectory at any given time during the cycle of the thrill ride, a predetermined distance traveled by the passenger's vehicle during the cycle of the thrill ride, or after a predetermined amount of time has passed. In this manner, by using the electronic goggles and graphics generation system to create an AR experience, a VR experience, and / or a mixed reality experience, the electronic goggles and graphics generation system may enhance the thrill factor of the thrill ride, which in turn may enhance the experience that the passengers of the ride have when riding the thrill ride.

[0038] While only certain features of the present embodiments have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the present disclosure. It is further to be understood that certain elements of the disclosed embodiments can be combined with or substituted for one another.

Claims

1. at least one vehicle configured to receive vehicle passengers; electronic goggles configured to be worn by a passenger of the vehicle, the electronic goggles including a camera and a display; a computer graphics generation system communicatively connected to the electronic goggles, The computer graphics generation system includes: generating streaming media of a real-world environment based on image data captured by the camera of the electronic goggles; generating one or more virtual augmentations of the real-world environment overlaid on the streaming media; configured to transmit the streaming media of the real-world environment along with the one or more superimposed virtual augmentations to be displayed on the display of the electronic goggles. Vehicle system.

2. 2. The vehicle system of claim 1, wherein the display of the electronic goggles includes a first display and a second display, the first display configured to display the streaming media to a first eye of the vehicle passenger, and the second display configured to display the streaming media to a second eye of the vehicle passenger.

3. 3. The vehicle system of claim 2, wherein the first display and the second display each comprise an opaque liquid crystal display (LCD) or an opaque organic light emitting diode (OLED) display.

4. 10. The vehicle system of claim 1, wherein the electronic goggles include an additional camera configured to capture a first perspective corresponding to a first eye of the vehicle passenger and the additional camera configured to capture a second perspective corresponding to a second eye of the vehicle passenger.

5. 10. The vehicle system of claim 1, wherein the computer graphics generation system is configured to generate the one or more virtual augmentations during a vehicle cycle when the at least one vehicle travels to a predetermined location, travels a predetermined distance, after a predetermined time has elapsed, or any combination thereof.

6. 6. The ride system of claim 5, comprising a roller coaster including a track, wherein the computer graphics generation system is configured to generate the one or more virtual augmentations as the at least one ride vehicle travels along the track to the predetermined location, as the at least one ride vehicle travels along the track for the predetermined distance, after the predetermined time has elapsed, or any combination thereof.

7. 2. The vehicle system of claim 1, wherein the computer graphics generation system is configured to generate the streaming media of the real-world environment based on an orientation of the electronic goggles, a position of the vehicle passenger, a viewpoint of the vehicle passenger, or a combination thereof.

8. The vehicle system of claim 7 , further comprising a positioning sensor within the electronic goggles for detecting the orientation of the electronic goggles.

9. The vehicle system of claim 7 , comprising a monitoring system configured to monitor physical attributes of the electronic goggles to determine the orientation of the electronic goggles.

10. The vehicle system of claim 7 , comprising a sensor configured to detect the location of the vehicle passenger within the at least one vehicle.

11. 8. The vehicle system of claim 7, further comprising one or more position sensors within the at least one vehicle or the electronic goggles configured to monitor the vehicle passengers as a function of determining the vehicle passenger's point of view.

12. 10. The vehicle system of claim 1, wherein the computer graphics generation system is configured to render the streaming media and the one or more superimposed virtual augmentations of the real-world environment to the display at a rate of about 30 frames per second (FPS) or greater.

13. The computer graphics generation system includes: receiving a measure of lighting, contrast, brightness, or a combination thereof associated with the real-world environment; 10. The vehicle system of claim 1, configured to generate the streaming media and the one or more superimposed virtual augmentations of the real-world environment adjusted to reflect the lighting, the contrast, the brightness, or a combination thereof, of the real-world environment.

14. The computer graphics generation system includes: receiving an indication of the position and orientation of a passenger in the vehicle via one or more sensors in the electronic goggles; generating the streaming media and the superimposed virtual augmentation of the real-world environment based at least in part on the position and the orientation; The vehicle system of claim 1 configured to render the streaming media on the display.

15. the display includes a first display and a second display, and the computer graphics generation system receiving indications of a first viewpoint and a second viewpoint of a passenger in the vehicle captured by the camera and an additional camera of the electronic goggles, respectively; generating the streaming media and the one or more superimposed virtual augmentations of the real-world environment based at least in part on the first perspective and the second perspective; configured to render the streaming media on each of the first display and the second display, respectively; 10. The vehicle system of claim 1, wherein the streaming media rendered on the first display corresponds to the first viewpoint and the streaming media rendered on the second display corresponds to the second viewpoint.

16. A wearable electronic device comprising goggles, The goggles are one or more displays disposed within a front face of the goggle frame; one or more cameras configured to capture images of a real-world environment associated with a theme park ride; processing circuitry; The processing circuitry configured to transmit the image of the real-world environment to a computer graphics generation system; and receive a signal from the computer graphics generation system, the signal including a video stream of the virtualization of the real-world environment together with at least one augmented reality (AR) image or at least one virtual reality (VR) image included in the video stream; The wearable electronic device, wherein the processing circuitry is configured to cause the one or more displays to display the video stream.

17. 17. The wearable electronic device of claim 16, wherein the one or more displays include a first display and a second display, the first display configured to correspond to a first eye of a user and the second display configured to correspond to a second eye of the user.

18. 17. The wearable electronic device of claim 16, wherein the goggles comprise an orientation sensor, a position sensor, an accelerometer, a magnetometer, a gyroscope, or any combination thereof.

19. 17. The wearable electronic device of claim 16, wherein the processing circuitry includes one or more processors configured to generate the video stream and the at least one AR image or the at least one VR image of the virtualization of the real-world environment.

20. receiving real-time data via a computer graphics generation system, including receiving a real-time video data stream from electronic goggles during a cycle of an amusement park ride; generating a virtualization of the amusement park's real-world environment based on the received real-time video data stream; overlaying an augmented reality (AR) image or a virtual reality (VR) image onto the virtualization of the real-world environment; transmitting the overlaid AR or VR imagery along with the virtualization of the real-world environment to the electronic goggles during the cycle of the amusement park ride.

21. 21. The method of claim 20, wherein receiving the real-time data comprises receiving data related to a passenger's position on the amusement park ride, a passenger's orientation on the ride, a passenger's viewpoint on the ride, or a combination thereof.

22. 21. The method of claim 20, comprising transmitting the overlaid AR or VR image with the virtualization of the real-world environment based at least in part on a position of a passenger on the amusement ride, an orientation of the passenger on the amusement ride, a viewpoint of the passenger on the amusement ride, a location of the amusement ride, an orientation of the electronic goggles, a predetermined time period, recognition of one or more features in the real-time video data stream, or any combination thereof.

23. receiving real-time image data via processing circuitry of the electronic goggles, the real-time image data including receiving a real-time video data stream captured via one or more cameras of the electronic goggles during cycling of a theme park ride; generating a virtualization of a real-world environment of the theme park ride based on the captured real-time image data; overlaying an augmented reality (AR) image or a virtual reality (VR) image onto the virtualization of the real-world environment; and displaying the overlaid AR or VR imagery with the virtualization of the real-world environment via a display of the electronic goggles during the cycle of the theme park ride.

24. 24. The method of claim 23, comprising displaying the overlaid AR or VR imagery with the virtualization of the real-world environment based at least in part on a position of the electronic goggles, an orientation of the electronic goggles, a viewpoint of a passenger on the theme park ride, a location of a passenger vehicle on the theme park ride, a predetermined time period, recognition of one or more features in the real-time video data stream, user-configurable settings, or any combination thereof.

Images