Contextually significant 3D models

JP7631237B2Active Publication Date: 2025-02-18UNIVERSAL CITY STUDIOS LLC
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2021572014
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-12-18
Filing Date
2020-06-03
Publication Date
2025-02-18
Estimated Expiration
2040-06-03

Smart Images

  • Figure 0007631237000001
    Figure 0007631237000001
  • Figure 0007631237000002
    Figure 0007631237000002
  • Figure 0007631237000003
    Figure 0007631237000003
Patent Text Reader

Abstract

The monitoring system (10) includes a video assembly (24) disposed within a predetermined area and including at least one camera (26) configured to transmit a real-time video feed of physical locations in the predetermined area. The monitoring system (10) further includes a control system (16) configured to receive the real-time video feed from the at least one camera (26). The control system (16) includes a memory device (68) and a processor (66) configured to generate a virtual model (62) of the predetermined area based on instructions stored on the memory device (68), the processor (66) configured to incorporate the real-time video feed into the virtual model (62) at virtual locations in the virtual model (62) that correspond to the physical locations in the predetermined area. The control system (16) also includes a display unit (64) configured to display the virtual model (62).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of U.S. Provisional Patent Application No. 62 / 858,206, filed June 6, 2019, and entitled “Contextually Significant 3-Dimensional Model,” the disclosure of which is incorporated herein by reference in its entirety for all purposes.

[0002] FIELD OF THE DISCLOSURE The present disclosure relates generally to the field of amusement parks. Specifically, embodiments of the present disclosure relate to techniques for monitoring amusement parks and generating models of amusement park attractions that incorporate real-time image data. [Background technology]

[0003] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present disclosure, which are described below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0004] Since the early 20th century, amusement parks have grown significantly in popularity. An ever-increasing number of people visit amusement park attractions. Amusement park attendants are tasked with monitoring amusement park attractions to identify deviations in schedules and to ensure that guests have a positive experience. Certain amusement park monitoring systems incorporate security cameras throughout the amusement park and provide a video feed for viewing by amusement park attendants. When a situation arises that requires a maintenance response, such as a guest unintentionally dropping an item onto the ride track, amusement park attendants are dispatched to resolve the issue and prevent or reduce deviations in schedule. However, determining the specific location of the maintenance situation can be complicated. When multiple cameras are distributed throughout the attraction, the physical location of each individual camera within the attraction is difficult to ascertain from the captured image shown on the security monitoring screen. Thus, in practice, it has been recognized that an improvement in amusement park attraction monitoring systems is desirable. Summary of the Invention

[0005] Certain embodiments falling within the scope of the initially claimed invention are summarized below. These embodiments are not intended to limit the scope of the disclosure, but rather, these embodiments are intended merely to provide a brief summary of certain disclosed embodiments. Indeed, the disclosure may encompass a variety of forms that may be similar to or different from the embodiments set forth below.

[0006] According to one embodiment, a monitoring system includes a video assembly including at least one camera disposed within a predetermined area and configured to provide a real-time video feed of physical locations in the predetermined area. The monitoring system further includes a control system configured to receive the real-time video feed from the at least one camera. The control system includes a memory device and a processor configured to generate a virtual model of the predetermined area based on instructions stored on the memory device. The processor is configured to incorporate the real-time video feed into a virtual model at virtual locations in the virtual model that correspond to the physical locations in the predetermined area. The control system also includes a display unit configured to display the virtual model.

[0007] According to one embodiment, a monitoring system includes a video assembly having at least one camera disposed within a predetermined area and configured to capture and output real-time images. The monitoring system also includes a control system configured to receive the real-time images from the at least one camera. The control system includes a memory device and a processor configured to generate a virtual model of the predetermined area within a virtual space based on instructions stored on the memory device. The processor is configured to generate at least one virtual video display within the virtual space based on the real-time images. A position of the at least one virtual video display within the virtual space is based at least in part on a position of the at least one camera within the predetermined area. The control system also includes a user interface having a display unit configured to display the virtual space for a user. The user interface also includes an input device configured to provide at least one user-initiated command to the processor to control a camera orientation of the at least one camera.

[0008] According to one embodiment, the monitoring system includes a video assembly having at least one camera disposed within the amusement park attraction and configured to send a video feed of at least a portion of the amusement park attraction, a sensor assembly configured to detect a position of a ride vehicle at the amusement park attraction, and a control system configured to receive the video feed and the detected position of the ride vehicle from the at least one camera. The control system includes a memory device and a processor configured to generate a virtual model of the amusement park attraction and a virtual ride vehicle disposed within the virtual model based on instructions stored on the memory device. The processor is configured to generate virtual video displays within the virtual model based on the video feed, the positions of the at least one virtual video display in the virtual model being based at least in part on the positions of the at least one camera at the amusement park attraction. The positions of the virtual ride vehicles in the virtual model being based at least in part on the detected positions of the ride vehicles within the amusement park attraction. The control system also includes a display unit configured to display the virtual model. [Brief description of the drawings]

[0009] These and other features, aspects and advantages of the present disclosure will become better understood from the following detailed description when taken in conjunction with the accompanying drawings, in which like reference characters refer to like elements throughout.

[0010] [Figure 1] FIG. 1 is a perspective view of one embodiment of an amusement park attraction monitoring system.

[0011] [Diagram 2] FIG. 1 is a perspective view of one embodiment of a virtual model of an amusement park attraction.

[0012] [Diagram 3] FIG. 1 illustrates a perspective view of an embodiment of a virtual model having a virtual display screen configured to rotate relative to the virtual model.

[0013] [Figure 4] 1 illustrates a perspective view of an embodiment of a virtual model reoriented based at least in part on user input.

[0014] [Diagram 5] FIG. 1 is a perspective view of an embodiment of a virtual model having a viewing window configured to display a video feed corresponding to at least one virtual display screen.

[0015] [Figure 6] FIG. 1 is a block diagram of one embodiment of a monitoring system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] One or more specific embodiments of the present disclosure are described below. In order to provide a concise description of these embodiments, not all features of an actual implementation will be described herein. It will be appreciated that, as with any engineering or design project, the development of any such actual implementation will require numerous implementation-specific decisions to be made to achieve the developer's particular goals, which may vary from implementation to implementation, such as compliance with system and business-related constraints. It will be further appreciated that such a development effort may be complex and time-consuming, but will be a routine exercise in design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0017] When introducing elements of various embodiments of the invention, the articles "a," "an," and "the" are intended to mean that there are one or more of the element. The terms "comprising," "including," and "having" are inclusive and mean that there may be additional elements other than the listed elements. In addition, it should be understood that references to "one embodiment" or "one embodiment" of the invention are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

[0018] Theme park or amusement park attendants are responsible for monitoring amusement park attractions, guests, and other parts of theme parks and amusement parks. Certain amusement parks incorporate monitoring systems that provide multiple live feeds to display units for viewing by amusement park attendants. For example, multiple live feeds captured from various locations of an amusement park attraction may be arranged in a grid and displayed on a screen for the amusement park attendant. When the amusement park attendant views the live feeds, the attendant may rely on an organization method, naming convention, memory, or another suitable method to correlate the live feeds from the grid with their respective physical locations within the amusement park attraction. However, these methods may be complex to use and may require the amusement park attendant to have a high degree of familiarity with the physical layout of each attraction. Furthermore, these methods may become increasingly complex for amusement park attractions with many live feeds. Additionally, these methods may not accurately convey the actual physical location of a mobile camera (e.g., a camera mounted on a ride vehicle, drone, show element, etc., or a camera that has a range of views (e.g., a pivoting head). For example, if a camera is mounted on a ride vehicle, the physical location of the camera will move along the ride track, which may require amusement park attendants to infer the current location of the physical camera based on landmarks from the live feed. Furthermore, as some amusement parks may incorporate multiple cameras and / or mobile cameras as part of their monitoring systems, methods of correlating the live feed from the grid with their respective physical locations may become increasingly complex for amusement park attendants, resulting in slower responses to detected occurrences, more training required for amusement park employees, and an increased risk of error by amusement park attendants.

[0019] Provided herein is a monitoring system that generates a virtual model of an amusement park attraction that is visible on a display for an amusement park attendant. Live feeds (e.g., real-time video feeds) from cameras in the amusement park attraction are displayed in the virtual model at locations in the model that correspond to the actual physical locations of each of the cameras in the amusement park attraction, allowing the amusement park attendant to view the live feeds at geographic locations that are built into the virtual model of the amusement park attraction. As provided herein, the virtual model is a mix of a rendered or schematic model of the amusement park attraction and live feeds that are built into the model at locations in the model that correspond to or generally indicate the real-world field of view of each camera. In this way, the amusement park attendant will know the physical location of the live feeds while viewing them in the virtual model. Furthermore, the live feeds of the mobile cameras will be placed and moved in the virtual model based on the actual location and movement of the mobile cameras in the amusement park attraction, allowing the amusement park attendant to accurately determine the physical location of the mobile cameras.

[0020] FIG. 1 is a perspective view of one embodiment of a monitoring system for an amusement park attraction at an amusement park. The monitoring system 10 provides live feeds (e.g., real-time video feeds or real-time images) that can be viewed by amusement park attendants 19 designated to monitor the amusement park attraction 12. Specifically, the monitoring system 10 is configured to display the live feeds to the amusement park attendants 19 via virtual video displays within a virtual model of the amusement park attraction. In some embodiments, the amusement park attendants 19 can monitor additional amusement park attractions, other portions of the amusement park, or the entire amusement park. In some embodiments, the amusement park attendants 19 can monitor the live feeds for security or maintenance purposes. For example, at least one of the real-time video feeds can show off-limits areas 18 of the amusement park. Amusement park personnel 19 can observe the real-time video feed to determine if guest 20 enters off-limits area 18, which can be considered an attraction disruption. In some embodiments, amusement park personnel 19 can monitor the real-time video feed to determine the attraction status (e.g., schedule, track clear, vehicle operating status, prop operation status) of amusement park attraction 12. For example, amusement park personnel 19 can determine that show elements 22 (e.g., animatronic figures) are not moving as intended without having to perform an in-person inspection.

[0021] The monitoring system 10 includes a video assembly. The video assembly may include cameras 26 positioned in predetermined areas around the amusement park attraction 12 and configured to capture real-time video or images. For example, the cameras may be positioned at an entrance 28 of the amusement park attraction 12, along a path 30 leading to a ride area 32 of the amusement park attraction, within the ride area 32 of the amusement park attraction 12, at various locations along a ride track 34 of the amusement park attraction, on show elements 22 of the amusement park attraction 12, within an off-limits area 18 of the amusement park attraction 12, in a drop-off area 36 of the amusement park attraction, at an exit of the amusement park attraction 12, or in other areas of the amusement park attraction 12. Additionally, the cameras 26 may be positioned in other areas of the amusement park. For example, the cameras 26 may be positioned at the entrance / exit of the amusement park, along a path between the amusement park attractions, or in other areas of the amusement park.

[0022] In some embodiments, the amusement park attraction 12 can include a mobile camera 38. In some embodiments, the mobile camera 38 is disposed on a ride vehicle 40 of the amusement park attraction 12, such that the mobile camera 38 follows along the ride track 34 as the ride vehicle 40 moves along the ride track 34. The mobile camera 38 can be configured to provide a real-time video feed of a passenger portion 42 of the ride vehicle 40. In another embodiment, the mobile camera 38 can be configured to provide a real-time video feed of the amusement park attraction 12 as the ride vehicle 40 follows along the ride track 34 of the amusement park attraction 12. In a further embodiment, the mobile camera 38 can be configured to engage based on input from the amusement park attendant 19. For example, the mobile camera 38 can be configured to rotate left and right, up and down, etc. in response to input from the amusement park attendant 19.

[0023] In some embodiments, the mobile camera 38 may be located on an aerial drone 44. The aerial drone 44 may be configured to follow a set flight path 46 above the amusement park attraction 12 or above the amusement park. In some embodiments, the amusement park attendant 19 may directly control the aerial drone 44 to observe a desired area of ​​the amusement park attraction 12. For example, the amusement park attendant 19 may wish to view an unmonitored portion 48 of the amusement park that is not visible by the camera 26. The amusement park attendant 19 may direct one of the aerial drones 44 to the unmonitored portion 48 of the amusement park and capture a real-time video feed of the unmonitored portion 48 of the amusement park attraction 12.

[0024] In some embodiments, the monitoring system 10 includes a sensor assembly. The sensor assembly can be configured to detect trackable objects in the amusement park. The sensor assembly can be configured to track a guest device (e.g., an active wearable), a ride vehicle 40, or a show element 22 in the amusement park attraction 12. For example, the sensor assembly can detect the location of a ride vehicle 40 in the amusement park attraction 12. The sensor assembly can include sensors 52 positioned along the ride track 34 of the amusement park attraction 12. The sensors 52 can include infrared sensors, magnetic sensors, electrical sensors, position sensors, optical sensors, pressure sensors, or any other suitable sensors for detecting the ride vehicles 40.

[0025] In some embodiments, the live feed may include a real-time audio feed. In such an embodiment, the monitoring system 10 includes an audio assembly. The audio assembly may include audio input devices 60 (e.g., microphones) located throughout the amusement park attraction 12. Each audio input device 60 may be located proximate to one of the cameras 26. In some embodiments, the audio input devices 60 may be integrated into the cameras 26. Each audio input device 60 may record live audio at the respective location of the audio input device 60 and send a real-time audio feed to the control system 16 of the amusement park attraction 12 based on the recorded live audio. The monitoring system 10 may be configured to generate an audio output feed of the virtual model based on the real-time audio feed from each of the audio input devices 60 at the amusement park attraction 12. In one implementation, sound sources within the virtual model enable a spatially-spread user interface.

[0026] In some embodiments, the user interface 17 of the monitoring system 10 includes a display unit 64 (e.g., a monitor, a screen of a personal computing device, etc.) and an audio output device 65 (e.g., a speaker, headphones, etc.). A virtual model 62 including a real-time video feed of the amusement park attraction can be displayed on the display unit 64 for the amusement park attendant 19 to monitor the amusement park attraction 12. In addition, the audio output device 65 can be configured to output an audio output feed for the amusement park attendant 19. The audio output feed can include a real-time audio feed corresponding to a first audio input device 60 positioned proximate to the camera 26 that provides the real-time video feed that is most prominently displayed on the display unit 64.

[0027] In some embodiments, the amusement park attraction monitoring system 10 can generate spatial audio for the virtual model 62. The spatial audio can be generated using the position of the audio input device 60 and the corresponding real-time audio feeds. The spatial audio includes audio based on position. That is, as the amusement park attendant 19 moves the virtual camera (i.e., a camera disposed within the virtual model 62 and configured to provide an image displayed on the display unit 64), the audio output feed changes based on the position of the user camera (e.g., the virtual camera) within the virtual model. The audio output feed can vary based on the position of the virtual camera relative to the real-time video feed. The audio output feed can be given a direction and volume based on the distance and rotation of the virtual camera relative to the real-time audio feed. For example, sound from a first real-time audio feed located to the left of the virtual camera can be output by the left speaker 71 of the audio output device 65, while sound from a second real-time audio feed located to the right of the virtual camera can be output by the right speaker 73 of the audio output device 65. Additionally, the volume of sound output in an audio feed from a real-time audio feed located closer to the virtual camera may generally be louder than another real-time audio feed located farther away from the virtual camera. Thus, the volume may be based on the proximity of the real-time audio feed to the virtual camera. Providing spatial audio to amusement park attendants 19 may assist amusement park attendants 19 in monitoring the locations of amusement park attractions 12 that are not displayed in the real-time video feed observable via display unit 64.

[0028] 2 is a perspective view of one embodiment of a virtual model 62 of an amusement park attraction shown in accordance with the disclosed techniques on a display unit 64. The virtual model 62 is shown on the display unit 64 from the perspective of a virtual camera 63 that is controllable by an amusement park attendant 19 via a control system. The control system can be configured to generate the virtual model 62 of the amusement park attraction based on instructions stored on a memory device of the control system. The virtual model 62 can show one or more areas of the attraction 12 of FIG. 1, including the entrance 28 of the amusement park attraction, a path 30 leading to the ride area of ​​the amusement park attraction, the ride area 32 of the amusement park attraction, the ride track 34, the ride vehicles 40, the show elements 22, the off-limits area 18 of the amusement park attraction, the amusement park attraction disembarkation area 36, ​​an exit of the amusement park attraction, and / or any other portion of the amusement park attraction.

[0029] In some embodiments, the virtual model 62 may be a three-dimensional view of the amusement park attraction located within the virtual space 70. The three-dimensional view may be a virtual replica of the amusement park attraction. In one embodiment, the three-dimensional view may be rendered to scale of the actual amusement park attraction such that the geospatial relationships of the parts of the amusement park attraction are represented in the virtual model 62.

[0030] In some embodiments, the virtual model 62 may omit various levels of detail of the amusement park attraction to simplify the virtual model 62. That is, the virtual model 62 may be a schematic form of the attraction showing only certain elements. In one embodiment, the virtual model 62 shows the walls, ride tracks, and vehicles of the attraction rendered in a schematic manner. The virtual model 62 may be rendered at least in part as a computer-generated line drawing. In another embodiment, the virtual model 62 is a two-dimensional view of the amusement park attraction. For example, the virtual model 62 may be a floor plan view of the amusement park attraction. In some embodiments, the two-dimensional view may be an exemplary view of the amusement park attraction. For example, the amusement park attraction may be multi-leveled, such that the floor plan view overlaps portions of the amusement park attraction. The exemplary view may hide, move, or resize portions of the amusement park attraction such that various desired portions of the amusement park attraction are visible in the virtual model 62. Each view (e.g., two-dimensional and three-dimensional) can provide unique advantages to the monitoring system. For example, a three-dimensional view can show a more precise virtual model 62 to the amusement park attendant, while a two-dimensional view can show the amusement park attendant a single example view for ease of viewing. In some embodiments, the monitoring system can be configured to display both three-dimensional and two-dimensional views of the virtual model 62 to the amusement park attendant.

[0031] Further, the control system is configured to generate at least one virtual image or video display 72 incorporated in the virtual model 62 or virtual space 70. As described above, the camera and / or mobile camera can be configured to send a real-time video feed. The control system can be configured to receive the real-time video feed and generate a respective virtual video display 72 in the virtual model 62 or virtual space 70. As provided herein, a virtual video display can refer to a display of the real-time video feed incorporated in the virtual model 62. That is, the virtual video display can display the captured camera feed. The virtual video display 72 can be located at a virtual location in the virtual model 62 or virtual space 70 based at least in part on the actual physical location of each of the at least one camera in the amusement park attraction. The virtual location can be based on a measure of the relationship of the virtual model 62 or based on the relative location of a landmark in the virtual model 62. For example, if the attraction has cameras positioned approximately equidistant around the track (e.g., approximately every 60 degrees around a circular track), the virtual displays 72 can be similarly distributed around the rendered virtual track. Further, where an attraction has one or more props and cameras positioned adjacent to such props, the props may be rendered using line drawings or simplified prop images, and the virtual video display 72 from the adjacent camera may be positioned, for example, in front of the prop, next to the prop, based on the captured field of view around the prop.

[0032] 1 may be positioned proximate the ride area of ​​an amusement park attraction. Thus, each first virtual video display 72 may be positioned at a virtual location that is rendered or displayed within the portion of virtual model 62 shown to be proximate virtual ride area 76. Additionally, virtual video displays 72 may be positioned within the model at the location of the camera itself or at a location that corresponds to the captured field of view of the camera.

[0033] In some embodiments, the virtual video display 72 includes a two-dimensional virtual display disposed within a three-dimensional virtual model or space. The orientation of the two-dimensional virtual display (e.g., the first virtual video display 74) can be based at least in part on the orientation of at least one camera at the amusement park attraction. For example, in FIG. 1, the at least one camera is oriented such that the camera is pointed toward the ride area of ​​the amusement park attraction. In the virtual model 62, the two-dimensional virtual display can be oriented toward the virtual ride area 76 of the amusement park attraction such that the two-dimensional virtual display is positioned and oriented within the virtual model 62 or virtual space 70 corresponding to the perspective of the at least one camera.

[0034] In some embodiments, the control system is configured to adjust the camera position and angle visible by the display unit 64 within the virtual space 70 based on input from an amusement park attendant for viewing each of the virtual video displays 72. For example, the second virtual video display 78 is not visible to the amusement park operator in the illustrated embodiment. However, the amusement park operator can adjust the camera position and angle to view the virtual model 62 or the virtual space 70 from the opposite side of the virtual model 70 such that the second virtual video display 78 is visible to the amusement park operator. In another embodiment, the control system is configured to maintain the camera position and angle of the virtual space 70, but rotate, pan, etc. the virtual model 62 to view each of the virtual video displays 72.

[0035] 1 is configured to capture and output a panoramic real-time video feed. The control system can be configured to generate a three-dimensional virtual video display configured to display the panoramic real-time video feed in the virtual model 62. The three-dimensional virtual video display can display a first portion of the panoramic real-time video feed when the virtual model 62 is viewed from a first camera position and angle in the virtual space 70, and the three-dimensional virtual video display can display a second portion of the panoramic real-time video feed when the virtual model 62 is viewed from a second camera position and angle.

[0036] As described above, in some embodiments, the monitoring system includes a sensor assembly configured to detect trackable objects (e.g., guest devices, ride vehicles, show elements) in the amusement park and output a detection signal to a control system of the amusement park or amusement park attraction. The control system can be configured to receive the detection signal and move a portion of the virtual model 62 based on the detection signal. For example, the sensor assembly can detect a position of a ride vehicle and output a detection signal to the control system. The control system can reposition / update the position of each virtual ride vehicle 80 in the virtual model 62 based on the detection signal, and each virtual ride vehicle 80 can be located in the virtual model 62 or virtual space 70 to represent the actual position of the ride vehicle in that actual amusement park attraction. In one embodiment, the virtual ride vehicles 80 move along a track to correspond to the movement of the actual ride vehicles along the physical track. When the real ride vehicle comes into view of the camera and is visible on the virtual video display 72 in the virtual model 62, the virtual ride vehicle 80 may temporarily not be displayed in the portion of the virtual model that corresponds to the virtual video display 72. When the real ride vehicle moves out of view, the virtual vehicle 80 may be displayed again.

[0037] An operator viewing the virtual model 62 on the display unit 64 will see the rendered or virtual vehicles 80 traversing the ride track over time, and the operator will recognize at a glance where each virtual ride vehicle 80 is located in the virtual space. This visibility will allow the operator to more easily envision where each real vehicle would be located in the real attraction, and the operator can more easily monitor the attraction without having to switch between multiple camera feeds that are displayed in a manner that is separate from the attraction space. Furthermore, because certain elements of the virtual model 62 (track, walls, ride areas) are invariant between different drive cycles, the computational power of the model can be relatively lower than that of a model in which each element is rendered anew for each ride cycle. However, certain parts of the model remain relatively stationary relative to one another, while moving parts of the virtual model, such as the virtual ride vehicles, can be rendered in a general manner to reduce computational complexity. Furthermore, the incorporation of real-time video feeds enhances the information available in the model while maintaining the advantage of relatively low computational power compared to rendering attraction elements anew for each ride cycle.

[0038] In some embodiments, the sensor assembly can detect a guest device corresponding to a guest and output a guest detection signal to the control system. The guest detection signal can include a detected position of the guest device relative to the amusement park attraction. The control system is configured to receive the guest detection signal position of the guest device and generate a guest avatar 82 in the virtual model 62 or virtual space 70. The position of the guest avatar 82 in the virtual model 62 can be based at least in part on the detected position of the guest device at the amusement park attraction, and the guest avatar 82 is placed in the virtual model 62 to represent the location of the guest corresponding to the detected guest device at the actual amusement park attraction. In some embodiments, the form of the guest avatar 82 can be based on instructions stored on the memory device. In some embodiments, the form of the guest avatar 82 can be based on guest identification information associated with the guest device. For example, the guest identification information can indicate that the guest is an adult. Thus, the control system can generate an adult-sized avatar. In other embodiments, guest avatar 82 may be a shape (e.g., round, square, etc.) configured to represent the guest corresponding to the detected guest device. Additionally, as the guest moves around the physical attraction, the position of avatar 82 and / or vehicle 80 within virtual model 62 may be updated based on the updated location information.

[0039] As described above, the display unit 64 is configured to display the virtual model 62. The display unit 64 can be a computer monitor, a television, a computer screen, a mobile device screen (e.g., a mobile phone screen, a tablet screen, etc.), or another suitable display unit 62. However, in some embodiments, the virtual space 70 is a virtual reality environment. The amusement park attendant can view the virtual model 62 in the virtual reality environment via a virtual reality headset. The amusement park attendant can move within the virtual reality environment and view a virtual video display 72 disposed in the virtual reality environment. Additionally, the amusement park attendant can move in six degrees of freedom in the virtual reality environment. In another embodiment, the virtual space is an augmented reality environment. The amusement park attendant can view the virtual model in the augmented reality environment using an augmented reality headset.

[0040] In some embodiments, the amusement park operator may view previous recorded feeds via the virtual video displays 72. The amusement park operator may rewind, fast forward, slow, or pause previous recorded video feeds for a particular virtual video display, allowing amusement park attendants to evaluate previous footage at a particular camera location. For example, an amusement park operator may monitor multiple virtual video displays 72 and may not see an event passing through a particular video display. The amusement park operator may review previous recorded feeds at a particular camera location via the virtual video displays to have a more comprehensive account of the event.

[0041] 3 is a perspective view of one embodiment of a virtual model having a virtual display configured to rotate relative to the virtual model. An amusement park attendant may wish to view a particular virtual video display (e.g., first virtual video display 74, etc.) from a current display unit 64 camera orientation (e.g., a position and angle relative to the virtual model 62, or virtual space 70 visible on the display unit 64). However, the first virtual video display 74 may not be visible from the current display unit 64 camera orientation. In some embodiments, a virtual video display 72 (e.g., first virtual video display 74) may be configured to rotate relative to the virtual model 62 in the virtual space 70 based at least in part on input from an input device. For example, an amusement park attendant may manually input an input into an input device to rotate the first virtual video display 74 approximately 90 degrees so that the first virtual video display 74 is visible from the current display unit 12 camera orientation. In some embodiments, the virtual video display 72 may be configured to rotate any number of degrees.

[0042] In another embodiment, virtual video displays 72 may be configured to automatically rotate virtual video displays 72 to align with a current display unit 64 camera orientation such that each of virtual video displays 72 is visible on display unit 64 from the current display unit 64 camera orientation. Virtual video displays 72 may be configured to automatically update their respective orientations based on changes in the current display unit 64 camera orientation. Automatically rotating virtual video displays 72 may reduce blind spots in the monitoring system for amusement park attendants, as automatically rotating virtual video displays 72 may allow amusement park attendants to view all of the virtual video displays 72 at the same time.

[0043] In some embodiments, virtual model 62 includes an orientation indicator 84 positioned proximate to virtual video display 72. Orientation indicator 84 may be configured to indicate the actual orientation of a camera providing a real-time video feed to virtual video display 72, allowing amusement park personnel to determine the actual orientation of the camera that corresponds to the rotated virtual video display 72.

[0044] 4 is a perspective view of one embodiment of a virtual model 62 reoriented based at least in part on user input. In the illustrated embodiment, the virtual model 62 is a three-dimensional virtual model, and a plurality of two-dimensional virtual video displays 72 are positioned in a virtual space 70 relative to the three-dimensional virtual model 62 based on the actual position of the camera 26 at the amusement park attraction. The virtual model 62 can be made viewable by an amusement park attendant via a display unit 64. The monitoring system includes a user interface, the user interface including the display unit 64. Further, the user interface can include at least one input device. The input device can include a keyboard, a mouse, a joystick, a touchpad, or any other suitable input device.

[0045] The amusement park attendant can use the at least one input device to reorient the view of the virtual model 62 on the display unit 64 (e.g., change the camera orientation of the display unit 64). The amusement park attendant can input at least one user-initiated command into the at least one input device that reorients the view of the virtual model 62. In some embodiments, the input device can be configured to further control a camera position of the display unit 64 in the virtual space 70. In some embodiments, the at least one user-initiated command is configured to control the camera orientation of the display unit 64 in six degrees of freedom. That is, the at least one user-initiated command is configured to control the forward / backward, up / down, lateral, roll, pitch, and yaw of the camera orientation of the display unit 64.

[0046] For example, the camera orientation of the first display unit 64 may position the camera of the display unit 64 on a first side of the virtual model 62 and above the virtual model of the amusement park attraction 62, as shown in Figure 2. The first current display unit camera may be oriented downward toward the virtual model of the amusement park attraction 62. In the camera orientation of the second display unit 64, as illustrated in this embodiment, the second camera is positioned on a second side of the amusement park attraction and positioned closer to the ground below the virtual model of the amusement park attraction 62. Additionally, the camera of the second display unit 64 is oriented toward the opposite side of the virtual model 62 and toward the first virtual video display 74.

[0047] The amusement park attendant may vary the size of the virtual video displays 72 via at least one user-initiated command to at least one input device. For example, the amusement park attendant may enlarge the virtual video display 72 for easier viewing. In another example, the first virtual video display 74 may obscure the view of the second virtual video display 86 from the current display unit 64 camera orientation. Rather than changing the display unit 64 camera orientation to better view the second virtual video display 86, the amusement park attendant may reduce the size of the first virtual video display 74 and / or increase the scale of the second virtual video display 86 so that the second virtual video display 86 is visible from the current display unit 64 camera orientation. In some embodiments, the amusement park attendant may vary the size of each virtual video display 72 individually. In another embodiment, the size of the virtual video displays 72 relative to the virtual model 62 is based at least in part on instructions stored on a memory device, input from an input device, a trigger event, or a combination thereof.

[0048] Further, the rendering of the virtual model 62 and real-time video feed for each virtual video display 72 may include a level of detail rendering, such that the portions of the virtual model 62 and the real-time video feed have increasingly decreasing complexity based on the distance from the virtual camera 63. For example, portions of the virtual model 62 located closer to the virtual camera 63 may have a higher complexity than portions of the virtual model 62 located further away. In addition, the real-time video feed located farther from the virtual camera may have a lower video resolution, and the video resolution of the real-time video feed may increase with proximity to the virtual camera 63. Further, the proximity of the virtual camera 63 to the virtual video display 72 corresponding to the camera (e.g., a real-world camera) may control the video resolution of the real-world video feed output by the real-world camera. For example, the real-world camera may capture and output high-resolution video to a control system when the virtual camera 63 is located closer to the virtual video display 72 corresponding to the real-world camera. However, the real-world cameras may degrade the quality of the real-world video feeds captured and output by the real-world cameras as the virtual cameras 63 move away from the virtual video displays 72 corresponding to the real-world cameras. The reduced video resolution of some real-world cameras may reduce overall network bandwidth. Additionally, the control system may shut down the real-world cameras (e.g., stop capturing video, outputting real-time video feeds, or some combination thereof) when the virtual video displays 72 corresponding to the respective real-world cameras are not within the field of view of the virtual cameras 63.

[0049] 5 is a perspective view of an embodiment of a virtual space 70 having a viewing window 90 configured to display a video feed 92 corresponding to at least one virtual video display 72. The monitoring system can be configured to generate the viewing window 90 that allows an amusement park attendant to view a selected video feed 92 in a stationary portion of the display unit 64 independent of the virtual model 62. The viewing window 90 can be configured to remain stationary when the amusement park attendant changes the camera orientation of the display unit 64 to view a different view or portion of the virtual model 62 of the amusement park attraction. The viewing window 90 can be a separate window or portion of a program window 94 that displays the virtual model 62. The viewing window can have pre-configured panes 96 configured to receive and display the video feed 92 from the selected virtual video display 72. The amusement park attendant can select a virtual video display 72 via an input device. For example, an amusement park attendant may select a virtual video display 72 in the virtual space by clicking on the virtual video display 72 and dragging the virtual video display 72 towards the pre-defined pane 96. Based on a user-initiated command, the viewing window 90 may display a video feed 92 that corresponds to the virtual video display 72 that was clicked and dragged into the pre-defined pane 96.

[0050] In some embodiments, the monitoring system may provide an option to hide the viewing window 90, selectable via an input device. Additionally, the monitoring system may include a filter tool 100. The filter tool 100 may be configured to selectively toggle / hide at least one of the virtual video display 72, the virtual ride vehicle 80, the guest avatar 82, the virtual show element 98, portions of the virtual model 62 of the amusement park attraction, or combinations thereof. The filter tool 100 may be a tool for an amusement park attendant to selectively simplify the virtual model 62. Additionally, the filter tool 100 may be a tool configured to adjust the opacity of the virtual video display 72, the virtual ride vehicle 80, the guest avatar 82, the virtual show element 98, portions of the virtual model 62 of the amusement park attraction, or combinations thereof. The filter tool 100 may be configured to individually adjust the opacity of the virtual video displays 72. In some embodiments, the filter tool 100 may have a condition-based option to automatically adjust the opacity of at least one virtual video display 72 under pre-set conditions. For example, the filter tool 100 may be configured to reduce the opacity of the first virtual video display 74 when at least a portion of the second virtual video display 78 is behind the first virtual video display 74 from the perspective of a virtual camera displayed on the display unit, such that the first virtual video display 74 becomes at least partially transparent and the second virtual video display 78 is at least partially visible through the first virtual video display 74.

[0051] In some embodiments, the user interface includes an audio output device 65. The audio output device 65 is configured to output audio captured by audio input devices located throughout the amusement park attraction. As described above, in some embodiments, the audio input devices are located proximate to the respective cameras. The audio input devices can be configured to capture audio proximate to the cameras. In some embodiments, the audio output device 65 is configured to output an audio feed captured by the respective audio input devices when at least one virtual display corresponding to at least one camera is selected via the input device. For example, clicking on a virtual video display via the input device can cause the audio output device to output sound captured by an audio input device located proximate to a camera corresponding to the selected virtual video display, allowing an amusement park attendant to hear audio around the amusement park attraction via the monitoring system.

[0052] 6 is a block diagram of one embodiment of the monitoring system 10. The monitoring system 10 includes a control system 16 and a video assembly 24. The video assembly 24 is configured to capture and send real-time video feed data 110 to the control system 16. The video assembly 24 includes a camera 26. In some embodiments, the camera 26 is configured to output the captured real-time video feed data 110 directly to a controller of the video assembly. In another embodiment, the camera 26 is configured to output the captured real-time video feed data 110 directly to the control system 16. The control system 16 can include communication circuitry 112 configured to receive the real-time video feed data 110 or real-time image data from the video assembly 24 or the camera 26. The communications circuitry 112 may include antennas, radio transceiver circuitry, and signal processing hardware and / or software (e.g., hardware or software filters, A / D converters, multiplexer amplifiers), or combinations thereof, and may be configured to communicate over wireless communications paths via infrared (IR) wireless communications, satellite communications, broadcast radio, microwave radio, Bluetooth, Zigbee, Wi-Fi, UHF, NFC, etc. In one embodiment, the communications circuitry 112 includes multiple IR transceivers located within the amusement park or amusement park attraction.

[0053] The control system 16 may also include a system controller 114 having a system processor 66 and a memory 68. The system processor 66 may include one or more processing devices, and the memory 68 may include one or more tangible, non-transitory, machine-readable media. By way of example, such machine-readable media may include RAM, ROM, EPROM, EEPROM, or optical disk storage, magnetic disk storage or other magnetic storage devices, or any other media that may be used to hold or store desired program code in the form of machine-executable instructions or data structures and that may be accessed by the system processor or other processor-based devices (e.g., mobile devices). In some embodiments, the memory device 68 is configured to store video footage of the real-time video feed data 110. In some embodiments, the memory 68 is configured to store instructions executable by the system processor 66 to output various control system signals. For example, the system processor may execute instructions to generate a virtual model of a predetermined area based on instructions stored on the memory device 68.

[0054] Further, the system processor 66 is configured to generate a virtual video display within the virtual model based on the real-time video feed data 110 received from the video assembly 24 and / or the camera 26. The system processor 66 can be configured to output the virtual model and the virtual video display to the display unit 64 of the user interface 17 via a display signal 118. In some embodiments, the system processor 66 is configured to output the display signal 118 to the display unit 64 of the user interface 17 via a wired connection. However, in some embodiments, a wireless device can include the display unit 64. Thus, the system processor 66 can be configured to output the display signal 118 to the display unit 64 of the user interface 17 via the communication circuitry 112. As described above, the display unit 64 can include a computer monitor, a television, a computer screen, a mobile device screen (e.g., a mobile phone screen, a tablet screen, etc.), or another suitable display unit 62. The display unit 64 is configured to display the virtual model and the virtual video display within the virtual space for the amusement park attendant.

[0055] The user interface 17 may also include an input device 120 configured to provide at least one user-initiated command 108 to the system processor 66. The at least one user command 108 may include instructions to control portions of the monitoring system 10. For example, the at least one user command 108 may control a camera orientation of the display unit 64 for the display unit 64 in the virtual space. In some embodiments, the at least one user command 108 may be configured to activate at least one of the cameras 26 to change the orientation of the camera 26 at the amusement park attraction. Furthermore, in some embodiments, the at least one user command 108 may be configured to control a mobile camera. For example, the mobile camera may include a drone-mounted camera or a camera mounted on a ride vehicle. The at least one user command 108 may be configured to control a flight path of the at least one drone to view a particular portion of the amusement park attraction.

[0056] In some embodiments, user interface 17 also includes an audio output device 65. Audio output device 65 may be configured to output an audio feed 122 when at least one virtual display corresponding to at least one camera 26 is selected by input device 120 based at least on a user command. Audio output device 102 may include a speaker or any other suitable audio device for an output audio feed.

[0057] In some embodiments, the monitoring system 10 includes a sensor assembly 50, which may include sensors 52 disposed throughout the amusement park attraction. As described above, the sensors 52 may be configured to detect a position of a ride vehicle at the amusement park attraction. The sensors 52 and / or the sensor assembly 50 may be configured to output a detection signal 124 of the ride vehicle to the communication circuitry 112 of the control system 16 of the amusement park attraction. The control system 16 may be configured to receive the detection signal 124 and position the virtual ride vehicle in the virtual model based at least in part on the detected position of the ride vehicle at the amusement park attraction. In some embodiments, the sensors 52 are configured to output the detection signal 124 to the sensor assembly 50. The sensors 52 may be configured to output the detection signal 124 over a wired or wireless network.

[0058] In some embodiments, the monitoring system 10 includes an audio assembly 126. The audio assembly 126 may include at least one audio input device 128 positioned proximate to the at least one camera 26 at the amusement park attraction. The audio input device 128 and / or the audio assembly 126 may be configured to send an audio feed 122 to the communications circuitry 112 of the control system 16.

[0059] While only certain features of the disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art, and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes which fall within the true spirit of the disclosure.

[0060] The techniques presented and claimed herein refer to and apply substantial objects and specific embodiments of a practical nature that clearly improve the art of the present invention, and are therefore not abstract, intangible, or theoretical in nature. Moreover, to the extent that any claim appended to the end of this specification contains one or more elements designated as "means for 'performing' a 'function' ..." or "steps for 'performing' a 'function' ...," such elements are to be construed pursuant to 35 U.S.C. 112(f). However, for any claim containing elements designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f).

Claims

1. a video assembly including at least one camera disposed within a predetermined area and configured to provide a real-time video feed of physical locations within the predetermined area; a control system configured to receive the real-time video feed from the at least one camera; Equipped with The control system includes: A memory device; a processor configured to generate a virtual model of the predetermined area and a virtual vehicle disposed within the virtual model based on instructions stored on the memory device, the processor configured to incorporate the real-time video feed into the virtual model at a virtual location in the virtual model that corresponds to the physical location in the predetermined area, the virtual model including a representation of the virtual vehicle in the predetermined area such that the real-time video feed is overlaid on the virtual model, the virtual vehicle is not displayed at the virtual location of the virtual model while a real vehicle passes through the physical location corresponding to the virtual location, and the real vehicle is displayed within the real-time video feed of the virtual model; a display unit configured to display the virtual model; Including, Monitoring system,

2. the virtual position corresponds to a field of view of the at least one camera, and the virtual position is configured to be adjusted or moved within the virtual model in response to an adjustment of the field of view by an operator. The monitoring system of claim 1 .

3. the virtual model includes a three-dimensional virtual model, and the display of the real-time video feed includes a two-dimensional display positioned in the three-dimensional virtual model such that the real-time video feed is not visible in a particular orientation of the virtual model. The monitoring system of claim 1 .

4. the at least one camera is configured to capture and output a panoramic real-time video feed, and a displayed portion of the panoramic real-time video feed in the virtual model is adjusted based on an orientation of the virtual model. The monitoring system of claim 1 .

5. the virtual model includes a rendering of a virtual attraction track, and the virtual location is adjacent to the virtual attraction track. The monitoring system of claim 1 .

6. one or more sensors configured to send data indicative of a position of one or more moving parts within the predetermined area, and the control system is configured to update the virtual model based on the positions of the one or more moving parts. The monitoring system of claim 1 .

7. a video assembly including at least one camera disposed within a predetermined area, the at least one camera configured to capture and output real-time images of physical locations in the predetermined area; a control system configured to receive the real-time images from the at least one camera; Equipped with The control system includes: A memory device; a processor configured to generate a virtual model of the predetermined area in a virtual space and a virtual vehicle disposed within the virtual model based on instructions stored on the memory device, the processor configured to overlay at least one virtual video display on the virtual space based on the real-time imagery, a position of the at least one virtual video display in the virtual space based at least in part on a position of the at least one camera within the predetermined area, the virtual model including a representation of a virtual vehicle in the predetermined area such that the virtual vehicle is not displayed at the virtual location of the virtual model while a real vehicle passes through a physical location corresponding to a virtual location in the virtual model, and the real vehicle is displayed in the real-time imagery of the virtual model; A user interface; Including, The user interface includes: a display unit configured to display the virtual space to a user; an input device configured to provide at least one user-initiated command to the processor that controls a camera orientation of the at least one camera; Including, Monitoring system.

8. the at least one user-initiated command is configured to control forward / backward, up / down, lateral, roll, pitch, and yaw of the camera orientation; The monitoring system of claim 7.

9. the at least one virtual video display is configured to rotate relative to the virtual model in the virtual space based at least in part on input from the input device. The monitoring system of claim 7.

10. the processor is configured to generate a viewing window configured to display at least one selected virtual video display on a separate portion of the display unit; The monitoring system of claim 7.

11. a size of the virtual video display relative to the virtual model is based at least in part on instructions stored on the memory device, input from the input device, a trigger event, or a combination thereof; The monitoring system of claim 7.

12. the at least one virtual video display is configured to automatically rotate the at least one virtual video display to align with the camera orientations such that the virtual video display is viewable on the display unit from a plurality of camera orientations. The monitoring system of claim 7.

13. an audio assembly including at least one audio input device disposed proximate to the at least one camera and configured to provide a real-time audio feed to the control system; The monitoring system of claim 7.

14. the user interface includes an audio output device configured to output a real-time audio output feed when the at least one virtual video display corresponding to the at least one camera is selected by the input device; The monitoring system of claim 13.

15. a video assembly including at least one camera disposed within the amusement park attraction and configured to provide a real-time video feed of the physical location of the amusement park attraction; a sensor assembly configured to detect a position of a ride vehicle at the amusement park attraction; a control system configured to receive the real-time video feed from the at least one camera and the detected position of the ride vehicle; Equipped with The control system includes: A memory device; a processor configured to generate a virtual model of the amusement park attraction and a virtual ride vehicle disposed within the virtual model based on instructions stored on the memory device, the processor configured to overlay at least one virtual video display on the virtual model based on the real-time video feed, a position of the at least one virtual video display overlaid on the virtual model based at least in part on the physical location, a position of the virtual ride vehicle in the virtual model changes based at least in part on the detected location of the ride vehicle within the amusement park attraction, and while the detected location of the ride vehicle corresponds to the physical location, the virtual ride vehicle is not displayed at a position of the virtual video display of the virtual model and the ride vehicle is displayed within the real-time video feed of the virtual model; a display unit configured to display the virtual model; Including, Monitoring system.

16. the sensor assembly is configured to detect a guest device corresponding to a guest; The processor, receiving a detected location of the guest device; generating an avatar in the virtual model based on instructions stored on the memory device, a position of the avatar in the virtual model based at least in part on a detected position of the guest device at the amusement park attraction; updating the avatar in the virtual model based on the updated position of the guest device; It is configured as follows:

16. The monitoring system of claim 15.

17. the at least one camera includes a camera disposed on a ride vehicle at the amusement park attraction, the at least one camera configured to transmit a video feed of a passenger portion of the ride vehicle.

16. The monitoring system of claim 15.

18. the virtual model includes a filter tool configured to selectively switch between displays of the at least one virtual video display, the virtual ride vehicle, an avatar corresponding to a guest, or a combination thereof.

16. The monitoring system of claim 15.

19. the controller is configured to update the virtual model such that the ride vehicle is visible within the virtual video display such that the virtual ride vehicle is not displayed within the virtual model when a position of the ride vehicle corresponds to the physical location of the amusement park attraction.

16. The monitoring system of claim 15.

Citation Information

Patent Citations

  • Remote monitor system and program

    JP2003244683A

  • Multiple camera system, zoom camera control method, and zoom camera control program

    JP2003259349A

  • Map interconnection video monitoring method and apparatus thereof

    JP2007158496A

  • Image display apparatus, image display control method, program, and monitoring camera system

    JP2008244946A

  • Monitoring system and monitoring method

    JP2012239068A