A system for multi-user collaboration in a virtual reality environment

Abstract

Real-world users of an event simulation system can simulate events being performed at a real-world venue by playing back a digital representation of the event mapped onto a virtual model of the real-world venue. As real-world users view this virtual event, they can virtually interact with it, for example, by moving around to view the virtual event in different locations and / or modifying the parameters, characteristics, and / or attributes of the virtual event. The event simulation system can then propagate these modifications across multiple real-world users of the event simulation system, enabling these real-world users to interact with the virtual event in a coordinated manner.

Description

BACKGROUND ART

[0001] Background The media and entertainment industry of the United States is the largest in the world. The media and entertainment industry of the United States accounts for one-third of the global media and entertainment industry that delivers events such as music events, theater events, sports events, and / or movie events to audiences for viewing enjoyment. Different real-world venues have different configurations and arrangements from each other, such as media surfaces, seats, and / or standing areas, to name a few, for staging events for audiences' viewing enjoyment. Event planners often design and plan event stagings to optimize the event experience for specific configurations and arrangements at these specific venues. In some situations, an event may need to be optimized to correspond to a specific configuration and arrangement of a specific venue before the event is staged, and / or a specific venue may need to be modified to correspond to the event before the event is staged. In these situations, the event and / or the content of the event may need to be modified differently for different venues. However, with current systems, customizing and planning content for specific configurations and arrangements requires planners to physically travel to specific venues, sometimes across the world. SUMMARY OF THE INVENTION MEANS FOR SOLVING THE PROBLEM

[0002] Overview

[0003] Real-world users of an event simulation system can simulate events being performed at a real-world venue by playing back a digital representation of the event mapped onto a virtual model of the real-world venue. As real-world users view this virtual event, they can virtually interact with it, for example, by moving around to view the virtual event in different locations and / or modifying the parameters, characteristics, and / or attributes of the virtual event. The event simulation system can then propagate these modifications across multiple real-world users of the event simulation system, enabling these real-world users to interact with the virtual event in a coordinated manner. [Brief explanation of the drawing]

[0004] Brief explanation of the drawing / diagram The accompanying drawings incorporated herein and forming part thereof illustrate the disclosure and, together with the description, further illustrate its principles and enable those skilled in the art to manufacture and use it. The aspects of this disclosure will be best understood from the following detailed description, when read in conjunction with the accompanying drawings. Note that, in accordance with standard industry practice, features are not drawn to scale. In fact, the dimensions of features may be arbitrarily enlarged or reduced for clarity in the description. In the drawings:

[0005] [Figure 1] Figure 1 schematically illustrates an exemplary event simulation system according to several exemplary embodiments of the present disclosure.

[0006] [Figure 2] Figure 2 shows a flowchart of an exemplary event simulation according to several exemplary embodiments of the present disclosure. The present disclosure is not limited to this description of operation.

[0007] [Figure 3]Figure 3 schematically illustrates exemplary virtual events that may be implemented within an exemplary event simulation system according to some exemplary embodiments of the present disclosure.

[0008] [Figure 4A] Figure 4A schematically illustrates an exemplary virtual event view that may be generated by an exemplary event simulation system according to some exemplary embodiments of the present disclosure. [Figure 4B] Figure 4B schematically illustrates an exemplary virtual event view that may be generated by an exemplary event simulation system according to some exemplary embodiments of the present disclosure.

[0009] [Figure 5A] Figure 5A schematically illustrates exemplary interactions with exemplary virtual event views that may be generated by a user of an exemplary event simulation system, according to some exemplary embodiments of the present disclosure. [Figure 5B] Figure 5B schematically illustrates exemplary interactions with exemplary virtual event views that may be generated by a user of an exemplary event simulation system, according to some exemplary embodiments of the present disclosure.

[0010] [Figure 6] Figure 6 schematically illustrates exemplary coordination between users of an exemplary virtual event view in some exemplary embodiments of the present disclosure.

[0011] [Figure 7] Figure 7 schematically shows an exemplary event simulation server that may be implemented within an exemplary event simulation system according to some exemplary embodiments of the present disclosure.

[0012] [Figure 8A] Figure 8A schematically shows an exemplary user device that may be implemented within an exemplary event simulation system according to some exemplary embodiments of the present disclosure.

[0013] [Figure 8B] FIG. 8B schematically illustrates an exemplary implementation of the exemplary user device of FIG. 8A, in accordance with some exemplary embodiments of the present disclosure.

[0014] [Figure 9] FIG. 9 schematically illustrates a simplified block diagram of a computer system suitable for use with the embodiments described herein, in accordance with some exemplary embodiments of the present disclosure.

[0015] In the accompanying drawings, like reference numerals indicate identical or functionally similar elements. Furthermore, the leftmost digit of a reference numeral identifies the drawing in which the reference numeral first appears. DETAILED DESCRIPTION OF THE INVENTION

[0016] Detailed Description The following disclosure provides many different embodiments or examples for implementing different features of the provided subject matter. Specific examples of components and arrangements are described below to simplify the present disclosure. Of course, these are merely examples and are not intended to be limiting. For example, the formation of a first feature over a second feature in the description that follows may include embodiments in which the first and second features are formed in direct contact, and may also include embodiments in which additional features may be formed between the first and second features such that the first and second features may not be in direct contact. In addition, the present disclosure may repeat reference numerals and / or letters in the examples. This repetition does not in itself define a relationship between the described embodiments and / or configurations.

[0017] Exemplary Event Simulation System

[0018] Figure 1 schematically illustrates an exemplary event simulation system according to several exemplary embodiments of the present disclosure. Different real-world venues have different configurations and arrangements, to give a few examples, such as media surfaces, seating, and / or standing areas, for staging events for audiences to enjoy viewing. Thus, viewers of these venues may have different perceptions of events, which may depend on a wide variety of factors. In the exemplary embodiment shown in Figure 1, the event simulation system 100 can provide a virtual event by mapping a digital representation of an event, such as a music event, a theatrical event, a sporting event, and / or a film event, onto a virtual model of a real-world venue. As will be described in more detail below, one or more real-world users of the event simulation system 100 can play the virtual event to simulate an event being performed in a real-world venue. When one or more real-world users are viewing the virtual event, these users can virtually interact with the virtual event, for example, by moving around the virtual event to view it in different locations, and / or by modifying one or more parameters, characteristics, and / or attributes of the virtual event. In some embodiments, the event simulation system 100 can propagate these interactions and modifications across multiple real-world users of the event simulation system 100, enabling these real-world users to interact with virtual events in a coordinated manner. As shown in Figure 1, the event simulation system 100 may include an event simulation server 102, event storage 104, user devices 106.1 to 106.n, and / or one or more remote event sources 108, all connected to each other via a communication network 110.

[0019] As shown in Figure 1, the event simulation server 102 may include one or more computing devices, such as one or more desktop computers, one or more rack-mount computers, one or more computer hardware servers, and / or any other computing devices having one or more processors, to name a few examples, which would be recognized by those skilled in the art without departing from the spirit and scope of this disclosure. In some embodiments, one or more of these computing devices, desktop computers, rack-mount computers, computer hardware servers, etc. may be located near the user devices 106.1 to 106.n, for example, within the same building structure as the user devices 106.1 to 106.n, or one or more of these computing devices, desktop computers, rack-mount computers, computer hardware servers, etc. may be located far from the user devices 106.1 to 106.n, for example, in a different building structure located far away from the user devices 106.1 to 106.n. In some embodiments, one or more of the user devices 106.1 to 106.n may be implemented as the event simulation server 102, as well as in a peer-to-peer network.

[0020] In the exemplary embodiment shown in Figure 1, the event simulation server 102 may retrieve and / or generate a virtual model of a real-world venue. The virtual model represents a computer-generated digital model of the real-world venue in a three-dimensional space. In some embodiments, the real-world venue may represent a music venue, such as a music theater, music club, and / or concert hall, a sports venue, such as an arena, convention center, and / or stadium, an exhibition space, such as a museum, and / or library, and / or any other suitable venue that would be apparent to those skilled in the art without departing from the spirit and scope of the present disclosure. In these embodiments, the virtual model may represent a computer-generated digital model of a music theater, sports venue, and / or other suitable venue in a three-dimensional space, including the specific configuration and arrangement of walls and other surfaces that define the venue. In some embodiments, the virtual model may include one or more computer-generated digital models of various architectural features of the real-world venue in three-dimensional space, such as, to name a few examples, performance areas, media surfaces, seats, and / or standing areas. In some embodiments, the virtual model may include one or more computer-generated digital models of various objects at the real-world venue in three-dimensional space, such as, to name a few examples, stage objects associated with the real-world venue and / or stage objects associated with an event. In some embodiments, the virtual model may be generated as described in U.S. Patent Application No. 16 / 678,804, filed November 8, 2019, now U.S. Patent No. 11,023,729, which is incorporated herein by reference in its entirety.

[0021] In some embodiments, the event simulation server 102 synchronizes virtual events among multiple user devices 106.1 to 106.n, facilitating coordination regarding the design and planning of virtual events. After retrieving the virtual model, the event simulation server 102 can generate virtual events by mapping the digital representation of events onto the virtual model, as shown in Figure 1, and provide the virtual events to the user devices 106.1 to 106.n. In some embodiments, the event simulation server 102 can retrieve digital representations of events from event storage 104 and / or remote event sources 108 via a communication network 110. The user devices 106.1 to 106.n can locally maintain and implement their own versions of the virtual events, each virtual event 112.1 to 112.n.

[0022] In some embodiments, the event simulation server 102 can only function to synchronize virtual events 112.1 to 112.n based on interactions and modifications by user devices 106.1 to 106.n. In these embodiments, each of the user devices 106.1 to 106.n can retrieve a virtual model or virtual event directly from the event storage 104 or a remote event source 108. After retrieving either a virtual model or a virtual event, the user devices 106.1 to 106.n can then transmit their respective interactions and modifications to the event simulation server 102, which then transmits the interactions and modifications to other user devices. In this way, the event simulation server 102 facilitates coordination among user devices 106.1 to 106.n by ensuring that each user device has the same view of the virtual events.

[0023] After receiving a virtual event (either from the event simulation server 102, or directly from the event storage 104 or remote event source 108), each user device can store and interact with a local copy of the virtual event, such as virtual event 112.1 for user device 106.1, virtual event 112.2 for user device 106.2, and virtual event 112.n for user device 106.n. Modifications to the virtual event (e.g., moving digital objects, changing acoustic or visual parameters of the virtual event) and other interactions by each user device are transmitted to the event simulation server 102, which then forwards the modifications to other user devices to update their respective virtual events. For example, if user device 106.1 adjusts props for a virtual event 112.1, such as airflow patterns (e.g., in the case of a concert), scent models (e.g., modeling of scents passing through a venue), or changes to acoustic beamforming, user device 106.1 transmits the adjustments to user devices 106.2 and 106.n via the event simulation server 102. User devices 106.2 and 106.n can then make the corresponding adjustments for their respective virtual events 112.2 and 112.n, and as a result, the adjustments may be visually represented on user devices 106.2 and 106.n.

[0024] The digital representation of an event can represent one or more computer-generated digital representations of the event itself, such as a music event, a theatrical event, and / or a sporting event, and / or a film event, to name a few. In some embodiments, real-time or near-real-time events, also called live events, such as a music event, a theatrical event, and / or a sporting event, to name a few, may be digitally captured by, for example, one or more digital cameras to provide a digital representation of this real-time or near-real-time event for mapping into a virtual model. As shown in Figure 1, virtual events 112.1 to 112.n represent a virtual performance of a digital representation of an event in a virtual model for virtually simulating an event being performed in a real-world venue. For example, an event may include, to name a few, a music event, a theatrical event, a sporting event, and / or a film event. In this example, the event simulation server 102 can generate virtual events by mapping one or more computer-generated digital representations of music events, one or more computer-generated digital representations of theatrical events, one or more computer-generated digital representations of sporting events, and / or films onto a virtual model, and the virtual events may then be provided to user devices 106.1 to 106.n for local storage and / or processing. Thus, the virtual events 112.1 to 112.n represent virtual performances of music events, theatrical events, sporting events, and / or films in the virtual model, virtually simulating music events, theatrical events, sporting events, and / or films being performed in real-world venues.

[0025] In some embodiments, an event may include one or more performers associated with the event and / or one or more theatrical props, also known as props. In these embodiments, the event simulation server 102 can generate a virtual event by mapping one or more computer-generated models of one or more performers and / or one or more computer-generated models of one or more props associated with the event onto a virtual model.

[0026] In some embodiments, virtual events 112.1–112.n may also include visual representations of real-world effects related to actual events. Various virtual effects may relate to the senses of the human body, such as sight, smell, touch, taste, and / or hearing, to name a few. These various virtual effects may include audio, visual, and / or sensory effects that are visually represented in the virtual event and provide visual aids to real-world effects that are not necessarily visible. For example, real-world effects of an event may include airflow patterns (e.g., from a fan), sound localization (e.g., from acoustic beamforming techniques), and scent trails. The virtual event may represent these real-world props through visual virtual effects such as arrows, lines, or any other visual effects that may be displayed in the virtual event.

[0027] In some embodiments, these various visual virtual effects may relate to the external environment of the real-world venue, such as lighting options available within the real-world venue, colors present within the real-world venue, different materials within the real-world venue, seating, screens, trees, buildings, roads, sky, lighting, and / or sun effects, as well as / or other real-world audiences within the real-world venue. In some embodiments, auditory effects may include, to some examples, realistic confirmation effects, realistic recall effects, symbolic recall effects, customary effects, impressionistic effects, and / or music as an effect. In some embodiments, visual effects may include, to some examples, special effects, motion capture, matte painting, animation, 3D modeling, rigging, rotoscoping, matchmove, and / or compositing. In some embodiments, sensory effects may include, to some examples, various effects related to the senses that the human body can experience, such as temperature, touch, and / or smell. In some embodiments, the virtual event may include computer-generated digital models of these virtual effects, as well as / or various electrical, mechanical, and / or electromechanical devices, in order to simulate these virtual effects. For example, a virtual event could include, to name a few, a lighting system, a smoke machine, a blower, robots or animatronics, a platform such as a movable platform for performers, and / or a computer-generated digital model of a 4D effects pod for the virtual event.

[0028] After generating a virtual event, the event simulation server 102 can provide the virtual event to user devices 106.1 to 106.n. As shown in Figure 1, one or more of the user devices 106.1 to 106.n may include, to name a few, one or more computing devices such as one or more desktop computers, one or more mobile phones, one or more mobile computing devices, one or more mobile internet devices such as tablet computers and / or laptop computers, one or more mobile video game consoles, one or more mobile wearable electronic devices such as smartwatches, and / or any other computing devices having one or more processors that would be recognized by those skilled in the art without departing from the spirit and scope of this disclosure. In some embodiments, one or more of these computing devices may be communicably coupled to one or more virtual reality (VR) headsets and / or one or more VR controllers.

[0029] In the exemplary embodiment shown in Figure 1, user devices 106.1 to 106.n can play each virtual event 112.1 to 112.n to virtually simulate an event being performed in a real-world venue. In some embodiments, user devices 106.1 to 106.n can further stop, pause, fast forward, and / or rewind each virtual event 112.1 to 112.n. In some embodiments, the event simulation server 102 can time-synchronize the virtual events 112.1 to 112.n across all user devices 106.1 to 106.n. In these embodiments, user devices 106.1 to 106.n can synchronize the playback of the virtual events to the master clock signal of the event simulation server 102. Event synchronization also includes updating each virtual event based on interactions and modifications that generate other virtual events. For example, an interaction or modification in virtual event 112.1 propagates to virtual events 112.2 to 112.n, and as a result, the same interaction or modification is applied to virtual events 112.2 to 112.n.

[0030] In the exemplary embodiment shown in Figure 1, real-world users of user devices 106.1 to 106.n can interact with their respective virtual events 112.1 to 112.n while these real-world users are viewing virtual event views 114.1 to 114.n. In some embodiments, these interactions may include virtually moving virtual users corresponding to real-world users around the 3D space of each virtual event 112.1 to 112.n to view the digital representation of the event at various locations within the 3D space of each virtual event 112.1 to 112.n. In these embodiments, multiple real-world users can view the virtual event from their user devices from the same or different locations within the 3D space. In some embodiments, these various locations may include, for example, locations within the 3D space of the virtual event that are not normally available for viewing the event at a real-world venue, such as a broadcast film camera position. In the exemplary embodiment shown in Figure 1, user devices 106.1 to 106.n can process each virtual event 112.1 to 112.n as the virtual event is being played to provide virtual event views 114.1 to 114.n corresponding to various locations of the virtual user that should be displayed to the real-world user by the user devices 106.1 to 106.n. This processing may include tracking the three-dimensional position of the virtual user in the three-dimensional space of the virtual event, estimating the virtual user's line of sight at the three-dimensional position, estimating the virtual user's field of view associated with the line of sight, and / or matching the virtual event views 114.1 to virtual 114.n to the virtual user's field of view at the three-dimensional position.

[0031] In some embodiments, these interactions may include virtually modifying virtual events while these users are viewing virtual event views 114.1–114.n. In some embodiments, user devices 106.1–106.n may provide real-world users with various virtual graphical elements to enable these users to modify virtual events. In these embodiments, these virtual graphical elements may outline various interactions available to real-world users, such as modifications. In these embodiments, these virtual graphical elements may include, to name a few, one or more radio buttons, one or more checkboxes, one or more text boxes, one or more toggle switches, one or more pop-up menus, one or more lists, and / or any other suitable mechanisms that enable real-world users to interact. For example, these modifications may include removing one or more parameters, characteristics, and / or attributes of a virtual event from the three-dimensional space of the virtual event. As another example, these modifications may include moving the location, such as position and / or orientation, of one or more parameters, characteristics, and / or attributes of a virtual event 112 within the three-dimensional space of the virtual event. As further examples, these modifications may include inserting one or more new parameters, new characteristics, and / or new attributes into the three-dimensional space of the virtual event. In some embodiments, the parameters, characteristics, and / or attributes of the virtual event may include, or relate to, one or more computer-generated digital models of various architectural features of a real-world venue, one or more computer-generated digital models of various objects, one or more computer-generated models of one or more performers, one or more computer-generated models of one or more props associated with the event, and / or other suitable parameters, characteristics, and / or attributes of the virtual event that would be apparent to those skilled in the art without departing from the spirit and scope of this disclosure.

[0032] In some embodiments, virtual graphical elements correspond to virtual effects and are displayed in virtual event views 114.1–114.n. Virtual graphical elements can be visual representations of real-world effects, and the parameters, characteristics, and / or attributes of virtual events correspond to the parameters, characteristics, and / or attributes of real-world effects. Examples of real-world effects, to name just a few, include wind flow, scent trails, smoke / fog trails, acoustic direction (e.g., from beamforming), and lighting effects. Examples of parameters, characteristics, and / or attributes of wind flow may include wind speed, wind direction, and wind duration. Examples of parameters, characteristics, and / or attributes of scent or smoke / fog trails may include scent or smoke intensity, initial direction, and duration. Acoustic direction relates to beamforming techniques that control the size, shape, and direction of acoustic waves to direct sound to a specific location. For example, beamforming can allow sound to be directed to a specific location in a venue so that only specific users can hear the sound. Examples of parameters, characteristics, and / or attributes for acoustic direction may include target locations for sound and volume. Examples of parameters, characteristics, and / or attributes for lighting effects may include color, intensity, movement pattern, and target locations (to be illuminated).

[0033] In some embodiments, virtual graphical elements provide visual representations of real-world effects that are normally invisible to the human eye, such as wind, scent, and sound, as described above. For example, a virtual graphical element for wind could depict the trajectory of wind flow (e.g., from a fan) and the interaction of wind with the architecture of the venue in a virtual event. As another example, a virtual graphical element for directional acoustics (e.g., beamforming) could depict the direction of sound from a sound source to an intended target and the interaction of sound with the architecture of the venue. When the parameters, characteristics, and / or attributes of these real-world effects are modified (e.g., by any of the user devices 106.1 to 106.n), the event simulation server 102 and / or user devices 106.1 to 106.n can update the virtual graphical elements to represent the modifications. For example, the updated virtual graphical elements may represent a new direction of wind flow or a new direction or target for directional acoustics.

[0034] In some embodiments, a user can modify the parameters, characteristics, and / or attributes of a virtual effect through an interface provided by user devices 106.1 to 106.n. For example, a user can modify the parameters, characteristics, and / or attributes of a virtual event 112.1 in user device 106.1, such as the wind direction of a fan. Such modifications alter the virtual event 112.1, which displays the modifications as a visual representation via the virtual event view 114.1. For example, the virtual event view 114.1 may display arrows representing the new wind direction and airflow within the venue. User device 106.1 can transmit the modifications to user devices 106.2 to 106.n (e.g., via the event simulation server 102). Upon receiving the modifications, user devices 106.2 to 106.n can update their respective virtual events 112.2 to 112.n based on the modifications. This update includes displaying arrows representing the new wind direction and airflow in their respective virtual event views 114.2 to 114.n. While wind direction is described in this embodiment, the same description applies to other virtual effects (e.g., scent trails, fog / smoke trails, acoustic directions) and any resulting modifications to those effects, as described above for displaying virtual graphical effects to represent virtual effects. In this way, virtual events 112.1 to 112.n can simulate the behavior of real-world effects within a particular venue and display the simulated behavior as virtual graphical elements in virtual event views 114.1 to 114.n.

[0035] In some embodiments, the event simulator server 102 can process virtual graphical elements to simulate real-world effects. For example, the event simulator server 102 can receive modifications to parameters, characteristics, and / or attributes from a user device, simulate the effect of those modifications on a virtual event, generate virtual graphical elements corresponding to the simulated effect, and transmit the virtual graphical elements to other user devices. In some embodiments, user devices 106.1 to 106.n receive modifications from the event simulator server 102 and locally simulate the effect of the modifications.

[0036] In some embodiments, processing of virtual graphical elements may include simulating interactions between two or more virtual graphical elements. For example, a user may modify one or more parameters, characteristics, and / or attributes, such as both the airflow and the smoke machine. A virtual event may be updated based on modifications to the airflow and smoke trajectories, which may include simulating the effects of those modifications. This may further include updating virtual graphical elements in the virtual event view to display the updated simulation, such as lines representing the new smoke trajectories affected by the changes in airflow.

[0037] In the exemplary embodiment shown in Figure 1, user devices 106.1 to 106.n can provide their modifications to the event simulation server 102, causing the event simulation server 102 to provide updated virtual events 112 having these modifications so that the modifications can propagate throughout user devices 106.1 to 106.n. The propagation of modifications throughout user devices 106.1 to 106.n enables real-world users of user devices 106.1 to 106.n to coordinately modify the virtual event 112 in real time or near real time at various locations in the three-dimensional space of the virtual event 112. For example, a first real-world user of the first user device 106.1 can virtually modify first parameters, characteristics, and / or attributes of the virtual event 112 while viewing the first virtual event view 114.1 of the virtual event views 114.1 to 114.n. In this example, the first user device 106.1 provides the event simulation server 102 with modifications to the first parameters, characteristics, and / or attributes in order to update the virtual event 112 to include modifications to the first parameters, characteristics, and / or attributes. In this example, the event simulation server 102 provides the updated virtual event 112 to the user devices 106.1 to 106.n in order to propagate the modifications throughout the user devices 106.1 to 106.n.

[0038] In the exemplary embodiment shown in Figure 1, the event simulation server 102 and user devices 106.1 to 106.n functionally cooperate to provide an interactive environment for interacting with the virtual event 112. In some embodiments, the event simulation server 102 can provide various communication functions, such as audio, video, and / or data communication, to multiple real-world users of user devices 106.1 to 106.n. In these embodiments, the event simulation server 102 can establish one or more communication sessions, such as audio, video, and / or data communication sessions, among multiple real-world users of user devices 106.1 to 106.n, enabling these real-world users to communicate with each other while interacting with the virtual event 112 as described above.

[0039] In some embodiments, communication between user devices 106.1 to 106.n may be associated with virtual graphical elements displayed in the corresponding virtual event views 114.1 to 114.n. For example, a user of user device 106.1 may interact with virtual graphical elements in virtual event view 114.1. Examples of such interactions include selecting, annotating, or modifying the virtual graphical elements. The user may wish to coordinate with another user of user device 106.2 in their interaction with the virtual graphical elements. User device 106.1 can initiate communication with user device 106.2, which may include modifying virtual event view 114.2 to view the virtual graphical elements. For example, user device 106.1 can send a command to user device 106.2 to move the virtual user's location so that the virtual graphical elements are displayed in virtual event view 114.2. As another example, user device 106.1 can transmit text-based communication to user device 106.2 that includes images of interactions with the virtual graphical elements.

[0040] The remote event source 108 can provide events to the event simulation server 102 via the communication network 110 as described above. In some embodiments, the remote event source 108 may include a remote vault for storing digital representations of events, for example, a remote vault associated with one or more owners of the digital representations of events. In some embodiments, the remote event source 108 may live stream the digital representations of events to the event simulation server 102 via the communication network 110. For example, when an event is being performed at another real-world venue, the remote event source 108 may provide the remote event source 108 with digital representations of events such as, to give some examples, one or more computer-generated digital representations of a music event, one or more computer-generated digital representations of a theatrical event, one or more computer-generated digital representations of a sporting event, and / or a film event.

[0041] The communication network 110 may include a wireless communication network, a wired communication network, and / or any combination thereof, as would be obvious to those skilled in the art without departing from the spirit and scope of this disclosure, in order to connect the event simulation server 102, user devices 106.1 to 106.n, and / or one or more remote event sources 108 in a communicative manner. In some embodiments, the wireless communication network may conform to, for example, versions of the Institute of Electrical and Electronics Engineers (IEEE) 802.11 communication standard, such as 802.11a, 802.11b / g / n, 802.11h, and / or 802.11ac, collectively known as Wi-Fi, versions of the Bluetooth® communication standard, and / or any other wireless communication standard or protocol, as would be obvious to those skilled in the art without departing from the spirit and scope of this disclosure. In some embodiments, the wired communication network may conform to versions of the IEEE 802.10 communication standard or protocol, also known as Ethernet, such as 50G Ethernet®, 100G Ethernet®, 200G Ethernet®, and / or 400G Ethernet®, and / or any other wired communication standard or protocol that would be apparent to those skilled in the art without departing from the spirit and scope of this disclosure.

[0042] Exemplary operation of an exemplary event simulation system

[0043] Figure 2 shows a flowchart of an exemplary event simulation according to several exemplary embodiments of the present disclosure. The present disclosure is not limited to this description of operation. Rather, it will be apparent to those skilled in the art that other operation control flows are within the scope and spirit of the present disclosure. The following description describes an exemplary operation control flow 200 that enables multiple real-world users to interact in coordination with a virtual event having a digital representation of an event mapped to a virtual model of a real-world venue. The operation control flow 200 described in more detail below may be executed by one or more computer systems, such as the event simulation server 102 and / or user devices 106.1 to 106.n described above in Figure 1.

[0044] In operation 202, the operation control flow 200 generates a virtual event by mapping a digital representation of an event to a virtual model. The digital representation of the event is substantially the same as the digital representation of the event described above in Figure 1. The virtual model in operation 202 may be one embodiment of the virtual model described above in Figure 1. In some embodiments, the operation control flow 200 may retrieve and / or generate a digital representation of the virtual model and / or event, including updating the virtual model based on any modifications to the parameters, characteristics, and / or attributes associated with the virtual event. In these embodiments, the operation control flow 200 may generate a virtual event in substantially the same manner as described above in Figure 1 by mapping a digital representation of an event, including parameters, characteristics, and / or attributes associated with any real-world effect, to the virtual model.

[0045] In operation 204, the operation control flow 200 generates a virtual event view at the three-dimensional spatial location of the virtual event from operation 202. The three-dimensional spatial location may correspond to the physical location of the venue, and therefore the virtual event view at that location corresponds to the real-world view at the corresponding physical location in the venue. In the exemplary embodiment shown in Figure 1, the operation control flow 200 can process the virtual event from operation 202 as the virtual event from operation 202 is being played back, and provide a virtual event view event at that location in substantially the same manner as described above in Figure 1. In some embodiments, the generated virtual event view may also be based on parameters, characteristics, and / or attributes established or modified by user devices 106.1 to 106.n. For example, the visual graphic elements of the generated virtual event view may represent the simulated behavior of one or more parameters, characteristics, and / or attributes associated with the virtual event.

[0046] In operation 206, the operation control flow 200 can receive interactions from user devices 106.1-106.n in the form of user input and represent these interactions in a virtual event view from operation 204. The operation control flow 200 can replay virtual events from operation 202 to virtually simulate events being performed in a real-world venue. The operation control flow 200 can receive user input from user devices 106.1-106.n while the virtual event view from operation 204 is being viewed (for example, on the displays of user devices 106.1-106.n). In some embodiments, this user input may include instructions (for example, from the input devices of user devices 106.1-106.n) to virtually move a virtual user around the three-dimensional space of the virtual events from operation 202 and view a digital representation of the event at one or more locations in the three-dimensional space of the virtual events from operation 202. In some embodiments, this interaction may include virtually modifying one or more parameters, characteristics, and / or attributes of a virtual event from operation 202 when the virtual event view from operation 204 is viewed in substantially the same manner as described above in Figure 1. One or more parameters, characteristics, and / or attributes of operation 206 are substantially the same as and represent one or more embodiments of the one or more parameters, characteristics, and / or attributes described above in Figure 1. In some embodiments, the operation control flow 200 may update the virtual event from operation 202 to reflect modifications to one or more parameters, characteristics, and / or attributes of the virtual event from operation 202. For example, the operation control flow 200 may update one or more virtual graphical elements of the virtual event view to reflect any modifications to one or more parameters, characteristics, and / or attributes of the virtual event.In these embodiments, the operation control flow 200 can, for example, distribute updated virtual events across an entire event simulation system, such as an event simulation system 100, to propagate modifications from the entire event simulation system to, for example, multiple user devices of the event simulation system, enabling these multiple user devices to interact in coordination with the virtual events from operation 202. In some embodiments, instead of distributing updated virtual events, the operation control flow may transmit one or more modifications to user devices 106.1 to 106.n. Each user device may then locally update the virtual events based on the received modifications.

[0047] Exemplary virtual events that can be implemented within an exemplary event simulation system

[0048] Figure 3 schematically illustrates an exemplary virtual event that may be implemented within an exemplary event simulation system according to several exemplary embodiments of the present disclosure. In the exemplary embodiments shown in Figure 3, for example, an event simulation server, such as the event simulation server 102 described above in Figure 1, can generate a virtual event 300 by mapping a digital representation of an event onto a virtual model of a real-world venue. In some embodiments, for example, a user device, such as the user devices 106.1 to 106.n described above in Figure 1, can replay the virtual event 300 to virtually simulate an event being performed at a real-world venue. While replaying, the user devices 106.1 to 106.n may interact with the virtual event 300 by pausing the virtual event, moving within the virtual model, or providing user input to provide modifications to one or more parameters, characteristics, and / or attributes. The virtual event 300 may represent an exemplary embodiment of the virtual event 112 described above in Figure 1.

[0049] As shown in Figure 3, a real-world user of a user device can virtually move virtual users 302.1 to 302.a around the three-dimensional space of the virtual event 300 and view the event in various locations. In some embodiments, virtual users 302.1 to 302.a may be depicted within the virtual event 300 using graphical icons and / or shapes, also called graphical avatars. In the exemplary embodiment shown in Figure 3, virtual users 302.1 to 302.a are located in the first location, the second location, and location a, respectively, of the virtual event 300. In the exemplary embodiment shown in Figure 3, the user device can track the first location, second location, and a-th location of virtual users 302.1-302.a, respectively, within the virtual event 300, estimate the gazes 304.1-304.a of virtual users 302.1-302.a at the first location, second location, and a-th location, respectively, estimate the field of view 306.1-306.a of virtual users 302.1-302.a associated with the gazes 304.1-304.a, respectively, and / or match the virtual event views 308.1-308.a to be displayed by the user device to the field of view 306.1-306.a of virtual users 302.1-302.a at the first location, second location, and a-th location, respectively.

[0050] For example, as shown in Figure 3, a first real-world user of a first user device can use the first user device to virtually move virtual user 302.1 to a first location of virtual event 300 around the three-dimensional space of virtual event 300. In this example, the first user device can match the virtual event view 308.1 to the field of view 308.1 of virtual user 302.1 at the first location. In another example, as shown in Figure 3, a second real-world user of a second user device can use the second user device to virtually move second user 302.2 to a second location of virtual event 300 around the three-dimensional space of virtual event 300. In this other example, the second user device can match the virtual event view 308.2 to the field of view 308.2 of virtual user 302.2 at the second location. As a further example, as shown in Figure 3, the a real-world user of the a user device among the user devices can use the a user device to virtually move the a user 302.a to the a location of the virtual event 300 around the three-dimensional space of the virtual event 300. In this further example, the a user device can match the virtual event view 308.a to the field of view 308.a of the virtual user 302.a at the a location. This further example further shows that the fields of view 306.1-306.a of virtual users 302.1-302.a can include other virtual users among virtual users 302.1-302.a. In this situation, the virtual event views 308.1-308.a can similarly include these other virtual users and / or their interactions.

[0051] Exemplary virtual event view that can be generated by an exemplary event simulation system

[0052] Figures 4A and 4B schematically illustrate exemplary virtual event views that may be generated by an exemplary event simulation system according to some exemplary embodiments of the present disclosure. The following description of Figures 4A and 4B describes exemplary virtual event views that may be generated by an event simulation system, such as the event simulation system 100 described above in Figure 1, for example, one or more of the virtual event views 308.1 to 308.a described above in Figure 3. In some embodiments, the virtual event views described below in more detail may be generated by one or more user devices of the event simulation system, such as one or more user devices 106.1 to 106.n described above in Figure 1. The virtual event views shown in Figures 4A and 4B are for illustrative purposes only and are not limiting. Those skilled in the art will recognize that other virtual event views are possible depending on the virtual model and / or events simulated on the virtual model, without departing from the spirit and scope of the present disclosure.

[0053] Figure 4A schematically shows a virtual event view 400 that can include a digital representation of the event, labeled as event 402 in Figure 4A, which can be mapped onto a virtual model 404 of a real-world venue. Figure 4B schematically shows a virtual event view 420 that can include a digital representation of the same or a different event, labeled as event 422 in Figure 4B, which can be mapped onto a virtual model 424 of the same or a different real-world venue. In the exemplary embodiment shown in Figure 4A, event 402 can be virtually simulated as if it were being performed inside the virtual model 404. In the exemplary embodiment shown in Figure 4B, event 422 can be virtually simulated as if it were being performed outside the virtual model 424. As shown in Figures 4A and 4B, the virtual event view 400 and the virtual event view 420 can correspond to the field of view of virtual user 406.1 among virtual users 406.1 to 406.t who are at the corresponding locations in the three-dimensional space of the virtual models 404 and 424, respectively.

[0054] As shown in Figures 4A and 4B, the virtual event views 400 and 420 include a graphical user interface 408 to enable a real-world user associated with the virtual user 406.1 to interact with the virtual event views 400 and 420. In some embodiments, these interactions may include virtually moving the virtual user 406.1 around the three-dimensional space of the virtual event 112 to view a digital representation of the event at various locations within the three-dimensional space of the virtual event 112, and / or virtually modifying one or more parameters, characteristics, and / or attributes of the event 402, virtual model 404, event 422, and / or virtual model 424 in substantially the same manner as described above in Figure 1. In some embodiments, the graphical user interface 408 may include a virtual map 410 to graphically show the location of the virtual user 406.1 within the three-dimensional space of the virtual models 404 and / or virtual model 424. In the exemplary embodiments shown in Figures 4A and 4B, the graphical user interface 408 can represent a hierarchical arrangement of interactions that can be performed by a real-world user to interact with the virtual event view 400 and / or virtual event view 420. In some embodiments, the graphical user interface 408 can be overlaid on top of the virtual event view 400 and / or virtual event view 420. In these embodiments, the real-world user can make selections through the hierarchical arrangement of interactions using virtual selection tools, such as virtual pointer 416.1 among the virtual pointers 416.1-416.t associated with the virtual user 406.1 shown in Figures 4A and 4B. In these embodiments, the virtual pointers 416.1-416.t can function in a manner substantially similar to a real-world laser pointer, enabling the virtual user 406.1-406.t to interact with the virtual event view 400 and / or virtual event view 420.

[0055] As shown in Figure 4A, the interaction hierarchy includes one or more broad interaction fields, denoted as menus 412.1 to 412.r. In some embodiments, menus 412.1 to 412.r may include, to name a few, media menus related to events 402 and / or 422, user menus related to virtual users 406.1 to 406.t, environment menus related to virtual models 404 and / or virtual models 424, and settings menus related to virtual event views 400 and / or virtual event views 420. In some embodiments, one or more of the menus 412.1 to 412.r may be extended to include certain interactions associated with these menus, such as the lists 414.1 to 414.s shown in Figure 4A, one or more radio buttons, one or more checkboxes, one or more text boxes, one or more toggle switches, one or more pop-up menus, one or more other menus, and / or any other suitable mechanisms that would be apparent to those skilled in the art without departing from the spirit and scope of this disclosure, enabling a user to interact with virtual models 404 and / or virtual models 424.

[0056] Exemplary interaction with an exemplary virtual event view that can be generated by a user of an exemplary event simulation system.

[0057] Figures 5A and 5B schematically illustrate exemplary interactions with exemplary virtual event views that may be generated by users of exemplary event simulation systems according to some exemplary embodiments of the present disclosure. As stated above, one or more real-world users can virtually interact with virtual events while these real-world users are viewing virtual views of virtual events. For example, one or more real-world users can modify one or more parameters, characteristics, and / or attributes of virtual events, as will be described in more detail below in Figures 5A and 5B. In some embodiments, the interactions described in more detail below may be generated by one or more real-world users operating one or more user devices of the event simulation system, such as one or more user devices 106.1 to 106.n described above in Figure 1. The specific interactions described in more detail below are for illustrative purposes only and are not limiting. Those skilled in the art will recognize that other interactions are possible without departing from the spirit and scope of the present disclosure.

[0058] Figure 5A schematically illustrates an exemplary interaction with the architectural features of a real-world venue within the virtual event view 500. In the exemplary embodiment shown in Figure 5A, the digital representation of an event may be mapped onto a virtual model of the real-world venue to generate a virtual event, which can be processed as described above in Figures 1 and / or 3 to generate the virtual event view 500. As shown in Figure 5A, the virtual event view 500 includes a computer-generated digital model of the architectural features of the real-world venue, which are represented as architectural features 502 in Figure 5A. In some embodiments, the virtual architectural features 502 may represent architectural features of the real-world venue relating to, to name a few, performance areas, media surfaces, seating, and / or standing areas. As will be described in more detail below, for example, a real-world user of a user device of the event simulation system, such as one or more of the user devices 106.1 to 106.n described above in Figure 1, can interact with the virtual event view 500 to modify one or more parameters, characteristics, and / or attributes of the virtual architectural features 502.

[0059] As shown in Figure 5A, a real-world user can use a virtual pointer 504 to highlight, for example, select or highlight a virtual architectural feature 502 from the virtual event view 500. In the exemplary embodiment shown in Figure 5A, the computer-generated digital model of the virtual architectural feature 502 may be stored in a library of architectural features. In some embodiments, the library of architectural features includes architectural features that can be highlighted by a real-world user for modification. In some embodiments, a real-world user can interact with the virtual event view 500 to modify one or more parameters, characteristics, and / or attributes of the computer-generated digital model of the virtual architectural feature 502. These parameters, characteristics, and / or attributes may include, for example, the position and / or orientation of the virtual architectural feature 502 in the three-dimensional space of the virtual event, and / or the physical dimensions of the virtual architectural feature 502 in the three-dimensional space of the virtual event.

[0060] After highlighting the virtual architectural feature 502, a real-world user can use a virtual pointer 504 to interact with the user interface 506 and modify one or more parameters, characteristics, and / or attributes of the computer-generated digital model of the virtual architectural feature 502. In some embodiments, the user interface 506 can represent exemplary embodiments of the user interface 408 described above in Figures 4A and 4B. In the exemplary embodiment shown in Figure 5A, a real-world user can modify one or more parameters, characteristics, and / or attributes of the computer-generated digital model of the virtual architectural feature 502 by selecting through various menus, radio buttons, checkboxes, text boxes, toggle switches, and / or pop-up menus. In some embodiments, a real-world user can display the modification interface 508 together with the virtual architectural feature 502 by selecting through various menus, radio buttons, checkboxes, text boxes, toggle switches, and / or pop-up menus of the user interface 506. As shown in Figure 5A, the modification interface 508 includes virtual axes of a Cartesian coordinate system, and can move and / or rotate the virtual architectural features 502 in the three-dimensional space of the virtual events around these virtual axes.

[0061] Figure 5B schematically illustrates exemplary interactions with virtual objects within the virtual event view 520. In the exemplary embodiment shown in Figure 5B, the digital representation of an event may be mapped onto a virtual model of a real-world venue to generate a virtual event which can be processed as described above in Figures 1 and / or 3 to generate the virtual event view 520. As shown in Figure 5B, the virtual event view 520 includes computer-generated digital models of objects, which are represented as virtual objects 522 in Figure 5B. In some embodiments, virtual objects 522 may represent, to give a few examples, stage objects associated with a real-world venue and / or events and / or objects within a real-world venue associated with stage objects associated with an event. Other examples of virtual objects 522 may include the above-mentioned virtual effects such as visual representations of wind flow, scents, and smoke / fog trails, acoustic direction, and lighting effects. The virtual event view 520 can display any number of virtual objects, including interactions between these virtual objects, such as the influence of the venue's architectural features on wind flow or acoustic direction.

[0062] As will be described in more detail below, for example, a real-world user of a user device of the event simulation system, such as one or more of the user devices 106.1 to 106.n described above in Figure 1, can interact with the virtual event view 520 to insert a virtual object 522 into the three-dimensional space of the virtual event. In the exemplary embodiment shown in Figure 5B, the simulation system can store a library of objects that can be inserted into the virtual event. For example, as shown in Figure 5B, the library of objects may include triangles, cubes, and donuts that can be inserted into the virtual event. In the exemplary embodiment shown in Figure 5A, a real-world user can use a virtual pointer 524 to interact with the user interface 526 to insert a virtual object 522 into the three-dimensional space of the virtual event. In these embodiments, the user can then modify one or more parameters, characteristics, and / or attributes of the virtual object 522 in substantially the same manner as described above in Figure 5A.

[0063] Exemplary cooperation between users of an exemplary event simulation system

[0064] Figure 6 schematically illustrates exemplary coordination between users of an exemplary virtual event view in some exemplary embodiments of the present disclosure. In the exemplary embodiment shown in Figure 6A, an event simulation system, such as the event simulation system 100 described above in Figure 1, can generate a virtual event by mapping a digital representation of an event, labeled as event 602 in Figure 6, onto a virtual model 604 of a real-world venue, in substantially the same manner as described above in Figure 1. The event simulation system can then align the virtual event view 600 with the field of view of virtual user 606.1, one of the virtual users 606.1 to 606.t, who is located at a corresponding location in the three-dimensional space of the virtual event, in substantially the same manner as described above in Figure 3.

[0065] In the exemplary embodiment shown in Figure 6, the event simulation system allows real-world users associated with virtual users 606.1 to 606.t to interact with each other while viewing the virtual events at their corresponding locations in the three-dimensional space of the virtual events. As shown in Figure 6, a first user associated with the first virtual user 606.1 among the virtual users 606.1 to 606.t can interact with the virtual event view 600 to include, for example, a virtual mark 608.1 among the virtual marks 608.1 to 608.t within the virtual event. In some embodiments, virtual marks 608.1 to 608.t can be inserted into the virtual event by a real-world user and may include, to give some examples, one or more freeform lines, one or more shapes, and / or text. In some embodiments, one or more of the virtual marks 608.1 to 608.t may be dynamically generated to represent a simulation of a virtual effect, so that the user can see the simulated behavior of the real-world effect. For example, the event simulation server 102 or a user device may generate one or more virtual marks 608.1 to 608.t to represent simulated wind flow as it traverses the venue. In this example, one or more virtual marks 608.1 to 608.t may be lines displayed in the virtual event view 600, and the lines represent the wind trails of fans within the venue. The virtual event view 600 may display lines that curve or flow around the venue, representing the interaction between the wind trails and any architectural features of the venue (e.g., walls, sheets, surfaces). Thus, the lines may be a visual representation of simulated wind trails within the venue. Virtual marks 608.1 to 608.t may be implemented as arbitrary visual marks within the virtual event view 600 to represent real-world effects or simulated behavior of objects. In the exemplary embodiment shown in Figure 6, a real-world user can interact with the user interface 612 using virtual pointer 610.1 of virtual pointers 610.1 to 610.t to insert a virtual mark 608.1 into a virtual event.In some embodiments, the user interface 612 may represent an exemplary embodiment of the user interface 408 described above, as shown in Figures 4A and 4B.

[0066] In the exemplary embodiment shown in Figure 6, the virtual event view 600 may further include other virtual users among virtual users 606.1 to 606.t, other virtual marks among virtual marks 608.1 to 608.t, and / or other virtual pointers among virtual pointers 610.1 to 610.t. In some embodiments, the event simulation system may overlay a virtual grid 614 on the virtual event to allow real-world users to easily identify the location of other interactions by other real-world users in the three-dimensional space of the virtual event. In some embodiments, these other real-world users, other virtual marks, and / or other virtual pointers may be within the field of view of virtual user 606.1 at their corresponding locations in the three-dimensional space of the virtual event. In these embodiments, this allows real-world users to see interactions by other real-world users when these interactions are within the field of view of their corresponding virtual users 606.1 to 606.t at their corresponding locations in the three-dimensional space of the virtual event. Thus, real-world users can coordinate with each other in real time or near real time to interact with the virtual event in a coordinated manner. For example, as shown in Figure 6, virtual user 606.2 among virtual users 606.1 to 606.t, virtual mark 608.2 among virtual marks 608.1 to 608.t, and / or virtual pointers 610.2 and 610.t among virtual pointers 610.1 to 610.t can exist within the field of view of virtual user 606.1, which is located at its corresponding location in the three-dimensional space of the virtual event. In this example, virtual user 606.2, virtual mark 608.2, and / or virtual pointers 610.2 and 610.t can be seen by a real-world user when this real-world user is viewing the virtual event view 600.

[0067] Exemplary event simulation server that can be implemented within an exemplary event simulation system

[0068] Figure 7 schematically illustrates an exemplary event simulation server that may be implemented within an exemplary event simulation system according to some exemplary embodiments of the present disclosure. In the exemplary embodiment shown in Figure 7, the event simulation server 700 can map events onto a virtual model of a real-world venue to generate virtual events such as the virtual events 112.1 to 112.n described above in Figure 1. As will be described in more detail below, the event simulation server 700 can update the virtual events in response to interactions received from user devices, such as the user devices 106.1 to 106.n described above in Figure 1, for example. The event simulation server 700 can then provide the updated virtual events to the user devices to propagate these interactions among the user devices. As shown in Figure 7, the event simulation server 700 may include an environment simulation server 702 that is communicatively coupled to an experience simulation server 704. In some embodiments, the event simulation server 102 and / or the experience simulation server 704 may include one or more computing devices, such as one or more desktop computers, one or more rack-mount computers, one or more computer hardware servers, and / or any other computing devices having one or more processors, to name a few examples, which would be recognized by those skilled in the art without departing from the spirit and scope of this disclosure. The event simulation server 700 may represent an exemplary embodiment of the event simulation server 102 described above in Figure 1.

[0069] In the exemplary embodiment shown in Figure 7, the environment simulation server 702 can map events onto a virtual model of a real-world venue to generate virtual events such as the virtual event 112 described above in Figure 1. As shown in Figure 7, the environment simulation server 702 includes and / or can run a venue modeling module 706, an event modeling module 708, a virtual event organization module 710, and / or a virtual event simulation module 712. In this specification, references to “module” should be understood to include, to some examples, at least one of software, firmware, hardware, and / or any combination thereof, such as one or more circuits, microchips, and / or electronic devices.

[0070] The venue modeling module 706 can retrieve and / or generate a virtual model of a real-world venue. The virtual model represents a computer-generated digital model of the real-world venue in three-dimensional space. In some embodiments, the real-world venue can represent a music venue, e.g., a music theater, a music club, and / or a concert hall; a sports venue, e.g., an arena, a convention center, and / or a stadium; and / or any other suitable venue that would be apparent to those skilled in the art without departing from the spirit and scope of this disclosure. In these embodiments, the virtual model can represent a computer-generated digital model of a music theater, a sports venue, and / or other suitable venue in three-dimensional space. In some embodiments, the virtual model may include one or more computer-generated digital models of various architectural features of the real-world venue in three-dimensional space, such as performance areas, media surfaces, seating, and / or standing areas, to name a few.

[0071] In the exemplary embodiment shown in Figure 7, the venue modeling module 706 can modify the virtual model in response to interactions provided by real-world users. In some embodiments, real-world users can modify one or more parameters, characteristics, and / or attributes of the virtual model as these real-world users view the virtual event in substantially the same manner as described above in Figure 1. In these embodiments, the venue modeling module 706 can similarly modify the virtual model to include these modifications. For example, real-world users can modify one or more parameters, characteristics, and / or attributes of various architectural features within the virtual event, to name a few, such as performance areas, media surfaces, seating, and / or standing areas. In this example, the venue modeling module 706 can similarly modify the virtual model in response to modifications of one or more parameters, characteristics, and / or attributes of various architectural features by real-world users.

[0072] The event modeling module 708 can retrieve and / or generate a digital representation of an event. In some embodiments, the event may include, to some examples, a music event, a theatrical event, a sporting event, and / or a film event. In the exemplary embodiment shown in Figure 7, the event modeling module 708 can modify the digital representation of the event in response to interactions provided by real-world users. In some embodiments, real-world users may modify one or more parameters, characteristics, and / or attributes of the digital representation of the event as these real-world users view the virtual event in substantially the same manner as described above in Figure 1. In these embodiments, the event modeling module 708 can similarly modify the digital representation of the event to include these modifications. For example, a real-world user may modify one or more parameters, characteristics, and / or attributes of one or more performers and / or one or more theatrical props, also called props, associated with the event within the virtual event. In this example, the event modeling module 708 can similarly modify the digital representation of the event in response to modifications made by the real-world user to one or more parameters, characteristics, and / or attributes of one or more performers and / or one or more props.

[0073] The virtual event organization module 710 can search for and / or generate a variety of virtual effects to be included within a virtual event, including, to give a few examples, those related to the senses of the human body such as sight, smell, touch, taste, and / or hearing. These various virtual effects may include audio, visual, and / or sensory effects to be inserted into the virtual event. In some embodiments, these various virtual effects may relate to, to give a few examples, lighting options available in the real-world venue, colors present in the real-world venue, different materials in the real-world venue, the external environment of the real-world venue such as seating, screens, trees, buildings, roads, sky, lighting, and / or sun effects, as well as / or other real-world audiences in the real-world venue. In some embodiments, auditory effects may include, to give a few examples, realistic confirmation effects, realistic recall effects, symbolic recall effects, customary effects, impressionistic effects, and / or music as an effect. In some embodiments, visual effects may include, to give a few examples, special effects, motion capture, matte painting, animation, 3D modeling, rigging, rotoscoping, matchmove, and / or compositing. In some embodiments, sensory effects can include a variety of effects related to the senses that the human body can experience, such as temperature, touch, and / or smell, to name a few. In some embodiments, the virtual event structuring module 710 can simulate these virtual effects by inserting computer-generated digital models of these virtual effects, as well as various electrical, mechanical, and / or electromechanical devices, into the virtual event. For example, the virtual event structuring module 710 can insert computer-generated digital models of lighting systems, fogging machines, smoke machines, blowers, robots or animatronics, platforms such as a movable platform for performers, and / or 4D effect pods into the virtual event.Exemplary four-dimensional effect pods are described in U.S. Patent Application No. 16 / 997,511, filed August 19, 2020, U.S. Patent Application No. 16 / 997,518, filed August 19, 2020, and U.S. Patent Application No. 17 / 150,794, filed January 15, 2021, each of which is incorporated herein by reference in whole.

[0074] In some embodiments, real-world users can simulate these virtual effects by inserting sensory effects and / or modifying one or more parameters, characteristics, and / or attributes of computer-generated digital models of various electrical, mechanical, and / or electromechanical devices, while these real-world users are viewing the virtual event in substantially the same manner as described above in Figure 1. In these embodiments, the venue modeling module 706 can similarly modify the sensory effects and / or computer-generated digital models of various electrical, mechanical, and / or electromechanical devices to include these modifications. For example, within the virtual event, real-world users can modify one or more parameters, characteristics, and / or attributes of computer-generated digital models of various electrical, mechanical, and / or electromechanical devices, such as lighting systems, fogging machines, blowers, robots or animatronics, platforms, and / or 4D effect pods, to name a few. In this example, the venue modeling module 706 can similarly modify computer-generated digital models of various electrical, mechanical, and / or electromechanical devices in response to modifications of one or more parameters, characteristics, and / or attributes of computer-generated digital models of various electrical, mechanical, and / or electromechanical devices by real-world users.

[0075] The virtual event simulation module 712 can generate virtual events by mapping digital representations of events from the event modeling module 708 onto virtual models from the venue modeling module 706. In some embodiments, the virtual event represents a virtual performance of an event in a real-world venue using the virtual model. For example, the event may include, to name a few, a music event, a theatrical event, a sporting event, and / or a film event. In this example, the virtual event simulation module 712 can generate a virtual event by mapping a music event, a theatrical event, a sporting event, and / or a film onto the virtual model. Thus, the virtual event represents a virtual performance of a music event, a theatrical event, a sporting event, and / or a film in a real-world venue using the virtual model. In some embodiments, the virtual event simulation module 712 can simulate these virtual effects within the virtual event by inserting sensory effects from the virtual event organization module 710, as well as computer-generated digital models of various electrical, mechanical, and / or electromechanical devices, into the virtual event.

[0076] In the exemplary embodiment shown in Figure 7, the experience simulation server 704 represents a gateway between the environment simulation server 702 and user devices communicably coupled to the experience simulation server 704, enabling multiple users to interact with virtual events in a coordinated manner in functional coordination with the user devices. As shown in Figure 7, the experience simulation server 704 includes and / or can include a gateway module 714 and a communication module 716. The gateway module 714 authenticates and / or authorizes real-world users to interact with virtual events. In some embodiments, this authentication and / or authorization may be as simple as providing a username and / or password, to name a few examples, but more complex authentication and / or authorization, such as biometric authentication including retinal, facial, and / or voice verification, to name a few examples, is possible as will be recognized by those skilled in the art without departing from the spirit and scope of this disclosure. In some embodiments, the gateway module 714 may assign different levels of authorization, also known as priority levels, to real-world users of user devices. In these embodiments, the priority level can range from the lowest priority level, which only allows the assigned user to virtually move around the virtual event, to the highest priority level, which allows the assigned user to fully interact with the virtual event as described above. As an example, the experience simulation server 704 may assign the general public to the lowest priority level in order to allow the general public to view the virtual event at different locations within the three-dimensional space of the virtual event. In this example, this allows the general public to view the virtual event using a user device without being able to modify the virtual event, for example, to preview the event at different locations in a real-world venue before purchasing tickets to attend the event at a real-world venue.

[0077] The communication module 716 and the user device functionally cooperate to provide an interactive environment for interacting with virtual events. In some embodiments, the communication module 716 can provide various communication functions, such as audio, video, and / or data communication, to multiple real-world users of the user device. In these embodiments, the communication module 716 can establish one or more communication sessions, such as audio, video, and / or data communication sessions, among multiple real-world users of the user device, enabling these real-world users to communicate with each other while interacting with virtual events as described above. For example, the communication module 716 can establish voice calls, video calls, and / or data text messaging among multiple real-world users of the user device, enabling these real-world users to communicate with each other while interacting with virtual events as described above. In some embodiments, one or more communication sessions may include synchronous audio and / or video conferencing sessions among multiple users, enabling these users to communicate with each other in real time or near real time while interacting with virtual events. In these embodiments, synchronous audio and / or video conferencing sessions may be implemented according to, to name a few, the Internet Relay Chat (IRC) conferencing protocol, the Synchronous Conferencing Protocol (PSYC), the Secure Internet Live Conferencing (SILC) protocol, the Extensible Messaging and Presence Protocol (XMPP), and / or the Session Initiation Protocol for Instant Messaging and Presence Leverage (SIMPLE). In some embodiments, one or more communication sessions may include asynchronous audio and / or video conferencing sessions between multiple users, allowing these users to communicate with each other with a delay while interacting with a virtual event.In these embodiments, asynchronous audio and / or video conferencing sessions may include, to name a few, electronic bulletin boards, electronic messages (email), online forums and / or surveys, social networking sites, and / or shared calendars.

[0078] Exemplary event user device that can be implemented within an exemplary event simulation system

[0079] Figure 8A schematically shows an exemplary user device that may be implemented in an exemplary event simulation system according to some exemplary embodiments of the present disclosure. In the exemplary embodiment shown in Figure 8, the user device 800 can simulate an event being performed in a real-world venue by playing back a digital representation of an event mapped onto a virtual model of a real-world venue. When a real-world user of the user device 800 is viewing this virtual event on the user device 800, the real-world user can use the user device 800 to virtually interact with the virtual event, for example, by moving around the virtual event to view it in different locations and / or modify the parameters, characteristics, and / or attributes of the virtual event.

[0080] In some embodiments, the user device 800 may be implemented as a standalone or individual device, and / or, to give some examples, may be incorporated into or coupled to one or more computing devices, such as one or more desktop computers, one or more mobile phones, one or more mobile computing devices, one or more mobile internet devices such as tablet computers and / or laptop computers, one or more mobile video game consoles, one or more mobile wearable electronic devices such as smartwatches, and / or any other computing devices having one or more processors that would be recognized by those skilled in the art without departing from the spirit and scope of this disclosure. In some embodiments, the user device 800 may represent one or more exemplary embodiments of the user devices 106.1 to 106.n described above in Figure 1. As shown in Figure 8, the user device 800 may include a user simulation module 810, an interaction module 812, and a venue manipulator module 814.

[0081] The user simulation module 810 can process virtual events to generate a virtual event view corresponding to the location of a virtual user associated with a real-world user within the virtual event. In some embodiments, the user simulation module 810 can process virtual events to generate a virtual event view for performance in a virtual reality (VR) environment. In these embodiments, the virtual event view displayed by the user device 800 represents an immersive virtual world of the virtual event view. This virtual world effectively immerses the real-world user within the virtual event, giving the real-world user the impression that they have entered the virtual event. In some embodiments, when the real-world user moves, such as by changing their location within the virtual event, and / or moves a part of their body in the real world, for example, by moving their head up and down or left and right, the user device 800 can update the virtual event view to effectively immerse the real-world user within the virtual event. In some embodiments, the user simulation module 810 can process virtual events and generate a virtual event view in substantially the same manner as described above in Figure 3. In these embodiments, this process may include tracking the three-dimensional position of a virtual user in the three-dimensional space of a virtual event, estimating the virtual user's line of sight at the three-dimensional position, estimating the virtual user's field of view associated with the line of sight, and / or matching the virtual event view 808 to the virtual user's field of view at the three-dimensional position.

[0082] The interaction module 812 functionally coordinates with an event simulation server, such as the event simulation server 102 described above in Figure 1, to provide an interactive environment for interacting with virtual events. In some embodiments, the interaction module 812 can provide the user device 800 with various communication functions, such as audio, video, and / or data communication. In these embodiments, the interaction module 812 can request that one or more communication sessions, such as audio, video, and / or data communication sessions, be established between other user devices in an event simulation system, such as the event simulation system 100 described above in Figure 1, enabling real-world users of these user devices to communicate with each other while interacting with virtual events in substantially the same manner as described above in Figure 1. For example, the interaction module 812 can request that voice calls, video calls, and / or text messaging be established by the event simulation server between multiple real-world users of user devices, enabling these real-world users to communicate with each other while interacting with virtual events in substantially the same manner as described above in Figure 1.

[0083] The venue manipulator module 814 receives interactions between real-world users and virtual events. In some embodiments, the venue manipulator module 814 can insert, for example, overlay, various virtual graphical elements onto the virtual event view to enable real-world users to interact with virtual events. In some embodiments, these virtual graphical elements can outline various interactions available to real-world users, such as modifications. In these embodiments, these virtual graphical elements may include, to give some examples, one or more radio buttons, one or more checkboxes, one or more text boxes, one or more toggle switches, one or more pop-up menus, one or more lists, and / or any other suitable mechanisms that enable real-world users to interact. In some embodiments, the venue manipulator module 814 can insert, for example, virtual selection tools onto the virtual event view, such as those described above in Figures 4A to 6, to enable real-world users to interact with virtual events. In some embodiments, the interaction module 812 can control the behavior of the virtual graphical elements and / or virtual selection tools. In these embodiments, the interaction module 812 can receive a variety of commands, such as "point and click" and / or "drag and drop," to name a few.

[0084] Figure 8B schematically illustrates different implementations of user device 800 according to some exemplary embodiments of the present disclosure. For example, user device 800 may be implemented as user devices 800A-C, each capable of providing its own virtual event viewer 808A-C. User device 800A may be a mobile computer including a physical keyboard, such as a laptop; user device 800B may be a virtual reality (VR) device including a viewer 802; and user device 800C may be a mobile device without a physical keyboard, such as a smartphone. The number and types of user devices depicted in Figure 8B are purely illustrative. Any number and types of user devices consistent with the present disclosure may be implemented. Any combination of user devices 800A-C may be implemented as part of a collaborative function for executing and modifying virtual events.

[0085] In the exemplary embodiment shown in Figure 8B, user devices 800A-C generate virtual event views 808A-C based on a virtual event, for example, a virtual event 112. Each of the user devices 800A-800C may be configured to generate and display its own virtual event view 808A-C, each virtual event view representing a different perspective of the virtual event based on the virtual location of the virtual user associated with the user device 800A-800C. For example, the virtual event view 808A of user device 800A may depict a perspective of the virtual event from a specific location in the virtual world, and similarly, the virtual event views 808B-C of user devices 800B-C may depict a perspective of the virtual event from another location in the same virtual world.

[0086] In some embodiments, user devices 800A-C process virtual events by representing interactions with the virtual event view 808, for example, by moving around the virtual event to view it in various locations and / or modifying the parameters, characteristics, and / or attributes of the virtual event. Different interactions may be available through a graphical user interface within the virtual event view of the virtual event, based on the type of user device. For example, user device 800A may include physical interface devices such as a keyboard and mouse. The virtual event view 808A may be customized to include interactions that are more easily entered via such physical interface devices. Examples of such interactions for user device 800A include modifying code segments of the virtual event or any modifications to parameters, characteristics, and / or attributes that require text input. As another example, the virtual event view 808B may be customized to accommodate a VR implementation of user device 800B in order to include interactions specific to user controller device 806. As yet another example, the virtual event view 808C may be customized to accommodate the mobility of user device 800C. An example of such interaction for user device 800C is to provide an augmented reality (AR) based interaction. For example, user device 800C may be physically located within the venue where the event is to take place, while user devices 800A and / or user devices 800B may be physically located away from the venue. A virtual event view 808C can combine a real-time view of the venue with a virtual event in an augmented reality format. For example, virtual graphical elements of the virtual event view 808C may be displayed as an overlay on real-world elements of the venue.

[0087] User device 800B can present a virtual event view 808B. In some embodiments, viewer 802 represents a virtual reality (VR) headset for presenting the virtual event view 808B in a virtual reality (VR) environment. In these embodiments, viewer 802 presents the immersive virtual world of the virtual event view 808B to the real-world user, effectively immersing the real-world user in the virtual event. In some embodiments, viewer 802 may be implemented as a standalone device. In some embodiments, viewer 802 may be implemented as a tethering device communicatively coupled to another device, such as user device 800A.

[0088] The user controller device 806 represents an input device used by a real-world user to interact with virtual events when using the user device 800B. In some embodiments, the user controller device 806 may include one or more action buttons and / or one or more omnidirectional control sticks or buttons that can be operated by a real-world user to interact with virtual events. In some embodiments, a real-world user may use one or more action buttons and / or one or more omnidirectional control sticks or buttons to perform various actions within the virtual world. For example, a real-world user may use one or more action buttons and / or one or more omnidirectional control sticks to "point and click" and / or "drag and drop" one or more computer-generated digital models of various architectural features of a real-world venue in three-dimensional space, such as performance areas, media surfaces, seating, and / or standing areas, and / or one or more computer-generated digital models of various objects in a real-world venue in three-dimensional space, such as stage objects associated with the real-world venue and / or stage objects associated with events, to give some examples.

[0089] Exemplary computer systems that can be used to implement electronic devices within an exemplary venue.

[0090] Figure 9 schematically shows a simplified block diagram of a computer system suitable for use in the embodiments described herein, according to some exemplary embodiments of the present disclosure. Various electronic devices, such as the event simulation server 102 described above in Figure 1, the environment simulation server 702 and / or experience simulation server 704 described above in Figure 7, and / or the user device 800 described above in Figure 8A, can be implemented in hardware, firmware, software, or any combination thereof. The following description of Figure 9 describes an exemplary computer system 910 that may be used with these electronic devices.

[0091] In the exemplary embodiment shown in Figure 9, the computer system 910 typically includes at least one processor 914 that communicates with several peripheral devices via a bus subsystem 912. Typically, at least one processor 914 may include, or be, a microprocessor, a graphics processing unit, or a digital signal processor, and their electronic processing equivalents, such as an application-specific integrated circuit ("ASIC") or a field-programmable gate array ("FPGA"). As used herein, the term “processor” typically means a tangible data and information processing device that physically transforms data and information using sequence transformations (also called “operations”). Data and information may be physically represented by electrical, magnetic, optical, or acoustic signals that can be stored, accessed, transferred, combined, compared, or otherwise manipulated by the processor. The term “processor” may mean a single processor and a multi-core system or multi-processor array, including a graphics processing unit, a digital signal processor, a digital processor, or a combination of these elements. A processor may be electronic, including, for example, digital logic circuits (e.g., binary logic) or analog (e.g., operational amplifiers). Processors can also operate to support the execution of related operations within a “cloud computing” environment or as “Software as a Service” (SaaS). For example, at least some of the operations may be performed by a group of processors available in a distributed or remote system, which are accessible via a communication network (e.g., the Internet) and one or more software interfaces (e.g., Application Programming Interfaces (APIs)).

[0092] Computer systems typically include operating systems such as Microsoft's Windows®, Sun Microsystems' Solaris®, Apple Computer's MacOs, Linux®, or UNIX®. Computer systems may also typically include a Basic Input / Output System (BIOS) and processor firmware. The operating system, BIOS, and firmware are used by the processor to control the subsystems and interfaces coupled to it. Typical processors compatible with these operating systems include Intel's Pentium® and Itanium, Advanced Micro Devices' Opteron and Athlon, and ARM Holdings' ARM processors.

[0093] As shown in Figure 9, these peripheral devices may include a storage subsystem 924 comprising a memory subsystem 926 and a file storage subsystem 928, a user interface input device 922, a user interface output device 920, and a network interface subsystem 916. The input and output devices enable user interaction with the computer system 910. In the exemplary embodiment shown in Figure 9, the network interface subsystem 916 provides an interface to an external network, including an interface to a communication network 918, which is coupled to a corresponding interface device in another computer system or machine via the communication network 918. The communication network 918 may comprise many interconnected computer systems, machines, and communication links. These communication links may be wired links, optical links, wireless links, or any other devices for the transmission of information. The communication network 918 may be any suitable computer network, e.g., a wide area network such as the Internet® and / or a local area network such as Ethernet®. The communication network 918 may be wired and / or wireless, and the communication network may use encryption and decryption methods such as those available in a virtual private network. A communication network uses one or more communication interfaces that can receive data from other systems and transmit data to other systems. Embodiments of communication interfaces typically include Ethernet® cards, modems (e.g., telephone, satellite, cable, or ISDN), (asynchronous) digital subscriber line (DSL) units, Firewire® interfaces, USB interfaces, etc. One or more communication protocols may be used, such as HTTP, TCP / IP, RTP / RTSP, IPX, and / or UDP.

[0094] The user interface input device 922 may include pointing devices such as alphanumeric keyboards, keypads, mice, trackballs, touchpads, styluses, or graphics tablets; audio input devices such as scanners, touchscreens integrated into displays, speech recognition systems, or microphones; gaze recognition, electroencephalogram pattern recognition, and other types of input devices. Such devices may be connected to the computer system by wire or wirelessly. In general, the use of the term “input device” is intended to include all possible types of devices and methods for inputting information into the computer system 910 or the communication network 918. The user interface input device 922 typically allows the user to select several types of user interface output devices, such as objects, icons, text, etc., that appear on the display subsystem.

[0095] The user interface output device 920 may include non-visual displays such as a display subsystem, printer, fax machine, or audio output device. The display subsystem may include flat panel devices such as cathode ray tubes (CRTs), liquid crystal displays (LCDs), projection devices, or any other devices for creating visible images such as virtual reality systems. The display subsystem may also provide non-visual displays via audio output or haptic output (e.g., vibration) devices. In general, the use of the term “output device” is intended to include all possible types of devices and methods for outputting information from the computer system 910 to a user or another machine or computer system.

[0096] The memory subsystem 926 typically includes several memories, including main random access memory ("RAM") 930 (or other volatile storage device) for storing instructions and data during program execution, and read-only memory ("ROM") 932 for storing fixed instructions. The file storage subsystem 928 provides persistent storage for program and data files and may include a hard disk drive, a floppy disk drive with associated removable media, a CD-ROM drive, an optical drive, flash memory, or a removable media cartridge. Databases and modules implementing the functionality of a particular embodiment may be stored by the file storage subsystem 928.

[0097] The bus subsystem 912 provides various components of the computer system 910. While the bus subsystem 912 is schematically shown as a single bus, and provides devices for the subsystems to communicate with each other as intended, alternative embodiments of the bus subsystem may use multiple buses. For example, RAM-based main memory can communicate directly with a file storage system using a direct memory access ("DMA") system.

[0098] conclusion For detailed descriptions, please refer to the accompanying figures to illustrate exemplary embodiments consistent with this disclosure. References to “exemplary embodiments” in this disclosure indicate that the described exemplary embodiments may include certain features, structures, or characteristics, but not all exemplary embodiments may necessarily include certain features, structures, or characteristics. Furthermore, such phrases do not necessarily refer to the same exemplary embodiment. In addition, any features, structures, or characteristics described in relation to an exemplary embodiment may be included independently of, or in any combination with, features, structures, or characteristics of other exemplary embodiments, whether expressly described or not.

[0099] The detailed description is not intended to be limiting. Rather, the scope of this disclosure is defined solely in accordance with the following claims and their equivalents. It should be understood that the detailed description section, rather than the abstract section, is intended to be used to interpret the claims. The abstract section may describe one or more exemplary embodiments of this disclosure, but not all of them, and therefore does not limit this disclosure or the following claims and their equivalents in any way.

[0100] The exemplary embodiments described herein are provided for illustrative purposes only and are not limiting. Other exemplary embodiments are possible and may be modified within the spirit and scope of this disclosure. This disclosure is described with the help of functional components that illustrate implementations of specified functions and their relationships. The boundaries of these functional components are arbitrarily defined herein for ease of explanation. Alternative boundaries may be defined as long as the specified functions and their relationships are adequately performed.

[0101] Embodiments of the Disclosure may be implemented in hardware, firmware, software applications, or any combination thereof. Embodiments of the Disclosure may also be implemented as instructions stored in a machine-readable medium that can be read and executed by one or more processors. The machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computing circuit). For example, the machine-readable medium may include non-temporary machine-readable media such as read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, and flash memory devices. As another example, the machine-readable medium may include temporary machine-readable media such as electrically, optically, acoustically, or other forms of propagating signals (e.g., carrier waves, infrared signals, digital signals, etc.). Furthermore, firmware, software applications, routines, and instructions may be described herein as performing specific operations. However, such descriptions are merely for convenience, and it should be understood that such operations are actually attributable to computing devices, processors, controllers, or other devices that perform the firmware, software applications, routines, instructions, etc.

[0102] The detailed description of the exemplary embodiments fully reveals the general nature of this disclosure, which means that others may readily modify and / or adapt such exemplary embodiments to various uses without excessive experimentation and without departing from the spirit and scope of this disclosure, by applying the knowledge of those skilled in the art. Such adaptations and modifications are therefore intended to be within the meaning of the exemplary embodiments and their equivalents based on the teachings and guidance presented herein. It should be understood that the expressions or terms herein are for illustrative purposes only, not limitation, so that they may be interpreted by those skilled in the art in light of the teachings herein.

Claims

1. A computer implementation method for multi-user cooperation within a virtual event, wherein the method is The first user device maps a digital representation of an event onto a virtual model in order to generate the virtual event, wherein the virtual event includes parameters corresponding to the real-world effects of the event, and the virtual model is a representation of a real-world venue. Based on the mapping, a virtual event view of the virtual event for display by the first user device is generated, wherein the virtual event view comprises virtual graphical elements corresponding to the parameters. The first user device receives user input for the first user device to interact with the virtual event, The first user device receives a second user input from the second user device for interacting with the virtual event, The virtual event view is updated based on the user input and the second user input. Computer implementation methods, including those mentioned above.

2. The computer implementation method according to claim 1, wherein the virtual event view corresponds to the location of the virtual event, and the location of the virtual event corresponds to the physical location of the real-world venue.

3. The computer implementation method according to claim 1, further comprising transmitting the user input to the second user device, wherein the user input is configured to update a second virtual event view on the second user device.

4. The computer implementation method according to claim 1, wherein the virtual graphical element is a simulation of the real-world effect in the virtual model, and the parameter corresponding to the real-world effect is associated with one of a blower, a fogging machine, a lighting effect, or an acoustic effect.

5. Updating the aforementioned virtual event view means Modify the virtual graphical elements based on the user input, Display the modified virtual graphical element within the virtual event view. The computer implementation method according to claim 1, further comprising:

6. Generating the aforementioned virtual event view means Within the virtual event, a virtual location associated with the first user device is determined, wherein the virtual location corresponds to a real-world location within the real-world venue. Within the virtual event, the view of the virtual model is determined based on the virtual location, wherein the view of the virtual model corresponds to a real-world view of the real-world location within the real-world venue. Based on the determined view of the virtual model, the virtual event view is determined. The computer implementation method according to claim 1, further comprising:

7. The virtual event includes a second parameter corresponding to the second real-world effect of the event, the second user input includes modifications to the second parameter, and updating the virtual event view is: Modifying the second virtual graphical element based on the modifications to the second parameter, Display the modified second virtual graphical element within the virtual event view. The computer implementation method according to claim 1, further comprising:

8. A user device for multi-user collaboration within a virtual event, wherein the user device is Memory and At least one processor coupled to the memory, To generate the aforementioned virtual event, a digital representation of the event is mapped onto a virtual model, wherein the virtual event includes parameters corresponding to the real-world effects of the event, and the virtual model is a representation of the real-world venue. Based on the mapping, a virtual event view of the virtual event for display by the first user device is generated, wherein the virtual event view comprises virtual graphical elements corresponding to the parameters. Receiving user input for interacting with the aforementioned virtual event, Receiving a second user input from a second user device for interacting with the virtual event, The virtual event view is updated based on the user input and the second user input. A processor configured to perform the following: A user device equipped with the following features.

9. The user device according to claim 8, wherein the virtual event view corresponds to the location of the virtual event, and the location of the virtual event corresponds to the physical location of the real-world venue.

10. The aforementioned processor, The user input is transmitted to the second user device, wherein the user input is configured to update the second virtual event view on the second user device. The user device according to claim 8, configured to perform the following:

11. The user device according to claim 8, wherein the virtual graphical element is a simulation of the real-world effect in the virtual model, and the parameter corresponding to the real-world effect is associated with one of a blower, a fogging machine, a lighting effect, or a sound effect.

12. In updating the virtual event view, the processor: Modify the virtual graphical elements based on the user input, Display the modified virtual graphical element within the virtual event view. The user device according to claim 8, further configured to perform the following:

13. In generating the virtual event view, the processor Within the virtual event, a virtual location associated with the first user device is determined, wherein the virtual location corresponds to a real-world location within the real-world venue. Within the virtual event, the view of the virtual model is determined based on the virtual location, wherein the view of the virtual model corresponds to a real-world view of the real-world location within the real-world venue. Determining the virtual event view based on the determined view of the virtual model. The user device according to claim 8, further configured to perform the following:

14. The virtual event includes a second parameter corresponding to the second real-world effect of the event, the second user input includes a modification to the second parameter, and in updating the virtual event view, the processor: Modifying the second virtual graphical element based on the modifications to the second parameter, Display the modified second virtual graphical element within the virtual event view. The user device according to claim 8, further configured to perform the following:

15. A non-temporary computer-readable medium for storing instructions, wherein the instructions, when executed by a processor on a mobile device for multi-user cooperation within a virtual event, are directed to the processor, The first user device maps a digital representation of an event onto a virtual model in order to generate the virtual event, wherein the virtual event includes parameters corresponding to the real-world effects of the event, and the virtual model is a representation of a real-world venue. Based on the mapping, a virtual event view of the virtual event for display by the first user device is generated, wherein the virtual event view comprises virtual graphical elements corresponding to the parameters. The first user device receives user input for interacting with the virtual event, The first user device receives a second user input from the second user device for interacting with the virtual event, The virtual event view is updated based on the user input and the second user input. A non-temporary computer-readable medium that enables the execution of actions including [specific actions].

16. The non-temporary computer-readable medium according to claim 15, wherein the virtual event view corresponds to the location of the virtual event, and the location of the virtual event corresponds to the physical location of the real-world venue.

17. The aforementioned operation is, The user input is transmitted to the second user device, wherein the user input is configured to update the second virtual event view on the second user device. The non-temporary computer-readable medium according to claim 15, further comprising:

18. The non-temporary computer-readable medium according to claim 16, wherein the virtual graphical elements are simulations of the real-world effects within the virtual model, and the parameters corresponding to the real-world effects are associated with one of a blower, a fogging machine, a lighting effect, or a sound effect.

19. In updating the virtual event view, the operation is as follows: The virtual graphical elements are modified based on the user input, Display the modified virtual graphical element within the virtual event view. The non-temporary computer-readable medium according to claim 15, further comprising:

20. In generating the aforementioned virtual event view, the operation is as follows: Within the virtual event, a virtual location associated with the first user device is determined, wherein the virtual location corresponds to a real-world location within the real-world venue. Within the virtual event, the view of the virtual model is determined based on the virtual location, wherein the view of the virtual model corresponds to a real-world view of the real-world location within the real-world venue. Determining the virtual event view based on the determined view of the virtual model. A non-temporary computer-readable medium according to claim 16, further comprising:

Images