221 results about "Virtual experience" patented technology

A metaverse application receives user input from a user during gameplay of a virtual experience. The metaverse application renders a first game state of gameplay of the virtual experience on a user device based on the user input, wherein the first game state is described by a set of properties. The metaverse application generates a list of changes in properties between the first game state and a second game state, wherein the second game state occurred before the first game state. The metaverse application receives a request from the user to replay the second game state. The metaverse application renders the second game state of gameplay by reversing the list of changes between the first game state and the second game state.

Implementations relate to methods, systems, and computer-readable media to render hair and hair-like features on user devices. In some implementations, the method includes receiving, at a user device that participates in a virtual experience, a hair model for a 3D object, wherein the hair model includes a plurality of curves, hair geometry metadata associated with one or more curves of the plurality of curves, and hair simulation metadata, generating, at the user device, hair geometry for the 3D object based on the hair model, the hair geometry metadata, and a type of the user device, simulating, at the user device, hair for the 3D object based on the hair geometry, the hair simulation metadata, and one or more physics parameters of the virtual experience, and rendering the 3D object with the simulated hair on the user device.

The invention provides a pumping method based on multi-agent reinforcement learning control, and belongs to the technical field of deep reinforcement learning. S2, feature extraction and fusion; s3, time sequence modeling; s4, generating an action; s5, carrying out environment interaction; s6, virtual experience generation; s7, experience pool management; s8, performing network training; and S9, performing closed-loop control. Discrete and continuous actions are controlled through the DQN and the DDPG respectively, collaborative optimization of start-stop and frequency adjustment of the water pump is achieved by combining the Critic network, and the problem that a traditional single agent cannot process a mixed action space is solved.

The invention discloses a virtual experience interaction control method based on a virtual environment and a related device, and the method comprises the steps: loading a corresponding virtual interaction experience scene to a VR head-mounted display device based on a virtual experience game after an experience user wears the VR head-mounted display device and selects the virtual experience game; associating and generating a three-dimensional virtual character at a specified position of the virtual interaction experience scene based on the three-dimensional character model; acquiring a current motion trend based on capturing the current motion trend of the experiencing user; updating the position and the motion trend of the three-dimensional virtual character in the virtual interaction experience scene based on the current motion trend to obtain an updated position and an updated motion trend of the three-dimensional virtual character; and adjusting interactive experience elements in the virtual interactive experience scene based on the updated motion trend, the updated position and the gaze tracking result. In the embodiment of the invention, seamless connection between the virtual environment and the real action is realized, so that the interactive experience is more natural and smoother.

There is provided a configuration entity in a wireless communication network, the configuration entity comprising a receiver, a processor and a transmitter. The receiver is arranged to receive a service requirement for communication of virtual devices within a virtual experience service at the wireless communication network, wherein each virtual device corresponds to a physical device identified by a subscriber identity. The processor is arranged to discover a plurality of candidate digital and physical devices for a given area and based on the received service requirement. The processor is further arranged to derive one or more session requirements from the received service requirement; wherein a session is established between any combination of the plurality of candidate digital and physical devices. The processor is further still arranged to determine a parameter for each session. The transmitter is arranged to transmit the determined parameter to at least one network node.

There is provided an enablement entity for a virtual experience service, the enablement entity in a wireless communication network, the enablement entity comprising a receiver, a processor and a transmitter. The receiver is arranged to receive an application service requirement corresponding to a plurality of devices, the plurality of devices operating in physical space, or in a virtual space of the virtual experience service, or both. The processor is arranged to decompose the application service requirement to a plurality of session requirements, wherein the session requirements apply to a plurality of communication sessions, the communication sessions provided between devices in both physical space and virtual space, and to derive a set of joint quality of service parameters for the plurality of sessions based on the session requirements. The transmitter is arranged to send the set of joint quality of service parameters to one or more network entities in the wireless communication network.

The invention discloses a multifunctional electric power safety emergency experience and evaluation method, system and device and a medium thereof. The method comprises the following steps: acquiring historical electric power safety accident data; and the accident type, severity and occurrence frequency of the historical electric power safety accident data are intelligently classified and sorted based on an artificial intelligence algorithm. An immersive virtual experience scene is constructed by adopting VR, AR or MR technology in combination with AI aided design, a traditional single electric power safety emergency experience mode is changed, the scene has a high sense of reality, participants are personally on the scene, meanwhile, the interactivity of experience is greatly improved through designed interaction elements, interaction links and voice interaction, and the experience experience is improved. Participants can really feel the danger and urgency of electric power safety accidents; the performance in the electric power safety emergency experience process is evaluated in real time through the AI algorithm, the electric power safety emergency capability level of the participant can be reflected more objectively, and a powerful basis is provided for targeted training.

Systems and methods of providing an immersive virtual experience in autonomous vehicles in autonomous (e.g., self-driving) mode are disclosed. A navigation path of an autonomous vehicle is determined, the navigation path including autonomous mode segments and non-autonomous mode segments. Based on at least real-time location data of the vehicle or metadata associated with the navigation path, the vehicle is determined to enter autonomous mode for an autonomous mode segment. Based on determining that the vehicle is entering autonomous mode, a virtual journey view is initiated, causing immersive content to be displayed. A motion simulated accessory is operated based on immersive content data or the current or future motion status of the vehicle. Upon determining that the vehicle will no longer operate in autonomous mode, the transparency of the display is adjusted, causing the presentation of the immersive content to fade away while a real-world environment becomes visible.

Some implementations relate to methods, systems and computer readable media to provide an aerodynamic force model for real-time distributed physics simulation. According to one aspect, a computer-implemented method includes receiving a description of a mechanism that includes physically coupled geometric assemblies within a virtual experience, with each geometric assembly defining a surface mesh. The description includes motion data of the mechanism. The method further includes, for each geometric assembly, identifying exposed surface areas of the surface mesh. The method further includes evaluating an aerodynamic force model based on the exposed surface areas and the motion data of the mechanism, where the aerodynamic force model includes a pressure coefficient that varies based on an angle of attack and based on windward and leeward facing surfaces. The method further includes integrating the aerodynamic force models into a physics simulation to refine the motion data of the mechanism.

The invention relates to a multi-agent collaborative semiconductor batch processing area scheduling method, which integrates adversarial learning and a multi-agent collaborative mechanism, constructs a batch grouping agent and a batch assignment agent, and realizes joint optimization of batch combination and task assignment. A gating circulation unit network is introduced to extract dynamic characteristics in the workshop operation process, and the perception and environment adaptability of a scheduling strategy to time sequence information are enhanced. Real and virtual experience samples are generated through adversarial training for pre-training, training data are expanded, and the strategy convergence speed is improved. An internal correlation structure between relation correction network modeling experiences is further introduced, and experience quality and strategy updating efficiency are improved in combination with a relative entropy optimization mechanism. According to the method, the problem that wafer processing system scheduling is often difficult to meet quick response and efficient scheduling through a traditional reinforcement learning method is solved, the scheduling decision can be quickly and accurately generated, the total production cycle in the wafer manufacturing process is effectively shortened, and the method has high engineering application value.

An AR system for a spectator event involving moving participants in a real space, each participant having a participant field of view of said real space through a screen, said spectator event involving cameras, each camera having a camera field of view of said real space, said AR system comprising: (a) a computer presentation system for generating virtual space corresponding to said real space and a virtual object in said virtual space; (b) a participant display configured to overlay an image of a portion of said virtual space corresponding to said participant field of view of said real space on said field of view of said real space for each participant; and (c) a spectator display configured overlay an image of a portion of said virtual space corresponding to said camera field of view of said real space on said camera field of view of said real space.

Described herein are technologies for generating and providing a virtual experience. The virtual experience includes digital elements that are generated and provided according to settings as well as user feedback and feedback from sensors in an environment that is being represented by the virtual experience. The virtual experience includes a real world image of the environment and virtual objects overlapping the real world image.

The invention discloses a tunnel science popularization element universe system, and relates to a traffic informatization and science popularization digital information technology. A tunnel development display module, a panoramic exhibition hall display module, an activity synchronization module, a rescue channel module, a vehicle inspection module, an unmanned aerial vehicle inspection module, a robot fire extinguishing module, a robot dog inspection module, a token interaction module, a disease evolution module, a fire escape module and a visual induction experience module are integrated. Original abstract tunnel knowledge is converted into visual and vivid virtual experience, in addition, complex tunnel knowledge is dispersed to all the modules, a large amount of complex tunnel knowledge can be presented to a user in an organized mode, and the user can conveniently select tunnel science popularization knowledge needing to be known according to actual needs; and meanwhile, the user can interact with the virtual environment through the interaction equipment corresponding to each module, so that the interestingness of learning is improved while the user knows tunnel knowledge.

Implementations described herein relate to methods, systems, apparatuses, and computerreadable media to generate personalized avatars for a user, based on one or more 2D images of a face. The automatic generation may be facilitated by a generative component deployed at a virtual experience server and that is configured to generate a data structure representing a 3D mesh of the personalized avatar responsive to input of the one or more 2D images. The data structure may be converted to a polygonal mesh, and the polygonal mesh may be automatically fit and rigged onto a head portion of an avatar data model.

A wearable display device for facilitating provisioning of a virtual experience is disclosed. Further, the wearable display device may include a support member configured to be mounted on a user. Further, the wearable display device may include a display device attached to the support member. Further, the wearable display device may include at least one disturbance sensor configured for sensing a disturbance in a spatial relationship between the display device and the user. Further, the wearable display device may include a processing device communicatively coupled with the display device. Further, the processing device may be configured for receiving a display data. Further, the processing device may be configured for analyzing the disturbance in the spatial relationship, and generating a correction data based on the analyzing. Further, the processing device may be configured for generating a corrected display data based on the at least one display data and the correction data.

In a virtual experience system, at least one metric associated with a user experience within a virtual experience is defined, the at least one metric having a plurality of possible values. A resource utilization factor having a plurality of levels corresponding to respective amounts of resource utilization by the virtual experience system is defined. A knob having a plurality of states is defined, each state corresponding to a respective level of the resource utilization factor. A prediction that associates a particular level of the resource utilization factor with a selected value of the at least one metric is generated. The knob is adjusted from a first state to a second state associated with the particular level of the resource utilization factor, based on the prediction.

Implementations described herein relate to methods, systems, and computer-readable media to render virtual objects on a client device. In some implementations, the method includes obtaining a plurality of virtual objects associated with a virtual experience, for each virtual object of the plurality of virtual objects: determining physical connections of the virtual object to one or more other virtual objects in the virtual experience, and determining logical associations of the virtual object to one or more other virtual objects in the virtual experience, forming streaming sets of virtual objects, wherein for streaming sets that include two or more virtual objects, each virtual object within the streaming set has one or more of a physical connection and a logical association with at least one other virtual object in the streaming set, and rendering virtual objects included in one or more streaming sets in the virtual experience on the client device.

Some embodiments relate to methods, systems, and computer-readable media for dynamically changing an avatar body during runtime during which an avatar associated with the avatar body participates in a virtual experience. In some embodiments, the method includes identifying a first avatar body having a first body cage, identifying a target avatar body having a target body cage, and performing interpolation between the first body cage and the target body cage to obtain a second body cage corresponding to a second avatar body, thereby providing a transformation of the first avatar body to the second avatar body. The body of the avatar can also be changed in the configuration environment. Altering the avatar body may involve interpolating between the body cages of the pair of cages, or by directly manipulating the body cages of the avatar body.

A user prompt, such as a user prompt received by a client device and sent to an online game system, is provided into a trained large language model. The large language model identifies keywords corresponding to the user prompt. These keywords may be provided to a search engine that identifies corresponding object(s) to place in a virtual experience. The large language model further processes the user prompt to determine spatial placement information for the objects and places the objects accordingly. Subsequently, the system may iteratively receive more prompts and update the virtual experience based on the additional prompts. The placement may be facilitated using macros. The prompts may also affect other attributes of the objects. The knowledge built-into the LLM allows it to suggest which objects are relevant and what quantity and arrangements of these objects is consistent with a scene requested in the user prompt.

According to one aspect, a method of audio-signal processing of a network device is described. The method may include obtaining an audio portion associated with a sound field of an avatar at an initial position in a virtual experience. The method may include identifying at least one interpolation region associated with the avatar at the initial position or associated with the avatar at one or more subsequent positions. The method may include sampling an audio mix for a plurality of points of the at least one interpolation region based on the audio portion associated with the sound field of the avatar at the initial position or associated with the sound field of the avatar at the one or more subsequent positions. The method may include transmitting an audio packet associated with the audio mix to a client device.

Disclosed are example embodiments of systems and methods that facilitate a unique customer experience in which consumers may virtually try-on of articles of clothing at any online store. The system and methods deliver an easy-to-use experience as a graphical overlay on top of an existing retailer's or brand's online presence, either via mobile or desktop. The e-commerce technology provides a framework for integrating a user interface widget that modifies the user experience of existing retailer e-commerce websites without requiring additional companion software. The widget communicates with any retailer's infrastructure and enables consumers to add articles into the retailer's shopping cart directly using the unique widget. A myriad features personalize and elevate customer experiences. An example method of virtual try-on of articles of clothing includes selecting a garment from a retailer's e-commerce website, loading a photo of a source model wearing the selected garment, and creating different combinations from of different garments for viewing.

A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may provide immersive VR experiences by replacing the view of the real world with virtual environments. Active vehicle systems and / or vehicle control systems may be integrated with the VR system to provide physical effects with the virtual experiences. The virtual environments may be altered to accommodate a passenger upon determining that the passenger is prone to or is exhibiting signs of motion sickness.

A system adaptively generates a virtual experience inclusive of a virtual agent. The system receives speech text from a constrained machine-learned language model configured to provide adaptive speech for the agent. The system parses the speech text into a plurality of speech units, wherein a speech unit is an atomic unit representative of natural breaks in human speech. The system applies a hashing function to each speech unit to determine a corresponding hash. The system, for each hash, queries a cache database to identify whether the cache database includes a cached hash that matches the queried hash. Responsive to identifying a matching hash to a first queried hash, the system retrieves a first audio byte stored with the matching hash. The system generates a voiceover track for the virtual agent with the first audio byte for presentation to a user.

Some implementations relate to methods, systems, and computer-readable media to dynamically change an avatar body during runtime while an avatar associated with the avatar body is participating in a virtual experience. In some implementations, the method includes identifying a first avatar body having a first body cage, identifying a target avatar body having a target body cage, and performing an interpolation between the first body cage and the target body cage to obtain a second body cage corresponding to a second avatar body to provide a transformation of the first avatar body into the second avatar body. The avatar body can also be changed in a configuration environment. Changing the avatar body may involve interpolating between body cages of a pair of cages, or by directly manipulating the body cage of the avatar body.

The application discloses a health-care robot knowledge graph dynamic updating method based on reinforcement learning, and relates to the technical field of artificial intelligence and rehabilitation medical treatment. The application realizes zero-risk virtual exploration through a counterfactual reasoning mechanism, avoids the security risks caused by the trial-and-error process to users from the root, and uses the current knowledge graph as a world model. When a high-fuzziness knowledge node is identified, instead of directly executing unknown actions in a real environment, a virtual result generated by executing a virtual action is deduced based on similar user group records and association rules in the knowledge graph, a virtual reward value is calculated, virtual experience samples are stored in an experience replay pool to participate in subsequent network training, the reinforcement learning intelligent agent can learn the potential value of the action without ever executing the action in reality, and thus a virtual learning environment is constructed in the whole knowledge exploration process, and the security threat of the trial-and-error process to users is solved.

Embodiments of the present disclosure relate to region partitioning with unit merging using a spanning tree. Location-based parallel reality games may use regions to determine how to disperse virtual elements, locate a virtual experience, and / or define game goals. To determine a region of a geographic region, a server divides the geographic region into cells. The server allocates real-world data to each of the cells, and constructs a graph of nodes and edges based on the cells. Each node corresponds to a cell, and each edge connects nodes corresponding to adjacent cells. The server segments the graph into contiguous segments based on the real-world data. The server defines a region of the geographic region based on the contiguous segments and stores the defined region in a data store. The server may hierarchically segment the region into higher order regions until each region satisfies a standard set.

There is provided a method in an application entity of a wireless communication system, the method for managing performance of one or more virtual experience applications, the method comprising: receiving a performance parameter for a virtual experience application session; determining a network requirement for the virtual experience application session based on the received performance parameter, wherein the determining the network requirement comprises identifying one of more protocol data unit, PDU, sets for the virtual experience application session; and, based on the determined network requirement, for each of the identified PDU sets, determining a respective PDU set parameter.

The invention relates to the technical field of virtual experience, and discloses an immersive simulation training evaluation system and method based on virtual reality, and the system comprises an equipment interaction perception module which is used for capturing the sight line, gesture data and feature data of a user; the environment scene simulation module is used for reconstructing and rendering a three-dimensional model of a target scene and performing digital simulation; the task training and logic control module is used for establishing task process management, analyzing a user instruction and adjusting the difficulty degree of a task according to real-time training performance after the user instruction is executed; the evaluation analysis module is used for quantitatively scoring the training performance of the user and generating a personalized training scheme according to a scoring result; and the data management platform is used for uploading the data to the cloud for storage and sharing. According to the method, a whole-process closed loop from scene construction, task control to evaluation optimization is realized, and the system response efficiency is improved; and a personalized training scheme can be generated according to a scoring result, so that targeted training of the user is facilitated, and the training efficiency is improved.

A metaverse application receives, from a user, a request to report abuse that occurs in a virtual experience. Responsive to receiving the request, the metaverse application captures a three-dimensional (3D) capture of the virtual experience. The metaverse application generates a two-dimensional (2D) capture from the 3D capture. The metaverse application determines a list of avatars in the 2D capture. The metaverse application mixes the additional audio with the encoded audio. The metaverse application generates a list of candidates from the list of avatars based on whether the avatars are visible to the user. The metaverse application generates graphical data for displaying an overlay on the 2D capture with the list of candidates that is user-selectable to provide a report of abuse.