409 results about "Virtual world" patented technology

Systems and methods for simulating multi-agent within a virtual world in response to generated hypotheses are disclosed herein. The system can generate a virtual world that includes a set of agents. The system can receive instructions that include a question, including a first query and a first input item, and a set of input traits, which can be used to instantiate a set of agents. The system can generate a first hypothesis representing the first input item and can execute a first simulation session to generate a first output set. The system can generate a second data schema associated with a second hypothesis and execute a second simulation session to generate, using the second hypothesis and the first query, a second output set. Accordingly, the system can generate a sentiment summary and display the sentiment (impression) summary at a graphical user interface (GUI) accessible to an experimenter.

The invention discloses an industrial mechanical arm tool changing operation monitoring system based on digital twinning, and relates to the technical field of digital twinning. The system establishes a complete digital twinning model by integrating a floating platform model, a mechanical arm model and a tool changing device model; and a sensing sensor group is arranged to acquire real physical world data of the platform, the mechanical arm and the tool changing device in real time. The data are transmitted to a digital twin model in real time for processing and simulation, so that the virtual world state and the physical world state can be bidirectionally synchronized. According to the highly integrated monitoring mode, the resonance risk between the platform and the mechanical arm and the change of the tool locking trend can be recognized in time. Through an effective risk early warning and adjusting mechanism, the system can ensure the accuracy and safety of tool changing operation, and tool changing failure or equipment damage caused by resonance or abnormal locking is avoided, so that the production efficiency is improved, and the downtime is shortened.

A computing platform can generate a virtual world and a set of virtual agents having agent traits and interaction rules. For example, by automatically analyzing experimenter queries, the platform can bind the agents to machine learning models that perform tasks responsive to the questions. The platform can generate additional hypotheticals to enable chains of simulations. The platform can execute a first simulation session by causing the set of agents to generate a first output set. Using an additional data source to generate new world characteristics, such as environmental and / or temporal conditions, the platform can generate and apply agent evolution logic for subsequent simulations, such as by performing mutation of agent traits, selection of agents, crossover of agent characteristics, and / or deletion of agents that do not meet a fitness threshold. The platform can persist agent states and outputs to generate user-interactive visualizations, aggregations, and training data sets for training agent models.

Techniques for simulating multi-agent interactions within a virtual world in response to generated hypotheses using dynamically retrieved external data are disclosed herein. A computing system can receive instructions including a user input with a seed phrase and provide the user input to a configuration generation model to generate agent traits associated with agents in a virtual world and / or data-source identifiers associated with external data sources. The system can retrieve external data from the external data sources and provide the agent traits and external data to a hypothesis generation model to generate a hypothesis that includes a constraint associated with the external data. The system can instantiate agents that have the agent traits and execute a simulation session consistent with the constraint (e.g., by causing the agents to generate an output set using the hypothesis and question). The system can generate a representation of the output set for analysis.

A method for creating automations for interactions of a plurality of electronic devices may include receiving a user input including user intents from a user, generating, using a generative model based on the user input, a list of activities to be executed in connection with the user intents, identifying, using the generative model, a plurality of entities that are required to perform the activities, predicting an execution plan including a plurality of automations to be carried out the activities, based on relations between the activities and the plurality of entities for triggering the plurality of automations via the plurality of electronic devices, mapping a corresponding electronic device among the plurality of electronic devices with a corresponding entity among the plurality of entities based on the execution plan, and triggering, based on the mapping, the plurality of automations in a sequence upon occurrence of events in connection with the activities.

A computing platform can generate a virtual world and a set of virtual agents that have agent traits (attributes). A trait distribution for a set of agents Y can be generated by processing seed data to generate trait values T and a trait distribution algorithm. The algorithm assigns a particular trait value T′ to an agent Y′, conforming to the trait distribution algorithm applied to the set of agents Y. The platform uses the agents in a simulation session, prompting an AI model with the particular trait value T′ to generate an output set. The output set can be displayed and navigated to provide further information about the trait value T′, which enables analysis of agent behaviors and outputs based on agent traits.

Techniques for simulating multi-agent interactions within a virtual world in response to generated hypotheses are disclosed herein. A computing system can receive an input dataset of a first format and process the dataset, in connection with an input configuration, to generate a virtual world populated with a set of agents. The system can receive input (e.g., a query, an API message, an AI model output) specifying attributes of a particular item or scenario to test within the virtual world. Based on the input, the system can generate a hypothesis, execute a simulation session according to the hypothesis, and generate an associated output set for display on a graphical user interface. The disclosed techniques enable flexible, tunable simulations of various within the virtual world based on multimodal inputs and / or contextual information.

The invention provides a data acquisition method and system of an intelligent Internet of Things sensor in universe virtual-real fusion, and relates to the technical field of universe, and the method comprises the steps: collecting physical scene information through the intelligent Internet of Things sensor, and carrying out the preprocessing; adaptive fusion processing is carried out by using a deep space-time correlation network; constructing a meta universe virtual scene; bidirectional mapping and interaction of virtual and real scenes are realized through an intelligent perception engine, and a sampling strategy is optimized based on deep reinforcement learning. According to the invention, accurate mapping and real-time interaction between the physical world and the virtual world are realized, and the data acquisition efficiency and the virtual-real fusion experience are improved.

The invention relates to the related field of simulation verification of welding, discloses a BIM-based three-dimensional simulation verification method and system, and constructs a high-precision welding management implementation method in which reality is mapped to virtuality and reality data is corrected through virtual simulation in an analogue simulation mode. Simulation fitting can be carried out on thermal deformation of a workpiece joint at different positions in the welding process on the premise of condition synchronization, a small amount of change of the position of the joint relative to a cooling state when the current welding point is moved to the next welding point after welding is completed is judged, then a deviation correction value which should be made by the welding point is calculated, and the deviation correction value of the welding point is calculated. Compared with a welding control scheme in the prior art, more accurate welding seam positioning can be obtained, and the welding quality is improved.

The invention relates to a virtual hand grasping perception and exoskeleton force feedback mapping method based on virtual-real interaction, and belongs to the technical field of virtual reality, the method comprises the following steps: building a hand exoskeleton, and reading joint data in real time; calculating the pose of each joint coordinate system of the virtual hand relative to the virtual world; according to the calculated poses of all the joints of the virtual hand, the virtual hand is driven to synchronously move with the hand exoskeleton in real time; collision and contact events of the virtual hand and the digital object are monitored in real time, and virtual interaction force generated when the virtual hand interacts with the digital object is calculated; calculating feedback torque required to be output by each hand exoskeleton motor of the hand exoskeleton, and driving the motors to output corresponding feedback force through a motor controller of the hand exoskeleton, so as to realize force feedback of the hand. According to the method, the interaction reality sense in the virtual reality application can be enhanced, the user can interact with the virtual environment more naturally in an immersive mode, and the user experience is improved.

The invention provides a space positioning technology provided for a meta-universe virtual world based on RTK and VIO precise positioning, the space positioning system comprises an RTK positioning module and a VIO positioning module, the RTK positioning module adopts a high-precision RTK receiver, receives satellite signals and calculates absolute position information of a user or an object, and the absolute position information of the user or the object is calculated by using a differential positioning technology. The satellite signal error is eliminated by performing data differential processing with a reference station with a known position; the VIO positioning module collects image information of the surrounding environment through a visual sensor, and the motion posture and displacement of the equipment are calculated through feature extraction and a matching algorithm. According to the invention, continuous positioning can be maintained in an environment without GNSS signals. The relative positioning capability enables the VIO to be especially suitable for indoor, underground and other complex scenes. A visual sensor captures an environment image, and the relative displacement of the equipment is calculated through feature extraction and matching; and the IMU provides motion information in a short time, and high-robustness positioning can be realized through combination of the motion information and the motion information.

A platform for adaptive multi-agent simulation in a virtual world instantiates a set of agents with input traits and executes a simulation session, generating an output set. Upon detecting a change event in the virtual world, a trained model recommends an evolution operation, which is applied to the set of agents to generate an evolved set. The evolution operation includes mutation, selection, crossover, deletion of agents, or a combination thereof. The platform persists at least a portion of the initial output set and executes a second simulation operation using the evolved agents, generating a new output set and thereby enabling analysis and comparison of simulation results. The disclosed adaptive simulation approach with persisted context enables realistic and dynamic modeling of complex systems.

In one implementation, we describe the semantics of skeleton joints of the avatar to be animated as a mapping to a highly-detailed skeleton model containing most or all of the joints and bones of human anatomy (the "reference skeleton"). Such a reference skeleton (e.g., the "LOA-4" version of the Web3D humanoid skeleton model) features detailed models of the hand and foot phalanges and joints for every vertebra of the spine. Owing to the level of detail of the reference skeleton, each joint of a user-defined animation skeleton can be mapped to one of the joints of the reference skeleton. The identification and location of each joint in the user-defined skeleton on the human body is thereby accurately and unambiguously described. Such semantics can be used in implementing some features of a virtual world platform, for example, in automated action or gesture recognition.

A method for execution by a computer to produce video in a virtual world environment includes selecting a lesson package based on a learner requirement for a learner to produce a selected lesson package. The method further includes selecting an active virtual world environment of a set of active virtual world environments to produce a selected virtual world environment. The method further includes determining a learner perception approach for the learner based on the learner requirement, where the learner perception approach maps a baseline four dimensional model of the selected virtual world environment to a learner specific four dimensional model of the selected virtual world environment. The method further includes rendering updated first descriptive asset video frames of a first descriptive asset and updated second descriptive asset video frames of a second descriptive asset within the learner specific four dimensional model to produce a new video stream for the learner.

Image rendering techniques for use with virtual worlds and interactive media are described herein. Techniques may include: acquiring a first scene depth texture map and a first scene color texture map of a first image frame; acquiring, based on the first scene depth texture map, a first spatial position of a vertex of a target triangle face in a first clipping space; mapping, based on a first camera parameter and a second camera parameter, the first spatial position to a second spatial position in a second clipping space; generating a second scene depth texture map and a second scene color texture map based on the second spatial position and the first scene color texture map; and displaying a second image frame based on the second scene depth texture map and the second scene color texture map. Image display frame rates for a virtual scene may be improved, thereby improving visual effects.

The invention provides an entity doll and an intelligent doll interaction system and method, and belongs to the technical field of Internet. The entity doll comprises a first doll body and a pluggable secret key activation part, when the secret key activation part is inserted into the first doll body, body identity authentication is conducted on the first doll body based on secret key information in the secret key activation part, and the first doll body is activated after authentication is passed; the method comprises the steps that an activated first doll body responds to a received entity interaction activation instruction, the response state of the intelligent doll is switched into an offline active state, and the first doll body responds to an interaction instruction of a user; when the activated first doll body receives an entity interaction closing instruction, the response state of the intelligent doll is switched into an online active state, so that the virtual doll interacts in the virtual world, and the virtual doll and the entity doll belong to the same intelligent doll. The interactive experience between the user and the doll can be achieved.

The invention discloses a virtual item control method and device, equipment, a storage medium and a program product, and belongs to the technical field of virtual world. The method comprises the steps that a scene interface of a virtual scene is displayed, the virtual scene comprises a first virtual object, and the first virtual object is equipped with a virtual shooting prop; receiving a shooting operation, wherein the shooting operation has at most N force storage stages; in response to the fact that the shooting operation is released in the first operation stage, a gain effect corresponding to the first operation stage is applied to a virtual launcher launched by the virtual shooting prop; the first operation stage is one of N force storage stages; in response to the fact that the shooting operation is released in the second operation stage, gain effects corresponding to the N force storage stages are applied to the virtual launcher; the second operation phase is located after the N force storage phases.

A system for test running of equipment using a digital twin object is presented and the system may include a controller configured to determine at least one control value for operation of at least one equipment in the virtual world; transmit an at least one control value to the equipment in the virtual world; receive at least one feedback on the at least one control value from the at least one equipment in the virtual world wherein the at least one feedback on the at least one control value is used to calculate at least one correction value for a virtual model control program; and receive the at least one correction value based on the at least one feedback on the at least one control value.

Depth maps are generated based on a sequence of posed images captured by a camera, the depth maps are fused into a truncated signed distance function (TSDF), and an initial estimate of 3-dimensional (3D) scene geometry is generated by extracting a 3D mesh via the TSDF. 3D embeddings are estimated for each vertex in the 3D mesh by mapping each vertex to a multi-view consistent plane embedding space such that vertices on a same plane map to nearly a same place in the embedding space. The vertices are clustered into 3D plane instances based on respective 3D embeddings and geometry information defined by the 3D mesh to create a planar representation of the scene. A location of a virtual element in a virtual world of an augmented reality game is determined based on the planar representation.

The invention discloses a content pushing method and device of a virtual world, electronic equipment and a program product. The method comprises the following steps: determining current position information of a target virtual character corresponding to a target virtual account in a virtual world; based on the current position information, a target area is determined from multiple areas included in the virtual world, the multiple areas are obtained through division according to attribute information corresponding to the areas, and the attribute information at least comprises area functions and area types; and based on the target area, determining target push content pushed for the target virtual character. Through the method and the device, the problem of low accuracy of content pushing of the virtual world in related technologies is solved.

In an approach to improve computer-based virtual world collaboration environments, embodiments of the present invention embodiments identify a context associated with a current state of a virtual environment and determines a physical object that is being rendered as a virtual display in the virtual environment based on the context. Further, embodiments render a virtual object representing the physical object according to the context using a generative model in a such a manner that the virtual object is rendered visually distinct from the physical object being represented.

Methods, systems, and computer-readable storage media are disclosed for translating a user input to a virtual environment into a contextualized output. The input is converted into a first textual representation by a recognition model, and a first set of tokens based on the textual representation is generated. The first set of tokens is fused with a second set of tokens stored in a contextualized language database. The second set of tokens is based on a second textual representation of previously collected user interactivity metrics, a virtual environment engine configuration, or displayable attributes. A trained neural network uses the fused set of tokens and at least a portion of the second set of tokens to generate an assessment of user activity to adjust a first display attribute, change the current position of the user within the virtual environment, or generate a natural language audio or textual output from the virtual environment.

The invention provides an outdoor mixed reality illumination compensation method and system based on multi-source environment perception and real-time weather data, and the method comprises the steps: obtaining multi-source data: providing original data of'space-time reference + environment characteristics' for all subsequent illumination calculation, solving the problems of incomplete coverage and insufficient precision of a single data source (such as only a camera), and obtaining the multi-source data; the data is a data basis for real-time illumination compensation; main light source resolving: the'spatio-temporal data 'is converted into'virtual main light source parameters' through a physical algorithm, it is ensured that the direction and intensity of a virtual main light source (sun / moon) are completely consistent with those of the real world, and the problems of'shadow direction error 'and'illumination angle splitting' are solved; through GPS space-time positioning, network weather API data and local visual sensor fused illumination compensation, a real-time environment illumination shadow relationship matches a virtual world with a real world, a more immersive mixed reality experience is presented, and a split feeling is reduced.

In an approach to improve computer-based virtual world collaboration environments, embodiments of the present invention identifies, by a client computer, a structure of a virtual world collaboration room and the placement of participants in the virtual world collaboration room, and correlates, by an internet of things (IoT) sensor set, body language of an avatar to match a spoken context of the avatar. Further, embodiments select personalized virtual world collaboration room or a predetermined physical location to conduct a virtual world collaboration and utilize a generative adversarial network (GAN) to adapt the avatar to the personalized virtual world collaborative environment. Additionally, embodiments perform real-time adaptation, by the GAN, of participating avatars to generate and output a required body language for the participating avatars based on their location different personalized virtual world collaboration rooms.

A display method and a display system of an on-vehicle around view monitor (AVM), an electronic device, and a storage medium. The display method is performed based on on-vehicle lenses. The display method includes constructing a coordinate mapping table representing a coordinate mapping relationship between a panoramic image generated by splicing original images captured by the on-vehicle lenses and each original image captured by the on-vehicle lenses, generating the panoramic image based on the original images captured by the on-vehicle lenses and the coordinate mapping table, mapping the panoramic image to a preset world model to construct a virtual world inside the preset world model, disposing a vehicle model at a position corresponding to a real vehicle in the virtual world, and rendering and outputting an image, corresponding to a specified view point, in the virtual world. The view point is located on the preset world model and faces towards a center of the vehicle model. The end-to-end coordinate mapping table constructed with the method can avoid multiple image interpolations, and the construction of the virtual world facilitates the realization of a real-time preview.

The present invention particularly relates to a computer-implemented machine learning method. The method includes providing a test data set of a scenario. The test data set belongs to a test domain. The method includes providing a domain adaptation neural network. The domain adaptation neural network is a neural network of machine learning that learns data obtained from a training domain. The domain adaptation neural network is configured to infer spatially reconstructable objects in the scenario of the test domain. The method further includes determining an intermediate domain. In terms of data distribution, the intermediate domain is closer to the training domain than the test domain. The method further includes inferring spatially reconstructable objects according to the scenario of the test domain transferred on the intermediate domain by applying the domain adaptation neural network. Such a method constitutes an improved machine learning method using a data set of scenarios including spatially reconstructable objects.

Methods and systems are described herein for using cryptographic tokens that represent real-world items to enable those items to be used in different virtual worlds (e.g., game worlds). In particular, an object retrieval system may be used to retrieve a cryptographic token that encodes parameter data for an object to be used (e.g., displayed) within a plurality of computing platforms. The object retrieval system may determine (e.g., using a cryptographic signature) that the user is allowed to use the object and may then generate a set of parameters for representing the object with the particular computing platform requesting the object. The object retrieval system may then transmit the parameters to the requesting platform. The object retrieval system may perform the same operations for requests from other platforms, such that the object retrieval system may uniquely encode the parameters for the particular platforms.

The invention relates to the technical field of comprehensive energy transformation, in particular to a digital twin-body-based comprehensive energy system transformation optimization method, which comprises the following steps of: constructing a digital twin body comprising a building thermal model and an energy equipment system model on the basis of static data, dynamic operation data and external environment data of a target area; global optimization with a preset objective function as a guide is carried out, an optimal system capacity configuration and architecture scheme is determined, and then local equipment type selection and control strategy optimization are carried out; issuing the optimized control strategy to a physical energy system for execution, and continuously collecting feedback data to calibrate the digital twin to form closed-loop optimization; a sensing-analysis-decision-execution-learning closed-loop system is constructed, an energy system of a physical world is deeply coupled with a digital model of a virtual world, global and local layered collaborative optimization is realized through a digital twin, and dynamic adaptability is improved through closed-loop operation.

The embodiments of the disclosure provide a method for providing a virtual plane, a host, and a computer readable storage medium The method includes: tracking a hand gesture of a hand and determining whether the hand has performed a target gesture; in response to determining that the hand has performed the target gesture, providing the virtual plane at a reference height in a virtual world of a reality service; and displaying a height adjustment element in the virtual world, wherein the height adjustment element is used for adjusting a height of the virtual plane in the virtual world.

The invention discloses a virtual character control method and device, equipment and a storage medium, and belongs to the technical field of virtual world. The method comprises the following steps: displaying a plurality of virtual chess and cards in a virtual chess and card game and virtual characters respectively corresponding to a plurality of game parties in the virtual chess and card game; the virtual character is a virtual object which assists the playing party in processing virtual chess and cards; receiving a specified operation of the first playing party on the first virtual chess and card; the first playing party is one of a plurality of playing parties, and the first virtual chess and card is one or more of a plurality of virtual chess and cards; controlling the first virtual character to execute an interaction action corresponding to the specified operation on the first virtual chess and card; the first virtual role is a virtual role corresponding to the first game party. By setting the virtual character, the interaction between the virtual character and the virtual chess and card in the game can be realized, so that the interaction effect between the game party and the virtual chess and card is improved.