895 results about "Virtual space" patented technology

The invention discloses a live-action three-dimensional dynamic change modeling method based on digital twinning. The method comprises the following steps: collecting multi-source data; carrying out space registration and time synchronization processing, and outputting a fusion data set; carrying out three-dimensional modeling, optimizing model parameters, and generating a live-action three-dimensional model; virtual-real mapping is carried out, and generated virtual space data and state parameters thereof are stored; performing differential analysis to generate a change detection result data set; performing dynamic change modeling to generate an updated virtual model; executing geometric accuracy optimization and semantic consistency check, and outputting an optimized virtual model; bidirectional data flow association and dynamic updating are executed, and the live-action three-dimensional dynamic change modeling process is completed. The real scene dynamic updating is realized by adopting the improved Gaussian sputtering modeling, and the method has the advantages of high precision, strong real-time performance and virtual-real synchronization.

The invention discloses an intelligent control and optimization system and method for the whole process of a photovoltaic power station. The method comprises the following steps: constructing a component-level high-fidelity digital twin through multi-source heterogeneous data fusion and an attention enhancement deep learning model; injecting annotated historical fault data, carrying out joint training by combining a feature embedding layer and an adversarial generative network, and generating a digital mapping body with fault evolution deduction capability; a three-layer architecture is introduced, reinforcement learning and a multi-objective optimization algorithm are fused, and autonomous decisions of power station level power output maximization, equipment loss minimization and maintenance cost optimization are realized in a virtual simulation environment constructed by a digital mapping body. According to the method, accurate dynamic mapping of the physical entity and the virtual space, fault pre-judgment and deduction and closed-loop control of global autonomous optimization are realized, the intelligent level and the full-life-cycle economy of the photovoltaic power station are improved, and the problems of insufficient fidelity, lack of fault deduction capability and low global optimization efficiency in the prior art are solved.

The invention provides an energy efficiency optimization and predictive regulation and control method for a building electromechanical system based on digital twinning. The method comprises five layers of architectures including a physical entity layer, a data acquisition and interaction layer, a digital twinning model layer, an energy efficiency analysis and optimization layer and a predictive regulation and control layer. The dynamic digital twinborn body interacting and synchronizing with the physical electromechanical system in real time is constructed, fundamental transformation from passive lag control to prospective predictive control is achieved, a high-fidelity virtual model is used as a nondestructive testing platform, countless operation strategies can be safely and rapidly simulated and evaluated in a virtual space, and therefore accurate optimization is achieved, and the real-time dynamic digital twinborn body is obtained. The overall energy efficiency of the system is remarkably improved, the dilemma that the traditional method makes consideration and loses others is eliminated, and the leap-type improvement of the comprehensive operation quality is achieved.

The invention discloses a virtual space multi-person interaction synchronous control method oriented to an end-cloud collaborative architecture. The invention relates to a computer graphics and three-dimensional modeling technology, and discloses a cross-format lightweight and geometric consistency maintenance method based on a three-dimensional model. Through format-independent geometric representation and a self-adaptive lightweight strategy, efficient compression and precision maintenance of three-dimensional model cross-format conversion are realized. The method specifically comprises the following steps: performing format analysis and geometric feature extraction on an input model, and establishing a unified internal representation; adaptively selecting a multi-level LOD lightweight strategy based on the complexity of the model; the accuracy of key information is ensured through geometric feature keeping and topology consistency detection; the geometric consistency is dynamically maintained by combining error monitoring and an iterative correction mechanism; and generating a target format lightweight model and carrying out quality verification. According to the method, adaptive precision control, multi-level consistency maintenance and format irrelevant processing are combined, the model size and conversion errors are effectively reduced, and cross-platform compatibility and geometric fidelity are improved. The method can be widely applied to the fields of industrial design, game development, virtual reality and the like.

The invention relates to the technical field of equipment control, in particular to a feeding and discharging machining production control system and method based on a PLC, and the system comprises a multi-mode data sensing module which collects a three-dimensional point cloud and image sequence of a working scene through a laser radar and a visual sensor, and combines a vibration signal and a current signal of a machining main shaft; and after feature extraction, outputting a comprehensive state vector including the workpiece pose and the equipment health state. And the digital twinborn collaborative planning module receives the comprehensive state vector, drives a digital twinborn model to be synchronized with a physical environment in a virtual space, performs Monte Carlo tree search by applying a reinforcement learning algorithm, and generates a flexible control strategy with a time sequence mark. And the digital twinborn collaborative planning module adjusts a task allocation strategy according to the early warning signal, and corrects digital twinborn model parameters based on the execution log. According to the operation process corresponding to the modules, collaborative optimization of the feeding and discharging system and the machining rhythm is achieved, and the equipment utilization rate and the production efficiency are improved.

The invention discloses a coal mine intelligent coal face control system based on digital twinning. The system comprises an underground entity unit, a ground virtual unit and an interaction unit connecting the underground entity unit and the ground virtual unit. The physical unit acquires data through the sensing network module and uploads the data through the communication module; the virtual unit builds a three-dimensional dynamic model through a twinborn body building module, virtual and real consistency is guaranteed through a model dynamic correction module, then an optimal control strategy is generated through simulation optimization of a twinborn data analysis and decision-making module, and finally an instruction is issued to an execution mechanism module through a control module to form closed-loop control; according to the method, the digital twinborn body completely corresponding to the physical working face is constructed, simulation operation and verification can be carried out on the whole process of the coal mining technology and equipment linkage logic in a virtual space in advance, and therefore potential action interference and logic conflicts are recognized and eliminated before an actual control instruction is issued, the effect of pre-judgment in advance is achieved, and the real-time performance of the coal mining technology is improved. And the look-ahead decision-making capability of the system is greatly improved.

The invention discloses a conference sound reinforcement system based on an AI intelligent algorithm and 360-degree omni-directional noise reduction, and relates to the technical field of audio signal processing, the conference sound reinforcement system comprises a conference management center, the conference management center is in communication connection with the following modules: a multi-sound-source sensing module used for capturing 360-degree omni-directional sound field information in a conference environment and constructing a sound source space distribution model; according to the invention, the omnidirectional microphone array unit covers all directions of a conference space, synchronously collects audio data streams, eliminates the limitation of a conventional unidirectional microphone, combines the sound source positioning space mapping unit, constructs a sound source space distribution model based on the time difference of arrival and the phase difference through a deep learning model, and improves the sound source positioning accuracy. The azimuth angle, pitch angle and distance parameters of the sound source are accurately analyzed, the position of the sound source is mapped to a virtual space coordinate system, a dynamically updated 3D sound source distribution diagram is generated, the position change and intensity distribution of the sound source are reflected in real time, and the positioning precision in a complex acoustic environment is remarkably improved.

The technology disclosed relates to using virtual attraction between hand or other control object in a three-dimensional (3D) sensory space and a virtual object in a virtual space. In particular, it relates to defining a virtual attraction zone of a hand or other control object that is tracked in a three-dimensional (3D) sensory space and generating one or more interaction forces between the control object and a virtual object in a virtual space that cause motion of the virtual object responsive to proximity of the control object to the virtual object and escalation with a virtual pinch or grasp action of the control object directed to a manipulation point of the virtual object.

The invention provides a user behavior intention recognition method and device based on multi-modal data fusion, and relates to the technical field of data processing.The method comprises the steps that a multi-modal observation sequence is obtained, initial features are formed through time synchronization and mutual information screening, a cross-space initial offset vector is generated in combination with virtual space offset parameters, and the cross-space initial offset vector is obtained; establishing an association relationship between a real action and a virtual action through nonlinear mapping to obtain a cross-space registration feature; generating a correction coefficient according to the proportion of the real action amplitude and the virtual action amplitude, and performing amplitude correction to obtain a cross-space correction feature sequence; compensating rendering delay and synchronous drift by using weighted fusion of the current feature and the lag feature to obtain a time sequence correction feature; outputting cross-space fusion features through a unified embedding space and a cross-modal attention mechanism; and non-linear intention mapping is constructed based on the fusion features, and a user behavior intention result is inferred and output in combination with time smoothing. According to the invention, the accuracy of user behavior intention analysis in a virtual field scene can be improved.

The invention discloses a method for implementing intelligent management and control of a special vehicle operation process based on a virtual space. Only a laser radar and an optical camera which are deployed in a special vehicle operation site and have overlapped detection view fields are used as external sensing equipment to synchronously collect operation environment data; based on the working environment data, constructing a three-dimensional virtual space containing the semantic information of the electrified equipment, and setting a virtual electronic fence to form a security defense area; based on laser radar real-time point cloud data, point cloud clusters of different rigid parts of the special vehicle are identified through segmentation and clustering, and a theoretical three-dimensional contour is generated; extracting a two-dimensional edge of the vehicle part through semantic segmentation based on the optical camera image data, and generating a three-dimensional semantic contour; fusing the theoretical three-dimensional contour with the three-dimensional semantic contour to obtain a high-precision dynamic three-dimensional contour of the moving part of the special vehicle; and calculating the shortest distance between the high-precision dynamic three-dimensional contour and the boundary of the virtual electronic fence, and taking the shortest distance as a reference for executing graded early warning or operating intervention on a special vehicle.

Dynamic valuation of virtual spaces in a virtual environment includes receiving telemetry data describing current user interactions with a virtual environment; performing predictive analysis on the telemetry data to predict future user interactions with a plurality of virtual spaces in the virtual environment; and continually adjusting values of the virtual spaces based on the predicted future user interactions without considering virtual objects in the plurality of virtual spaces.

The invention discloses an intelligent anti-falling risk management system based on artificial intelligence, and relates to the technical field of artificial intelligence, the intelligent anti-falling risk management system comprises a management center, and the management center is connected with a monitoring acquisition module, a transmission processing module, a body position analysis module and a multi-dimensional supervision module; constructing a resting virtual space for the bedridden old person, and performing position marking on the collected bedridden state data through the resting virtual space based on the intelligent anti-falling bed to obtain a continuous track of the bedridden old person; boundary distance statistics is carried out according to the continuous track of the bedridden patient, the boundary distance is converted into a real-time track fluctuation map, range division is carried out on the real-time track fluctuation map, the range proportion is counted, and a curve judgment range is obtained; carrying out simulation diagnosis through the static lying virtual space to obtain an abnormal identification state, and carrying out dynamic feedback adjustment on the bedridden old people according to the abnormal identification state based on the static lying virtual space to obtain an anti-falling intervention measure; the occurrence of falling-off accidents of old people is effectively reduced, the nursing efficiency is improved, and the burden of nursing personnel is relieved.

The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating block content elements from meeting data of multiple video calls to add to data blocks of a virtual space. In particular, in one or more embodiments, the discloses systems utilize a large language model to process meeting data across multiple video calls and generate the block content elements for data blocks. For example, in some embodiments, the disclosed systems generate new block content elements based on detecting meeting data from additional video calls. Further, in one or more embodiments, the disclosed systems generate block content elements according to block type of a data block and extract meeting data to generate summaries, action items, document elements, or dates. Moreover, in some embodiments, the disclosed systems provide options and prompts to generate or update a virtual space using meeting date from video calls.

The invention provides a textile flexible production line multi-material scheduling system, which comprises a physical execution layer and a multi-material scheduling layer, wherein the physical execution layer comprises reconfigurable textile production equipment; the intelligent sensing layer is arranged at key nodes of the physical execution layer; the central scheduling and control layer is in communication connection with the physical execution layer and the intelligent sensing layer; and the digital twin layer is a virtual mapping of the physical execution layer in an information space, and forms a closed loop with the central scheduling and control layer and the physical execution layer. According to the method, the perspectiveness and the global optimization capability of a scheduling decision are realized through a digital twinning technology, the system places an initial production scheduling scheme in a high-fidelity virtual production line model for millisecond-level concurrent simulation deduction, and potential process bottlenecks and quality risks during blending production of different materials are accurately predicted; and by taking the production efficiency, the energy consumption and the quality qualification rate as multi-target reward functions, completing iterative optimization of massive strategies in a virtual space, thereby obtaining an approximately globally optimal scheduling instruction before the physical production is put into use.

An automotive competition method for having at least a first real road vehicle and a second virtual road vehicle race with each other; the method comprises the steps of: defining a virtual space, comprising a virtual track, on which a virtual projection of the first road vehicle and the second road vehicle race together; moving the virtual projection of the first road vehicle in the virtual space according to actions imparted by a driver to the first road vehicle; transmitting to the driver data related to the movement of the second road vehicle in the virtual space by means of an interface device indicating at least the position on the virtual track of the second road vehicle with respect to the position of the projection of the first road vehicle on the virtual track.

The invention discloses a digital twinning real-time simulation optimization method for an aviation part five-axis equipment processing track, and relates to the technical field of processing track optimization, and the method comprises the following steps: building a virtual processing model in a virtual space based on digital twinning; acquiring an initial processing track based on the virtual processing model; acquiring a first right side area based on the initial processing track; obtaining a first area threshold value and a second area threshold value based on the first right side area; obtaining a first right mean value based on the first area threshold and the second area threshold; acquiring a left side area based on the initial processing track; obtaining a first overall area, and obtaining a second adjustment straight line based on the first overall area, the left side area and the first right side mean value; an optimized path is obtained based on the second adjusting straight line, and the aviation part is machined based on the optimized path; the method is used for solving the problems that in an existing machining track optimization technology, due to the fact that irregular machining area boundaries are complementary, many repeated machining areas exist, and the total path is long.

The invention provides an alkaline electrolytic cell electrothermal parameter global sensing and security situation assessment method and system, and the method comprises the following steps: obtaining global parameters through a sensing layer, including electrical parameters, thermal parameters, physical and chemical parameters, and visual and acoustic parameters; the method comprises the following steps: constructing an alkaline electrolytic cell multi-physical field high-fidelity model based on a physical and chemical principle according to global parameters, calculating a state which cannot be directly measured inside, performing redundant state estimation when a physical sensor fails, and positioning a fault source by reproducing and deducing in a virtual space when an anomaly occurs. The multi-physical-field high-fidelity model of the alkaline electrolytic cell comprises an electrochemical field, a mass transfer field, a fluid field and a thermodynamic field; and carrying out quantitative evaluation on the safety situation of the alkaline electrolytic cell according to the output of the multi-physical field high-fidelity model of the alkaline electrolytic cell. According to the method and the system for global sensing of the electrothermal parameters of the alkaline electrolytic cell and assessment of the safety situation, the operation efficiency and the safety of equipment are improved.

The invention discloses an inspection interaction control method based on three-dimensional live-action virtual-real mapping, belongs to the technical field of industrial inspection and digital operation and maintenance, and aims to solve the problems of virtual-real space interaction splitting, model updating lagging and control closed loop deficiency in a traditional inspection mode. A system integrating laser scanning and positioning is used for collecting live-action data and constructing a high-fidelity three-dimensional live-action model, then high-precision feature matching and space alignment are carried out on the high-fidelity three-dimensional live-action model and a preset virtual inspection model, a stable virtual-real mapping relation is established, an operator can input a control instruction in a natural interaction mode, and the real-time performance of the system is improved. According to the mapping relation, the instruction is analyzed into specific control parameters for the physical scanning system, the physical scanning system is driven to adjust the scanning posture or path so as to pertinently collect and update data, and the three-dimensional live-action model is fused and updated in real time. According to the method, accurate linkage of virtual and real spaces and dynamic enhancement of the model in the inspection process are realized, and the interactivity, the real-time performance and the intelligent level of inspection are remarkably improved.

Techniques for streaming generative machine learned model (or LLM) output to a virtual space are described herein. A system may receive a request to perform an action. The system may leverage LLMs to assist in performing aspects of the requested action. The system can generate input data to input into the LLM. When generating the input data, the system can identify sensitive data associated with the request. The system can modify the input data to mask and / or anonymize the sensitive data. The system can input the input data into an LLM trained to output a subset (e.g., less than all) of the response at a time. The system can add the output subset to a buffer and upon identifying the masked data in the buffer, the system can demask the sensitive data and output the sensitive data to the user profile in a streaming manner.

The disclosure relates to a method and electronic device for generating pose information about a virtual 3D object. The electronic device obtains a feature map based on at least one RGB image frame captured by the electronic device, obtains depth information of an object in the at least one RGB image frame through at least one depth sensor associated with the electronic device, generates a contour mask of the object based on the feature map, generates a 3D point cloud of the object based on the contour mask and the depth information and generates a plurality of pose features of the object for representation in a 3D virtual space based on the contour mask and the 3D point cloud.

The invention provides an intelligent warehouse management method and system based on multi-modal feature fusion, electronic equipment and a medium. The method comprises the following steps: acquiring an image and a weight feature of a cargo, and executing multi-modal fusion processing to determine a cargo quality degradation degree grade; calling a three-dimensional topological model of the digital twin warehouse system, retrieving a target storage area matched with the cargo grade, and judging a storage location occupation state; if the region is saturated, searching adjacent alternative free storage locations based on a topology center and modifying logic attribute tags of the alternative free storage locations in batches to realize dynamic expansion and spatial layout continuity of the storage region; and finally controlling the carrying equipment to put in storage and synchronously updating the virtual space state. Hard partition limitation of a physical goods shelf is broken through, self-adaptive elastic management of the storage space is achieved, and continuity of an automatic carrying path is optimized.

The invention discloses an implementation method and system for AI and Agent agents to perform autonomous exploration and produce content, and relates to the technical field of AI and Agent agents, and the implementation method comprises the following steps: receiving an Agent identity file, an exploration target keyword, a narrative style parameter and an observation preference parameter configured by a user at a client, and generating Agent metadata containing character vectors and behavior tendencies; generating a virtual city model with a spatial topological structure based on GIS data, a POI map and historical and cultural corpora, and endowing buildings, roads and NPCs in a city with queriable semantic tags and interactive states to form a city-level semantic environment; by constructing a city-level semantic environment and a multi-agent collaborative exploration mechanism, autonomous perception, hierarchical decision and dynamic narrative generation of the AI Agent in a highly structured virtual city are realized, and by means of deep fusion of GIS data, POI atlas and historical and cultural corpora, a real geographic basis and cultural connotation are given to a virtual space, and immersion and logic coherence are improved.

The invention relates to a virtual reality assisted building space planning method and device, equipment and a medium. The method comprises the following steps: constructing a three-dimensional virtual reality space based on initial design data of a building, and generating a virtual scene; performing physical environment attribute mapping on the three-dimensional scene to generate a virtual space with physical environment attributes; the method comprises the following steps: synchronously accessing a plurality of user terminals into a virtual space to obtain behavior track data and interactive behavior data of a user; analyzing the interactive behavior data to generate user feedback data, and performing environment performance simulation analysis according to the behavior track data to generate an analysis result; and adjusting the initial design data based on the user feedback data and the environmental performance analysis result, and generating an updated building space planning scheme. By adopting the method, accurate optimization and adjustment of the building space can be realized, and the scientificity of space planning and the user experience are improved.

The present application provides output control device, output control system, and control method. The image and the sound with the sense of presence are provided to the passenger of the moving body. The output control device (1A, 1B, and 1C) has: position direction determination part (11), which determines the real position and the real orientation; reading part (12), which reads virtual space data (31); virtual position decision part (131), which decides the virtual position and the virtual orientation according to the real position and the real orientation; display control part (14), which makes the display device (4) display the image of the partial area or the partial object of the virtual space based on the virtual position and the virtual orientation and the setting position of the display device (4); sound output control part (15), which controls the position of the sound image formed by the output sound from the loudspeaker (5) based on the virtual orientation and the relative position relationship between the virtual position and the sound source body.

An image data generation device includes a target object acquisition unit configured to acquire a learning target object created as computer graphics (CG), a virtual space generation unit configured to generate a virtual space in which the learning target object is disposed, a background setting unit configured to set a background image captured in a physical space as a background in the virtual space, and an image data generation unit configured to generate image data by using a captured image obtained by imaging the learning target object disposed in the virtual space.

The present invention provides an environment generation method and the like capable of executing calibration of the predetermined parameter of a virtual object in a virtual space or a mixed reality space under an appropriate condition. In this environment generation method, a virtual space VS, avatars A1, A2, and virtual objects VO1-VO3 are generated. Further, when the calibration processing is not executed, the environment of the virtual space is generated using the virtual space VS, the avatars A1, A2, and the virtual objects VO1-VO3, and when the calibration processing is executed, the environment of the virtual space to be recognized by a user is generated using the virtual space VS, the avatars A1, A2, and the calibrated VO1-VO3.

Provided is a device including a communication module that receives a drone image from a drone, and a processor that generates an AR image by merging the virtual object in virtual space with the drone image. The processor converts first location information of the drone in real space into second location information in virtual space, generates the AR image based on a field of view (FOV) of a virtual camera positioned at a location corresponding to the second location information in the virtual space, calculates a similarity between the AR image and the drone image, and corrects the second location information when the calculated similarity is lower than a predetermined similarity.

We provide the system. [Solution] A means for analyzing voice and video information of a person acquired by the user and generating a three-dimensional model of the said person, A means for reproducing the voice of the person based on the aforementioned audio information, A means to enable dialogue with the person in a virtual space using a generated three-dimensional model and reproduced voice, A system that includes this.

An information processing apparatus that displays an image of a virtual space on a display device worn or held by a user. A controller performs determination of whether or not the user is lying down and performs control to display the image of the virtual space on the display device. The control of a virtual object included in the virtual space is changed based on a result of the determination.

Disclosed herein are a dialogue generation system that reflects the location of a character within a virtual space, and a dialogue generation system that provides a more immersive and richer dialogue experience to a user by providing metadata including location information of objects within a virtual space to an API server together with a user's query at the time the user's query is received, thereby enabling a generative AI model to generate more natural and contextual dialogue by considering the character's location.