263 results about "Immersion (virtual reality)" patented technology

The invention relates to the technical field of power system operation training, and discloses a virtual reality-based power grid fault simulation training system and method, and the system comprises a virtual scene modeling module which is used for constructing a three-dimensional model of power grid equipment and an operation environment thereof, and providing a vivid training environment for subsequent modules; and the interaction and operation module is connected with the virtual scene modeling module and realizes interaction between the trainee and the virtual environment by using a VR head-mounted display, a handle and a motion capture device. By adopting a high-precision three-dimensional modeling technology, PBR material rendering and an LOD optimization strategy, high simulation of power grid equipment and an operation environment is realized, students can experience a vivid visual effect and immersion in a virtual reality scene, and meanwhile, by combining a gesture recognition technology realized by motion capture equipment and a convolutional neural network, the real-time simulation of the power grid equipment and the operation environment is realized. Operation actions of trainees can be accurately captured, a natural and visual interaction mode is provided, and the authenticity and operation experience of the training system are greatly improved.

The invention discloses an interactive virtual reality generation method, and belongs to the technical field of virtual reality, and the method comprises the steps: collecting the spatial position and motion data of a user through a pose sensor and a somatosensory sensor, carrying out the three-dimensional point cloud reconstruction and interaction plane parameter extraction through an edge calculation processor, and calling a matched virtual object model to generate an initial scene. A dynamic prediction model is loaded to predict influence parameters of user actions on a scene, scene evolution is calculated in real time in combination with a digital twin engine, and a result is transmitted to a multi-mode feedback module to generate visual, tactile and auditory feedback instructions. And the scene dynamic adjustment module is triggered to adjust the physical attribute parameters by monitoring the bio-electricity signal in real time. According to the method, geometric constraint consistency and semantic reasonable matching of a virtual scene and a real environment are realized through multi-source sensor data fusion and edge calculation, user actions are dynamically responded by combining space-time prediction and a digital twinning technology, scene physical attributes are adaptively adjusted on the basis of bio-electricity signals, and multi-modal feedback cooperation is assisted, so that the user experience is improved. And the reality, immersion and user comfort of virtual reality interaction are obviously improved.

The invention discloses a virtual reality interaction method and system applied to classical famous picture display, and particularly relates to the technical field of virtual reality interaction. Multi-dimensional high-definition image acquisition and composition element three-dimensional modeling are performed on a painting, a cultural context label system is constructed in combination with historical data, a fixation point, an action posture and a staying behavior of a user are perceived in real time, accurate matching of a user behavior and a semantic label is realized, and multi-modal interaction feedback content consistent with the style of the painting is generated, so that the user experience is improved. And typical paths and misunderstanding areas are identified through clustering analysis of multi-user behavior data, and context tags and response logic are dynamically optimized, so that personalized recommendation and semantic guidance are realized, the understanding depth and immersion experience of the users on classical art are effectively improved, and the cultural expression ability and intelligent adaptability of the system are enhanced.

The invention provides a neural rehabilitation training method and system integrating a brain-computer interface and virtual reality, and relates to the technical field of brain-computer interfaces. The method comprises the following steps: constructing an aligned multi-modal feature sequence by collecting electroencephalogram, myoelectricity, joint kinematics, eye movement and physiological load signals; generating an immersion parameter prescription in the baseline stage and setting a time delay and synchronization strategy; according to the nerve quality index, performing cooperative self-adaption of decoder parameters, prescriptions and peripheral assistance; establishing a drift model after the session to update the prior and shorten the re-calibration time; and monitoring dizziness and task load in real time and executing grading treatment. According to the invention, stable closed-loop individualized rehabilitation training is realized, the decoding performance and the rehabilitation effect are improved, and the safety and long-term convergence are ensured.

The invention relates to the technical field of computers, and discloses a real-time rendering and interaction method and system for an immersive virtual reality scene. The method comprises the following steps: fusing tuner inertial data and eyeball tracking data, and constructing a prospective state prediction model; generating a predictive focus field in combination with scene visual saliency; synthesizing an anisotropic temporal-spatial resolution graph according to the predicted head angular velocity; gPU variable-rate coloring is driven to realize non-uniform rendering; and re-projection or dynamic fuzzy correction is executed in a self-adaptive manner according to the attitude prediction error before display. According to the technical scheme, the perception delay and the rendering load are remarkably reduced, and the frame rate stability and the visual immersion in a high-dynamic scene are improved.

A device for simulating a weapon in a virtual reality (VR) environment, an augmented reality (AR) environment, a mixed reality (MR) environment, and / or combinations thereof. The device is adjustable to fit a user's shape and receive a gaming controller. The device includes a forearm grip and a front-end grip that improves the simulation of weaponry and user immersion.

The invention discloses an immersive travel experience system based on the meta-universe technology, which relates to the field of the meta-universe technology and comprises a scene construction module, an interaction equipment module, a data analysis module and a multi-mode interaction module. According to the immersive text travel experience system, virtual reality, augmented reality and 3D rendering technologies are integrated to construct a virtual text travel scene, special equipment is configured to enable a user to feel the virtual text travel scene personally on the scene, meanwhile, the system can further analyze user behavior data in real time, and the user experience is improved. The virtual scene is adjusted according to the interactive behavior of the user in the virtual travel scene, personalized touring experience is provided, the naturalness and depth of interaction are further enhanced by fusing gestures, voice interaction, eye movement tracking and electroencephalogram signal recognition technologies, the user can obtain richer and more real travel experience, and the user experience is improved. The immersion and individuation degree of cultural tourism are improved, and interesting tourism experience is brought.

The invention belongs to the technical field of computer graphics and virtual reality, and discloses a virtual-real fusion-based panoramic roaming construction method for a digital exhibition hall, which effectively solves the problems of easy drift and offset in a virtual environment in a traditional system through a multi-sensor fusion algorithm and a closed-loop optimization mechanism. Under the complex environment of people flow change, illumination fluctuation and the like in an exhibition hall, accurate alignment of virtual content and physical space can still be kept, it is ensured that a user obtains coherent and stable visual experience in the roaming process, and a reliable space reference is provided for virtual-real interaction; the light and shadow effect and the material performance of the virtual content are naturally fused with the physical environment through the physical rendering and multi-sensory interaction technology, and meanwhile, a multi-dimensional immersion sense is constructed in combination with the spatial sound effect and interaction feedback; when the user interacts with the virtual exhibit, sensory experience close to reality can be obtained, and the sense of substitution and attraction of the digital exhibition hall are remarkably improved.

The invention provides a flight environment virtual simulation restoration method and system based on flight data, relates to the technical field of virtual reality and flight simulation, and solves the problem of how to accurately and smoothly restore real flight data to a virtual simulation environment. The method comprises the following steps: acquiring real flight data, converting the real flight data into a data format which can be identified by a UE rendering engine, analyzing and extracting key flight parameters, and smoothing process data corresponding to the key flight parameters, so that the process data smoothly changes when the flight environment of an aircraft is virtually simulated and updated; according to the smoothed process data, updating the aircraft pose in the UE virtual environment of the UE rendering engine to realize the reduction of the flight path; meanwhile, a world space UI is created, and instrument information corresponding to the flight path is updated and displayed in the world space UI. According to the invention, the flight path and instrument display under the simulation condition are close to the real flight condition, and the authenticity and immersion of flight training are effectively improved.

The invention relates to the technical field of virtual reality, in particular to an immersive virtual character interaction method based on virtual reality, which comprises the following steps: acquiring voice information input by a user and action information acquired by action capture equipment, processing and analyzing the voice information and the action information, and on the basis of the obtained initial performance state information, acquiring a virtual character interaction result. Adjusting the initial expression state information under the condition that the association degree of the initial text information and the initial expression state information meets a preset association degree standard, and adjusting the initial text information of the user according to the initial expression state information of the user to obtain target pronunciation information; therefore, the interactive voice and action represented by the virtual character better meet the requirements of the user, and the immersion of the user is improved. According to the method, the problem that the immersive experience of a user is poor due to the fact that the traditional virtual interaction method lacks recognition of postures of legs, feet and the like and the actions made by the user cannot be reflected in a virtual scene is solved.

The invention discloses a whole-process vascular interventional operation training method and system based on a virtual reality technology, and the method comprises the steps: firstly, developing a vascular interventional mechanics and collision simulation module, and achieving the deformation simulation of a blood vessel and a guide wire through the combination of position dynamics, a region shape matching technology and a Cosseerat elastic rod model, the collision between the blood vessel and the guide wire is treated by adopting a wide-to-narrow three-layer progressive collision detection method; secondly, constructing an immersive virtual operation scene through model construction and rendering optimization; visual angle roaming, instrument operation and interface interaction are fused, and multi-mode interaction control driving intervention training is achieved; finally, based on a'module-event 'dual-drive framework, operation tasks such as anesthesia, puncture, radiography, intervention, stent release and hemostasis are sequentially connected in series through a unified state machine, and whole-process training is achieved. The accuracy and stability of blood vessel and guide wire simulation are improved, the training immersion sense is enhanced, interventional operation whole-process training is achieved, and high teaching and practical value is achieved.

The invention discloses a method, a system, equipment and application for realizing multi-dimensional coherent symbiosis between a physical world and a digital world, and relates to the field of virtual reality. According to the application, the entities in the physical world can have the networking capability no matter whether the entities can be networked or not. Through an immersion gateway in a specific field domain, entities in a physical world can be mapped into a digital world, and a multi-dimensional digital body is provided in the digital world and has different forms and functions. In the field domain deployed by the application, the entity of the physical world and the digital body of the digital world can realize the relationship of Coherent Symbiosis, can influence and synchronize with each other, and can keep consistent, harmonious and derived.

The invention relates to the technical field of man-machine interaction, in particular to a virtual reality man-machine interaction method. The method comprises the following steps: S1, designing an interactive interface conforming to a virtual environment; s2, collecting hand actions of a user through a camera; s3, performing real-time processing and analysis on the hand action of the user through a key point detection OpenPose model, and identifying the intention of the hand action of the user; and S4, adjusting the state of the virtual environment according to the intention of the hand action of the user. According to the invention, by combining the YOLO model and the OpenPose model, accurate recognition and real-time response to the hand action of the user are realized. Static features (such as joint angles and palm normals) and dynamic features (such as motion trails, speeds and accelerated speeds) of hand actions are comprehensively utilized, so that visual and natural interaction experience is provided. The user can complete operations such as'grabbing 'and'pointing' through visual gestures, additional equipment is not needed, and the immersion and interactivity of virtual reality are enhanced.

The invention provides an astronaut working load relieving implementation method based on a virtual reality technology in a microgravity environment, and belongs to the field of microgravity environment psychological recovery. The problems that an existing working load relieving system is difficult to provide higher immersion and interactivity for astronauts in a microgravity environment, and is poor in individuation and intervention effect are solved. According to the method, physiological state data and psychological state data of astronauts are collected, task execution data are integrated, workloads are quantified, workload types are identified after comprehensive evaluation, preliminary matching is carried out according to defined matching conditions, a virtual scene is selected through machine learning and multi-dimensional data analysis, and a virtual scene is obtained. And performing continuous fine adjustment in the loaded and presented optimized virtual scene, and recording the process. According to the method, an effective pressure relieving means can be flexibly and accurately provided according to the real-time state of the astronaut and the requirements of the working environment, and the cognitive reconstruction and psychological recovery process is enhanced through the immersion of the virtual reality technology.

The invention provides a virtual reality three-dimensional space data correction method, which comprises the following steps of: firstly, acquiring an image, depth and inertia measurement data of a virtual reality terminal, and a pose, a speed and a force feedback signal of an interaction body, and carrying out time sequence alignment under a unified time reference; an interaction event is identified through collision detection, and parameters such as a contact point, a normal direction, a relative speed, a penetration depth and a contact duration are extracted. Then, physical consistency constraints including no penetration, contact stability, friction consistency, momentum conservation and energy non-increase are constructed, and geometric consistency, depth consistency and physical consistency residual functions are established in the local contact area; and solving surface normal, depth, scale, pose, calibration parameters and other corrections through a robust nonlinear optimization method so as to update the point cloud, the grid and the calibration model. According to the method, the consistency and the stability of geometric modeling and physical interaction in the virtual reality scene can be remarkably improved, and the immersion and the interaction precision are improved.

The invention provides a virtual reality moving method and device for gait self-adaptive translation gain. The method comprises the following steps: determining natural disturbance in a gait cycle when a user naturally walks; according to natural disturbance in the gait cycle, the translation gain of the user in the virtual reality environment is dynamically adjusted; wherein the larger the natural disturbance is, the larger the translation gain corresponding to the natural disturbance is, and the translation gain is used for adjusting the proportion of the walking speed of the user in the virtual space to the actual walking speed of the user in the physical space. According to the method, the use of the translation gain is dynamically adjusted according to the gait cycle of the user, the inconsistency between the user body feeling and the visual perception is reduced by using the motion disturbance of the user, the perception threshold value of the user for the difference between the virtual space motion rate and the physical space motion rate is widened, meanwhile, the occurrence probability of motion sickness is not increased, and the user experience is improved. Therefore, the overall comfort and immersion of the user are improved.

The invention provides a real-time operation remote video consultation system and method based on virtual reality, and the system comprises a driving data collection module which collects multi-modal data; the data processing module is used for carrying out fusion processing on data from different acquisition sources; the virtual image driving module is used for reconstructing a virtual scene of an operation site and performing three-dimensional modeling and rendering on an image acquired by the high-definition camera and an internal structure image acquired by the medical imaging equipment; the template matching module is used for collecting and sorting standard action templates of common surgical operations and matching the standard action templates; the data collaboration module is fused with the virtual scene to display the medical data of the patient; and the 5G robot assistance module remotely controls the robot to execute an action corresponding to the virtual reality scene through 5G. According to the invention, audio and scene fusion is realized, scene fidelity is improved, and consultation immersion is enhanced. Interaction between experts and virtual scenes in consultation can be achieved, consultation efficiency and sense of participation are improved, doctors are assisted in standard operation, and surgical risks are reduced.

The invention discloses a coal mine fireproof simulation training method based on a virtual reality technology, relates to the technical field of coal mine fireproof simulation training, is used for solving the problem that a virtual scene and student operation are asynchronous due to sensor data delay or misalignment in the training process, and comprises the following steps: collecting action data of a student in real time; comprise posture change, hand movement and position coordinate information. Seamless synchronization of the sensor and the virtual scene is ensured through the time synchronization algorithm and the dynamic compensation model, and the safety and effectiveness of training are improved. In combination with a sliding window, a prediction algorithm and a redundancy detection mechanism, the system has high fault-tolerant capability, and training continuity and stability are guaranteed. The dynamic path planning under the fire spreading trend is realized by adopting the A * algorithm, and the guidance is quickly adjusted and corrected when the trainee deviates from the path, so that the real-time response capability and the immersion of training are improved, and the trainee is helped to quickly make a decision and act in an emergency.

The invention discloses a multi-person interaction system and method based on a VR environment, and relates to the technical field of virtual reality, and the method comprises the steps: building a tourist database; on the basis of a player database, analyzing preference behavior style indexes of each player according to action events in the player data; acquiring a game scene corresponding to the real-time progress in the game linear process, analyzing a task type in the game scene, and evaluating a difficulty index of the game scene; according to the difficulty index of the game scene, carrying out association matching screening on the preference behavior style index of each player, and generating a game scene optimal person combination of the game process progress; according to the task optimal personnel combination of the game process progress and the current game space coordinate position of the personnel combination, a guide path scene is generated, and game interaction matching is completed. The method has the advantages that the interaction frequency in the VR game scene is improved, and the game immersion is improved.

The invention discloses an intelligent interaction method and system for user behavior data in a virtual reality environment, and particularly relates to the technical field of virtual reality. Evaluating the matching degree between the interaction intention characteristics of the user and the immersion target of the user by analyzing the interaction intention characteristics of the user in the virtual reality environment; the adaptability of the user to the virtual environment is evaluated by analyzing behavior changes of the user in different virtual scenes. And based on the overall integrating degree index and the adaptability index, comprehensively evaluating the immersion state of the user, and judging whether the immersion depth of the virtual reality system needs to be adjusted or not. When adjustment is needed, the refined interaction demand intensity of the user is analyzed, and the interaction strategy of the virtual reality system is adjusted in combination with the overall integrating degree index, the adaptability index and the demand intensity index, so that the interaction demands of different users in the virtual environment are met, and the overall experience effect of the user is improved.

The invention provides an image fusion stereoscopic display method and system based on a Unity engine, and relates to the technical field of computer graphics and virtual reality. According to the method, a left-eye camera and a right-eye camera are configured in a Unity scene, left and right view angle images are collected according to interpupillary distance parameters, and left-eye and right-eye rendering textures are generated; generating a UI texture according to the Canvas type of the UI element, executing parallax compensation, pixel alignment and image fusion processing through a Compute Shader, and superposing image layers according to the transparency of the UI texture to generate a synthetic display image; and introducing a previous frame result into the fused image, and realizing time continuous output based on an inter-frame smooth function. And outputting the synthesized texture to a device supporting a plurality of stereoscopic display modes through a graphic rendering pipeline. According to the method, efficient fusion of the 3D image and the UI is realized, the rendering efficiency and the visual immersion are improved, and the method is suitable for scenes such as virtual reality, augmented reality and digital twinning.

The invention provides an intelligent interactive digital somatosensory system and method, and relates to the field of somatosensory interaction. The system comprises an acquisition module, a posture capture module, a behavior optimization module, a sensor optimization module and a virtual object interaction module. Wherein the acquisition module acquires physiological, behavior and environmental data in real time; the posture capturing module captures the three-dimensional space position and posture change of the user through a deep learning algorithm; the behavior optimization module dynamically adjusts a feedback interaction mode based on user historical data; the sensor optimization module dynamically adjusts the layout and configuration of the sensor; the virtual object interaction module is combined with a virtual reality technology to simulate dynamic physical feedback of a virtual object in real time; the system improves the naturalness and immersion of interaction through multi-sensor cooperation and a deep learning algorithm.

The invention relates to the technical field of virtual reality, and discloses a hydraulic power plant operation training system and method based on the virtual reality technology, and the method comprises the steps: firstly obtaining historical operation time series data of a hydraulic power plant, dividing the historical operation time series data into discrete operation segments, and obtaining operation segment time series data; constructing a hydraulic power plant operation knowledge graph based on the operation fragments and the operation fragment time sequence data; mapping the hydraulic power plant operation knowledge graph to a three-dimensional virtual space, and constructing a hydraulic power plant virtual reality scene; and finally, designing a VR operation training course based on the scene, and carrying out immersive VR operation training. According to the invention, hydraulic power plant operation knowledge is extracted by using a knowledge graph technology, and immersive operation training is carried out in combination with a virtual reality technology, so that the intuition, interactivity and immersion of training are greatly improved, and understanding and mastering of students on hydraulic power plant operation regulations and safety precautions are deepened.

The invention relates to a tactile enhancement training system based on virtual reality. The tactile enhancement training system comprises a virtual reality unit, a tactile feedback unit and a processing unit. The virtual reality unit interacts with a virtual reality environment; the tactile feedback unit is used for being worn on the hand and feeding back acting force corresponding to a grabbed object in the virtual reality environment to fingers in the mode of applying traction force to the fingers, and the processing unit is used for determining contact points of the grabbed object in the virtual reality environment. According to the contact points of the grabbed object, the acting force fed back by the tactile feedback unit to the fingers is analyzed, information related to the acting force is sent to the tactile feedback unit, and the acting force is related to the physical characteristics of all the contact points of the grabbed object. When the user interacts with the virtual object, the technical effect of obtaining more real force feedback by applying the traction force to the fingers is achieved, so that the user can feel real physical feedback in the interaction process, and the interaction immersion of the user is enhanced.

The invention discloses a virtual scene immersion prediction method based on electroencephalogram signals. The method comprises the following steps: firstly, based on a binocular imaging principle, constructing a space distortion model of different distortion effects caused by mismatching of a camera shooting field angle and a human eye field angle, and quantifying a distortion degree by using an index based on a field angle difference; secondly, a man-machine interaction experiment involving virtual reality space distortion is designed, and subjective I PQ scoring data and objective EEG signal data under different distortion conditions are collected; preprocessing such as filtering, artifact removal and spectral analysis is carried out on the collected EEG original signal so as to calculate the absolute power value of a specified brain wave frequency band. And finally, combining the calculated electroencephalogram absolute power value with the distortion index, constructing an immersion prediction model based on a polynomial regression algorithm, and realizing objective prediction of subjective immersion. According to the method, the influence mechanism of virtual space distortion on immersion can be effectively revealed, and a solid theoretical support is provided for optimizing virtual reality space design.

The invention discloses a VR path optimization system and method based on a BIM technology, and relates to the technical field of a building information model (BIM) and virtual reality (VR), and the system comprises the following components: a BIM model construction module which is used for constructing a BIM model containing the space structure, facility layout and personnel flow information of a building through integrating a CAD drawing, GIS data and sensor data, by deeply integrating the social relation data and the social activity requirements of the user, highly personalized social interaction path recommendation is realized, the social experience of the user in the building space is greatly improved, the path planning is enabled to better meet the actual requirements of the user, and the user experience is improved. According to the method, the social interaction demand of the user is further fused, a path which is efficient and meets the social interaction demand is planned for the user, and the satisfaction degree and immersion of the user in the using process are remarkably enhanced through a recommendation mechanism based on user behaviors and psychology.

The invention provides a vehicle-mounted virtual reality synchronization system, which can solve the problem of motion sickness caused by mismatching of vehicle dynamic motion and visual perception in a vehicle-mounted environment of traditional VR. The system collects the acceleration, angular velocity and GPS position information of a vehicle through the sensor module, and the data analysis module maps the information to a virtual camera coordinate system in real time. The virtual camera motion control module ensures that the motion of the virtual camera is synchronized with the actual motion of the vehicle. And the dynamic scene response module adjusts the virtual scene according to the vehicle state to enhance the immersion. Finally, the virtual reality equipment provides a dynamic VR picture synchronous with the vehicle motion, the motion sickness symptom is reduced, and the user experience is improved. Furthermore, the system has the design of light weight and low power consumption, is suitable for various vehicles, and has a wide application prospect.

The invention relates to the technical field of virtual reality, and discloses an interactive education platform based on a virtual reality technology, which comprises an acquisition and preprocessing module, a scene generation and interaction module, a self-adaptive learning module, an interaction module, an evaluation module and an evidence storage module, by constructing a dynamic interactive virtual scene and a multi-modal feedback mechanism, the problems of scene staticization and single interaction mode in traditional virtual reality education are solved, real-time disassembly, combination and parameter adjustment of scene elements are realized by means of a UE5 engine and a programmed generation algorithm, and eye movement tracking, gesture recognition and tactile feedback technologies are combined, so that the real-time interaction of the scene elements is realized. The immersion and participation degree of the learning process are significantly improved, and students can deepen the understanding and application of knowledge in immersive operation.

The invention discloses a safety accident dynamic experience simulation courseware development method, system and device and a medium thereof, and the method comprises the following steps: obtaining demand data of safety production training, and analyzing the demand data based on a data analysis tool to obtain a demand analysis result. According to the invention, a safety accident experience simulation scene is constructed by using a virtual reality technology, so that employees can personally feel the effects of vibration, impact and the like of an accident, meanwhile, a plurality of interaction modes are designed, the interactivity and immersion of training are enhanced, and the employees do not passively accept knowledge but actively explore a safety accident scene and a coping method; security risk types of different industries are grasped through data analysis, scenes are constructed in a targeted manner, course contents are designed in combination with safety laws and regulations and standards, and precise training is performed for special risks of each industry, so that the training effects of different industries are improved, personalized adjustment is performed according to the cognitive level of employees on safety accidents, and the safety risk training efficiency is improved. And personalized safety training is realized.

The invention discloses an electric power production safety simulation training system and method based on AR virtual reality. The system comprises AR glasses, a simulation teaching resource cloud platform and a 3D modeling real-time interaction subsystem. The method comprises the following steps: firstly, constructing a virtual reality scene of a power production environment by using an AR virtual reality technology; a plurality of training modules are arranged in the virtual reality scene, and each training module corresponds to one kind of power production safety knowledge or skill; the employee wears AR glasses, enters a virtual reality scene, and selects a corresponding training module for training according to own needs; the training system evaluates the operation of the employees and provides feedback and suggestions according to the evaluation result; the training system records the training progress and the training effect of the employees and generates a training report; and the training system periodically updates the training content. According to the invention, the immersion and reality of training are improved, the safety awareness of employees is enhanced, the safety awareness of the employees is improved, the training cost is reduced, and the training effect is improved.