200 results about "Immersion (virtual reality)" patented technology

The invention discloses an interactive virtual reality generation method, and belongs to the technical field of virtual reality, and the method comprises the steps: collecting the spatial position and motion data of a user through a pose sensor and a somatosensory sensor, carrying out the three-dimensional point cloud reconstruction and interaction plane parameter extraction through an edge calculation processor, and calling a matched virtual object model to generate an initial scene. A dynamic prediction model is loaded to predict influence parameters of user actions on a scene, scene evolution is calculated in real time in combination with a digital twin engine, and a result is transmitted to a multi-mode feedback module to generate visual, tactile and auditory feedback instructions. And the scene dynamic adjustment module is triggered to adjust the physical attribute parameters by monitoring the bio-electricity signal in real time. According to the method, geometric constraint consistency and semantic reasonable matching of a virtual scene and a real environment are realized through multi-source sensor data fusion and edge calculation, user actions are dynamically responded by combining space-time prediction and a digital twinning technology, scene physical attributes are adaptively adjusted on the basis of bio-electricity signals, and multi-modal feedback cooperation is assisted, so that the user experience is improved. And the reality, immersion and user comfort of virtual reality interaction are obviously improved.

The invention discloses a virtual reality interaction method and system applied to classical famous picture display, and particularly relates to the technical field of virtual reality interaction. Multi-dimensional high-definition image acquisition and composition element three-dimensional modeling are performed on a painting, a cultural context label system is constructed in combination with historical data, a fixation point, an action posture and a staying behavior of a user are perceived in real time, accurate matching of a user behavior and a semantic label is realized, and multi-modal interaction feedback content consistent with the style of the painting is generated, so that the user experience is improved. And typical paths and misunderstanding areas are identified through clustering analysis of multi-user behavior data, and context tags and response logic are dynamically optimized, so that personalized recommendation and semantic guidance are realized, the understanding depth and immersion experience of the users on classical art are effectively improved, and the cultural expression ability and intelligent adaptability of the system are enhanced.

The invention provides a neural rehabilitation training method and system integrating a brain-computer interface and virtual reality, and relates to the technical field of brain-computer interfaces. The method comprises the following steps: constructing an aligned multi-modal feature sequence by collecting electroencephalogram, myoelectricity, joint kinematics, eye movement and physiological load signals; generating an immersion parameter prescription in the baseline stage and setting a time delay and synchronization strategy; according to the nerve quality index, performing cooperative self-adaption of decoder parameters, prescriptions and peripheral assistance; establishing a drift model after the session to update the prior and shorten the re-calibration time; and monitoring dizziness and task load in real time and executing grading treatment. According to the invention, stable closed-loop individualized rehabilitation training is realized, the decoding performance and the rehabilitation effect are improved, and the safety and long-term convergence are ensured.

The invention relates to the technical field of computers, and discloses a real-time rendering and interaction method and system for an immersive virtual reality scene. The method comprises the following steps: fusing tuner inertial data and eyeball tracking data, and constructing a prospective state prediction model; generating a predictive focus field in combination with scene visual saliency; synthesizing an anisotropic temporal-spatial resolution graph according to the predicted head angular velocity; gPU variable-rate coloring is driven to realize non-uniform rendering; and re-projection or dynamic fuzzy correction is executed in a self-adaptive manner according to the attitude prediction error before display. According to the technical scheme, the perception delay and the rendering load are remarkably reduced, and the frame rate stability and the visual immersion in a high-dynamic scene are improved.

A device for simulating a weapon in a virtual reality (VR) environment, an augmented reality (AR) environment, a mixed reality (MR) environment, and / or combinations thereof. The device is adjustable to fit a user's shape and receive a gaming controller. The device includes a forearm grip and a front-end grip that improves the simulation of weaponry and user immersion.

The invention discloses an immersive travel experience system based on the meta-universe technology, which relates to the field of the meta-universe technology and comprises a scene construction module, an interaction equipment module, a data analysis module and a multi-mode interaction module. According to the immersive text travel experience system, virtual reality, augmented reality and 3D rendering technologies are integrated to construct a virtual text travel scene, special equipment is configured to enable a user to feel the virtual text travel scene personally on the scene, meanwhile, the system can further analyze user behavior data in real time, and the user experience is improved. The virtual scene is adjusted according to the interactive behavior of the user in the virtual travel scene, personalized touring experience is provided, the naturalness and depth of interaction are further enhanced by fusing gestures, voice interaction, eye movement tracking and electroencephalogram signal recognition technologies, the user can obtain richer and more real travel experience, and the user experience is improved. The immersion and individuation degree of cultural tourism are improved, and interesting tourism experience is brought.

The invention belongs to the technical field of computer graphics and virtual reality, and discloses a virtual-real fusion-based panoramic roaming construction method for a digital exhibition hall, which effectively solves the problems of easy drift and offset in a virtual environment in a traditional system through a multi-sensor fusion algorithm and a closed-loop optimization mechanism. Under the complex environment of people flow change, illumination fluctuation and the like in an exhibition hall, accurate alignment of virtual content and physical space can still be kept, it is ensured that a user obtains coherent and stable visual experience in the roaming process, and a reliable space reference is provided for virtual-real interaction; the light and shadow effect and the material performance of the virtual content are naturally fused with the physical environment through the physical rendering and multi-sensory interaction technology, and meanwhile, a multi-dimensional immersion sense is constructed in combination with the spatial sound effect and interaction feedback; when the user interacts with the virtual exhibit, sensory experience close to reality can be obtained, and the sense of substitution and attraction of the digital exhibition hall are remarkably improved.

The invention provides a flight environment virtual simulation restoration method and system based on flight data, relates to the technical field of virtual reality and flight simulation, and solves the problem of how to accurately and smoothly restore real flight data to a virtual simulation environment. The method comprises the following steps: acquiring real flight data, converting the real flight data into a data format which can be identified by a UE rendering engine, analyzing and extracting key flight parameters, and smoothing process data corresponding to the key flight parameters, so that the process data smoothly changes when the flight environment of an aircraft is virtually simulated and updated; according to the smoothed process data, updating the aircraft pose in the UE virtual environment of the UE rendering engine to realize the reduction of the flight path; meanwhile, a world space UI is created, and instrument information corresponding to the flight path is updated and displayed in the world space UI. According to the invention, the flight path and instrument display under the simulation condition are close to the real flight condition, and the authenticity and immersion of flight training are effectively improved.

The invention relates to the technical field of virtual reality, in particular to an immersive virtual character interaction method based on virtual reality, which comprises the following steps: acquiring voice information input by a user and action information acquired by action capture equipment, processing and analyzing the voice information and the action information, and on the basis of the obtained initial performance state information, acquiring a virtual character interaction result. Adjusting the initial expression state information under the condition that the association degree of the initial text information and the initial expression state information meets a preset association degree standard, and adjusting the initial text information of the user according to the initial expression state information of the user to obtain target pronunciation information; therefore, the interactive voice and action represented by the virtual character better meet the requirements of the user, and the immersion of the user is improved. According to the method, the problem that the immersive experience of a user is poor due to the fact that the traditional virtual interaction method lacks recognition of postures of legs, feet and the like and the actions made by the user cannot be reflected in a virtual scene is solved.

The invention discloses a whole-process vascular interventional operation training method and system based on a virtual reality technology, and the method comprises the steps: firstly, developing a vascular interventional mechanics and collision simulation module, and achieving the deformation simulation of a blood vessel and a guide wire through the combination of position dynamics, a region shape matching technology and a Cosseerat elastic rod model, the collision between the blood vessel and the guide wire is treated by adopting a wide-to-narrow three-layer progressive collision detection method; secondly, constructing an immersive virtual operation scene through model construction and rendering optimization; visual angle roaming, instrument operation and interface interaction are fused, and multi-mode interaction control driving intervention training is achieved; finally, based on a'module-event 'dual-drive framework, operation tasks such as anesthesia, puncture, radiography, intervention, stent release and hemostasis are sequentially connected in series through a unified state machine, and whole-process training is achieved. The accuracy and stability of blood vessel and guide wire simulation are improved, the training immersion sense is enhanced, interventional operation whole-process training is achieved, and high teaching and practical value is achieved.

The invention provides an astronaut working load relieving implementation method based on a virtual reality technology in a microgravity environment, and belongs to the field of microgravity environment psychological recovery. The problems that an existing working load relieving system is difficult to provide higher immersion and interactivity for astronauts in a microgravity environment, and is poor in individuation and intervention effect are solved. According to the method, physiological state data and psychological state data of astronauts are collected, task execution data are integrated, workloads are quantified, workload types are identified after comprehensive evaluation, preliminary matching is carried out according to defined matching conditions, a virtual scene is selected through machine learning and multi-dimensional data analysis, and a virtual scene is obtained. And performing continuous fine adjustment in the loaded and presented optimized virtual scene, and recording the process. According to the method, an effective pressure relieving means can be flexibly and accurately provided according to the real-time state of the astronaut and the requirements of the working environment, and the cognitive reconstruction and psychological recovery process is enhanced through the immersion of the virtual reality technology.

The invention provides a virtual reality three-dimensional space data correction method, which comprises the following steps of: firstly, acquiring an image, depth and inertia measurement data of a virtual reality terminal, and a pose, a speed and a force feedback signal of an interaction body, and carrying out time sequence alignment under a unified time reference; an interaction event is identified through collision detection, and parameters such as a contact point, a normal direction, a relative speed, a penetration depth and a contact duration are extracted. Then, physical consistency constraints including no penetration, contact stability, friction consistency, momentum conservation and energy non-increase are constructed, and geometric consistency, depth consistency and physical consistency residual functions are established in the local contact area; and solving surface normal, depth, scale, pose, calibration parameters and other corrections through a robust nonlinear optimization method so as to update the point cloud, the grid and the calibration model. According to the method, the consistency and the stability of geometric modeling and physical interaction in the virtual reality scene can be remarkably improved, and the immersion and the interaction precision are improved.

The invention provides a virtual reality moving method and device for gait self-adaptive translation gain. The method comprises the following steps: determining natural disturbance in a gait cycle when a user naturally walks; according to natural disturbance in the gait cycle, the translation gain of the user in the virtual reality environment is dynamically adjusted; wherein the larger the natural disturbance is, the larger the translation gain corresponding to the natural disturbance is, and the translation gain is used for adjusting the proportion of the walking speed of the user in the virtual space to the actual walking speed of the user in the physical space. According to the method, the use of the translation gain is dynamically adjusted according to the gait cycle of the user, the inconsistency between the user body feeling and the visual perception is reduced by using the motion disturbance of the user, the perception threshold value of the user for the difference between the virtual space motion rate and the physical space motion rate is widened, meanwhile, the occurrence probability of motion sickness is not increased, and the user experience is improved. Therefore, the overall comfort and immersion of the user are improved.

The invention provides a real-time operation remote video consultation system and method based on virtual reality, and the system comprises a driving data collection module which collects multi-modal data; the data processing module is used for carrying out fusion processing on data from different acquisition sources; the virtual image driving module is used for reconstructing a virtual scene of an operation site and performing three-dimensional modeling and rendering on an image acquired by the high-definition camera and an internal structure image acquired by the medical imaging equipment; the template matching module is used for collecting and sorting standard action templates of common surgical operations and matching the standard action templates; the data collaboration module is fused with the virtual scene to display the medical data of the patient; and the 5G robot assistance module remotely controls the robot to execute an action corresponding to the virtual reality scene through 5G. According to the invention, audio and scene fusion is realized, scene fidelity is improved, and consultation immersion is enhanced. Interaction between experts and virtual scenes in consultation can be achieved, consultation efficiency and sense of participation are improved, doctors are assisted in standard operation, and surgical risks are reduced.

The invention provides an image fusion stereoscopic display method and system based on a Unity engine, and relates to the technical field of computer graphics and virtual reality. According to the method, a left-eye camera and a right-eye camera are configured in a Unity scene, left and right view angle images are collected according to interpupillary distance parameters, and left-eye and right-eye rendering textures are generated; generating a UI texture according to the Canvas type of the UI element, executing parallax compensation, pixel alignment and image fusion processing through a Compute Shader, and superposing image layers according to the transparency of the UI texture to generate a synthetic display image; and introducing a previous frame result into the fused image, and realizing time continuous output based on an inter-frame smooth function. And outputting the synthesized texture to a device supporting a plurality of stereoscopic display modes through a graphic rendering pipeline. According to the method, efficient fusion of the 3D image and the UI is realized, the rendering efficiency and the visual immersion are improved, and the method is suitable for scenes such as virtual reality, augmented reality and digital twinning.

The invention provides an intelligent interactive digital somatosensory system and method, and relates to the field of somatosensory interaction. The system comprises an acquisition module, a posture capture module, a behavior optimization module, a sensor optimization module and a virtual object interaction module. Wherein the acquisition module acquires physiological, behavior and environmental data in real time; the posture capturing module captures the three-dimensional space position and posture change of the user through a deep learning algorithm; the behavior optimization module dynamically adjusts a feedback interaction mode based on user historical data; the sensor optimization module dynamically adjusts the layout and configuration of the sensor; the virtual object interaction module is combined with a virtual reality technology to simulate dynamic physical feedback of a virtual object in real time; the system improves the naturalness and immersion of interaction through multi-sensor cooperation and a deep learning algorithm.

The invention relates to the technical field of virtual reality, and discloses a hydraulic power plant operation training system and method based on the virtual reality technology, and the method comprises the steps: firstly obtaining historical operation time series data of a hydraulic power plant, dividing the historical operation time series data into discrete operation segments, and obtaining operation segment time series data; constructing a hydraulic power plant operation knowledge graph based on the operation fragments and the operation fragment time sequence data; mapping the hydraulic power plant operation knowledge graph to a three-dimensional virtual space, and constructing a hydraulic power plant virtual reality scene; and finally, designing a VR operation training course based on the scene, and carrying out immersive VR operation training. According to the invention, hydraulic power plant operation knowledge is extracted by using a knowledge graph technology, and immersive operation training is carried out in combination with a virtual reality technology, so that the intuition, interactivity and immersion of training are greatly improved, and understanding and mastering of students on hydraulic power plant operation regulations and safety precautions are deepened.

The invention discloses a virtual scene immersion prediction method based on electroencephalogram signals. The method comprises the following steps: firstly, based on a binocular imaging principle, constructing a space distortion model of different distortion effects caused by mismatching of a camera shooting field angle and a human eye field angle, and quantifying a distortion degree by using an index based on a field angle difference; secondly, a man-machine interaction experiment involving virtual reality space distortion is designed, and subjective I PQ scoring data and objective EEG signal data under different distortion conditions are collected; preprocessing such as filtering, artifact removal and spectral analysis is carried out on the collected EEG original signal so as to calculate the absolute power value of a specified brain wave frequency band. And finally, combining the calculated electroencephalogram absolute power value with the distortion index, constructing an immersion prediction model based on a polynomial regression algorithm, and realizing objective prediction of subjective immersion. According to the method, the influence mechanism of virtual space distortion on immersion can be effectively revealed, and a solid theoretical support is provided for optimizing virtual reality space design.

The invention relates to the technical field of virtual reality, and discloses an interactive education platform based on a virtual reality technology, which comprises an acquisition and preprocessing module, a scene generation and interaction module, a self-adaptive learning module, an interaction module, an evaluation module and an evidence storage module, by constructing a dynamic interactive virtual scene and a multi-modal feedback mechanism, the problems of scene staticization and single interaction mode in traditional virtual reality education are solved, real-time disassembly, combination and parameter adjustment of scene elements are realized by means of a UE5 engine and a programmed generation algorithm, and eye movement tracking, gesture recognition and tactile feedback technologies are combined, so that the real-time interaction of the scene elements is realized. The immersion and participation degree of the learning process are significantly improved, and students can deepen the understanding and application of knowledge in immersive operation.

The invention relates to the technical field of virtual reality, and particularly discloses a traditional culture scene construction method based on VR, and the method comprises the steps: data collection, feature extraction, multi-modal fusion, scene construction and user interaction. According to the scheme, cross-modal unified spatial expression is constructed for multi-modal data, the semantic fusion capability among cultural elements is enhanced, a multi-modal fusion network is constructed, semantic information, visual information and geometric structures are introduced layer by layer, gradual enhancement of feature aggregation under semantic driving is realized, and semantic consistency and output quality of fusion expression are effectively ensured; based on the fused multi-modal feature vector, the geometric morphology of entities and scene elements corresponding to culture semantics is extracted, the structural integrity and culture expressive power of a scene are effectively improved, and the immersion of a traditional culture scene and the visual reality sense of a user are effectively improved through highly real texture mapping, light and shadow simulation and scene rendering.

The invention relates to a virtual reality and network interaction technology, and discloses a virtual space multi-person interaction synchronous control method oriented to an end-cloud collaborative architecture. Through combination of end-side prediction and cloud arbitration, low-delay transmission and global consistency of a multi-user interaction state are realized. The method specifically comprises the steps that an end side carries out prediction and feature extraction on action and voice data, and redundant transmission is reduced; the key state parameters are uploaded to a cloud end and are judged by a global consistency model and a conflict arbitration mechanism in a unified manner, and a synchronization instruction is generated; and the end side performs rendering and feedback according to a result. According to the method, end-cloud hierarchical prediction and arbitration, a priority-driven protocol and bandwidth adaptive control are combined, delay and conflicts are effectively reduced, and cooperation efficiency, immersion and network adaptability are improved. The method can be widely applied to the fields of universe, online education, remote collaboration, virtual simulation and the like.

The invention relates to an interaction method and device based on virtual reality, equipment and a medium. According to the method, firstly, state data of a user in a virtual reality environment is collected and preprocessed to generate a standardized data stream, and then the distance, orientation similarity and interaction frequency between the user and a virtual avatar are calculated based on the data so as to construct a situational social graph representing social relation strength. Meanwhile, an attention model representing attention weight is constructed by analyzing a fixation point and a head direction of a virtual avatar of the user, and then information priority is calculated through weighted summation of social relation strength and the attention weight by utilizing a situational social graph and the attention model; according to the method and the device, the priority of the user is obtained, the audio, visual and text information is dynamically filtered or enhanced according to the priority to generate the optimized information flow, and finally the information flow is presented in the virtual reality environment, so that the cognitive load of the user in a dense social scene is effectively reduced, and the social interaction efficiency and immersion are improved.

The invention discloses an interaction method and system for a virtual reality education scene, and belongs to the technical field of man-machine interaction. The input rate of a user is collected in real time, the update response time of a virtual object is synchronously recorded, and the interaction speed of the virtual object is calculated based on the action rate of input equipment and the response time of the virtual object. Calculating the synchronous delay between the input device and the virtual environment, dividing the synchronous delay into a low delay level, a middle delay level and a high delay level, and maintaining the current interaction mode for the low delay; for high delay, an emergency optimization measure is started; for middle delay, a partial optimization mechanism is started, including adjustment of object update frequency in a virtual environment or reduction of dynamic elements, and automatic adjustment of an optimization strategy based on user interaction feedback data, the technology can significantly improve response precision and interaction experience of a virtual reality system, reduce distortion and unnatural feeling caused by delay, and improve user experience. And the immersion and interaction experience of the user are enhanced.

The invention discloses a directional floor vibration feedback method and system. The directional floor vibration feedback method comprises the steps of obtaining spatial information and audio information of a virtual object and state information of a target user; obtaining distribution parameters according to the spatial information and the state information, and performing overall frequency scaling on the audio information to obtain vibration waveform data; distributing the vibration waveform data according to the distribution parameters to obtain vibration intensity distribution information; and performing vibration feedback on the target user according to the vibration intensity distribution information. According to the invention, space sound rendering and floor vibration feedback can be driven at the same time, synchronous transmission of sound and vibration is realized, and the space perception and immersion of virtual reality are improved.

The invention provides an application analysis method and system of virtual reality in historical education, and relates to the technical field of virtual reality, and the method comprises the steps: S1, obtaining literature and user data of a virtual reality technology in historical education from a plurality of data sources, and forming a literature topic network; s2, constructing a topic clustering model by using a keyword co-occurrence algorithm, defining a scene immersion parameter (ICF) and an educational adaptability coefficient (EAI), and quantitatively evaluating the immersion effect and the teaching matching degree of the virtual reality technology; s3, through time sequence analysis, the evolution trend of the hotspot along with time is tracked and studied; s4, literature metering and mechanism evaluation are carried out, the quotation frequency is calculated, and high-influence authors and research mechanisms are evaluated; and S5, based on an analysis result, improving content diversity, standardizing an evaluation method and teacher training support. According to the method, the scene immersion degree parameter (ICF) and the education adaptability coefficient (EAI) are defined, so that the immersion effect and the teaching adaptability of virtual reality applied to historical education can be quantified.

An interactive data immersion and collaboration system comprising an augmented reality (AR) or virtual reality (VR) headwear (e.g., glasses, goggles, headset, etc.) and a computer software application configured to display to the user a dynamic, interactive presentation of data or data sets in a virtual environment that appears to surround the user and that enables a user to configure, arrange, and / or edit the data in a variety of ways.

The invention discloses a virtual exhibition hall system construction method, an exhibition system and a storage medium, and relates to the technical field of virtual reality and three-dimensional modeling, and the method comprises the steps: planning an exhibition hall layout according to the number of exhibits, and constructing a three-dimensional virtual exhibition hall model; mapping textures are set for all the areas of the exhibition hall, and a mapping model is generated through illumination baking; and setting exhibit point locations, embedding display materials, constructing interaction logic and configuring an interaction mode. According to the method, intelligent statistics and partitioning are carried out on the exhibits, the spatial layout of the exhibition hall is optimized, the design efficiency and the visit fluency are improved, the reality sense and the immersion experience of the exhibits are improved, meanwhile, rendering resource consumption is reduced, the visual effect is improved, multi-terminal interaction adaptation is supported, user behaviors are recorded, operation is optimized, and the user experience is improved. Dynamic updating and personalized recommendation are achieved, the intelligent level and user experience of the exhibition hall are comprehensively improved, different user requirements are met, and system expansibility and maintenance convenience are enhanced.

The utility model discloses a naked eye virtual reality suspension ball film watching facility and a film watching system, and belongs to the technical field of naked eye virtual reality film watching, the naked eye virtual reality suspension ball film watching facility comprises a film watching hall, and the naked eye virtual reality suspension ball film watching facility comprises a suspension ball, a support frame assembly, a lifting mechanism and a film watching well; a display screen is laid on the outer surface of the hanging ball, the supporting frame assembly is arranged on the film watching hall, the lifting mechanism is arranged on the supporting frame assembly, the lifting mechanism is connected with the hanging ball through a hanging rope, and the lifting mechanism is used for driving the hanging ball to ascend and descend; the film watching well is arranged below the film watching hall, the side wall of the film watching well is transparent, and the film watching well is used for containing the hanging balls. According to the utility model, the problem that the immersion and infection are difficult to be further improved due to the fact that the planarity of the picture displayed by the existing dome screen and projection film watching mode is too strong and the picture with deep scene and high dynamic is difficult to build can be solved.

The application discloses an immersive space virtual-real interaction method and relates to the technical field of virtual reality; after the game starts, the first sub-time zone of each game stage is taken as a starting data collection window, EEG signal data of a player is collected, an alpha wave trend graph is constructed, through a series of calculation and analysis, including determining a reference frequency range, identifying an abnormal point, calculating an alpha wave variation ratio, an alpha wave evaluation value of the player in the starting data collection window is obtained, this process can accurately evaluate the brain state of the player in the starting stage of the game, the change trend of the player's immersion is predicted in advance and the intensity of the tactile feedback is adjusted in time, the player's frequent "out of the game" in the game process is avoided, the coherence and immersion of the game experience are maintained, when the alpha wave evaluation value of the player shows that the immersion may decrease, the tactile feedback is enhanced to attract attention, the game participation is improved, and the player can continuously immerse in the game.

This invention discloses a virtual reality assistive device base. A spherical connecting block is fixedly connected to the upper end of a mounting column. A connecting column is located above the spherical connecting block, and a mounting groove is formed on the lower surface of the connecting column. The spherical connecting block is placed in the mounting groove. A seat is provided at the upper end of the connecting column. Four grooves are formed at equal angles on the lower surface of the seat. There are four electric push rods, which are respectively placed around the upper surface of the mounting plate. Each electric push rod has a connecting rod at its upper end, and each connecting rod has a support plate at its upper end. The upper end of the support plate is placed in a groove. There are four baffles, which are respectively placed around the upper surface of the mounting plate. The baffles are fixedly connected to the mounting plate. This allows the user's body to be rotated or tilted, increasing immersion and realism, and improving the user experience.