167 results about "Immersion (virtual reality)" patented technology

The invention discloses an interactive virtual reality generation method, and belongs to the technical field of virtual reality, and the method comprises the steps: collecting the spatial position and motion data of a user through a pose sensor and a somatosensory sensor, carrying out the three-dimensional point cloud reconstruction and interaction plane parameter extraction through an edge calculation processor, and calling a matched virtual object model to generate an initial scene. A dynamic prediction model is loaded to predict influence parameters of user actions on a scene, scene evolution is calculated in real time in combination with a digital twin engine, and a result is transmitted to a multi-mode feedback module to generate visual, tactile and auditory feedback instructions. And the scene dynamic adjustment module is triggered to adjust the physical attribute parameters by monitoring the bio-electricity signal in real time. According to the method, geometric constraint consistency and semantic reasonable matching of a virtual scene and a real environment are realized through multi-source sensor data fusion and edge calculation, user actions are dynamically responded by combining space-time prediction and a digital twinning technology, scene physical attributes are adaptively adjusted on the basis of bio-electricity signals, and multi-modal feedback cooperation is assisted, so that the user experience is improved. And the reality, immersion and user comfort of virtual reality interaction are obviously improved.

The invention discloses a virtual reality interaction method and system applied to classical famous picture display, and particularly relates to the technical field of virtual reality interaction. Multi-dimensional high-definition image acquisition and composition element three-dimensional modeling are performed on a painting, a cultural context label system is constructed in combination with historical data, a fixation point, an action posture and a staying behavior of a user are perceived in real time, accurate matching of a user behavior and a semantic label is realized, and multi-modal interaction feedback content consistent with the style of the painting is generated, so that the user experience is improved. And typical paths and misunderstanding areas are identified through clustering analysis of multi-user behavior data, and context tags and response logic are dynamically optimized, so that personalized recommendation and semantic guidance are realized, the understanding depth and immersion experience of the users on classical art are effectively improved, and the cultural expression ability and intelligent adaptability of the system are enhanced.

The invention provides a neural rehabilitation training method and system integrating a brain-computer interface and virtual reality, and relates to the technical field of brain-computer interfaces. The method comprises the following steps: constructing an aligned multi-modal feature sequence by collecting electroencephalogram, myoelectricity, joint kinematics, eye movement and physiological load signals; generating an immersion parameter prescription in the baseline stage and setting a time delay and synchronization strategy; according to the nerve quality index, performing cooperative self-adaption of decoder parameters, prescriptions and peripheral assistance; establishing a drift model after the session to update the prior and shorten the re-calibration time; and monitoring dizziness and task load in real time and executing grading treatment. According to the invention, stable closed-loop individualized rehabilitation training is realized, the decoding performance and the rehabilitation effect are improved, and the safety and long-term convergence are ensured.

The invention relates to the technical field of computers, and discloses a real-time rendering and interaction method and system for an immersive virtual reality scene. The method comprises the following steps: fusing tuner inertial data and eyeball tracking data, and constructing a prospective state prediction model; generating a predictive focus field in combination with scene visual saliency; synthesizing an anisotropic temporal-spatial resolution graph according to the predicted head angular velocity; gPU variable-rate coloring is driven to realize non-uniform rendering; and re-projection or dynamic fuzzy correction is executed in a self-adaptive manner according to the attitude prediction error before display. According to the technical scheme, the perception delay and the rendering load are remarkably reduced, and the frame rate stability and the visual immersion in a high-dynamic scene are improved.

A device for simulating a weapon in a virtual reality (VR) environment, an augmented reality (AR) environment, a mixed reality (MR) environment, and / or combinations thereof. The device is adjustable to fit a user's shape and receive a gaming controller. The device includes a forearm grip and a front-end grip that improves the simulation of weaponry and user immersion.

The invention belongs to the technical field of computer graphics and virtual reality, and discloses a virtual-real fusion-based panoramic roaming construction method for a digital exhibition hall, which effectively solves the problems of easy drift and offset in a virtual environment in a traditional system through a multi-sensor fusion algorithm and a closed-loop optimization mechanism. Under the complex environment of people flow change, illumination fluctuation and the like in an exhibition hall, accurate alignment of virtual content and physical space can still be kept, it is ensured that a user obtains coherent and stable visual experience in the roaming process, and a reliable space reference is provided for virtual-real interaction; the light and shadow effect and the material performance of the virtual content are naturally fused with the physical environment through the physical rendering and multi-sensory interaction technology, and meanwhile, a multi-dimensional immersion sense is constructed in combination with the spatial sound effect and interaction feedback; when the user interacts with the virtual exhibit, sensory experience close to reality can be obtained, and the sense of substitution and attraction of the digital exhibition hall are remarkably improved.

The invention discloses a whole-process vascular interventional operation training method and system based on a virtual reality technology, and the method comprises the steps: firstly, developing a vascular interventional mechanics and collision simulation module, and achieving the deformation simulation of a blood vessel and a guide wire through the combination of position dynamics, a region shape matching technology and a Cosseerat elastic rod model, the collision between the blood vessel and the guide wire is treated by adopting a wide-to-narrow three-layer progressive collision detection method; secondly, constructing an immersive virtual operation scene through model construction and rendering optimization; visual angle roaming, instrument operation and interface interaction are fused, and multi-mode interaction control driving intervention training is achieved; finally, based on a'module-event 'dual-drive framework, operation tasks such as anesthesia, puncture, radiography, intervention, stent release and hemostasis are sequentially connected in series through a unified state machine, and whole-process training is achieved. The accuracy and stability of blood vessel and guide wire simulation are improved, the training immersion sense is enhanced, interventional operation whole-process training is achieved, and high teaching and practical value is achieved.

The invention provides an astronaut working load relieving implementation method based on a virtual reality technology in a microgravity environment, and belongs to the field of microgravity environment psychological recovery. The problems that an existing working load relieving system is difficult to provide higher immersion and interactivity for astronauts in a microgravity environment, and is poor in individuation and intervention effect are solved. According to the method, physiological state data and psychological state data of astronauts are collected, task execution data are integrated, workloads are quantified, workload types are identified after comprehensive evaluation, preliminary matching is carried out according to defined matching conditions, a virtual scene is selected through machine learning and multi-dimensional data analysis, and a virtual scene is obtained. And performing continuous fine adjustment in the loaded and presented optimized virtual scene, and recording the process. According to the method, an effective pressure relieving means can be flexibly and accurately provided according to the real-time state of the astronaut and the requirements of the working environment, and the cognitive reconstruction and psychological recovery process is enhanced through the immersion of the virtual reality technology.

The invention provides a virtual reality three-dimensional space data correction method, which comprises the following steps of: firstly, acquiring an image, depth and inertia measurement data of a virtual reality terminal, and a pose, a speed and a force feedback signal of an interaction body, and carrying out time sequence alignment under a unified time reference; an interaction event is identified through collision detection, and parameters such as a contact point, a normal direction, a relative speed, a penetration depth and a contact duration are extracted. Then, physical consistency constraints including no penetration, contact stability, friction consistency, momentum conservation and energy non-increase are constructed, and geometric consistency, depth consistency and physical consistency residual functions are established in the local contact area; and solving surface normal, depth, scale, pose, calibration parameters and other corrections through a robust nonlinear optimization method so as to update the point cloud, the grid and the calibration model. According to the method, the consistency and the stability of geometric modeling and physical interaction in the virtual reality scene can be remarkably improved, and the immersion and the interaction precision are improved.

The invention provides an image fusion stereoscopic display method and system based on a Unity engine, and relates to the technical field of computer graphics and virtual reality. According to the method, a left-eye camera and a right-eye camera are configured in a Unity scene, left and right view angle images are collected according to interpupillary distance parameters, and left-eye and right-eye rendering textures are generated; generating a UI texture according to the Canvas type of the UI element, executing parallax compensation, pixel alignment and image fusion processing through a Compute Shader, and superposing image layers according to the transparency of the UI texture to generate a synthetic display image; and introducing a previous frame result into the fused image, and realizing time continuous output based on an inter-frame smooth function. And outputting the synthesized texture to a device supporting a plurality of stereoscopic display modes through a graphic rendering pipeline. According to the method, efficient fusion of the 3D image and the UI is realized, the rendering efficiency and the visual immersion are improved, and the method is suitable for scenes such as virtual reality, augmented reality and digital twinning.

The invention provides an intelligent interactive digital somatosensory system and method, and relates to the field of somatosensory interaction. The system comprises an acquisition module, a posture capture module, a behavior optimization module, a sensor optimization module and a virtual object interaction module. Wherein the acquisition module acquires physiological, behavior and environmental data in real time; the posture capturing module captures the three-dimensional space position and posture change of the user through a deep learning algorithm; the behavior optimization module dynamically adjusts a feedback interaction mode based on user historical data; the sensor optimization module dynamically adjusts the layout and configuration of the sensor; the virtual object interaction module is combined with a virtual reality technology to simulate dynamic physical feedback of a virtual object in real time; the system improves the naturalness and immersion of interaction through multi-sensor cooperation and a deep learning algorithm.

The invention relates to the technical field of virtual reality, and discloses an interactive education platform based on a virtual reality technology, which comprises an acquisition and preprocessing module, a scene generation and interaction module, a self-adaptive learning module, an interaction module, an evaluation module and an evidence storage module, by constructing a dynamic interactive virtual scene and a multi-modal feedback mechanism, the problems of scene staticization and single interaction mode in traditional virtual reality education are solved, real-time disassembly, combination and parameter adjustment of scene elements are realized by means of a UE5 engine and a programmed generation algorithm, and eye movement tracking, gesture recognition and tactile feedback technologies are combined, so that the real-time interaction of the scene elements is realized. The immersion and participation degree of the learning process are significantly improved, and students can deepen the understanding and application of knowledge in immersive operation.

The invention relates to the technical field of virtual reality, and particularly discloses a traditional culture scene construction method based on VR, and the method comprises the steps: data collection, feature extraction, multi-modal fusion, scene construction and user interaction. According to the scheme, cross-modal unified spatial expression is constructed for multi-modal data, the semantic fusion capability among cultural elements is enhanced, a multi-modal fusion network is constructed, semantic information, visual information and geometric structures are introduced layer by layer, gradual enhancement of feature aggregation under semantic driving is realized, and semantic consistency and output quality of fusion expression are effectively ensured; based on the fused multi-modal feature vector, the geometric morphology of entities and scene elements corresponding to culture semantics is extracted, the structural integrity and culture expressive power of a scene are effectively improved, and the immersion of a traditional culture scene and the visual reality sense of a user are effectively improved through highly real texture mapping, light and shadow simulation and scene rendering.

The invention relates to a virtual reality and network interaction technology, and discloses a virtual space multi-person interaction synchronous control method oriented to an end-cloud collaborative architecture. Through combination of end-side prediction and cloud arbitration, low-delay transmission and global consistency of a multi-user interaction state are realized. The method specifically comprises the steps that an end side carries out prediction and feature extraction on action and voice data, and redundant transmission is reduced; the key state parameters are uploaded to a cloud end and are judged by a global consistency model and a conflict arbitration mechanism in a unified manner, and a synchronization instruction is generated; and the end side performs rendering and feedback according to a result. According to the method, end-cloud hierarchical prediction and arbitration, a priority-driven protocol and bandwidth adaptive control are combined, delay and conflicts are effectively reduced, and cooperation efficiency, immersion and network adaptability are improved. The method can be widely applied to the fields of universe, online education, remote collaboration, virtual simulation and the like.

The invention relates to an interaction method and device based on virtual reality, equipment and a medium. According to the method, firstly, state data of a user in a virtual reality environment is collected and preprocessed to generate a standardized data stream, and then the distance, orientation similarity and interaction frequency between the user and a virtual avatar are calculated based on the data so as to construct a situational social graph representing social relation strength. Meanwhile, an attention model representing attention weight is constructed by analyzing a fixation point and a head direction of a virtual avatar of the user, and then information priority is calculated through weighted summation of social relation strength and the attention weight by utilizing a situational social graph and the attention model; according to the method and the device, the priority of the user is obtained, the audio, visual and text information is dynamically filtered or enhanced according to the priority to generate the optimized information flow, and finally the information flow is presented in the virtual reality environment, so that the cognitive load of the user in a dense social scene is effectively reduced, and the social interaction efficiency and immersion are improved.

The invention discloses an interaction method and system for a virtual reality education scene, and belongs to the technical field of man-machine interaction. The input rate of a user is collected in real time, the update response time of a virtual object is synchronously recorded, and the interaction speed of the virtual object is calculated based on the action rate of input equipment and the response time of the virtual object. Calculating the synchronous delay between the input device and the virtual environment, dividing the synchronous delay into a low delay level, a middle delay level and a high delay level, and maintaining the current interaction mode for the low delay; for high delay, an emergency optimization measure is started; for middle delay, a partial optimization mechanism is started, including adjustment of object update frequency in a virtual environment or reduction of dynamic elements, and automatic adjustment of an optimization strategy based on user interaction feedback data, the technology can significantly improve response precision and interaction experience of a virtual reality system, reduce distortion and unnatural feeling caused by delay, and improve user experience. And the immersion and interaction experience of the user are enhanced.

The invention discloses a directional floor vibration feedback method and system. The directional floor vibration feedback method comprises the steps of obtaining spatial information and audio information of a virtual object and state information of a target user; obtaining distribution parameters according to the spatial information and the state information, and performing overall frequency scaling on the audio information to obtain vibration waveform data; distributing the vibration waveform data according to the distribution parameters to obtain vibration intensity distribution information; and performing vibration feedback on the target user according to the vibration intensity distribution information. According to the invention, space sound rendering and floor vibration feedback can be driven at the same time, synchronous transmission of sound and vibration is realized, and the space perception and immersion of virtual reality are improved.

An interactive data immersion and collaboration system comprising an augmented reality (AR) or virtual reality (VR) headwear (e.g., glasses, goggles, headset, etc.) and a computer software application configured to display to the user a dynamic, interactive presentation of data or data sets in a virtual environment that appears to surround the user and that enables a user to configure, arrange, and / or edit the data in a variety of ways.

The invention discloses a virtual exhibition hall system construction method, an exhibition system and a storage medium, and relates to the technical field of virtual reality and three-dimensional modeling, and the method comprises the steps: planning an exhibition hall layout according to the number of exhibits, and constructing a three-dimensional virtual exhibition hall model; mapping textures are set for all the areas of the exhibition hall, and a mapping model is generated through illumination baking; and setting exhibit point locations, embedding display materials, constructing interaction logic and configuring an interaction mode. According to the method, intelligent statistics and partitioning are carried out on the exhibits, the spatial layout of the exhibition hall is optimized, the design efficiency and the visit fluency are improved, the reality sense and the immersion experience of the exhibits are improved, meanwhile, rendering resource consumption is reduced, the visual effect is improved, multi-terminal interaction adaptation is supported, user behaviors are recorded, operation is optimized, and the user experience is improved. Dynamic updating and personalized recommendation are achieved, the intelligent level and user experience of the exhibition hall are comprehensively improved, different user requirements are met, and system expansibility and maintenance convenience are enhanced.

The application discloses an immersive space virtual-real interaction method and relates to the technical field of virtual reality; after the game starts, the first sub-time zone of each game stage is taken as a starting data collection window, EEG signal data of a player is collected, an alpha wave trend graph is constructed, through a series of calculation and analysis, including determining a reference frequency range, identifying an abnormal point, calculating an alpha wave variation ratio, an alpha wave evaluation value of the player in the starting data collection window is obtained, this process can accurately evaluate the brain state of the player in the starting stage of the game, the change trend of the player's immersion is predicted in advance and the intensity of the tactile feedback is adjusted in time, the player's frequent "out of the game" in the game process is avoided, the coherence and immersion of the game experience are maintained, when the alpha wave evaluation value of the player shows that the immersion may decrease, the tactile feedback is enhanced to attract attention, the game participation is improved, and the player can continuously immerse in the game.

This invention discloses a virtual reality assistive device base. A spherical connecting block is fixedly connected to the upper end of a mounting column. A connecting column is located above the spherical connecting block, and a mounting groove is formed on the lower surface of the connecting column. The spherical connecting block is placed in the mounting groove. A seat is provided at the upper end of the connecting column. Four grooves are formed at equal angles on the lower surface of the seat. There are four electric push rods, which are respectively placed around the upper surface of the mounting plate. Each electric push rod has a connecting rod at its upper end, and each connecting rod has a support plate at its upper end. The upper end of the support plate is placed in a groove. There are four baffles, which are respectively placed around the upper surface of the mounting plate. The baffles are fixedly connected to the mounting plate. This allows the user's body to be rotated or tilted, increasing immersion and realism, and improving the user experience.

The invention belongs to the technical field of image rendering, and discloses a painting interactive exhibition system based on a VR technology. Comprising the following steps: acquiring high-precision painting original data and exhibition environment information, and constructing an exhibition space feature map; performing spatial attribute feature recognition on the exhibition space feature map, and constructing a virtual exhibition space holographic model; performing painting interaction rendering processing on the virtual exhibition space holographic model to generate a painting interaction experience network; performing visual experience simulation on the virtual exhibition space holographic model to generate high-immersion visual experience data; performing dynamic ray tracing processing on the painting interactive experience network by utilizing the high-immersion visual experience data to obtain an interactive experience change track; performing multi-dimensional exhibition effect comprehensive evaluation on the interactive experience change track; according to the method, highly immersive painting interaction experience can be realized, the method has accurate visual restoration capability, and the exhibition experience quality of a user and the exhibition space utilization efficiency are improved.

The invention discloses a big data-based universe scenic area multi-modal interaction special effect generation method and system, and relates to the technical field of virtual reality, and the method comprises the steps: obtaining universe scenic area information, obtaining historical tourist information according to the universe scenic area information, and generating a universe scenic area multi-modal interaction special effect according to the historical tourist information; and obtaining historical interaction time information and historical interaction tourist information corresponding to each interaction special effect. According to the method, the preferred tourists of each interaction special effect are accurately analyzed through the preferred tourist feature information, a data basis is provided for subsequent interaction special effect generation, the interaction deviation angle model is constructed through the special effect visual position and the tourist position, the special effect interaction degree is calculated in combination with the interaction time, single interaction duration judgment is replaced, and the interaction efficiency is improved. The tourist preference analysis accuracy is improved, the appropriate interaction special effect is selected by screening the interaction special effects corresponding to the meta universe scenic spots, the special effect individuation adaptation degree is improved, and the tourist immersion experience is optimized.

Even when users experience virtual reality without using VR equipment, this enhances their sense of immersion in virtual reality. [Solution] The acquisition unit 112 acquires eyelid information indicating the movement of the user's eyelids. The display control unit 115 displays a display image on the display device 14, which is a superimposed image of a first image with a fixed display area and a second image that obscures at least a part of the first image. The area determination unit 114 determines the area obscured by the first image by the second image based on the eyelid information. The area determination unit 114 maximizes the area when the user's eyelids are closed and decreases the area after the first point in time when the user's eyelids begin to open.

The invention belongs to the technical field of oral medicine education, and particularly relates to a dental microscope operation simulation training system based on a virtual reality technology. The system comprises a machine shell, a simulation head assembly, a microscopic lifting mechanism and a binocular microscopic observation device, a supporting plate capable of extending outwards is arranged on the front portion of the machine shell, a 3D operation mouse is arranged on the outer side of the outer supporting plate, and the simulation head is installed on the outer side of the outer supporting plate. An operation display screen capable of extending outwards is fixedly installed on the side portion of the machine shell, and a treatment virtual simulation system under a digital dental microscope is integrated in the operation display screen. Through combination of the dental microscope virtual reality equipment and the force feedback mechanism, real treatment feedback is provided for the hands and eyes of an operator in the training process, and the immersion and simulation degree of treatment operation training under the dental microscope are remarkably improved; and the requirement of oral medicine microsurgery teaching on high-fidelity simulation training is met.

The utility model provides a viewing device, which comprises a support assembly, an MR observer and a spatial position detection assembly, and is characterized in that the MR observer is assembled on the support assembly and comprises a visual angle display assembly and a manipulation interaction assembly; the spatial position detection assembly is assembled on the supporting assembly and used for detecting the movement track of the MR observer. Thus, the MR observer helps to improve the use comfort and viewing experience of the user, for example, the user can watch the scene in front of the eyes through the viewing angle display assembly of the MR observer and deeply understand the culture and ecology of the scene, and the MR observer also helps to improve the immersion experience of the user, for example, the user can perform real-time interaction by manipulating the interaction assembly, so that the user experience is improved. And the participation sense and immersion sense of the user can be enhanced, so that the user can obtain more real and interactive visual enjoyment in the use process. And the spatial position detection component is beneficial to improving the spatial positioning precision of the equipment, so that more accurate virtual reality or augmented reality experience is provided.

The application relates to a virtual reality-based intangible cultural heritage immersive experience method, device, equipment and medium. The method comprises the following steps: acquiring multidimensional data of a target intangible cultural heritage scene; performing grid processing on original three-dimensional point cloud data to obtain an initial three-dimensional geometric model; performing spatial registration on a spectral reflection curve and the initial three-dimensional geometric model to obtain a three-dimensional geometric model containing material spectral properties; analyzing a facet spectral emission curve in combination with a scene space-time cultural database to generate a parameterized physical material library; generating a basic light image in combination with the parameterized physical material library and the scene space-time cultural database according to experience space-time information selected by a user; fusing environmental special effect physical description parameters and the basic light image to obtain a synthesized visual picture result; and generating an immersive experience instruction based on the synthesized visual picture result and environmental special effect data. The method can dynamically adapt to material characteristics and space-time changes of different intangible cultural heritage scenes, and improves the restoration degree of the intangible cultural heritage scene and the user immersion.

The invention relates to the technical field of simulation training, in particular to an immersive education training system based on virtual reality and augmented reality, which comprises a scene acquisition and construction module for analyzing a track to generate a virtual-real contrast chart, and a virtual-real contact fusion module for calibrating a boundary to form a stable mapping table, the teaching action mapping module is used for generating an action synchronization set by comparing paths, the training task connection module is used for integrating actions to generate a task continuous linked list, and the immersion behavior presentation module is used for scheduling multimedia elements and dynamically adjusting feedback to generate an educational training interaction state set. According to the method, virtual-real dynamic mapping is constructed by fusing the contour and the track, so that the virtual object and the real identifier are consistent in direction and stable in form, continuous association of the action track and the virtual path is maintained, the motion trend adaptively adjusts the interaction area, the action chain association ensures the training logic traceability, and the multimedia feedback delay is corrected to maintain perception synchronization. Visual connectivity and feedback accuracy are optimized, and an immersion training environment capable of being dynamically adjusted is formed.

The invention discloses a method and a system for publishing an advertisement in a virtual reality scene based on mobile live-action cognition, and the method comprises the steps: collecting live-action data through a mobile device, and recognizing scene elements and user attributes through deep learning; clothing advertisement content is dynamically selected from a database based on an identification result, 3D advertisement content is superposed to a real scene through an AR / MR technology, and stable positioning is realized by adopting an SLAM technology; the user realizes virtual fitting through interaction of gestures, voices and advertisements; collecting interaction data in real time and optimizing an advertisement strategy through reinforcement learning; an advertisement release management function is provided through a mobile terminal management interface; according to the method, scene key elements are accurately identified through CNN, stable positioning of the virtual advertisement is realized in combination with an SLAM technology, a material shadow is adjusted through real-time illumination matching, the environment understanding ability is improved by means of multi-modal data fusion, and the fusion naturalness and immersion of the advertisement and a real scene are greatly enhanced.

The invention belongs to the technical field of virtual reality and human-computer interaction, and provides a multi-mode collaborative feedback virtual reality interaction method and system, which are used for acquiring real-time movement speed information of a pedal period of a static rehabilitation bicycle, and accurately synchronizing the riding speed of a patient with a panoramic video playing rate; through scene gradient visual identification and dynamic damping feedback based on deep learning, video topographic features are analyzed, the resistance of a single vehicle is adjusted, and real uphill and downhill somatosensory is simulated; a plurality of pre-collected branch routes are integrated, a patient is allowed to autonomously select a path at a virtual intersection through handlebar steering, and passive sightseeing is converted into active exploration; a heart rate monitoring bracelet, a carbon dioxide detector and an acetone detector are integrated, the rehabilitation training intensity and the physical state of a patient are evaluated in real time, and data support is provided for self-adaptive difficulty adjustment and safety early warning. According to the invention, the user can ride the carrier to roam in a wider virtual space in a limited physical space, and high-immersion rehabilitation VR experience is realized.