Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

115 results about "Immersion (virtual reality)" patented technology

Immersion into virtual reality (VR) is a perception of being physically present in a non-physical world. The perception is created by surrounding the user of the VR system in images, sound or other stimuli that provide an engrossing total environment.

Neural rehabilitation training method and system integrating brain-computer interface and virtual reality

The invention provides a neural rehabilitation training method and system integrating a brain-computer interface and virtual reality, and relates to the technical field of brain-computer interfaces. The method comprises the following steps: constructing an aligned multi-modal feature sequence by collecting electroencephalogram, myoelectricity, joint kinematics, eye movement and physiological load signals; generating an immersion parameter prescription in the baseline stage and setting a time delay and synchronization strategy; according to the nerve quality index, performing cooperative self-adaption of decoder parameters, prescriptions and peripheral assistance; establishing a drift model after the session to update the prior and shorten the re-calibration time; and monitoring dizziness and task load in real time and executing grading treatment. According to the invention, stable closed-loop individualized rehabilitation training is realized, the decoding performance and the rehabilitation effect are improved, and the safety and long-term convergence are ensured.
Owner:XIEHE HOSPITAL ATTACHED TO TONGJI MEDICAL COLLEGE HUAZHONG SCI & TECH UNIV

Real-time rendering and interaction method for immersive virtual reality scene

The invention relates to the technical field of computers, and discloses a real-time rendering and interaction method and system for an immersive virtual reality scene. The method comprises the following steps: fusing tuner inertial data and eyeball tracking data, and constructing a prospective state prediction model; generating a predictive focus field in combination with scene visual saliency; synthesizing an anisotropic temporal-spatial resolution graph according to the predicted head angular velocity; gPU variable-rate coloring is driven to realize non-uniform rendering; and re-projection or dynamic fuzzy correction is executed in a self-adaptive manner according to the attitude prediction error before display. According to the technical scheme, the perception delay and the rendering load are remarkably reduced, and the frame rate stability and the visual immersion in a high-dynamic scene are improved.
Owner:CHENGDU TECHNICIAN COLLEGE (CHENGDU VOCATIONAL & TECH COLLEGE OF IND & TRADE CHENGDU ADVANCED TECH SCHOOL CHENGDU RAILWAY ENG SCHOOL)

Whole-process vascular interventional operation training method and system based on virtual reality technology

The invention discloses a whole-process vascular interventional operation training method and system based on a virtual reality technology, and the method comprises the steps: firstly, developing a vascular interventional mechanics and collision simulation module, and achieving the deformation simulation of a blood vessel and a guide wire through the combination of position dynamics, a region shape matching technology and a Cosseerat elastic rod model, the collision between the blood vessel and the guide wire is treated by adopting a wide-to-narrow three-layer progressive collision detection method; secondly, constructing an immersive virtual operation scene through model construction and rendering optimization; visual angle roaming, instrument operation and interface interaction are fused, and multi-mode interaction control driving intervention training is achieved; finally, based on a'module-event 'dual-drive framework, operation tasks such as anesthesia, puncture, radiography, intervention, stent release and hemostasis are sequentially connected in series through a unified state machine, and whole-process training is achieved. The accuracy and stability of blood vessel and guide wire simulation are improved, the training immersion sense is enhanced, interventional operation whole-process training is achieved, and high teaching and practical value is achieved.
Owner:TIANJIN UNIV OF SCI & TECH

Three-dimensional space data correction method for virtual reality

The invention provides a virtual reality three-dimensional space data correction method, which comprises the following steps of: firstly, acquiring an image, depth and inertia measurement data of a virtual reality terminal, and a pose, a speed and a force feedback signal of an interaction body, and carrying out time sequence alignment under a unified time reference; an interaction event is identified through collision detection, and parameters such as a contact point, a normal direction, a relative speed, a penetration depth and a contact duration are extracted. Then, physical consistency constraints including no penetration, contact stability, friction consistency, momentum conservation and energy non-increase are constructed, and geometric consistency, depth consistency and physical consistency residual functions are established in the local contact area; and solving surface normal, depth, scale, pose, calibration parameters and other corrections through a robust nonlinear optimization method so as to update the point cloud, the grid and the calibration model. According to the method, the consistency and the stability of geometric modeling and physical interaction in the virtual reality scene can be remarkably improved, and the immersion and the interaction precision are improved.
Owner:LILU (SHANGHAI) CULTURE TECH CO LTD

Virtual space multi-person interaction synchronous control method for end-cloud collaborative architecture

The invention relates to a virtual reality and network interaction technology, and discloses a virtual space multi-person interaction synchronous control method oriented to an end-cloud collaborative architecture. Through combination of end-side prediction and cloud arbitration, low-delay transmission and global consistency of a multi-user interaction state are realized. The method specifically comprises the steps that an end side carries out prediction and feature extraction on action and voice data, and redundant transmission is reduced; the key state parameters are uploaded to a cloud end and are judged by a global consistency model and a conflict arbitration mechanism in a unified manner, and a synchronization instruction is generated; and the end side performs rendering and feedback according to a result. According to the method, end-cloud hierarchical prediction and arbitration, a priority-driven protocol and bandwidth adaptive control are combined, delay and conflicts are effectively reduced, and cooperation efficiency, immersion and network adaptability are improved. The method can be widely applied to the fields of universe, online education, remote collaboration, virtual simulation and the like.
Owner:SHANGHAI GRAPHIC DIGITAL INFORMATION CO LTD

Interaction method and device based on virtual reality, equipment and medium

The invention relates to an interaction method and device based on virtual reality, equipment and a medium. According to the method, firstly, state data of a user in a virtual reality environment is collected and preprocessed to generate a standardized data stream, and then the distance, orientation similarity and interaction frequency between the user and a virtual avatar are calculated based on the data so as to construct a situational social graph representing social relation strength. Meanwhile, an attention model representing attention weight is constructed by analyzing a fixation point and a head direction of a virtual avatar of the user, and then information priority is calculated through weighted summation of social relation strength and the attention weight by utilizing a situational social graph and the attention model; according to the method and the device, the priority of the user is obtained, the audio, visual and text information is dynamically filtered or enhanced according to the priority to generate the optimized information flow, and finally the information flow is presented in the virtual reality environment, so that the cognitive load of the user in a dense social scene is effectively reduced, and the social interaction efficiency and immersion are improved.
Owner:SHIJIAZHUANG UNIVERSITY

Interactive data immersion and collaboration system and related methods

An interactive data immersion and collaboration system comprising an augmented reality (AR) or virtual reality (VR) headwear (e.g., glasses, goggles, headset, etc.) and a computer software application configured to display to the user a dynamic, interactive presentation of data or data sets in a virtual environment that appears to surround the user and that enables a user to configure, arrange, and / or edit the data in a variety of ways.
Owner:S1 IND PCB INC

Construction method of virtual exhibition hall system, exhibition system and storage medium

The invention discloses a virtual exhibition hall system construction method, an exhibition system and a storage medium, and relates to the technical field of virtual reality and three-dimensional modeling, and the method comprises the steps: planning an exhibition hall layout according to the number of exhibits, and constructing a three-dimensional virtual exhibition hall model; mapping textures are set for all the areas of the exhibition hall, and a mapping model is generated through illumination baking; and setting exhibit point locations, embedding display materials, constructing interaction logic and configuring an interaction mode. According to the method, intelligent statistics and partitioning are carried out on the exhibits, the spatial layout of the exhibition hall is optimized, the design efficiency and the visit fluency are improved, the reality sense and the immersion experience of the exhibits are improved, meanwhile, rendering resource consumption is reduced, the visual effect is improved, multi-terminal interaction adaptation is supported, user behaviors are recorded, operation is optimized, and the user experience is improved. Dynamic updating and personalized recommendation are achieved, the intelligent level and user experience of the exhibition hall are comprehensively improved, different user requirements are met, and system expansibility and maintenance convenience are enhanced.
Owner:山东齐鲁壹点传媒有限公司 +1

Virtual reality aid base

This invention discloses a virtual reality assistive device base. A spherical connecting block is fixedly connected to the upper end of a mounting column. A connecting column is located above the spherical connecting block, and a mounting groove is formed on the lower surface of the connecting column. The spherical connecting block is placed in the mounting groove. A seat is provided at the upper end of the connecting column. Four grooves are formed at equal angles on the lower surface of the seat. There are four electric push rods, which are respectively placed around the upper surface of the mounting plate. Each electric push rod has a connecting rod at its upper end, and each connecting rod has a support plate at its upper end. The upper end of the support plate is placed in a groove. There are four baffles, which are respectively placed around the upper surface of the mounting plate. The baffles are fixedly connected to the mounting plate. This allows the user's body to be rotated or tilted, increasing immersion and realism, and improving the user experience.
Owner:GUANGZHOU KOU KE KE KE SOFTWARE TECH CO LTD

Metacosmic scenic spot multi-modal interaction special effect generation method and system based on big data

The invention discloses a big data-based universe scenic area multi-modal interaction special effect generation method and system, and relates to the technical field of virtual reality, and the method comprises the steps: obtaining universe scenic area information, obtaining historical tourist information according to the universe scenic area information, and generating a universe scenic area multi-modal interaction special effect according to the historical tourist information; and obtaining historical interaction time information and historical interaction tourist information corresponding to each interaction special effect. According to the method, the preferred tourists of each interaction special effect are accurately analyzed through the preferred tourist feature information, a data basis is provided for subsequent interaction special effect generation, the interaction deviation angle model is constructed through the special effect visual position and the tourist position, the special effect interaction degree is calculated in combination with the interaction time, single interaction duration judgment is replaced, and the interaction efficiency is improved. The tourist preference analysis accuracy is improved, the appropriate interaction special effect is selected by screening the interaction special effects corresponding to the meta universe scenic spots, the special effect individuation adaptation degree is improved, and the tourist immersion experience is optimized.
Owner:CHONGQING TOURISM CLOUD INFORMATION TECH CO LTD

Image processing apparatus and image processing method

PendingJP2026110219AEyelidImaging processing
Even when users experience virtual reality without using VR equipment, this enhances their sense of immersion in virtual reality. [Solution] The acquisition unit 112 acquires eyelid information indicating the movement of the user's eyelids. The display control unit 115 displays a display image on the display device 14, which is a superimposed image of a first image with a fixed display area and a second image that obscures at least a part of the first image. The area determination unit 114 determines the area obscured by the first image by the second image based on the eyelid information. The area determination unit 114 maximizes the area when the user's eyelids are closed and decreases the area after the first point in time when the user's eyelids begin to open.
Owner:株式会社NTTコノキュー

Viewing equipment

The utility model provides a viewing device, which comprises a support assembly, an MR observer and a spatial position detection assembly, and is characterized in that the MR observer is assembled on the support assembly and comprises a visual angle display assembly and a manipulation interaction assembly; the spatial position detection assembly is assembled on the supporting assembly and used for detecting the movement track of the MR observer. Thus, the MR observer helps to improve the use comfort and viewing experience of the user, for example, the user can watch the scene in front of the eyes through the viewing angle display assembly of the MR observer and deeply understand the culture and ecology of the scene, and the MR observer also helps to improve the immersion experience of the user, for example, the user can perform real-time interaction by manipulating the interaction assembly, so that the user experience is improved. And the participation sense and immersion sense of the user can be enhanced, so that the user can obtain more real and interactive visual enjoyment in the use process. And the spatial position detection component is beneficial to improving the spatial positioning precision of the equipment, so that more accurate virtual reality or augmented reality experience is provided.
Owner:XIMMERSE LTD

Virtual reality-based intangible cultural heritage immersive experience method, device, equipment and medium

The application relates to a virtual reality-based intangible cultural heritage immersive experience method, device, equipment and medium. The method comprises the following steps: acquiring multidimensional data of a target intangible cultural heritage scene; performing grid processing on original three-dimensional point cloud data to obtain an initial three-dimensional geometric model; performing spatial registration on a spectral reflection curve and the initial three-dimensional geometric model to obtain a three-dimensional geometric model containing material spectral properties; analyzing a facet spectral emission curve in combination with a scene space-time cultural database to generate a parameterized physical material library; generating a basic light image in combination with the parameterized physical material library and the scene space-time cultural database according to experience space-time information selected by a user; fusing environmental special effect physical description parameters and the basic light image to obtain a synthesized visual picture result; and generating an immersive experience instruction based on the synthesized visual picture result and environmental special effect data. The method can dynamically adapt to material characteristics and space-time changes of different intangible cultural heritage scenes, and improves the restoration degree of the intangible cultural heritage scene and the user immersion.
Owner:XIAN INST OF INTERPRETATION & TRANSLATION

Immersive education training system based on virtual reality and augmented reality

The invention relates to the technical field of simulation training, in particular to an immersive education training system based on virtual reality and augmented reality, which comprises a scene acquisition and construction module for analyzing a track to generate a virtual-real contrast chart, and a virtual-real contact fusion module for calibrating a boundary to form a stable mapping table, the teaching action mapping module is used for generating an action synchronization set by comparing paths, the training task connection module is used for integrating actions to generate a task continuous linked list, and the immersion behavior presentation module is used for scheduling multimedia elements and dynamically adjusting feedback to generate an educational training interaction state set. According to the method, virtual-real dynamic mapping is constructed by fusing the contour and the track, so that the virtual object and the real identifier are consistent in direction and stable in form, continuous association of the action track and the virtual path is maintained, the motion trend adaptively adjusts the interaction area, the action chain association ensures the training logic traceability, and the multimedia feedback delay is corrected to maintain perception synchronization. Visual connectivity and feedback accuracy are optimized, and an immersion training environment capable of being dynamically adjusted is formed.
Owner:山西铁道职业技术学院

Method and system for publishing advertisement in virtual reality scene based on mobile live-action cognition

The invention discloses a method and a system for publishing an advertisement in a virtual reality scene based on mobile live-action cognition, and the method comprises the steps: collecting live-action data through a mobile device, and recognizing scene elements and user attributes through deep learning; clothing advertisement content is dynamically selected from a database based on an identification result, 3D advertisement content is superposed to a real scene through an AR / MR technology, and stable positioning is realized by adopting an SLAM technology; the user realizes virtual fitting through interaction of gestures, voices and advertisements; collecting interaction data in real time and optimizing an advertisement strategy through reinforcement learning; an advertisement release management function is provided through a mobile terminal management interface; according to the method, scene key elements are accurately identified through CNN, stable positioning of the virtual advertisement is realized in combination with an SLAM technology, a material shadow is adjusted through real-time illumination matching, the environment understanding ability is improved by means of multi-modal data fusion, and the fusion naturalness and immersion of the advertisement and a real scene are greatly enhanced.
Owner:CHANGZHOU TEXTILE GARMENT INST

Multi-mode collaborative feedback virtual reality interaction method and system

The invention belongs to the technical field of virtual reality and human-computer interaction, and provides a multi-mode collaborative feedback virtual reality interaction method and system, which are used for acquiring real-time movement speed information of a pedal period of a static rehabilitation bicycle, and accurately synchronizing the riding speed of a patient with a panoramic video playing rate; through scene gradient visual identification and dynamic damping feedback based on deep learning, video topographic features are analyzed, the resistance of a single vehicle is adjusted, and real uphill and downhill somatosensory is simulated; a plurality of pre-collected branch routes are integrated, a patient is allowed to autonomously select a path at a virtual intersection through handlebar steering, and passive sightseeing is converted into active exploration; a heart rate monitoring bracelet, a carbon dioxide detector and an acetone detector are integrated, the rehabilitation training intensity and the physical state of a patient are evaluated in real time, and data support is provided for self-adaptive difficulty adjustment and safety early warning. According to the invention, the user can ride the carrier to roam in a wider virtual space in a limited physical space, and high-immersion rehabilitation VR experience is realized.
Owner:SHANDONG UNIV

Multi-mode driving character animation automatic generation method and system for virtual reality

The invention belongs to the technical field of animation production, and discloses a multi-modal driving character animation automatic generation method and system for virtual reality, and the method comprises the steps: obtaining multi-modal creation information inputted by a developer, and carrying out the analysis of the multi-modal creation information through a context intention analysis mechanism; converting the multi-mode creation information into a creation instruction symbol stream containing a plot rhythm mark, an emotion color mark and an action tendency mark; decomposing a creation instruction symbol stream into different independent event units, and distributing the independent event units to rhythm lattice points on a time axis through plot node mapping and priority drift rules to form an event queue with rhythm sensation; according to the event queue, role actions are generated through master-slave double-track logic, a lens view angle projection mechanism is introduced, expression tension of the role actions is automatically adjusted according to scene changes, and a logic frame sequence with a lens feeling is generated; the time and labor cost are saved, the animation expressive force and immersion are improved, and meanwhile multi-platform applicability and intelligent operation are achieved.
Owner:JINING POLYTECHNIC

Virtual reality immersion prediction method based on constraint perception depth regression

The invention discloses a virtual reality immersion prediction method based on constraint perception depth regression, and belongs to the technical field of virtual reality display evaluation and human-computer interaction. In order to solve the problems that existing immersion assessment lacks a unified quantitative standard and is weak in cross-device generalization ability, the invention provides a constraint perception depth regression framework. According to the method, firstly, physical boundary constraint is applied to display parameters, and the display parameters are coupled with electroencephalogram Beta frequency band power to construct six-dimensional features; carrying out the statistics of boundary constraint input features through a training domain, and carrying out the modeling through a lightweight multi-layer perceptron regression network; and finally, combining feature importance analysis and a constrained single-parameter search mechanism to form a'prediction-interpretation-parameter adjustment 'integrated scheme. According to the method, the immersion prediction precision and the cross-device robustness can be effectively improved, and executable engineering suggestions are provided for parameter optimization of a virtual reality display system.
Owner:SUZHOU UNIV OF SCI & TECH +1

A psychotherapy system and method integrating virtual reality scenarios

This invention discloses a system and method for psychotherapy that integrates virtual reality scenes, belonging to the interdisciplinary field of psychotherapy and virtual reality. It addresses the problems of fixed scenes, delayed adjustment, weak interactivity, and lack of cultural adaptability in traditional psychotherapy. The method includes using non-contact biosensors to capture facial blood oxygen fluctuations, combining this with a hemodynamic model to remove artifacts, and then quantifying these fluctuations into emotional energy values ​​based on an individual emotional sample set and an incremental learning algorithm to generate scene seeds containing parameters such as color temperature. A virtual physics engine is then driven to reconstruct elements such as light and shadow, and fluids, forming a physically-level dynamic scene. Inertial sensors capture user movements and convert them into virtual pressure gradients, constructing a coupled feedback loop between movement and scene. Psychological trends are predicted through hierarchical Fourier analysis of the seed sequence. This invention achieves real-time adaptation and proactive intervention between psychological states and virtual scenes, enhancing user immersion and cultural and emotional resonance, and improving the accuracy and effectiveness of psychotherapy.
Owner:SICHUAN UNIV

A virtual reality-based haptic enhancement training system

ActiveCN119414958BEnhance interactive immersionreal physical feedbackInput/output for user-computer interactionPhysical therapies and activitiesHand partsTouch Senses
This invention relates to a virtual reality-based haptic enhancement training system, comprising a virtual reality unit, a haptic feedback unit, and a processing unit. The virtual reality unit interacts with the virtual reality environment; the haptic feedback unit is worn on the hand and applies traction force to the fingers, providing feedback on the force corresponding to a grasping object in the virtual reality environment. The processing unit determines the contact points of the grasping object in the virtual reality environment, analyzes the force applied by the haptic feedback unit to the fingers based on these contact points, and sends force-related information to the haptic feedback unit. The force is correlated with the physical characteristics of each contact point of the grasping object. This invention achieves a more realistic force feedback effect by applying traction force to the fingers when the user interacts with virtual objects, allowing the user to experience realistic physical feedback during interaction and enhancing the user's immersion in the interaction.
Owner:HEFEI UNIV OF TECH

Multi-sensory cooperation man-machine interaction method and system for motion cognition combined rehabilitation training

The invention relates to the technical field of virtual reality and medical rehabilitation, and provides a multi-sensory collaborative man-machine interaction method and system for motion cognition combined rehabilitation training. According to the method, the attention level, the fixation point position, the arm motion vector and the gesture state of a subject are quantized by collecting and analyzing electroencephalogram, near infrared, eye movement, optical marking, myoelectricity and other multi-mode physiological signals of the subject so as to represent the motion and cognitive intention of the subject. On the basis of the structured result, interaction instructions and performance data for controlling locking, lifting, moving, grabbing and releasing of objects in the virtual rehabilitation environment are generated according to composite triggering conditions; and finally, according to the instruction execution and the internal state of the virtual environment, determining an interaction event, synchronously driving a motion platform and a visual display and sound system to provide multi-channel fusion feedback, and according to performance data, adaptively adjusting the training difficulty. Multi-modal physiological signals are adopted, the immersion feeling of a patient in the rehabilitation training process is enhanced, the understanding of tasks is improved, and combined rehabilitation of the motion cognition function is achieved.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA

A virtual reality three-dimensional space data correction method and system

The application discloses a kind of virtual reality three-dimensional space data correction method and system, it is related to virtual reality technical field, including obtaining basic three-dimensional space information and camera lens information, real image feature points and corresponding preset image feature points are matched, obtain normal positioning mark information and abnormal positioning mark information.The application is divided to basic space anchor point, improve the efficiency of virtual scene construction, the position of real image in three-dimensional space is predicted, it is convenient to evaluate the accuracy of image superposition, by comparing the actual position of real image in three-dimensional space with predicted position, whether real image meets virtual scene demand is judged, by adjusting abnormal image feature points, reduce positioning deviation, improve the degree of trust and immersion of user to virtual environment, provide more abundant and real experience for user.
Owner:XIUJIA TECH (BEIJING) CO LTD

VR system and control method

PendingCN122321414APhysical spaceSimulation
This disclosure relates to a VR system and control method. The VR system includes a VR device, a positioning device, a control device, and an environmental feedback device. The positioning device is communicatively connected to the control device; the control device is communicatively connected to the environmental feedback device; the environmental feedback device is deployed in a target physical space; the positioning device determines the position of the VR device in the target physical space; the target physical space includes a reference position; the control device, in response to the position of the VR device in the target physical space, determines the distance between the VR device and the reference position; and outputs control information based on the distance between the VR device and the reference position; the environmental feedback device, in response to the control information, switches its own operating state. Because the environmental feedback device is deployed in the target physical space, the environmental perception signal output by the environmental feedback device carries environmental characteristics during its propagation in the target physical space, which can improve the user's immersion in the virtual reality experience.
Owner:BEIJING QIYI CENTURY SCI & TECH CO LTD

Virtual riding exercise system based on VR technology

The application discloses a virtual riding exercise system based on VR technology and relates to the technical field of virtual reality.The system comprises a riding assembly, a VR head-mounted device, a motion control card, a four-degree-of-freedom motion platform, a stepless fan and a visual information processing device, wherein the riding assembly is located on the four-degree-of-freedom motion platform, the stepless fan is located in front of the riding assembly and faces the rider, and through the communication connection relationship and the function design of the riding assembly, the stepless fan and the visual information processing device, the system can not only provide a riding audio-visual experience through the VR head-mounted device, but also can realize the purpose that the posture of the riding vehicle is adaptively adjusted along with the change of the virtual scene road condition through the motion control card and the four-degree-of-freedom motion platform, and the stepless fan can provide the rider with the wind feeling caused by the riding, so that the riding experience can be greatly enriched, the riding experience immersion can be effectively improved, and the system is convenient for actual application and popularization.
Owner:LEBAO SPORTS INTERNET (WUHAN) CO LTD

A virtual reality-based vehicle control method and device

The application discloses a kind of vehicle control method and device based on virtual reality, it is related to intelligent control technical field, comprising: in response to the vehicle control action request for virtual target vehicle, based on the mapping relationship of vehicle component identification information and vehicle control instruction, determine the target vehicle control instruction corresponding to the target vehicle component identification information;In the case where the preset communication security condition is satisfied, the target vehicle control instruction is sent to cloud, to make the cloud instruct the target vehicle component in the real target vehicle based on the target vehicle control instruction to execute corresponding physical vehicle control action;The vehicle control feedback result for the real target vehicle sent by the cloud is received, and based on the vehicle control feedback result, the target vehicle component in the virtual target vehicle is instructed to execute the virtual vehicle control action consistent with the physical vehicle control action.User can really feel the vehicle control effect in remote vehicle control, the whole process is vivid, with immersion, improve user operation experience.
Owner:NINGBO GEELY AUTOMOBILE RES & DEV CO LTD

A method for online evaluation of forces acting on a character in a virtual reality environment

This invention provides a method for online force assessment of characters in a virtual reality environment, aiming to achieve real-time quantitative assessment, physical accuracy, and high robustness of force on humanoid character movements in virtual reality environments. This method combines a motion generation model and a physics optimizer, using an end-to-end integrated approach to dynamically estimate key mechanical parameters such as joint torque and ground reaction force. Specific steps include: acquiring user motion trajectory data from sparse sensors (such as VR headsets and controllers); generating preliminary full-body motion postures using a motion generation model based on discrete latent space learning; performing physical correction and force estimation on the motion using a physics optimization module (employing a dual proportional-differential controller and a motion tracking optimizer); integrating motion data and force parameters; and outputting character animation and force visualization results in real time through a rendering engine. Through the collaborative design of motion generation and physical force assessment, this invention significantly improves the realism, real-time performance, and adaptability of virtual character movements, making it suitable for VR applications such as security monitoring, medical training, and sports simulation, enhancing immersion and interaction efficiency.
Owner:EAST CHINA UNIV OF SCI & TECH

Image processing apparatus, image processing method, and storage medium

In a mixed reality image using a see-through HMD, a wearer's concentration and immersion are improved. In an image processing apparatus generating a mixed reality image which is obtained by combining a real image with a virtual reality image and is displayed on a see-through captured image display device worn on a person's head, an area of the mixed reality image in which a real object seen in the real image is visible is determined based on an instruction from a wearer and the mixed reality image is generated by combining the real image with the virtual reality image according to the determined area.
Owner:CANON KK

Non-enthusiasm immersive experience method, device and equipment based on virtual reality and medium

The invention relates to a non-missing immersive experience method and device based on virtual reality, equipment and a medium. The method comprises the following steps: acquiring multi-dimensional data of a target non-missing scene; gridding the original three-dimensional point cloud data to obtain an initial three-dimensional geometric model; performing spatial registration on the spectral reflection curve and the initial three-dimensional geometric model to obtain a three-dimensional geometric model containing material spectral attributes; analyzing the patch spectral emission curve in combination with the scene space-time culture database, and generating a parameterized physical material library; generating a basic shadow image according to experience space-time information selected by a user in combination with the parameterized physical material library and the scene space-time culture database; fusing the environment special effect physical description parameters and the basic shadow image to obtain a synthetic visual picture result; and generating an immersive experience instruction based on the synthesized visual picture result and the environmental special effect data. The method can dynamically adapt to the material characteristics and spatial-temporal changes of different non-abandoned scenes, and improves the restoration degree of the non-abandoned scenes and the immersion of a user.
Owner:XIAN INST OF INTERPRETATION & TRANSLATION

Virtual simulation and evaluation method for outboard maintenance of large-scale equipment of manned spacecraft

The invention discloses a virtual simulation and evaluation method for outboard maintenance of large equipment of a manned spacecraft. The method comprises the following steps: S1, establishing a virtual simulation model for outboard maintenance of the large equipment of the manned spacecraft; s2, setting constraint conditions of astronauts; s3, performing virtual maintenance process simulation and multi-person view angle and interactive setting; s4, transfer and installation path planning of the large-scale equipment; and S5, performing man-machine ergonomics analysis and judgment. According to the manned spacecraft large-scale equipment outboard maintenance virtual simulation and evaluation method provided by the invention, an active stereo display technology, a virtual training environment building technology and a virtual operation process model building technology are taken as main research objects; a virtual reality man-machine interaction mode which integrates an operation handle, a stereoscopic display system, a motion tracker and other devices and has immersion performance is constructed, analysis and evaluation of the whole process and multiple factors can be covered, visibility, reachability, operability, maintenance time and the like of the maintenance process outside the cabin are verified, and a reference basis is provided for reasonability of the maintenance process.
Owner:SHANGHAI AEROSPACE SYST ENG INST

Sitting type immersion experience system

The invention discloses a sitting type immersion experience system, and belongs to the technical field of virtual reality, the sitting type immersion experience system comprises a base and a swing seat, the swing seat is slidably connected with two side beds, the two side beds are arranged in a mirror image manner, each side bed is provided with a plurality of rollers, the swing seat is provided with a seat, and the seat is provided with a stool switching assembly. The device can simulate the acting force generated by inertia when a person drives an automobile, can also simulate shaking when the road surface is uneven, and has multiple functions; each backrest can provide multi-angle supporting force for the person in a self-adaptive manner, so that the person is prevented from being shaken out of the seat; when a person is in a sitting state, the hip of the person can be covered, the hip curve is attached, the sitting stability of the person is improved, the hip of the person is evenly stressed, and the hip ache feeling cannot be generated; the supporting rod I can prevent the main backrest from sinking, and the spring II can prevent the stool frame from rotating, so that the bed surface is flat, and people can turn the stool frame at will.
Owner:GUANGZHOU TIME NETWORK TECH CO LTD