Implementation method of virtual reality software framework suitable for visual and haptic fusion feedback

Abstract

The invention provides a method for implementing a virtual reality software framework suitable for visual-tactile fusion feedback. The software framework includes visual components, tactile components, hardware components and core management components. Through the coordinated work of several components, users can One or more different tool libraries are selected for the contact type between the object and the virtual avatar, so as to meet the interaction requirements of different contact types such as single-point contact, multi-point contact, sliding contact, and flexible body contact. While meeting the visual presentation requirements, It can truly provide users with tactile feedback, and can provide users with immersive visual-tactile fusion feedback.

Description

technical field [0001] The invention belongs to the technical field of computer applications, and in particular relates to an implementation method of a virtual reality software framework suitable for visual-tactile fusion feedback. Background technique [0002] For simple virtual interaction scenarios, such as virtual objects being rigid objects with regular geometric shapes, existing virtual reality software frameworks, such as the Unity 3D engine, can truly reproduce the visual effects of user avatars interacting with virtual objects, providing users with Real-time dynamic visual interactive experience. However, in terms of visual-tactile fusion feedback between simulated users and virtual scenes, these engines are often difficult to meet the interactive needs of immersive visual-tactile fusion feedback between users and virtual objects. [0003] The existing virtual reality software framework has the following problems: when the virtual avatar and the virtual object are...

AI Technical Summary

Problems solved by technology

However, in terms of simulating the visual-tactile fusion feedback between the user and the virtual scene, these engines are often difficult to meet the interactive needs of the immersive visual-tactile fusion feedback between the user and the virtual object.

[0003] The existing virtual reality software framework has the following problems: when the virtual avatar and the virtual object are in contact, and the distance between the two positions is smaller than the set threshold, the existing VR software framework will simply bind the virtual avatar to the virtual object Together, the realistic simulation of operating tasks such as elastic body interaction and relative sliding cannot be realized; the existing VR software framework lacks friendly support for tactile feedback, which is mainly reflected in the lack of interaction with multiple types of haptics (called multiple haptics). Support, it is difficult to simulate the experience of subtle force and tactile changes, and the update frequency of tactile feedback is much lower than 1kHz, which significantly weakens the immersion of virtual interaction; different VR applications have different requirements for the VR software framework, which requires the VR software framework to provide Strong scalability, and in recent years, VR hardware devices, such as VR glasses / helmets, vibration handles, force feedback gloves, etc., have developed rapidly, and the VR software framework's ability to support different hardware devices needs to be improved

[0004] The technical problems existing in the existing virtual reality software framework greatly increase the difficulty and development cost of the virtual reality application system with visual and tactile fusion feedback, and limit the application and promotion of visual and tactile fusion interaction in the field of virtual reality and augmented reality

Images