Display method and system based on virtual reality technology

Abstract

The invention provides a display method and system based on a virtual reality technology. The method comprises the steps that a collection terminal collects audio data and image data and preprocessing the audio data and the image data so that audio information and image information can be generated and sent to a server; a virtual reality terminal obtains motion parameter information of a wearing user and sends the information to the server, sends a request for watching a three-dimensional audio corresponding to a current environment to the server, and receives and displays three-dimensional audio information which is sent by the server and is synchronous to a user motion state; the sever receives the audio information, the image information and the motion parameter information, trains the motion parameter information in an SVM model to determine a motion state, and generates three-dimensional audio information according to the audio information, the image information, and preset background information, obtains the three-dimensional audio information synchronous to the motion state through adjustment, and sends the obtained three-dimensional audio information to the virtual reality terminal. In this way, through the combination of the motion state, delay of infra-frames of a three-dimensional audio is made up, smearing feeling and sticking feeling are lowered, and the user experience of virtual reality equipment is improved.

Description

technical field [0001] The present invention relates to the field of computers, in particular to a display method and system based on virtual reality technology. Background technique [0002] With the development of computer technology, virtual reality (VR, Augmented Reality) technology is more and more applied to all walks of life. Taking the education industry as an example, due to the lack of vivid teaching environment in the traditional teaching process, the interaction between teachers and students In order to simulate a vivid English environment and allow students to participate in the interaction, it can bring students a better learning experience. [0003] In the application process of virtual reality technology, usually multiple cameras can be used to collect images in the real environment from multiple angles (for example, including images of teachers lecturing), and then through cutout, filling and other processing, the collected images and Predetermined backgrou...

AI Technical Summary

Problems solved by technology

[0004] However, in the actual use process, the wearing user will have different motion states such as head turning and walking, and the picture displayed on the display screen of the virtual reality terminal will jump back to the origin at the end of each frame, that is to say, because the user The visual persistence phenomenon will retain the image of the previous frame and the current frame, resulting in smearing and picture freeze, and the user experience is poor

In addition, since the image is collected from multiple directions by multiple cameras, the data volume of the image is relatively large. Although existing solutions can compress image data through software or hardware, based on the current network capabilities, it still requires a long transmission time. time, which in turn affects the image processing efficiency in the subsequent steps. Therefore, there is often a time delay in the images viewed by the user, which will also affect the user experience

Images