Adaptive coding method based on VR terminal feedback

Abstract

The invention discloses an adaptive coding method based on VR terminal feedback and belongs to the technical field of multimedia transmission. The core concept of the method comprises the steps that a transmission mechanism is improved; a panorama video is segmented into a plurality of visual angle videos; each piece of visual angle video information is independently coded and transmitted; the visual angle video information demanded by a user is transmitted in real time according to a terminal visual angle tracking technology; other visual angle information is transmitted in a low bit rate; various visual angle videos are spliced into the panorama video at the terminal; the user is enabled to obtain suitable visual angle information through adoption of the terminal scoring feedback mechanism; a scoring instruction of the user is transmitted to a server; and the server maps different bit rates to the terminal according to the user scores. The invention has the advantages that under the existing transmission channel capacity, the panorama video sill can be transmitted, so a VR technology can be realized on various platforms, the method is applicable to wide groups, a channel itself does not need to be excessively improved, and the user is enabled to select the suitable subjective watching experience through adoption of the terminal scoring feedback mechanism.

Description

technical field [0001] The invention relates to an adaptive coding method based on VR terminal feedback, and belongs to the technical field of multimedia transmission. Background technique [0002] With the development and application of VR technology, the way we watch videos has become more immersive. There are various head-mounted display VR devices on the market at present, but the devices alone are not enough. The provision of video sources is the key to the development of VR. Panoramic video is content provided to VR devices. In our daily life, whether we are watching TV or mobile phones, the angle of view we see is just a perspective, which is considered a plane. But in fact, our position is a point in three-dimensional space, and the video information we can accept can be three-dimensional, and we can accept viewing angle information in all directions in space. Panoramic video is just such a product, users can choose to "turn their heads" to watch according to what...

AI Technical Summary

Problems solved by technology

[0014] The idea of ​​the present invention is to combine mathematical statistics and probability theory to improve the main transmission mechanism: firstly, the information seen by the user can be output first during the transmission process, and other perspective information is transmitted according to the buffer length reaching a certain threshold, to a certain extent It solves the problem that the signal information cannot be transmitted to the terminal at the first time due to the large amount of signal information, and achieves a reasonable allocation of the bandwidth and delay required by the transmitted content; secondly, through the terminal scoring and background feedback processing, the VR user terminal , that is, VR terminals have a higher utilization rate of bandwidth and delay, and the interactive experience between users and the virtual environment is effectively improved, and users can properly select the appropriate objective virtual scene based on subjective feelings.

Images