Panoramic video transmission method, transmission device and transmission system

Abstract

The invention provides a panoramic video transmission method, a transmission device and a transmission system, wherein the panoramic video transmission method is applied to a client and comprises thesteps of acquiring a media file from a server end and analyzing the file, and downloading video segments according to the media file; in a loading process, acquiring head position information of a user, and predicating viewing probability of the video segments according to the head position information; calculating the size of a video playing buffering area, and calculating a total code rate upperlimit of the video segments according to the estimated network bandwidth and the size of the video playing buffering area; calculating the spatial quality change of the video segments and the expected distortion of the video segments, establishing a QoE model according to the spatial quality change and the expected distortion of the video fragments, and selecting the to-be-downloaded video fragments. The panoramic video transmission method, the transmission device and the transmission system realize technical effects of reducing data volume in panoramic video transmission, improving video quality, reducing spatial quality fluctuation and lags in video playing.

Description

technical field [0001] The present invention relates to the field of multimedia technology, in particular to a panoramic video transmission method, a panoramic video transmission device, a panoramic video transmission system, a computer device, and a computer-readable storage medium. Background technique [0002] With the development of multimedia technology, virtual reality technology (VR) has received extensive attention from industry and academia. Among them, applications of panoramic video, such as 360-degree video and omnidirectional video, have been widely used. [0003] The data volume of virtual reality video is usually very large, which makes the compression bit rate and network transmission of panoramic video the biggest challenge. For example, a panoramic video with a resolution of 4Kx2K and mapped in ERP mode can reach a bit rate of 15Mbps to 20Mbps after compression and encoding. The characteristics of high resolution and high bit rate of panoramic video hinde...

AI Technical Summary

Problems solved by technology

[0005] However, there are still challenges in providing high-quality chunk-based delivery: (1) Video chunk acquisition error

To obtain future video content in advance, the client needs to predict the user's viewing direction. If the prediction is wrong, the client will not download some video segments. If this part of the video content is needed during actual playback, this part of the content will be missing. Affect user experience; (2) video playback freezes

Due to the immediacy of the prediction of the user's viewing orientation, that is, the accuracy of the prediction of the user's orientation for a long time in the future will be extremely reduced, so the playback buffer of the video is very small (for example, 3 seconds), and it is easy to happen in the case of a small buffer Video playback freezes; (3) Mixed bit rates lead to boundary effects

Since the block-based transmission method needs to divide the video in space, when the client selects the video content, the video may have obvious borders or inconsistent quality when rendering due to different bit rates.

Images