Panoramic video transmission method and system based on node calculation

Abstract

The invention provides a panoramic video transmission method and system based on node calculation. The method comprises the following steps: obtaining feedback information of a user terminal in real time through an intermediate node, calculating a user visual field region according to the user visual field information, selecting a video stream accommodating the user visual field region for splicing, and obtaining a processed video stream; selecting a transmission scheme according to the user network condition information, extracting a transmission area for the processed video stream, and transmitting the transmission area code to a corresponding user terminal; wherein the transmission scheme comprises non-redundancy transmission and redundancy transmission, in the non-redundancy transmission, the transmission area is a user view area, in the redundancy transmission, the transmission area is a user view area plus a redundancy area, and the redundancy area is calculated according to usernetwork condition information and user terminal processing capability information. By combining the feedback information of the user terminal, the processing time delay can be effectively reduced, and the bandwidth overhead is reduced, so that the consumption experience of the user is integrally improved.

Description

technical field [0001] The invention relates to the field of node computing and video processing, in particular to a panoramic video transmission method and system based on node computing. Background technique [0002] With the rapid development of immersive media, virtual reality (Virtual Reality, VR) is applied to more and more consumption scenarios, such as games and live games. In these scenarios, it is often required to have a low response delay to ensure that users will not feel dizzy, which puts forward higher requirements on data transmission delay. However, as a basic data format in VR, panoramic video has a huge amount of data and complex processing. Generally, the generation of panoramic video requires multiple cameras covering a 360-degree range for data collection, such as figure 1 As shown, multiple videos are stitched into a spherical data by splicing and rendering, and then consumed by users. The process of splicing is relatively complicated, and in the ca...

AI Technical Summary

Problems solved by technology

The process of splicing is relatively complicated, and in the case of limited local processor capacity, it will often cause a certain delay

In the live broadcast scene, this delay will have a certain impact on the user experience

Images