Interactive panoramic video transcoding and playing method based on space telescopic coding and system

Abstract

The invention discloses an interactive panoramic video transcoding and playing method based on space telescopic coding and a system. The method comprises steps of diving an original video into multiple space layer video data with different resolutions; diving data of each layer according to a tile form; according to an operation instruction of a user, projecting ROI into the video in each layer; based on the principle that the video zooming coefficient is closest to 1, selecting the most proper space layer video data and the corresponding Tile to carry out transcoding rewriting; and filling unselected data with skip data, thereby reducing bandwidth and ensuring compatibility. According to the invention, video data with the most proper play window resolution is played to the user according to different bandwidth environments; the method and the system are characterized in that the space is telescopic; and the space resolution is self-adaptive; and the user is enabled to well enjoy a natural scene of an interactive video or a three-dimensional immersive vision feelings of a virtual scene, seamless viewpoint switching and flexible human-machine interaction features.

Description

technical field [0001] The invention belongs to the technical field of interactive panoramic video transcoding and playback, in particular to an interactive panoramic video transcoding and playback method and system based on spatially scalable coding. Background technique [0002] Interactive panoramic video is a new type of media that is emerging. It increases the sense of visual reality and lifelikeness on the basis of traditional two-dimensional video. It allows users to freely choose viewpoints and perspectives to obtain the video content they are interested in. . Interactivity is an important feature of this medium. [0003] In 2001, MPEG, the international audio and video standard organization, established a research group to conduct exploratory research on 3DAV technology for three-dimensional audio and video. The joint video expert group JVT established by ITU-T video coding expert group VCEG and MPEG also conducted research on 3DAV coding standards. with enactment...

AI Technical Summary

Problems solved by technology

The basic idea of ​​the above improved methods is to divide the panoramic video into multi-block data with a fixed amount of data, and only transmit the part watched by the user, which can partially relieve the pressure of transmission bandwidth occupation, but does not consider the computing power and network status of the receiving playback terminal. The dynamic changes of the user interaction and the characteristics of commands such as pan / tilt / zoom (translation / rotation / zoom), so the actual use effect needs to be improved

Images