Estimation method of distortion performance of stereo video encoding rate

Abstract

The invention provides an estimation method of distortion performance of a stereo video encoding rate, comprising the following steps: acquiring a multi-view video and acquiring a corresponding multi-view depth map according to the multi-view video; respectively obtaining a multi-view video encoding rate distortion model and a multi-view depth map encoding rate distortion model; respectively obtaining the relationship between multi-view video encoding distortion and virtual view rendering distortion as well as the relationship between the multi-view depth map encoding distortion and the virtual view rendering distortion; and finally establishing a virtual view encoding rendering rate distortion model in a stereo video based on the relationships. By the analysis method of virtual view encoding rendering rate distortion in the stereo video provided by the invention, the distortion performance of the virtual view encoding rendering rate in the stereo video can be accurately and rapidly established so as to provide model guide and solution for problems such as selection of coding parameters, code rate distribution and the like in the stereo video.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a method for estimating rate-distortion performance of stereoscopic video coding for virtual viewpoint rendering. Background technique [0002] With the continuous development of multimedia technology, traditional two-dimensional video media can no longer meet the needs of human vision. People hope to see more realistic and interactive video programs, that is, three-dimensional videos with a high degree of three-dimensional immersion. The three-dimensional video technology that has gradually emerged in recent years, such as multi-viewpoint video, free-viewpoint video and stereoscopic video, and other new video media are gradually becoming an important part of multimedia technology. The so-called free-viewpoint video refers to video media in which viewers watch three-dimensional scenes by freely choosing a viewing point of view. [0003] The development of free-viewpoint...

AI Technical Summary

Problems solved by technology

[0007] The disadvantage of the existing technology is that there is currently no estimation scheme for the rate-distortion performance of stereoscopic video coding for virtual viewpoint rendering

[0008] For example, in the patent application with application number 200810163801 titled a network-adaptive stereoscopic video coding method, only an adaptive coding scheme for stereoscopic video under different network bandwidths is given, and there is no rate-distortion for stereoscopic video coding performance analysis

In the patent application with application number 200810126528 titled a stereoscopic video encoding and decoding method, device and system, although a complete set of stereoscopic video encoding schemes, devices and systems are disclosed, the stereoscopic video encoding rate distortion is also not given. performance analysis

In the patent application with the application number 200710164747 titled a bit rate control method for multi-viewpoint video, although the rate-distortion model of multi-viewpoint video coding is announced, there is no stereoscopic video coding rate-distortion performance for virtual viewpoint rendering

Images