Rendering distortion model-based code rate allocation method of multi-viewpoint plus depth coding

Abstract

The invention relates to a rendering distortion model-based code rate allocation method of viewpoint plus depth coding. The objective of the invention is to optimize code rate allocation of texture video and depth map joint coding. The method includes the following steps that: a total distortion model frame of virtual viewpoints is built; rendering distortion of a left viewpoint and a right viewpoint is calculated; rendering distortion when a depth sensitive value is added is researched, and a geometric error model when a depth error is introduced is built; a distortion model when an occlusion region is added is built; a geometric error model when a texture video error is added is built; an overall viewpoint rendering distortion model error is obtained; and a viewpoint rendering distortion model-based code rate allocation method can be obtained. According to the rendering distortion model-based code rate allocation method of viewpoint plus depth coding, texture video difference and depth map difference are utilized to evaluate virtual viewpoint rendering distortion. The method can be used for optimizing the code rate allocation of texture videos and depth maps, and therefore, viewpoint rendering quality can be optimized. Reasonable bit allocation is performed between the viewpoints, and therefore, the quality balance of viewpoint coding images is high. The rendering distortion model-based code rate allocation method of viewpoint plus depth coding has the advantages of practical operability and convenience in application and realization.

Description

technical field [0001] The present invention belongs to the technical field of three-dimensional video coding, and specifically relates to a code rate allocation method for video coding, in particular to a code rate allocation method for multi-viewpoint video plus depth coding based on a rendering distortion model. Background technique [0002] With the development of multi-viewpoint system and 3D display technology, a new 3D video format - multi-viewpoint video plus depth (MVD) applications, such as 3D television (3DTV) and free-viewpoint television are increasingly attracting attention. Compared with traditional 2D video, MVD synthesizes texture video and corresponding depth map, which can make people get a rich sense of three-dimensionality and immersion when watching video; in addition, its interactive function can provide different three-dimensional effects from different perspectives, use Depth-map-based view synthesis (DIBR) generates a virtual view at any position. ...

AI Technical Summary

Problems solved by technology

In order to solve the problem of optimal bit rate allocation for joint coding of texture video and depth map, some technologies have been proposed, but the existing technology does not integrate texture video compression and depth map compression, and cannot fully reflect the virtual viewpoint rendering process, and the corresponding bit rate allocation performance Also unsatisfactory, which affects the quality of virtual viewpoint rendering

Images