Free viewpoint video depth map coding method and distortion predicting method thereof

Abstract

The invention provides a free viewpoint video depth map coding method and a distortion predicting method thereof. The distortion predicting method comprises the following steps: A1, acquiring a stereoscopic video texture map with more than two viewpoints and a depth map; A2, adopting a viewpoint synthesis algorithm to synthesize the current viewpoint to-be-coded and a middle viewpoint of the viewpoint to-be-coded, adjacent to the to-be-coded viewpoint; A3, recording composite characters of all pixels in the current to-be-coded viewpoint depth map and generating corresponding distortion predicting weight according to synthesis results of the step A2; A4, carrying out distortion summation for all pixels in the coding block of a current depth map by using a distortion predicting model according to the composite characters of all pixels and the corresponding distortion predicting weight, so as to obtain total distortion. According to the invention, accuracy in predicting the distortion of the depth map during a free viewpoint video depth map coding process can be improved, and meanwhile, the calculating complexity of a distortion predicting algorithm in free viewpoint video depth map coding can be lowered greatly.

Description

technical field [0001] The invention relates to video signal processing, in particular to a distortion prediction method for free-viewpoint video depth sequence coding. Background technique [0002] Free viewpoint video can greatly enhance the user's visual experience and enable users to obtain a more realistic 3D scene experience, so it has broad application prospects in film and television production, cultural relic protection, military simulation and other fields. As a promotion of HEVC (High Efficiency Video Coding), a joint video project of MPEG (Moving Pictures Experts Group) and VCEG (Video Coding Experts Group), 3D-HEVC will be developed for 3D video coding. [0003] In 3D-HEVC, 3D video data is encoded in the format of "multi-view video + depth map", where the depth map represents the distance from the object in the scene to the camera. Using the decoded texture data and depth data, arbitrary intermediate viewpoint video can be composited and displayed on a stereos...

AI Technical Summary

Problems solved by technology

The traditional distortion calculation method is simple in principle and easy to implement in hardware, but it does not consider the impact of depth map distortion on the synthetic view, so it cannot guarantee the quality of the synthetic view as a whole

The depth map distortion calculation method based on the viewpoint synthesis algorithm can effectively guarantee the quality of the synthetic view, but the calculation amount is huge, which is not conducive to the application of real-time systems.

Depth map distortion prediction methods based on synthetic view distortion estimation properly balance coding complexity and compression performance, but the accuracy of existing estimation models is very limited

Images