Free viewpoint video depth map coding method and distortion predicting method thereof

A technology of depth map coding and prediction method, which is applied in the field of video signal processing, can solve the problems of limited accuracy of estimation model, large amount of calculation, unfavorable real-time system application, etc., and achieve the effect of reducing computational complexity and improving accuracy

Active Publication Date: 2013-11-20
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF4 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional distortion calculation method is simple in principle and easy to implement in hardware, but it does not consider the impact of depth map distortion on the synthetic view, so it cannot guarantee the quality of the synthetic view as a whole
The depth map distortion calculation method based on the viewpoint synthesis algorithm can effectively

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Free viewpoint video depth map coding method and distortion predicting method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The idea of ​​the present invention is mainly to use one-time viewpoint pre-synthesis (the current general method is to repeatedly perform the viewpoint synthesis algorithm during encoding, while the method of the present invention is to use only one synthesis algorithm to record some information, and then only need to repeatedly perform the simplification Algorithm on the line), obtain the coded depth map pixel synthesis features and distortion prediction weights, and then map to generate a depth map coded distortion prediction model. Due to the effective definition and use of synthetic feature data reflecting the impact of depth map lossy compression on viewpoint synthesis, repeated execution of the synthesis algorithm in the depth map coding process is avoided, and the present invention can significantly improve the depth map distortion in the free viewpoint video depth map coding process predictive accuracy while substantially reducing the computational complexity of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a free viewpoint video depth map coding method and a distortion predicting method thereof. The distortion predicting method comprises the following steps: A1, acquiring a stereoscopic video texture map with more than two viewpoints and a depth map; A2, adopting a viewpoint synthesis algorithm to synthesize the current viewpoint to-be-coded and a middle viewpoint of the viewpoint to-be-coded, adjacent to the to-be-coded viewpoint; A3, recording composite characters of all pixels in the current to-be-coded viewpoint depth map and generating corresponding distortion predicting weight according to synthesis results of the step A2; A4, carrying out distortion summation for all pixels in the coding block of a current depth map by using a distortion predicting model according to the composite characters of all pixels and the corresponding distortion predicting weight, so as to obtain total distortion. According to the invention, accuracy in predicting the distortion of the depth map during a free viewpoint video depth map coding process can be improved, and meanwhile, the calculating complexity of a distortion predicting algorithm in free viewpoint video depth map coding can be lowered greatly.

Description

technical field [0001] The invention relates to video signal processing, in particular to a distortion prediction method for free-viewpoint video depth sequence coding. Background technique [0002] Free viewpoint video can greatly enhance the user's visual experience and enable users to obtain a more realistic 3D scene experience, so it has broad application prospects in film and television production, cultural relic protection, military simulation and other fields. As a promotion of HEVC (High Efficiency Video Coding), a joint video project of MPEG (Moving Pictures Experts Group) and VCEG (Video Coding Experts Group), 3D-HEVC will be developed for 3D video coding. [0003] In 3D-HEVC, 3D video data is encoded in the format of "multi-view video + depth map", where the depth map represents the distance from the object in the scene to the camera. Using the decoded texture data and depth data, arbitrary intermediate viewpoint video can be composited and displayed on a stereos...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N7/26H04N7/32H04N7/64H04N13/00H04N19/89
Inventor 金欣李晨阳戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products