Free viewpoint video depth map distortion prediction method and free viewpoint video depth map coding method

A prediction method and technology of depth map, applied in the direction of digital video signal modification, image communication, electrical components, etc., can solve the problems of limited accuracy and inability to provide synthetic view quality, so as to simplify the model, ensure the quality of synthetic view point and encode compression Performance, the effect of reducing computational complexity

Active Publication Date: 2014-06-18
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF9 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, existing depth map coding distortion prediction methods based on synthetic view distortion prediction have limited accuracy and cannot provide good synthetic view quality.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Free viewpoint video depth map distortion prediction method and free viewpoint video depth map coding method
  • Free viewpoint video depth map distortion prediction method and free viewpoint video depth map coding method
  • Free viewpoint video depth map distortion prediction method and free viewpoint video depth map coding method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028]Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be emphasized that the following description is only exemplary and not intended to limit the scope of the invention and its application.

[0029] refer to figure 1 , according to an embodiment of the present invention, a free-viewpoint depth video distortion prediction method based on hole-filling synthesis, comprising the following steps:

[0030] A1: For a given block of a given frame of a given view of a multi-view stereoscopic video sequence used for hole filling synthesis, input the encoded texture block T c , using the pre-selected coding mode to try to code the depth block d c , the corresponding original texture tile T o and the original depth tile d o ;

[0031] A2: Input the combined weight matrix W of this block, the combined weight matrix marks the combined weights when using the left and right viewpoint texture maps to obtain t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a free viewpoint video depth map distortion prediction method and a free viewpoint video depth map coding method. The free viewpoint video depth map distortion prediction method includes the steps that for a map block to be coded and used for hole-filling synthesis of a given frame of a multi-view three-dimensional video sequence given viewpoint, a coded texture map block, a depth map block coded by adopting a preselected coding mode in a trial mode, a corresponding original texture map block and an original depth map block are input; a combined weight matrix of the map block to be coded is input, wherein combined weight when synthetic viewpoint texture is obtained by using a left viewpoint texture map and a right viewpoint texture map is marked; distortion of the synthetic texture obtained after mapping and hole filling synthesis are completed by using pixel points in a depth map is calculated, and the distortion is used as a prediction value of synthetic viewpoint distortion; distortion prediction values of all pixels in the map block to be coded are summed to obtain a prediction value of synthetic viewpoint distortion caused by coding the map block to be coded. According to the method, coding distortion of the depth map can be predicated accurately, meanwhile the situation that a synthetic view algorithm is executed repeatedly is avoided, and the computation complexity is greatly lowered.

Description

technical field [0001] The invention relates to the fields of computer vision technology and video coding, in particular to a method for predicting distortion of a depth map of a free-viewpoint video and a coding method. Background technique [0002] Traditional 3D video systems can only provide users with single-view left and right eye videos, and their visual experience is very limited. The free-viewpoint video system can provide users with scene videos of arbitrary viewpoints by collecting and transmitting video information of limited viewpoints and using synthesis algorithms at the terminal. Therefore, the free viewpoint video system can greatly enhance the user's visual experience, and has broad development prospects. In order to develop technology for free viewpoint video coding, MPEG (Moving Pictures Experts Group) and VCEG (Video Coding Experts Group) proposed an extension project 3D-HEVC based on the joint video project HEVC (High Efficiency Video Coding). [0003...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N19/154H04N19/597H04N19/176H04N13/00
Inventor 金欣李晨阳戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products