A method for improving frame rate of depth map based on graph cut optimization
A depth map, frame rate technology, applied in the field of 3D video processing, can solve problems such as impracticality, blurred object edges, discontinuous motion vectors between blocks, etc.
Active Publication Date: 2019-01-04
ZHEJIANG UNIV
View PDF10 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Pixel-level matching works well, but the amount of calculation is too large to be practical; block matching is more commonly used, but it needs to solve the problems of discontinuous motion vectors between blocks and blurred edges of objects.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0037] In order to describe the present invention in more detail, the technical solution of the present invention will be described in detail below with reference to the drawings and specific embodiments.
[0038] The method of the present invention is implemented on the coding framework of 3D-HEVC, which is based on the MVD format, and encodes the collected multiple viewpoint videos and corresponding depth maps into a 3D video bitstream. After the texture video and the depth data are decoded, additional intermediate viewpoints can be synthesized for display using depth image based rendering (DIBR).
[0039] Such as figure 1 As shown, the depth map frame rate improvement method based on the graph cut optimization of the present invention specifically includes the following steps:
[0040] Step 1. Depth frame skip at the encoding end: On the 3D video encoding end, the texture map and depth map of the multi-viewpoint are sequentially encoded in units of access units, and the depth map...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a depth image frame rate upgrading method based on graph cut optimization. First of all, for each CTU (Coding Tree Unit), a block size and a search range for specifically executing motion estimation and compensation are determined by motion information of a corresponding block in a texture image; then, a motion search of each block is not relatively independent, but considers the smoothness of an interblock motion vector field and the motion searches of all blocks in one CTU are taken as an energy minimizing process, wherein a smooth item is a difference of adjacent blocks in a motion vector, and a data item is used for evaluating VSD (View Synthesis Distortion) of inserted depth image quality; and at last, the energy minimizing process is converted into a label optimal allocation process and is solved by a graph cut optimization algorithm. The depth image frame rate upgrading method disclosed by the invention is applied to optimization of the 3D video encoding efficiency as well as fault tolerance and enhancement of a depth video.
Description
Technical field [0001] The invention relates to the field of three-dimensional video processing, in particular to a depth map frame rate improvement method based on map cut optimization. Background technique [0002] The depth map plays an important role in the 3D video processing system. Although not directly displayed, the geometric information contained in the depth map can be used to synthesize a limited number of known viewpoints into additional virtual viewpoints, support free viewpoint viewing, and enhance visual experience. On the one hand, due to technological limitations, the depth map collected by the depth camera often has a low frame rate, resulting in too low time resolution of the synthesized virtual viewpoint, which is prone to video jitter and motion discontinuity. On the other hand, the multi-view video plus depth (MVD) format has a very large data volume. In order to facilitate transmission and storage, efficient video coding is required for compression. The ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/161H04N19/597
CPCH04N13/111H04N13/139H04N13/161H04N19/597
Inventor 陈耀武郭莉琳田翔周凡
Owner ZHEJIANG UNIV