Method of adaptively compensating stereo video frame rate up conversion based on correlation

A technology of adaptive compensation and frame rate up-conversion, applied in the field of image and multimedia signal processing, it can solve problems such as errors, blurred edges, etc., and achieve the effect of high quality, good edge characteristics, and enhanced processing.

Active Publication Date: 2017-01-11
SHANDONG UNIV
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, if we up-convert the frame rate of the depth map in the same way as the texture map, then the ima

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method of adaptively compensating stereo video frame rate up conversion based on correlation
  • Method of adaptively compensating stereo video frame rate up conversion based on correlation
  • Method of adaptively compensating stereo video frame rate up conversion based on correlation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The specific process of the stereoscopic video frame rate up-conversion method proposed by the present invention is as follows: figure 1 As shown in Fig. 1, the depth image is first classified according to the edge, and the current frame and the next frame of the texture image are obtained by edge-based adaptive motion estimation according to the classification results to obtain the initial motion vector, and then the optimal motion vector is obtained by post-processing based on the depth information. Motion vector, and then judge the edge area of ​​the hole block to complete the interpolation of motion compensation, achieve the frame rate up-conversion of the depth map and the texture map, effectively reduce the edge misinterpolation of the depth map, and achieve the purpose of high-quality reconstruction.

[0031] The present invention will be further described below in conjunction with specific embodiments (but not limited to this example) and accompanying drawings. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The correlation between a depth map and a texture map is used, classification of edge blocks and flat blocks is carried out on the depth map, a block motion matching criterion with texture gradient information added is adopted to obtain motion vectors of different macro blocks according to marks, motion vector post-processing and adaptive interpolation are carried out on the different macro blocks respectively, and a depth map interpolation frame and a texture map interpolation frame are obtained at the same time. Compared with the traditional frame rate up conversion method, the method of the invention enhances processing on edges of the depth map, the interpolated depth map has better edge features, and the interpolated texture map has better quality.

Description

technical field [0001] The invention relates to a stereoscopic video frame rate up-conversion technology, which belongs to the technical field of image and multimedia signal processing. [0002] technical background [0003] Free-viewpoint TV presents the audience with a three-dimensional viewing effect through multi-viewpoint playback, and thus has been widely developed. Due to the limitation of transmission bandwidth, the current research and application of 3D video usually adopts the depth video (MVD) mode. The presentation of the virtual viewpoint in 3D video is obtained by combining the real viewpoint texture map with the corresponding depth map through the depth map-texture map rendering technology (DIBR). The depth map is not used for direct viewing, but only for synthesizing virtual viewpoints. [0004] Frame rate up-conversion technology can break through the limitation of network transmission bandwidth, and increase the video frame rate by multiples at the receivin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N19/597H04N13/00
CPCH04N13/139H04N19/597
Inventor 刘琚肖依凡曲爱喜郭志鑫
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products