A 3D video frame rate improvement method based on depth-guided extended block matching

Abstract

The present invention discloses a three-dimensional video frame rate enhancing method based on depth guide extension block matching. The method comprises a step of carrying out bidirectional movement estimation based on an image block on a video frame, using a movement vector obtained by estimation to compensate to obtain an initial depth insert frame, calculating the two-dimensional structure tensor of each depth image block in the insert frame, and dividing image blocks into edge image blocks and non-edge image blocks according to the two-dimensional structure tensors, a step of dividing the edge image blocks into a plurality of sub blocks, and estimating the movement vector of each sub block by using an extension block matching method based on depth information guide, a step of carrying out adaptive movement compensation on the non-edge image blocks and the edge image blocks with image blocks as a unit and realizing the reconstruction of the insert frame. According to the method, the problem of the insert frame foreground object edge fuzzy in three-dimensional video frame rate enhancement is effectively solved.

Description

technical field [0001] The invention relates to a three-dimensional video frame rate improving method based on depth-guided extended block matching. Background technique [0002] As an emerging form of visual media, 3D video can provide users with a strong sense of three-dimensionality and immersion, and the most commonly used 3D video format is color + depth video frame. Compared with traditional two-dimensional video, three-dimensional video provides both color and depth video. At the same time, with the development of video capture and playback equipment, the spatial resolution of single-frame video has been greatly improved. Therefore, compared with traditional video, The amount of 3D video data has increased dramatically. In an actual stereoscopic video transmission system, it is usually necessary to achieve the purpose of reducing the amount of transmitted data through efficient coding technology and virtual view synthesis. Even so, the high frame rate transmission o...

AI Technical Summary

Problems solved by technology

Although the research on traditional video frame rate improvement has been relatively sufficient, some efficient frame rate improvement algorithms have been proposed and applied, but the existing algorithms usually perform traditional block matching on the edge image blocks of moving objects in the video scene to obtain motion vectors, and according to The motion vector refers to the previous frame and the current frame at the same time to reconstruct the edge image block of the inserted frame, resulting in inaccurate block matching and blurring of the edge of the moving object in the inserted frame, which greatly affects the visual quality of the video after the frame rate is increased.

On the other hand, for stereoscopic video, existing 3D video frame rate enhancement algorithms do not make full use of depth information and spatial information between different viewpoints, which are important in motion estimation, motion vector field optimization processing, and motion compensation. effect

Images