A method of upsampling low-resolution depth images based on image features

Abstract

The invention discloses a method for achieving up-sampling of a low-resolution depth image based on image features. According to content-based variance of the low-resolution depth image, content-based variance of a low-resolution color image and the coefficient of association between corresponding pixel points of the low-resolution depth image and the low-resolution color image, pixel values obtained after up-sampling of pixel points of the foreground edge of the low-resolution depth image can be well guided to reflect edge information, obtained after up-sampling, of the high-resolution depth image; for discontinuous pixel points in the low-resolution depth image, replacement and refinement are carried out on pixel values, obtained after up-sampling, of the discontinuous pixel points based on pixel points, in a window, of the low-resolution depth image according to the level of similarity between the pixel values obtained after up-sampling and pixel values, with the pixel values obtained after up-sampling as the center, of the pixel points in the appointed window, and therefore the continuity of the high-resolution depth image obtained after up-sampling can be well kept. Through the two steps, edge blur of the low-resolution depth image can be effectively restrained in the up-sampling process.

Description

technical field [0001] The invention relates to a processing method of a depth image, in particular to an upsampling method of a low-resolution depth image based on image features. Background technique [0002] With the continuous development and advancement of commercial industries such as 3D (Three-Dimensional, 3D) movies and 3D television, 3D video has poured into people's field of vision. Different from 2D video formats, 3D video contains depth information widely used in computer interaction, robot vision, and 3D scene reconstruction. The quality of depth information will directly affect the stereoscopic visual experience of viewers; in addition, depth information can also be used DepthImageBasedRendering (DIBR) based on the depth map to realize the virtual viewpoint rendering function of the free viewpoint video system. At the same time, in the 3D video coding standard, the depth image providing depth information is used to reduce the data volume of the 3D video, so as...

AI Technical Summary

Problems solved by technology

However, the general method of upsampling low-resolution depth images based on high-resolution color images can easily lead to edge blurring in the high-resolution depth images obtained after upsampling, thereby reducing the quality of high-resolution depth images and reducing the quality of high-resolution depth images. The accuracy of video affects its application in various occasions such as human-computer interaction, 3D scene reconstruction, virtual viewpoint rendering, etc.

Images