Super-resolution reconstruction method of depth map

A super-resolution reconstruction and depth map technology, applied in the field of computer vision, can solve problems such as lack of complementary information, inaccurate depth pixel values, etc., and achieve good results

Active Publication Date: 2017-02-15
TIANJIN UNIV
View PDF6 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to overcome the deficiencies of the existing technology, the current super-resolution reconstruction algorithm of the depth map mainly considers the information of a single depth image, lacks the research status of complementary information between viewpoints and inaccurate depth pixel values, etc., the present invention aims to propose a fusion of multiple The super-resolution reconstruction method of viewpoint depth information lays the foundation for 3D image processing technologies such as virtual viewpoint rendering

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Super-resolution reconstruction method of depth map
  • Super-resolution reconstruction method of depth map
  • Super-resolution reconstruction method of depth map

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0053] The best implementation mode of the present invention is described below by super-resolution reconstruction of depth maps based on the fusion of two viewpoint depth maps: 1. Judgment of credible depth values

[0054] Depth maps captured by mainstream depth map cameras often contain imprecise pixel values. This phenomenon is mainly caused by internal factors such as photon shot noise and thermal noise, as well as external factors such as high reflection and weak brightness of the scene. To solve this problem, the complementary information between multiple viewpoints is considered to improve the imprecise depth value of the current viewpoint. On the one hand, because the same 3D scene is shot from different perspectives, its depth values ​​are the same or close to each other. Therefore, a threshold is set, and when the disparity value between viewpoints is within this error range, it means that the depth value of the viewpoint is accepted for multi-viewpoint fusion. Sup...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a super-resolution reconstruction method in which multi-view depth information is fused, belongs to the field of machine vision, and provides basis for 3D image processing technologies as virtual viewpoint drafting. The method comprises the following steps that 1) a trusted depth value is determined according to the restriction determining conditions that the depth values of the same 3D point shot in different visual angels are the same or close to one another and that the pixel values of color pictures are very close to one another when adjacent viewpoint color pictures and depth maps are used to draw single-viewpoint virtual view; 2) after that a trusted weight expression Ri, j(p) is determined, a matching point of all pixel points of the present viewpoint is searched according to a stereoscopic matching relation, the depth value credibility is combined with a virtual view quality credibility, and a multi-view depth map fusion mechanism is provided; and 3) the depth map is reconstructed. The method of the invention is mainly applied to 3D image processing.

Description

technical field [0001] The invention belongs to the field of computer vision, and relates to a depth map super-resolution reconstruction method based on credibility fusion for a multi-viewpoint low-resolution depth map acquired by a depth perception camera. Background technique [0002] The super-resolution reconstruction of the depth map is to solve the problems of low spatial resolution and loss of high-frequency detail information of the depth map through software algorithms without changing the existing depth acquisition hardware system, and reconstruct a high-resolution depth map. The core of depth map super-resolution reconstruction technology is to restore low-resolution depth map details, sharpen edges and increase spatial resolution. [0003] In recent years, with the rapid development of the field of 3D images, 3D content has become more and more common. In fields such as manufacturing, object reconstruction, and 3D media entertainment, accurate and high-resolutio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06T5/00G06T5/50
CPCG06T3/4053G06T5/001G06T5/50G06T2207/10141G06T2207/20221
Inventor 雷建军李乐乐侯春萍吴敏丛润民倪敏
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products