Dense three-dimensional reconstruction method and system based on multi-scale geometric consistency guidance

A 3D reconstruction and consistency technology, applied in the field of computer vision, can solve the problems of not considering the reliable constraints of depth estimation in weak texture areas, the loss of depth estimation in detail areas, etc.

Active Publication Date: 2019-08-27
HUAZHONG UNIV OF SCI & TECH
View PDF9 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the above defects or improvement needs of the prior art, the present invention provides a dense 3D reconstruction method and system based on multi-scale geometric consistency guidance, thereby solving t...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dense three-dimensional reconstruction method and system based on multi-scale geometric consistency guidance
  • Dense three-dimensional reconstruction method and system based on multi-scale geometric consistency guidance
  • Dense three-dimensional reconstruction method and system based on multi-scale geometric consistency guidance

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0049] figure 1 A general flow diagram of the invention is shown. The greatest contribution of the present invention is to propose a multi-scale geometric consistency guidance scheme for the depth estimation problem of weak texture regions. On a coarser scale, weakly textured regions can contain more salient texture information under the same matching window size. Therefore, the depth information of the weak texture area can be estimated more reliably on the coarser scale first, and then propagated to the finer scale gradually. In this process, due to the fact that photographic consistency cannot provide reliable depth estimation for weakly textured regions on a finer scale, in order to ensure that the reliable estimation of these regions on a coarse scale will not be disturbed by photographic consistency, the geometry between multiple views is used. Consistency can combine the depth estimation results of the neighborhood to constrain reliable estimates of weakly textured re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dense three-dimensional reconstruction method and system based on multi-scale geometric consistency guidance, and belongs to the field of computer vision, and the method comprises the steps: building an image pyramid based on an image set; carrying out depth estimation on the most rough scale of the image pyramid by utilizing photographing consistency, and acquiring a depth map on the most rough scale; taking the most rough depth image on the scale as a depth image on the current scale, sequentially carrying out upsampling and error depth estimation correction on thedepth image on the current scale, and carrying out optimization by utilizing geometric consistency to obtain an optimized depth image on the next scale; taking the optimized depth map of the next scale as a depth map of the current scale, and then carrying out upsampling, correction and optimization until optimized depth maps of all original images in the image set are obtained; and fusing the optimized depth maps of all the original images to obtain dense three-dimensional point cloud. The depth information of the weak texture area can be estimated, and the depth information of the detail area can be kept.

Description

technical field [0001] The invention belongs to the field of computer vision, and more specifically relates to a dense three-dimensional reconstruction method and system guided by multi-scale geometric consistency. Background technique [0002] The patch matching stereo vision method basically follows a 4-step process: random initialization, propagation, view selection and refinement. Among them, the view selection determines the set of aggregated views for each pixel of the current reference image. For a certain pixel in the reference image, the mining of its aggregated view set depends heavily on the similarity between the patch delineated when the pixel is matched and the patch formed by the corresponding pixels in the neighboring views. However, in order to comprehensively consider the depth change and relatively smooth area, the pixel area delineated for measuring the similarity of the patch is usually not too large. Thus, for weakly textured regions, such usual regio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T7/50
CPCG06T7/50G06T17/00G06T2207/10028G06T2207/20016
Inventor 陶文兵徐青山
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap