Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional reconstruction method considering multi-stage matching propagation of weak texture area

A technology of 3D reconstruction and texture area, which is applied in the field of analysis and measurement, can solve problems such as bumpy water surface, hollow wall, unsatisfactory image matching and reconstruction effect, etc., and achieve the effect of overcoming illumination changes

Inactive Publication Date: 2020-05-26
SHANDONG TANGKOU COAL +1
View PDF11 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the complexity of the scene structure (especially for urban scenes), the influence of factors such as illumination changes, perspective distortion, weak texture and repeated texture areas in the scene, it is still difficult to effectively obtain complete 3D reconstruction results using oblique multi-view image information. is a very challenging subject
Among the existing related algorithms and relatively mature commercial software, the matching and 3D reconstruction of texture-rich images or image regions are relatively perfect, but for some weak texture, no texture and repeated texture regions, image matching and reconstruction The effect is usually not ideal, which leads to phenomena such as "bumps" on the water surface and "holes" in the walls in the subsequent 3D reconstruction results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional reconstruction method considering multi-stage matching propagation of weak texture area
  • Three-dimensional reconstruction method considering multi-stage matching propagation of weak texture area
  • Three-dimensional reconstruction method considering multi-stage matching propagation of weak texture area

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] refer to figure 1 , figure 2 and image 3 , a 3D reconstruction method of the present invention that takes into account multi-stage matching and propagation of weak texture areas, uses the initial sparse matching results based on SIFT to estimate the homography matrix between images, and densely matches the reference image and the image to be matched after projection deformation correction between images. Taking into account the weak texture area and based on the assumption of segmental smoothness of the scene, matching propagation and 3D reconstruction are carried out in three stages, which is a step-by-step constraint and layer-by-layer progressive process. The first stage: use the existing algorithm to complete the pixel-level matching propagation and construct the initial 3D model at the same time, and complete the spatial plane reconstruction of the texture-rich area on the basis of image segmentation; the second stage: based on the image segmentation and the 3D...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A three-dimensional reconstruction method considering multi-stage matching propagation of a weak texture area comprises the following steps of completing pixel-level matching transmission through an existing algorithm, while creating an initial three-dimensional model to complete spatial plane reconstruction of an area rich in texture; based on image segmentation and the three-dimensional model constraint constructed in a first stage, completing matching of a weak texture region and spatial plane reconstruction under an energy function minimization framework; under an energy function minimization framework, adopting a multi-constraint optimization method and the like to solve matching and reliable three-dimensional reconstruction of a texture-free area. According to the method, the problemthat in the prior art, the image matching and reconstruction effect is generally not ideal for areas with weak textures, areas without textures and areas with repeated textures is solved, and the phenomena of 'jolt 'of the water surface, 'cavities' of the wall body and the like in a three-dimensional reconstruction result are avoided. The influence of factors such as illumination change, perspective distortion, weak texture and repeated texture areas in a scene is overcome, and a guarantee is provided for a real effect and surveying and mapping level precision.

Description

technical field [0001] The invention relates to the field of analysis and measurement, in particular to a three-dimensional reconstruction method considering multi-stage matching propagation in weak texture areas. Background technique [0002] Three-dimensional reconstruction, that is, the process of recovering the geometric structure of the surface of the object from the two-dimensional image, has always been an important research content of digital photogrammetry and computer vision. Compared with the traditional upright photogrammetry, since 3D reconstruction needs to obtain side texture information, oblique photography technology emerges at the historic moment, which comprehensively perceives complex scenes in a large-scale, multi-angle, high-precision, and high-definition way. Through efficient data The data results generated by the collection equipment and professional data processing process can intuitively reflect the appearance, position, height and other attributes...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G01C11/04
CPCG01C11/04
Inventor 李彪刘延生闫勇杨化超岳光波张鹏商迪
Owner SHANDONG TANGKOU COAL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products