Large-scale part three-dimensional reconstruction method based on image sequence

An image sequence and three-dimensional reconstruction technology, applied in image enhancement, image analysis, image data processing, etc., can solve the problems of low matching time efficiency, disordered reconstruction results, low efficiency of dense reconstruction process, etc.

Active Publication Date: 2020-10-23
SHANDONG IND TECH RES INST OF ZHEJIANG UNIV
View PDF3 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0014] Although the above methods can achieve better reconstruction results, there are still many problems in the overall reconstruction technology; for example, in the incremental method, the matching time efficiency of the image-to-feature point matching stage is low, and clustering operations need to be performed on the feature point descri...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale part three-dimensional reconstruction method based on image sequence
  • Large-scale part three-dimensional reconstruction method based on image sequence
  • Large-scale part three-dimensional reconstruction method based on image sequence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0099] The present invention is further described in conjunction with the accompanying drawings.

[0100] The reconstruction method based on image sequence does not rely on additional equipment to obtain information such as position, direction or geometric structure, but uses computer vision and geometric techniques to obtain information through the image itself. The present invention mainly utilizes the incremental motion recovery structure method to estimate the camera pose and register spatially sparse three-dimensional points. Since the reconstruction process strongly depends on the accuracy of feature point matching between images, when there are similar repetitive structures between images, false matching pairs will be introduced, resulting in wrong reconstruction results. For such objects with repetitive structures, the present invention uses independent observation points between images to detect repetitive structures and correct reconstruction results.

[0101] A met...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The large part three-dimensional reconstruction method based on the image sequence comprises the following steps that S1, an unmanned aerial vehicle carrying a camera flies around a target part, and ato-be-reconstructed image sequence is obtained; s2, adopting an SIFT algorithm and an SURF algorithm to jointly extract image feature points; s3, estimating camera motion by calculating an essentialmatrix and a basic matrix based on the sparse feature points obtained by the SIFT corner points and the SURF corner points, and registering three-dimensional space points to obtain sparse point cloudof a three-dimensional scene; s4, judging whether the optimized sparse point cloud has a symmetrical repeated structure or not; and S5, taking the sparse point cloud as seed point and reference imageinput, and performing dense reconstruction based on a dense three-dimensional point construction method of multiple views to obtain a low-resolution depth map. The three-dimensional point recovery andcorrection method based on the image sequence has the advantages that the three-dimensional point recovery and correction method based on the image sequence is provided, and construction from the image sequence to the space sparse three-dimensional points is achieved.

Description

technical field [0001] The invention relates to a method for three-dimensional reconstruction of large components based on visual images. Background technique [0002] The overall process of image-based 3D reconstruction technology is as follows: first, image input is obtained by taking images of objects from different perspectives, then extracting feature points of the image set, establishing mutual relations through the matching relationship of feature points between images, and then using multi-view geometric principles to calculate and obtain 3D point coordinates and estimate the camera pose, and then optimize the 3D information through the beam adjustment method to obtain the corresponding sparse 3D result output; the feature point extraction and matching process will be affected by factors such as illumination, occlusion, or repeated appearance of a certain structure in the scene. Getting wrong results will seriously affect the calculation results of the camera project...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T7/55G06K9/46
CPCG06T17/00G06T7/55G06T2207/10028G06V10/462G06V10/44
Inventor 曹衍龙董献瑞王敬梁立威
Owner SHANDONG IND TECH RES INST OF ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products