Multi-view three-dimensional reconstruction method

A 3D reconstruction and multi-view technology, which is applied in the field of image processing and stereo vision, can solve the problems that limit the applicability of 3D reconstruction technology, and achieve the effects of increasing the scope of action, reducing the probability of loss, and high reconstruction accuracy

Active Publication Date: 2019-12-13
TIANJIN UNIV
View PDF6 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] When using multi-view for 3D reconstruction in existing technologies, although information from multiple perspectives can be better used to obtain a 3D reconstruction model, most algorithms have strict requirements on the number of input multi-view images, making it difficult to Reconstruction of 3D mesh models in the ca

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-view three-dimensional reconstruction method
  • Multi-view three-dimensional reconstruction method
  • Multi-view three-dimensional reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0056] Figure 4 The multi-view proposed by the present invention is given respectively on the ShapeNet test data set Figure three The comparison of the results obtained after calculating the quantitative index Chamfer Distance (CD) of the model reconstructed by the three-dimensional reconstruction method and the 3D-R2N2 method.

[0057] The data in the figure represents the average value of the CD of the 13 types of data in the ShapeNet test data set, and the lower the CD value, the higher the reconstruction accuracy and the better the performance of the method. It can be seen from the data results that the multi-view reconstruction method proposed by the present invention has the lowest CD value and the best reconstruction performance.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-view three-dimensional reconstruction method, and the method comprises the following steps: based on an end-to-end deep learning framework, taking a plurality of colorimages at different visual angles as network input, and taking a reconstructed three-dimensional grid model as output; according to the network, firstly, extracting multi-view fusion features of different scales by using a multi-level fusion feature extraction module; and based on the fusion features of different scales, utilizing a grid deformation module to deform the input initialized ellipsoidal grid model, and reconstructing a three-dimensional grid model corresponding to the input image. According to the method, multi-view information is fully utilized, and higher reconstruction precision and a better reconstruction effect are achieved.

Description

technical field [0001] The present invention relates to the technical fields of image processing and stereo vision, in particular to a multi-view Figure three Dimensional reconstruction method. Background technique [0002] As a hot issue in the field of computer graphics and computer vision, 3D reconstruction has received more and more attention. The task of 3D reconstruction is to construct the 3D structural model of the scene and the objects in the scene according to the mapping relationship between 2D and 3D space on the premise of using the visual inspection equipment to obtain the image. This technology has been widely used in urban planning, medical diagnosis and unmanned driving, and has important research significance and application value. [0003] Traditional 3D reconstruction methods use the principle of binocular vision geometry to reconstruct complex 3D scenes based on disparity information, so as to achieve a certain degree of realistic scene modeling. Howe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/20G06K9/62G06N3/04
CPCG06T17/205G06N3/045G06F18/253
Inventor 雷建军宋嘉慧郭琰侯春萍范晓婷徐立莹
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products