Multi-view reconstruction method based on deep learning contour network

A deep learning, multi-view technology, applied in the field of view reconstruction, which can solve problems such as complex lighting conditions

Inactive Publication Date: 2018-07-20
SHENZHEN WEITESHI TECH
View PDF2 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although there is a lot of research on multi-view reconstruction, there are still some challenges in combining information from multiple views and improving the reconstruction performance accordingly when the original view images are few, the baseline is wide and the lighting conditions are complex.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-view reconstruction method based on deep learning contour network
  • Multi-view reconstruction method based on deep learning contour network
  • Multi-view reconstruction method based on deep learning contour network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present invention will be further described in detail below in conjunction with the drawings and specific embodiments.

[0028] figure 1 It is a system frame diagram of a multi-view reconstruction method based on deep learning contour network in the present invention. It mainly includes the introduction of deep learning architecture, 3D shape encoding, construction of contour network, network training and testing.

[0029] Among them, the introduction of deep learning architecture, the introduction of blob-shaped object datasets and real sculpture datasets, wherein the blob-like object dataset is used for pre-training, and the sculpture dataset is used to prove that contours can learn and encode three-dimensional shapes, and in each In order to generate a new contour view in sculptures of various shape...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-view reconstruction method based on a deep learning contour network. The method comprises steps of introducing a deep learning architecture, carrying out three-dimensional shape coding, constructing a contour network, and carrying out network training and testing. To be specific, a deep learning contour network is introduced and the used for learning three-dimensional shape codes of one or more input images; a new view is generated by using a code adjustment decoder; with introduction of a contour-based proxy loss, when the decoder does not include three-dimensional representation, the network uses the two-dimensional loss to encode the three-dimensional shape, wherein the two-dimensional loss is not limited by the three-dimensional representation resolution;and a massive spotted object data set network is generated and pretrained and then micro adjustment of the contour network of the data set is carried out. According to the invention, the three-dimensional shape is learned by using the neural network and the contour generated in the new view forces the network to code a three-dimensional shape; information of multiple views is combined; and the multi-view reconstruction performance is improved.

Description

technical field [0001] The present invention relates to the field of view reconstruction, in particular to a multi-view reconstruction method based on deep learning contour network. Background technique [0002] Multi-view reconstruction is a method to restore the 3D model of the scene by using multiple pictures of different perspectives of a scene. The multi-view of natural scenes Figure three Three-dimensional reconstruction has always been a basic problem in the field of computer vision. By reconstructing the three-dimensional model of the target, the target can be quantitatively analyzed and the relevant information of the target can be processed. Multi-view reconstruction technology is applied to medical imaging. Through view reconstruction, on the one hand, biomedical imaging technology can obtain visualized structural or functional information for biological research or clinical diagnosis; on the other hand, human body structure can also be obtained through reconstruc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T7/13G06N3/04G06N3/08
CPCG06N3/084G06T5/001G06T7/13G06T2207/10012G06T2207/20081G06T2207/20084G06N3/045
Inventor 夏春秋
Owner SHENZHEN WEITESHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap