Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Monocular depth estimation method based on deep learning

A technology of depth estimation and deep learning, which is applied in the field of monocular depth estimation based on deep learning, can solve the problems of poor restoration of details and large amount of calculation, and achieve better restoration of details, low resolution, and improved training speed Effect

Active Publication Date: 2020-01-31
FUZHOU UNIV
View PDF4 Cites 34 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the deficiencies in the prior art, the technical problem to be solved by the present invention is to provide a monocular depth estimation method based on deep learning to solve the problems of large amount of calculation and poor recovery of details in depth reconstruction when using deep learning for depth estimation. question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monocular depth estimation method based on deep learning
  • Monocular depth estimation method based on deep learning
  • Monocular depth estimation method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to make the features and advantages of this patent more obvious and easy to understand, the following special examples are described in detail as follows:

[0055] Such as figure 1 As shown, the solution flow provided by this embodiment includes the following steps:

[0056] 1) Data set preprocessing, generate training set and test set, and perform data enhancement on the original image collected by the monocular lens and its corresponding real depth image. The specific steps are as follows:

[0057] 1-1) Classify the original data set, generate the training set and the test set and the label files of the two, wherein 50688 pairs of images are the training set, 654 pairs of images are used as the test set, and each pair of images in the training set and test set includes the original The image and the corresponding real depth image, the label file includes the serial number and file directory of the original image and the real depth image;

[0058] 1-2) Readj...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a monocular depth estimation method based on deep learning, and the method is based on an unsupervised convolutional neural network structure for monocular depth estimation, andcomprises an encoder, a multi-scale feature fusion module, a gating adaptive decoder, and a refinement unit. The method comprises the following steps: S1, preprocessing a data set; S2, constructing aloss function of the convolutional neural network, inputting a training set image, calculating a loss value of the loss function by using a back propagation algorithm, and performing parameter learning by reducing errors through repeated iteration to enable a prediction value to be close to a real value so as to obtain an optimal weight model of the convolutional neural network; and S3, loading the weight model trained in the step S2, and inputting the test set into an unsupervised convolutional neural network for monocular depth estimation to obtain a depth prediction image. The method solves the problems of large calculation amount during offline training and poor detail part recovery effect in deep reconstruction.

Description

technical field [0001] The invention belongs to the field of image recognition and artificial intelligence, in particular to a monocular depth estimation method based on deep learning. Background technique [0002] In recent years, with the development of computer technology, deep learning has made a series of breakthroughs in the field of computer vision, and using deep learning to obtain the depth of monocular images has also become a popular research field. Depth images contain distance information in the scene, which is the basic task in 3D reconstruction, navigation, target detection and recognition, semantic segmentation, and an important basis for environmental perception and scene understanding. Although the current mainstream uses lidar and depth sensors to obtain object distance information, these sensors are expensive and have certain requirements for the surrounding environment when used. For example, laser attenuation increases sharply in harsh environments such...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/50G06K9/62G06N3/04G06N3/08
CPCG06T7/50G06N3/084G06T2207/20081G06T2207/20084G06N3/045G06F18/2135G06F18/253Y02T10/40
Inventor 林立雄黄国辉汪青何炳蔚张立伟陈彦杰
Owner FUZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products