Monocular light field image unsupervised depth estimation method based on convolutional neural network

A convolutional neural network and depth estimation technology, which is applied in the field of unsupervised depth estimation of monocular field images, which can solve the problem of accurate labeling difficulties, and achieve the effect of accurate, fast and efficient image depth estimation results.

Active Publication Date: 2019-08-23
HANGZHOU DIANZI UNIV
View PDF10 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Single image depth estimation is an important technique for obtaining scene depth based on images in 3D reconstruction, and it is also a classic problem in computer vision. In recent years, single image depth estimation based on supervised learning has developed rapidly. However, to obtain the accuracy of supervised learning The labeling of is very difficult and will be affected by many external factors such as environment, light and so on. To overcome these influences requires a huge price

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monocular light field image unsupervised depth estimation method based on convolutional neural network
  • Monocular light field image unsupervised depth estimation method based on convolutional neural network
  • Monocular light field image unsupervised depth estimation method based on convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The present invention will be further described below in conjunction with drawings and embodiments.

[0055] Such as figure 1 As shown, the unsupervised depth estimation method for monocular field images based on convolutional neural network, specifically includes the following steps:

[0056] Step 1. The experimental data set of the present invention is based on the light field image data set disclosed by Stanford using the Lytroillum light field camera to shoot real objects in the real world. The data set includes a large number of plants, flowers, street scenes and some sculpture images. These images are preprocessed and enhanced. The enhancement methods mainly used in the present invention include enhancing image brightness, horizontal / vertical flipping and random cutting, etc. After image enhancement, the data set is further expanded, and training samples and test samples are increased. The diversity of the network model will be further enhanced, and the generali...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a monocular light field image unsupervised depth estimation method based on a convolutional neural network. According to the method, the disclosed large-scale light field imagedata set is firstly used as a training set, and samples of the training set tend to be balanced through data enhancement and data expansion; an improved ResNet50 network model is constructed; an encoder and a decoder are used for extracting high-level and low-level features of a model respectively, results of the encoder and the decoder are fused through a dense difference structure, meanwhile, asuper-resolution shielding detection network is additionally constructed, and the shielding problem between all visual angles can be accurately predicted through deep learning; the objective functionbased on the light field image depth estimation task is a multi-loss function, the preprocessed image is trained through a pre-defined network model, and finally generalization evaluation is carriedout on the network model on a test set. According to the method, the preprocessing effect on the light field image of the complex scene is obvious, and the effect of more accurate light field image unsupervised depth estimation is achieved.

Description

technical field [0001] The invention relates to the field of light field image processing, in particular to an unsupervised depth estimation method for monocular field images based on a convolutional neural network. Background technique [0002] Single image depth estimation is an important technique for obtaining scene depth based on images in 3D reconstruction, and it is also a classic problem in computer vision. In recent years, single image depth estimation based on supervised learning has developed rapidly. However, to obtain the accuracy of supervised learning Labeling is very difficult and will be affected by many external factors such as environment and light, and it will take a huge price to overcome these effects. Based on this, according to the characteristics of image depth, the present invention invented a monocular unsupervised depth estimation method based on deep convolutional neural network, which can quickly and accurately estimate the depth information of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04
CPCG06N3/045G06F18/214
Inventor 戴国骏刘高敏张桦周文晖陶星戴美想
Owner HANGZHOU DIANZI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products