Unsupervised absolute scale calculation method and system

A calculation method and unsupervised technology, applied in the field of computer vision, can solve the problems of scale uncertainty, the inability to obtain the true value of each frame image, and the difficulty of applying scale restoration methods to achieve the effect of ensuring structural consistency

Active Publication Date: 2020-06-12
ADVANCED INST OF INFORMATION TECH AIIT PEKING UNIV +1
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, most unsupervised monocular models face the following challenging problems: scale uncertainty and scale recovery problem
[0009] Such a scale recovery method is difficult to apply in practice, because there is no way to get the true value of each frame image in the actual scene

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unsupervised absolute scale calculation method and system
  • Unsupervised absolute scale calculation method and system
  • Unsupervised absolute scale calculation method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0053] Such as Figure 1-9 As shown, a method and system for unsupervised absolute scale calculation, in which the following modules are mainly used: pose estimation depth network module T, depth estimation depth network module G1, depth network module G2 for restoring a reference RGB image according to a reference depth map, Discrimination module D1, discrimination module D2 and error loss function module. Module T includes encoder and predictor, module G1, module G2, module D1 and module D2 all include encoder and decoder, the encoder of module T adopts ResNet18 network structure, and the predictor of module T adopts Figure 8 As shown in the structure, the predictor is a network structure composed of 4 convolutional layers; the encoder of module G1 adopts ResNet18 network structure, and the decoder of module G1 adopts Figure 7 As shown in the structure, the decoder is a network structure composed of 5 layers of deconvolution layers; the encoder of module G2 adopts the Res...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unsupervised absolute scale calculation method and system. The method comprises the following steps of: judging a reference absolute scale depth map and a prediction depth map by using a Generative Adversarial Networks (GAN); and meanwhile, due to the constraint of the re-projection error, the predicted depth map and the pose are in the same scale, so that the pose alsohas the absolute scale.

Description

technical field [0001] The invention belongs to the field of visual odometry and depth estimation methods in the field of computer vision, in particular to an unsupervised absolute scale calculation method and system. Background technique [0002] In recent years, the algorithms of monocular dense depth estimation and visual odometer VO (Visual Odometry) based on deep learning methods have developed rapidly, and they are also key modules of SfM and SLAM systems. Existing studies have shown that VO and depth estimation based on supervised deep learning achieve good performance in many challenging environments and alleviate performance degradation issues such as scale drift. However, to train these supervised models in practical applications, it is difficult and expensive to obtain enough ground truth labeled data. In contrast, unsupervised methods have the great advantage of only requiring unlabeled video sequences. [0003] Deep unsupervised models for depth and pose estim...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/55G06T7/70
CPCG06T7/55G06T7/70G06T2207/10016G06T2207/20081G06T2207/20084G06T2207/30244
Inventor 蔡行李承远李宏
Owner ADVANCED INST OF INFORMATION TECH AIIT PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products