Multi-view depth acquisition method

Abstract

The invention discloses a multi-view depth acquisition method, relates to the field of computer vision and the technical field of deep learning, solves a depth map by using a machine learning mode, and has better robustness for shooting angle problems such as wide baselines and complex texture and shadow problems such as rough areas, weak texture areas and shielding. A CBAM attention mechanism is introduced into a feature extraction module, and features obtained by convolution each time are sorted in two directions of a channel dimension and a space dimension. Hopping layer connection in a feature extraction Unet structure ensures that high-level information is not covered, and low-level information is obtained at the same time. The feature extraction Unet and the CBAM attention mechanism fully consider the relation of geometric mapping of different view angles, and the recognition capability of the feature extraction module on different view angle features is improved. In a cost regularization part, a mode of combining 3D convolution and bidirectional long short-term memory (LSTM) is used, and the three-dimensional variance characteristics are regularized from two aspects of depth dimension and channel dimension, so that the network processing is improved, and the generation speed is high.

Description

Technical field: [0001] The present invention relates to the field of computer vision and the field of deep learning technology, in particular to a multi-view depth acquisition method. Background technique: [0002] Three-dimensional reconstruction refers to the use of images of three-dimensional objects in the real world to establish a three-dimensional model stored by a computer. It is a key technology for using a computer to store the three-dimensional geometric structure of the objective world. 3D reconstruction has applications in 3D modeling and mapping, robotics, medical imaging, surveillance, tracking and navigation. At the same time, depth acquisition has broad application prospects in various industries such as reverse engineering, games and entertainment. [0003] 3D reconstruction using computer vision is a complete process, including camera calibration, feature matching and reconstruction. The purpose of 3D reconstruction is to restore the complete structural ...

AI Technical Summary

Problems solved by technology

[0010] In order to obtain higher-precision depth information, solve the dependence on feature matching caused by the limitation of extracting feature points in traditional depth acquisition methods, and speed up the generation of depth maps at the same time

Images