Binocular vision stereo matching algorithm based on improved PSMNet

A technology of stereo matching and binocular vision, applied in computing, image data processing, instruments, etc., can solve problems such as unsatisfactory performance, achieve the effects of accelerating training convergence speed, improving loss function, and ensuring matching accuracy

Active Publication Date: 2019-07-30
麦特维斯(武汉)科技有限公司
View PDF2 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although compared with the traditional binocular vision stereo matching algorithm, the CNN-based stereo matching method has a certain improvement in speed and accuracy, but in ill-posed areas (such as occlusion areas, discontinuous disparity areas, weak texture areas, reflective surfaces, etc.) is still not ideal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Binocular vision stereo matching algorithm based on improved PSMNet
  • Binocular vision stereo matching algorithm based on improved PSMNet
  • Binocular vision stereo matching algorithm based on improved PSMNet

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention will be further described below in combination with specific embodiments.

[0031] The present invention proposes a kind of binocular vision stereo matching algorithm based on improved PSMNet, comprising the steps:

[0032] S1: Use the dimensionality reduction initial module to extract features from the left and right images, and obtain the feature maps respectively. The acquisition of the image by the initial module is to scan the image first to obtain the data image. According to the characteristics of the feature data on the image data, the feature data extraction;

[0033] S2: Input the obtained feature map into the SPP module. The SPP module compresses the feature map and performs upsampling. During the upsampling process, the method based on the edge of the original low-resolution image is used to first detect the edge of the low-resolution image, and then according to the detection The edges of the pixels are classified and processed, and t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a binocular vision stereo matching algorithm based on an improved PSMNet. The method comprises the following steps: performing feature extraction on the left image and the right image by adopting a dimensionality reduction starting module; obtaining feature maps respectively, inputting the obtained feature map into an SPP module; enabling the SPP module to compress the feature map and then carry out up-sampling; synthesizing the feature maps of different levels into a final SPP feature map; combining each parallax value in the left and right images, wherein the featuremap corresponding to each parallax value and the SPP feature map form a four-dimensional matching cost volume; enabling the three-dimensional convolution module to aggregate environment information, obtaining a final disparity map through up-sampling and disparity regression, calculating the possibility of each disparity according to a prediction cost Cd obtained through operation of a normalization exponential function, using constant mapping to perform optimization, and wherein a prediction disparity value is obtained through summation of each disparity value and the corresponding possibility.

Description

technical field [0001] The invention relates to the technical field of visual stereo algorithms, in particular to a binocular visual stereo matching algorithm based on improved PSMNet. Background technique [0002] After years of development, binocular stereo vision has played an important role in 3D reconstruction, industrial measurement, unmanned driving and other fields. Stereo matching is the core content of binocular vision research, and it is also a difficult research point of binocular vision. So far, traditional binocular vision stereo matching algorithms are mainly divided into the following three categories: global matching, local matching and semi-global matching. Global matching generally includes matching cost calculation, disparity calculation, and disparity optimization. Its core is to construct a global energy function and minimize the global energy function to obtain an optimal disparity map. The global matching algorithm gets better results, but generally ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/55
CPCG06T7/55G06T2207/20228G06T2207/20081Y02T10/40
Inventor 秦岭黄庆雷波程遥张杰
Owner 麦特维斯(武汉)科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap