Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image stereo matching method

A stereo matching and image technology, applied in the field of image processing, can solve the problems of lack of texture, excessive reflection, difficult generalization ability, etc., and achieve the effect of great theoretical and practical value and wide application prospects.

Pending Publication Date: 2020-11-17
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF8 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The generalization ability of the existing stereo matching method based on deep learning is relatively poor. The main reason is that the data in the field of stereo matching has certain defects, such as too strong reflection, occlusion, etc. On the other hand, there will also be areas lacking texture in the image. This makes some methods that add neighborhood constraints prone to overfitting
At the same time, there is a lack of high-quality data sets in the field of stereo matching, and it is difficult to obtain a network with generalization ability through simple training.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image stereo matching method
  • Image stereo matching method
  • Image stereo matching method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0065] (1) Build a training image library. There are certain difficulties in the acquisition of binocular images including depth, so there are relatively few binocular data sets currently in existence. At present, there are two main ways to obtain the depth map, one is to use lidar; the other is to use infrared depth sensor, the former obtains a sparse depth map, and the latter cannot work effectively outdoors. The lack of data limits the versatility of the algorithm. The current common practice is to pre-train on the synthetic data set first, and then fine-tune on a small number of real data sets. depth map, but the image itself lacks a certain realism. The lack of data greatly limits the generalization ability of the deep learning stereo matching algorithm, and often gets completely wrong results for scenes that have not been seen.

[0066] This part uses Secenflow, Kitti, Middlebury and other data in combination to provide sufficient data for model training. Furthermore,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of image processing, and particularly relates to an image stereo matching method. An existing stereo matching method based on deep learning is poor in generalization ability, the main reason is that data in the stereo matching field has certain defects such as too strong reflection and shielding, and on the other hand, an area lacking textures also exists in an image, so that some methods for adding neighborhood constraints are prone to over-fitting. Meanwhile, a high-quality data set in the stereo matching field is lacked, and a network with generalization ability is difficult to obtain through simple training. The invention provides the image stereo matching method which comprises the following steps: constructing a training image library; enhancing a training image; extracting point (line) features of all images; training a feature point extraction network; extracting unary features of the binocular image; acquiring a coarse precision disparity map by the iteration module; performing unitary feature aggregation; performing parallax regression; and performing disparity refinement. The problem of overfitting in a stereo depth matching algorithm is solved.

Description

technical field [0001] The present application belongs to the technical field of image processing, and in particular relates to an image stereo matching method. Background technique [0002] Stereo matching can be applied in scenarios such as autonomous driving and 3D reconstruction. In the stereo matching task, the occlusion and reflection problems and the lack of texture will have a greater impact on the matching results (such as figure 1 , there is reflection on the car glass in the outdoor road scene). In an ideal situation, the corrected binocular images remain consistent in the vertical direction, and there is only parallax in the horizontal direction. However, in actual situations, the correction of the camera is not perfect, and the parameters of the two cameras are not exactly the same. On the other hand, the scenes seen from different perspectives are not completely the same, and the scene content and lighting conditions will be different. , which will cause som...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/55G06N3/04G06N3/08
CPCG06T7/55G06N3/08G06T2207/10028G06T2207/20081G06T2207/20084G06N3/047G06N3/045
Inventor 周杰李永强郭振华
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products