Parallax image fusion method of multiband stereo camera

Abstract

The invention discloses a parallax image fusion method of a multiband stereo camera, and belongs to the field of image processing and computer vision. According to the method for obtaining the pixel parallax confidence information by utilizing the intermediate output of binocular parallax estimation, the confidence information can be used for judging the parallax confidence of the position and assisting parallax fusion. The confidence coefficient obtaining process makes full use of the calculated intermediate output, can be conveniently embedded into the traditional parallax estimation process, and is high in calculation efficiency, simple and easy to operate. According to the multi-band stereo camera parallax fusion method provided by the invention, the parallax image participating in fusion is obtained according to the binocular image of the corresponding band, the information of each band is fully utilized, Meanwhile, the introduction of uncertainty and errors is avoided. And accurate information of each waveband can be selected according to a strategy of fusing the parallax according to the confidence, so that the purpose of advantage complementation of multi-waveband equipmentis achieved.

Description

technical field [0001] The invention belongs to the field of image processing and computer vision, relates to multi-modal binocular parallax estimation and confidence degree calculation, and performs fusion and depth calculation of parallax information obtained by multi-band sensors. In particular, the invention relates to a confidence calculation method and a parallax image fusion method of a multi-band stereo camera. Background technique [0002] The development of binocular stereo vision technology based on visible light band is relatively mature. Visible light imaging has rich contrast, color, and shape information, so it can accurately and quickly obtain matching information between binocular images, and then obtain scene depth information. However, imaging in the visible light band has its defects. For example, in strong light, fog, rain, snow or night, the imaging quality is greatly reduced, which affects the matching accuracy. Therefore, using the complementarity of...

AI Technical Summary

Problems solved by technology

The above method matches binocular cameras with different bands separately, and then maps the images into three-dimensional information according to the matching results, and performs fusion on the point cloud level, which greatly increases the amount of calculation and resource consumption, and is difficult to apply to actual products

Images