The RGB-D image synthesis optimization system and method of the deep information camera module

Abstract

An RGB-D image synthesis optimization system of a depth information camera module is used to optimize the RGB-D image synthesis effect of a depth information camera module. The RGB-D image synthesis optimization system of the depth information camera module includes a calibration module, an alignment quantization module and an adjustment optimization module. The calibration module is communicatively connected to the depth information camera module for calibrating the calibration parameters of the depth imaging module and the RGB imaging module; the alignment quantization module is communicably connected to the depth information camera module and the calibration module, It is used to quantify the alignment effect of the feature points of the IR image and the RGB image, so as to indirectly quantify the alignment effect of the depth image data and the RGB image. The adjustment optimization module adjusts the calibration parameters of the depth imaging module and the RGB imaging module according to the quantized alignment result of the alignment quantization module.

Description

technical field [0001] The invention relates to the field of three-dimensional imaging, in particular to an RGB-D image synthesis optimization system and method of a depth information camera module. Background technique [0002] With the development of optical measurement and computer vision, optical three-dimensional measurement technology has gradually matured and been applied in various fields of human production and life, such as automatic tracking and obstacle avoidance systems of drones, augmented reality (AugmentedReality), virtual reality (Virtual Reality) Reality), 3D modeling, etc. [0003] The 3D imaging technology based on structured light technology needs to actively project structured light to the target to determine the depth information of the target through the deformation or time-of-flight of the structured light. Traditional structured light 3D imaging modules, such as TOF depth information camera module and speckle structured light depth information came...

AI Technical Summary

Problems solved by technology

However, the evaluation of the alignment effect of the depth image data and the RGB image mainly depends on human subjective evaluation, which is extremely unfavorable for the objective evaluation and efficiency improvement of the algorithm

The main reason is that if you want to quantitatively evaluate the alignment effect and accuracy of depth image data and RGB image, you must rely on the feature point extraction and comparison of RGB image and depth image data. However, the technology of extracting feature points of depth image data is not only cumbersome but also Low precision, no practical industrial application value

[0006] Furthermore, since the existing evaluation of the alignment effect of depth image data and RGB images mainly depends on human subjective perception, it is impossible to make subsequent targeted adjustments and optimizations to the synthesis of RGB images and depth image data to improve the RGB- D's imaging effect

Images