Binocular vision position measurement system and method based on deep learning

Abstract

The invention discloses a binocular vision position measurement system and method based on deep learning, and belongs to the technical field of multi-vision position measurement. The system disclosed by the invention comprises a binocular vision image capture module, a deep learning object recognition module, an image segmentation module, a fitting module and a binocular point cloud module. The invention further discloses a binocular vision position measurement method based on deep learning, image features are extracted and fused based on the convolutional neural network, a feature extraction network is trimmed according to an image recognition task, a network structure is lightened, the extracted image features are regressed and decoded by using a full-connection layer network, an image segmentation and fitting algorithm is made, deep learning is applied to binocular vision position measurement, the measurement applicability and accuracy can be considered, the positions of multiple types of objects in an actual scene can be rapidly and accurately measured, and the system and method has the advantages of non-contact measurement, accurate position solving and high real-time performance.

Description

technical field [0001] The invention relates to a binocular vision position measurement system and method based on deep learning, and belongs to the technical field of multi-eye vision position measurement. Background technique [0002] Visual measurement technology is a technology based on computer vision research. The research focuses on the measurement of the geometric size of objects and the position and attitude of objects in space. Binocular vision is an important distance perception technology in the computer passive ranging method. It can flexibly measure the three-dimensional information of the scene under various conditions, and it occupies an increasingly important position in non-contact measurement. Binocular vision is based on the spatial geometry structure, and reflects the spatial position of the object in the real world by calculating the parallax of the left and right images. Because binocular vision is based on the spatial geometry structure, the result i...

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problem that the existing recognition technology cannot take into account the applicability and accuracy of the measurement when actually measuring the position of the object, the invention discloses a binocular based on deep learning The problem to be solved by the visual position measurement system and method is: applying deep learning to the position measurement of binocular vision, through the lightweight deep learning network, it can take into account the applicability and accuracy of recognition and measurement, and be able to identify and measure multiple categories in actual scenes. Rapid identification and accurate position measurement of quantitative objects, with the advantages of non-contact measurement, accurate position solution and high real-time performance

Images