The invention relates to a ball head rod disordered grabbing method based on 3D vision, belongs to the technical field of
robot operation and automatic manufacturing, and particularly relates to a workpiece
pose estimation method based on combination of YOLOv8 and Triplet Attention modules, which is used for disordered grabbing tasks in complex scenes. According to the method, the color and depth images of the workpiece are acquired through the RGB-D camera, and the efficient lightweight Triplet Attention module is introduced, so that the
processing speed and precision of the model on the target detection and segmentation task on the mobile
terminal equipment are remarkably improved. And the Triplet Attention module enhances the space attention mechanism of the model through three-way rotation
convolution operation on the features, so that the detection and segmentation precision is remarkably improved. The segmented
mask region is applied to the depth image, corresponding
point cloud data are extracted, and six-degree-of-freedom
pose estimation is carried out by using a normal consistency optimization (NDT)
algorithm. The NDT
algorithm is excellent in
processing noise and partially shielded scenes. Experimental results show that compared with an original YOLOv8 model, the model added with the Triplet Attention module is improved in segmentation precision and recognition accuracy. The method has high accuracy and robustness in the aspects of workpiece recognition and
pose estimation, and is suitable for real-time industrial application scenes.