The invention discloses a multi-scale attention aggregation-based target
point cloud segmentation method for a battery replacement
robot, and the method comprises the steps: 1, collecting an
RGB image, a depth image and three-dimensional
point cloud data of a target
fastener through a binocular
structured light depth camera, and carrying out the fusion to generate a FastSeg3D
data set; 2, a two-stage preprocessing method is provided,
noise points are removed through
radius filtering, and background point clusters far away from a target are removed through
DBSCAN density clustering; 3, the network
encoder uses a local
feature aggregation module to extract geometric features, and the calculation complexity is reduced in combination with a random sampling strategy; 4, embedding a multi-scale attention aggregation module into the jump connection of the
encoder and the decoder, fusing the features through a channel and a space attention unit, and achieving the self-adaptive weight weighting of the features of each layer of the
encoder; and 5, recovering the resolution of the original
point cloud by adopting nearest neighbor interpolation up-sampling, outputting a segmentation semantic tag, and obtaining a high-quality point cloud target. According to the method, the
operation time of the battery replacement
robot is shortened, and the balance problem of large-scale target
point cloud segmentation speed and precision is solved.