The invention relates to a mechanical arm disordered grabbing
algorithm, and belongs to the technical field of
robotics, and the method comprises the steps: firstly, obtaining a target material image and a
point cloud sample, and training a multi-
modal attention fusion
perception model through sample enhancement
processing and a difficult case mining mechanism after the target material image and the
point cloud sample are labeled with categories, postures and grabbing areas; secondly, a mechanical arm obtains operation area data, the operation area data are input into a multi-
modal attention fusion
perception model to obtain initial attitude parameters, errors are corrected by combining with a visual data fusion calibration model, and the material stacking state is judged through a dynamic reference comparison method; thirdly, based on the correction parameters and the stacking state, an
evaluation function is constructed to screen collision-free and stress-balanced grabbing points, and a collision-free path is planned by fusing
kinematics constraints of the mechanical arm; and finally, the grabbing action is executed, the strength and the posture are adjusted in real time according to the
contact force and the position deviation, the material stability is evaluated through vision after grabbing, and the stability and the operation efficiency of the mechanical arm in a complex disordered scene are improved.