The invention provides a control method and
system of a double-arm clothes folding
robot, and relates to the technical field of
robot control, and the control method constructs a perceived control
closed loop by fusing visual, force and tactile multi-
modal data. The touch sense and the force sense make up the blind area of the vision in the self-shielding scene, and grabbing, sliding and pleating
perception is improved. Based on clothing joint characterization of a visual
semantic network, geometric morphology, semantic components and confidence coefficient are structured and coded, a robust state fusing prior and real-time observation is provided for planning, and decision errors caused by deformation and
noise are reduced. Long-time-history folding is decomposed into sub-target sequences through a hierarchical strategy, action closed-loop correction is conducted through multi-
modal data, and cooperative control over grabbing, folding and pleating is achieved. And finally, a torque instruction is generated based on a
control algorithm, interaction compliance and safety are ensured, and the folding success rate and operation stability of the double-arm clothes folding
robot under different materials, sizes and initial forms are integrally improved.