This invention relates to the field of
data processing technology, specifically to a
robot manipulation method, device,
system, and medium based on a
diffusion model. The method includes: collecting the position information of the
index finger tip and the state information of a flexible
linear object during a human hand teaching process to construct training samples; training the training samples using a
diffusion model, and learning the mapping from a high-
noise state to a clear target state through a
noise prediction network in the training
diffusion model to obtain a trained diffusion model; the training process of the diffusion model includes forward
noise addition and backward
noise reduction; collecting the state of the flexible
linear object and the position of the
robotic arm end
effector to construct the current observation environment, inputting the current observation environment into the trained diffusion model to generate a
target action sequence, and controlling the
robotic arm to perform manipulation actions based on the
target action sequence; this invention can improve the accuracy and real-time performance of
robot manipulation of flexible linear objects.