The invention provides an intelligent mechanical arm
control system scheme based on multi-model cooperation, and belongs to the field of
automation and
intelligent control. The
system is divided into four parts of man-
machine interaction, detection and
perception, task decoupling planning and program generation, and
robot execution operation. Man-
machine interaction is carried out, a user inputs an instruction in a text or voice format, and instruction
processing is carried out through voice recognition and a
natural language translation model; detecting and sensing, and identifying and positioning a target captured by the camera by using a multi-
modal large model; task decoupling planning and program generation: analyzing the user instruction and the
perception information into an
executable program by applying a task planning model and a program translation model; and checking and correcting the program by using the program checking model, and driving the mechanical arm to complete a task. According to the
system scheme, variable environments can be dealt with, complex language instructions can be understood,
intelligent control over the mechanical arm is achieved, and the multi-task execution capacity and the intelligent level of the mechanical arm are remarkably improved.