The invention discloses a body intelligent execution and training method and device based on an edge-end cooperation
large model, and the method comprises the steps: transmitting a voice instruction to a
robot body, converting the voice instruction into a text instruction through the
robot body, and transmitting the text instruction,
machine vision feedback and a visual image to an edge side unit; a multi-
modal large model is arranged in the edge side unit; reasoning the text instruction, the
machine vision feedback and the vision image by the multi-
modal large model, obtaining the intention of the text instruction after reasoning, generating a task
decomposition instruction according to the intention, and sending the task
decomposition instruction to the
robot body; the robot body calls a
chassis moving API and an atomic skill
library API according to the task
decomposition instruction to complete a target task; and after the target task is completed, the robot body feeds back process
algorithm data and an execution effect to the edge side unit, and the edge side unit carries out post-training upgrading according to the feedback. According to the method, the large model reasoning time
delay and cost can be effectively reduced, the load of the
cloud server is reduced, and the
data security and privacy are improved.