The invention provides a
robot body
data labeling method and device based on an
artificial intelligence large model, and the method comprises the steps: obtaining the multi-
modal original data of a
robot during task execution, and carrying out the
standardization processing of the
original data, and obtaining the standardized data; performing multi-
modal semantic understanding and analysis on the standardized data based on an
artificial intelligence large model, and reversely generating a structured task description; and generating a structured labeling result according to the structured task description, and storing the structured labeling result into a labeling
database. According to the method and the device provided by the invention,
data format conversion and data enhancement are performed on the
robot body data through the
large model, so that the consistency of the
data annotation source data file and the
annotation result is realized. A unified semantic understanding standard is provided, subjective deviation of
manual annotation is eliminated, semantic and
time sequence synchronization of language, vision and action is guaranteed through an end-to-end multi-mode alignment mechanism, the labor cost is greatly reduced through an automatic process, and large-scale data production is supported.