The invention discloses an agent training
data set construction method and
system combined with cross-
modal learning, and relates to the technical field of agent training, and the method comprises the steps: obtaining multi-
modal intelligence data from a multi-source
database, extracting feature information, and projecting the feature information to a preset
semantic space to obtain cross-
modal alignment features; constructing an agent function call
syntax tree based on cross-modal alignment features, analyzing the
syntax tree into an
instruction sequence, constructing an analysis reasoning chain, and generating a
sample label and an interaction track; constructing a
task dependency graph by using the sample labels and the interaction tracks, decomposing the
task dependency graph into a plurality of parallel decision branches, and dynamically adjusting a
processing strategy to form a training
data set; mapping the training
data set to an agent target space, optimizing and analyzing an
inference chain through a training feedback channel, and outputting a standardized sample
library; and finally inputting to-be-analyzed data into the trained agent, and generating an
intelligence analysis report according to the analysis reasoning chain.