The invention relates to the technical field of multi-
modal matching, in particular to a multi-
modal input instruction and
data analysis matching method and
system, and the method comprises the following steps: collecting input multi-
modal data and instructions, recognizing texts, images and audios, extracting a
time sequence,
spatial distribution and statistical parameters, and generating a feature distribution result. According to the method, the modal correlation degree is calculated, information entropy measurement is combined, the correlation features are subjected to differentiation
processing, the accuracy and consistency of the high correlation features are ensured through
space mapping, the potential deviation of the middle correlation features is reduced through alignment adjustment, and the weights of the
low correlation features are re-distributed through normalization; according to the method, the overall feature distribution balance and
semantic consistency are enhanced, accurate task matching and classification are realized based on the fitting degree
score and the
time sequence fitting degree, the association accuracy and the
time sequence association recognition capability among complex multi-
modal data are effectively improved, and the analysis requirement of diversified
data input in a complex scene is met.