The invention discloses a multi-
modal data association relationship mining method based on potential feature
perception, which belongs to the field of multi-
modal data analysis and feature association modeling in
artificial intelligence and
data mining technologies, and comprises the steps of multi-
modal data acquisition and preprocessing, multi-modal
feature mining based on potential
semantic alignment, multi-
modal data analysis and feature association modeling. Performing multi-stage
feature fusion and
time sequence association representation learning, and constructing a cross-modal
semantic association graph. According to the method, under the conditions of
noise interference, unbalanced sample distribution and weak
semantic association of the multi-
modal data, robust fusion and
semantic consistency expression of the multi-modal features in a
potential space can be realized through adaptive anomaly correction and a multi-level feature alignment mechanism, mismatching caused by
noise pollution and shallow association is avoided, and the robustness of the multi-modal features is improved. And accurate mining of the high-order potential
semantic relationship is realized. Meanwhile, the semantic edge and the
time sequence edge can be subjected to separation modeling according to the internal structure of the multi-
modal data under the conditions of modal isomerism and
time sequence overlapping, and meanwhile, a unified cross-modal association graph is constructed. Furthermore, in order to improve the accuracy of time sequence relation modeling, time sequence comparative learning and dynamic consistency constraint are utilized, effective distinguishing between real time sequence dependence and multi-mode repeated representation is achieved, and the precision and robustness of multi-mode
correlation analysis are remarkably improved.