The application discloses a kind of structural information enhanced multimodal heterogeneous data fusion representation method, belong to
data processing technical field.Method includes: by text, image, audio and video obtain multimodal heterogeneous data, after executing pre-
processing operation to multimodal heterogeneous data,
feature extraction and conversion operation are executed, obtain the multimodal
feature matrix of uniform feature space and using graph structure enhancement technology constructs graph structure with stability and explainability;Structural entropy regular
discriminant representation learning framework is constructed, structure information optimization framework and soft allocation mechanism are designed,
hypergraph structure is constructed, and the structural entropy of
hypergraph structure is calculated;Based on
hypergraph structure entropy, guide multimodal
unsupervised clustering.The present application is based on structural entropy, constructs hypergraph structure and introduces soft allocation mechanism, has the characteristic of automatically
learning data structure information, improves the
processing efficiency of
unstructured data, effectively breaks through the traditional restriction condition, provides new solution.