The invention discloses a multi-layer graph multi-mode
sentiment analysis method and device based on meta-information, and the method comprises the steps: firstly, extracting the high-level features of text, video and audio data through BERT, OpenFace 2.0 and Librosa, carrying out the
time sequence coding through BiLSTM, and then mapping each mode feature to a unified space through MLP; then, respectively capturing
modal invariant and specific features by using a shared multi-
modal encoder and a private multi-
modal encoder; for modal specific features, adopting GNN to construct a modal graph, and combining a grammar
dependency tree and self-attention to calculate a
graph edge weight so as to align meta-information in a modal; video and audio features are aligned with a text through Cross-Attention, a new multi-modal graph is constructed, and multi-level features are extracted; then, applying
convolution, BiLSTM and GNN to extract local,
time sequence and global features, and realizing multi-level
feature fusion through a cross-modal attention mechanism; and after each modal feature graph and each modal
invariant feature are input into a graph knowledge
distillation module, dimension reduction
processing is carried out, features are further fused through Transform and a multi-head attention mechanism, and finally an emotion prediction value is obtained.