The application discloses a kind of based on multi-
modal fusion
sentiment analysis method and
system, comprising the following steps: S1, obtain multi-
modal data and the initial feature representation of each mode;S2, the initial feature representation of each mode is input into multi-head attention mechanism and is preliminarily fused, generates primary fusion feature;S3, generate timing feature in conjunction with bidirectional long short-
term memory network and multi-scale causal
convolution network;S4, utilize multi-layer graph neural network to construct hierarchical dependency relationship network between
modes, form global context
perception feature representation;S5, dynamically generate and adjust the fusion weight of each mode;S6, utilize multi-layer fully connected network and multi-
task learning framework joint classification and regression output, generate the multidimensional expression of emotional state;S7, by migration learning and individualized modeling technique, group sentiment model is migrated to specific
sentiment analysis of individual user.The application utilizes multi-
modal fusion and adaptive
weight adjustment, realizes high-precision, multidimensional
sentiment analysis.