The invention discloses a multi-
modal emotion
analysis method and device, and relates to the technical field of emotion analysis. The method comprises the following steps: preprocessing each
modal emotion of multi-
modal emotion data, performing dimension alignment, and determining a
target text feature, an aligned video feature and an aligned audio feature; a single-mode
encoder is adopted to
encode the aligned video features and the aligned audio features, and target video features and target audio features are correspondingly obtained; performing cross-membrane attention mechanism operation on the basis of the
target text features, the target audio features and the target video features through a cross-modal fusion network and a cross-membrane conversion network, inputting the
target text features, the target audio features and the target video features into a Transform network, performing self-attention operation, performing
feature fusion, and determining emotion fusion features; and performing sentiment classification on the sentiment fusion features by adopting a sentiment classification layer, and outputting a
sentiment analysis result. Based on the scheme,
information loss during modal interaction is reduced, and the reliability of multi-modal emotion analysis is improved.