The invention provides a deep jump connection attention multi-
modal sentiment analysis method based on image-text fine
granularity alignment, and belongs to the field of multi-
modal sentiment analysis. According to the method, by introducing an image-text fine-grained alignment and jump connection attention mechanism, a traditional multi-
modal sentiment analysis method is improved, and the problems that modal alignment is not fine and important information is lost during
feature fusion are effectively solved. According to the technology, firstly,
feature extraction is carried out on an image and a text, the image is converted into a pixel block embedding sequence, the text is converted into a
word embedding sequence, then deep interactive fusion is carried out through a cross-modal deep interactive network, and fine-grained alignment and feature deep fusion between modals are achieved. In the method, a jump connection attention channel controlled by a self-adaptive
gate valve is designed to reserve important information, and the understanding of the model on the image-text relationship is improved. According to the method, the accuracy and
interpretability of multi-modal sentiment analysis can be remarkably improved, and the cross-modal learning ability of the model is improved. The method is suitable for multi-mode sentiment analysis application scenes such as
social media analysis and public opinion monitoring, and powerful support is provided for understanding the sentiment, attitude and viewpoint of the user.