基于多模态思维链对齐的大语言模型情感分析方法

By employing a large language model sentiment analysis method with multimodal thought chain alignment, the problems of modal inconsistency and conflict in multimodal sentiment analysis are resolved, thereby improving the accuracy and interpretability of sentiment analysis.

CN121980314BActive Publication Date: 2026-07-17HEFEI UNIV OF TECH

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
HEFEI UNIV OF TECH
Filing Date
2026-01-23
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing multimodal sentiment analysis methods lack explicit reasoning mechanisms, making it difficult to explain the basis of model decisions. Furthermore, inconsistencies or conflicts exist in the reasoning information between different modalities, resulting in insufficient accuracy and interpretability of sentiment analysis.

Method used

We employ a large language model sentiment analysis method with multimodal thought chain alignment. By acquiring and preprocessing text, visual, and speech modal data, we utilize a large language model for modality-specific thought chain reasoning, employ an attention weighting mechanism for fusion, and construct a sentiment alignment loss function to resolve modality conflicts.

Benefits of technology

It improves the accuracy, robustness, and interpretability of multimodal sentiment analysis, and can effectively align and coordinate different modalities when they conflict, thereby enhancing the accuracy and stability of sentiment analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121980314B_ABST
    Figure CN121980314B_ABST
Patent Text Reader

Abstract

本发明提供一种基于多模态思维链对齐的大语言模型情感分析方法,涉及人工智能与多模态信息处理技术领域。本发明,首先获取并预处理至少包括文本模态、视觉模态和语音模态的多模态情感分析输入数据;之后,对各个模态数据进行向量化编码;进一步的,利用大语言模型进行模态特定的思维链推理,在提示驱动下分别生成文本、语音和视觉模态的情感推理思维链,并对各模态思维链进行向量化编码与融合;最后,对多模态思维链融合表示进行情感分类预测,获取最终的情感分析结果。本发明通过引入可对齐的多模态思维链推理机制,充分发挥大模型的推理能力与多模态信息互补优势,在无需人工标注推理过程的情况下,提高了情感分析的准确性、鲁棒性及可解释性。
Need to check novelty before this filing date? Find Prior Art