A knowledge-enhanced traceable multi-modal reasoning method, device and medium

By constructing structured candidate hypotheses and evidence-constrained reasoning, the problem of unclear evidence support in multimodal reasoning methods is solved, enabling explicit verification of high-confidence evidence and reliable generation of answers, thereby improving the interpretability and accuracy of multimodal reasoning.

CN122414409APending Publication Date: 2026-07-17CENT SOUTH UNIV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202610837530.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-06-11
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing multimodal reasoning methods suffer from problems in interpretability and reliability, including unaddressable evidence in attention methods, irrelevant noise knowledge in knowledge enhancement methods, lack of cross-modal consistency in multi-stage chained reasoning, and separation of semantic verification in visual localization, which leads to difficulty in obtaining clear evidence support and instability in answer generation.

Method used

We employ a knowledge-enhanced traceable multimodal reasoning method, which constructs structured candidate hypotheses through hypothesis-driven knowledge discovery, dual-channel evidence verification, and evidence-constrained reasoning stages. We then conduct fine-grained evidence verification and answer decision-making, and use high-confidence evidence to constrain the final reasoning process, resulting in explicit verification scores and hierarchical prompts.

Benefits of technology

It significantly improves the interpretability, verifiability, and traceability of the reasoning process, reduces interference from irrelevant concepts, enhances the accuracy of evidence screening and the reliability of answer decisions, reduces the risk of error accumulation, and strengthens the stability of multimodal reasoning.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122414409A_ABST
    Figure CN122414409A_ABST
Patent Text Reader

Abstract

本发明涉及多模态推理技术领域,尤其涉及一种知识增强的可追溯性多模态推理方法及系统,本发明方法通过构建面向当前问题的结构化候选假设,对候选视觉证据与候选语义实体进行显式置信度评估,并进一步利用高置信证据约束最终推理过程,从而在保证答案准确性的同时显著增强推理过程的可解释性、可验证性和可追踪性。本发明方法有效降低文本解析歧义和级联误差传播的影响,适用于视觉问答、科学问答、灾害事件理解等多种图像与文本联合输入的多模态推理场景。
Need to check novelty before this filing date? Find Prior Art