The invention provides an OCR (
Optical Character Recognition) information dynamic
verification method and
system based on multi-
modal fusion and a medium. The method comprises the following steps: firstly, acquiring OCR identification data and scene environment data, extracting a multi-
modal feature set, then training a multi-
modal quality evaluation model based on historical data, performing field
correctness, format compliance and logic relevance scoring on each modal, calculating confidence to position a problem modal, and finally obtaining a multi-modal quality
evaluation result. The method comprises the following steps of: obtaining an OCR (
Optical Character Recognition) identification result, performing
traceability analysis on a problem mode, implementing mode enhancement, recalculating an enhanced
quality score and a
confidence score, dynamically distributing each mode weight according to enhanced confidence, obtaining a global
quality score after weight fusion, and finally judging whether the OCR identification result is qualified or not based on a global
score threshold value. According to the method, the accuracy and the robustness of OCR information
verification are remarkably improved through collaborative
verification and dynamic weight fusion of the multi-modal information, and identification interference in a complex scene can be effectively coped with.