The invention provides an intelligent
data labeling method and
system based on multi-
modal fusion and
large model verification, belongs to the field of
artificial intelligence and
data processing, and innovatively fuses multi-
modal information such as an OCR recognition result, a
layout structure, original image visual features and deep semantic analysis of a large
language model (LLM). And a precise automatic labeling result credibility evaluation mechanism is constructed. According to the method, various errors in automatic labeling can be accurately recognized and adaptively corrected, and the errors comprise conventional error correction based on
hard coding rules and complex semantic error correction driven by LLM. Meanwhile, the
system can continuously optimize the
data labeling capability of the
system through an efficient man-
machine cooperation and closed-loop feedback learning mechanism, and automatically precipitate
domain knowledge assets. The invention aims to solve the problems of recognition accuracy
bottleneck, heavy manual proofreading burden, lack of intelligent judgment and error correction, knowledge accumulation
lag and the like in traditional document
data labeling, so that the efficiency, accuracy and
automation level of document data labeling are remarkably improved.