The invention discloses a
character recognition method and
system based on a
large model and an OCR technology, and relates to the technical field of
character recognition, and the method comprises the steps: extracting picture information, carrying out the unified preprocessing, generating a
text detection box of a character region through a DBNet lightweight
text detection model, and obtaining a text position; quickly identifying characters in the textbox by using a lightweight OCR model to obtain text content, and generating an identification information group; carrying out average value calculation on the confidence coefficient of the lightweight OCR model result, and analyzing the overall confidence coefficient; and for the result with
low confidence coefficient, inputting the corresponding identification information group into the multi-
modal large model, and carrying out secondary identification. According to the method, the text position set and the text character string sequence are combined into the identification information group, so that the effect of structured storage of detection and identification results is achieved, subsequent
information retrieval and multi-
modal fusion analysis are facilitated, and the effect of optimizing the subsequent
processing efficiency and precision is achieved through the combination of the confidence coefficient screening step.