The invention belongs to the technical field of
artificial intelligence and auditing science, and particularly relates to an intelligent auditing method and device based on
large model and multi-
modal data fusion. The method comprises the steps of firstly constructing a vector
knowledge base, then extracting deep features of unstructured bill data, an original audit text and an original audit table, and based on cross-
modal comparative learning and fusion of a dynamic weight
algorithm based on risk awareness attention, obtaining multi-
modal joint embedded representation features so as to obtain a vector
knowledge base retrieval result, the method comprises the following steps: firstly, generating a standard auditing program template, then constructing an auditing prompt word, finally generating a
risk detection score and a risk evidence chain based on a large
language model, constructing an auditing program template through the standard auditing program template obtained by retrieving a vector
knowledge base, and finally generating a structured auditing report in combination with the auditing program template, the
risk detection score and the risk evidence chain. According to the method, the problems of low efficiency and low accuracy of fusion auditing based on multi-
modal data such as texts, tables, images and the like are solved.