The invention provides a document image-text integrated intelligent understanding and
processing method and
system, and relates to the technical field of
artificial intelligence. Comprising the following steps: separating image-text elements and establishing context association; calling a graph vectorization engine, and executing intelligent vector conversion
processing on the rasterized illustration; performing hierarchical classification, attribute endowing and structured reconstruction on the vector primitives in combination with text semantic analysis to generate vector entity objects with complete attributes; the text elements and the vector entity objects are jointly input into a pre-trained multi-mode large
language model, unified knowledge expression containing vectors, topology, attributes and document contexts is generated, and applications such as
question answering, editing, abstracting and reporting of image-text integration are supported. According to the method, the problems of graph semantic loss, difficulty in fine analysis and the like caused by vector-to-grid illustration in papers, reports and other types of documents are solved, the overall understanding depth and
interpretability of AI for complex image-text documents are remarkably improved, and high-performance semantic understanding capacity is provided for document-based training and intelligent
processing.