The invention discloses a
system and a method for extracting project information based on a multi-
modal large model, and the
system comprises a file preprocessing module which is used for receiving and recognizing an input project document file, and extracting the
metadata information of the file; the file type identification module is used for selecting different
processing modes according to file types; the
information extraction module is used for extracting text elements, labels, layer information and geometric elements from the document according to the file type and embedding the text elements, the labels, the layer information and the geometric elements into a vector space; the multi-
modal model
processing module is used for generating semantic description according to the text content, the picture description and the element
metadata; the clustering module is used for clustering elements in the DWG drawing based on the coordinates; the
knowledge graph construction module is used for constructing a
knowledge graph based on the description, the text content and the element
metadata; the vector
database is used for storing embedded text content, description and related context information; the
question analysis module is used for receiving user questions, extracting keywords, and retrieving in the vector
database and the
knowledge graph construction module to obtain related contexts; and the answer generation module is used for generating answers based on the retrieved context information in combination with a multi-
modal large model and providing original text reference.