The invention discloses a multi-
modal knowledge-based automotive body innovative design
system, which comprises a multi-
modal data fusion module, a multi-
modal data fusion module, a multi-
modal data fusion module, a multi-
modal data fusion module and a multi-
modal data fusion module, wherein the multi-modal data fusion module is used for receiving text data, picture data, a three-dimensional CAD (
Computer Aided Design) model file and an
engineering symbol expression from an automotive body
design process and is used for carrying out
feature extraction and
semantic alignment on input data of four modals; generating a unified
semantic vector representation; the cross-modal
knowledge mining and graph construction module is used for extracting multi-level entities and relationships from the unified
semantic vector and constructing a dynamically weighted multi-modal
knowledge graph; the large-model-driven multi-hop collaborative reasoning module is used for analyzing the multi-modal design requirement of a user, carrying out multi-hop reasoning on a
knowledge graph, and outputting design parameter recommendation and an interpretable reasoning chain. The method aims at breaking through the limitation of an existing design
system in the aspects of multi-modal
processing and shallow semantic understanding, and deep fusion and intelligent application of multi-source heterogeneous
design data are achieved.