The invention discloses a kernel data multi-
modal knowledge graph construction method, and relates to the technical field of knowledge graphs. The kernel data multi-
modal knowledge graph construction method comprises the following steps: S1, acquiring multi-
modal data in the field of kernel science and technology, wherein the multi-
modal data comprises text
modal data and image
modal data; s2, constructing a multi-modal
knowledge graph ontology of the kernel data; s3, integrating target detection, relation prediction and
character recognition technologies for the image modal data to realize automatic extraction of entities, relations and attributes; s4, extracting structured knowledge from the text modal data by adopting a rule-based method; and S5, realizing fusion of the image knowledge and the text knowledge through entity alignment, and storing a fusion result into a
graph database to complete construction of the kernel data multi-modal knowledge graph. By adopting the multi-modal knowledge graph construction method for the kernel data, deep fusion and
knowledge mining of the kernel data can be realized, and data support is provided for multi-modal
question answering, retrieval and recommendation application of the kernel data.