The invention relates to the technical field of medical
artificial intelligence and
knowledge graph construction, in particular to a
rare disease knowledge graph construction method based on
modal injection and multi-
modal fusion. Comprising the following steps: S1, collecting multi-
modal medical information including texts, images and genes; s2,
standardization processing is carried out, and a three-layer
metadata structure is constructed; s3, complementing missing
modal data, and performing
feature extraction and unified dimension conversion on the
modal data to realize representation alignment in a shared
semantic space; s4, performing multi-level semantic fusion to obtain a unified fusion
semantic vector; and S5, constructing a double-layer
structure system rare disease knowledge graph comprising an ontology layer and an instance layer. According to the method, multi-modal
medical information of texts, images and genes is selected to construct the knowledge graph of the
rare disease, the application range, coverage and accuracy of the knowledge graph are improved, correspondence
adaptation of rare cases during
clinical diagnosis and treatment of the rare
disease can be achieved, and the method has high recognition capacity.