The invention provides a multi-
modal knowledge graph completion method based on
modal hierarchy fusion, a multi-
modal knowledge graph completion model MHF is used to introduce visual features and text features, the model comprises an independent learning layer, a
knowledge graph independent learning structure embedding # imgabs0 #, a visual embedding # imgabs1 # and a text embedding # imgabs2 # are embedded from a
data set segmented by multiple modals, and the independent learning layer is used to carry out multi-modal hierarchical fusion on the knowledge graph independent learning structure embedding # imgabs0 #, the visual embedding # imgabs1 #, the text embedding # imgabs2 # and the text embedding # imgabs1 # and the text embedding # imgabs2 #; meanwhile, the scale of the external features is adjusted by adopting a scaling factor; the modal fusion layer is used for fusing the structural features with the visual features and the text features respectively to obtain two fusion embedding
modes, and the two fusion embedding
modes are included in final loss calculation; the semantic constraint layer is used for further
processing the five kinds of embedding through a factor interaction regularizer, and five additional regularization loss items generated in the
processing process are calculated in final loss; according to the method, the structure data and the
external data are integrated, so that the visual data and the text data are more reasonably applied, the expression ability of the model is effectively improved, and a new thought is provided for comprehensiveness and accuracy expression of entities in the knowledge graph.