A Knowledge Base Completion Method Based on Multimodal Representation Learning

A multi-modal and knowledge base technology, applied in the field of knowledge base completion, can solve problems such as failure to utilize multi-modal complementary features, performance limited by display and storage knowledge, unstable knowledge base completion effect, etc. Important features, improvement of presentation quality, effects of complementing stable performance

CN112348191BActive Publication Date: 2022-06-21FUZHOU UNIV
0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Publication Date
2022-06-21

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention relates to a knowledge base completion method based on multi-modal representation learning. Given a knowledge base KB, the KB includes two parts, one is a known knowledge set, and the other is an unknown knowledge set; Data preprocessing of the data; a knowledge base completion model ConvAt is proposed, and the multimodal representation of the head entity and tail entity is first generated for the acquired data; then the multimodal representation of the head entity, the structural feature vector of the relationship and the tail entity The multi-modal representation of is concatenated by columns, processed by the convolutional neural network module, channel attention module and spatial attention module respectively, and finally multiplied with a weight matrix to obtain the score of the triplet (h, r, t); Use the loss function to train the completion model in step S2, and use the trained model to complete the knowledge base. The algorithm proposed by the invention can fuse external information and utilize richer semantic information.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the field of knowledge base completion, in particular to a knowledge base completion method based on multimodal representation learning. Background technique

[0002] A variety of knowledge base completion methods have emerged in recent years, among which methods based on knowledge representation learning are currently an active research field of knowledge base completion. A key problem in representation learning is to learn low-dimensional distributed embeddings of entities and relations.

[0003] At present, there are mainly two kinds of information that can be used for knowledge representation learning. The first is the triples that already exist in the knowledge graph. It mainly includes: knowledge graph representation learning methods based on translation / translation, such as TransE; methods based on tensor / matrix decomposition, such as RESCAL model; representation learning models based on neural network, such as ConvE. ...

Examples

Embodiment Construction

[0057] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0058] It should be noted that the following detailed description is exemplary and intended to provide further explanation of the application. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.

[0059] It should be noted that the terminology used herein is for the purpose of describing specific embodiments only, and is not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural as well, furthermore, it is to be understood that when the terms "comprising" and / or "including" are used in this specification, it indicates that There are features, steps, operations, devices, components, and...