Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

A Knowledge Base Completion Method Based on Multimodal Representation Learning

A multi-modal and knowledge base technology, applied in the field of knowledge base completion, can solve problems such as failure to utilize multi-modal complementary features, performance limited by display and storage knowledge, unstable knowledge base completion effect, etc. Important features, improvement of presentation quality, effects of complementing stable performance

Active Publication Date: 2022-06-21
FUZHOU UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the existing methods for integrating external information only consider a single modal information, most of which are text modals, and fail to use the complementary characteristics between multiple modalities to learn more comprehensive features.
[0004] At present, most knowledge graph representation learning only considers the structural knowledge between entities and relationships. The performance of this type of model is limited by the display and storage of knowledge, resulting in unstable knowledge base completion. Possess knowledge of multiple modes, such as text, picture, audio and video, etc.
These external knowledge of different modalities can enrich and expand the existing knowledge base to a certain extent, and then provide richer semantic information for downstream tasks such as question answering and link prediction; existing representation learning methods that incorporate external information , most of them only consider a single modality information, and fail to use the complementary characteristics between multimodalities to learn more comprehensive features

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Knowledge Base Completion Method Based on Multimodal Representation Learning
  • A Knowledge Base Completion Method Based on Multimodal Representation Learning
  • A Knowledge Base Completion Method Based on Multimodal Representation Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0058] It should be noted that the following detailed description is exemplary and intended to provide further explanation of the application. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.

[0059] It should be noted that the terminology used herein is for the purpose of describing specific embodiments only, and is not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural as well, furthermore, it is to be understood that when the terms "comprising" and / or "including" are used in this specification, it indicates that There are features, steps, operations, devices, components, and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a knowledge base completion method based on multi-modal representation learning. Given a knowledge base KB, the KB includes two parts, one is a known knowledge set, and the other is an unknown knowledge set; Data preprocessing of the data; a knowledge base completion model ConvAt is proposed, and the multimodal representation of the head entity and tail entity is first generated for the acquired data; then the multimodal representation of the head entity, the structural feature vector of the relationship and the tail entity The multi-modal representation of is concatenated by columns, processed by the convolutional neural network module, channel attention module and spatial attention module respectively, and finally multiplied with a weight matrix to obtain the score of the triplet (h, r, t); Use the loss function to train the completion model in step S2, and use the trained model to complete the knowledge base. The algorithm proposed by the invention can fuse external information and utilize richer semantic information.

Description

technical field [0001] The invention relates to the field of knowledge base completion, in particular to a knowledge base completion method based on multimodal representation learning. Background technique [0002] A variety of knowledge base completion methods have emerged in recent years, among which methods based on knowledge representation learning are currently an active research field of knowledge base completion. A key problem in representation learning is to learn low-dimensional distributed embeddings of entities and relations. [0003] At present, there are mainly two kinds of information that can be used for knowledge representation learning. The first is the triples that already exist in the knowledge graph. It mainly includes: knowledge graph representation learning methods based on translation / translation, such as TransE; methods based on tensor / matrix decomposition, such as RESCAL model; representation learning models based on neural network, such as ConvE. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06N5/02
CPCG06N5/022G06N5/027
Inventor 汪璟玢苏华
Owner FUZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products