Large-scale knowledge graph storage scheme based on distributed key value library

A technology of distributed key-value and storage solutions, which is applied in the field of knowledge map storage solutions to achieve the effect of improving storage capacity

Active Publication Date: 2021-07-09
TIANJIN UNIV
View PDF12 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] However, the research on distributed storage schemes for knowledge graphs is still a serious challenge. Existing schemes can only store knowledge graph data of a single model. Therefore, it is urgent to propose a unified distributed storage scheme to make it compatible with RDF. Efficient Storage of Graph Models and Property Graph Models

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale knowledge graph storage scheme based on distributed key value library
  • Large-scale knowledge graph storage scheme based on distributed key value library
  • Large-scale knowledge graph storage scheme based on distributed key value library

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be further described below in conjunction with the accompanying drawings.

[0053] The present invention selects CockroachDB as the database backend, and CockroachDB is used as the open source implementation of Google Spanner, and adopts the architecture of "SQL on Distributed KV". CockroachDB provides a standard SQL interface to the outside world. Any node in the cluster can be used as an access node to process user SQL requests. The access node converts SQL requests into underlying KV operations and sends the operations to other nodes for processing when necessary. Upon completion, return the result to the client. Data is organized into ordered key-value pairs at the bottom layer and stored by the local KV storage engine RocksDB. At the same time, these key-value pairs will form a KV map. The KV map is logically divided into a large number of key spaces according to the range. Each key space is called a Range, and each Range is copied and d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a large-scale knowledge graph storage scheme based on a distributed key value library. A "KG over SQL" unified storage scheme or a "KG over KV" unified storage scheme is adopted; the unified storage scheme of "KG over SQL" comprises the following steps: reading knowledge graph data; extracting metadata in the mapping knowledge domain, and generating a corresponding SQL statement; extracting data in the knowledge graph, storing the data in a data structure, and generating a corresponding SQL statement; executing an SQL statement through an external SQL interface of the Cockroach DB database, and establishing a relation table; mapping the data in the relation table into a key value pair form by using an original data coding mapping scheme in a Cockroach DB database, and storing the data in a Cockroach DB bottom layer; By means of the "KG over KV" unified storage scheme, knowledge graph data are read, a knowledge graph is converted into a graph containing index nodes, index node graph data are stored in a data structure, and the data are mapped into a key value pair form through an optimized data coding mapping scheme and stored in a Cockroach DB bottom layer. According to the method, efficient data storage compatible with the RDF graph model and the attribute graph model can be realized.

Description

technical field [0001] The present invention relates to the field of knowledge map storage solutions, and more specifically, relates to a large-scale knowledge map storage solution based on a distributed key-value library. Background technique [0002] Knowledge Graph has become the cornerstone of a new generation of cognitive artificial intelligence. With the widespread application of artificial intelligence, more and more fields have begun to organize and publish their domain knowledge in the form of knowledge graphs. Knowledge graphs can not only describe entities and concepts in the real world, but also describe the connections between these entities and concepts. [0003] There are currently two mainstream knowledge graph data models: RDF graph model and attribute graph model. The full name of RDF is Resource Description Framework (Resource Description Framework), which is a standard data model developed by the World Wide Web Consortium for representing and exchanging...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/28G06F16/27G06F16/242G06F16/22
CPCG06F16/288G06F16/27G06F16/2272G06F16/2433Y02D10/00
Inventor 王鑫李思卓
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap