Distributed system based on graph database

Abstract

The invention discloses a distributed system based on a graph database. The system comprises a client, a database management layer, a computing layer, a storage layer, a resource management module anda data import layer, and is characterized in that the computing layer comprises a plurality of distributed computing clusters, each distributed computing cluster consists of a query control node anda graph query node, and subsequent processing such as screening, aggregation and sorting is performed on the data extracted by the storage layer, the storage layer comprises a storage control node anda graph storage node, and the graph storage node undertakes storage, query and update operations of graph data. According to the system, the performance is improved by better utilizing the proximityof the graph data through an operator push-down scheme, meanwhile, the performance overhead caused by data communication between the storage layer and the computing layer is also reduced, the problemof expandability of the distributed graph data is solved through a thought of separating the storage layer from the computing layer, and the storage layer solves the problems of data storage and fragmentation through the thought of combining key value pairs with hash partitioning.

Description

technical field [0001] The present invention relates to the field of graph databases, in particular to a distributed system based on graph databases. Background technique [0002] With the continuous development of the Internet era, the global Internet is generating massive data sets every second. These data sets often have the characteristics of unstructured, no fixed format, and complex relationships between data. In order to process and analyze these data more efficiently, technologies such as big data technology, distributed computing, data mining, and AI have developed vigorously in recent years. As a new type of database specially designed for storing graph data, graph database can well adapt to this data application scenario. Graph data can be declared and defined data in the form of graphs, and all data that can be abstracted and stored by relational databases can be converted into graph data without barriers. At the same time, the graph data starts from one or sev...

AI Technical Summary

Problems solved by technology

[0003] At present, the following problems exist in the application of graph databases: (1) The existing graph databases are simply semantically encapsulated on the basis of other types of database storage engines, and the proximity and relationship of graph data cannot be considered at the storage layer (2) Existing query languages ​​have congenital deficiencies in the expression of graph data queries, do not have the ability to query databases based on graph thinking, and are not competent for graph database query work

Images