Data import method, device, electronic equipment and medium of a graph database

A data import and database technology, applied in the field of data processing, can solve problems affecting the speed of data import, and achieve the effect of improving data import speed and data processing performance

Active Publication Date: 2022-03-01
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the current batch data import process needs to frequently query data from external storage media such as KV databases, which seriously affects the data import speed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data import method, device, electronic equipment and medium of a graph database
  • Data import method, device, electronic equipment and medium of a graph database
  • Data import method, device, electronic equipment and medium of a graph database

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0050] figure 1 It is a flow chart of a graph database data import method provided according to the first embodiment of the present application. This embodiment is based on MapReudce logic and is used to solve the problem of how to quickly import data into a graph database. The method can be executed by a data importing device of a graph database, which can be implemented in the form of software and / or hardware, and can be integrated into an electronic device carrying a data importing function. Such asfigure 1 As shown, the data import method of the graph database provided in this embodiment may include:

[0051] S110. Determine the first tuple data of edges in the graph data.

[0052] It can be understood that a graph is a map, which is composed of endpoints and edges; where endpoints represent entities such as people, things, objects, and places, and edges represent the relationship between two endpoints. In this embodiment, the graph data is the data to be imported into t...

no. 2 example

[0070] Figure 2A It is a flow chart of a graph database data import method provided according to the second embodiment of the present application. On the basis of the above embodiments, this embodiment further analyzes the mapping relationship in at least two slice files and the edge For the first multi-group data, determine the combined data for interpretation. Such as Figure 2A As shown, the data import method of the graph database provided in this embodiment may include:

[0071] S210. Determine first tuple data of edges in the graph data.

[0072] S220. According to the original id of the endpoint in the graph data, write the mapping relationship between the original id of the endpoint and the unique id of the endpoint, and the first tuple data of the edge into at least two shard files.

[0073] S230. Determine the second tuple data of the edge according to the mapping relationship in at least two shard files and the first tuple data of the edge.

[0074] In this emb...

no. 3 example

[0089] Figure 3A It is a flow chart of a graph database data import method provided according to the third embodiment of the present application. On the basis of the above embodiments, this embodiment further analyzes the mapping relationship in at least two slice files and the edge The first multi-group data, determine the combined data to be interpreted. Such as Figure 3A As shown, the data import method of the graph database provided in this embodiment may include:

[0090] S310. Determine first tuple data of edges in the graph data.

[0091] S320. According to the original id of the endpoint in the graph data, write the mapping relationship between the original id of the endpoint and the unique id of the endpoint, and the first tuple data of the edge into at least two shard files.

[0092] S330. Determine the second tuple data of the edge according to the mapping relationship in at least two shard files and the first tuple data of the edge.

[0093] S340. Write the s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the present application discloses a graph database data import method, device, electronic equipment and media, which relate to the technical field of big data. The specific implementation plan is: determine the first tuple data of the edge in the graph data; according to the original id of the endpoint in the graph data, map the mapping relationship between the original id of the endpoint and the unique id of the endpoint, and the first tuple data of the edge Write the tuple data into at least two fragment files; determine the combination data according to the mapping relationship in the at least two fragment files and the first tuple data of the edge; write the combination data Data files in the graph database. Through the technical solutions of the embodiments of the present application, the data importing speed can be improved.

Description

technical field [0001] The present application relates to data processing technology, in particular to big data technology, and in particular to a data import method, device, electronic device and medium for a graph database. Background technique [0002] In graph databases, data import performance is an important evaluation indicator. When the amount of data reaches a certain level, due to resource limitations such as memory, the import performance of batch data drops sharply. Therefore, finding a data import method that can adapt to large amounts of data is imminent for graph databases. [0003] However, the current batch data import process needs to frequently query data from external storage media such as KV databases, which seriously affects the data import speed. Contents of the invention [0004] Embodiments of the present application provide a data import method, device, electronic device, and medium for a graph database, so as to improve data import speed and fu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/25
CPCG06F16/2228G06F16/258G06F16/28G06F16/9024G06F16/1844G06F16/16G06F16/183G06F16/288G06F16/2246
Inventor 张海平汪洋陈曦王益飞郑杰鹏
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap