Method and device for importing and exporting multi-source heterogeneous data source and graph database

A multi-source heterogeneous, import-export technology, applied in database models, relational databases, structured data retrieval, etc., can solve the problems of low reuse, high development cost, and long cycle, and achieve high reuse and low cost , high performance effect

Pending Publication Date: 2022-05-10
CHINA UNITECHS
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] (3) Program development based on custom logic, long cycle and low reusability
Between the data source and the target storage, if the modification or addition of conversion is involved, the corresponding program code also needs to be modified, and the development cost is high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for importing and exporting multi-source heterogeneous data source and graph database
  • Method and device for importing and exporting multi-source heterogeneous data source and graph database
  • Method and device for importing and exporting multi-source heterogeneous data source and graph database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0126] 1. Data writing to the graph database

[0127] (1) Write configuration files

[0128] The configuration file configures the following parts: define the data source; associate multiple data sources (optional); configure 0 to multiple conversion modules; configure vertex and edge information; connect to the graph database.

[0129] Examples are as follows:

[0130]

[0131]

[0132]

[0133]

[0134]

[0135] (2) run

[0136] At runtime, the configuration file is passed as an argument to the executed program.

[0137] The above configuration data is stored in the configuration file data_import.conf, execute the data import command:

[0138] . / data_imort.sh --configfile . / data_import.conf

[0139] 2. Data reading of graph database

[0140] The data reading of the graph database is similar to the data writing. The main configuration is the following parts: define the vertices of the graph database and convert them; define the edges of the graph database ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for importing and exporting a multi-source heterogeneous data source and a graph database, and the method comprises the steps: reading various types of stored data sources, carrying out the data association, and generating a distributed data set with a unified column format; after the distributed data set with the unified column format is converted, a new distributed data set with the unified column format is generated; extracting information of points and edges of the graph database from the new distributed data set with the unified column format, and respectively writing the information into vertexes and edges of the graph database; the method comprises the following steps: reading a graph database, converting vertexes and edges of the graph database, associating data of the vertexes and the edges to generate a distributed data set with a unified column format, and writing the data into target storage after subsequent conversion processing. According to the method and the device, the technical problem of tool-based data import / export at present is solved.

Description

technical field [0001] The invention relates to the field of data import and export, in particular to a method and device for importing and exporting multi-source heterogeneous data sources and graph databases. Background technique [0002] The current mainstream tools for writing data into graph databases, such as DataX or graph database import tools released by graph data manufacturers, cannot cover flexible and complex import / export logic. mainly reflects in: [0003] (1) Insufficient data processing functions for tool-based data import / export [0004] The existing graph database import / export tools cannot convert the data of the data source according to business requirements or the conversion function is very weak, and cannot meet the complex data processing requirements. [0005] (2) Tool-based data import / export links are long [0006] Before importing data into the graph database, it is necessary to perform various transformations on the data according to the data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/27G06F16/28
CPCG06F16/258G06F16/27G06F16/284
Inventor 周朝卫
Owner CHINA UNITECHS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap