A system and method for writing data into a graph database based on NiFi

A data writing and database technology, applied in the computer field, can solve problems such as cumbersome and complex solutions and poor performance

Active Publication Date: 2019-02-22
INSPUR SOFTWARE CO LTD
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, when it is necessary to analyze the potential relationship between entities in the existing relational database, the existi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A system and method for writing data into a graph database based on NiFi
  • A system and method for writing data into a graph database based on NiFi
  • A system and method for writing data into a graph database based on NiFi

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work belong to the protection of the present invention. scope.

[0050] Such as figure 1 As shown, the embodiment of the present invention provides a system for writing data into a graph database based on NiFi, which may include: a graph database 101, a data flow platform 102, and at least one relational database 103;

[0051] Wherein, the graph database 101 includes: a modeling control platform 1011;

[0052] Wher...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a system and a method for writing data into a graph database based on NiFi. The system comprises a graph database, a data stream platform comprising a processing module and a plurality of data execution nodes, and a plurality of relational databases storing data tables. The modeling control platform in the graph database is configured to designate the data source informationof the data tables to be synchronized, and the graph data model corresponding to each data table to be synchronized is established. The processing module uses NiFi to call the interface of graph database to generate NiFi data flow including several SQL statements according to the data source information and executes the NiFi data flow to distribute the several SQL statements to each data execution node. The data execution node executes distributed SQL statements to load a data set to be synchronized obtained from its corresponding data table into a graph data model corresponding to the data table. Therefore, this scheme can write the data from the relational database into the graph database.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a system and method for writing data into a graph database based on NiFi. Background technique [0002] With the generation and application of ultra-large-scale and high-concurrency social network data, traditional relational databases have exposed insurmountable problems. For example, when it is necessary to analyze the potential relationship between entities in the existing relational database, the existing relational database has the characteristics of poor performance and cumbersome and complicated schemes in dealing with relations. [0003] A graph database is a new type of database different from a relational database. It can handle large-scale data and respond to changing needs, and quickly solve complex relational problems. In this way, the data in the relational database needs to be written into the graph database. Contents of the invention [0004] The invention p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/242G06F16/25G06F16/27G06F16/23G06F16/28
Inventor 宋丽丽刘福才胡清王建华肖雪
Owner INSPUR SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap