Data migration method and system, electronic device and storage medium
A data and data table technology, applied in the computer field, can solve problems such as unfavorable data link relationship, small data volume, unfavorable graph database data generation, etc.
Active Publication Date: 2021-08-06
杭州费尔斯通科技有限公司
View PDF14 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, there are no tools and methods for directly importing data from relational databases to graph databases such as JanusGraph in existing tools
[0003]
In related technologies, data migration is implemented based on message middleware. However, the amount of data transferred each time in this data migration is too small, which is not conducive to the data generation when the graph database is initially established, and is also not conducive to the creation of link relationships between data.
In addition, in some related technologies, data migration is to move between similar databases, which does not achieve the purpose of migrating data from existing relational databases to graph databases
[0004]
At present, there is no effective solution for the lack of methods for directly importing data from relational databases to graph databases in related technologies.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0039] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application. In addition, it can also be understood that although such development efforts may be complex and lengthy, for those of ordinary skill in the art relevant to the content disclosed in this application, the technology disclosed in this application Some design, manufacturing or production changes based on the content are just conventional technical means, and...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a data migration method and system, an electronic device and a storage medium, and the method comprises the steps that: data table structure information in a relational database is obtained, and the corresponding conversion of the data table structure information is performed according to a mapping relation table; then, the data is screened, and a new global UUIDn is set; according to the ido of the data in the data table, whether a unique global UUIDo exists or not is inquired from a mapping relation library MDB, if yes, the global UUIDo is set to the data, and if not, the global UUIDn is set to the data and stored in the MDB; and finally, the data after id setting is completed are stored as node csv files in batches, after all the data are stored as the csv files, the node csv files are read, according to the associated fields of the data, UUIDs of the associated data corresponding to the associated fields are searched in the MDB, connection edges are established, and the connection edges are stored as connection edge csv files. The purpose of migrating the data of the relational database to the graph database is achieved.
Description
technical field [0001] The present application relates to the computer field, in particular to a data migration method, system, electronic device and storage medium. Background technique [0002] With the continuous development of network application forms, more and more relational data tables need to be created to realize more and more rich network applications. These data tables are both related and independent of each other. When obtaining associated data in different data tables, there will be a huge performance bottleneck. The emergence of non-relational databases such as JanusGraph (a scalable distributed graph database) solves the problem of simultaneous storage of data from multiple data sources. However, there are no tools and methods for directly importing data from relational databases to graph databases such as JanusGraph in existing tools. [0003] In related technologies, data migration is implemented based on message middleware. However, the amount of data t...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F16/21G06F16/22G06F16/25G06F16/28G06F16/901
CPCG06F16/214G06F16/258G06F16/2282G06F16/284G06F16/9024Y02D10/00
Inventor 杨鸿博杨红飞金霞
Owner 杭州费尔斯通科技有限公司