Database cluster data migration method and system

A database and data technology, applied in the database field, can solve the problems of high risk, laborious and time-consuming, and achieve the effect of less resource consumption, time saving and business impact reduction.

Inactive Publication Date: 2018-07-10
HANDAN BRANCH OF CHINA MOBILE GRP HEBEI COMPANYLIMITED +1
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0020] The present invention provides a method and system for database cluster data migration, which can at least solve the problems of time-consuming, laborious, and risky problems in the migration process of large data, and greatly improve the safety and security of data extraction, transmission, and loading. performance, saving data relocation time and reducing the impact on business

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database cluster data migration method and system
  • Database cluster data migration method and system
  • Database cluster data migration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] refer to figure 1 , figure 1 A flow chart of a method for migrating database cluster data provided by the present invention is shown. Including: step S110 and step S120.

[0049] In step S110, all the data copied in parallel by the source-end database cluster by batch invoking point-to-point data copying is received.

[0050] Specifically, the source-end database cluster adopts the method of batch-calling the underlying API interface of the database, randomly selects the destination server in the destination database cluster that is equal to the source-end database server in the source-end database cluster, and receives the source-end database server through mutual trust. All data replicated in parallel by source-side database servers in the database cluster.

[0051] Wherein, the underlying API interface of the database may be the libpg copy interface of the PostgreSQL database. The database calls the database API interface in parallel to complete the data extracti...

Embodiment 2

[0094] refer to figure 2 , figure 2 A flowchart of an embodiment of a database cluster data migration method provided by the present invention is shown. Including: step S210.

[0095] In step S210, all the data is copied in parallel to the insert select method for data redistribution by adopting the method of batch call point-to-point data replication, and the received data can be redistributed to the destination database cluster on the computing node.

[0096] Specifically, the source-end database cluster adopts the method of batch-calling the underlying API interface of the database, randomly selects the destination server in the destination database cluster that is equal to the source-end database server in the source-end database cluster, and receives the source-end database server through mutual trust. All data replicated in parallel by source-side database servers in the database cluster.

[0097] Wherein, the underlying API interface of the database may be the libp...

Embodiment 3

[0142] refer to image 3 , image 3 A structural block diagram of an embodiment of a database cluster data migration system 300 provided by the present invention is shown, including:

[0143] The receiving module 31 is configured to receive all the data copied in parallel by the source-side database cluster by using a batch calling point-to-point data copying method.

[0144] The data redistribution module 32 is configured to perform data redistribution in an insert select manner, and redistribute the received data to computing nodes.

[0145] Further, such as Figure 4 As shown, the receiving module 31 includes:

[0146] The receiving unit 311 is configured to randomly select a destination server in the destination database cluster that is equivalent to the source database server in the source database cluster by using a batch call database underlying API interface replication method based on the source database cluster, and pass The mutual trust method receives all the d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a database cluster data migration method and system. The method comprises the steps of receiving all data copied in parallel in a batch call point-to-point data copy mode by asource end database cluster; and performing data redistribution in an insert select mode, and re-scattering the received data to computing nodes. According to the method and the system, a destinationend database cluster performs the data redistribution in the insert select mode directly in a database after the data is copied in parallel, so that the security and performance of data extraction, transmission and loading are greatly improved, the data migration time is greatly shortened, and the influence on businesses is reduced.

Description

technical field [0001] The invention relates to the field of databases, in particular to a method and system for database cluster data migration. Background technique [0002] With the rapid development of mobile 4G services, a large amount of 4G signaling data is transmitted to a massively parallel processing (MPP) database. The data uses a variety of BI tools and uses data integration to integrate various production platforms within the enterprise. The data is centralized into the MPP database. Through statistical analysis, data mining and other means, it serves market operations and provides analytical support for leadership decision-making. The basic data currently stored in the database database are mainly: customer information, user information, bills, business acceptance, etc., and also includes customer service, network management, signaling and other platforms to transmit data to the sub-system. However, the ever-increasing amount of data has doubled the operating...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/214G06F16/27
Inventor 王海通张琳
Owner HANDAN BRANCH OF CHINA MOBILE GRP HEBEI COMPANYLIMITED
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap