Database cluster data migration method and system

A database and data technology, applied in the database field, can solve the problems of high risk, laborious and time-consuming, and achieve the effect of less resource consumption, time saving and business impact reduction.

Inactive Publication Date: 2018-07-10
HANDAN BRANCH OF CHINA MOBILE GRP HEBEI COMPANYLIMITED +1
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0020] The present invention provides a method and system for database cluster data migration, which can at least solve the problems of time-consuming, laborious, and risky problems in the migrat

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database cluster data migration method and system
  • Database cluster data migration method and system
  • Database cluster data migration method and system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0047] Example one

[0048] Reference figure 1 , figure 1 Shows a flowchart of a method for data migration of a database cluster provided by the present invention. Including: step S110 and step S120.

[0049] In step S110, all the data copied in parallel by the source-end database cluster using a batch call point-to-point data replication method is received.

[0050] Specifically, the source-end database cluster adopts the replication method of batch calling the underlying API interface of the database, randomly selects the destination-end servers equal to the source-end database server in the source-end database cluster in the destination-end database cluster, and receives the source through mutual trust. All data replicated in parallel by the source database server in the database cluster.

[0051] Among them, the underlying API interface of the database can be the libpg copy interface of the PostgreSQL database. The database calls the database API interface in parallel to complet...

Example Embodiment

[0093] Example two

[0094] Reference figure 2 , figure 2 It shows a flowchart of an embodiment of a method for data migration of a database cluster provided by the present invention. Including: step S210.

[0095] In step S210, the batch call point-to-point data replication method is adopted to copy all the data in parallel to the insert select method for data redistribution, and the received data can be re-distributed to the destination database cluster on the computing node.

[0096] Specifically, the source-end database cluster adopts the replication method of batch calling the underlying API interface of the database, randomly selects the destination-end servers equal to the source-end database server in the source-end database cluster in the destination-end database cluster, and receives the source through mutual trust. All data replicated in parallel by the source database server in the database cluster.

[0097] Among them, the underlying API interface of the database can b...

Example Embodiment

[0141] Example three

[0142] Reference image 3 , image 3 The structural block diagram of an embodiment of a system 300 for database cluster data migration provided by the present invention is shown, including:

[0143] The receiving module 31 is configured to receive all data copied in parallel by the source-end database cluster using a batch call point-to-point data replication method.

[0144] The data redistribution module 32 is used to perform data redistribution in an insert select mode, and redistribute the received data to the computing nodes.

[0145] Further, such as Figure 4 As shown, the receiving module 31 includes:

[0146] The receiving unit 311 is configured to randomly select a destination server in the destination database cluster that is equivalent to the source database server in the source database cluster based on the source database cluster using the batch call database bottom API interface replication mode, and pass The mutual trust method receives all data r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a database cluster data migration method and system. The method comprises the steps of receiving all data copied in parallel in a batch call point-to-point data copy mode by asource end database cluster; and performing data redistribution in an insert select mode, and re-scattering the received data to computing nodes. According to the method and the system, a destinationend database cluster performs the data redistribution in the insert select mode directly in a database after the data is copied in parallel, so that the security and performance of data extraction, transmission and loading are greatly improved, the data migration time is greatly shortened, and the influence on businesses is reduced.

Description

technical field [0001] The invention relates to the field of databases, in particular to a method and system for database cluster data migration. Background technique [0002] With the rapid development of mobile 4G services, a large amount of 4G signaling data is transmitted to a massively parallel processing (MPP) database. The data uses a variety of BI tools and uses data integration to integrate various production platforms within the enterprise. The data is centralized into the MPP database. Through statistical analysis, data mining and other means, it serves market operations and provides analytical support for leadership decision-making. The basic data currently stored in the database database are mainly: customer information, user information, bills, business acceptance, etc., and also includes customer service, network management, signaling and other platforms to transmit data to the sub-system. However, the ever-increasing amount of data has doubled the operating...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/214G06F16/27
Inventor 王海通张琳
Owner HANDAN BRANCH OF CHINA MOBILE GRP HEBEI COMPANYLIMITED
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap