Data migration method and device

Abstract

The invention discloses a data migration method and device used for migrating a data table from an original database to a target database of a distributed database containing multiple storage nodes. The method comprises the steps that full-amount data corresponding to a to-be-migrated data table is acquired, and a distribution column is set for each data record in the full-amount data; all the data records are migrated into all the storage nodes of the target database respectively according to the distribution columns; log point location information corresponding to the full-amount data is determined; and a log record generated after the log point location information is acquired, data operation corresponding to the log record is determined, and the data operation is executed according to the full-amount data stored in all the storage nodes of the target database. By the adoption of the scheme, the data can be migrated to the distributed database containing the storage nodes under the condition of not influencing online business, the situation that the processing capability of a distributed main node influences data migration efficiency is avoided, the data migration efficiency is improved, and real-time synchronization of the data is guaranteed.

Description

technical field [0001] The present invention relates to the technical field of communications, and in particular to a data migration method and device. Background technique [0002] With the development of information technology, the frequency of information system replacement or adjustment is getting higher and higher. For example, in many situations, such as transferring the test database to the online business database, updating and upgrading old equipment, performing maintenance operations on equipment that has been overloaded for a long time, or changing the computer room, it is necessary to migrate data from one database to another . [0003] However, the inventor found in the process of implementing the present invention that at least the following defects exist in the prior art: currently, the data in the original database is usually transferred to the target database through a third-party data container. For example, the data in the original database can be copied...

AI Technical Summary

Problems solved by technology

[0003] However, the inventor found in the process of realizing the present invention that there are at least the following defects in the prior art: the data in the original database is usually transferred to the target database through a third-party data container

For example, the data in the original database can be copied to the disk, and then copied to the target database through the disk, but the data migration speed of this method is slow, and the real-time synchronization of the data in the original database and the target database cannot be realized. It will affect the normal operation of the online database; or, by expanding the slave database to the original database, the data is migrated from the slave database to the target database, but this method wastes a lot of resources, and the synchronization of data in the target database and the original database The delay is high; and, when the target database is a distributed database containing multiple storage nodes, in the prior art, all migration data is usually sent directly to the master node of the distributed database, and the distributed master node then performs the migration Data is redistributed. However, when the amount of migrated data is large, the processing pressure on the master node increases greatly, so that the processing capacity of the master node limits the overall data migration efficiency.

Images