Lightweight concurrent migration method of database

Abstract

The invention discloses a lightweight concurrent migration method of a database, and relates to the technical field of data migration. Aiming at problems and existing defects in the existing database migration process, the technical scheme adopted by the invention comprises the following steps: loading configurations of an original database and a target database, loading a corresponding grammar dialect according to the type of the target database, and performing grammar verification on the configurations; generating a table, a storage process, a function, a view, an index and others of the target database based on the loaded configuration; according to resources of an operating system, dynamically controlling the number of started threads, and carrying out concurrent migration on data of an original database through the started threads; and after migration is completed, performing default verification and configuration verification on the original database and the target database. Third-party middleware is not adopted, the method has the advantages of being efficient in operation, low in use cost, easy to expand, configurable and capable of achieving elastic expansion and contraction, and lightweight fast migration of data can be achieved.

Description

technical field [0001] The invention relates to the technical field of data migration, in particular to a lightweight concurrent migration method for databases. Background technique [0002] With the continuous progress of society, computer computing power and data storage capacity continue to increase, and various technical means for data storage and data migration emerge in an endless stream, among which relational database storage is a common storage method. Combined with the actual application scenarios and the size of the data volume, changing the database has become a common technical means of database data storage. How to migrate the database quickly, accurately, elastically, and with custom configuration is an important part of database migration. Various verifications and inspections need to be performed before and during database migration. Database migration can manually export data from the original database, create a target database, and import data into the ta...

AI Technical Summary

Problems solved by technology

This requires more investment in equipment maintenance and software upgrades, as well as labor costs for maintenance. The application is too dependent on third-party hardware or software, and the scalability is not enough. For example, the third-party software Navicat heterogeneous database migration cannot automatically create indexes and tables. Name, field case, etc., cannot meet the changing needs of database migration, may cause enterprises to be unable to personalize the implementation method according to their own business scenarios

In addition, third-party hardware or software usually takes up a lot of server resources

[0003]In many business scenarios, enterprise user data migration scenarios are relatively single, but changeable, requiring customized configuration conversion, and third-party middleware can easily fail to take care of it These scenarios may also need to occupy a lot of other resources, but they cannot meet the needs; there are also some enterprise user databases with simple structures and small amounts of data to be migrated, as long as they can be fast, concurrent, stable, configurable, and lightweight. , the use of third-party middleware causes waste of manpower and material resources to the enterprise

Images