Database data migration-oriented data verification method

Abstract

The invention relates to a database data migration-oriented data verification method. Compared with the prior art, the database data migration method and system have the advantages that each data table is taken as a migration task, a database import / export tool or a customized program is taken as a main measure for reading heterogeneous database data, the tasks are operated in a distributed cluster, a self-defined sub-library algorithm is added in the data processing, read data is divided into a plurality file, and in the tasks, the database import / export tool or the customized program is called to import the data into a plurality of new databases. Various paths of data migrations are carried out at the same time without influencing one another, so that the data migration speed is greatlyimproved. A data verification function is provided, so that the stability and data correctness in the migration process are ensured. In the data migration process, distributed verification is carriedout on the data, so that the safety and completeness of the data verification are ensured. Users are allowed to self-define data verification manners, and finally verified result data is returned to corresponding users.

Description

【Technical field】 [0001] The invention is dedicated to data security access, and ensures that the data is free from missing and complete during the migration process by performing distributed verification on the migration data during the data migration process of the database. 【Background technique】 [0002] In early Internet applications, the underlying data generally adopts a storage solution for storing all data in a single database. With the development of Internet applications, the number of users has increased sharply, and the amount of data storage has increased exponentially. The underlying data single-database storage scheme restricts or even limits the further expansion of Internet applications. Therefore, in order to solve the bottleneck problem of single database storage, it is necessary to gradually adopt another solution that supports horizontal storage. To solve the bottleneck of data storage, the existing storage structure must be switched. However, due to t...

AI Technical Summary

Problems solved by technology

To solve the bottleneck of data storage, the existing storage structure must be switched. However, due to the huge amount of underlying data at present, how to migrate the original massive data to a new storage structure that supports horizontal expansion while switching the storage structure It is also a big bottleneck point, especially this kind of expansion cannot guarantee that the correct and complete data results will be obtained in the end

Moreover, the common expansion method is not only costly and inefficient, but also the security and reliability cannot be guaranteed

Images