Data recovery and migration method and device

Abstract

The invention provides a data recovery and migration method and device. The method comprises a configuration step of configuring a data recovery and migration task and setting parameters associated with the task; a data reading step of reading history data in sequence according to batches and the parameters, independently generating a data file for each batch of history data, buffering and storingthe data files, and storing a data range and a data reading mark of each data file into Redis; and a data writing step of obtaining each batch of to-be-recovered data ranges and data reading marks inthe Redis according to the parameters, if the data reading marks fails, terminating the operation, and otherwise, recovering the buffered and stored history data into a source database or migrating the buffered and stored history data into a target database in sequence according to the batches and the data ranges, and storing the data range and a data writing mark of each data file into the Redis.

Description

technical field [0001] The invention relates to the field of computer technology and software, in particular to a method and device for data restoration and migration. Background technique [0002] With the increase of visits, the amount of online data is growing faster and faster. Operators need to periodically transfer the closed business data to the historical library or cloud storage. The transferred data is called historical data. However, historical data is not permanently sealed. It can be said that its subsequent survival is of greater significance, such as data analysis and restoration to the performance test environment for stress testing. In addition, for big data analysis or offline testing, it is necessary to migrate closed business data to the big data platform or test database. Therefore, there is a need for a method and device for restoring or migrating historical data. [0003] At present, there are several ways to restore data to the source database or mi...

AI Technical Summary

Problems solved by technology

[0007] 1) It has a great impact on the normal production warehouse and is inconvenient to operate;

[0008] 2) Low efficiency and longer data migration time;

[0009] 3) The close cooperation of the database administrator is required, and the communication cost is high;

[0010] 4) High processing costs after problems occur

It is cumbersome to continue at the interruption point after the interruption, requiring too much manual intervention, and the labor cost is high

Images