Data migration method, device, equipment and storage medium

By using the verification result record of the data pre-checking platform in the data migration platform, migratory data can be obtained based on the upload time and the verification start time, the long time and low efficiency caused by full verification during the data migration process are solved. Problem, achieving more efficient data migration.

CN113986877BActive Publication Date: 2025-01-07CHINA PING AN PROPERTY INSURANCE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111234685.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-22
Publication Date
2025-01-07
Estimated Expiration
2041-10-22

AI Technical Summary

Technical Problem

During the data migration process, the existing technology requires full verification of the migration data, resulting in too long migration time and inefficient efficiency.

Method used

The data migration platform obtains the verification result records of the data pre-checking platform, and obtains migratory data based on the upload time and the verification start time to avoid full verification and saves verification time.

Benefits of technology

Improves the efficiency of data migration, shortens the migration process time, and improves the performance of data migration.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113986877B_ABST
    Figure CN113986877B_ABST
Patent Text Reader

Abstract

The present application relates to the field of data storage, and specifically discloses a data migration method, device, equipment and storage medium. The data migration method is based on a data migration system, and the migration system includes a data acquisition platform, a data pre-verification platform, a temporary database, a data migration platform and a business database; applied to the data migration platform, the data migration method includes: obtaining at least one data set in the temporary database, at least one data set is uploaded to the temporary database by the data acquisition platform at respective upload times; obtaining at least one verification result record from the data pre-verification platform, at least one verification result is generated by the data pre-verification platform verifying the temporary database at respective verification start times; based on the upload time and the verification start time, obtaining migratable data according to at least one data set and at least one verification result record; migrating the migratable data from the temporary database to the business database.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data storage, and in particular to a data migration method, device, equipment and storage medium. Background Art

[0002] In the process of migrating the data from one database to another, if the data in the database is wrong, the data migrated to the other database will be wrong, resulting in the data in the migrated database being unable to be used normally. After the error occurs during the migration process, the data in the migrated database needs to be cleaned up, which is a very complicated process and will change the production environment and cause data problems. Therefore, before the official data migration, the data to be migrated in the database needs to be verified.

[0003] Data can be verified by manual verification or automatic verification by program. Manual verification can only verify the correctness of the content or form of the data, but cannot verify the correctness of the data storage logic. Manual verification is not comprehensive, so automatic verification by program is generally used. During data migration, a comprehensive verification is performed on the logic and correctness of all data to be migrated.

[0004] However, before data migration, all the data to be migrated must be verified, and the verification process will take a very long time, which is very time-consuming, indirectly resulting in a longer total process time for each data migration and lower data migration efficiency. Summary of the invention

[0005] The present application provides a data migration method, apparatus, device and storage medium to save time for data verification during data migration and improve the efficiency of data migration.

[0006] In a first aspect, the present application provides a data migration method, comprising:

[0007] The data migration platform acquires at least one data set in the temporary database, and the at least one data set is uploaded to the temporary database by the data collection platform at at least one upload time;

[0008] The data migration platform obtains at least one verification result record from the data pre-verification platform, where the at least one verification result is generated by the data pre-verification platform verifying the temporary database at at least one verification start time;

[0009] Based on the at least one verification result record and the at least one data set, the data migration platform acquires the migratable data according to the at least one upload time and the at least one verification start time;

[0010] The data migration platform migrates the migratable data from the temporary database to a business database.

[0011] In a second aspect, the present application also provides a data migration method, including:

[0012] The data pre-verification platform verifies the data in the temporary database at at least one verification start time, generates at least one verification initial record corresponding to at least one data set, the temporary database includes the at least one data set, and the at least one verification initial record is used to obtain at least one verification result record;

[0013] The data pre-verification platform provides the at least one verification result record to the data migration platform, so that the data migration platform obtains the migratable data according to the at least one verification result record, and migrates the migratable data from the temporary database to the business database.

[0014] In the third aspect, the present application also provides a data migration system, which includes a data pre-verification platform and a data migration platform, wherein the data migration platform is used to execute the data migration method provided in the first aspect of the embodiment of the present application, and the data pre-verification platform is used to execute the data migration method provided in the second aspect of the embodiment of the present application.

[0015] In a fourth aspect, the present application further provides a data migration device, including:

[0016] A data acquisition module, used to acquire at least one data set in a temporary database, wherein the at least one data set is uploaded to the temporary database by a data acquisition platform at at least one upload time;

[0017] A verification record acquisition module, used to obtain at least one verification result record from a data pre-verification platform, wherein the at least one verification result is generated by the data pre-verification platform verifying the temporary database at at least one verification start time;

[0018] A migration data acquisition module, based on the upload time and the verification start time, for obtaining the migratable data according to the at least one data set and the at least one verification result record;

[0019] A migration module is used to migrate the migratable data from the temporary database to the business database.

[0020] In a fifth aspect, the present application also provides a data migration device, including:

[0021] A data verification module, configured to verify the data in the temporary database at a verification start time, respectively, to generate at least one verification initial record corresponding to at least one data set, the temporary database including the at least one data set, and the at least one verification initial record used to obtain at least one verification result record;

[0022] The verification record providing module is used to provide the at least one verification result record to the data migration platform, so that the data migration platform obtains the migratable data according to the at least one verification result record, and migrates the migratable data from the temporary database to the business database.

[0023] In a sixth aspect, the present application further provides a computer device, comprising a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and implement any one of the data migration methods provided in the embodiments of the present application when executing the computer program.

[0024] In a seventh aspect, the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor enables the processor to implement any one of the data migration methods provided in the embodiments of the present application.

[0025] The present application discloses a data migration method, apparatus, device and storage medium, which can obtain migratable data based on data verification records according to the data upload time and the verification start time, without the need to perform full verification on the data to be migrated before obtaining the migratable data, thereby saving time for data verification during data migration and improving the efficiency of data migration. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0027] Figure 1 A schematic diagram of the architecture of a data migration system provided in an embodiment of the present application;

[0028] Figure 2 A schematic diagram of a flow chart of a data migration method provided in an embodiment of the present application;

[0029] Figure 3 Another schematic diagram of a data migration method according to an embodiment of the present invention;

[0030] Figure 4Another schematic diagram of a data migration method according to an embodiment of the present invention;

[0031] Figure 5 Another schematic diagram of a data migration method according to an embodiment of the present invention;

[0032] Figure 6 Another schematic diagram of a data migration method according to an embodiment of the present invention;

[0033] Figure 7 A schematic block diagram of a data migration device provided in an embodiment of the present application;

[0034] Figure 8 It is a schematic block diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0036] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0037] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0038] It should also be understood that the term “and / or” used in the specification and appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0039] In order to solve the problem that the total data migration process takes a very long time and the data migration efficiency is low due to full verification of the data to be migrated when the data migration process is started, the present application provides a data migration method device, equipment and storage medium.

[0040] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0041] See also Figure 1 , Figure 1 FIG. 1 shows a schematic block diagram of a data migration system provided by an embodiment of the present application. Figure 1 As shown, the data migration system includes a data collection platform 101 , a temporary database 102 , a data pre-checking platform 103 , a data migration platform 104 and a business database 105 .

[0042] The data collection platform 101 reports the data collected within a period of time to the temporary database 102. When the data collection platform reports the data collected within the period of time to the temporary database 102, it records the time of reporting the data.

[0043] The temporary database 102 is used to store the data to be migrated and provide the data pre-checking platform 103 or the data migration platform 104 with data required for verification or migration.

[0044] The data pre-verification platform 103 and the data migration platform 104 are independent of each other, wherein the data pre-verification platform 103 verifies the data in the temporary database 102, and the generated verification result records are stored in the data pre-verification platform 103, and the starting time of the verification process is recorded when the verification result records are stored; the data migration platform 104 can query the verification result records in the data pre-verification platform 103 and the starting time of the verification process corresponding to the verification result records, and can also migrate the data in the temporary database 102 to the business database 105.

[0045] The business database 105 is used to store the migrated data and support business operations based on the migrated data.

[0046] based on Figure 1 In addition to the data migration system shown, the embodiment of the present application also provides a data migration method applied to the data migration platform 104.

[0047] See also Figure 2 , Figure 2 A flowchart of a data migration method in an embodiment of the present application.

[0048] S201. The data migration platform obtains at least one data set in a temporary database.

[0049] As of the target time, at least one data set is stored in the temporary database, and the at least one data set is uploaded to the temporary database by the data acquisition platform in the data migration system at the upload time. The upload time can be a scheduled upload triggered by the data acquisition platform, or the data acquisition platform receives an upload instruction issued manually.

[0050] S202: The data migration platform obtains at least one verification result record from the data pre-verification platform.

[0051] As of the target time, at least one verification result record is stored in the data pre-verification platform. The at least one verification result record is the final verification result record for each verification process generated by the data pre-verification platform in at least one verification process performed on the temporary database. Each verification process has a starting time, and at least one verification process has a verification starting time.

[0052] It should be noted that a total verification process may include multiple verification sub-processes. A total verification process is a verification process for the same original data in the temporary database, including a sub-verification process for the corrected data after the original data is modified. If the total verification process includes sub-verification processes, the verification initial record generated by the last sub-verification process is used as the result record of the total verification process.

[0053] S203: Based on the upload time and the verification start time, the data migration platform obtains the migratable data according to at least one data set and at least one verification result record.

[0054] When the data migration platform starts the migration task and begins the pre-migration preparation phase, the data migration platform can link the data in the temporary database with the independently performed pre-verification result record based on the upload time corresponding to at least one uploaded data and the verification start time corresponding to at least one verification result record, through the pre-verification time and the upload time, and determine the pre-verification result record corresponding to the data in the temporary database. According to the verification result record corresponding to the linked data, determine the correctness result of the data to be migrated, and according to the correctness result of the data to be migrated, further obtain completely correct migratable data according to the result of the data to be migrated.

[0055] S204. The data migration platform migrates the migratable data from the temporary database to the business database.

[0056] After completing the preparation phase of the data migration process and confirming the correctness of the migratable data, the data migration platform officially starts the migration logic to migrate the migratable data from the temporary database to the business database used for business operations.

[0057] based on Figure 2 The data migration method shown, the embodiment of the present application also provides a data migration method, wherein for step S203, the sub-steps of step S203 include S2031 and S2032.

[0058] S2031. When the last moment of the verification start moment is earlier than the last moment of the upload moment, the data migration platform determines an unverified data set from at least one data set according to at least one verification result record.

[0059] At least one start time of at least one verification record in the data pre-verification platform forms a sequence arranged in chronological order, with the first one representing the start time of the first verification and the last one representing the start time of the last verification. When the last time in the verification start time is earlier than the last time of the upload time, it means that the last uploaded data has not been verified by the pre-verification platform, and it can be determined that there is data in at least one data set that has not been verified.

[0060] When the data migration platform determines that there is data that has not been verified in at least one data set, the upload time of the at least one data set and the verification start time of at least one verification record are compared one by one to determine that the data set after the target data time in the at least one data set has not been verified, thereby determining the unverified data set.

[0061] S2032. Based on at least one data set and at least one verification result record, the data migration platform obtains migratable data according to the unverified data set.

[0062] After the data migration platform obtains the unverified data set, it needs to obtain correct migratable data based on the unverified data set. For the unverified data set, it is necessary to first verify the unverified data set, and then perform further processing based on the verification result.

[0063] In some embodiments, when at least one verification result record and the verification initial record of the unverified data set both have passed verification results, at least one data set is determined to be migratable data.

[0064] In some embodiments, when there is a failed verification result in at least one verification result record or the verification initial record of an unverified data set, a data set that fails the verification is determined from at least one data set, a correction collection instruction for the data set that fails the verification is sent to the data collection platform, and the temporary database is cleared, so that the data collection platform collects a corrected data set for the data set that fails the verification, and then the corrected data set and the correct data set in at least one data set are all uploaded to the temporary database, and the data set in the corrected temporary database is determined to be migratable data.

[0065] based on Figure 2 The data migration method shown, the embodiment of the present application also provides a data migration method, wherein for step S203, the sub-steps of step S203 include S2033 and S2034.

[0066] S2033: When the last time of the verification start time is later than the last time of the upload time, determine at least one data set as a verified data set.

[0067] At least one start time of at least one verification record in the data pre-verification platform forms a sequence arranged in chronological order, with the first one representing the start time of the first verification and the last one representing the start time of the last verification. When the last time in the verification start time is later than the last time of the upload time, it means that the last uploaded data has been verified by the data pre-verification platform, and the data migration platform determines at least one data set as a verified data set.

[0068] S2034. Based on at least one verification result record, obtain migratable data according to at least one data set.

[0069] When the data migration platform determines that at least one data set in the temporary database has completed verification, the migratable data is obtained based on at least one verification result record representing the verification result.

[0070] In some embodiments, when at least one verification result record is a passing verification result, at least one data set is determined to be migratable data.

[0071] In some embodiments, when there is a failed verification result record in at least one verification result record, the failed verification data set is determined from at least one data set, a correction collection instruction for the failed verification data set is sent to the data collection platform, and the temporary database is cleared, so that the data collection platform collects the corrected data set of the failed verification data set, and then the corrected data set and the correct data set in at least one data set are all uploaded to the temporary database, and the data set in the corrected temporary database is determined to be migratable data.

[0072] based on Figure 1 The data migration system shown, the embodiment of the present application also provides a data migration method applied to the data pre-checking platform 103.

[0073] See also Figure 5 , Figure 5 This is another flowchart of the data migration method in an embodiment of the present application.

[0074] S301, the data migration platform verifies the data in the temporary database at the verification start time, and by the target time, the data pre-verification platform generates at least one initial verification record, and the temporary database stores at least one data set. The at least one initial verification record is used to obtain at least one verification result record.

[0075] In some embodiments, the data pre-verification platform may verify the data in the temporary database in an irregular manner triggered manually.

[0076] In some embodiments, the data pre-verification platform performs a timed verification according to a preset time interval.

[0077] S302: The data pre-verification platform provides at least one verification result record to the data migration platform.

[0078] By the target time, the data pre-verification platform stores at least one verification result record. The verification result record can be queried or obtained by the data migration platform, and the migratable data is obtained according to the at least one verification result record, and the migratable data is migrated from the temporary database to the business database.

[0079] based on Figure 5 The data migration method shown, the embodiment of the present application also provides a data migration method.

[0080] See also Figure 6 , Figure 6 Based on the embodiments of the present application Figure 5 The data migration method of the illustrated embodiment includes: Figure 5 In addition to step 301 and step 302, the illustrated embodiment further includes steps 303 to 306.

[0081] S303: When at least one initial verification record includes a record that fails verification, the data pre-verification platform determines information of a data set that fails verification from at least one data set.

[0082] As of the target moment, at least one data set is stored in the temporary database, and at least one initial verification record is stored in the data pre-verification platform. When at least one initial verification record includes a record that failed the verification, the data pre-verification platform determines the data set that passed the verification from the at least one data set.

[0083] S304: The data pre-verification platform obtains a correction data set based on the data set that has not passed the verification, and generates an initial verification record of the correction data set.

[0084] In some embodiments, the data pre-verification platform sends an alarm to the administrator, causing the administrator to issue instructions to the data collection platform to re-collect the corrected data set corresponding to the data set that failed the verification, and generate an initial verification record for the corrected data set.

[0085] S305: When the initial verification record of the corrected data set is a verification result that passes, determine the initial verification record of the corrected data set as a verification result record of the data set that fails the verification.

[0086] After the data pre-verification platform verifies the data set that fails the verification, it obtains an initial record of failure to pass the verification. Then, when the corrected data set that has been modified from the data set that fails the verification is verified again and a passing result is obtained, the passing result combined with the corrected data is associated with the first verification of the data set that fails the verification, and the verification result record of the corrected data set is used as the final verification result record of the data set that fails the verification.

[0087] S306: The data pre-verification platform obtains at least one verification result record according to the verification result records of the data set that failed the verification.

[0088] After obtaining the verification result records corresponding to the failed verification data set, the data pre-verification platform uses the initial verification record of the passed verification data set as the final result record, and obtains at least one verification result record representing the final verification result based on at least one verification initial record.

[0089] See also Figure 7 , Figure 7 The embodiment of the present application further provides a schematic block diagram of a data migration device, wherein the data migration device 400 is used to execute the aforementioned data migration method. The data migration device can be configured in a server or a terminal.

[0090] The server may be an independent server or a server cluster, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The terminal may be an electronic device such as a mobile phone, tablet computer, laptop computer, desktop computer, personal digital assistant, and wearable device.

[0091] like Figure 7 As shown, the data migration device 400 includes: a data acquisition module 401 , a verification record acquisition module 402 , a migration data acquisition module 403 , and a migration module 404 .

[0092] The data acquisition module 401 is used to acquire at least one data set in the temporary database, and the at least one data set is uploaded to the temporary database by the data acquisition platform at the upload time;

[0093] The verification record acquisition module 402 is used to obtain at least one verification result record from the data pre-verification platform, wherein the at least one verification result is generated by the data pre-verification platform verifying the temporary database at the verification start time;

[0094] A migration data acquisition module 403, based on the at least one verification result record and the at least one data set, for acquiring the migratable data according to the upload time and the verification start time;

[0095] The migration module 404 is used to migrate the migratable data from the temporary database to the business database.

[0096] In some embodiments, the migration data acquisition module 405 is also used for: when the last moment of the verification start time is earlier than the last moment of the upload time, the data migration platform determines the unverified data set from the at least one data set according to the at least one verification result record; based on the at least one data set and the at least one verification result record, the data migration platform obtains migratable data according to the unverified data set.

[0097] In some other embodiments, the migration data acquisition module 405 is further used to: when the data migration platform determines that the verification result of the unverified data set and the at least one verification result are both verification passing results, the data migration platform determines that the at least one data set is migratable data. When the data migration platform determines that there is a verification failure result in the verification result of the unverified data set and the at least one verification result, the data migration platform obtains a verification failure data set from the at least one data set and obtains migratable data based on the at least one data set and the verification failure data set.

[0098] In other embodiments, the migration data acquisition module 405 is also used for: when the last moment of the verification start time is later than the last moment of the upload time, the data migration platform determines that the at least one data set is a verified data set; based on the at least one verification result record, the data migration platform obtains migratable data according to the at least one data set.

[0099] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the data migration device and each module described above can refer to the corresponding process in the aforementioned data migration method embodiment, and will not be repeated here.

[0100] The above-mentioned data migration device can be implemented in the form of a computer program. The computer program can be Figure 8 Runs on the computer device shown.

[0101] See also Figure 5 , Figure 5 1 is a schematic block diagram of a computer device provided in an embodiment of the present application. The computer device may be a server or a terminal.

[0102] See also Figure 8 The computer device includes a processor, a memory and a network interface connected through a system bus, wherein the memory may include a non-volatile storage medium and an internal memory.

[0103] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any seat compliance detection method.

[0104] The processor is used to provide computing and control capabilities and support the operation of the entire computer equipment.

[0105] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any data migration method.

[0106] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0107] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0108] Exemplarily, in one embodiment, the processor is used to run a computer program stored in the memory to implement the following steps:

[0109] Acquire at least one data set in a temporary database, the at least one data set is uploaded to the temporary database by a data acquisition platform at an upload time; acquire at least one verification result record from a data pre-verification platform, the at least one verification result is generated by the data pre-verification platform verifying the temporary database at a verification start time; based on the at least one verification result record and the at least one data set, acquire migratable data according to the upload time and the verification start time; migrate the migratable data from the temporary database to a business database.

[0110] In some embodiments, when the processor implements acquiring the migratable data based on the at least one verification result and the at least one data set according to the upload time and the verification start time, the processor specifically implements the following steps:

[0111] When the last moment of the verification start time is earlier than the last moment of the upload time, an unverified data set is determined from the at least one data set according to the at least one verification result record; based on the at least one data set and the at least one verification result record, migratable data is obtained according to the unverified data set.

[0112] In some embodiments, when the migratable data is obtained according to the unverified data set based on the at least one data set and the at least one verification result, the following steps are specifically implemented:

[0113] When it is determined that the verification result of the unverified data set and the at least one verification result are both verification passing results, determining the at least one data set as migratable data;

[0114] When it is determined that a verification result of the unverified data set and the at least one verification result include a verification failure result, a verification failure data set is obtained from the at least one data set and migratable data is obtained based on the at least one data set and the verification failure data set.

[0115] In some embodiments, when the processor implements the acquiring of the migratable data according to the upload time and the verification start time based on the at least one verification result and the at least one data set, the processor is further configured to specifically implement the following steps:

[0116] When the last moment of the verification start moment is later than the last moment of the upload moment, the at least one data set is determined to be a verified data set; based on the at least one verification result record, migratable data is obtained according to the at least one data set.

[0117] In some embodiments, the processor may also implement the data migration method according to the following specific steps:

[0118] The data in the temporary database are verified at the verification start time respectively, and at least one verification initial record corresponding to at least one data set is generated, the temporary database includes the at least one data set, and the at least one verification initial record is used to obtain at least one verification result record; the at least one verification result record is provided to the data migration platform, so that the data migration platform obtains migratable data according to the at least one verification result record, and migrates the migratable data from the temporary database to the business database.

[0119] In some embodiments, the processor is further used to implement: when the at least one initial verification record includes a failed verification record, determining a failed verification data set from the at least one data set; obtaining a corrected data set based on the failed verification data set, and generating an initial verification record for the corrected data set; when the initial verification record of the corrected data set is a passed verification result, determining the initial verification record of the corrected data set as the verification result record of the failed verification data set; and obtaining the at least one verification result record based on the verification result record of the unverified data set.

[0120] A computer-readable storage medium is also provided in an embodiment of the present application. The computer-readable storage medium stores a computer program. The computer program includes program instructions. The processor executes the program instructions to implement any data migration method provided in the embodiment of the present application.

[0121] The computer-readable storage medium may be an internal storage unit of the computer device described in the above embodiment, such as a hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the computer device.

[0122] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A data migration method based on a data migration system, characterized in that: The data migration system includes a data acquisition platform, a data pre-verification platform, a temporary database, a data migration platform and a business database; applied to the data migration system, the data migration method includes: Acquire at least one data set in the temporary database, wherein the at least one data set is uploaded to the temporary database by the data acquisition platform at respective upload times; Verifying the data in the temporary database at the verification start time respectively, generating at least one verification initial record corresponding to at least one data set, wherein the at least one verification initial record is used to obtain at least one verification result record; Providing the at least one verification result record to the data migration platform; Based on the upload time and the verification start time, acquiring the migratable data according to the at least one data set and the at least one verification result record; Migrating the migratable data from the temporary database to the business database; The acquiring the migratable data based on the upload time and the verification start time and according to the at least one data set and the at least one verification result record includes: When the last moment of the verification start moment is earlier than the last moment of the upload moment, the data migration platform determines an unverified data set from the at least one data set according to the at least one verification result record; Based on the at least one data set and the at least one verification result record, the data migration platform obtains migratable data according to the unverified data set.

2. The data migration method according to claim 1, characterized in that: Based on the at least one data set and the at least one verification result record, the data migration platform obtains the migratable data according to the unverified data set, including: When the data migration platform determines that the verification result of the unverified data set and the at least one verification result are both verification passing results, the data migration platform determines that the at least one data set is migratable data; When the data migration platform determines that there is a verification failure result among the verification results of the unverified data set and the at least one verification result, the data migration platform obtains a verification failed data set from the at least one data set and obtains migratable data based on the at least one data set and the verification failed data set.

3. The data migration method according to claim 1, characterized in that: The acquiring the migratable data based on the upload time and the verification start time and according to the at least one data set and the at least one verification result record includes: When the last moment of the verification start moment is later than the last moment of the upload moment, the data migration platform determines that the at least one data set is a verified data set; Based on the at least one verification result record, the data migration platform obtains migratable data according to the at least one data set.

4. The data migration method according to claim 1, characterized in that: The method further comprises: When the at least one verification initial record includes a record that failed the verification, determining a data set that failed the verification from the at least one data set; Acquire a correction data set according to the data set that failed the verification, and generate an initial verification record of the correction data set; When the verification initial record of the corrected data set is a verification result that passes verification, the verification initial record of the corrected data set is determined as the verification result record corresponding to the verification failure record.

5. The data migration method according to claim 1, characterized in that: The method further comprises: When the at least one initial verification record is a passed verification record, determining the at least one data set as a passed verification data set; The verification initial record of the verified data set is determined as the verification result record.

6. A data migration system, characterized in that: The data migration system includes a data acquisition platform, a data pre-verification platform, a temporary database, a data migration platform and a business database, wherein the data migration system is used to execute the data migration method according to any one of claims 1 to 5.

7. A computer device, characterized in that: The computer device includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the data migration method according to any one of claims 1 to 5 when executing the computer program.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the data migration method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Data synchronization method, device and equipment and readable storage medium

    CN111522798A

  • Data migration integrity checking method, device and equipment and computer readable medium

    CN112231271A