Data migration method, device, equipment and storage medium

Abstract

The present application relates to a data migration method, device, equipment and storage medium, and belongs to the technical field of big data resource scheduling. The data migration method is used in a data migration system, and the data migration system is provided with a source database, an intermediate database and a target database. The method comprises: extracting data from the source database by using a data pump, and performing a primary processing on the extracted data to obtain the target source data, and the primary processing includes data integration processing, data conversion processing or data calculation processing; calling a preset verification script to verify the target source data, and performing secondary processing on the target source data that meets the verification standard to obtain intermediate data, and the secondary processing includes: data merging processing, data association processing or data desensitization processing; storing the intermediate data in the target database. The data migration method provided in the present application can ensure the reliability of data migration.

Description

Technical Field

[0001] The present invention relates to the technical field of big data resource scheduling, and in particular to a data migration method, device, equipment and storage medium. Background Art

[0002] With the widespread application of databases and the continuous upgrading of enterprise business systems, in order to ensure the continuity and traceability of business data, enterprises need to migrate business data stored in old systems to and store them in new systems. Therefore, migrating data from one database to another has become a common database operation.

[0003] The existing data migration is to export the data in the source database directly to the target database. This migration method cannot guarantee the reliability of the migrated data. Summary of the invention

[0004] Based on this, it is necessary to provide a data migration method, device, equipment and storage medium to address the above technical problems, which can ensure the reliability of data migration.

[0005] In a first aspect, an embodiment of the present application provides a data migration method for use in a data migration system, wherein the data migration system is provided with a source database, an intermediate database, and a target database, and the method includes:

[0006] Use a data pump to extract data from the source database and process the extracted data once to obtain the target source data. The processing once includes data integration processing, data conversion processing or data calculation processing;

[0007] Call the preset verification script to verify the target source data, and perform secondary processing on the target source data that meets the verification standards to obtain intermediate data. The secondary processing includes: data merging, data association or data desensitization.

[0008] Store the intermediate data in the target database.

[0009] In one embodiment, a data pump is used to extract data from a source database, and the extracted data is processed once to obtain target source data, including:

[0010] Use a data pump to extract stock data from the source database and determine the data to be migrated from the stock data;

[0011] The data to be migrated is processed once to obtain the target source data.

[0012] In one embodiment, the data to be migrated is processed once to obtain target source data, including:

[0013] Store the data to be migrated into the preset table structure to obtain the target migration data;

[0014] The target migration data is processed once to obtain the target source data.

[0015] In one embodiment, calling a preset verification script to verify the target source data includes: calling a preset verification script to obtain key indicator information of the stock data and key indicator information in the target source data, and determining whether the key indicator information of the stock data is consistent with the key indicator information in the target source data, wherein the key indicator information includes: customer data, number of accounts, or number of operators;

[0016] If they are consistent, the target source data verification passes.

[0017] In one embodiment, before extracting data from the source database using the data pump, the method further includes: detecting whether the remaining storage space of the current device is greater than the storage space of the source database;

[0018] Correspondingly, use the data pump to extract data from the source database, including:

[0019] If the remaining storage space is larger than the storage space of the source database, a data pump is used to extract data from the source database.

[0020] In one embodiment, extracting data from a source database using a data pump includes:

[0021] Use the data pump to extract data from the source database and store the extracted data in the remaining storage space.

[0022] In one embodiment, the data format of the intermediate data is consistent with that of the target source data, and the data format includes: data type, data length and data coding.

[0023] According to a second aspect of an embodiment of the present application, a data migration device is provided, the device comprising:

[0024] The first processing module is used to extract data from the source database using a data pump and perform a primary processing on the extracted data to obtain target source data. The primary processing includes data integration processing, data conversion processing or data calculation processing;

[0025] The verification module is used to call the preset verification script to verify the target source data;

[0026] The second processing module is used to perform secondary processing on the target source data that meets the verification standard to obtain intermediate data. The secondary processing includes: data merging processing, data association processing or data desensitization processing;

[0027] The storage module is used to store the intermediate data in the target database.

[0028] In one embodiment, the first processing module is specifically used for:

[0029] Use a data pump to extract stock data from the source database and determine the data to be migrated from the stock data;

[0030] The data to be migrated is processed once to obtain the target source data.

[0031] In one embodiment, the first processing module is specifically used for:

[0032] Store the data to be migrated into the preset table structure to obtain the target migration data;

[0033] The target migration data is processed once to obtain the target source data.

[0034] In one embodiment, the verification module is specifically used to:

[0035] Call the preset verification script to obtain the key indicator information of the stock data and the key indicator information in the target source data, and determine whether the key indicator information of the stock data is consistent with the key indicator information in the target source data, where the key indicator information includes: customer data, number of accounts or number of operators.

[0036] If they are consistent, the target source data verification passes.

[0037] In one embodiment, the apparatus further comprises:

[0038] A detection module, used to detect whether the remaining storage space of the current device is greater than the storage space of the source database;

[0039] Correspondingly, the first processing module is specifically used for: if the remaining storage space is larger than the storage space of the source database, extracting data from the source database by using a data pump.

[0040] In one embodiment, the first processing module is specifically used for:

[0041] Use the data pump to extract data from the source database and store the extracted data in the remaining storage space.

[0042] In one embodiment, the data format of the intermediate data is consistent with that of the target source data, and the data format includes: data type, data length and data coding.

[0043] A third aspect of an embodiment of the present application further provides a computer device, characterized in that it includes a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, it implements the data migration method of the first aspect of the embodiment of the present application.

[0044] The fourth aspect of the embodiments of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the data migration method of the first aspect of the embodiments of the present application is implemented.

[0045] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0046] The data migration method provided in the embodiment of the present application uses a data pump to extract data from a database, and performs a primary processing on the extracted data to obtain target source data, wherein the primary processing includes data integration processing, data conversion processing or data calculation processing, calling a preset verification script, verifying the target metadata, and performing secondary processing on the target source data that meets the verification standard to obtain intermediate data, wherein the secondary processing includes: data merging processing, data association processing or data desensitization processing, and storing the intermediate data in the target database. The data migration method provided in the embodiment of the present application can verify the data during the data migration process, thereby ensuring the reliability of data migration. At the same time, the data migration method provided in the embodiment of the present application can process the extracted data and filter out the target data, thereby improving the migration and transmission efficiency of the data. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A flowchart of a data migration method provided in an embodiment of the present application;

[0048] Figure 2 A flowchart of a technical process for extracting data from a source database using a data pump and performing a processing on the extracted data to obtain target source data provided by an embodiment of the present application;

[0049] Figure 3 A flowchart of a technical process for processing the data to be migrated once to obtain target source data provided by an embodiment of the present application;

[0050] Figure 4 A flowchart of a data migration method provided in an embodiment of the present application;

[0051] Figure 5 A structural block diagram of a data migration device provided in an embodiment of the present application;

[0052] Figure 6 A schematic diagram of the internal structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0054] With the widespread application of databases and the continuous upgrading of enterprise business systems, in order to ensure the continuity and traceability of business data, enterprises need to migrate business data stored in old systems to and store them in new systems. Therefore, migrating data from one database to another has become a common database operation.

[0055] The existing data migration is to export the data in the source database directly to the target database. This migration method cannot guarantee the reliability of the migrated data.

[0056] Based on this, it is necessary to provide a data processing method to address the above technical issues and ensure the reliability of data migration.

[0057] The data migration method provided in the embodiment of the present application uses a data pump to extract data from a database, and performs a primary processing on the extracted data to obtain target source data, wherein the primary processing includes data integration processing, data conversion processing or data calculation processing, calling a preset verification script, verifying the target metadata, and performing secondary processing on the target source data that meets the verification standard to obtain intermediate data, wherein the secondary processing includes: data merging processing, data association processing or data desensitization processing, and storing the intermediate data in the target database. The data migration method provided in the embodiment of the present application can verify the data during the data migration process, thereby ensuring the reliability of the data migration.

[0058] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0059] Please refer to Figure 1 , which shows a data migration method provided by an embodiment of the present application, the data migration method is used in a data migration system, the data migration system is provided with a source database, an intermediate database and a target database, the method comprises the following steps:

[0060] Step 101: Use a data pump to extract data from a source database, and process the extracted data to obtain target source data.

[0061] Among them, the primary processing includes: data integration processing, data conversion processing or data calculation processing.

[0062] Step 102: Call a preset verification script to verify the target source data, and perform secondary processing on the target source data that meets the verification standard to obtain intermediate data.

[0063] Among them, secondary processing includes: data merging processing, data association processing or data desensitizing processing.

[0064] In practice, the preset verification script can be called to verify the target source data, and the target source data that meets the verification standards can be processed again to obtain intermediate data. By verifying the target source data, the accuracy of the data migration process can be guaranteed.

[0065] Step 103: Store the intermediate data in the target database.

[0066] In practical applications, the verified intermediate data is stored in the target database, thereby achieving data migration from the source database to the target database.

[0067] The data migration method provided in the embodiment of the present application uses a data pump to extract data from a database, and performs a primary processing on the extracted data to obtain target source data, wherein the primary processing includes data integration processing, data conversion processing or data calculation processing, calling a preset verification script, verifying the target metadata, and performing secondary processing on the target source data that meets the verification standard to obtain intermediate data, wherein the secondary processing includes: data merging processing, data association processing or data desensitization processing, and storing the intermediate data in the target database. The data migration method provided in the embodiment of the present application can verify the data during the data migration process, thereby ensuring the reliability of data migration. At the same time, the data migration method provided in the embodiment of the present application can process the extracted data and filter out the target data, thereby improving the migration and transmission efficiency of the data.

[0068] like Figure 2 As shown, the embodiment of the present application also provides a technical process of extracting data from a source database by using a data pump and processing the extracted data once to obtain target source data. The technical process includes the following steps:

[0069] Step 201: extract stock data from a source database using a data pump, and determine data to be migrated from the stock data.

[0070] Step 202: Process the data to be migrated to obtain target source data.

[0071] In practice, during the data migration process, you first need to extract the existing data from the source database, determine the data to be migrated in the extracted existing data based on the table name, delete invalid data, and then process the data to be migrated to obtain the target source data. By determining the data to be migrated from the extracted existing data, you can reduce the amount of data transmitted and improve data transmission efficiency.

[0072] like Figure 3 As shown, the embodiment of the present application also provides a technical process for processing the data to be migrated once to obtain the target source data, and the technical process includes the following steps:

[0073] Step 301: Store the data to be migrated in a preset table structure to obtain target migration data.

[0074] Step 302: Process the target migration data to obtain target source data.

[0075] Among them, the preset table structure can be set manually according to needs, and the application embodiment does not make any specific limitations on this.

[0076] In practice, the target migration data is obtained by storing the data to be migrated in a preset table structure, and the target migration data is processed once to obtain the target source data, so as to facilitate the subsequent further processing of the target source data and improve the data processing efficiency.

[0077] In one embodiment, calling a preset verification script to verify the target source data includes:

[0078] Call the preset verification script to obtain the key indicator information of the existing data and the key indicator information in the target source data, and determine whether the key indicator information of the existing data and the key indicator information in the target source data are consistent. If they are consistent, the target source data verification passes.

[0079] Among them, key indicator information includes: customer data, account data or number of operators.

[0080] In practical applications, by comparing the key indicator information in the existing data and the target source data, it is possible to determine whether there is data loss or data confusion during the data migration process, thereby ensuring the reliability of data migration.

[0081] In one embodiment, before extracting data from the source database using a data pump, the data migration method further includes:

[0082] Detect whether the remaining storage space of the current device is greater than the storage space of the source database; correspondingly, use the data pump to extract data from the source database, including: if the remaining storage space is greater than the storage space of the source database, use the data pump to extract data from the source database.

[0083] It should be noted that before extracting data, it should be determined whether the remaining storage space of the current device storing the source database is greater than the storage space of the source data. If the remaining storage space is greater than the storage space of the source database, the operation of extracting data from the database should be performed to avoid insufficient space.

[0084] In one embodiment, extracting data from a source database using a data pump includes:

[0085] Use the data pump to extract data from the source database and store the extracted data in the remaining storage space.

[0086] In actual applications, when the remaining storage space is larger than the storage space of the source database, the extracted data is stored in the remaining storage space.

[0087] In one embodiment, the data format of the intermediate data is consistent with that of the target source data.

[0088] Among them, the data format includes: data type, data length and data coding.

[0089] In actual applications, during data migration, in order to facilitate data verification, the data formats of intermediate data and target source data are made consistent during data processing.

[0090] like Figure 4 As shown, an embodiment of the present application further provides a data migration method, which is used in a data migration system, wherein a source database, an intermediate database, and a target database are provided in the data migration system, and the method comprises the following steps:

[0091] S401, detecting whether the remaining storage space of the current device is greater than the storage space of the source database;

[0092] S402: If the remaining storage space is larger than the storage space of the source database, extract data from the source database using a data pump.

[0093] S403, determining the data to be migrated from the stock data;

[0094] S404, storing the data to be migrated in a preset table structure to obtain target migration data;

[0095] S405: Process the target migration data to obtain target source data.

[0096] S406. Call a preset verification script to obtain key indicator information of the stock data and key indicator information in the target source data, and determine whether the key indicator information of the stock data is consistent with the key indicator information in the target source data. If they are consistent, the target source data verification passes.

[0097] S407, performing secondary processing on the target source data that meets the verification standard to obtain intermediate data;

[0098] S408: Store the intermediate data in the target database.

[0099] The data migration method provided in the embodiment of the present application uses a data pump to extract data from a database, and performs a primary processing on the extracted data to obtain target source data, wherein the primary processing includes data integration processing, data conversion processing or data calculation processing, calling a preset verification script, verifying the target metadata, and performing secondary processing on the target source data that meets the verification standard to obtain intermediate data, wherein the secondary processing includes: data merging processing, data association processing or data desensitization processing, and storing the intermediate data in the target database. The data migration method provided in the embodiment of the present application can verify the data during the data migration process, thereby ensuring the reliability of the data migration.

[0100] Please refer to Figure 5 , which shows a structural block diagram of a data migration device provided in an embodiment of the present application, the data migration device can be configured in a computer device, such as Figure 5 As shown, the data migration device includes:

[0101] The first processing module 51 is used to extract data from the source database using a data pump and perform a primary processing on the extracted data to obtain target source data. The primary processing includes data integration processing, data conversion processing or data calculation processing;

[0102] The verification module 52 is used to call a preset verification script to verify the target source data;

[0103] The second processing module 53 is used to perform secondary processing on the target source data that meets the verification standard to obtain intermediate data. The secondary processing includes: data merging processing, data association processing or data desensitization processing;

[0104] The storage module 54 is used to store the intermediate data in the target database.

[0105] In one embodiment, the first processing module 51 is specifically used to: extract stock data from the source database using a data pump, and determine the data to be migrated from the stock data; and process the data to be migrated to obtain target source data.

[0106] In one embodiment, the first processing module 51 is specifically used for: storing the data to be migrated in a preset table structure to obtain target migration data; and performing a processing on the target migration data to obtain target source data.

[0107] In one embodiment, the verification module 52 is specifically used to call a preset verification script, obtain key indicator information of the stock data and key indicator information in the target source data, and determine whether the key indicator information of the stock data and the key indicator information in the target source data are consistent, wherein the key indicator information includes: customer data, account number or operator number. If they are consistent, the target source data verification passes.

[0108] In one embodiment, the apparatus further comprises: a detection module 55, configured to detect whether the remaining storage space of the current device is greater than the storage space of the source database;

[0109] Correspondingly, the first processing module 51 is specifically configured to: if the remaining storage space is larger than the storage space of the source database, extract data from the source database using a data pump.

[0110] In one embodiment, the first processing module 51 is specifically used to extract data from the source database using a data pump, and store the extracted data in the remaining storage space.

[0111] In one embodiment, the data format of the intermediate data is consistent with that of the target source data, and the data format includes: data type, data length and data coding.

[0112] The data migration device provided in the embodiment of the present application can implement the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0113] For the specific definition of the data migration device, please refer to the definition of the data migration method above, which will not be repeated here. Each module in the above-mentioned data migration device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor of the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the computer device can call and execute the operations corresponding to the above modules.

[0114] Figure 6 The internal structure diagram of a computer device provided in an embodiment of the present application is shown in FIG. Figure 6As shown, the computer device includes a processor and a memory connected via a system bus. The processor is used to provide computing and control capabilities to support the operation of the entire terminal. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by the processor to implement a data processing method provided in each of the above embodiments. The internal memory provides a cache operating environment for the operating system and computer program in the non-volatile storage medium.

[0115] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0116] In one embodiment of the present application, a computer device is provided, the computer device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program:

[0117] Use a data pump to extract data from the source database, and perform a primary processing on the extracted data to obtain the target source data. The primary processing includes data integration processing, data conversion processing, or data calculation processing; call the preset verification script to verify the target source data, and perform a secondary processing on the target source data that meets the verification standards to obtain intermediate data. The secondary processing includes: data merging processing, data association processing, or data desensitization processing; store the intermediate data in the target database.

[0118] In one embodiment, the processor implements the following steps when executing the computer program: extracting stock data from the source database using a data pump, and determining the data to be migrated from the stock data; and processing the data to be migrated to obtain target source data.

[0119] In one embodiment, the processor implements the following steps when executing the computer program: storing the data to be migrated in a preset table structure to obtain target migration data; and processing the target migration data once to obtain target source data.

[0120] In one embodiment, the processor implements the following steps when executing a computer program: calling a preset verification script, obtaining key indicator information of the existing data and key indicator information in the target source data, and determining whether the key indicator information of the existing data and the key indicator information in the target source data are consistent, wherein the key indicator information includes: customer data, number of accounts or number of operators; if they are consistent, the target source data verification passes.

[0121] In one embodiment, the processor implements the following steps when executing the computer program: detecting whether the remaining storage space of the current device is larger than the storage space of the source database; correspondingly, extracting data from the source database using a data pump, including: if the remaining storage space is larger than the storage space of the source database, extracting data from the source database using a data pump.

[0122] In one embodiment, the processor implements the following steps when executing the computer program: extracting data from the source database using a data pump, and storing the extracted data in the remaining storage space.

[0123] In one embodiment, the processor implements the following steps when executing the computer program: the data format of the intermediate data is consistent with that of the target source data, and the data format includes: data type, data length and data coding.

[0124] The implementation principle and technical effects of the computer device provided in this embodiment are similar to those of the above method embodiments, and will not be repeated here.

[0125] In one embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented: using a data pump to extract data from a source database, and performing a primary processing on the extracted data to obtain target source data, the primary processing includes data integration processing, data conversion processing or data calculation processing; calling a preset verification script to verify the target source data, and performing a secondary processing on the target source data that meets the verification criteria to obtain intermediate data, the secondary processing includes: data merging processing, data association processing or data desensitization processing; storing the intermediate data in the target database.

[0126] In one embodiment, the computer program implements the following steps when executed by a processor: extracting stock data from a source database using a data pump, and determining data to be migrated from the stock data; and processing the data to be migrated to obtain target source data.

[0127] In one embodiment, when the computer program is executed by a processor, the following steps are implemented: storing the data to be migrated in a preset table structure to obtain target migration data; and processing the target migration data once to obtain target source data.

[0128] In one embodiment, when the computer program is executed by a processor, the following steps are implemented: calling a preset verification script, obtaining key indicator information of the existing data and key indicator information in the target source data, and determining whether the key indicator information of the existing data and the key indicator information in the target source data are consistent, wherein the key indicator information includes: customer data, number of accounts or number of operators; if they are consistent, the target source data verification passes.

[0129] In one embodiment, when the computer program is executed by a processor, the following steps are implemented: detecting whether the remaining storage space of the current device is larger than the storage space of the source database; correspondingly, extracting data from the source database using a data pump, including: if the remaining storage space is larger than the storage space of the source database, extracting data from the source database using a data pump.

[0130] In one embodiment, when the computer program is executed by a processor, the following steps are implemented: extracting data from a source database using a data pump, and storing the extracted data in the remaining storage space.

[0131] In one embodiment, the computer program implements the following steps when executed by a processor: the data format of the intermediate data is consistent with that of the target source data, and the data format includes: data type, data length and data coding.

[0132] The computer-readable storage medium provided in this embodiment has similar implementation principles and technical effects to those of the above method embodiments, and will not be described in detail here.

[0133] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in M ​​forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (SyMchliMk) DRAM (SLDRAM), memory bus (RaMbus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0134] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0135] The above embodiments only express several implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for those of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A data migration method, It is characterized in that Used in a data migration system, the data migration system is provided with a source database, an intermediate database and a target database, the method comprising: Extracting stock data from the source database using a data pump, and determining data to be migrated from the stock data; storing the data to be migrated in a preset table structure to obtain target migration data; performing a primary processing on the target migration data to obtain target source data; the primary processing includes data integration processing, data conversion processing or data calculation processing; Calling a preset verification script to obtain key indicator information of the stock data and key indicator information in the target source data, and determining whether the key indicator information of the stock data and the key indicator information in the target source data are consistent, wherein the key indicator information includes: customer data, number of accounts or number of operators; if they are consistent, the target source data passes verification; Perform secondary processing on the target source data that meets the verification standard to obtain intermediate data, wherein the secondary processing includes: data merging processing, data association processing or data desensitization processing; The intermediate data is stored in the target database.

2. The method according to claim 1, It is characterized in that Before extracting data from the source database using a data pump, the method further includes: Detecting whether the remaining storage space of the current device is greater than the storage space of the source database; Correspondingly, the extracting data from the source database by using a data pump includes: If the remaining storage space is larger than the storage space of the source database, a data pump is used to extract data from the source database.

3. The method according to claim 2, It is characterized in that The extracting data from the source database by using a data pump comprises: A data pump is used to extract data from the source database, and the extracted data is stored in the remaining storage space.

4. The method according to claim 1, It is characterized in that The intermediate data has a data format consistent with that of the target source data, and the data format includes: data type, data length and data coding.

5. A data migration device, It is characterized in that The device comprises: The first processing module is used to extract stock data from the source database by using a data pump, and determine the data to be migrated from the stock data; store the data to be migrated in a preset table structure to obtain target migration data; perform a primary processing on the target migration data to obtain target source data; the primary processing includes data integration processing, data conversion processing or data calculation processing; A verification module is used to call a preset verification script, obtain key indicator information of the stock data and key indicator information in the target source data, and determine whether the key indicator information of the stock data and the key indicator information in the target source data are consistent, wherein the key indicator information includes: customer data, account number or operator number; if they are consistent, the target source data passes the verification; The second processing module is used to perform secondary processing on the target source data that meets the verification standard to obtain intermediate data, wherein the secondary processing includes: data merging processing, data association processing or data desensitization processing; The storage module is used to store the intermediate data in a target database.

6. The device according to claim 5, It is characterized in that The device also includes: A detection module, used to detect whether the remaining storage space of the current device is greater than the storage space of the source database; Correspondingly, the first processing module is specifically configured to: if the remaining storage space is larger than the storage space of the source database, extract data from the source database using a data pump.

7. The device according to claim 6, It is characterized in that The first processing module is specifically used for: A data pump is used to extract data from the source database, and the extracted data is stored in the remaining storage space.

8. The device according to claim 5, It is characterized in that The intermediate data has a data format consistent with that of the target source data, and the data format includes: data type, data length and data coding.

9. A computer device, It is characterized in that The method comprises a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the data migration method according to any one of claims 1 to 4 is implemented.

10. A computer-readable storage medium, It is characterized in that A computer program is stored thereon, and when the computer program is executed by a processor, the data migration method as described in any one of claims 1 to 4 is implemented.

Images