Data migration method and system

By combining application and data mapping based on library table mapping, and splitting processing logic for batch processing, the data migration uncertainty caused by large differences between new and old systems is solved, and the smooth data migration requirements of the target system are achieved.

CN113010489BActive Publication Date: 2025-03-21CHINA CONSTRUCTION BANK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110189236.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-02-19
Publication Date
2025-03-21
Estimated Expiration
2041-02-19

AI Technical Summary

Technical Problem

The old and new systems have great differences, resulting in great uncertainty when using traditional library table mapping methods for data migration, and the data cannot be mapped directly to the new system.

Method used

By combining application and data mapping without based on library table mapping, data is divided into static data and dynamic data, and batch processing is realized to complete data migration by splitting the processing logic of the target system.

Benefits of technology

It effectively adapts to the data migration problems caused by excessive differences between new and old systems, realizes smooth data migration, and meets the data migration needs of the target system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113010489B_ABST
    Figure CN113010489B_ABST
Patent Text Reader

Abstract

The present invention discloses a data migration method and system, wherein the method comprises: obtaining data information of a source system; obtaining a target system; analyzing the target system, dividing the data information into first static data and first dynamic data; mapping the first static data to the target system, obtaining second static data; splitting the processing logic of the target system, obtaining multiple sub-processing logics; and batch processing the static data mapped to the target system through the multiple sub-processing logics according to the first dynamic data, obtaining second dynamic data, wherein the second dynamic data is the same data as the first dynamic data in the target system. The method solves the technical problem that the old and new systems in the prior art are very different, and there is great uncertainty in data migration by using the traditional library-table mapping method, resulting in the inability to directly map data to the new system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of database technology, and in particular to a data migration method and system. Background Art

[0002] At present, data migration is mainly carried out through library-table mapping, analyzing the mapping rules at the field level, and implementing migration by writing stored procedures. In local complex scenarios, some code blocks may be used to assist in implementation. The original library-table mapping data migration method is increasingly unable to meet current needs, which is mainly reflected in the replacement of old and new systems, including differences in business logic, modeling methods, and business drivers between new and old systems. Often, new systems have stronger and more flexible functions, and heterogeneous designs between systems are becoming more and more obvious. The more and more powerful the new functions of the target system are, the more obvious this problem is. The old data cannot be abandoned, and the new functions only support newly sent data. In this way, both the user experience and system implementation will be greatly reduced. The traditional library-table mapping data migration is becoming increasingly difficult to support similar scenarios, and a new set of solutions needs to be explored.

[0003] In the process of implementing the technical solution of the invention in the embodiment of the present application, the inventors of the present application found that the above technology has at least the following technical problems:

[0004] The new and old systems are very different. If the traditional library-table mapping method is used for data migration, there will be great uncertainty, resulting in the inability to directly map the data to the new system. Summary of the invention

[0005] The embodiments of the present application provide a data migration method and system to solve the technical problem that in the prior art, there are great differences between old and new systems. For example, there is great uncertainty in data migration using traditional library-table mapping, which leads to the inability to directly map data to the new system. The present application achieves the technical goal of meeting the data migration needs of the target system by combining application and data mapping without relying on library-table mapping.

[0006] The embodiment of the present application provides a data migration method, wherein the method includes: obtaining data information of a source system; obtaining a target system; analyzing the target system to divide the data information into first static data and first dynamic data; mapping the first static data to the target system to obtain second static data, wherein the second static data is the first static data migrated to the target system; splitting the processing logic of the target system to obtain multiple sub-processing logics; and according to the first dynamic data, batch processing the static data mapped to the target system by the multiple sub-processing logics to obtain second dynamic data, wherein the second dynamic data is the same data in the target system as the first dynamic data.

[0007] On the other hand, the present application also provides a data migration system, wherein the system includes: a first acquisition unit, the first acquisition unit is used to obtain data information of a source system; a second acquisition unit, the second acquisition unit is used to obtain a target system; a first analysis unit, the first analysis unit is used to analyze the target system and divide the data information into first static data and first dynamic data; a third acquisition unit, the third acquisition unit is used to map the first static data to the target system to obtain second static data, wherein the second static data is the first static data migrated to the target system; a fourth acquisition unit, the fourth acquisition unit is used to split the processing logic of the target system to obtain multiple sub-processing logics; a fifth acquisition unit, the fifth acquisition unit is used to batch process the static data mapped to the target system through the multiple sub-processing logics according to the first dynamic data to obtain second dynamic data, wherein the second dynamic data is the same data in the target system as the first dynamic data.

[0008] On the other hand, an embodiment of the present application also provides a data migration device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method described in the first aspect when executing the program.

[0009] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0010] Since the data migration work is completed by reusing the target system's application instead of traditional library-table mapping, and by splitting the target system processing logic into appropriate stages, and implementing the stage functions through batch processing, it is well adapted to the situation where the data migration cannot be mapped due to the large difference between the new and old systems, and achieves the technical purpose of meeting the target system's data migration needs by combining application and data mapping without library-table mapping.

[0011] The above description is an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, which can be implemented in accordance with the contents of the specification, and in order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 A schematic diagram of a data migration method according to an embodiment of the present application;

[0013] Figure 2 This is a structural diagram of a data migration system according to an embodiment of the present application;

[0014] Figure 3 It is a schematic diagram of the structure of an exemplary electronic device according to an embodiment of the present application.

[0015] Explanation of the reference numerals: first obtaining unit 11 , second obtaining unit 12 , first analyzing unit 13 , third obtaining unit 14 , fourth obtaining unit 15 , fifth obtaining unit 16 , bus 300 , receiver 301 , processor 302 , transmitter 303 , memory 304 , bus interface 305 . DETAILED DESCRIPTION

[0016] The embodiment of the present application solves the technical problem that the difference between the old and new systems in the prior art is very large, such as the large uncertainty caused by using the traditional library-table mapping method for data migration, which leads to the inability to directly map the data to the new system. The technical purpose of meeting the data migration requirements of the target system by combining the application program with the data mapping is achieved without being based on the library-table mapping. Below, the example embodiments of the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments of the present application, and it should be understood that the present application is not limited to the example embodiments described here.

[0017] Application Overview

[0018] At present, data migration is mainly carried out through library-table mapping, analyzing the mapping rules at the field level, and implementing migration by writing stored procedures. In relatively complex local scenarios, some code blocks may be used to assist in implementation. In the existing technology, there are still great differences between the new and old systems. For example, the use of traditional library-table mapping for data migration has great uncertainty, resulting in technical problems such as the inability to directly map data to the new system.

[0019] In response to the above technical problems, the overall idea of ​​the technical solution provided by this application is as follows:

[0020] The embodiment of the present application provides a data migration method, wherein the method includes: obtaining data information of a source system; obtaining a target system; analyzing the target system to divide the data information into first static data and first dynamic data; mapping the first static data to the target system to obtain second static data, wherein the second static data is the first static data migrated to the target system; splitting the processing logic of the target system to obtain multiple sub-processing logics; and according to the first dynamic data, batch processing the static data mapped to the target system by the multiple sub-processing logics to obtain second dynamic data, wherein the second dynamic data is the same data in the target system as the first dynamic data.

[0021] After introducing the basic principles of the present application, various non-limiting implementation methods of the present application will be specifically described below in conjunction with the drawings in the specification.

[0022] Embodiment 1

[0023] like Figure 1 As shown, an embodiment of the present application provides a data migration method, wherein the method includes:

[0024] Step S100: obtaining data information of the source system;

[0025] Specifically, data migration refers to the process of selecting, preparing, extracting and converting data, and permanently transferring data from one computer storage system to another. In addition, verifying the integrity of the migrated data and retiring the original old data storage are also considered part of the entire data migration process. The source system is the original system that needs to be migrated, and the original data information in the source system database is obtained, including transaction data information, cash flow data information, accounting data information and other original data information.

[0026] Step S200: obtaining a target system;

[0027] Specifically, the target system is a storage system for data migration and transmission. After the target system information is obtained, data analysis is performed on the target system.

[0028] Step S300: Analyze the target system and divide the data information into first static data and first dynamic data;

[0029] Furthermore, the target system is analyzed to divide the data information into first static data and first dynamic data. The embodiment S300 of the present application further includes:

[0030] Step S301: obtaining a predetermined division rule;

[0031] Step S302: Analyze the target system according to the predetermined division rule, and divide the data information into first static data and first dynamic data.

[0032] Specifically, in the embodiment of the present application, the migration is divided into four main steps: data import and preparation, data mapping and import, program operation and data production, verification and checking. The data information is analyzed, and the data information is divided into the first static data and the first dynamic data, and then the data import and preparation in the data migration are completed. Among them, the predetermined division rule is: the first static data is the pre-data that the application depends on for operation, such as parameter definition, historical inventory transaction data, inspection clauses in transaction management, etc.; the first dynamic data is data information generated by the application based on the first static data, such as transaction bookkeeping in transaction management, process instances in the process engine, signal nodes and other data information.

[0033] Step S400: Mapping the first static data to the target system to obtain second static data, wherein the second static data is the first static data migrated to the target system;

[0034] Furthermore, the first static data is mapped to the target system to obtain the second static data, and step S400 in the embodiment of the present application further includes:

[0035] Step S401a: constructing an association relationship between the target system and the source system;

[0036] Step S402a: According to the association relationship between the target system and the source system, the first static data is mapped to the target system to obtain second static data.

[0037] Specifically, the data mapping and importing process of the data migration in the embodiment of the present application includes the design and development of the first static data. The association relationship between the target system and the source system is established by building the intermediate table, and then the first static data is mapped into the target system, so as to prepare for the production of dynamic data. The intermediate table is an intermediate file generated during the data migration process. The mapping of the first static data is completed based on the intermediate table. Data migration includes three stages: data extraction, data conversion, and data loading. In these stages, the mapping is responsible for defining its guiding rules to complete the data migration.

[0038] Step S500: splitting the processing logic of the target system to obtain multiple sub-processing logics;

[0039] Specifically, the multiple sub-processing logics are obtained by simulating the normal operation process of the target system and splitting the normal process into multiple steps. For example, the logic of mapping cash flow data can be divided into multiple sub-processing logics such as obtaining data from IPFT, generating transaction decoding table data, generating state identification table data, original cash flow comparison, and original cash flow data replacement.

[0040] Step S600: According to the first dynamic data, the static data mapped to the target system are batch processed by the multiple sub-processing logics to obtain second dynamic data, where the second dynamic data is the same data as the first dynamic data in the target system.

[0041] Specifically, after obtaining multiple sub-processing logics, each step is triggered by batch processing, and then the first static data is batch processed based on the multiple sub-processing logics to obtain the second dynamic data, which is the result data after the first dynamic data is migrated and mapped.

[0042] Furthermore, the construction of the association relationship between the target system and the source system, step S401a of the embodiment of the present application further includes:

[0043] Step S401a1: obtaining intermediate table information;

[0044] Step S401a2: constructing an association relationship between the target system and the source system according to the intermediate table information.

[0045] Specifically, the intermediate table is used to construct a mapping relationship between the source system and the target system, and by obtaining the intermediate table information, the extraction and conversion of the first static data in the data migration process is achieved.

[0046] Furthermore, after mapping the first static data to the target system to obtain the second static data, step S400 in the embodiment of the present application further includes:

[0047] Step S401b: comparing the second static data with the first static data to determine whether there are omissions in the second static data relative to the first static data;

[0048] Step S402b: if the second static data is missing from the first static data, obtaining a first supplementary recording instruction;

[0049] Step S403b: According to the first supplementary recording instruction, the second static data is supplemented according to the first static data.

[0050] Specifically, after completing the first static migration, the second static data is verified. The verification after data migration is an inspection of the migration quality. At the same time, the result of data verification is also an important basis for judging whether the new system can be officially used. Through the respective query tools of the source system and the target system, the data of the same indicator is queried, and the final query results are compared to obtain the first supplementary recording instruction and supplement the second static data.

[0051] Further, according to the first dynamic data, the static data mapped to the target system is batch processed by the multiple sub-processing logics to obtain the second dynamic data. Step S600 of the embodiment of the present application also includes:

[0052] Step S601a: obtaining a first sub-processing logic, wherein the first sub-processing logic is one of the plurality of sub-processing logics;

[0053] Step S602a: performing batch processing on the static data mapped to the target system according to the first sub-processing logic to obtain first result data;

[0054] Step S603a: obtaining a second sub-processing logic, wherein the second sub-processing logic is one of the multiple sub-processing logics;

[0055] Step S604a: performing batch processing on the static data mapped to the target system according to the second sub-processing logic to obtain second result data;

[0056] Step S605a: Obtain the second dynamic data according to the first result data and the second result data.

[0057] Specifically, by simulating the normal operation process of the target system and splitting the normal process into multiple steps, the multiple sub-processing logics are obtained, and then the static data mapped to the target system are batch processed according to the first sub-processing logic and the second sub-processing logic respectively, so as to obtain the first result data and the second result data, and then the second dynamic data is obtained based on the first result data and the second result data.

[0058] Furthermore, before obtaining the second dynamic data according to the first result data and the second result data, step S605a of the embodiment of the present application further includes:

[0059] Step S605a1: obtaining a first predetermined inspection rule;

[0060] Step S605a2: judging whether the first result data complies with the first predetermined inspection rule according to the first predetermined inspection rule;

[0061] Step S605a3: If the first result data conforms to the first predetermined checking rule, the second dynamic data is obtained according to the first result data.

[0062] Specifically, after batch processing the static data mapped to the target system according to the multiple sub-processing logics, the first result data needs to be checked according to the first predetermined check rule. If the first predetermined check rule is met, the second dynamic data can be obtained according to the first result data. The indicators of post-migration data verification mainly include integrity check; consistency check; total-to-score balance check; record number check; and special sample data check.

[0063] Furthermore, according to the second sub-processing logic, batch processing is performed on the static data mapped to the target system to obtain second result data. Step S604a of the embodiment of the present application further includes:

[0064] Step S604a1: obtaining a second predetermined inspection rule, wherein the second predetermined inspection rule is different from the first predetermined inspection rule;

[0065] Step S604a2: judging whether the second result data complies with the second predetermined inspection rule according to the second predetermined inspection rule;

[0066] Step S604a3: If the second result data conforms to the second predetermined checking rule, obtain the second dynamic data according to the second result data.

[0067] Specifically, the second result data is verified according to the second predetermined check rules for the second result data, including integrity check, consistency check, total score balance check, record number check, and special sample data check. The second predetermined check rules are rules for post-migration data verification preset according to the second result data. If the second result information meets the second predetermined check rules, the second dynamic data can be obtained based on the second result information.

[0068] Furthermore, step S600 in the embodiment of the present application also includes:

[0069] Step S601b: obtaining a predetermined scheduling script;

[0070] Step S602b: According to the predetermined scheduling script and the first dynamic data, the static data mapped to the target system is automatically processed in batches through the multiple sub-processing logics to obtain second dynamic data.

[0071] Specifically, after the plurality of sub-processing logics are obtained, batch processing of the static data of the target system can be automatically completed through the predetermined scheduling script.

[0072] Furthermore, step S500 in the embodiment of the present application also includes:

[0073] Step S501: determining whether each sub-processing logic is a manual processing logic;

[0074] Step S502: if each of the sub-processing logics is a manual processing logic, obtaining a first conversion instruction;

[0075] Step S503: According to the first conversion instruction, the manual processing logic is converted into automatic processing logic.

[0076] Specifically, it is determined whether the sub-processing logic is manual logic, and the manual logic is converted into non-manual logic, namely, the automatic processing logic, so as to improve the accuracy and efficiency of data migration.

[0077] Furthermore, step S600 in the embodiment of the present application also includes:

[0078] Step S601c: obtaining a predetermined checking rule;

[0079] Step S602c: Check the second dynamic data and the second static data according to the predetermined checking rule.

[0080] Specifically, the migrated data is checked for integrity and correctness according to the predetermined check rules. The predetermined check rules include data format check, data length check, interval range check, null value and default value check, integrity check, and consistency check. By checking the second dynamic data and the second static data according to the predetermined check rules, the accuracy and integrity of the data migration are ensured.

[0081] Furthermore, step S601c of the embodiment of the present application further includes:

[0082] Step S601c1: Obtain business data and account data according to data attributes;

[0083] Step S601c2: Obtaining predetermined verification rules from the dimensions of the business data and the accounting data.

[0084] Specifically, the verification of the migrated data is divided into two dimensions: business data and accounting data, and different predetermined verification rules are formulated to verify the second static data and the second dynamic data.

[0085] Furthermore, step S602c of the embodiment of the present application further includes:

[0086] Step S602c1: Obtaining a verification report;

[0087] Step S602c2: storing the verification report.

[0088] Specifically, after verifying the migrated data, the verification report is generated and stored for subsequent review and verification.

[0089] In summary, the data migration method provided in the embodiment of the present application has the following technical effects:

[0090] Since the data migration work is completed by reusing the target system's application instead of traditional library-table mapping, and by splitting the target system processing logic into appropriate stages, and implementing the stage functions through batch processing, it is well adapted to the situation where the data migration cannot be mapped due to the large difference between the new and old systems, and achieves the technical purpose of meeting the target system's data migration needs by combining application and data mapping without library-table mapping.

[0091] Embodiment 2

[0092] Based on the same inventive concept as the data migration method in the aforementioned embodiment, the present invention also provides a data migration system, such as Figure 2 As shown, the system comprises:

[0093] A first obtaining unit 11, wherein the first obtaining unit 11 is used to obtain data information of a source system;

[0094] A second obtaining unit 12, wherein the second obtaining unit 12 is used to obtain a target system;

[0095] A first analyzing unit 13, the first analyzing unit 13 is used to analyze the target system and divide the data information into first static data and first dynamic data;

[0096] A third obtaining unit 14, the third obtaining unit 14 is used to map the first static data to the target system to obtain second static data, wherein the second static data is the first static data migrated to the target system;

[0097] A fourth obtaining unit 15, the fourth obtaining unit 15 is used to split the processing logic of the target system to obtain multiple sub-processing logics;

[0098] The fifth obtaining unit 16 is used to batch process the static data mapped to the target system through the multiple sub-processing logics according to the first dynamic data to obtain second dynamic data, where the second dynamic data is the same data as the first dynamic data in the target system.

[0099] Furthermore, the system also includes:

[0100] a sixth obtaining unit, the sixth obtaining unit being used to obtain a predetermined division rule;

[0101] The second analyzing unit is used to analyze the target system according to the predetermined division rule, and divide the data information into first static data and first dynamic data.

[0102] Furthermore, the system also includes:

[0103] A first construction unit, wherein the first construction unit is used to construct an association relationship between the target system and the source system;

[0104] A seventh obtaining unit is used to map the first static data to the target system according to the association relationship between the target system and the source system to obtain second static data.

[0105] Furthermore, the system also includes:

[0106] An eighth obtaining unit, the eighth obtaining unit is used to obtain intermediate table information;

[0107] A second construction unit, wherein the second construction unit is used to construct an association relationship between the target system and the source system according to the intermediate table information.

[0108] Furthermore, the system also includes:

[0109] a first judging unit, configured to compare the second static data with the first static data to judge whether the second static data has any omissions relative to the first static data;

[0110] a ninth obtaining unit, configured to obtain a first supplementary recording instruction if the second static data is missing from the first static data;

[0111] A first execution unit, wherein the first execution unit is configured to supplement the second static data according to the first supplement instruction and the first static data.

[0112] Furthermore, the system also includes:

[0113] a tenth obtaining unit, the tenth obtaining unit being configured to obtain a first sub-processing logic, wherein the first sub-processing logic is one of the plurality of sub-processing logics;

[0114] an eleventh obtaining unit, the eleventh obtaining unit being configured to perform batch processing on the static data mapped to the target system according to the first sub-processing logic to obtain first result data;

[0115] a twelfth obtaining unit, the twelfth obtaining unit being used to obtain a second sub-processing logic, wherein the second sub-processing logic is one of the plurality of sub-processing logics;

[0116] a thirteenth obtaining unit, the thirteenth obtaining unit being configured to perform batch processing on the static data mapped to the target system according to the second sub-processing logic to obtain second result data;

[0117] A fourteenth obtaining unit, the fourteenth obtaining unit is used to obtain the second dynamic data according to the first result data and the second result data.

[0118] Furthermore, the system also includes:

[0119] a fifteenth obtaining unit, the fifteenth obtaining unit being used to obtain a first predetermined checking rule;

[0120] a second judgment unit, the second judgment unit being used to judge whether the first result data complies with the first predetermined inspection rule according to the first predetermined inspection rule;

[0121] A sixteenth obtaining unit is configured to obtain the second dynamic data according to the first result data if the first result data meets the first predetermined checking rule.

[0122] Furthermore, the system also includes:

[0123] a seventeenth obtaining unit, the seventeenth obtaining unit being used to obtain a second predetermined inspection rule, wherein the second predetermined inspection rule is different from the first predetermined inspection rule;

[0124] a third judgment unit, the third judgment unit being used to judge whether the second result data complies with the second predetermined inspection rule according to the second predetermined inspection rule;

[0125] A seventeenth obtaining unit, the seventeenth obtaining unit is used to obtain the second dynamic data according to the second result data if the second result data meets the second predetermined checking rule.

[0126] Furthermore, the system also includes:

[0127] An eighteenth obtaining unit, the eighteenth obtaining unit is used to obtain a predetermined scheduling script;

[0128] A nineteenth obtaining unit is used to automatically perform batch processing on the static data mapped to the target system through the multiple sub-processing logics according to the predetermined scheduling script and the first dynamic data to obtain second dynamic data.

[0129] Furthermore, the system also includes:

[0130] a fourth judgment unit, the fourth judgment unit being used to judge whether each of the sub-processing logics is a manual processing logic;

[0131] a twentieth obtaining unit, the twentieth obtaining unit being used for obtaining a first conversion instruction if each of the sub-processing logics is a manual processing logic;

[0132] A second execution unit, wherein the second execution unit is used to convert the manual processing logic into an automatic processing logic according to the first conversion instruction.

[0133] Furthermore, the system also includes:

[0134] A twenty-first obtaining unit, the twenty-first obtaining unit is used to obtain a predetermined checking rule;

[0135] A third execution unit, the third execution unit is used to check the second dynamic data and the second static data according to the predetermined checking rule.

[0136] Furthermore, the system also includes:

[0137] A twenty-second obtaining unit, the twenty-second obtaining unit is used to obtain business data and account data according to data attributes;

[0138] The twenty-third obtaining unit is used to obtain predetermined checking rules from the dimensions of the business data and the accounting data.

[0139] Furthermore, the system also includes:

[0140] A twenty-fourth obtaining unit, the twenty-fourth obtaining unit is used to obtain a verification report;

[0141] A first storage unit, wherein the first storage unit is used to store the verification report.

[0142] The foregoing Figure 1 Various variations and specific examples of a data migration method in Example 1 are also applicable to a data migration system in this embodiment. Through the above detailed description of a data migration method, those skilled in the art can clearly understand a data migration system in this embodiment, so for the sake of brevity of the specification, it will not be described in detail here.

[0143] Exemplary Electronic Devices

[0144] Reference below Figure 3 To describe the electronic device of the embodiment of the present application.

[0145] Figure 3 The figure shows a schematic structural diagram of an electronic device according to an embodiment of the present application.

[0146] Based on the inventive concept of a data migration method in the aforementioned embodiment, the present invention further provides a data migration device, on which a computer program is stored, and when the program is executed by a processor, the steps of any method of the data migration method described above are implemented.

[0147] Among them, Figure 3 In the embodiment of the present invention, a bus architecture (represented by bus 300) is shown, which may include any number of interconnected buses and bridges, and bus 300 links together various circuits including one or more processors represented by processor 302 and memory represented by memory 304. Bus 300 may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. Bus interface 305 provides an interface between bus 300 and receiver 301 and transmitter 303. Receiver 301 and transmitter 303 may be the same element, namely a transceiver, which provides a unit for communicating with various other systems over a transmission medium.

[0148] The processor 302 is responsible for managing the bus 300 and general processing, while the memory 304 may be used to store data used by the processor 302 when performing operations.

[0149] The embodiment of the present application provides a data migration method, wherein the method includes: obtaining data information of a source system; obtaining a target system; analyzing the target system to divide the data information into first static data and first dynamic data; mapping the first static data to the target system to obtain second static data, wherein the second static data is the first static data migrated to the target system; splitting the processing logic of the target system to obtain multiple sub-processing logics; and according to the first dynamic data, batch processing the static data mapped to the target system by the multiple sub-processing logics to obtain second dynamic data, wherein the second dynamic data is the same data in the target system as the first dynamic data.

[0150] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0151] The present invention is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products of the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A system that specifies the functions of a box or multiple boxes.

[0152] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction system, which is implemented in the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0153] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps of the functions specified in a box or multiple boxes. Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they know the basic creative concept. Therefore, the attached claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0154] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A data migration method, wherein: The method comprises: Obtain data information from the source system; Obtain the target system; Analyze the target system and divide the data information into first static data and first dynamic data; Mapping the first static data to the target system to obtain second static data, wherein the second static data is the first static data migrated to the target system; Splitting the processing logic of the target system to obtain multiple sub-processing logics; According to the first dynamic data, the static data mapped to the target system are batch processed by the multiple sub-processing logics to obtain second dynamic data, where the second dynamic data is the same data as the first dynamic data in the target system; The analyzing the target system and dividing the data information into first static data and first dynamic data includes: Obtaining a predetermined division rule; Analyzing the target system according to the predetermined division rule, and dividing the data information into first static data and first dynamic data; The step of performing batch processing on the static data mapped to the target system by the plurality of sub-processing logics according to the first dynamic data to obtain the second dynamic data includes: Obtaining a first sub-processing logic, wherein the first sub-processing logic is one of the plurality of sub-processing logics; According to the first sub-processing logic, batch processing is performed on the static data mapped to the target system to obtain first result data; Obtaining a second sub-processing logic, wherein the second sub-processing logic is one of the plurality of sub-processing logics; According to the second sub-processing logic, batch processing is performed on the static data mapped to the target system to obtain second result data; The second dynamic data is obtained according to the first result data and the second result data.

2. The method of claim 1, wherein: Mapping the first static data to the target system to obtain second static data includes: Establishing an association relationship between the target system and the source system; According to the association relationship between the target system and the source system, the first static data is mapped to the target system to obtain second static data.

3. The method of claim 2, wherein: The step of constructing an association relationship between the target system and the source system includes: Get the intermediate table information; According to the intermediate table information, an association relationship between the target system and the source system is constructed.

4. The method of claim 1, wherein: After mapping the first static data to the target system to obtain the second static data, the method includes: Comparing the second static data with the first static data to determine whether the second static data has any omissions relative to the first static data; If the second static data is missing from the first static data, obtaining a first supplementary recording instruction; According to the first supplementary recording instruction, the second static data is supplemented according to the first static data.

5. The method of claim 1, wherein: Before obtaining the second dynamic data according to the first result data and the second result data, the method includes: obtaining a first predetermined inspection rule; According to the first predetermined inspection rule, determining whether the first result data complies with the first predetermined inspection rule; If the first result data meets the first predetermined checking rule, the second dynamic data is obtained according to the first result data.

6. The method of claim 5, wherein: The step of batch processing the static data mapped to the target system according to the second sub-processing logic to obtain second result data includes: Obtaining a second predetermined inspection rule, wherein the second predetermined inspection rule is different from the first predetermined inspection rule; According to the second predetermined inspection rule, determining whether the second result data complies with the second predetermined inspection rule; If the second result data meets the second predetermined checking rule, the second dynamic data is obtained according to the second result data.

7. The method of claim 1, wherein: The step of performing batch processing on the static data mapped to the target system by the plurality of sub-processing logics according to the first dynamic data to obtain the second dynamic data includes: Get the scheduled scheduling script; According to the predetermined scheduling script and the first dynamic data, the static data mapped to the target system is automatically processed in batches through the multiple sub-processing logics to obtain second dynamic data.

8. The method of claim 1, wherein: After splitting the processing logic of the target system to obtain multiple sub-processing logics, the method includes: Determining whether each of the sub-processing logics is a manual processing logic; If each of the sub-processing logics is a manual processing logic, obtaining a first conversion instruction; According to the first conversion instruction, the manual processing logic is converted into automatic processing logic.

9. The method of claim 1, wherein: After the static data mapped to the target system is batch processed by the plurality of sub-processing logics according to the first dynamic data to obtain the second dynamic data, the method includes: Obtaining predetermined verification rules; The second dynamic data and the second static data are checked according to the predetermined checking rule.

10. The method of claim 9, wherein: The obtaining of the predetermined checking rules includes: Obtain business data and accounting data based on data attributes; From the dimensions of the business data and the accounting data, predetermined verification rules are obtained.

11. The method of claim 9, wherein: After checking the second dynamic data and the second static data according to the predetermined checking rule, the method includes: Obtain verification report; The verification report is stored.

12. A data migration system, wherein: The system comprises: A first obtaining unit, wherein the first obtaining unit is used to obtain data information of a source system; a second obtaining unit, the second obtaining unit being used to obtain a target system; A first analyzing unit, the first analyzing unit is used to analyze the target system and divide the data information into first static data and first dynamic data; a third obtaining unit, configured to map the first static data to the target system to obtain second static data, wherein the second static data is the first static data migrated to the target system; A fourth obtaining unit, the fourth obtaining unit is used to split the processing logic of the target system to obtain multiple sub-processing logics; a fifth obtaining unit, configured to perform batch processing on the static data mapped to the target system respectively through the plurality of sub-processing logics according to the first dynamic data to obtain second dynamic data, wherein the second dynamic data is data in the target system that is the same as the first dynamic data; The analyzing the target system and dividing the data information into first static data and first dynamic data includes: Obtaining a predetermined division rule; Analyzing the target system according to the predetermined division rule, and dividing the data information into first static data and first dynamic data; The step of performing batch processing on the static data mapped to the target system by the plurality of sub-processing logics according to the first dynamic data to obtain the second dynamic data includes: Obtaining a first sub-processing logic, wherein the first sub-processing logic is one of the plurality of sub-processing logics; According to the first sub-processing logic, batch processing is performed on the static data mapped to the target system to obtain first result data; Obtaining a second sub-processing logic, wherein the second sub-processing logic is one of the plurality of sub-processing logics; According to the second sub-processing logic, batch processing is performed on the static data mapped to the target system to obtain second result data; The second dynamic data is obtained according to the first result data and the second result data.

13. A data migration device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the steps of the method according to any one of claims 1 to 11 are implemented.

Citation Information

Patent Citations

  • Data migration method and device

    CN107391231A

  • Distributed cache structure based on real-time dynamic migration mechanism

    CN110297783A