Data migration methods, apparatus, devices, and readable media for heterogeneous databases

Abstract

This disclosure discloses a data migration method, apparatus, device, and readable medium for heterogeneous databases. One specific implementation of the method includes: first, determining whether an empty string exists in a migration table; then, in response to determining the existence of an empty string in the migration table, scanning the table information in the migration table containing the empty string within a development framework; subsequently, correcting the processing keywords containing empty strings in the scanned migration table to target empty character keywords; and finally, migrating the heterogeneous migration data based on the corrected target empty character keywords. The embodiments of this disclosure solve the problem of empty string differences in heterogeneous environments, reduce production line failure rates, and maximize data consistency and integrity.

Description

Technical Field

[0001] The embodiments disclosed herein relate to the field of data migration technology, and more specifically to data migration methods, apparatus, devices, and readable media for heterogeneous databases. Background Technology

[0002] With the advancement of software and hardware technologies, various databases have emerged. However, these databases exhibit numerous differences, posing significant challenges for users. The implementation of different database access interfaces, the invocation of SQL statements, the calling of underlying database functions, and the unique characteristics of different keywords and data types within different databases all contribute to the complexity of handling these differences for developers. As the number of application modules increases, a change in a single database interface necessitates modifications to an additional number of application modules. Furthermore, with the continuous development and updates of domestically developed and controllable databases, not only are new domestically developed and controllable databases constantly emerging, but existing database versions also undergo frequent iterations. Data migration between different databases, as well as between different versions of the same database, presents many challenges and can even lead to migration failures. For a single machine to successfully migrate data between different databases, it must simultaneously support multiple different databases.

[0003] During heterogeneous database migration, inconsistencies in how two different databases handle empty strings frequently lead to application-level issues and ultimately production line failures. For example, Oracle stores an empty string as null, while MySQL stores it as "". In such cases, after the application completes the heterogeneous database migration, production line data anomalies cause business failures. Summary of the Invention

[0004] The summary section of this disclosure provides a brief overview of concepts that will be described in detail in the subsequent detailed description section. This summary section is not intended to identify key or essential features of the claimed technical solutions, nor is it intended to limit the scope of the claimed technical solutions. Some embodiments of this disclosure propose data migration methods, apparatuses, devices, and readable media for heterogeneous databases to address the technical problems mentioned in the background section above.

[0005] In a first aspect, some embodiments of this disclosure provide a data migration method for heterogeneous databases, the method comprising: determining whether an empty string exists in the migration table;

[0006] In response to determining that an empty string exists in the migration table, the table information in the migration table containing the empty string is scanned in the development framework;

[0007] Correct any empty strings in the scanned migration table to the target empty string keyword;

[0008] Based on the corrected target empty character keywords, heterogeneous migration data is migrated.

[0009] Secondly, some embodiments of this disclosure provide a data migration apparatus for heterogeneous databases, the apparatus including: a determining unit, used to determine whether an empty string exists in the migration table;

[0010] A scanning unit is used to scan the table information of the migration table containing the empty string in the development framework in response to determining that an empty string exists in the migration table;

[0011] The correction unit is used to correct the processing keywords that contain empty strings in the scanned migration table to the target empty character keywords;

[0012] The migration unit is used to migrate heterogeneous migration data based on the corrected target empty character keyword.

[0013] Thirdly, some embodiments of this disclosure provide an electronic device, including:

[0014] Memory is used to store executable instructions;

[0015] A processor, configured to operate the electronic device according to the instructions to implement any of the methods described in the first aspect.

[0016] Fourthly, some embodiments of this disclosure provide a computer-readable medium having a computer program stored thereon, wherein the program, when executed by a processor, implements any of the methods in the first aspect.

[0017] One embodiment of the above-described embodiments of this disclosure has the following beneficial effects: First, it is determined whether an empty string exists in the migration table; then, in response to determining that an empty string exists in the migration table, the table information in the migration table containing the empty string is scanned in the development framework; subsequently, the processing keywords containing empty strings in the scanned migration table are corrected to target empty character keywords; finally, based on the corrected target empty character keywords, heterogeneous migration data is migrated. The embodiments of this disclosure solve the problem of empty string differences in heterogeneous situations, reduce production line failure rates, and maximize data consistency and integrity. Attached Figure Description

[0018] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0019] Figure 1 This is a flowchart of some embodiments of the data migration method under heterogeneous databases according to this disclosure;

[0020] Figure 2 These are schematic diagrams illustrating application scenarios of other embodiments of the data migration method for heterogeneous databases according to this disclosure;

[0021] Figure 3 This is a schematic diagram of the structure of some embodiments of a data migration apparatus for heterogeneous databases according to the present disclosure;

[0022] Figure 4 This is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. Detailed Implementation

[0023] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0024] It should also be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings. Unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.

[0025] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0026] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0027] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0028] This disclosure will now be described in detail with reference to the accompanying drawings and embodiments.

[0029] Figure 1 This is a flowchart illustrating some embodiments of the data migration method for heterogeneous databases according to this disclosure. The aforementioned data migration method for heterogeneous databases includes the following steps:

[0030] Step 101: Determine if an empty string exists in the migration table.

[0031] In some embodiments, the execution entity of the data migration method under heterogeneous databases (e.g., a server) can determine whether an empty string exists in the migration table. The migration table is pre-generated. The information in the migration table is an association between an empty string and table information. The heterogeneous database is a collection of multiple related database systems, enabling data sharing and transparent access. Several database systems already existed before being added to the heterogeneous database system, each with its own database management system. Each component of the external database has its own autonomy, achieving data sharing while maintaining its own application characteristics, integrity controls, and security controls. The empty string is a unique string with no characters on the alphabet Σ, denoted as ε or λ. The length of the empty string is 0. The empty string occupies one byte in memory.

[0032] In some optional implementations of certain embodiments, before scanning the table information in the migration table containing the empty string in the development framework in response to determining that an empty string exists in the migration table, the method further includes: scanning for empty strings in the heterogeneous migration data; and in response to the existence of an empty string in the heterogeneous migration data, associating the scanned empty string with table information to obtain the migration table. The empty string scanning is performed early in the migration process, and the table information is associated with the scanned empty string.

[0033] In some optional implementations of some embodiments, after scanning for empty strings in the heterogeneous migration data, the method further includes: migrating the heterogeneous migration data in response to the absence of empty strings in the heterogeneous migration data.

[0034] Step 102: In response to determining that an empty string exists in the migration table, the table information in the migration table containing the empty string is scanned in the development framework.

[0035] In some embodiments, the execution entity may, in response to determining that an empty string exists in the migration table, scan the table information in the migration table containing the empty string within the development framework. The development framework may be MyBatis, a Java-based persistence framework that supports customized SQL (Structured Query Language), stored procedures, and advanced mappings. MyBatis avoids almost all JDBC (Java Database Connectivity) code and manual parameter setting and result set retrieval. The table information may be the information corresponding to the empty string in the migration table.

[0036] Step 103: Correct the processing keywords containing empty strings in the scanned migration table to the target empty character keywords.

[0037] In some embodiments, the execution entity can correct the processing keywords containing empty strings in the scanned migration table to the target empty character keyword. Based on the table information where the empty string is located, the MyBatis file is scanned, and all operations involving empty characters are uniformly corrected to the `empty` MyBatis keyword.

[0038] As an example, MyBatis corrects all instances of (null) in the string blank (null, empty) to (empty).

[0039] Step 104: Migrate the heterogeneous migration data based on the corrected target empty character keyword.

[0040] In some embodiments, the aforementioned execution entity may migrate heterogeneous migration data based on the corrected target empty character keyword.

[0041] This disclosure provides a data migration method for heterogeneous databases. First, it determines whether an empty string exists in the migration table. Then, in response to the determination of an empty string, it scans the table information in the migration table containing the empty string within a development framework. Next, it corrects the processing keywords containing empty strings in the scanned migration table to target empty string keywords. Finally, based on the corrected target empty string keywords, it migrates the heterogeneous data. This disclosure solves the problem of empty string differences in heterogeneous environments, reduces production line failure rates, and maximizes data consistency and integrity.

[0042] Further reference Figure 2This is a flowchart of some other embodiments of the data migration method for heterogeneous databases according to this disclosure. The above-described data migration method for heterogeneous databases includes the following steps:

[0043] Step 201: Determine if an empty string exists in the migration table.

[0044] Step 202: In response to determining that an empty string exists in the migration table, the table information in the migration table containing the empty string is scanned in the development framework.

[0045] Step 203: Correct the processing keywords containing empty strings in the scanned migration table to the target empty character keywords.

[0046] Step 204: Migrate the heterogeneous migration data based on the corrected target empty character keyword.

[0047] In some embodiments, the specific implementation of steps 201-204 and the resulting technical effects can be found in [reference]. Figure 2 Steps 101-104 in the corresponding embodiments will not be repeated here.

[0048] Step 205: In response to the completion of heterogeneous migration data migration in the heterogeneous database, a logical verification is performed to compare empty strings in the heterogeneous migration data.

[0049] In some embodiments, the execution entity of the data migration method under a heterogeneous database may, in response to the completion of heterogeneous data migration in the heterogeneous database, perform a logical check by comparing empty strings in the heterogeneous migration data. After the heterogeneous data migration is completed, a logical check by comparing empty strings is performed before the application is migrated to the new database. For example, "Select count(*) from table where xxx='';

[0050] And Select count(*)from table where is null;".

[0051] In some optional implementations of certain embodiments, an empty string in the heterogeneous migration data is compared with an empty string in the heterogeneous migration data after the migration is completed, to obtain a comparison result; that is, to determine whether the empty strings in the two heterogeneous databases are consistent. In response to the comparison result indicating that the empty string in the heterogeneous migration data is consistent with the empty string in the heterogeneous migration data after the migration is completed, the verification passes.

[0052] In some optional implementations of some embodiments, the verification fails in response to the comparison result indicating that the empty string in the heterogeneous migration data is inconsistent with the empty string in the heterogeneous migration data after the heterogeneous migration data is completed.

[0053] In some optional implementations of certain embodiments, in response to a failed verification, a message indicating that the heterogeneous migration of data has failed is generated and sent to the terminal device. This message may be used to inform the user of the verification failure, or it may indicate the position of an empty string that differs from the corresponding empty string.

[0054] Step 206: In response to the successful verification, the migrated heterogeneous migration data is migrated to the target database.

[0055] In some embodiments, the execution entity may, in response to successful verification, migrate the migrated heterogeneous migration data to a target database. The target database is a heterogeneous database different from the heterogeneous database containing the migrated heterogeneous data.

[0056] This disclosure provides a data migration method for heterogeneous databases. First, it determines whether an empty string exists in the migration table. Second, in response to the determination of an empty string, it scans the table information in the migration table containing the empty string within a development framework. Third, it corrects the processing keywords containing empty strings in the scanned migration table to target empty string keywords. Then, based on the corrected target empty string keywords, it migrates the heterogeneous migration data. Afterward, in response to the completion of the heterogeneous migration data migration in the heterogeneous database, it performs a logical verification by comparing the empty strings in the heterogeneous migration data. Finally, in response to successful verification, it migrates the migrated heterogeneous migration data to the target database. This disclosure solves the problem of empty string differences in heterogeneous environments from scanning to repair to verification, reducing production line failure rates and maximizing data consistency and integrity.

[0057] Further reference Figure 3 As an implementation of the methods shown in the above figures, this disclosure provides some embodiments of a data migration device for heterogeneous databases. These device embodiments are similar to... Figure 1 Corresponding to the method embodiments shown, the device can be specifically applied to various electronic devices.

[0058] like Figure 3As shown, a data migration device 300 for heterogeneous databases in some embodiments includes: a determining unit 301, a scanning unit 302, a correcting unit 303, and a migration unit 304. The determining unit 301 is used to determine whether an empty string exists in the migration table; the scanning unit 302 is used to scan the table information in the migration table containing the empty string in the development framework in response to determining that an empty string exists in the migration table; the correcting unit 303 is used to correct the processing keywords containing empty strings in the scanned migration table to target empty character keywords; and the migration unit 304 is used to migrate the heterogeneous migration data based on the corrected target empty character keywords.

[0059] Some embodiments of this disclosure disclose a data migration apparatus for heterogeneous databases. First, it determines whether an empty string exists in the migration table. Then, in response to the determination that an empty string exists in the migration table, it scans the table information in the migration table containing the empty string within a development framework. Next, it corrects the processing keywords containing empty strings in the scanned migration table to target empty character keywords. Finally, based on the corrected target empty character keywords, it migrates the heterogeneous data. The embodiments of this disclosure solve the problem of empty string differences in heterogeneous environments, reduce production line failure rates, and maximize data consistency and integrity.

[0060] In some optional implementations of the embodiments, before the scanning unit 302, the data migration device 300 under the heterogeneous database is further configured to: scan for empty strings in the heterogeneous migration data; in response to the presence of empty strings in the heterogeneous migration data, associate table information for the scanned empty strings to obtain the migration table.

[0061] In some optional implementations of the embodiments, after scanning for empty strings in the heterogeneous migration data, the data migration device 300 under the heterogeneous database is further configured to migrate the heterogeneous migration data in response to the absence of empty strings in the heterogeneous migration data.

[0062] In some optional implementations of embodiments, the data migration device 300 under the heterogeneous database is further configured to: in response to the completion of heterogeneous migration data migration in the heterogeneous database, perform logical verification by comparing empty strings in the heterogeneous migration data; in response to the verification passing, migrate the migrated heterogeneous migration data to the target database.

[0063] In some optional implementations of the embodiments, the data migration device 300 under the heterogeneous database is further configured to: compare the empty string in the heterogeneous migration data with the empty string in the heterogeneous migration data after the heterogeneous migration data is completed, and obtain a comparison result; in response to the comparison result indicating that the empty string in the heterogeneous migration data is consistent with the empty string in the heterogeneous migration data after the heterogeneous migration data is completed, the verification is passed.

[0064] In some optional implementations of embodiments, the data migration device 300 under the heterogeneous database is further configured to: in response to the comparison result indicating that the empty string in the heterogeneous migration data is inconsistent with the empty string in the heterogeneous migration data after the heterogeneous migration data is completed, the verification fails.

[0065] In some optional implementations of the embodiments, the data migration device 300 under the heterogeneous database is further configured to: generate a prompt message indicating that the heterogeneous migration data migration has failed in response to a verification failure, and send the prompt message to the terminal device.

[0066] It is understandable that the units described in the device 300 are related to the reference. Figure 1 The steps in the described method correspond accordingly. Therefore, the operations, features, and beneficial effects described above for the method also apply to the device 300 and the units contained therein, and will not be repeated here.

[0067] Corresponding to the above method embodiments, this embodiment also provides an electronic device, please refer to... Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure.

[0068] like Figure 4 As shown, the electronic device 400 may include a processor 420 and a memory 410, the memory 410 being used to store executable instructions; the processor 420 being used to operate the electronic device according to the instructions to perform a method according to any embodiment of the present disclosure.

[0069] In particular, according to some embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts.

[0070] It should be noted that, in some embodiments of this disclosure, the computer-readable medium described above may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In some embodiments of this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In some embodiments of this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0071] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0072] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device. The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: determine whether an empty string exists in a migration table; in response to determining that an empty string exists in the migration table, scan the table information in the migration table containing the empty string within a development framework; correct the processing keywords containing empty strings in the scanned migration table to target empty character keywords; and migrate heterogeneous migration data based on the corrected target empty character keywords.

[0073] Computer program code for performing operations of some embodiments of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0074] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0075] The units described in some embodiments of this disclosure can be implemented in software or hardware. The described units can also be housed in a processor; for example, a processor may be described as including a determining unit, a scanning unit, a correcting unit, and a migration unit. The names of these units do not necessarily limit the unit itself; for example, a determining unit may also be described as "a unit that determines whether an empty string exists in the migration table."

[0076] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0077] The above description is merely a selection of preferred embodiments of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in the embodiments of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described inventive concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features with similar functions disclosed in the embodiments of this disclosure.

Claims

1. A data migration method for heterogeneous databases, comprising: Determine if an empty string exists in the migration table; In response to determining that an empty string exists in the migration table, the table information in the migration table containing the empty string is scanned in the development framework; Correct any empty strings in the scanned migration table to the target empty string keyword; Based on the corrected target empty character keywords, heterogeneous migration data is migrated; In response to the completion of heterogeneous migration data migration in the heterogeneous database, a logical verification is performed to compare empty strings in the heterogeneous migration data. Upon successful verification, the migrated heterogeneous data is migrated to the target database. The logical verification that compares empty strings in the heterogeneous migration data in response to the completion of heterogeneous migration data in the heterogeneous database includes: The empty string in the heterogeneous migration data is compared with the empty string in the heterogeneous migration data after the migration is completed, and the comparison result is obtained. The verification passes if the comparison result indicates that the empty string in the heterogeneous migration data is consistent with the empty string in the heterogeneous migration data after the migration is completed.

2. The method of claim 1, wherein, Before scanning the table information of the migration table containing the empty string in the development framework in response to determining that an empty string exists in the migration table, the method further includes: Scan for empty strings in the heterogeneous migration data; In response to the presence of an empty string in the heterogeneous migration data, the migration table is obtained by associating the scanned empty string with the associated table information.

3. The method of claim 1, wherein, After scanning for empty strings in the heterogeneous migration data, the method further includes: In response to the absence of an empty string in the heterogeneous migration data, the heterogeneous migration data is migrated.

4. The method of claim 1, wherein, The method further includes: The verification fails because the comparison result indicates that the empty string in the heterogeneous migration data is inconsistent with the empty string in the heterogeneous migration data after the migration is completed.

5. The method according to claim 1, characterized in that, The method further includes; In response to the verification failure, a message indicating that the heterogeneous migration of data has failed is generated and sent to the terminal device.

6. A data migration device for heterogeneous databases, comprising: The determination unit is used to determine whether an empty string exists in the migration table; A scanning unit is used to scan the table information of the migration table containing the empty string in the development framework in response to determining that an empty string exists in the migration table; The correction unit is used to correct the processing keywords that contain empty strings in the scanned migration table to the target empty character keywords; The migration unit is used to migrate heterogeneous migration data based on the corrected target empty character keywords; The data migration device under the heterogeneous database is further configured to: in response to the completion of heterogeneous migration data migration in the heterogeneous database, perform logical verification by comparing empty strings in the heterogeneous migration data. Upon successful verification, the migrated heterogeneous data is migrated to the target database. The logical verification that compares empty strings in the heterogeneous migration data in response to the completion of heterogeneous migration data in the heterogeneous database includes: The empty string in the heterogeneous migration data is compared with the empty string in the heterogeneous migration data after the migration is completed, and the comparison result is obtained. The verification passes if the comparison result indicates that the empty string in the heterogeneous migration data is consistent with the empty string in the heterogeneous migration data after the migration is completed.

7. An electronic device, characterized in that, include: Memory is used to store executable instructions; A processor, configured to operate the electronic device according to the instructions to perform the method as described in any one of claims 1-5.

8. A computer-readable medium having a computer program stored thereon, wherein, When the program is executed by the processor, it implements the method as described in any one of claims 1-5.

Images