Data processing method, device, storage medium and equipment based on multiple data sources

Abstract

The present application discloses a data processing method, device, storage medium and equipment based on multiple data sources. When receiving a data operation instruction input by a user, the data operation instruction is parsed to obtain the intention of the data operation instruction. For each database, the data operation instruction is converted into a syntax according to the SQL syntax of the database to obtain an operation statement that can be recognized by the database. When the intention is to query data, delete data and modify data, each database is triggered to execute an operation statement that can be recognized by each database, and the execution result fed back by each database is received. Using the scheme shown in the present application, when the business system replaces the database, there is no need to customize the development of the new database, nor is there any need to migrate the data in the original database to the new database, thereby avoiding wasting a lot of time on database replacement and avoiding the phenomenon of data loss due to data migration.

Description

Technical Field

[0001] The present application relates to the field of data processing, and in particular to a data processing method, apparatus, storage medium and device based on multiple data sources. Background Art

[0002] The retirement management system is a comprehensive office system commonly used by major enterprises. It mainly includes functions such as retiree information management, activity management, health management, and statistical analysis, providing unified tool support and service means for retirement management business. At present, the data sources that can be used in the retirement management system are mainly divided into foreign databases and domestic databases. Foreign databases and domestic databases are different in data types and SQL syntax.

[0003] When the retirement management system needs to use a domestic database to replace the original foreign database, it takes a lot of time to customize the domestic database and migrate the data in the foreign database to the domestic database. In addition, the data migration process is not only time-consuming, but also prone to data loss during the data migration process.

[0004] Therefore, how to reduce the time consumed by database replacement and the amount of data loss has become an urgent problem to be solved in this field. Summary of the invention

[0005] The present application provides a data processing method, apparatus, storage medium and device based on multiple data sources, aiming to reduce the time consumed by database replacement and the amount of data loss.

[0006] In order to achieve the above objectives, this application provides the following technical solutions:

[0007] A data processing method based on multiple data sources, comprising:

[0008] Based on the pre-acquired configuration information of each database, establishing a data link with each of the databases;

[0009] When receiving a data operation instruction input by a user, parsing the data operation instruction to obtain the intention of the data operation instruction;

[0010] For each of the databases, the data operation instructions are converted into syntax according to the SQL syntax of the database to obtain an operation statement that can be recognized by the database;

[0011] In the case where the intention is to add new data, a database is selected from each of the databases as a target database, the target database is triggered to execute an operation statement that can be recognized by the target database, and an execution result fed back by the target database is received;

[0012] Displaying the execution result to the user through a preset interface;

[0013] In the case where the intention is any one of querying data, deleting data, and modifying data, triggering each of the databases to execute an operation statement that can be recognized by each of the databases, and receiving the execution result fed back by each of the databases;

[0014] The execution results fed back by each of the databases are integrated to obtain a target execution result, and the target execution result is displayed to the user through the preset interface.

[0015] Optionally, each of the databases includes a first database and a second database;

[0016] For each of the databases, the data operation instructions are converted into syntax according to the SQL syntax of the database to obtain operation statements that can be recognized by the database, including:

[0017] According to the SQL grammar of the first database, the data operation instruction is converted into a grammar to obtain a first operation statement that can be recognized by the first database;

[0018] According to the SQL grammar of the second database, the data operation instruction is converted into a grammar to obtain a second operation statement that can be recognized by the second database.

[0019] Optionally, when the intention is to add new data, selecting a database from each of the databases as a target database, triggering the target database to execute an operation statement recognizable by the target database, and receiving an execution result fed back by the target database, includes:

[0020] When the intention is to add new data, the second operation statement is sent to the second database, the second database is triggered to execute the second operation statement, and the execution result fed back by the second database is received.

[0021] Optionally, when the intention is any one of querying data, deleting data, and modifying data, triggering each of the databases to execute an operation statement recognizable by each of the databases, and receiving an execution result fed back by each of the databases, includes:

[0022] In a case where the intention is any one of querying data, deleting data, and modifying data, sending the first operation statement to the first database, triggering the first database to execute the first operation statement, and receiving a first execution result fed back by the first database;

[0023] Trigger the second database to execute the second operation statement, send the second operation statement to the second database, and receive a second execution result fed back by the second database.

[0024] Optionally, the data integration of the execution results fed back by each of the databases to obtain the target execution result includes:

[0025] The first execution result and the second execution result are integrated to obtain a target execution result.

[0026] A data processing device based on multiple data sources, comprising:

[0027] A data link unit, used to establish data links with each of the databases based on the configuration information of each database acquired in advance;

[0028] An intention parsing unit, configured to parse a data operation instruction input by a user to obtain the intention of the data operation instruction;

[0029] A syntax conversion unit, for performing syntax conversion on the data operation instruction for each of the databases according to the SQL syntax of the database, to obtain an operation statement that can be recognized by the database;

[0030] A first triggering unit is used to select a database from each of the databases as a target database when the intention is to add new data, trigger the target database to execute an operation statement that can be recognized by the target database, and receive an execution result fed back by the target database;

[0031] A first display unit, used to display the execution result to the user through a preset interface;

[0032] A second triggering unit is used to trigger each of the databases to execute an operation statement that can be recognized by each of the databases when the intention is to query data, delete data, and modify data, and receive an execution result fed back by each of the databases;

[0033] The data integration unit is used to integrate the execution results fed back by each of the databases to obtain a target execution result, and to display the target execution result to the user through the preset interface.

[0034] Optionally, each of the databases includes a first database and a second database;

[0035] The grammar conversion unit is specifically used for:

[0036] According to the SQL grammar of the first database, the data operation instruction is converted into a grammar to obtain a first operation statement that can be recognized by the first database;

[0037] According to the SQL grammar of the second database, the data operation instruction is converted into a grammar to obtain a second operation statement that can be recognized by the second database.

[0038] Optionally, the first triggering unit is specifically used to:

[0039] When the intention is to add new data, the second operation statement is sent to the second database, the second database is triggered to execute the second operation statement, and the execution result fed back by the second database is received.

[0040] A computer-readable storage medium includes a stored program, wherein the program executes the data processing method based on multiple data sources.

[0041] A data processing device based on multiple data sources, comprising: a processor, a memory and a bus; the processor and the memory are connected via the bus;

[0042] The memory is used to store programs, and the processor is used to run programs, wherein the data processing method based on multiple data sources is executed when the program is run.

[0043] The technical solution provided by the present application establishes a data link with each database based on the configuration information of each database obtained in advance. When receiving the data operation instruction input by the user, the data operation instruction is parsed to obtain the intention of the data operation instruction. For each database, the data operation instruction is converted into a syntax according to the SQL syntax of the database to obtain an operation statement that can be recognized by the database. When the intention is to add new data, a database is selected from each database as the target database, the target database is triggered to execute the operation statement that can be recognized by the target database, and the execution result fed back by the target database is received. The execution result is displayed to the user through a preset interface. When the intention is to query data, delete data, and modify data, each database is triggered to execute the operation statement that can be recognized by each database, and the execution result fed back by each database is received. The execution results fed back by each database are integrated to obtain the target execution result, and the target execution result is displayed to the user through a preset interface. By utilizing the solution shown in the present application, by performing syntax conversion on data operation instructions, operation statements that can be recognized by each database are obtained, so that the business system can adapt to each database. In this way, when the business system replaces the database, there is no need to customize the development of the new database, nor is there any need to migrate the data in the original database to the new database, thereby avoiding wasting a lot of time on database replacement and avoiding data loss due to data migration. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 A flowchart of a data processing method based on multiple data sources provided in an embodiment of the present application;

[0046] Figure 2 A flowchart of another data processing method based on multiple data sources provided in an embodiment of the present application;

[0047] Figure 3 A schematic diagram of the architecture of a data processing device based on multiple data sources provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0049] like Figure 1 As shown, it is a flowchart of a data processing method based on multiple data sources provided in an embodiment of the present application, which can be applied to a business system (such as a retirement system), and includes the following steps:

[0050] S101: Obtain database configuration information and SQL syntax.

[0051] Among them, the database includes a first database and a second database. In the embodiment of the present application, the second database is a substitute for the first database, and the first database and the second database are different in data type and SQL syntax. That is to say, the first database can be understood as the original database in the database replacement process, and the second database can be understood as a new database.

[0052] It should be noted that the configuration information of the database includes but is not limited to: database type, driver type, database driver, database URL, user name and password, etc. In addition, the configuration information of each database can be input by the user through the front-end interface.

[0053] S102: Establishing a data link with the first database based on the configuration information of the first database.

[0054] Among them, the specific implementation process of establishing a data link with the first database based on the configuration information of the first database is a technical means familiar to technical personnel in this field. Specifically, after establishing a data link with the first database, it is necessary to perform a connection test on the first database, that is, sending a preset test SQL statement to the first database, and receiving response information from the first database based on the test SQL statement within a preset time, it is determined that the business system has successfully established a data link with the first database.

[0055] S103: Establishing a data link with the second database based on the configuration information of the second database.

[0056] The specific execution process and implementation principle of S103 are consistent with the specific execution process and implementation principle of S102, and will not be repeated here.

[0057] S104: When receiving a data operation instruction input by a user, the data operation instruction is parsed to obtain the intention of the data operation instruction.

[0058] S105: Performing syntax conversion on the data operation instruction according to the SQL syntax of the first database to obtain a first operation statement.

[0059] The data operation instruction is converted into a syntax according to the SQL syntax of the first database, and the syntax of the obtained first operation statement is compatible with the SQL syntax of the first database, that is, the first operation statement can be recognized by the first database.

[0060] S106: Performing syntax conversion on the data operation instruction according to the SQL syntax of the second database to obtain a second operation statement.

[0061] The data operation instruction is converted into a syntax according to the SQL syntax of the second database, and the syntax of the obtained second operation statement is compatible with the SQL syntax of the second database, that is, the second operation statement can be recognized by the second database.

[0062] S107: When the data operation instruction intends to add new data, a second operation statement is sent to the second database, the second database is triggered to execute the second operation statement, and the execution result fed back by the second database is received.

[0063] After executing S107, continue to execute S108.

[0064] Among them, since the second database is a substitute for the first database, it is determined that the newly added data will be written into the second database, and there is no need to write the newly added data into the first database.

[0065] S108: Displaying the execution result to the user through a preset interface.

[0066] S109: When the data operation instruction intends to query data, delete data, and modify data, send a first operation statement to the first database, trigger the first database to execute the first operation statement, and receive a first execution result fed back by the first database.

[0067] S110: Send a second operation statement to the second database, trigger the second database to execute the second operation statement, and receive a second execution result fed back by the second database.

[0068] S111: Integrate the data of the first execution result and the second execution result to obtain a target execution result.

[0069] S112: Displaying the target execution result to the user through a preset interface.

[0070] To sum up, by performing syntax conversion on data operation instructions, a first operation statement that can be recognized by the first database and a second operation statement that can be recognized by the second database are obtained, so that the business system can adapt to the first database and the second database. In this way, if the second database is used as a substitute for the first data, there is no need to customize the development of the second database, nor is there any need to migrate the data in the first database to the second database, thereby avoiding wasting a lot of time on database replacement and avoiding data loss due to data migration.

[0071] It should be noted that S103 mentioned in the above embodiment is an optional implementation of the data processing method based on multiple data sources described in this application. In addition, S110 mentioned in the above embodiment is also an optional implementation of the data processing method based on multiple data sources described in this application. To this end, the process mentioned in the above embodiment can be summarized as follows: Figure 2 The method shown.

[0072] like Figure 2 FIG. 1 is a flow chart of a data processing method based on multiple data sources provided in an embodiment of the present application, comprising the following steps:

[0073] S201: Establishing data links with each database based on the pre-acquired configuration information of each database.

[0074] S202: When receiving a data operation instruction input by a user, the data operation instruction is parsed to obtain the intention of the data operation instruction.

[0075] S203: For each database, perform syntax conversion on the data operation instructions according to the SQL syntax of the database to obtain operation statements that can be recognized by the database.

[0076] S204: When the intention is to add new data, a database is selected from various databases as a target database, the target database is triggered to execute an operation statement that can be recognized by the target database, and the execution result fed back by the target database is received.

[0077] S205: Displaying the execution result to the user through a preset interface.

[0078] S206: When the intention is to query data, delete data, and modify data, each database is triggered to execute an operation statement that can be recognized by each database, and the execution result fed back by each database is received.

[0079] S207: Integrate the execution results fed back from various databases to obtain the target execution result, and display the target execution result to the user through a preset interface.

[0080] To sum up, by performing syntax conversion on data operation instructions, operation statements that can be recognized by each database are obtained, so that the business system can adapt to each database. In this way, when the business system replaces the database, there is no need to customize the development of the new database, nor to migrate the data in the original database to the new database, thus avoiding wasting a lot of time on database replacement and avoiding data loss due to data migration.

[0081] Corresponding to the data processing method based on multiple data sources provided in the above-mentioned embodiment of the present application, the embodiment of the present application also provides a data processing device based on multiple data sources.

[0082] like Figure 3 FIG. 1 is a schematic diagram of the architecture of a data processing device based on multiple data sources provided in an embodiment of the present application, including:

[0083] The data link unit 100 is used to establish data links with each database based on the configuration information of each database acquired in advance.

[0084] Each database includes a first database and a second database.

[0085] The intention parsing unit 200 is used to parse the data operation instruction upon receiving the data operation instruction input by the user, so as to obtain the intention of the data operation instruction.

[0086] The syntax conversion unit 300 is used to perform syntax conversion on the data operation instructions for each database according to the SQL syntax of the database to obtain operation statements that can be recognized by the database.

[0087] Among them, the syntax conversion unit 300 is specifically used to: perform syntax conversion on the data operation instruction according to the SQL syntax of the first database to obtain a first operation statement that can be recognized by the first database; perform syntax conversion on the data operation instruction according to the SQL syntax of the second database to obtain a second operation statement that can be recognized by the second database.

[0088] The first trigger unit 400 is used to select a database from various databases as a target database when the intention is to add new data, trigger the target database to execute an operation statement that can be recognized by the target database, and receive the execution result fed back by the target database.

[0089] The first trigger unit 400 is specifically used for: when the intention is to add new data, sending a second operation statement to the second database, triggering the second database to execute the second operation statement, and receiving the execution result fed back by the second database.

[0090] The first display unit 500 is used to display the execution result to the user through a preset interface.

[0091] The second trigger unit 600 is used to trigger each database to execute an operation statement that can be recognized by each database when the intention is to query data, delete data, and modify data, and receive the execution result fed back by each database.

[0092] Among them, the second trigger unit 600 is specifically used to: when the intention is to query data, delete data, and modify data, send a first operation statement to the first database, trigger the first database to execute the first operation statement, and receive a first execution result fed back by the first database; trigger the second database to execute a second operation statement, send a second operation statement to the second database, and receive a second execution result fed back by the second database.

[0093] The data integration unit 700 is used to integrate the execution results fed back from various databases to obtain the target execution result, and to display the target execution result to the user through a preset interface.

[0094] The data integration unit 700 is specifically used to perform data integration on the first execution result and the second execution result to obtain a target execution result.

[0095] To sum up, by performing syntax conversion on data operation instructions, operation statements that can be recognized by each database are obtained, so that the business system can adapt to each database. In this way, when the business system replaces the database, there is no need to customize the development of the new database, nor to migrate the data in the original database to the new database, thus avoiding wasting a lot of time on database replacement and avoiding data loss due to data migration.

[0096] The present application also provides a computer-readable storage medium, which includes a stored program, wherein the program executes the data processing method based on multiple data sources provided by the present application.

[0097] The present application also provides a data processing device based on multiple data sources, including: a processor, a memory, and a bus. The processor and the memory are connected via a bus, the memory is used to store programs, and the processor is used to run programs, wherein when the program is run, the data processing method based on multiple data sources provided by the present application is executed, including the following steps:

[0098] Based on the pre-acquired configuration information of each database, establishing a data link with each of the databases;

[0099] When receiving a data operation instruction input by a user, parsing the data operation instruction to obtain the intention of the data operation instruction;

[0100] For each of the databases, the data operation instructions are converted into syntax according to the SQL syntax of the database to obtain operation statements that can be recognized by the database;

[0101] In the case where the intention is to add new data, a database is selected from each of the databases as a target database, the target database is triggered to execute an operation statement that can be recognized by the target database, and an execution result fed back by the target database is received;

[0102] Displaying the execution result to the user through a preset interface;

[0103] In the case where the intention is any one of querying data, deleting data, and modifying data, triggering each of the databases to execute an operation statement that can be recognized by each of the databases, and receiving the execution result fed back by each of the databases;

[0104] The execution results fed back by each of the databases are integrated to obtain a target execution result, and the target execution result is displayed to the user through the preset interface.

[0105] Specifically, based on the above embodiment, each database includes a first database and a second database;

[0106] For each of the databases, the data operation instructions are converted into syntax according to the SQL syntax of the database to obtain operation statements that can be recognized by the database, including:

[0107] According to the SQL grammar of the first database, the data operation instruction is converted into a grammar to obtain a first operation statement that can be recognized by the first database;

[0108] According to the SQL grammar of the second database, the data operation instruction is converted into a grammar to obtain a second operation statement that can be recognized by the second database.

[0109] Specifically, based on the above embodiment, when the intention is to add new data, a database is selected from each of the databases as a target database, the target database is triggered to execute an operation statement that can be recognized by the target database, and the execution result fed back by the target database is received, including:

[0110] When the intention is to add new data, the second operation statement is sent to the second database, the second database is triggered to execute the second operation statement, and the execution result fed back by the second database is received.

[0111] Specifically, based on the above embodiment, when the intention is any one of querying data, deleting data, and modifying data, triggering each of the databases to execute an operation statement that can be recognized by each of the databases, and receiving the execution result fed back by each of the databases, includes:

[0112] In a case where the intention is any one of querying data, deleting data, and modifying data, sending the first operation statement to the first database, triggering the first database to execute the first operation statement, and receiving a first execution result fed back by the first database;

[0113] Trigger the second database to execute the second operation statement, send the second operation statement to the second database, and receive a second execution result fed back by the second database.

[0114] Specifically, based on the above embodiment, the execution results fed back by each database are integrated to obtain the target execution result, including:

[0115] The first execution result and the second execution result are integrated to obtain a target execution result.

[0116] If the functions described in the method of the embodiment of the present application are implemented in the form of software functional units and sold or used as independent products, they can be stored in a storage medium readable by a computing device. Based on this understanding, the part of the embodiment of the present application that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computing device (which can be a personal computer, server, mobile computing device or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories, random access memories, magnetic disks or optical disks.

[0117] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0118] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A data processing method based on multiple data sources, characterized in that: include: Based on the pre-acquired configuration information of each database, establishing a data link with each of the databases; When receiving a data operation instruction input by a user, parsing the data operation instruction to obtain the intention of the data operation instruction; For each of the databases, the data operation instructions are converted into syntax according to the SQL syntax of the database to obtain an operation statement that can be recognized by the database; In the case where the intention is to add new data, a database is selected from each of the databases as a target database, the target database is triggered to execute an operation statement that can be recognized by the target database, and an execution result fed back by the target database is received; Displaying the execution result to the user through a preset interface; In the case where the intention is any one of querying data, deleting data, and modifying data, triggering each of the databases to execute an operation statement that can be recognized by each of the databases, and receiving the execution result fed back by each of the databases; The execution results fed back by each of the databases are integrated to obtain a target execution result, and the target execution result is displayed to the user through the preset interface.

2. The method according to claim 1, characterized in that The respective databases include a first database and a second database; For each of the databases, the data operation instructions are converted into syntax according to the SQL syntax of the database to obtain operation statements that can be recognized by the database, including: According to the SQL grammar of the first database, the data operation instruction is converted into a grammar to obtain a first operation statement that can be recognized by the first database; According to the SQL grammar of the second database, the data operation instruction is converted into a grammar to obtain a second operation statement that can be recognized by the second database.

3. The method according to claim 2, characterized in that In the case where the intention is to add new data, selecting a database from each of the databases as a target database, triggering the target database to execute an operation statement that can be recognized by the target database, and receiving an execution result fed back by the target database, including: When the intention is to add new data, the second operation statement is sent to the second database, the second database is triggered to execute the second operation statement, and the execution result fed back by the second database is received.

4. The method according to claim 2, characterized in that: In the case where the intention is any one of querying data, deleting data, and modifying data, triggering each of the databases to execute an operation statement that can be recognized by each of the databases, and receiving an execution result fed back by each of the databases, includes: In a case where the intention is any one of querying data, deleting data, and modifying data, sending the first operation statement to the first database, triggering the first database to execute the first operation statement, and receiving a first execution result fed back by the first database; Trigger the second database to execute the second operation statement, send the second operation statement to the second database, and receive a second execution result fed back by the second database.

5. The method according to claim 4, characterized in that The data integration of the execution results fed back by each of the databases to obtain the target execution result includes: The first execution result and the second execution result are integrated to obtain a target execution result.

6. A data processing device based on multiple data sources, characterized in that: include: A data link unit, used to establish data links with each of the databases based on the configuration information of each database acquired in advance; An intention parsing unit, configured to parse a data operation instruction input by a user to obtain the intention of the data operation instruction; A syntax conversion unit, for performing syntax conversion on the data operation instruction for each of the databases according to the SQL syntax of the database, to obtain an operation statement that can be recognized by the database; A first triggering unit is used to select a database from each of the databases as a target database when the intention is to add new data, trigger the target database to execute an operation statement that can be recognized by the target database, and receive an execution result fed back by the target database; A first display unit, used to display the execution result to the user through a preset interface; A second triggering unit is used to trigger each of the databases to execute an operation statement that can be recognized by each of the databases when the intention is to query data, delete data, and modify data, and receive an execution result fed back by each of the databases; The data integration unit is used to integrate the execution results fed back by each of the databases to obtain a target execution result, and to display the target execution result to the user through the preset interface.

7. The device according to claim 6, characterized in that The respective databases include a first database and a second database; The grammar conversion unit is specifically used for: According to the SQL grammar of the first database, the data operation instruction is converted into a grammar to obtain a first operation statement that can be recognized by the first database; According to the SQL grammar of the second database, the data operation instruction is converted into a grammar to obtain a second operation statement that can be recognized by the second database.

8. The device according to claim 7, characterized in that The first trigger unit is specifically used for: When the intention is to add new data, the second operation statement is sent to the second database, the second database is triggered to execute the second operation statement, and the execution result fed back by the second database is received.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program executes the data processing method based on multiple data sources described in any one of claims 1-5.

10. A data processing device based on multiple data sources, characterized in that: include: processor, memory, and bus; The processor is connected to the memory via the bus; The memory is used to store programs, and the processor is used to run programs, wherein the program executes the data processing method based on multiple data sources described in any one of claims 1 to 5 when running.

Images