A method and system for data integration based on a data middle platform

Through the data middle platform technology, the data synchronization table is identified and matched, the problem of data interaction dependence interfaces of different business systems in the power grid system is solved, efficient data access and simplified interaction processes are realized, and the system maintainability and availability are improved.

CN115422268BActive Publication Date: 2025-07-25RES INST OF ECONOMICS & TECH STATE GRID SHANDONG ELECTRIC POWER +3
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210888026.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-25
Publication Date
2025-07-25
Estimated Expiration
2042-07-25

AI Technical Summary

Technical Problem

Data interactions of different business systems in existing power grid systems depend on customized interfaces, resulting in a long and inefficient access process, lack of maintainability and high availability.

Method used

Using data middle platform technology, the data middle platform identifies the interface type of cross-service data requests through the data middle platform, matches the data synchronization table, and returns data snapshot information based on the data synchronization strategy, simplifies the data interaction process, and establishes a personalized data synchronization strategy.

Benefits of technology

It improves the data interaction efficiency of different business systems, simplifies the data access process, and enhances the system's maintainability and high availability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115422268B_ABST
    Figure CN115422268B_ABST
Patent Text Reader

Abstract

The present invention provides a method and system for data integration based on a data middle platform. The method includes obtaining a cross-business data request from a business terminal user and forwarding the cross-business data request to the data middle platform; the data middle platform identifies the data interface type of the current cross-business data request, matches a data synchronization table of the current data interface type from the middle platform database, and the data synchronization table stores data snapshot information of the services associated with the current business terminal user; based on the services of the current business terminal user and the data synchronization policy of the associated services, the data snapshot information is returned to the current business terminal user. The present invention applies the middle platform database of the data middle platform technology to integrate different business data, and provides a way for business terminal users to obtain different business data, eliminating the defect of relying on data interfaces when different business data interact, simplifying the data interaction process between different services, and improving the data interaction efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a method and system for data integration based on a data middle platform. Background Art

[0002] At present, the management middle platform of the power grid system has completed the preliminary construction. According to the current construction results, data interaction with systems such as ERP (Enterprise Resource Planning) materials and online power grids has been realized respectively. However, with the continuous in-depth application of system development, the horizontal expansion of system services, and the increasing demand for various system data, further strengthening the feasibility, maintainability, and high availability of horizontal data integration has become an urgent problem to be solved.

[0003] Currently, the method of developing customized interfaces with each business system is prone to the following problems: the data access process is long, and it is necessary to communicate with each business system in advance about the business and customize the interfaces, and then wait for the interface development, interface online and interface joint debugging. A large amount of work in the process is mechanized and repetitive, resulting in low data access efficiency. Summary of the Invention

[0004] The present invention provides a method and system for data integration based on a data middle platform, which is used to solve the problem that when data is exchanged between existing different services, it depends on data interfaces, and the interaction process is complex, affecting the data access efficiency.

[0005] To achieve the above object, the present invention adopts the following technical solutions:

[0006] The first aspect of the present invention provides a method for data integration based on a data middle platform, and the method includes the following steps:

[0007] Obtain a cross-service data request of a business terminal user, and forward the cross-service data request to the data middle platform;

[0008] The data middle platform identifies the data interface type of the current cross-service data request, and matches a data synchronization table of the current data interface type in the middle platform database. The data synchronization table stores data snapshot information of services associated with the current business terminal user;

[0009] Based on the service of the current business terminal user and the data synchronization strategy of the associated service, return the data snapshot information to the current business terminal user.

[0010] Further, after obtaining the cross-service data request and before forwarding the cross-service data request to the data middle platform, the method further includes:

[0011] Authenticate the identity of the current business terminal user.

[0012] Further, the specific process of authenticating the current business terminal user is as follows:

[0013] Parse the cross-service data request to obtain the digital signature of the current business terminal user;

[0014] Use the public key of the current business terminal user to decrypt the digital signature to obtain the message digest, and compare the message digest with the digest obtained by hash operation. If the two are the same, the authentication of the current business terminal user passes.

[0015] Further, each of the data interface types includes one or more data synchronization tables, and each synchronization table includes the associated data of at least two services and the real-time snapshot information of the associated data.

[0016] Further, the method further includes constructing data synchronization policies for different services in the data middle platform, and the specific process is as follows:

[0017] Based on the current service association relationship or user requirements, establish a service association list, which is sorted in sequence according to the data request interfaces of different services, and each item contains at least two associated services;

[0018] Set the data synchronization frequency for each item in the list according to the historical data interaction frequency of the associated services.

[0019] Further, each item in the list corresponds to a data synchronization table.

[0020] Further, the method further includes the steps of:

[0021] If the current business terminal user that issues the cross-service data request is not in the list, after the authentication of the current business terminal user passes, add the current business terminal user to the list, parse the cross-service data request issued by it, and write the service corresponding to the request data into the current item of the list to form a new item.

[0022] In a second aspect of the present invention, a data integration system based on a data middle platform is provided. The system includes a client, a server, and a data middle platform. The data middle platform is connected to the client and the server. The client includes multiple business terminal users. The server obtains a cross-business data request from the business terminal users and forwards the cross-business data request to the data middle platform. The data middle platform identifies the data interface type of the current cross-business data request, matches a data synchronization table of the current data interface type in the middle platform database. The data synchronization table stores data snapshot information of the services associated with the current business terminal. Based on the data synchronization policy between the current business terminal user and the associated service, the data snapshot information is returned to the current business terminal user.

[0023] Further, the server includes a user identity authentication module. The user identity authentication module analyzes the cross-business data request to obtain the digital signature of the current business terminal user. The digital signature is decrypted using the public key of the current business terminal user to obtain a message digest. The message digest is compared with the digest obtained through hash operation. If the two are the same, the identity authentication of the current business terminal user passes.

[0024] In a third aspect of the present invention, a computer storage medium is provided. The computer storage medium stores computer instructions. When the computer instructions run on a system, the system executes the steps of the method.

[0025] The data integration system in the second aspect of the present invention can implement the methods in the first aspect and various implementation manners of the first aspect, and achieve the same effects.

[0026] The effects provided in the summary of the invention are only the effects of the embodiments, rather than all the effects of the invention. One of the above technical solutions has the following advantages or beneficial effects:

[0027] 1. The present invention applies the middle platform database of the data middle platform technology to integrate different business data and provides a way for business terminal users to obtain different business data, eliminating the defect of relying on data interfaces during the interaction of different business data, simplifying the data interaction process between different services, and improving the data interaction efficiency.

[0028] 2. For the data interaction between different services, establish an association relationship for the services that may have data interaction, create a synchronization table for each association relationship, and customize a personalized synchronization policy for each synchronization table, further improving the data synchronization efficiency between different services. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0030] Figure 1 is a schematic flowchart of the method of the present invention;

[0031] Figure 2 is a schematic structural diagram of the system of the present invention. Detailed implementation manners

[0032] To clearly illustrate the technical features of this solution, the present invention will be described in detail below through specific implementation manners and in conjunction with its drawings. The following disclosure provides many different embodiments or examples for implementing different structures of the present invention. To simplify the disclosure of the present invention, the components and settings of specific examples are described below. In addition, the present invention may repeat reference numerals and / or letters in different examples. This repetition is for the purpose of simplification and clarity, and does not itself indicate the relationship between the various embodiments and / or settings discussed. It should be noted that the components illustrated in the drawings are not necessarily drawn to scale. The present invention omits the description of well-known components and processing technologies and processes to avoid unnecessarily limiting the present invention.

[0033] As Figure 1 shown, an embodiment of the present invention provides a method for data integration based on a data middle platform, including the following steps:

[0034] S1. Obtain a cross-business data request of a business terminal user, and forward the cross-business data request to the data middle platform;

[0035] S2. The data middle platform identifies the data interface type of the current cross-business data request, and matches the data synchronization table of the current data interface type in the middle platform database. The data synchronization table stores the data snapshot information of the services associated with the current business terminal user.

[0036] S3. Based on the service of the current business terminal user and the data synchronization policy of the associated service, return the data snapshot information to the current business terminal user.

[0037] The operation of step S1 runs on the server side. The business terminal user first sends the cross-business data request to the server side. If the request involves cross-business, it has an identifier in the message description. The server side first identifies this identifier. For the cross-business identifier, it is forwarded to the data middle platform.

[0038] In step S1, after obtaining the cross-business data request and before forwarding the cross-business data request to the data center, the method further includes:

[0039] Authenticate the current business terminal user. The specific process is as follows:

[0040] Parse the cross-business data request to obtain the digital signature of the current business terminal user. This digital signature is obtained by the current business terminal user encrypting the message digest based on its own private key, and the message digest is obtained through hash calculation.

[0041] The server decrypts the digital signature using the public key of the current business terminal user to obtain the message digest, and compares the message digest with the digest obtained through hash operation. If the two are the same, the authentication of the current business terminal user passes. The private key and public key mentioned above are a pair of key pairs.

[0042] In step S2, each data interface type includes one or more data synchronization tables. Each synchronization table includes the associated data of at least two services and the real-time snapshot information of the associated data.

[0043] In step S3, the business terminal user obtains the real-time associated data of the associated service based on the snapshot information.

[0044] In one implementation of the method of the present invention, the method further includes constructing data synchronization policies for different services in the data center. The specific process is as follows:

[0045] Based on the current business association relationship or user requirements, establish a business association list. The list is sorted in sequence according to the data request interfaces of different services, and each item includes at least two associated services.

[0046] Set the data synchronization frequency for each item in the list according to the historical data interaction frequency of the associated services.

[0047] Each item in the list corresponds to a data synchronization table.

[0048] In one implementation of the embodiment of the present invention, the method further includes the step of creating a new cross-business data interaction, specifically:

[0049] If the business terminal user that currently issues the cross-business data request is not in the list, after the authentication of the current business terminal user passes, add the current business terminal user to the list, parse the cross-business data request issued by it, and write the services corresponding to the request data into the current item of the list to form a new item.

[0050] Such as Figure 2As shown in the figure, an embodiment of the present invention further provides a data integration system based on a data middle platform. The system includes a client, a server, and a data middle platform. The data middle platform is connected to the client and the server. The client includes multiple business terminal users. The server obtains a cross-business data request from the business terminal users and forwards the cross-business data request to the data middle platform. The data middle platform identifies the data interface type of the current cross-business data request, matches a data synchronization table of the current data interface type from the middle platform database. The data synchronization table stores data snapshot information of the services associated with the current business terminal. Based on the data synchronization policy between the current business terminal user and the associated services, the data snapshot information is returned to the current business terminal user.

[0051] The server includes a user authentication module. The user authentication module analyzes the cross-business data request to obtain the digital signature of the current business terminal user. The digital signature is decrypted using the public key of the current business terminal user to obtain a message digest. The message digest is compared with the digest obtained through a hashing operation. If the two are the same, the identity authentication of the current business terminal user passes.

[0052] An embodiment of the present invention further provides a computer storage medium. Computer instructions are stored in the computer storage medium. When the computer instructions run on the system, the system is caused to execute the steps of the method.

[0053] Although the specific implementation manners of the present invention are described above in conjunction with the accompanying drawings, it is not a limitation to the protection scope of the present invention. Those skilled in the art should understand that based on the technical solutions of the present invention, various modifications or deformations that can be made by those skilled in the art without creative efforts are still within the protection scope of the present invention.

Claims

1. A method for data integration based on a data middle platform, characterized in that The method includes the following steps: Obtain the cross-business data request of the business terminal user and forward the cross-business data request to the data middle platform; The data middle platform identifies the data interface type of the current cross-business data request, matches the data synchronization table of the current data interface type from the middle platform database, and the data synchronization table stores the data snapshot information of the business associated with the current business terminal user; Based on the business of the current business terminal user and the data synchronization policy of the associated business, return the data snapshot information to the current business terminal user; Each of the data interface types includes one or more data synchronization tables, and each synchronization table includes the associated data of at least two services and the real-time snapshot information of the associated data; The method further includes building data synchronization policies for different services in the data middle platform. The specific process is as follows: Based on the current business association relationship or user requirements, establish a business association list, which is sorted in sequence according to the data request interfaces of different services, and each item includes at least two associated services; According to the historical data interaction frequency of the associated services, set the data synchronization frequency for each item in the list.

2. The method for data connection based on the data middle platform according to claim 1, wherein After obtaining the cross-business data request and before forwarding the cross-business data request to the data middle platform, the method further includes: Authenticate the current business terminal user.

3. The method for data integration based on the data middle platform according to claim 2, wherein The specific process of authenticating the current business terminal user is as follows: Parse the cross-business data request to obtain the digital signature of the current business terminal user; Use the public key of the current business terminal user to decrypt the digital signature to obtain a message digest, and compare the message digest with the digest obtained by hash operation. If the two are the same, the authentication of the current business terminal user passes.

4. The method for data integration based on the data middle platform according to claim 1, wherein Each item in the list corresponds to a data synchronization table.

5. The method for data connection based on the data middle platform according to claim 1, characterized in that, The method further includes the step of: If the business terminal user that currently issues the cross-business data request is not in the list, after the authentication of the current business terminal user passes, add the current business terminal user to the list, parse the cross-business data request issued by it, and write the service corresponding to the request data into the current item of the list to form a new item.

6. A system for data integration based on a data middle platform, the system comprising a client, a server, and a data middle platform, the data middle platform connecting the client and the server, the client including a plurality of business terminal users, characterized in that, The server obtains the cross-business data request of the business terminal user and forwards the cross-business data request to the data middle platform; The data middle platform identifies the data interface type of the current cross-business data request, matches the data synchronization table of the current data interface type from the middle platform database, and the data synchronization table stores the data snapshot information of the business associated with the current business terminal; Based on the data synchronization policy between the current business terminal user and the associated business, return the data snapshot information to the current business terminal user; Each of the data interface types includes one or more data synchronization tables, and each synchronization table includes the associated data of at least two services and the real-time snapshot information of the associated data; The system is also used to build data synchronization policies for different services in the data middle platform. The specific process is as follows: Based on the current business association relationship or user requirements, establish a business association list, which is sorted in sequence according to the data request interfaces of different services, and each item includes at least two associated services; Set the data synchronization frequency for each item in the list according to the historical data interaction frequency of the associated services.

7. The system for data integration based on the data middle platform according to claim 6, characterized in that, The server includes a user authentication module. The user authentication module parses the cross-service data request to obtain the digital signature of the current business terminal user, decrypts the digital signature using the public key of the current business terminal user to obtain a message digest, and compares the message digest with the digest obtained through hash operation. If the two are the same, the identity authentication of the current business terminal user passes.

8. A computer storage medium storing computer instructions, characterized in that, When the computer instructions run on the system of claim 6 or 7, the system is caused to perform the steps of the method according to any one of claims 1-5.

Citation Information

Patent Citations

  • Service data management method, device and equipment and computer readable storage medium

    CN109902103A