A universal data processing system and method

Abstract

The present invention discloses a universal data processing system and method, the universal data processing system comprises: a data supply module, a universal data opening module and a data application module; the data supply module is used to define the supply data of different systems to obtain multiple open data, and push all open data to the universal data opening module; the universal data opening module is used to process the open data, and receive the data request sent by the data application module, query the second target open data according to the data request, and send the second target open data to the data application module; the data application module is used to send the data request to the universal data opening module, and receive the second target open data sent by the universal data opening module. The present invention improves the universality of data between data suppliers and application parties by constructing a universal data opening platform, and also improves the processing efficiency of data exchange, increases the data opening capability, and has low implementation cost.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a general data processing system and method. Background Art

[0002] In the process of empowering business with Internet technology, many systems jointly support business capabilities to develop business. The core interaction logic between these many systems is the connection of data. The party that provides data is defined as the data supplier, and the other party is the data user. Common data types for interaction between systems include Data, File, URL, Text, etc. It is precisely because of the data exchange and sharing between multiple systems that common data exchange and sharing methods include database direct connection sharing, end-to-end interface calls, file synchronization, communication protocols, etc., which in turn forms the customized openness of data.

[0003] However, each business is composed of more than one system, ranging from a dozen systems to hundreds of systems. The number of systems is related to the complexity of the business. However, there are some shortcomings when opening up and empowering each type of data: data suppliers and users customize and develop according to application scenarios and specific data types, and the versatility is extremely poor; multi-system interaction requires a large number of data-connected services, and the implementation cost is extremely high; data exchange and sharing methods are very different, data openness is poor, and processing efficiency is low.

[0004] Therefore, the prior art still needs to be improved and developed. Summary of the invention

[0005] The main purpose of the present invention is to provide a universal data processing system and method, aiming to solve the problems of poor data universality between different systems, low processing efficiency and high cost when exchanging data in the prior art.

[0006] To achieve the above-mentioned object, the present invention provides a universal data processing system, wherein the universal data processing system comprises: a data supply module, a universal data opening module and a data application module;

[0007] The data supply module, the general data opening module and the data application module are connected in sequence;

[0008] The data supply module is used to define the supply data of different systems, obtain multiple open data, and push all the open data to the general data open module;

[0009] The general data opening module is used to process the open data to obtain first target open data, receive a data request sent by the data application module, query the first target open data according to the data query request to obtain second target open data, and send the second target open data to the data application module;

[0010] The data application module is used to send a data request to the general data opening module and receive the second target opening data sent by the general data opening module.

[0011] The general data processing system, wherein the data supply module includes a data acquisition unit, an access application unit, a data definition unit and a data push unit;

[0012] The data acquisition unit is used to acquire a data access request and supply data of a plurality of different data supply systems, and send the data access request to the application access unit, and send all the supply data to the data definition unit;

[0013] The access application unit is used to send the data access request to the general data open module, receive the authorization key sent by the general data open module, and send the authorization key to the data push unit;

[0014] The data definition unit is used to classify all the supplied data according to data types to obtain a plurality of classified data, define the data information that can be opened for each of the classified data to obtain a plurality of open data, and send all the open data to the data push unit;

[0015] The data push unit is used to access the general data open module according to the authorization key, and push all the open data to the general data open module.

[0016] The general data processing system, wherein the data types include business data class, file address class, file format class and text information class; the data information includes data field, data format and data content.

[0017] The general data processing system, wherein the general data opening module includes an authorization unit, an interface creation unit, a data processing unit, a data query unit, a subscription message service unit and a data storage unit;

[0018] The authorization unit is used to receive the data access request sent by the access application unit, authorize the data access request to obtain an authorization key, and send the authorization key to the access application unit;

[0019] The interface creation unit is used to create an open interface, wherein the open interface includes a first open interface and a second open interface;

[0020] The data processing unit is used to receive the open data based on the first open interface, input fields of the open data, obtain first target open data, and send the first target open data to the data storage unit;

[0021] The data query unit is used to receive the data request sent by the data application module, obtain the query condition according to the data request, perform field query according to the query condition, obtain the second target open data, and send the second target open data to the data application module;

[0022] The subscription message service unit is used to provide subscription message service and send subscription notification to the data supply module, receive incremental change data sent by the data supply module based on the second open interface, and send the incremental change data to the data storage unit;

[0023] The data storage unit is used to store the first target open data and the incremental change data.

[0024] The general data processing system, wherein the information of the open interface includes request parameters, English name, field type and field description.

[0025] The general data processing system, wherein the data supply module further comprises a message subscription unit; the message subscription unit comprises a subscription service subunit, a data monitoring subunit and a data push subunit;

[0026] The subscription service subunit is used to subscribe to the subscription message service, receive a subscription notification sent by the subscription message service unit, and send the subscription notification to the data monitoring subunit;

[0027] The data monitoring subunit is used to monitor the data in the general data open module according to the subscription notification, obtain the monitoring result, and send the monitoring result to the data push subunit;

[0028] The data push subunit is used to determine the change condition according to the monitoring result, call the second open interface according to the change condition, and push the incremental change data corresponding to the change condition to the general data open module based on the second open interface.

[0029] The general data processing system, wherein the general data opening module further comprises a mapping configuration unit;

[0030] The mapping configuration unit is used to configure and map the fields of the first target open data in the data storage unit, and store the mapped fields.

[0031] The general data processing system, wherein the data application module includes an interface calling unit, a condition acquisition unit and a data request unit;

[0032] The interface calling unit is used to obtain a data calling instruction and call the first open interface according to the data calling instruction;

[0033] The condition acquisition unit is used to acquire a data usage scenario, set a query condition according to the data usage scenario, and send the query condition to the data request unit;

[0034] The data request unit is used to generate a data request according to the query condition, send the data request to the general data open module based on the first open interface, and receive the second target open data sent by the general data open module.

[0035] In addition, the present invention also provides a general data processing method based on the general data processing system, wherein the general data processing method comprises:

[0036] The data supply module obtains supply data from different systems, defines each supply data, obtains a plurality of open data, and sends all the open data to the general data open module;

[0037] The general data opening module obtains first target open data from the open data input field and stores the first target open data;

[0038] The data application module sends a data request to the general data open module, and the general data open module queries the first target open data according to the data request to obtain second target open data, and sends the second target open data to the data application module.

[0039] The general data processing method of the general data processing system, wherein the general data processing method further comprises:

[0040] The data supply module subscribes to the subscription message service of the general data open module, receives the subscription notification sent by the general data open module, and monitors the data in the general data open module according to the subscription notification to obtain the monitoring result;

[0041] The data supply module determines a change condition according to the monitoring result, and pushes corresponding incremental change data to the general data opening module according to the change condition.

[0042] The data universal processing system of the present invention comprises: a data supply module, a universal data open module and a data application module; the data supply module, the universal data open module and the data application module are connected in sequence; the data supply module is used to define the supply data of different systems, obtain multiple open data, and push all the open data to the universal data open module; the universal data open module is used to process the open data, obtain the first target open data, and receive the data request sent by the data application module, query the first target open data according to the data query request, obtain the second target open data, and send the second target open data to the data application module; the data application module is used to send a data request to the universal data open module, and receive the second target open data sent by the universal data open module. The present invention improves the universality of data between data suppliers and application parties by constructing a universal data open platform, and also improves the processing efficiency of data exchange and sharing, increases the data openness capability, and has low implementation cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 It is a principle schematic diagram of the universal data processing system of the present invention;

[0044] Figure 2 It is another specific principle schematic diagram of the universal data processing system of the present invention;

[0045] Figure 3 It is a processing flow diagram of a preferred embodiment of the general data processing method based on the general data processing system of the present invention. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0047] It should be noted that if the embodiments of the present invention involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0048] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0049] An embodiment of the general data processing system described in the preferred embodiment of the present invention includes: Figure 1 As shown, the data general processing system includes: a data supply module 10, a general data opening module 20 and a data application module 30; the data supply module 10, the general data opening module 20 and the data application module 30 are connected in sequence.

[0050] Among them, the data supply module 10 is used to define the supply data of different systems, obtain multiple open data, and push all the open data to the general data open module 20; the general data open module 20 is used to process the open data, obtain the first target open data, and receive the data request sent by the data application module 30, query the first target open data according to the data query request, obtain the second target open data, and send the second target open data to the data application module 30; the data application module 30 is used to send a data request to the general data open module 20, and receive the second target open data sent by the general data open module 20.

[0051] like Figure 2 As shown, another specific embodiment of the data general processing system in the embodiment of the present invention includes: a data supply module 10, a general data opening module 20 and a data application module 30; the data supply module 10, the general data opening module 20 and the data application module 30 are connected in sequence.

[0052] Specifically, the data supply module 10 includes a data acquisition unit 101, an application access unit 102, a data definition unit 103 and a data push unit 104, wherein the data acquisition unit 101 is connected to the data definition unit 103, and the application access unit 102 and the data definition unit 103 are respectively connected to the data push unit 104; in the process of enabling business, it is achieved by multiple systems jointly supporting business capabilities, and the core interaction logic between these systems is the data connection, so that the data between the data supplier and the data application party can communicate with each other; but each business is not composed of a system, ranging from a dozen systems to hundreds of systems, and the number of systems is related to the complexity of the business, but the system of the data supplier and the system of the data application party are customized and developed according to the application scenario and specific data types, and the versatility is extremely poor. In order to realize multi-system interaction, a large number of data connection services are required, the implementation cost is extremely high, and the ability of data open empowerment is limited; in the embodiment of the present invention, if the data supply module 10 wants to interact with the general data open module 20 for data, it is necessary to obtain the general data open module 20. the authorization key of the general data opening module 20; when the data supply module 10 wants to request data from the general data opening module 20, the general data opening module 20 verifies the signature in the request sent by the data supply module. When the verification passes, the data required by the data supply module 10 is queried, and the query result is returned to the data supply module 10, specifically: the data acquisition unit 101 obtains a data access request, wherein the data access request is used to apply for the API (API is a protocol that allows data exchange and communication between different systems) key of the general data opening module, and the API key is a unique identifier used for identity authentication and authorization in the API interface, and sends the data access request to the application access unit 102; the application access unit 102 sends the data access request to the general data opening module 20, the general data opening module 20 opens authorization for the data supply module 10, and sends the authorization key to the application access unit 102, and the application access unit 102 sends the authorization key to the data push unit 103.

[0053] After the data supply module 10 obtains the authorization key of the universal data opening module 20, the data acquisition unit 101 of the data supply module 10 obtains the supply data of multiple different data supply systems (for example, system a, system b, system c, etc.), and sends all the supply data to the data definition unit 103; the data definition unit 103 classifies all the supply data according to the data type, wherein the data type includes Data, i.e., business data class, URL, i.e., file address class, File, i.e., file format class, and Text, i.e., text information class, and obtains multiple classified data (for example, product service indicators, internal production data, and external read data are classified into Business data class, document addresses, kanban addresses and external addresses are classified into file address classes, local files are classified into file format classes, etc.); and the data information that can be opened for each of the classified data is defined to obtain multiple open data, wherein the data information includes data fields, data formats and data contents, and all the open data are sent to the data push unit 104; the data push unit 104 accesses the general data opening module 20 according to the authorization key, and pushes all the open data to the general data opening module 20; by defining the supply data of each data supply system, not only the ability of data openness empowerment is improved, but also the cost is reduced while improving the versatility of data.

[0054] Specifically, the general data open module 20 includes an authorization unit 201, an interface creation unit 202, a data processing unit 203, a data query unit 204, a subscription message service unit 205 and a data storage unit 206; before the data supply module 10 wants to interact with the general data open module 20, it is necessary to obtain the authorization key of the general data open module 20, specifically, after receiving the data access request sent by the application access unit 102, the authorization unit 201 authorizes the data access request, obtains the authorization key, and sends the authorization key to the application access unit 102; and the interaction between data needs to be achieved through the corresponding interface, the interface creation unit 202 creates an open interface for interacting between data, and the number of the open interfaces is not limited; in an embodiment of the present invention, the interface creation unit 202 creates two open interfaces, namely a first open interface and a second open interface; the sent parameters and return values ​​of the first open interface and the second open interface are consistent, as shown in Table 1 and Table 2 respectively.

[0055] Table 1 Upload parameters

[0056] Request Parameters English name Field Type Field Description Logo Id Int Field 1Key 1_key Int [data field] Field 1Value 1_value String ["field1", "field2"] Field 2Key 2_key String [Search conditions] Field 2Value 2_value String [field 1, ..., field N] Field 3Key 3_key String [Key] Field 3 value 3_value ["SDFWE!!#@@#$#@"]

[0057] Table 2 Return value

[0058]

[0059] In the above Tables 1 and 2, Int is an integer type, String is a string type, and Bool is a Boolean variable, that is, the definition of a logical variable, which is used to represent two states of yes or no; when the data push unit 1 of the data supply module 10 pushes all the open data to the general data open module 20, the data processing unit 203 of the general data open module 20 receives the open data based on the first open interface and processes the open data. The specific processing is as follows: the data processing unit 203 inputs fields to the open data to obtain open data with fields, that is, the first target open data, that is, each open data Each data corresponds to a field. When querying the data subsequently, you only need to search and filter the fields to quickly obtain the data under specific conditions; the data processing unit 203 sends the first target open data to the data storage unit 206; when the data application module 30 needs to use the data, the data query unit 204 receives the data request sent by the data application module 30, obtains the query conditions according to the data request, and performs field query according to the query conditions to obtain the open data desired by the data application module 30, that is, the second target open data, and sends the second target open data to the data application module 30.

[0060] The general data open module 20 also provides a subscription message service for the data supply module 10 to subscribe; the subscription message service unit 205 in the general data open module 20 provides a subscription message service to the data supply module 10, and after the data supply module 10 successfully subscribes, the subscription message service unit 205 sends a subscription notification to the data supply module 10, and receives the incremental change data sent by the data supply module 10 based on the second open interface, and sends the incremental change data to the data storage unit 206; the data storage unit 206 stores the received first target open data and the incremental change data.

[0061] In addition to the above-mentioned units, the general data opening module 20 also includes a mapping configuration unit 207; the mapping configuration unit 207 configures and maps the fields of the first target open data in the data storage unit 206, and stores the mapped fields; when subsequently reading or writing files, the mapped storage space is directly accessed to improve the speed and efficiency of file reading and writing.

[0062] Furthermore, the data supply module 10 also includes a message subscription unit 105, through which the subscription message service provided by the data opening module 20 is subscribed; the message subscription unit 105 includes a subscription service subunit 1051, a data monitoring subunit 1052 and a data push subunit 1053; specifically, the subscription message service is subscribed to through the subscription service subunit 1051. After successfully subscribing to the subscription message service, the subscription message service unit 205 will send a subscription notification to the data supply module 10, wherein the subscription notification is a query condition; the subscription service subunit 1051 will The subscription notification is received and sent to the data monitoring sub-unit 1052; the data monitoring sub-unit 1052 monitors the data in the general data open module 20 in real time according to the subscription notification, obtains the monitoring result, and sends the monitoring result to the data push sub-unit 1053; when the monitoring result shows that the query condition has changed, the data push sub-unit 1053 determines the change condition according to the monitoring result, calls the corresponding incremental change data according to the change condition, and calls the second open interface, and pushes the incremental change data to the general data open module based on the second open interface.

[0063] Specifically, the data application module 30 includes an interface calling unit 301, a condition acquisition unit 302 and a data request unit 303; when the data application module 30 needs to apply data, the interface calling unit 301 obtains a data calling instruction, and calls the first open interface of the general data open module according to the data calling instruction; the condition acquisition unit 302 obtains a data usage scenario, sets a query condition according to the data usage scenario, and sends the query condition to the data request unit 303; the data request unit 303 generates a data request according to the query condition, sends the data request to the general data open module 20 based on the first open interface, and receives the second target open data sent by the general data open module 20, wherein the second target open data is the query condition obtained by the general data open module 20 according to the data request, and a field query is performed according to the query condition.

[0064] The present invention improves the universality of data between data suppliers and users by constructing a universal data open platform, improves the processing efficiency of data exchange and sharing, increases data openness, and achieves low cost; and through the universal data open platform, reduces data redundancy, improves reusability and processing efficiency, thereby reducing costs and reducing resource consumption.

[0065] Further, based on Figure 1The general data processing system shown in the figure, the preferred embodiment of the present invention is based on the general data processing method of the general data processing system, such as Figure 3 As shown, the general data processing method includes the following steps:

[0066] Step S10: The data supply module obtains supply data from different systems, defines each supply data to obtain a plurality of open data, and sends all the open data to the general data opening module.

[0067] Step S20: the general data opening module obtains first target open data from the open data input field and stores the first target open data.

[0068] Step S30: the data application module sends a data request to the general data open module; the general data open module queries the first target open data according to the data request, obtains second target open data, and sends the second target open data to the data application module.

[0069] Further, the data supply module subscribes to the subscription message service of the general data open module, receives the subscription notification sent by the general data open module, and monitors the data in the general data open module according to the subscription notification to obtain the monitoring result;

[0070] The data supply module determines a change condition according to the monitoring result, and pushes corresponding incremental change data to the general data opening module according to the change condition.

[0071] Specifically, in an embodiment of the present invention, if the data supply module wants to interact with the universal data open module, it needs to obtain the authorization key of the universal data open module; when the data supply module wants to request data from the universal data open module, the universal data open module verifies the signature in the request sent by the data supply module, and when the verification passes, it queries the data required by the data supply module and returns the query result to the data supply module, specifically: the data supply module first sends a data access request to the universal data open module, and the universal data open module activates authorization for the data supply module and sends the authorization key to the data supply module. After obtaining the authorization key of the universal data open module, the data supply module obtains the supply data of multiple different data supply systems, and classifies all the supply data according to the data type, wherein the data type includes Data, i.e., business data class, URL, i.e., file address class, File, i.e., file format class and Text, i.e., text information class, to obtain multiple classified data; the data supply module defines the data information that can be opened for each of the classified data, obtains multiple open data, accesses the universal data open module according to the authorization key, and pushes all the open data to the universal data open module.

[0072] The interaction between data needs to be achieved through corresponding interfaces. The general data open module creates an open interface for interaction between data, and the number of the open interfaces is not limited. In an embodiment of the present invention, two open interfaces are created, namely a first open interface and a second open interface. The general data open module receives the open data based on the first open interface and processes the open data. The specific processing is as follows: the open data input field is used to obtain the first target open data, that is, each open data corresponds to a field. When querying the data subsequently, it is only necessary to search and filter the field, so as to quickly obtain the data under specific conditions and store the first target open data. When the data application module needs to use the data, the general data open module receives the data request sent by the data application module, obtains the query conditions according to the data request, performs field query according to the query conditions to obtain the second target open data, and sends the second target open data to the data application module.

[0073] Furthermore, the general data open module also provides a subscription message service for the data supply module to subscribe; after the data supply module successfully subscribes, the general data open module sends a subscription notification to the data supply module, and the data supply module monitors the data in the general data open module in real time according to the subscription notification to obtain the monitoring result; when the monitoring result shows that the query condition has changed, the data supply module determines the change condition according to the monitoring result, calls the corresponding incremental change data according to the change condition, calls the second open interface, and pushes the incremental change data to the general data open module based on the second open interface.

[0074] The present invention solves the problems in the prior art of poor data universality between different systems, low processing efficiency during data exchange, and high cost.

[0075] The present invention provides a data universal processing system and method, the data universal processing system comprises: a data supply module, a universal data open module and a data application module; the data supply module, the universal data open module and the data application module are connected in sequence; the data supply module is used to define the supply data of different systems, obtain multiple open data, and push all the open data to the universal data open module; the universal data open module is used to process the open data, obtain the first target open data, and receive the data request sent by the data application module, query the first target open data according to the data query request, obtain the second target open data, and send the second target open data to the data application module; the data application module is used to send a data request to the universal data open module, and receive the second target open data sent by the universal data open module. The present invention improves the universality of data between data suppliers and application parties by constructing a universal data open platform, and also improves the processing efficiency of data exchange and sharing, increases the data openness capability, and has low implementation cost.

[0076] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0077] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A general data processing system, characterized in that: The general data processing system includes: a data supply module, a general data opening module and a data application module; The data supply module, the general data opening module and the data application module are connected in sequence; The data supply module is used to define the supply data of different systems, obtain multiple open data, and push all the open data to the general data open module; The data supply module includes a data acquisition unit, an access application unit, a data definition unit and a data push unit; The data acquisition unit is used to acquire a data access request and supply data of a plurality of different data supply systems, and send the data access request to the application access unit, and send all the supply data to the data definition unit; The access application unit is used to send the data access request to the general data open module, receive the authorization key sent by the general data open module, and send the authorization key to the data push unit; The data definition unit is used to classify all the supplied data according to data types to obtain a plurality of classified data, define the data information that can be opened for each of the classified data to obtain a plurality of open data, and send all the open data to the data push unit; The data push unit is used to access the general data open module according to the authorization key, and push all the open data to the general data open module; By defining the supply data of each data supply system, the data openness empowerment capability is enhanced and the data versatility is improved; The general data opening module is used to process the open data to obtain first target open data, receive a data request sent by the data application module, query the first target open data according to the data query request to obtain second target open data, and send the second target open data to the data application module; The general data opening module includes an authorization unit, an interface creation unit, a data processing unit, a data query unit, a subscription message service unit and a data storage unit; The authorization unit is used to receive the data access request sent by the access application unit, authorize the data access request to obtain an authorization key, and send the authorization key to the access application unit; The interface creation unit is used to create an open interface, wherein the open interface includes a first open interface and a second open interface; The data processing unit is used to receive the open data based on the first open interface, input fields of the open data, obtain first target open data, and send the first target open data to the data storage unit; The data query unit is used to receive the data request sent by the data application module, obtain the query condition according to the data request, perform field query according to the query condition, obtain the second target open data, and send the second target open data to the data application module; The subscription message service unit is used to provide subscription message service and send subscription notification to the data supply module, receive incremental change data sent by the data supply module based on the second open interface, and send the incremental change data to the data storage unit; The data storage unit is used to store the first target open data and the incremental change data; The data application module is used to send a data request to the general data opening module and receive the second target opening data sent by the general data opening module.

2. The general data processing system according to claim 1, characterized in that: The data types include business data class, file address class, file format class and text information class; the data information includes data field, data format and data content.

3. The general data processing system according to claim 1, characterized in that: The information of the open interface includes request parameters, English name, field type and field description.

4. The general data processing system according to claim 1, characterized in that: The data supply module also includes a message subscription unit; the message subscription unit includes a subscription service subunit, a data monitoring subunit and a data push subunit; The subscription service subunit is used to subscribe to the subscription message service, receive a subscription notification sent by the subscription message service unit, and send the subscription notification to the data monitoring subunit; The data monitoring subunit is used to monitor the data in the general data open module according to the subscription notification, obtain the monitoring result, and send the monitoring result to the data push subunit; The data push subunit is used to determine the change condition according to the monitoring result, call the second open interface according to the change condition, and push the incremental change data corresponding to the change condition to the general data open module based on the second open interface.

5. The general data processing system according to claim 1, characterized in that: The general data opening module also includes a mapping configuration unit; The mapping configuration unit is used to configure and map the fields of the first target open data in the data storage unit, and store the mapped fields.

6. The general data processing system according to claim 1, characterized in that: The data application module includes an interface calling unit, a condition acquisition unit and a data request unit; The interface calling unit is used to obtain a data calling instruction and call the first open interface according to the data calling instruction; The condition acquisition unit is used to acquire a data usage scenario, set a query condition according to the data usage scenario, and send the query condition to the data request unit; The data request unit is used to generate a data request according to the query condition, send the data request to the general data open module based on the first open interface, and receive the second target open data sent by the general data open module.

7. A general data processing method based on the general data processing system according to any one of claims 1 to 6, characterized in that: The general data processing method comprises: The data supply module obtains supply data from different systems, defines each supply data, obtains a plurality of open data, and sends all the open data to the general data open module; The general data opening module obtains first target open data from the open data input field and stores the first target open data; The data application module sends a data request to the general data open module, and the general data open module queries the first target open data according to the data request to obtain second target open data, and sends the second target open data to the data application module.

8. The general data processing method according to claim 7, characterized in that: The general data processing method further includes: The data supply module subscribes to the subscription message service of the general data open module, receives the subscription notification sent by the general data open module, and monitors the data in the general data open module according to the subscription notification to obtain the monitoring result; The data supply module determines a change condition according to the monitoring result, and pushes corresponding incremental change data to the general data opening module according to the change condition.

Images