Data processing method, rule configuration generation method and related products
By deploying a single target rule configuration containing multiple data sources and processing logic within the computing engine, the problem of complex multi-data source processing configuration in existing technologies is solved, achieving simplification and efficiency improvement.
Patent Information
- Application Number
- CN202411111678.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-13
- Publication Date
- 2026-02-13
AI Technical Summary
In existing technologies, a single rule configuration of a computing engine can only handle a single data source. When multiple rule configurations need to be combined to handle multiple data sources, the configuration logic becomes complex and difficult to manage.
Deploy a single target rule configuration in the computing engine, which includes multiple data source configurations and data processing logic configurations. Processing multiple data sources is achieved by reading and executing this rule configuration.
It simplifies the number of rule configurations in the computing engine, improves the efficiency of rule configuration execution, and achieves unified processing of multiple data sources.
Smart Images
Figure CN121524221A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of data processing, and in particular to a data processing method, a data processing device, a rule configuration generation method, a rule configuration generation device, an electronic device and a computer readable storage medium. BACKGROUND
[0002] The single rule configuration of the current computing engine only supports single data source processing; if multiple data sources need to be uniformly processed, multiple rule configurations need to be combined to achieve this, and the configuration logic is complex and difficult to manage. SUMMARY
[0003] In view of the above problems, a data processing method, a data processing device, a rule configuration generation method, a rule configuration generation device, an electronic device and a computer readable storage medium are proposed in order to provide a solution to overcome the above problems or at least partially solve the above problems.
[0004] The embodiment of the present application provides a data processing method applied to a computing engine, wherein a single target rule configuration is deployed in the computing engine, the target rule configuration comprises a plurality of data source configurations of data and a data processing logic configuration corresponding to each data, and the method comprises the following steps:
[0005] reading the target rule configuration;
[0006] processing data corresponding to each data source configuration in the target rule configuration according to a plurality of data processing logic configurations in the target rule configuration.
[0007] Optionally, the data source configuration comprises detailed configuration data, and the processing of the data corresponding to each data source configuration in the target rule configuration according to the plurality of data processing logic configurations in the target rule configuration comprises the following steps:
[0008] obtaining target data according to the detailed configuration data;
[0009] processing the target data according to the data processing logic configuration in the target rule configuration.
[0010] Optionally, the data processing logic configuration takes the data name of the corresponding data as the key.
[0011] Optionally, the target data at least comprises first data and second data, the plurality of data processing logic configurations at least comprises a first data processing logic configuration corresponding to the first data and a second data processing logic configuration corresponding to the second data, and the processing of the target data according to the data processing logic configuration in the target rule configuration comprises the following steps:
[0012] According to the first data processing logic configuration, the first data is processed to obtain third data;
[0013] According to the second data processing logic configuration, the second data is processed according to the third data.
[0014] Optionally, for any target data processing logic configuration, the target data processing logic configuration comprises:
[0015] An identifier of a third data processing logic configuration; the data operation corresponding to the third data processing logic configuration is a next data operation of the data operation corresponding to the target data processing logic configuration.
[0016] The embodiment of the application further provides a rule configuration generation method, and the method comprises:
[0017] In response to a first user operation, data source configurations of multiple data and data processing logic configurations corresponding to each data are determined;
[0018] According to the data source configurations of the multiple data and the data processing logic configurations corresponding to each data, a single target rule configuration is generated and deployed in a computing engine;
[0019] The computing engine is used for reading the target rule configuration; and according to the multiple data processing logic configurations in the target rule configuration, data corresponding to each data source configuration in the target rule configuration is processed.
[0020] Optionally, the method further comprises:
[0021] In response to a second user operation, an order of data operations corresponding to each data processing logic configuration is determined;
[0022] The target rule configuration is generated according to the data source configurations of the multiple data and the data processing logic configurations corresponding to each data, comprising:
[0023] The target rule configuration is generated according to the data source configurations of the multiple data, the order of data operations corresponding to each data processing logic configuration, and the data processing logic configurations corresponding to each data.
[0024] The embodiment of the application further provides a data processing device applied to a computing engine, wherein a single target rule configuration is deployed in the computing engine, the target rule configuration comprises data source configurations of multiple data and data processing logic configurations corresponding to each data, and the device comprises:
[0025] A reading module is used for reading the target rule configuration;
[0026] a processing module configured to process data corresponding to each data source configuration in the target rule configuration according to a plurality of data processing logic configurations in the target rule configuration.
[0027] Optionally, the data source configuration comprises detailed configuration data, and the processing module is configured to acquire target data according to the detailed configuration data and process the target data according to the data processing logic configuration in the target rule configuration.
[0028] Optionally, the data processing logic configuration takes a data name of corresponding data as a key.
[0029] Optionally, the target data comprises at least first data and second data, the plurality of data processing logic configurations comprises at least a first data processing logic configuration corresponding to the first data and a second data processing logic configuration corresponding to the second data, and the processing module is configured to process the first data according to the first data processing logic configuration to obtain third data and process the second data according to the third data according to the second data processing logic configuration.
[0030] Optionally, for any target data processing logic configuration, the target data processing logic configuration comprises:
[0031] an identifier of a third data processing logic configuration, and a data operation corresponding to the third data processing logic configuration is a next data operation of a data operation corresponding to the target data processing logic configuration.
[0032] Embodiments of the present application also provide a rule configuration generation device, the device comprising:
[0033] a configuration determination module configured to determine, in response to a first user operation, data source configurations of a plurality of data and data processing logic configurations corresponding to each data;
[0034] a generation module configured to generate a single target rule configuration according to the data source configurations of the plurality of data and the data processing logic configurations corresponding to each data and deploy the target rule configuration in a computing engine;
[0035] The computing engine is configured to read the target rule configuration and process data corresponding to each data source configuration in the target rule configuration according to a plurality of data processing logic configurations in the target rule configuration.
[0036] Optionally, the device further comprises:
[0037] a sequence determination module configured to determine, in response to a second user operation, a sequence of data operations corresponding to each data processing logic configuration.
[0038] The generation module is configured to generate the target rule configuration according to the data source configuration of the plurality of data, the sequence of data operations corresponding to the data processing logic configuration of each data, and the data processing logic configuration corresponding to each data.
[0039] The embodiment of the present application further provides an electronic device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the data processing method is realized, or the rule configuration generation method is realized.
[0040] The embodiment of the present application further provides a computer readable storage medium, and the computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the data processing method is realized, or the rule configuration generation method is realized.
[0041] The embodiment of the present application has the following advantages:
[0042] In the embodiment of the present application, a single target rule configuration is deployed in the computing engine, the target rule configuration includes the data source configuration of the plurality of data and the data processing logic configuration corresponding to each data, and the computing engine can read the target rule configuration first, and then process the data corresponding to each data source configuration in the target rule configuration according to the plurality of data processing logic configurations in the target rule configuration. The rule calculation of the multiple data sources is realized by a single rule configuration, the number of rule configurations in the computing engine is simplified, and the efficiency of the rule configuration running in the computing engine is improved. BRIEF DESCRIPTION OF DRAWINGS
[0043] In order to more clearly illustrate the technical solutions of the present application, the following will briefly introduce the drawings needed to be used in the description of the present application. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.
[0044] Figure 1 is a step flow chart of a data processing method of an embodiment of the present application;
[0045] Figure 2 is a step flow chart of another data processing method of an embodiment of the present application;
[0046] Figure 3 is a step flow chart of a rule configuration generation method of an embodiment of the present application;
[0047] Figure 4 is a step flow chart of another rule configuration generation method of an embodiment of the present application;
[0048] Figure 5 is a structural schematic diagram of a data processing device according to an embodiment of the present application;
[0049] Figure 6 is a structural schematic diagram of a rule configuration generation device according to an embodiment of the present application. DETAILED DESCRIPTION
[0050] In order to make the above objectives, characteristics and advantages of the present application more apparent, comprehensible and easier to understand, the present application will be described in further detail below with reference to the drawings and specific embodiments. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without any creative work, fall within the scope of protection of the present application.
[0051] In order to make the rule configuration of a single computing engine support multiple data sources, an embodiment of the present application provides a data processing method, in which a single target rule configuration is deployed in the computing engine; the target rule configuration can include data source configurations of multiple data, and data processing logic configurations corresponding to the data.
[0052] The data source configuration can define the source of data, i.e., the data source, so that the computing engine can obtain the data of the data source; the data processing logic configuration can define the manner of data processing, so that the computing engine can perform corresponding processing on the data after obtaining the data of the data source. Through this configuration, rule calculation of multiple data sources can be realized through a single rule configuration, which simplifies the number of rule configurations and improves the efficiency of rule configuration operation. Based on the rule configuration, an embodiment of the present application provides a data processing method, which can be applied in a computing engine; specifically, reference can be made to Figure 1 , Figure 1 shows a step flowchart of a data processing method according to an embodiment of the present application.
[0053] As shown in Figure 1 , the method can include the following steps:
[0054] Step 101, reading a target rule configuration.
[0055] In actual application, the computing engine can first read the target rule configuration to read the data source configurations of multiple data and the data processing logic configurations corresponding to the data in the target rule configuration.
[0056] Step 102, processing the data corresponding to each data source configuration in the target rule configuration according to the multiple data processing logic configurations in the target rule configuration.
[0057] After reading the data source configuration of the plurality of data in the target rule configuration and the data processing logic configuration corresponding to each data, the computing engine can sequentially acquire data from the data source according to the data source configuration, and process the data corresponding to each data source configuration in the target rule configuration according to the plurality of data processing logic configurations in the target rule configuration.
[0058] For example, the data source configuration can include an A data source, a B data source and a C data source; the data processing logic configuration can include an a data operation for the data of the A data source, a b data operation for the data of the B data source, and a c data operation for the data of the C data source.
[0059] Therefore, the computing engine can first acquire data from the A data source and perform data processing on the data acquired from the A data source by using the a data operation; then, the computing engine can acquire data from the B data source and perform data processing on the data acquired from the B data source by using the b data operation; and then, the computing engine can acquire data from the C data source and perform data processing on the data acquired from the C data source by using the c data operation, which is not limited in the embodiment of the application.
[0060] In the embodiment of the application, a single target rule configuration is deployed in the computing engine, the target rule configuration includes the data source configuration of the plurality of data and the data processing logic configuration corresponding to each data, and the computing engine can first read the target rule configuration; and then, the computing engine can process the data corresponding to each data source configuration in the target rule configuration according to the plurality of data processing logic configurations in the target rule configuration. The rule calculation of the plurality of data sources is realized by using a single rule configuration, which simplifies the number of rule configurations in the computing engine and improves the efficiency of the rule configuration running in the computing engine.
[0061] Referring to Figure 2 FIG. 2 shows a step flowchart of another data processing method according to an embodiment of the application, which can include the following steps:
[0062] Step 201: reading a target rule configuration.
[0063] In actual application, the computing engine can first read the target rule configuration to read the data source configuration of the plurality of data and the data processing logic configuration corresponding to each data in the target rule configuration.
[0064] Step 202: the data source configuration includes detailed configuration data, and the target data is acquired according to the detailed configuration data.
[0065] In some feasible embodiments, the data source configuration can include detailed configuration data, which can be used to specify specific data in the data source, so that the computing engine can acquire the specific data from the data source.
[0066] After reading the detailed configuration data, the computing engine can acquire target data from the corresponding data source according to the detailed configuration data.
[0067] In step 203, the target data is processed according to the data processing logic configuration in the target rule configuration.
[0068] After reading the data processing logic configuration for the target data in the target rule configuration, the computing engine can perform corresponding data processing on the target data acquired from the data source according to the data processing logic configuration for the target data in the target rule configuration.
[0069] In an embodiment of the present application, the data processing logic configuration takes the data name of the corresponding data as a key.
[0070] In some possible embodiments, the data processing logic configuration can take the data name of the data to be processed as a key, and take the code for data operation on the data as a value. When the data is obtained, the computing engine can execute the corresponding code based on the key to perform data operation on the data.
[0071] In an embodiment of the present application, the target data includes at least first data and second data, and the plurality of data processing logic configurations includes at least first data processing logic configuration corresponding to the first data and second data processing logic configuration corresponding to the second data; step 203 can be implemented through the following sub-steps:
[0072] In sub-step 11, the first data is processed according to the first data processing logic configuration to obtain third data.
[0073] In some possible embodiments, the computing engine can first process the first data according to the first data processing logic configuration to obtain third data; wherein the third data can be result data obtained after data operation on the first data, or can be intermediate process data obtained in the process of data operation on the first data, and the embodiments of the present application do not limit this.
[0074] In sub-step 12, the second data is processed according to the second data processing logic configuration based on the third data.
[0075] After processing the first data according to the first data processing logic configuration, the computing engine can continue to perform data operation on the second data according to the second data processing logic configuration based on the result data or intermediate process data (i.e. the third data) of the previous data operation.
[0076] In an embodiment of the present application, for any target data processing logic configuration, the target data processing logic configuration comprises: an identifier of a third data processing logic configuration; and a data operation corresponding to the third data processing logic configuration, which is a next data operation of a data operation corresponding to the target data processing logic configuration.
[0077] In some possible embodiments, since it is a single target rule configuration, in order to enable the computing engine to determine a next data operation to be executed after a data operation is executed, for any target data processing logic configuration, the target data processing logic configuration can comprise an identifier of a third data processing logic configuration; and a data operation corresponding to the third data processing logic configuration can be a next data operation of a data operation corresponding to the target data processing logic configuration.
[0078] Therefore, after the computing engine reads the target data processing logic configuration and executes the data operation corresponding to the target data processing logic configuration, the computing engine can determine a next data operation to be executed based on the identifier of the third data processing logic configuration included in the target data processing logic configuration, and execute the data operation corresponding to the third data processing logic configuration.
[0079] In an embodiment of the present application, the target rule configuration is read; the data source configuration comprises detailed configuration data, the target data is acquired according to the detailed configuration data; and the target data is processed according to the data processing logic configuration in the target rule configuration. The rule calculation of multiple data sources is implemented by a single rule configuration, which simplifies the number of rule configurations in the computing engine and improves the efficiency of the rule configuration running in the computing engine.
[0080] Referring to Figure 3 , a step flowchart of a rule configuration generation method according to an embodiment of the present application is shown, which can comprise the following steps:
[0081] In step 301, in response to a first user operation, data source configurations of multiple data and data processing logic configurations corresponding to the data are determined.
[0082] When a user needs to generate a target rule configuration, the first user operation can be performed to determine data source configurations of multiple data used to generate the target rule configuration and data processing logic configurations corresponding to the data.
[0083] For example, the first user operation can be a selection operation or an input operation, and the present application does not limit this.
[0084] When the first user operation is a selection operation, a selection interface can be displayed in a user interface, so that the user performs the first user operation to select data source configurations of multiple data used to generate the target rule configuration and data processing logic configurations corresponding to the data.
[0085] When the first user operation is an input operation, the data source configuration of the multiple data input by the first user operation of the user, and the data processing logic configuration corresponding to each data can be received, and the embodiments of the present application do not limit this.
[0086] Step 302, generating a target rule configuration according to the data source configuration of the multiple data, and the data processing logic configuration corresponding to each data.
[0087] After obtaining the data source configuration of the multiple data, and the data processing logic configuration corresponding to each data, a single target rule configuration can be generated according to the data source configuration of the multiple data, and the data processing logic configuration corresponding to each data; the single target rule configuration can include the data source configuration of the multiple data, and the data processing logic configuration corresponding to each data. The generated target rule configuration can execute the data processing method as above, and the embodiments of the present application do not limit this.
[0088] In the embodiments of the present application, in response to the first user operation, the data source configuration of the multiple data, and the data processing logic configuration corresponding to each data are determined; and the target rule configuration is generated according to the data source configuration of the multiple data, and the data processing logic configuration corresponding to each data. The rule calculation of the multiple data sources is realized through a single rule configuration, which simplifies the number of rule configurations in the calculation engine, and also improves the efficiency of the rule configuration running in the calculation engine.
[0089] Referring to Figure 4 , another step flow chart of a rule configuration generation method is shown, which can include the following steps:
[0090] Step 401, in response to a first user operation, determining the data source configuration of the multiple data, and the data processing logic configuration corresponding to each data.
[0091] When the user needs to generate a target rule configuration, the first user operation can be performed first to select the data source configuration of the multiple data used to generate the target rule configuration, and the data processing logic configuration corresponding to each data.
[0092] Step 402, in response to a second user operation, determining the order of the data operation corresponding to each data processing logic configuration.
[0093] In some feasible embodiments, the user can also perform the second user operation to set the order of the data operation corresponding to each data processing logic configuration.
[0094] For example, the first user operation and the second user operation can be one user operation: for example, a selected interface can be displayed first, and the selected interface can display a plurality of data source configurations and a plurality of data processing logic configurations; the user performs the first user operation, and can first select a data source configuration and a corresponding data processing logic configuration; then another data source configuration and a corresponding data processing logic configuration are selected, until the user completes the selection operation and performs confirmation. Based on the order of selection of the data source configuration and the data processing logic configuration in the first user operation, the order of the data processing logic configuration corresponding to the data operation can be determined.
[0095] For another example, when the first user operation is an input operation, a data source configuration of a first data and a corresponding data processing logic configuration can be received first, and then a data source configuration of another data and a corresponding data processing logic configuration can be received, until the user completes the selection operation and performs confirmation. Based on the order of input, the order of the data processing logic configuration corresponding to the data operation can be determined.
[0096] Another example, the first user operation and the second user operation can be different user operations, that is, the user first performs the first user operation to select or input the data source configurations of a plurality of data and the data processing logic configurations corresponding to the data, and then specifies the second user operation to set the order of the data processing logic configuration corresponding to the data operation, and the embodiments of the present application do not limit this.
[0097] Step 403, generating a target rule configuration according to the data source configurations of a plurality of data, the order of the data processing logic configuration corresponding to the data operation, and the data processing logic configuration corresponding to the data.
[0098] After obtaining the data source configurations of a plurality of data, the order of the data processing logic configuration corresponding to the data operation, and the data processing logic configuration corresponding to the data, a single target rule configuration can be generated according to the data source configurations of a plurality of data, the order of the data processing logic configuration corresponding to the data operation, and the data processing logic configuration corresponding to the data, and the single target rule configuration can include the data source configurations of a plurality of data, the order of the data processing logic configuration corresponding to the data operation, and the data processing logic configuration corresponding to the data, so that the computing engine can complete the multi-data processing of the multiple data sources based on the single target rule configuration.
[0099] In the embodiment of the present application, in response to a first user operation, the data source configuration of the plurality of data and the data processing logic configuration corresponding to each data are determined; in response to a second user operation, the order of data operation corresponding to each data processing logic configuration is determined; and the target rule configuration is generated according to the data source configuration of the plurality of data, the order of data operation corresponding to each data processing logic configuration, and the data processing logic configuration corresponding to each data. The rule calculation of the multiple data sources is realized through a single rule configuration, which simplifies the number of rule configurations in the calculation engine and improves the efficiency of the rule configuration operation in the calculation engine.
[0100] In the following, the above target rule configuration is described through a specific example; through the steps of the target rule configuration described below, the overall framework of the rule configuration can be realized, and further improvement can be made according to the business. Through a single rule configuration, multiple types of data source configurations can be supported, which can make the complex rule simple and efficient in configuration.
[0101] The steps of the target rule configuration are as follows:
[0102] 1. The content of the target rule configuration is divided into two types: source and exec, source represents data source configuration, and exec represents data processing logic configuration.
[0103] 2. The data source configuration is supported, for example, in json:
[0104]
[0105]
[0106] Among them, can sub is a configuration section, which is used to define the signals that can be replaced or replaced.
[0107] test_sig, that is, signal subscription; it is a signal (signal) configuration section, which is used to define the configuration data related to a specific signal subscription. These data may include the type, source, processing method, subscription rule of the signal, etc.
[0108] search test, that is, log search extraction; it is a log (log) configuration section, which is used to define the configuration data related to log search and extraction. These data may include the storage location of the log, the search condition, the extraction rule, the filter, etc.
[0109] timer1 is a timer (timer) configuration section, which is used to define a specific timer related configuration data. These data may include the trigger time, period, callback function, execution task of the timer, etc.
[0110] Currently, there are signal subscription (test_sig), log search extraction (search_test), and first timer (timer1) data for subsequent service processing.
[0111] 4. The following is the data processing logic configuration for each data definition:
[0112]
[0113] 5. In exec, the data name is used as a key to define the data processing logic configuration corresponding to the subsequent data operation for the corresponding data.
[0114] 6. The data operations supported by the target rule configuration include but are not limited to: filter operation, event operation, switch operation, sample operation, temporary data creation, etc. The operation type can be defined according to the service.
[0115] 7. At this time, the target rule configuration defines the sequence of data operations through the source in the source and the data processing logic configuration through the data name in the exec, supporting the configuration of multiple data sources and the operations performed after the corresponding data source is triggered.
[0116] 8. The data defined through the source will eventually be aggregated into the running environment of this target rule configuration, so the data in different data operations can access each other:
[0117] "exec": {
[0118] "test_sig": {},
[0119] "search test": {},
[0120] "timer1": {
[0121] "type": "filter",
[0122] "expr": "$source.test_sig.value == 1",
[0123] "iftrue": []
[0124] }
[0125] }
[0126] The above code defines that when the first timer (timer1) is running, the value of the signal subscription (test_sig) signal is filtered, and when the test_sig value == 1, the first timer performs the related operation; wherein "type":"filter" indicates that this operation is a filter (filter). "expr":"$source.test_sig.value == 1" is a conditional expression, which is used to judge whether the value of the "test_sig" signal is equal to 1.
[0127] 9. The subsequent operation when the operation is successfully / failed is specified by iftrue / iffalse keywords.
[0128] It should be noted that, for the method embodiments, in order to simply describe, they are all expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present application are not limited to the described action sequence, because according to the embodiments of the present application, certain steps can be performed in other order or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the involved actions are not necessarily the necessary of the embodiments of the present application.
[0129] Referring to Figure 5 , a structural schematic diagram of a data processing apparatus of an embodiment of the present application is shown, which is applied to a computing engine, the computing engine is deployed with a single target rule configuration, the target rule configuration includes a plurality of data source configurations of data and data processing logic configurations corresponding to each data, and the data processing apparatus can include the following modules:
[0130] The reading module 501 is configured to read the target rule configuration.
[0131] The processing module 502 is configured to process the data corresponding to each data source configuration in the target rule configuration according to the plurality of data processing logic configurations in the target rule configuration.
[0132] In an optional embodiment of the present application, the data source configuration includes detailed configuration data, and the processing module 502 is configured to obtain target data according to the detailed configuration data, and process the target data according to the data processing logic configuration in the target rule configuration.
[0133] In an optional embodiment of the present application, the data processing logic configuration takes the data name of the corresponding data as the key.
[0134] In an optional embodiment of the present application, the target data comprises at least the first data and the second data, the plurality of data processing logic configurations comprises at least the first data processing logic configuration corresponding to the first data and the second data processing logic configuration corresponding to the second data, and the processing module is configured to process the first data according to the first data processing logic configuration to obtain third data, and process the second data according to the second data processing logic configuration based on the third data.
[0135] In an optional embodiment of the present application, for any target data processing logic configuration, the target data processing logic configuration comprises:
[0136] an identifier of a third data processing logic configuration, and a data operation corresponding to the third data processing logic configuration is a next data operation of a data operation corresponding to the target data processing logic configuration.
[0137] In the embodiment of the present application, the computing engine is deployed with a single target rule configuration, the target rule configuration comprises data source configurations of a plurality of data and data processing logic configurations corresponding to the data, the computing engine can read the target rule configuration first, and then process data corresponding to each data source configuration in the target rule configuration according to the plurality of data processing logic configurations in the target rule configuration. The rule calculation of the multiple data sources is realized by the single rule configuration, which simplifies the number of rule configurations in the computing engine and improves the efficiency of the rule configuration running in the computing engine.
[0138] Referring to Figure 6 , a structural schematic diagram of a rule configuration generation apparatus in an embodiment of the present application is shown, which can comprise the following modules:
[0139] The configuration determination module 601 is configured to determine, in response to a first user operation, data source configurations of a plurality of data and data processing logic configurations corresponding to the data.
[0140] The generation module 602 is configured to generate a single target rule configuration according to the data source configurations of the plurality of data and the data processing logic configurations corresponding to the data, and deploy the target rule configuration in the computing engine.
[0141] The computing engine is configured to read the target rule configuration, and process data corresponding to each data source configuration in the target rule configuration according to the plurality of data processing logic configurations in the target rule configuration.
[0142] In an optional embodiment of the present application, the apparatus further comprises:
[0143] The sequence determination module is configured to determine, in response to a second user operation, a sequence of data operations corresponding to each data processing logic configuration.
[0144] The generating module 602 is configured to generate the target rule configuration according to the data source configuration of the plurality of data, the sequence of the data operation corresponding to the data processing logic configuration of each data, and the data processing logic configuration corresponding to each data.
[0145] In the embodiment of the present application, the data source configuration of the plurality of data and the data processing logic configuration corresponding to each data are determined in response to the first user operation, and the target rule configuration is generated according to the data source configuration of the plurality of data and the data processing logic configuration corresponding to each data. The rule calculation of the multiple data sources is realized by a single rule configuration, which simplifies the number of rule configurations in the calculation engine and improves the efficiency of the rule configuration operation in the calculation engine.
[0146] The embodiment of the present application also provides an electronic device, which comprises a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the data processing method described above is realized, or the rule configuration generation method described above is realized.
[0147] The embodiment of the present application also provides a computer readable storage medium, which stores a computer program. When the computer program is executed by a processor, the data processing method described above is realized, or the rule configuration generation method described above is realized.
[0148] For the device embodiment, it is basically similar to the method embodiment, so it is described more simply, and the related parts are described in the part of the method embodiment.
[0149] Each embodiment in the specification is described in a progressive manner, and each embodiment mainly describes the difference from other embodiments. The same and similar parts of each embodiment can be referred to each other.
[0150] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a device, or a computer program product. Therefore, the embodiments of the present application can be in the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present application can be in the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program codes.
[0151] The embodiments of the present application are described with reference to the flowchart illustrations and / or block diagrams of the methods, terminal devices (systems) and computer program products according to the embodiments of the present application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal devices to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal devices, create means for implementing the functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.
[0152] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal devices to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.
[0153] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal devices, such that a series of operational steps are carried out on the computer or other programmable terminal devices to produce a computer implemented process so that the instructions executed on the computer or other programmable terminal devices provide steps for implementing the functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.
[0154] Although preferred embodiments of the present application have been described, those skilled in the art will be able to make additional modifications and variations to these embodiments without departing from the scope of the present application. Accordingly, the appended claims are intended to encompass all such modifications and variations as falling within the scope of the present application.
[0155] Finally, it is to be understood that the phraseology or terminology such as "first" and "second" etc. used herein is merely intended to differentiate one entity or operation from another entity or operation, without necessarily requiring or implying any actual such relationship or order between such entities or operations. Moreover, the terms "comprising", "including", or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the statement "comprising a" does not exclude the existence of additional identical elements in the process, method, article, or apparatus including the one defined element.
[0156] The above provides a data processing method, a data processing device, a rule configuration generation method, a rule configuration generation device, an electronic device and a computer readable storage medium, and the principles and implementation manners of the present application are described by applying specific examples. The above description of the embodiments is only used to help understand the method of the present application and its core idea; meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation manners and application ranges will be changed, and the above description should not be understood as a limitation of the present application.
Claims
1. A data processing method, characterized in that, Applied to a computing engine, the computing engine deploys a single target rule configuration, which includes multiple data source configurations and data processing logic configurations corresponding to each data point. The method includes: Read the target rule configuration; According to the multiple data processing logic configurations in the target rule configuration, the data corresponding to each data source configuration in the target rule configuration is processed.
2. The method according to claim 1, characterized in that, The data source configuration includes detailed configuration data. The processing of data corresponding to each data source configuration in the target rule configuration, according to multiple data processing logic configurations in the target rule configuration, includes: Based on the detailed configuration data, obtain the target data; The target data is processed according to the data processing logic configuration in the target rule configuration.
3. The method according to claim 1, characterized in that, The data processing logic is configured with the data name of the corresponding data as the key.
4. The method according to claim 2, characterized in that, The target data includes at least first data and second data, and the plurality of data processing logic configurations include at least a first data processing logic configuration corresponding to the first data and a second data processing logic configuration corresponding to the second data. Processing the target data according to the data processing logic configuration in the target rule configuration includes: According to the first data processing logic configuration, the first data is processed to obtain the third data; According to the second data processing logic configuration, the second data is processed based on the third data.
5. The method according to claim 1, characterized in that, For any given target data processing logic configuration, the target data processing logic configuration includes: The identifier of the third data processing logic configuration; the data operation corresponding to the third data processing logic configuration is the next data operation following the data operation corresponding to the target data processing logic configuration.
6. A method for generating rule configurations, characterized in that, The method includes: In response to the first user's operation, determine the data source configuration for multiple data sets and the corresponding data processing logic configuration for each data set; Based on the data source configurations of multiple data sources and the corresponding data processing logic configurations, a single target rule configuration is generated and deployed in the computing engine; The computing engine is used to read the target rule configuration and process the data corresponding to each data source configuration in the target rule configuration according to the multiple data processing logic configurations in the target rule configuration.
7. The method according to claim 6, characterized in that, The method further includes: In response to the second user's operation, determine the order of data operations corresponding to each data processing logic configuration; The step of generating target rule configurations based on the data source configurations of multiple data sets and the corresponding data processing logic configurations includes: The target rule configuration is generated based on the data source configuration of multiple data sources, the order of data operations corresponding to each data processing logic configuration, and the data processing logic configuration corresponding to each data.
8. A data processing apparatus, characterized in that, Applied to a computing engine, the computing engine deploys a single target rule configuration, the target rule configuration including multiple data source configurations and data processing logic configurations corresponding to each data, the device includes: The reading module is used to read the target rule configuration; The processing module is used to process the data corresponding to each data source configuration in the target rule configuration according to the multiple data processing logic configurations in the target rule configuration.
9. A rule configuration generation device, characterized in that, The device includes: The configuration determination module is used to determine the data source configuration of multiple data and the data processing logic configuration corresponding to each data in response to the first user operation; The generation module is used to generate target rule configurations based on the data source configurations of multiple data sources and the corresponding data processing logic configurations.
10. An electronic device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when executed by the processor, the computer program implements the data processing method as described in any one of claims 1 to 5, or implements the rule configuration generation method as described in any one of claims 6 to 7.
11. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, which, when executed by a processor, implements the data processing method as described in any one of claims 1 to 5, or the rule configuration generation method as described in any one of claims 6 to 7.