Rule engine-based data acquisition and processing method, system and device

By introducing the rules engine module in the data collection system, dynamically adjusting the communication protocol and updating the configuration library, the existing system has dealt with the problems in the multi -protocol environment, and the efficient and flexible data collection and processing is achieved.

CN119337056APending Publication Date: 2025-01-21ZHEJIANG FUDA ALLOY MATERIALS TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411279472.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-09-09
Filing Date
2024-09-12
Publication Date
2025-01-21

AI Technical Summary

Technical Problem

Existing data acquisition systems are difficult to effectively process when facing multi-protocol environments, and the hard-coded method increases system complexity and reduces scalability and maintenance.

Method used

The data collection and processing method based on the rule engine is adopted. The rule engine module receives and parses the data collection instructions, dynamically adjusts the communication protocol, and updates the local configuration library according to the configuration information to realize data collection and processing.

Benefits of technology

Realize the timeliness of data collection rules, support communication of multiple devices and protocols, improve the efficiency and accuracy of data processing, and significantly improve the scalability and maintenance of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119337056A_ABST
    Figure CN119337056A_ABST
Patent Text Reader

Abstract

The invention relates to a data acquisition and processing method, system and device based on a rule engine, and the method comprises the steps: a rule engine module receives and analyzes a data acquisition instruction and a configuration instruction, and adjusts the communication connection relation between a data acquisition module and various devices according to a communication protocol; the rule engine module obtains a latest configuration version according to the configuration information, and the data acquisition module executes an acquisition task according to the acquisition item and obtains original data; and the data processing module performs primary processing on the original data according to the cleaning rule, performs further processing on the data and stores the data in the data center. Through the above settings, automatic data acquisition from various data sources is realized, real-time processing and analysis are performed according to a user-defined rule, and the method has high configurability, can flexibly adjust acquisition and processing rules according to different application scenes, and significantly improves the efficiency and accuracy of data processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of industrial automation and data processing technology, and in particular to a data collection and processing method, system and device based on a rule engine. Background Art

[0002] In modern industrial production, data acquisition systems are an important part of industrial automation and are used to monitor and record the operating status of equipment in real time. However, with the diversification of industrial equipment types and communication protocols, traditional data acquisition systems are unable to cope with multi-protocol environments, and logical processing of acquired data is also very difficult. Existing technologies usually use hard coding to support specific equipment and protocols, which not only increases the complexity of the system, but also reduces its scalability and maintainability. Summary of the invention

[0003] The purpose of the present invention is to overcome the shortcomings and deficiencies of the prior art and to provide a data collection and processing method, system and device based on a rule engine, including: a data center module outputs data collection instructions and configuration instructions to a rule engine module;

[0004] The rule engine module receives and parses data collection instructions and configuration instructions, and outputs device information, configuration information, communication address, communication protocol, collection items, and cleaning rules related to the device;

[0005] The rule engine module compares the configuration information with the local configuration library to obtain the latest configuration version, and updates the local configuration library to the latest version;

[0006] The rule engine module dynamically adjusts the communication connection relationship between the data acquisition module and various devices according to the dynamically changing communication protocol;

[0007] When the data acquisition module is connected to the device through communication, the data acquisition module performs the acquisition task according to the acquisition items and obtains the original data;

[0008] The data processing module performs preliminary processing on the raw data according to the cleaning rules and uploads the processed data to the data center;

[0009] The data processing module further processes the data uploaded to the data center and stores the processed data in the data center module or the data center of other devices.

[0010] Preferably, if the current configuration information is the latest version and the data acquisition module is connected to the device for communication, the system enters the data acquisition stage. At the same time, the collection points and collection cycles in the collection items of the rule engine module are monitored in real time, and the data collection process is adjusted according to whether the collection points are in the collection queue and the consistency of the collection cycle.

[0011] Preferably, the data processing module divides the data cleaning process into input data checking, filtering abnormal data and outputting data that complies with the rules according to the cleaning rules.

[0012] Preferably, after data cleaning is completed, the connection status between the rule engine module and the data center module is determined, and based on the connection status and preset trigger conditions, it is determined whether to upload the cleaned data to the data center module.

[0013] Preferably, the data processing module performs input, filtering and output processing on the cleaned data according to configuration instructions, and stores the processed data in a local database or a cloud server.

[0014] Preferably, the rule engine module monitors in real time the communication failures and data anomalies that may occur during the data collection process. When communication failures and data anomalies occur, the rule engine module can automatically adjust the data collection process according to preset strategies, or report fault information to the cloud server.

[0015] Preferably, the data center module is used to output data collection instructions and timed output configuration instructions;

[0016] The rule engine module is used to receive and parse data collection instructions and configuration instructions, and output device information, configuration information, communication address, communication protocol, collection items, and cleaning rules related to the device; dynamically adjust the communication connection relationship between the data collection module and various devices according to the dynamically changing communication protocol; compare the configuration information with the local configuration library to obtain the latest configuration version and update the local configuration library to the latest configuration version;

[0017] The data collection module is used to perform collection tasks according to collection items and obtain raw data;

[0018] The data processing module is used to perform preliminary processing on the original data according to the cleaning rules and upload the processed data to the data center; the data uploaded to the data center is further processed and the processed data is stored in the data center module or other equipment's data center.

[0019] Preferably, a data acquisition and processing system comprises:

[0020] The rule engine module includes a fault detection and processing module, and the communication fault includes a connection fault between the rule engine module and the data center module, a rule engine module fault, and a rule engine module storage capacity exceeding limit fault;

[0021] When the communication failure is a connection failure between the rule engine module and the data center module, the fault detection and processing module stores the collected data in the local time series database and records the disconnection time; when the connection is restored, the fault detection and processing module transmits the stored collected data back to the data center module with a timestamp;

[0022] When the communication failure is a rule engine module failure, the data center module will automatically mark the rule engine module and all its subordinate devices as offline and trigger the alarm mechanism;

[0023] When the communication failure is caused by the storage capacity exceeding the limit of the rule engine module, the system automatically cleans up the previous data to save the new data. At the same time, the rule engine module will give priority to retaining key data such as alarm data and store it separately.

[0024] Preferably, a computer-readable storage medium comprises: a data acquisition program for implementing a data acquisition method is stored on the computer-readable storage medium.

[0025] A data acquisition device includes: the data acquisition device includes a memory, a processor and a rule engine system running on the processor, which is used to implement a data acquisition and processing method.

[0026] The beneficial effects of the present invention are as follows: the rule engine module updates the latest configuration version according to the configuration information, ensuring the timeliness of the data collection rules; the data collection module communicates with different industrial equipment through different communication protocols, and then performs collection tasks according to the collection items and obtains the original data; the original data is cleaned and uploaded to the data center, and the data processing module processes and makes decisions according to the pre-configured rules. Automatic data collection from multiple data sources is achieved, and real-time processing and analysis are performed according to user-defined rules. The present invention is highly configurable, and can flexibly adjust the collection and processing rules according to different application scenarios, significantly improving the efficiency and accuracy of data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, without paying creative labor, other drawings obtained based on these drawings still belong to the scope of the present invention.

[0028] Figure 1 It is a structural diagram of the data acquisition system in the present invention;

[0029] Figure 2 It is a flow chart of the data collection method of the present invention;

[0030] Figure 3 A schematic diagram of the process flow of data collection and execution of the present invention;

[0031] Figure 4 A schematic diagram of the process of cleaning and storing data by the edge gateway in the present invention;

[0032] Figure 5 The figure is a schematic diagram of the process of cleaning and storing data in the data center of the present invention. DETAILED DESCRIPTION

[0033] In order to make the objectives, technical solutions and advantages of the present invention more clear, the present invention will be further described in detail below with reference to the accompanying drawings.

[0034] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are for distinguishing two non-identical entities with the same name or non-identical parameters. It can be seen that "first" and "second" are only for the convenience of expression and should not be understood as limitations on the embodiments of the present invention. The subsequent embodiments will not explain this one by one.

[0035] The directions and positions mentioned in the present invention, such as "upper", "lower", "front", "back", "left", "right", "inside", "outside", "top", "bottom", "side", etc., are only for reference to the directions or positions of the drawings. Therefore, the directions and positions used are for explaining and understanding the present invention, but not for limiting the scope of protection of the present invention.

[0036] like Figures 1 to 5 As shown, this is an embodiment of the present invention. In this embodiment, the edge gateway is used as a module integrating a data acquisition module and a rule engine module. The present invention is introduced in detail by taking the edge gateway as an example. In this embodiment, a rule engine is provided in the edge gateway for collecting data of industrial equipment. The edge gateway performs a series of operations such as cleaning, processing and storing the collected data according to the rule engine.

[0037] Figure 1 For the entire data collection process of this embodiment, the system connected to the output end of the present invention is not limited in type. Among them, multiple edge gateways can access the data center at the same time, and each edge gateway can access multiple devices; a rule engine is provided in the data center. In this embodiment, the edge gateway maintains a constant connection with the data center through the MQTT protocol, and ensures the stability of the connection by regularly sending heartbeat packets. The sending frequency of the heartbeat packets is issued and configured by the central system.

[0038] See also Figure 2 As shown, in this embodiment, the edge gateway receives a data collection instruction from the data center, and the data collection instruction includes device information, communication protocol, communication address, collection items and cleaning rules. The data collection method based on the rule engine of this embodiment includes the following steps:

[0039] S101. The data center outputs data collection instructions to the edge gateway, and the edge gateway receives the data collection instructions issued by the data center.

[0040] In this embodiment, the edge gateway obtains device information, communication protocol and communication address related to the device by receiving data collection instructions, and extracts collection items and cleaning rules to ensure that the data collection and processing process complies with predefined rules.

[0041] S102. The edge gateway parses the content in the data collection instruction, including device information, communication protocol, communication address, collection items and cleaning rules.

[0042] In this embodiment, after receiving the data collection instruction, the edge gateway parses the instruction content to obtain the type of data to be collected and the cleaning requirements, thereby preparing for subsequent data collection and processing operations.

[0043] S103. The edge gateway compares the version information of the collection configuration and sends heartbeat packets regularly to ensure that the collection rules are the latest version.

[0044] In this embodiment, in order to ensure the timeliness of data collection rules, the edge gateway communicates with the data center regularly through heartbeat packets to obtain configuration information, verifies the configuration version by comparing the obtained configuration information with the local configuration library, and updates the local configuration library.

[0045] S104. If the local configuration is the latest version, it is not changed. Otherwise, the configuration is added or modified according to the information provided by the data center.

[0046] The above steps are specifically implemented as follows: the edge gateway automatically downloads the configuration instructions and replaces the corresponding configuration instructions in the local configuration library with the latest version of the configuration data.

[0047] Through the above steps, this embodiment ensures that the edge gateway can obtain the latest collection configuration in a timely manner, and perform corresponding configuration updates or adjustments according to the configuration instructions of the data center when necessary.

[0048] See also Figure 3 As shown, in the embodiment of the present invention, after receiving the data collection instruction from the data center, the edge gateway enters the data collection execution process, and the specific steps are as follows:

[0049] S201. The edge gateway receives and parses the data collection instruction and completes the comparison operation.

[0050] In this embodiment, the edge gateway first comprehensively parses the received data collection instructions, and compares the parsing results with the local configuration library. Based on the comparison results, the configuration information in the local configuration library is replaced or retained to the latest version to ensure the accuracy of the collection task.

[0051] S202: The edge gateway obtains the corresponding communication protocol and communication address according to the analysis result, and attempts to establish a connection with the device.

[0052] In this embodiment, the edge gateway attempts to establish a connection with the target device based on the communication protocol and address information in the data acquisition instruction. Since the data acquisition instruction changes in real time, the edge gateway dynamically adjusts the communication connection relationship between the edge gateway and various industrial devices according to the dynamically changing communication protocol to facilitate subsequent data acquisition operations.

[0053] S203, query whether there is a collection period queue matching the current collection point, if so, add a task, if not, create a new queue.

[0054] In this embodiment, if the current configuration information is the latest version and the edge gateway establishes a connection with the target device, the system will enter the data collection stage. At the same time, the edge gateway monitors and adjusts the collected data in real time. During the monitoring process, if a change in the communication protocol or device status is detected, the rule engine can automatically adjust the data collection process and continue the data collection task. The above settings can ensure the accuracy and real-time performance of data collection;

[0055] During the monitoring process, if changes in the communication protocol or device status are detected, the rule engine can automatically adjust the data collection process and continue the data collection task.

[0056] During the data collection process, the edge gateway monitors the collection points and collection cycles in the collection items in real time, and adjusts the collection data configuration according to whether the collection points are in the collection queue and the consistency of the collection cycle. The specific implementation process is as follows:

[0057] When a collection point is collecting data and the collection cycle remains unchanged, the collection point continues to be executed according to the original collection cycle;

[0058] When a collection point is collecting and the collection cycle changes, the data collection module will remove the collection point from the original collection queue and create a new collection queue for data collection.

[0059] When the collection point is a newly added collection point, the edge gateway first checks whether there is a matching collection cycle queue;

[0060] When there are queues with the same collection cycle, the collection points are reallocated to the queues of the corresponding collection cycle for data collection.

[0061] When there is no queue with the same collection cycle, the edge gateway will create a new collection queue and place the collection point task in it.

[0062] It is understandable that in order to optimize the execution efficiency of the collection tasks, the edge gateway will check the existing collection cycle queue to ensure that each collection task can be executed at the appropriate time point, and can efficiently perform data collection tasks to ensure the timeliness and accuracy of the collected data.

[0063] S204: After entering the task queue, execute the data collection operation to obtain the required collection data.

[0064] Through the above process, the edge gateway in this embodiment dynamically configures the communication protocol type according to the needs of different industrial equipment, automatically adapts the equipment communication address and data transmission format, and realizes data collection, processing and execution of corresponding operations through flexible rule configuration according to different product types and equipment parameters of industrial equipment. The edge gateway can efficiently perform data collection tasks and ensure the timeliness and accuracy of collected data.

[0065] See also Figure 4 As shown, in the embodiment of the present invention, after acquiring the collected data, the edge gateway enters the data cleaning and storage processing stage, and the specific steps are as follows:

[0066] S301. The edge gateway completes data collection and obtains corresponding raw data.

[0067] In this embodiment, after completing the collection task, the edge gateway will obtain the required original data, which will serve as the basis for subsequent processing.

[0068] S302: Obtain cleaning rules corresponding to the current collected data.

[0069] In this embodiment, the edge gateway classifies and preprocesses the collected raw data according to the cleaning rules to improve the data quality.

[0070] S303: Input, filter and output the collected data according to the cleaning rules.

[0071] In this embodiment, the data cleaning process is divided into input data checking, filtering abnormal data, and outputting data that complies with the rules. This process ensures the accuracy and consistency of the data.

[0072] S304. Confirm the connection status with the data center through the heartbeat packet. If the connection is normal, upload the cleaned data.

[0073] In this embodiment, the edge gateway confirms the connection status with the data center by sending heartbeat packets regularly to ensure that data can be uploaded to the data center in a timely manner and that configuration rules can be downloaded in a timely manner.

[0074] S305: If the connection with the data center is disconnected, adjust the data storage strategy according to the local storage capacity.

[0075] In this embodiment, when the edge gateway detects that it is disconnected from the data center, it will perform data storage management based on the capacity of the local storage to ensure that important data is not lost.

[0076] S306: After the connection with the data center is reestablished, the locally stored data is uploaded to the data center and the local storage is cleared.

[0077] Through the above steps, this embodiment ensures that data can still be stored and managed safely and reliably even when the network is unstable.

[0078] See also Figure 5 As shown, in the embodiment of the present invention, after receiving the data from the edge gateway, the data center enters the data processing and storage stage, and the specific steps are as follows:

[0079] S401. The data center receives collected data from the edge gateway.

[0080] In this embodiment, the data center, as the final storage point for collected data, will first receive the cleaned data uploaded from the edge gateway.

[0081] S402: Acquire processing configuration rules corresponding to the collected data.

[0082] In this embodiment, the data center further processes and optimizes the received cleaning data according to preset configuration rules.

[0083] S403: Input, filter and output data according to the configuration rules.

[0084] In this embodiment, the data processing process is similar to the cleaning process of the edge gateway, but the data center will perform higher-level data processing according to its own configuration rules for subsequent storage or distribution.

[0085] S404: Store the cleaned data in a local database or a cloud server.

[0086] Through the above process, this embodiment ensures that the data can be safely stored in the data center or further output to other data platforms after multi-layer processing, thereby providing high-quality data support for subsequent analysis and application. Among them, for the data uploaded to the data center, the data center will process it according to the needs of the data, and the processing includes rule arrangement. The data center provides a simple drag-and-drop method, and the process is as follows:

[0087] First select the starting node. In fact, the node only has output and no input, such as a certain device, a certain parameter of a device, and a timer.

[0088] Then select the intermediate node, which contains input and output. The input is such as the data output of the starting node. The intermediate node performs function writing judgment or data filtering, etc. It can execute multiple intermediate nodes and can realize serial or parallel operation.

[0089] Finally, select the output of the end node. It can set the output data to the outside. It adapts to multiple protocols, such as http, mqtt and other protocols. It can also output alarms and storage.

[0090] The rule engine module realizes the decoupling of the data collection process from the specific device protocol logic. The collection logic is defined by the rule engine script to ensure the flexibility and scalability of the data collection process and adapt to the needs of different industrial scenarios. The decoupling design enables the data collection process to quickly adapt to the access of new devices and new protocols without major modifications to the underlying code.

[0091] A data collection and processing system for implementing a data collection and processing method based on a rule engine, comprising:

[0092] The data center module is used to output data collection instructions and regularly output configuration instructions;

[0093] The rule engine module is used to define, manage and execute data collection rules, including the parsing instruction module, the fault detection and processing module and the real-time data monitoring module;

[0094] The parsing instruction module is used to receive and parse data acquisition instructions and configuration instructions, and then output device information, configuration information, communication address, communication protocol, acquisition items, and cleaning rules related to the device; dynamically adjust the communication connection relationship between the data acquisition module and various industrial devices according to the dynamically changing communication protocol, and obtain the latest configuration version according to the configuration information after the connection is successful;

[0095] The fault detection and processing module is used to monitor in real time the communication faults and data anomalies that may occur during the data collection process, and automatically adjust the data collection process according to the preset strategy, or report the fault information to the cloud server.

[0096] The real-time data monitoring module monitors the collected data during the data collection phase and adjusts the type of collected data according to the collection rules;

[0097] The data collection module is used to perform collection tasks according to collection items and obtain raw data;

[0098] The data processing module is used to perform preliminary processing on the original data according to the cleaning rules, and upload the processed data to the data center; the data uploaded to the data center is further processed and stored on the data platform of the data center module or other devices.

[0099] Communication failures include connection failures between the rule engine module and the central system, rule engine module failures, and rule engine module storage capacity exceeding limit failures.

[0100] When the communication failure is a connection failure between the rule engine module and the central system, the fault detection and processing module will store the collected data in the local time series database and record the disconnection time; when the connection is restored, the fault detection and processing module will transmit the stored data back to the central system with a timestamp.

[0101] When the communication failure is a rule engine module failure, the data center module will automatically mark the rule engine module and all its subordinate devices as offline and trigger an alarm mechanism.

[0102] When the communication failure is caused by the storage capacity exceeding the limit of the rule engine module, the system automatically cleans up the previous data to save the new data. At the same time, the rule engine module will give priority to retaining key data such as alarm data and store it separately.

[0103] The system can store key data locally or upload it to a cloud server via a secure network protocol based on the conditions set by the rule engine;

[0104] Supports retrospective analysis of historical data and dynamic adjustment of rules to improve the overall data management capabilities of the system.

[0105] A data acquisition device: The data acquisition device includes a memory, a processor and a rule engine system running on the processor, and is used to implement a data acquisition and processing method.

[0106] Through the above settings, the present invention solves the problems of low efficiency and insufficient flexibility in data collection and processing in the prior art. The present invention combines a data collection module, a rule engine module and a data processing module to realize automatic data collection from multiple data sources, and performs real-time processing and analysis according to user-defined rules. The system is highly configurable and can flexibly adjust the collection and processing rules according to different application scenarios, significantly improving the efficiency and accuracy of data processing. The present invention is suitable for various application scenarios that require large-scale data processing and real-time analysis, such as finance, medical care, the Internet of Things and other fields.

[0107] A person skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, such as ROM / RAM, disk, CD-ROM, etc.

[0108] The above disclosure is only the preferred embodiment of the present invention, which certainly cannot be used to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

[0109] It should be noted that the embodiments of the present invention can be implemented by hardware, software or a combination of software and hardware. The hardware part can be implemented using dedicated logic; the software part can be stored in a memory and executed by an appropriate instruction execution system, such as a microprocessor or dedicated design hardware. Those skilled in the art will appreciate that the above-mentioned devices and methods can be implemented using computer executable instructions and / or contained in processor control codes, such as such codes provided on a programmable memory or a data carrier such as an optical or electronic signal carrier.

[0110] In addition, although the operation of the method of the present invention is described in a particular order in the accompanying drawings, this does not require or imply that these operations must be performed in this particular order, or that all the operations shown must be performed to achieve the desired result. On the contrary, the steps described in the flow chart can change the order of execution. Additionally or alternatively, some steps can be omitted, multiple steps can be combined into one step for execution, and / or one step can be decomposed into multiple steps for execution. It should also be noted that the features and functions of two or more devices according to the present invention can be embodied in one device. On the contrary, the features and functions of a device described above can be further divided into being embodied by multiple devices.

[0111] Although the invention has been described with reference to several specific embodiments, it should be understood that the invention is not limited to the specific embodiments disclosed. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims

1. A data collection and processing method based on a rule engine, characterized in that: The following steps are involved: The data center module outputs data collection instructions and configuration instructions to the rule engine module; The rule engine module receives and parses data collection instructions and configuration instructions, and outputs device information, configuration information, communication address, communication protocol, collection items, and cleaning rules related to the device; The rule engine module compares the configuration information with the local configuration library to obtain the latest configuration version, and updates the local configuration library to the latest version; The rule engine module dynamically adjusts the communication connection relationship between the data acquisition module and various devices according to the dynamically changing communication protocol; When the data acquisition module is connected to the device through communication, the data acquisition module performs the acquisition task according to the acquisition items and obtains the original data; The data processing module performs preliminary processing on the raw data according to the cleaning rules and uploads the processed data to the data center; The data processing module further processes the data uploaded to the data center and stores the processed data in the data center module or the data center of other devices.

2. The data collection and processing method based on rule engine according to claim 1 is characterized in that: If the current configuration information is the latest version and the data acquisition module is connected to the device for communication, the system enters the data acquisition stage. At the same time, the collection points and collection cycles in the collection items of the rule engine module are monitored in real time, and the data collection process is adjusted according to whether the collection points are in the collection queue and the consistency of the collection cycle.

3. The data collection and processing method based on rule engine according to claim 1, characterized in that: The data processing module divides the data cleaning process into input data checking, filtering abnormal data and outputting data that meets the rules according to the cleaning rules.

4. The data collection and processing method based on rule engine according to claim 3 is characterized in that: After the data cleaning is completed, the connection status between the rule engine module and the data center module is determined. The rule engine module determines whether to upload the cleaned data to the data center module according to the connection status and the preset trigger conditions.

5. The data collection and processing method based on rule engine according to claim 4 is characterized in that: The data processing module performs input, filtering and output processing on the cleaned data according to the configuration instructions, and stores the processed data in a local database or a cloud server.

6. The data collection and processing method based on rule engine according to claim 1, characterized in that: The rule engine module monitors in real time the communication failures and data anomalies that may occur during the data collection process. When communication failures and data anomalies occur, the rule engine module can automatically adjust the data collection process according to a preset strategy, or report the fault information to the cloud server.

7. A data acquisition and processing system, characterized in that: include: The data acquisition and processing system is used to implement the data acquisition and processing method based on the rule engine as described in any one of claims 1 to 6; Data center module, used to output data collection instructions and timed output configuration instructions; The rule engine module is used to receive and parse data collection instructions and configuration instructions, and output device information, configuration information, communication address, communication protocol, collection items, and cleaning rules related to the device; dynamically adjust the communication connection relationship between the data collection module and various devices according to the dynamically changing communication protocol; compare the configuration information with the local configuration library to obtain the latest configuration version and update the local configuration library to the latest configuration version; The data collection module is used to perform collection tasks according to collection items and obtain raw data; The data processing module is used to perform preliminary processing on the original data according to the cleaning rules and upload the processed data to the data center; the data uploaded to the data center is further processed and the processed data is stored in the data center module or other equipment's data center.

8. The data acquisition and processing system according to claim 7, characterized in that: The rule engine module includes a fault detection and processing module, and the communication fault includes a connection fault between the rule engine module and the data center module, a rule engine module fault, and a rule engine module storage capacity exceeding limit fault; When the communication fault is a connection failure between the rule engine module and the data center module, the fault detection and processing module stores the collected data in the local time series database and records the disconnection time; When the connection is restored, the fault detection and processing module transmits the stored collected data back to the data center module with a timestamp; When the communication failure is a rule engine module failure, the data center module will automatically mark the rule engine module and all its subordinate devices as offline and trigger the alarm mechanism; When the communication failure is caused by the storage capacity exceeding the limit of the rule engine module, the system automatically cleans up the previous data to save the new data. At the same time, the rule engine module will give priority to retaining key data such as alarm data and store it separately.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a data acquisition program for implementing the data acquisition method according to any one of claims 1 to 6; A data acquisition device, characterized in that: The data acquisition device includes a memory, a processor, and a rule engine system running on the processor, and is used to implement the data acquisition and processing method according to any one of claims 1 to 6.