Collected data distribution method, device and equipment based on scada system and storage medium

Abstract

The invention belongs to the technical field of data transmission, and discloses a collected data distribution method, device and equipment based on an scada system and a storage medium, corresponding labels are set for intelligent sensors needing to be monitored through a management end of the scada system, subscription rules and the labels corresponding to the intelligent sensors are bound and then stored in a service library, and the intelligent sensors are distributed according to the subscription rules. The method comprises the following steps: processing original acquisition data which is received by an access layer of an scada system and is uploaded by an intelligent sensor needing to be monitored, transmitting the original acquisition data to a real-time computing platform through message middleware, and generating a routing table by the real-time computing platform according to subscription rule data and intelligent sensor label data, after the message transmitted by the message-oriented middleware is matched with the routing table, the message is routed to the corresponding downstream application according to the routing mode and the routing address of the routing table, so that off-line analysis of transmission data is not needed, manual program writing and new distribution logic adding according to different requirements are not needed, and the stability and efficiency of data distribution transmission are ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to a method, device, equipment and storage medium for distributing collected data based on a SCADA system. Background Art

[0002] As an IoT collection and monitoring system, the SCADA system will first connect the raw data reported by the equipment to the SCADA system for analysis, and then route and distribute it to downstream applications as needed, such as simulation systems, diagnostic systems, work order systems, etc.

[0003] The current routing method mainly transmits data offline, or requires manual programming to add distribution logic according to different needs. This is not only prone to omissions and requires a lot of time to write programs, but also prone to errors during operation, affecting the original distribution logic.

[0004] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present invention is to provide a method, device, equipment and storage medium for distributing collected data based on the SCADA system, aiming to solve the technical problems of transmitting data in an offline manner or manually writing programs to add distribution logic according to different needs, which is not only prone to omissions and requires a lot of time to write programs, but also prone to errors during operation, affecting the original distribution logic.

[0006] To achieve the above object, the present invention provides a method for distributing collected data based on a SCADA system, and the method for distributing collected data based on a SCADA system comprises the following steps:

[0007] Determine the smart sensors that need to be monitored through the management end of the scada system and set corresponding tags for the smart sensors that need to be monitored;

[0008] Setting subscription rules through the management terminal of the SCADA system, binding the subscription rules with tags corresponding to the smart sensors, and storing the subscription rules and tags in a business library, wherein the subscription rules are used to enter at least a routing method and a routing address;

[0009] The access layer of the SCADA system receives the original collected data uploaded by the intelligent sensor to be monitored through the industrial control network, processes the original collected data, and transmits the processed collected data to the real-time computing platform through the message middleware;

[0010] Acquire subscription rule data and smart sensor tag data from the service library through the real-time computing platform, and generate a routing table according to the subscription rule data and the smart sensor tag data;

[0011] The real-time computing platform determines whether the message transmitted by the message middleware matches the routing table. If so, the message is routed to the corresponding downstream application according to the routing mode and routing address of the routing table.

[0012] In some embodiments, processing the raw collected data includes:

[0013] Analyzing the original collected data;

[0014] Determine cleaning conversion rules and workflow based on analysis results;

[0015] Verifying the cleaning conversion rules and workflow;

[0016] After the cleaning conversion rule and the workflow are verified, the original collected data is cleaned and converted according to the cleaning conversion rule and the workflow to obtain the cleaned and converted collected data;

[0017] The cleaned and converted collected data is used to replace the original collected data to obtain processed collected data.

[0018] In some embodiments, the cleaning and conversion of the original collected data according to the cleaning and conversion rules and workflow includes:

[0019] Determine abnormal data in the original collected data based on the analysis result;

[0020] Determining an abnormal form of the abnormal data, wherein the abnormal form at least includes missing data, wrong data, and inconsistent data;

[0021] Determine a corresponding attribute cleaning mode according to the abnormal form;

[0022] Cleaning the abnormal data of the corresponding abnormal form based on the attribute cleaning mode;

[0023] The cleaned data is converted into a unified format to obtain the cleaned and converted collected data.

[0024] In some embodiments, the processing of the collected data is transmitted to the real-time computing platform through the message middleware, including:

[0025] Read the subject attribute fields in the processed collected data;

[0026] Determine a corresponding channel object based on the subject attribute field;

[0027] The real-time computing platform sends a message subscription request to the message middleware;

[0028] After receiving the message subscription request, the message middleware searches for a corresponding object group in a hash mapping table used to maintain a subscription relationship, and extracts the channel object from the object group;

[0029] The message middleware transmits the processed collected data to the real-time computing platform through the channel object.

[0030] In some embodiments, the method further comprises:

[0031] Generate a corresponding message copy based on the processed collected data through the message middleware, and add the message copy to a delay queue;

[0032] After the message middleware transmits the processed collected data to the real-time computing platform, if the feedback result received from the real-time computing platform is that the data has been received, the message copy is removed from the delay queue; if the feedback result received from the real-time computing platform is that the data reception failed or the feedback result of the real-time computing platform is not received within a preset time, the message copy is retransmitted.

[0033] In some embodiments, generating a routing table according to the subscription rule data and the smart sensor tag data includes:

[0034] Determine a routing mode and a routing address based on the subscription rule data;

[0035] Acquire the smart sensor tag data corresponding to the routing mode and the routing address based on the binding relationship between the subscription rule and the tag of the smart sensor;

[0036] The smart sensor tag data is used as a routing identifier, and the routing identifier is combined with a corresponding routing method and a routing address to generate a routing table.

[0037] In some embodiments, the determining, by the real-time computing platform, whether the message transmitted by the message middleware matches the routing table includes:

[0038] Extracting a smart sensor tag from a message transmitted by the message middleware through the real-time computing platform;

[0039] The smart sensor tag is queried in the routing table through the real-time computing platform. If the smart sensor tag data in the routing table corresponds one-to-one with the smart sensor tag extracted from the message transmitted by the message middleware, it is determined that the message transmitted by the message middleware matches the routing table. If there is at least one non-corresponding smart sensor tag, it is determined that the message transmitted by the message middleware does not match the routing table.

[0040] In addition, to achieve the above-mentioned purpose, the present invention also proposes a collection data distribution device based on the SCADA system, and the collection data distribution device based on the SCADA system includes:

[0041] The label setting module is used to determine the smart sensors that need to be monitored through the management end of the SCADA system and set corresponding labels for the smart sensors that need to be monitored;

[0042] A tag binding module, used to set subscription rules through the management end of the SCADA system, bind the subscription rules to the tags corresponding to the smart sensors, and store the subscription rules and the tags in a business library, wherein the subscription rules are used to enter at least a routing method and a routing address;

[0043] A data processing module is used to receive the original collected data uploaded by the intelligent sensor to be monitored through the industrial control network through the access layer of the SCADA system, process the original collected data, and transmit the processed collected data to the real-time computing platform through the message middleware;

[0044] A routing table generation module, used to obtain subscription rule data and smart sensor tag data from the business library through the real-time computing platform, and generate a routing table according to the subscription rule data and the smart sensor tag data;

[0045] The data transmission module is used to determine whether the message transmitted by the message middleware matches the routing table through the real-time computing platform. If so, the message is routed to the corresponding downstream application according to the routing mode and routing address of the routing table.

[0046] In addition, to achieve the above-mentioned purpose, the present invention also proposes a SCADA system-based data collection distribution device, which includes: a memory, a processor, and a SCADA system-based data collection distribution program stored in the memory and executable on the processor, and the SCADA system-based data collection distribution program is configured to implement the steps of the SCADA system-based data collection distribution method as described above.

[0047] In addition, to achieve the above-mentioned purpose, the present invention also proposes a storage medium, on which a SCADA system-based data collection distribution program is stored. When the SCADA system-based data collection distribution program is executed by a processor, the steps of the SCADA system-based data collection distribution method as described above are implemented.

[0048] The present invention sets corresponding tags for smart sensors that need to be monitored through the management end of the SCADA system, and stores the subscription rules and the tags corresponding to the smart sensors in the business library after binding them. The original collected data uploaded by the smart sensors that need to be monitored and received through the access layer of the SCADA system are processed and then transmitted to the real-time computing platform through the message middleware. The real-time computing platform generates a routing table according to the subscription rule data and the smart sensor tag data. After the message transmitted by the message middleware matches the routing table, the message is routed to the corresponding downstream application according to the routing mode and routing address of the routing table. Not only does it not need to analyze the transmitted data offline, but it also does not need to manually write programs to add distribution logic according to different requirements, thereby ensuring the stability and efficiency of data distribution and transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 It is a flow chart of the first embodiment of the method for distributing collected data based on the SCADA system of the present invention;

[0050] Figure 2 It is a schematic diagram of the overall data distribution process in the data collection distribution method based on the SCADA system of the present invention;

[0051] Figure 3 It is a structural block diagram of the first embodiment of the data collection and distribution device based on the SCADA system of the present invention.

[0052] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0053] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0054] The embodiment of the present invention provides a method for distributing collected data based on a scada system, referring to Figure 1 , Figure 1 It is a flow chart of a first embodiment of a method for distributing collected data based on a SCADA system according to the present invention.

[0055] In this embodiment, the collected data distribution method based on the SCADA system includes the following steps:

[0056] Step S10: Determine the smart sensors that need to be monitored through the management end of the scada system, and set corresponding tags for the smart sensors that need to be monitored.

[0057] In this embodiment, the execution subject of this embodiment is a data collection and distribution device based on the SCADA system, wherein the data collection and distribution device based on the SCADA system has functions such as data processing, data communication and program running. The data collection and distribution device based on the SCADA system can be a computer terminal device or other network device, and of course it can also be other devices with similar functions, and this embodiment does not limit this.

[0058] It should be noted that the current routing method mainly transmits data offline, or requires manual programming to add distribution logic according to different needs. This is not only prone to omissions and requires a lot of time to write programs, but also prone to errors during operation, affecting the original distribution logic.

[0059] In order to solve the above technical problems, this embodiment sets corresponding tags for smart sensors that need to be monitored through the management end of the SCADA system, and stores the subscription rules and the tags corresponding to the smart sensors in the business library after binding them. The original collected data uploaded by the smart sensors that need to be monitored and received through the access layer of the SCADA system are processed and transmitted to the real-time computing platform through the message middleware. The real-time computing platform generates a routing table according to the subscription rule data and the smart sensor tag data. After the message transmitted by the message middleware matches the routing table, the message is routed to the corresponding downstream application according to the routing method and routing address of the routing table. Not only does it not need to analyze the transmitted data offline, but it also does not need to manually write programs to add distribution logic according to different needs, thereby ensuring the stability and efficiency of data distribution and transmission. It can be specifically implemented as follows.

[0060] In the specific implementation, the overall process of this technical solution is to create a tag, add the sensor device to be monitored to the corresponding tag, create a subscription rule, enter the routing method, routing address, subscription message type (device information, object model information, collected data, alarm data, device status, etc.), and bind the tag. The real-time computing platform obtains the device tag data and subscription rule data from the business library to generate a routing table. The sensor device transmits the collected data to scada through the industrial control network. After receiving, parsing, cleaning, conversion and other operations, it is transmitted to the real-time computing platform through the message middleware. The real-time computing platform determines whether the message and the routing table match. If they match, the message is routed to the downstream application according to the routing method and routing address of the routing table. You can refer to Figure 2Specifically, in this embodiment, the management end of the scada system first determines the smart sensors that need to be monitored, and then sets corresponding tags for the smart sensors that need to be monitored.

[0061] Step S20: Setting subscription rules through the management terminal of the scada system, binding the subscription rules with the tags corresponding to the smart sensors, and storing the subscription rules and the tags in the business library.

[0062] After completing the tag setting through the management end of the scada system, in this embodiment, it is further necessary to set subscription rules with the help of the management end of the scada system. The set subscription rules are used to at least enter the routing method and routing address, and for the tag binding relationship set above, that is, one tag or one type of tag corresponds to one subscription rule, and it can be seen from the above that the subscription rule enters the routing method and routing address, so the routing method and routing address corresponding to the tag can also be obtained. After the above binding, after obtaining the data collected by each smart sensor, the data can be distributed according to the routing method and routing address corresponding to its tag.

[0063] Step S30: receiving the original collected data uploaded by the intelligent sensor to be monitored through the industrial control network through the access layer of the SCADA system, processing the original collected data, and transmitting the processed collected data to the real-time computing platform through the message middleware.

[0064] Data collection is completed by the access layer of the SCADA system. Specifically, the access layer of the SCADA system receives the original collected data uploaded by the smart sensors to be monitored through the industrial control network. Since there are abnormal data in the original collected data, and the data collected by the smart sensors are mostly used for subsequent detection and analysis, it is necessary to ensure the validity and accuracy of the data. For this reason, the original collected data needs to be processed in this embodiment. The processing process is specifically to analyze the original collected data; determine the cleaning conversion rules and workflow based on the analysis results; verify the cleaning conversion rules and workflow; after the cleaning conversion rules and workflow are verified, the original collected data is cleaned and converted according to the cleaning conversion rules and workflow to obtain the cleaned and converted collected data; replace the original collected data with the cleaned and converted collected data to obtain the processed collected data.

[0065] It should be noted that there are two main methods for data analysis: data derivation and data mining. Data derivation mainly analyzes a single attribute. Data derivation can obtain a lot of information about the attribute, such as data type, length, value range, discrete values ​​and their frequency of occurrence, number of different values, number of missing values, and typical string patterns. By understanding the data application field and applying mathematical statistics techniques, statistical values ​​such as the average value, median value, maximum value, minimum value and standard deviation of the attribute value can be obtained. Determine the cleaning transformation rules and workflows based on the analysis results to define the cleaning transformation rules and workflows based on the results of the data analysis in the previous step, that is, different cleaning transformation rules and workflows for different abnormal data. The verification of the cleaning transformation rules and workflows can be performed on the data samples of the data source for cleaning verification. When the cleaning requirements are not met, the cleaning transformation rules, workflows or system parameters should be adjusted and improved.

[0066] Furthermore, the process of cleaning and converting the original collected data according to the cleaning conversion rules and workflow specifically includes determining abnormal data in the original collected data based on the analysis results; determining the abnormal form of the abnormal data, and the abnormal form at least includes data missing, data error and data inconsistency; determining a corresponding attribute cleaning mode according to the abnormal form; cleaning the abnormal data of the corresponding abnormal form based on the attribute cleaning mode; converting the cleaned data to a unified format to obtain the collected data after cleaning and conversion.

[0067] It should be noted that the cleaning conversion rules and workflows, that is, the cleaning modes corresponding to different abnormal data, and the workflows, that is, the flow of data, deletion or replacement, etc. In this embodiment, the cleaning mode collected for data missing is derived from the data source or other data sources. The missing value can be replaced by the average value, median value, maximum value, minimum value or more complex probability statistical function value, or a reasonable preset value can be manually entered. The cleaning mode adopted for data errors is to use a simple rule library (common sense rules, business-specific rules, etc.) to detect and correct errors, or to correct them based on external historical data. The cleaning mode adopted for data inconsistency is to uniformly transform inconsistent data through standard library functions.

[0068] After obtaining the collected data after the above processing, in this embodiment, the subject attribute field in the processed collected data is read; the corresponding channel object is determined based on the subject attribute field; the real-time computing platform sends a message subscription request to the message middleware; after the message middleware receives the message subscription request, it searches the hash mapping table used to maintain the subscription relationship for the corresponding object group, and extracts the channel object from the object group; the message middleware transmits the processed collected data to the real-time computing platform through the channel object. It should be noted that the hash mapping table for maintaining the subscription relationship is pre-built, and the channel object can be the interface of the message middleware. The data distribution interface can be determined in the above manner to ensure the accuracy of data distribution.

[0069] Further, in order to ensure the stability of data transmission and prevent data leakage caused by delay, the message middleware in this embodiment generates a corresponding message copy based on the processed collected data, and adds the message copy to the delay queue. After the message middleware transmits the processed collected data to the real-time computing platform, it will receive the feedback result of the real-time computing platform in real time. If the feedback result is that the data has been received, it means that the real-time computing platform has successfully received the message transmitted by the message middleware. In this case, the message copy can be removed from the delay queue. If the feedback result is that the data reception fails or the feedback result of the real-time computing platform is not received within the preset time, it means that the message transmission of the message middleware fails. For this situation, the previously saved message copy is retransmitted in this embodiment. It can be understood that the data is transmitted in real time. As the message middleware gradually sends messages, the corresponding message copies will be deleted synchronously. When the message is not received, the retransmission is also the corresponding part of the message in the message copy that the real-time computing platform has not received, not all the message copies.

[0070] Step S40: acquiring subscription rule data and smart sensor tag data from the business library through the real-time computing platform, and generating a routing table according to the subscription rule data and the smart sensor tag data.

[0071] In a specific implementation, generating a routing table according to the subscription rule data and the smart sensor tag data specifically includes determining a routing method and a routing address based on the subscription rule data; obtaining the smart sensor tag data corresponding to the routing method and the routing address based on a binding relationship between the subscription rule and the tag of the smart sensor; using the smart sensor tag data as a routing identifier, combining the routing identifier with the corresponding routing method and routing address to generate a routing table, wherein the constructed routing table has a mapping relationship between each smart sensor and the routing identifier and the corresponding routing method, and based on the routing table, accurate distribution of data collected by the tagged smart sensors can be achieved.

[0072] Step S50: determining, through the real-time computing platform, whether the message transmitted by the message middleware matches the routing table; if so, routing the message to a corresponding downstream application according to the routing mode and routing address of the routing table.

[0073] In order to ensure the accuracy of distribution, the real-time computing platform also needs to determine whether the message transmitted by the message middleware matches the routing table. Specifically, the real-time computing platform extracts the smart sensor tag from the message transmitted by the message middleware. If the smart sensor tag data in the routing table corresponds one-to-one with the smart sensor tag extracted from the message transmitted by the message middleware, it is determined that the message transmitted by the message middleware matches the routing table. If there is at least one non-corresponding smart sensor tag, it is determined that the message transmitted by the message middleware does not match the routing table.

[0074] In this embodiment, the management end of the SCADA system sets corresponding tags for the smart sensors that need to be monitored, and stores the subscription rules and the tags corresponding to the smart sensors in the business library after binding them. The original collected data uploaded by the smart sensors that need to be monitored and received through the access layer of the SCADA system are processed and then transmitted to the real-time computing platform through the message middleware. The real-time computing platform generates a routing table according to the subscription rule data and the smart sensor tag data. After the message transmitted by the message middleware matches the routing table, the message is routed to the corresponding downstream application according to the routing method and routing address of the routing table. Not only does it not need to analyze the transmitted data offline, but it also does not need to manually write programs to add distribution logic according to different needs, thereby ensuring the stability and efficiency of data distribution and transmission.

[0075] In addition, an embodiment of the present invention further proposes a storage medium, on which a SCADA system-based data collection distribution program is stored. When the SCADA system-based data collection distribution program is executed by a processor, the steps of the SCADA system-based data collection distribution method described above are implemented.

[0076] Reference Figure 3 , Figure 3 It is a structural block diagram of the first embodiment of the data collection and distribution device based on the SCADA system of the present invention.

[0077] like Figure 3 As shown, the SCADA system-based data collection and distribution device proposed in an embodiment of the present invention includes:

[0078] The label setting module 10 is used to determine the smart sensors that need to be monitored through the management end of the SCADA system and set corresponding labels for the smart sensors that need to be monitored.

[0079] The tag binding module 20 is used to set subscription rules through the management end of the scada system, bind the subscription rules to the tags corresponding to the smart sensors, and store the subscription rules and the tags in the business library, wherein the subscription rules are used to enter at least the routing method and routing address.

[0080] The data processing module 30 is used to receive the original collected data uploaded by the intelligent sensors to be monitored through the industrial control network through the access layer of the SCADA system, process the original collected data, and transmit the processed collected data to the real-time computing platform through the message middleware.

[0081] The routing table generation module 40 is used to obtain subscription rule data and smart sensor tag data from the business library through the real-time computing platform, and generate a routing table according to the subscription rule data and the smart sensor tag data.

[0082] The data transmission module 50 is used to determine whether the message transmitted by the message middleware matches the routing table through the real-time computing platform. If so, the message is routed to the corresponding downstream application according to the routing mode and routing address of the routing table.

[0083] In this embodiment, the management end of the SCADA system sets corresponding tags for the smart sensors that need to be monitored, and stores the subscription rules and the tags corresponding to the smart sensors in the business library after binding them. The original collected data uploaded by the smart sensors that need to be monitored and received through the access layer of the SCADA system are processed and then transmitted to the real-time computing platform through the message middleware. The real-time computing platform generates a routing table according to the subscription rule data and the smart sensor tag data. After the message transmitted by the message middleware matches the routing table, the message is routed to the corresponding downstream application according to the routing method and routing address of the routing table. Not only does it not need to analyze the transmitted data offline, but it also does not need to manually write programs to add distribution logic according to different needs, thereby ensuring the stability and efficiency of data distribution and transmission.

[0084] In some embodiments, the data processing module 30 is used to analyze the original collected data; determine the cleaning conversion rules and workflow based on the analysis results; verify the cleaning conversion rules and workflow; after the cleaning conversion rules and workflow pass the verification, clean and convert the original collected data according to the cleaning conversion rules and workflow to obtain cleaned and converted collected data; replace the original collected data with the cleaned and converted collected data to obtain processed collected data.

[0085] In some embodiments, the data processing module 30 is used to determine abnormal data in the original collected data based on the analysis results; determine the abnormal form of the abnormal data, and the abnormal form includes at least data missing, data error and data inconsistency; determine the corresponding attribute cleaning mode according to the abnormal form; clean the abnormal data of the corresponding abnormal form based on the attribute cleaning mode; convert the cleaned data to a unified format to obtain the collected data after cleaning and conversion.

[0086] In some embodiments, the data processing module 30 is used to read the subject attribute field in the processed collected data; determine the corresponding channel object based on the subject attribute field; the real-time computing platform sends a message subscription request to the message middleware; after the message middleware receives the message subscription request, it searches the hash mapping table used to maintain the subscription relationship for the corresponding object group, and extracts the channel object from the object group; the message middleware transmits the processed collected data to the real-time computing platform through the channel object.

[0087] In some embodiments, the data processing module 30 is used to generate a corresponding message copy based on the processed collected data through the message middleware, and add the message copy to a delay queue; after the message middleware transmits the processed collected data to the real-time computing platform, if the feedback result received from the real-time computing platform is that the data has been received, the message copy is removed from the delay queue; if the feedback result received from the real-time computing platform is that the data reception failed or the feedback result of the real-time computing platform is not received within a preset time, the message copy is retransmitted.

[0088] In some embodiments, the routing table generation module 40 is used to determine the routing method and routing address based on the subscription rule data; obtain the smart sensor tag data corresponding to the routing method and the routing address based on the binding relationship between the subscription rule and the tag of the smart sensor; use the smart sensor tag data as the routing identifier, and combine the routing identifier with the corresponding routing method and routing address to generate a routing table.

[0089] In some embodiments, the data transmission module 50 is used to extract the smart sensor tag from the message transmitted by the message middleware through the real-time computing platform; query the smart sensor tag in the routing table through the real-time computing platform, if the smart sensor tag data in the routing table corresponds one-to-one with the smart sensor tag extracted from the message transmitted by the message middleware, then it is determined that the message transmitted by the message middleware matches the routing table; if there is at least one non-corresponding smart sensor tag, then it is determined that the message transmitted by the message middleware does not match the routing table.

[0090] An embodiment of the present application also provides a data collection and distribution device based on the SCADA system, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus, and the memory is used to store a data collection and distribution program based on the SCADA system; the processor is used to implement the above-mentioned data collection and distribution method based on the SCADA system when executing the program stored in the memory.

[0091] The communication bus mentioned in the above SCADA-based data collection and distribution device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc.

[0092] The communication interface is used for communication between the above-mentioned SCADA system-based data collection and distribution device and other devices.

[0093] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0094] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, and discrete hardware components.

[0095] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk (SSD)), etc.

[0096] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0097] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0098] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

[0099] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.

[0100] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.

[0101] In addition, for technical details not described in detail in this embodiment, please refer to the SCADA system-based collection data distribution method provided in any embodiment of the present invention, which will not be repeated here.

[0102] In addition, it should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0103] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0104] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0105] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

[0106] It is understandable that the system provided by the embodiment of the present invention corresponds to the method provided by the embodiment of the present invention, and the explanation, examples and beneficial effects of the relevant contents can refer to the corresponding parts in the above method.

Claims

1. A method for distributing collected data based on a SCADA system, characterized in that: The SCADA system-based data collection and distribution method includes: Determine the smart sensors that need to be monitored through the management end of the scada system and set corresponding tags for the smart sensors that need to be monitored; Setting subscription rules through the management terminal of the SCADA system, binding the subscription rules with tags corresponding to the smart sensors, and storing the subscription rules and tags in a business library, wherein the subscription rules are used to enter at least a routing method and a routing address; The access layer of the SCADA system receives the original collected data uploaded by the intelligent sensor to be monitored through the industrial control network, processes the original collected data, and transmits the processed collected data to the real-time computing platform through the message middleware; Acquire subscription rule data and smart sensor tag data from the service library through the real-time computing platform, and generate a routing table according to the subscription rule data and the smart sensor tag data; The real-time computing platform determines whether the message transmitted by the message middleware matches the routing table. If so, the message is routed to the corresponding downstream application according to the routing mode and routing address of the routing table.

2. The method for distributing collected data based on the SCADA system according to claim 1, characterized in that: The processing of the original collected data comprises: Analyzing the original collected data; Determine cleaning conversion rules and workflow based on analysis results; Verifying the cleaning conversion rules and workflow; After the cleaning conversion rule and the workflow are verified, the original collected data is cleaned and converted according to the cleaning conversion rule and the workflow to obtain the cleaned and converted collected data; The cleaned and converted collected data is used to replace the original collected data to obtain processed collected data.

3. The method for distributing collected data based on the SCADA system according to claim 2, characterized in that: The cleaning and conversion of the original collected data according to the cleaning and conversion rules and workflow includes: Determine abnormal data in the original collected data based on the analysis result; Determining an abnormal form of the abnormal data, wherein the abnormal form at least includes missing data, wrong data, and inconsistent data; Determine a corresponding attribute cleaning mode according to the abnormal form; Cleaning the abnormal data of the corresponding abnormal form based on the attribute cleaning mode; The cleaned data is converted into a unified format to obtain the cleaned and converted collected data.

4. The method for distributing collected data based on the SCADA system according to claim 1, characterized in that: The method of transmitting the processed collected data to the real-time computing platform through the message middleware includes: Read the subject attribute fields in the processed collected data; Determine a corresponding channel object based on the subject attribute field; The real-time computing platform sends a message subscription request to the message middleware; After receiving the message subscription request, the message middleware searches for a corresponding object group in a hash mapping table used to maintain a subscription relationship, and extracts the channel object from the object group; The message middleware transmits the processed collected data to the real-time computing platform through the channel object.

5. The method for distributing collected data based on the SCADA system according to claim 4, characterized in that: The method further comprises: Generate a corresponding message copy based on the processed collected data through the message middleware, and add the message copy to a delay queue; After the message middleware transmits the processed collected data to the real-time computing platform, if the feedback result received from the real-time computing platform is that the data has been received, the message copy is removed from the delay queue; if the feedback result received from the real-time computing platform is that the data reception failed or the feedback result of the real-time computing platform is not received within a preset time, the message copy is retransmitted.

6. The method for distributing collected data based on the SCADA system according to claim 1, characterized in that: The generating of a routing table according to the subscription rule data and the smart sensor tag data comprises: Determine a routing mode and a routing address based on the subscription rule data; Acquire the smart sensor tag data corresponding to the routing mode and the routing address based on the binding relationship between the subscription rule and the tag of the smart sensor; The smart sensor tag data is used as a routing identifier, and the routing identifier is combined with a corresponding routing method and a routing address to generate a routing table.

7. The method for distributing collected data based on the SCADA system according to any one of claims 1 to 6, characterized in that: The determining, by the real-time computing platform, whether the message transmitted by the message middleware matches the routing table includes: Extracting a smart sensor tag from a message transmitted by the message middleware through the real-time computing platform; The smart sensor tag is queried in the routing table through the real-time computing platform. If the smart sensor tag data in the routing table corresponds one-to-one with the smart sensor tag extracted from the message transmitted by the message middleware, it is determined that the message transmitted by the message middleware matches the routing table. If there is at least one non-corresponding smart sensor tag, it is determined that the message transmitted by the message middleware does not match the routing table.

8. A collection data distribution device based on the SCADA system, characterized in that: The SCADA system-based data collection and distribution device comprises: The label setting module is used to determine the smart sensors that need to be monitored through the management end of the SCADA system and set corresponding labels for the smart sensors that need to be monitored; A tag binding module, used to set subscription rules through the management end of the SCADA system, bind the subscription rules to the tags corresponding to the smart sensors, and store the subscription rules and the tags in a business library, wherein the subscription rules are used to enter at least a routing method and a routing address; A data processing module is used to receive the original collected data uploaded by the intelligent sensor to be monitored through the industrial control network through the access layer of the SCADA system, process the original collected data, and transmit the processed collected data to the real-time computing platform through the message middleware; A routing table generation module, used to obtain subscription rule data and smart sensor tag data from the business library through the real-time computing platform, and generate a routing table according to the subscription rule data and the smart sensor tag data; The data transmission module is used to determine whether the message transmitted by the message middleware matches the routing table through the real-time computing platform. If so, the message is routed to the corresponding downstream application according to the routing mode and routing address of the routing table.

9. A data collection and distribution device based on the SCADA system, characterized in that: The SCADA system-based data collection distribution device includes: a memory, a processor, and a SCADA system-based data collection distribution program stored in the memory and executable on the processor, wherein the SCADA system-based data collection distribution program is configured to implement the steps of the SCADA system-based data collection distribution method as described in any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores a SCADA system-based data collection distribution program, which, when executed by a processor, implements the steps of the SCADA system-based data collection distribution method as described in any one of claims 1 to 7.

Images