Equipment data acquisition and processing method based on message driving

Abstract

An equipment data acquisition and processing method based on message driving comprises a construction step used for constructing a unified equipment model which at least comprises an equipment ledger module, an equipment type module, an equipment communication protocol module, an equipment operation parameter module, a parameter constant value module and an alarm event definition module; the data acquisition step is used for subscribing information from a queue for a consumer of the data, and the information comprises but is not limited to an equipment communication protocol, an operation parameter and a parameter fixed value; the data acquisition module is also used for realizing data acquisition, including but not limited to equipment operation data, abnormal information and the like, of various automatic equipment for a data producer according to subscribed equipment information, and sending real-time data to a message queue; wherein the message queue is used for receiving and releasing real-time data and providing high-performance real-time data service for various business applications.

Description

Technical Field

[0001] The present application relates to the field of information technology, and in particular to a device data collection and processing method based on message drive. Background Art

[0002] With the urgent need for my country's enterprises to transform to intelligent manufacturing and build digital factories, more and more manufacturing companies are adopting MES / MOM systems to improve the company's internal management level, and equipment data collection is an important component. By collecting equipment operation status data in real time, the MES system can help companies timely grasp the operation of equipment, including equipment temperature, humidity, vibration, current and other parameters, thereby optimizing equipment resource allocation and improving equipment utilization. However, there is a lack of appropriate centralized equipment management methods, resulting in poor safety. Summary of the invention

[0003] In order to improve the security of the State Grid intranet data, the present application provides a message-driven device data collection and processing method.

[0004] In order to achieve the above-mentioned purpose, the embodiment of the present application proposes a device data collection and processing method based on message drive, including:

[0005] A construction step for constructing a unified equipment model, wherein the equipment model at least includes: an equipment ledger module, an equipment type module, an equipment communication protocol module, an equipment operation parameter module, a parameter setting module, and an alarm event definition module;

[0006] The data collection step is used to subscribe information from the queue for data consumers, and the information includes but is not limited to: device communication protocol, operating parameters, parameter settings; it is also used for data producers to realize data collection of various types of automation equipment based on the subscribed device information, including but not limited to: device operation data, abnormal information, etc., and send real-time data to the message queue; wherein the message queue is used to receive and publish real-time data, providing high-performance real-time data services for various business applications.

[0007] Wherein, in the data collection step, the analog quantity in the real-time data is sent up periodically, and the state quantity changes are sent up;

[0008] The data label format is: device name + "." + data name;

[0009] The data includes at least the following fields:

[0010] Property Name type Is this field required? Attribute Chinese name name String yes Chinese measuring point name value String yes Measurement value quality String no Measurement quality code: 0 is valid, 1 is invalid dateTime String yes Data time, the format is yyyy-MM-dd hh:mm:ss .

[0011] The message format at least includes: topic and partition;

[0012] Topic: A topic represents a factory;

[0013] Partition: A partition represents a type of device, and devices of the same type use the same partition;

[0014] The message includes at least the following fields:

[0015]

[0016] Wherein, the method further comprises:

[0017] The time series database establishment step is used to establish a time series database, which is used to store massive data for a long time and provide a data basis for product quality traceability; the time series database provides an API interface to provide real-time data and historical data query services for other applications.

[0018] Wherein, the method further comprises:

[0019] Business application steps are used to obtain real-time data from the message queue and consume real-time data to implement business. The business includes:

[0020] The historical query sub-step is used to query real-time data and historical data from the time series database to provide data sources for other applications;

[0021] The equipment status monitoring sub-step is used to monitor the equipment's operating parameters, startup and shutdown status, and ambient temperature;

[0022] The equipment process parameter monitoring sub-step is used to bind the product process with the equipment operating parameters, compare the fixed values ​​of the process parameters, and realize product quality monitoring and quality traceability;

[0023] The device alarm sub-step is used to analyze the device data according to the device parameter set value, and to alarm when the device data exceeds the set value.

[0024] The beneficial effects of the above technical solutions of the present application are as follows: The disclosed embodiment proposes a message-driven device data collection and processing method. The production workshop network and the office network are isolated by a firewall to ensure the safety of the production equipment. The communication program collects the operation data of the workshop equipment to the front-end data gateway, and the front-end data gateway uploads the real-time data to the message queue platform through the firewall. The MES system subscribes to and consumes real-time data according to business needs, and finally realizes business applications based on real-time data of the equipment. The disclosed embodiment constructs an overall system framework of the automation equipment layer, network layer, message queue, and application layer to realize a loosely coupled application system such as real-time data collection, aggregation, distribution, and application, thereby improving the scalability of the MES / MOM system. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 It is a schematic diagram of the framework of the embodiment of the present disclosure;

[0026] Figure 2 Schematic diagram of an embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] In order to make the technical problems, technical solutions and advantages to be solved by the present application clearer, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.

[0028] The present disclosure provides a message-driven device data collection and processing method, including:

[0029] Build a unified equipment model, including equipment records, operating parameters, alarm parameters, communication protocols, etc., to form the basis for equipment management and data collection, integrate various types of business with equipment data, and perform unified data storage and analysis, ultimately realizing the analysis and application of various businesses.

[0030] Technical architecture see Figure 2 From the perspective of data and applications, it includes three parts: data collection system, message queue platform, historical data storage, and business applications. Among them:

[0031] 1. Equipment Model

[0032] Build a unified equipment model, including equipment records, equipment types, equipment communication protocols, equipment operating parameters, parameter settings, alarm event definitions, etc. As a data producer, send equipment communication protocols and parameter settings to the message queue.

[0033] 2. Data acquisition system

[0034] As a data consumer, it subscribes to information such as device communication protocols, operating parameters, parameter settings, etc. from the queue. As a producer, the data acquisition system collects data from various types of automation equipment based on the subscribed device information, including device operating data, abnormal information, etc., and sends real-time data to the message queue. Real-time data transmission adopts the following rules:

[0035] Analog quantity is sent periodically, and state quantity changes are sent;

[0036] The naming rule of data labels is: device name + "." data name, for example, "Device No. 1. Temperature".

[0037] 3. Message Queues

[0038] The message queue is responsible for receiving and publishing real-time data, providing high-performance real-time data services for various business applications. To support multi-factory data distribution, the message definition adopts the following rules:

[0039] Topic: A topic represents a factory;

[0040] Partition: A partition represents a type of device. Devices of the same type use the same partition.

[0041] Message body definition:

[0042]

[0043]

[0044] data format definition

[0045] Property Name type Is this field required? Attribute Chinese name illustrate name String yes Chinese measuring point name value String yes Measurement value quality String no Measurement quality code: 0 is valid, 1 is invalid dateTime String yes Data time, in the format of yyyy-MM-dd hh:mm:ss

[0046] Real-time data example:

[0047]

[0048] 3. Time Series Database

[0049] The time series database subscribes to real-time data and stores it. The purpose of using a time series database is to store massive amounts of data for a long time and provide a data basis for product quality traceability. The time series database provides an API interface to provide real-time data and historical data query services for other applications.

[0050] 4. Business Application

[0051] As a data consumer, business applications obtain real-time data from the message queue and consume real-time data to implement specific business:

[0052] (1) Historical Query

[0053] Query real-time and historical data from the time series database to provide data sources for other applications.

[0054] (2) Equipment status monitoring

[0055] Realize the monitoring of equipment’s operating parameters, startup and shutdown status, ambient temperature, etc.

[0056] (3) Equipment process parameter monitoring

[0057] Bind product process with equipment operating parameters, compare set values ​​of process parameters, and achieve product quality monitoring and quality traceability.

[0058] (4) Equipment alarm

[0059] The device data is analyzed according to the device parameter settings, and an alarm is triggered when the device data exceeds the settings.

[0060] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs. When the computer program is loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage medium such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density digital video disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0061] A person skilled in the art may understand that the various numerical numbers such as first and second involved in the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application, and also indicate the order of precedence.

[0062] At least one in the present application can also be described as one or more, and a plurality can be two, three, four or more, which is not limited in the present application. In the embodiments of the present application, for a technical feature, the technical features in the technical feature are distinguished by "first", "second", "third", "A", "B", "C" and "D", etc., and there is no order of precedence or size between the technical features described by the "first", "second", "third", "A", "B", "C" and "D".

[0063] The corresponding relationships shown in each table in the present application can be configured or predefined. The values ​​of the information in each table are only examples and can be configured as other values, which are not limited by the present application. When configuring the corresponding relationship between the information and each parameter, it is not necessarily required to configure all the corresponding relationships illustrated in each table. For example, in the table in the present application, the corresponding relationships shown in some rows may not be configured. For another example, appropriate deformation adjustments can be made based on the above table, such as splitting, merging, etc. The names of the parameters shown in the titles of the above tables can also use other names that can be understood by the communication device, and the values ​​or representations of the parameters can also be other values ​​or representations that can be understood by the communication device. When implementing the above tables, other data structures can also be used, such as arrays, queues, containers, stacks, linear lists, pointers, linked lists, trees, graphs, structures, classes, heaps, hash tables or hash tables.

[0064] The predefined in the present application may be understood as defined, predefined, stored, pre-stored, pre-negotiated, pre-configured, solidified, or pre-burned.

[0065] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0066] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0067] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A device data collection and processing method based on message drive, characterized in that: include: A construction step for constructing a unified equipment model, wherein the equipment model at least includes: an equipment ledger module, an equipment type module, an equipment communication protocol module, an equipment operation parameter module, a parameter setting module, and an alarm event definition module; The data collection step is used to subscribe information from the queue for data consumers, and the information includes but is not limited to: device communication protocol, operating parameters, parameter settings; it is also used for data producers to realize data collection of various types of automation equipment based on the subscribed device information, including but not limited to: device operation data, abnormal information, etc., and send real-time data to the message queue; wherein the message queue is used to receive and publish real-time data, providing high-performance real-time data services for various business applications.

2. The device data acquisition and processing method based on message drive according to claim 1, wherein in the data acquisition step, the analog quantity in the real-time data is sent up periodically, and the state quantity is sent up when it changes; The data label format is: device name + ".." + data name; The data includes at least the following fields:

3. The device data collection and processing method based on message drive according to claim 1, wherein the message format at least includes: Theme, partition; in, Topic: A topic represents a factory; Partition: A partition represents a type of device, and devices of the same type use the same partition; The message includes at least the following fields:

4. The device data collection and processing method based on message drive according to claim 1, the method further comprises: A time series database establishment step is used to establish a time series database, wherein the time series database is used to store massive data for a long time and provide a data basis for product quality traceability; The time series database provides an API interface to provide real-time data and historical data query services for other applications.

5. The device data collection and processing method based on message drive according to claim 1, the method further comprises: Business application step, used to obtain real-time information from the message queue and consume real-time data to implement business; The business includes: The historical query sub-step is used to query real-time data and historical data from the time series database to provide data sources for other applications; The equipment status monitoring sub-step is used to monitor the equipment's operating parameters, startup and shutdown status, and ambient temperature; The equipment process parameter monitoring sub-step is used to bind the product process with the equipment operating parameters, compare the fixed values ​​of the process parameters, and realize product quality monitoring and quality traceability; The device alarm sub-step is used to analyze the device data according to the device parameter set value, and to alarm when the device data exceeds the set value.

Images