Industrial equipment data acquisition system for being integrated with MES (Manufacturing Execution System)

Abstract

The invention discloses an industrial equipment data acquisition system for being integrated with an MES system, and the system comprises a system architecture module which is used for constructing a programming architecture and a system architecture of the industrial equipment data acquisition system; the data storage module is used for storing and preprocessing equipment data and process data of industrial equipment; various types of integrated configurable gateway components used for supporting the equipment to upload data are integrated in the gateway configuration module, and various protocols are correspondingly configured for the various types of integrated configurable gateway components; the data protocol analysis module is used for performing protocol analysis on the process data uploaded by the industrial equipment; and the data interface docking module is used for being integrated with an industrial equipment data acquisition and manufacturing execution system and providing equipment data query, process data query and equipment state query functions. The invention also discloses an application of the industrial equipment data acquisition system integrated with the MES system in the MES system. The MES system is provided with an MES system data integration interface correspondingly connected with the data interface docking module.

Description

Technical Field

[0001] The present invention relates to the fields of industrial equipment data collection, system integration and industrial automation technology, and in particular to a technical solution for integrating industrial equipment data collection with a manufacturing execution system (MES), aiming to achieve efficient, accurate and independent data collection and real-time monitoring. Background Art

[0002] In modern industrial production, real-time and accurate collection of industrial equipment data is of great significance for improving production efficiency, ensuring product quality, and realizing intelligent manufacturing. However, the existing industrial equipment data collection systems generally have the following problems:

[0003] 1. Data collection is not timely and there are delays;

[0004] 2. The accuracy of data collection is insufficient, which affects decision-making;

[0005] 3. Complex system integration, low scalability and high maintenance cost;

[0006] 4. Data collection is highly coupled with system business, which affects the normal use of system business and increases the system load;

[0007] 5. The lack of unified data standards and interfaces makes large-scale system integration and data sharing difficult.

[0008] In order to overcome the deficiencies in the prior art, it is necessary to provide an efficient, accurate and easily integrated industrial equipment data acquisition system and method. Summary of the invention

[0009] In order to solve the problems existing in the prior art, the present invention provides an industrial equipment data acquisition system for integration with a MES system.

[0010] On one hand, the present invention provides an industrial equipment data acquisition system for integration with an MES system, comprising: a system architecture module, a data storage module, a gateway configuration module, a data protocol analysis module and a data interface docking module; wherein:

[0011] The system architecture module is used to construct the programming architecture and system architecture of the industrial equipment data acquisition system;

[0012] The data storage module is used to store and pre-process the equipment data and process data of the industrial equipment;

[0013] The gateway configuration module integrates multiple types of integrated configurable gateway components for supporting devices to upload data, and multiple protocols are configured correspondingly for the multiple types of integrated configurable gateway components;

[0014] The data protocol analysis module is used to perform protocol analysis on the process data uploaded by the industrial equipment;

[0015] The data interface docking module is used to integrate with industrial equipment data acquisition and manufacturing execution systems, providing equipment data query, process data query and equipment status query functions.

[0016] Preferably, the system architecture module adopts Spring Responsive programming architecture and SpringCloud system architecture.

[0017] Preferably, the data storage module adopts the ElasticSearch storage engine and MySQL composite data storage solution.

[0018] Preferably, the data storage module also includes: a Redis storage subsystem, which periodically writes the updated industrial equipment data into the storage hardware or writes the modification operations on the industrial equipment data into an additional record file, thereby realizing master-slave synchronization; at the same time, as a high-performance key-value database, it has a publish / subscribe mechanism, so that when the tree formed by the industrial equipment data is synchronized from the database anywhere, it can subscribe to a channel and receive the complete message publishing record of the main server.

[0019] Preferably, the preprocessing includes data cleaning and format conversion operations.

[0020] Preferably, the multiple protocols include one or more of MQTT, OPC, PLC, TCP and WEBSOCKET protocols.

[0021] Preferably, the data protocol analysis module adopts a dynamic configuration method.

[0022] Preferably, the process of protocol analysis includes:

[0023] Collecting data packets corresponding to the process data;

[0024] Customize and develop message data protocol analysis packages according to the needs of different manufacturers and brands;

[0025] Uploading the message data protocol analysis package to a server through the system;

[0026] Setting a device association protocol package associated with the message data protocol analysis package;

[0027] The system dynamically calls the message data protocol analysis package and the associated protocol package by reflection to parse the collected data packets.

[0028] Preferably, the data interface in the data interface docking module is an API interface.

[0029] The second aspect of the present invention is to provide an application of an industrial equipment data acquisition system for integration with an MES system in an MES system, characterized in that the MES system is provided with an MES system data integration interface corresponding to the data interface docking module of the industrial equipment data acquisition system of the first aspect.

[0030] The system and application provided by the present invention have the following beneficial effects:

[0031] Compared with the existing data collection system, this data collection system is more robust, scalable and compatible. There is no need to frequently modify the system and the original code in the future. It only needs to develop independent protocol packages in a targeted manner, which greatly reduces the risks brought by later development. At the same time, it can handle the concurrent data reported by multiple devices faster and more effectively, greatly avoiding the risk of application service downtime caused by concurrent data. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 This is a schematic diagram of the structure of the industrial equipment data acquisition system for integration with the MES system described in the present invention. DETAILED DESCRIPTION

[0033] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0034] Embodiment 1

[0035] See also Figure 1 This embodiment provides an industrial equipment data acquisition system for integration with an MES system, including: a system architecture module, a data storage module, a gateway configuration module, a data protocol analysis module and a data interface docking module; wherein:

[0036] System architecture module, used to build programming architecture and system architecture of industrial equipment data acquisition system;

[0037] As a preferred implementation, the system architecture module adopts the Spring Reactive responsive programming architecture and the SpringCloud system architecture; the programming method using the Spring Reactive responsive programming architecture is different from the traditional imperative programming, which effectively improves the system throughput, and also prevents the risk of excessive data blocking the system due to excessive data volume and untimely system processing, which ultimately leads to system downtime; at the same time, the SpringCloud system architecture is adopted to maximize the solution to the system load problem;

[0038] The data storage module is used to store and pre-process equipment data and process data of industrial equipment;

[0039] As a preferred implementation, the data storage module adopts the ElasticSearch storage engine and MySQL composite data storage solution. The process data of the equipment is transmitted frequently and in large quantities, and the ElasticSearch storage engine is used to pre-process the original data; MySQL is used as the storage medium for basic data to persist equipment data and process parameters;

[0040] As a preferred embodiment, the data storage module also includes: a Redis storage subsystem, which periodically writes updated industrial equipment data into storage hardware or writes modification operations on industrial equipment data into additional record files, thereby realizing master-slave synchronization; at the same time, as a high-performance key-value database, it has a publish / subscribe mechanism, so that when the tree formed by synchronizing industrial equipment data from the database anywhere, it can subscribe to a channel and receive the complete message publishing record of the main server.

[0041] Redis is a key-value storage system. Similar to Memcached, it supports more types of values, including string, list, set, zset (sorted set) and hash. These data types support push / pop, add / remove, intersection, union, difference and richer operations, and these operations are atomic. On this basis, Redis supports various sorting methods. Like memcached, in order to ensure efficiency, data is cached in memory. The difference is that Redis will periodically write updated data to disk or write modification operations to additional record files, and on this basis, master-slave synchronization is realized. Redis is a high-performance key-value database. The emergence of Redis has largely compensated for the shortcomings of key / value storage such as memcached, and can play a good supplementary role to relational databases in some occasions. It provides clients for Java, C / C++, C#, PHP, JavaScript, Perl, Object-C, Python, Ruby, Erlang, etc., which are very convenient to use. Redis supports master-slave synchronization. Data can be synchronized from the master server to any number of slave servers, and the slave server can be a master server associated with other slave servers. This allows Redis to perform single-layer tree replication. Data can be written intentionally or unintentionally when saving to disk. Since the publish / subscribe mechanism is fully implemented, when synchronizing the tree from the database anywhere, it can subscribe to a channel and receive the complete message publishing record of the master server. Synchronization is very helpful for the scalability of read operations and data redundancy.

[0042] As a preferred implementation, preprocessing includes data cleaning and format conversion operations, thereby improving the storage and query efficiency of process data reported by the equipment.

[0043] The gateway configuration module integrates various types of integrated configurable gateway components to support device data upload. Multiple protocols are configured for each type of integrated configurable gateway component. The system can flexibly configure gateways of different protocols and is compatible with the access of multiple devices, maximizing scalability while reducing subsequent maintenance and development costs.

[0044] As a preferred embodiment, multiple protocols include but are not limited to MQTT, OPC, PLC, TCP and WEBSOCKET protocols. For example, Figure 1As shown, brand 1 devices support TCP protocol, brand 2 devices support MQTT protocol, brand 3 devices support OPC protocol, brand 4 devices support PLC protocol, and brand X devices support other protocols including WEBSOCKET protocol. The integrated configurable gateway components formed thereby include TCP-1, TCP-2, TCP-3, TCP-N, MQTT-1, MQTT-2, MQTT-3, MQTT-4, OPC-1, OPC-2, OPC-3, OPC-N, PLC-1, PLC-2, PLC-3, PLC-N, other-1, other-2, other-3, and other-N.

[0045] The data protocol analysis module uses a dynamic configuration method to perform protocol analysis on process data uploaded by industrial equipment. This eliminates the need to suspend application services to update protocols during system operation, reduces subsequent maintenance costs, and improves production efficiency.

[0046] As a preferred implementation, the process of protocol analysis includes:

[0047] Collect data packets corresponding to process data;

[0048] Customize and develop message data protocol analysis packages according to the needs of different manufacturers and brands; (for example, Figure 1 The device protocol package of brand 1, brand 2, brand 3, brand 4, and brand X are shown.

[0049] Upload the message data protocol analysis package to the server through the system;

[0050] Set the device association protocol package associated with the message data protocol analysis package;

[0051] The system dynamically calls the message data protocol analysis package and the associated protocol package by reflection to parse the collected data packets.

[0052] The data interface docking module is used to integrate with industrial equipment data collection and manufacturing execution system (MES system), providing equipment data query, process data query and equipment status query functions.

[0053] As a preferred embodiment, the data interface in the data interface docking module is an API interface. Of course, those skilled in the art should know that other forms of interfaces can also be used. As long as the interface is suitable for data exchange and is compatible with the data and services of the industrial equipment data acquisition and manufacturing execution system, it is within the scope of protection of the present invention.

[0054] The data acquisition system is made into a separate application system, decoupled from the business system, so relevant API interfaces are provided for business system calls, such as equipment data query, process data query, and equipment status query.

[0055] Embodiment 2

[0056] This embodiment provides an application of an industrial equipment data acquisition system integrated with an MES system in the MES system. The MES system is provided with an MES system data integration interface correspondingly connected to the data interface docking module of the industrial equipment data acquisition system of the first embodiment.

[0057] Although preferred embodiments of the present invention have been described, additional changes and modifications may be made to these embodiments by those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention. Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An industrial equipment data acquisition system for integration with an MES system, characterized in that: include: System architecture module, data storage module, gateway configuration module, data protocol analysis module and data interface docking module; among which: The system architecture module is used to construct the programming architecture and system architecture of the industrial equipment data acquisition system; The data storage module is used to store and pre-process the equipment data and process data of the industrial equipment; The gateway configuration module integrates multiple types of integrated configurable gateway components for supporting devices to upload data, and multiple protocols are configured correspondingly for the multiple types of integrated configurable gateway components; The data protocol analysis module is used to perform protocol analysis on the process data uploaded by the industrial equipment; The data interface docking module is used to integrate with industrial equipment data acquisition and manufacturing execution systems, providing equipment data query, process data query and equipment status query functions.

2. The industrial equipment data acquisition system for integration with the MES system according to claim 1, characterized in that: The system architecture module adopts Spring Reactive responsive programming architecture and SpringCloud system architecture.

3. The industrial equipment data acquisition system for integration with the MES system according to claim 2, characterized in that: The data storage module adopts the composite data storage solution of ElasticSearch storage engine and MySQL.

4. The industrial equipment data acquisition system for integration with the MES system according to claim 3, characterized in that: The data storage module also includes: a Redis storage subsystem, which periodically writes the updated industrial equipment data into the storage hardware or writes the modification operations on the industrial equipment data into the additional record file, thereby realizing master-slave synchronization; at the same time, as a high-performance key-value database with a publish / subscribe mechanism, when the slave database synchronizes the tree formed by the industrial equipment data anywhere, it can subscribe to a channel and receive the complete message publishing record of the master server.

5. The industrial equipment data acquisition system for integration with the MES system according to claim 4, characterized in that: The preprocessing includes data cleaning and format conversion operations.

6. The industrial equipment data acquisition system for integration with the MES system according to claim 5, characterized in that: The multiple protocols include one or more of MQTT, OPC, PLC, TCP and WEBSOCKET protocols.

7. An industrial equipment data acquisition system for integration with an MES system according to claim 6, characterized in that: The data protocol analysis module adopts dynamic configuration.

8. The industrial equipment data acquisition system for integration with the MES system according to claim 7, characterized in that: The process of protocol analysis includes: Collecting data packets corresponding to the process data; Customize and develop message data protocol analysis packages according to the needs of different manufacturers and brands; Uploading the message data protocol analysis package to a server through the system; Setting a device association protocol package associated with the message data protocol analysis package; The system dynamically calls the message data protocol analysis package and the associated protocol package by reflection to parse the collected data packets.

9. The industrial equipment data acquisition system for integration with the MES system according to claim 8, characterized in that: The data interface in the data interface docking module is an API interface.

10. An application of the industrial equipment data acquisition system for integration with an MES system according to any one of claims 1 to 9 in an MES system, characterized in that: The MES system is provided with an MES system data integration interface correspondingly connected to the data interface docking module of the industrial equipment data acquisition system according to any one of claims 1-9.

Images