Data acquisition method and device and electronic equipment
The standardized configuration model generates configuration parameters suitable for industrial equipment, which solves the problems of protocol diversity, configuration complexity and maintenance difficulties faced by industrial gateways in data collection, and achieves efficient and accurate data acquisition and reduces operation and maintenance costs.
Patent Information
- Application Number
- CN202411998469.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-31
- Publication Date
- 2025-04-22
AI Technical Summary
Industrial gateways face protocol diversity, configuration complexity and maintenance difficulties in the data acquisition process, which makes it difficult to ensure data acquisition efficiency and accuracy, increasing operation and maintenance costs.
The standardized configuration model generates configuration parameters that meet the characteristics of industrial equipment, including data acquisition model and point configuration information, and automatically generates configuration parameters that meet different industrial protocols and equipment acquisition requirements, determines the acquisition rules and performs data acquisition based on the preset acquisition frequency.
It simplifies the configuration process, improves the efficiency and accuracy of data acquisition, reduces the operation and maintenance costs of industrial gateways, and promotes the standardization of industrial data integration and analysis.
Smart Images

Figure CN119861626A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of industrial Internet technology, and more specifically, to a data collection method, device and electronic equipment. Background Art
[0002] In the wave of industrial automation and digital transformation, the importance of the Industrial Internet of Things as a bridge connecting the physical world and the digital world is self-evident. As a key component of the Industrial Internet of Things, the industrial gateway is responsible for integrating and transmitting data from industrial equipment to the cloud or data center to support advanced applications such as data analysis and machine learning.
[0003] However, with the diversification of industrial equipment and the increasing complexity of communication protocols, industrial gateways are also facing a series of challenges in data collection and equipment configuration, such as protocol diversity, complex configuration, high development and maintenance costs, different data processing and reporting standards, difficulty in ensuring real-time accuracy, and insufficient flexibility and scalability of system architecture. These problems not only increase the difficulty of work for on-site operation and maintenance personnel, but also limit the efficiency and accuracy of data collection, and constitute an obstacle to industrial digital transformation and intelligent upgrading.
[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention
[0005] The embodiments of the present application provide a data collection method, device and electronic device to at least solve the technical problems of protocol diversity, configuration complexity and maintenance difficulty existing in the data collection process of industrial gateways.
[0006] According to one aspect of an embodiment of the present application, a data collection method is provided, including: generating configuration parameters that conform to the characteristics of industrial equipment through a standardized configuration model, wherein the configuration parameters include at least a data collection model and point configuration information corresponding to the industrial equipment, the standardized configuration model automatically generates configuration parameters corresponding to the characteristics of the industrial equipment to adapt to different industrial protocols and equipment collection requirements, the data collection model is used to define the structure and format of data collection, and the point configuration information is used to guide the industrial gateway device to collect data from the industrial equipment; determining the collection rules for the industrial equipment based on the configuration parameters; and collecting data from the target industrial equipment based on the collection rules and a preset collection frequency.
[0007] Optionally, the industrial gateway device includes protocol middleware, wherein the protocol middleware defines application function standards, and the application function standards are used to determine the operating environment requirements, configuration file requirements, data acquisition model parsing, data reporting methods and command structures of all industrial protocols in the industrial gateway device.
[0008] Optionally, the protocol middleware also includes a protocol information library, wherein the protocol information library is used to store the protocol structure, data acquisition model, function code and data type of all industrial protocols in the industrial gateway device.
[0009] Optionally, the standardized configuration model is determined in the following manner: all industrial protocols in the industrial gateway device are decoupled according to the protocol information library to obtain decoupling information, wherein the decoupling information includes channel configuration information corresponding to the device configuration and data acquisition information corresponding to the data acquisition; and the standardized configuration model is determined based on the decoupling information.
[0010] Optionally, the method further includes: determining a connection channel corresponding to the industrial equipment according to the channel configuration information; and determining a data acquisition model corresponding to the industrial equipment according to the data acquisition information.
[0011] Optionally, the preset collection frequency is determined by: acquiring real-time data and historical data corresponding to the industrial equipment; determining the data level and data change rate of the real-time data, wherein the data level is used to indicate the degree of impact of the real-time data in the industrial production process; and determining the preset collection frequency based on the data level, data change rate and historical data.
[0012] Optionally, after collecting data from the target industrial equipment according to the collection rules and the preset collection frequency, the method also includes: uploading the collected data to the cloud platform for processing through a preset communication interface, wherein the collected data at least includes the operating status, parameter settings and fault information of the target industrial equipment.
[0013] According to another aspect of an embodiment of the present application, a data collection device is also provided, including: a generation module, used to generate configuration parameters that meet the characteristics of industrial equipment through a standardized configuration model, wherein the configuration parameters include at least a data collection model and point configuration information corresponding to the industrial equipment, the standardized configuration model automatically generates configuration parameters corresponding to the characteristics of the industrial equipment to adapt to different industrial protocols and equipment collection requirements, the data collection model is used to define the structure and format of data collection, and the point configuration information is used to guide the industrial gateway device to collect data from the industrial equipment; a determination module, used to determine the collection rules of the industrial equipment based on the configuration parameters; and a collection module, used to collect data from the target industrial equipment based on the collection rules and a preset collection frequency.
[0014] According to another aspect of the embodiments of the present application, there is also provided an electronic device, including: a memory and a processor, wherein the memory is used to store program instructions; the processor is connected to the memory and is used to execute the above-mentioned data acquisition method.
[0015] According to another aspect of the embodiments of the present application, a non-volatile storage medium is provided, the non-volatile storage medium includes a stored computer program, wherein the device where the non-volatile storage medium is located executes the above-mentioned data acquisition method by running the computer program.
[0016] According to another aspect of the embodiments of the present application, a computer program product is provided, including computer instructions, which implement the above data collection method when executed by a processor.
[0017] In an embodiment of the present application, configuration parameters that meet the characteristics of industrial equipment are generated through a standardized configuration model, wherein the configuration parameters include at least a data acquisition model and point configuration information corresponding to the industrial equipment. The standardized configuration model automatically generates configuration parameters corresponding to the characteristics of the industrial equipment to adapt to different industrial protocols and equipment acquisition requirements. The data acquisition model is used to define the structure and format of data acquisition, and the point configuration information is used to guide the industrial gateway device to collect data from the industrial equipment; the collection rules of the industrial equipment are determined based on the configuration parameters; data is collected from the target industrial equipment based on the collection rules and the preset collection frequency, thereby achieving the purpose of simplifying the configuration process and improving the efficiency and accuracy of data collection, thereby achieving the technical effect of reducing the operation and maintenance costs of the industrial gateway and promoting the standardization of industrial data integration and analysis, and further solving the technical problems of protocol diversity, configuration complexity and maintenance difficulty that exist in the data collection process of the industrial gateway. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0019] Figure 1 is a hardware structure diagram of a computer terminal for implementing a data acquisition method according to an embodiment of the present application;
[0020] Figure 2 is a flow chart of a data collection method according to an embodiment of the present application;
[0021] Figure 3 is a schematic diagram of a system architecture according to an embodiment of the present application;
[0022] Figure 4 is a business process diagram according to an embodiment of the present application;
[0023] Figure 5 It is a structural diagram of a data acquisition device according to an embodiment of the present application. DETAILED DESCRIPTION
[0024] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0025] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0026] First, some nouns or terms that appear in the process of explaining the embodiments of the present application are subject to the following explanations:
[0027] Industrial Internet of Things: Industrial Internet of Things refers to a system that connects industrial equipment, sensors, networks and software applications through Internet of Things technology to achieve efficient data collection, remote monitoring and intelligent analysis. Its goal is to improve industrial production efficiency, optimize resource utilization and improve product quality.
[0028] Industrial gateway: It is the core device in the industrial Internet of Things system, playing the role of data collector and data transmission channel, able to connect different types of industrial equipment and systems, and integrate data and transmit it to the cloud or data center. It usually has protocol conversion, data processing and edge computing capabilities.
[0029] Protocol middleware: A software component used to achieve interoperability between different industrial communication protocols. It provides a set of unified interfaces so that upper-layer applications do not need to care about the details of the underlying communication protocols, thereby simplifying the complexity of data acquisition and system integration.
[0030] Harbor: An open source, secure, and scalable container image repository. In the context of industrial IoT, Harbor is used to store and manage container images of protocol-driven components, enabling gateways to quickly deploy and update these components, simplifying the process of protocol integration and data collection.
[0031] Containerized environment: Containerization is an operating system-level virtualization technology that allows applications and their dependent environments to be packaged in lightweight containers and run independently. In industrial gateways, the containerized environment provides an operating environment for protocol-driven components, ensuring the isolation and portability of components and reducing system complexity.
[0032] Standardized configuration model: The standardized configuration model refers to a set of unified and standardized configuration rules and methods designed to simplify the configuration process during the industrial gateway data collection process. It can automatically generate corresponding configuration parameters according to different equipment requirements, improve configuration efficiency, reduce human errors, and improve the overall automation level and operation and maintenance efficiency of the system.
[0033] In order to solve the problem of poor data collection efficiency in the related art, the present application embodiment provides a data collection method, which can be run on Figure 1 In the computer terminal shown, the computer terminal is described below.
[0034] The data collection method embodiment provided in the embodiment of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Figure 1 FIG. 1 shows a hardware structure block diagram of a computer terminal for implementing a data acquisition method. Figure 1 As shown, the computer terminal 10 may include one or more (102a, 102b, ..., 102n are used to illustrate) processors (the processor may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission module 106 for communication functions connected via a wired and / or wireless network. In addition, it may also include: a display, a keyboard, a cursor control device, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the I / O interface), a network interface, and a BUS bus. Those skilled in the art can understand that Figure 1 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.
[0035] It should be noted that the one or more processors and / or other data processing circuits described above may generally be referred to herein as "data processing circuits". The data processing circuits may be embodied in whole or in part as software, hardware, firmware, or any other combination thereof. In addition, the data processing circuit may be a single independent processing module, or may be incorporated in whole or in part into any of the other components in the computer terminal 10. As described in the embodiments of the present application, the data processing circuit acts as a processor control (e.g., selection of a variable resistor terminal path connected to an interface).
[0036] The memory 104 can be used to store software programs and modules of application software, such as program instructions / data storage devices corresponding to the data acquisition method in the embodiment of the present application. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, realizing the above-mentioned data acquisition method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the computer terminal 10 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0037] The transmission module 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission module 106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission module 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.
[0038] The display may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the computer terminal 10 .
[0039] It should be noted that, in some optional embodiments, the above Figure 1 The computer terminal shown may include hardware elements (including circuits), software elements (including computer code stored on a computer-readable medium), or a combination of hardware elements and software elements. It should be noted that Figure 1 This is merely one example of a particular embodiment and is intended to illustrate the types of components that may be present in the computer terminal described above.
[0040] In the above-mentioned operating environment, an embodiment of the present application provides an embodiment of a data collection method. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0041] Figure 2 is a flow chart of a data collection method according to an embodiment of the present application, such as Figure 2 As shown, the method comprises the following steps:
[0042] Step S202, generating configuration parameters that meet the characteristics of industrial equipment through a standardized configuration model, wherein the configuration parameters include at least a data acquisition model and point configuration information corresponding to the industrial equipment. The standardized configuration model automatically generates configuration parameters corresponding to the characteristics of industrial equipment to adapt to different industrial protocols and equipment acquisition requirements. The data acquisition model is used to define the structure and format of data acquisition, and the point configuration information is used to guide the industrial gateway device to collect data from the industrial equipment.
[0043] In the above step S202, the standardized configuration model can automatically generate configuration parameters according to the characteristics of the industrial equipment. The configuration parameters include at least a data acquisition model and point configuration information, wherein the data acquisition model defines the structure and format of data acquisition and is a blueprint for data acquisition. It ensures that no matter what protocol the industrial equipment uses, the gateway can collect data according to a unified model, thereby reducing the complexity caused by protocol diversity and data format differences. Point configuration information provides a guide for the industrial gateway to collect data from specific industrial equipment, including the device ID, location, type, and collection frequency of the data point. By parsing the point configuration information, the gateway can locate the correct data collection point and perform accurate data collection.
[0044] Step S204: determining the collection rules of the industrial equipment according to the configuration parameters.
[0045] In the above step S204, the collection rule is the refinement and specificity of the data collection model and point configuration information, which includes which data to collect and how to collect, etc. By standardizing the configuration parameters generated by the configuration model, it can be ensured that the collection rules not only meet the equipment characteristics, but also meet the standardization requirements of data collection. This process makes data collection more systematic and lays a solid foundation for subsequent data processing and analysis.
[0046] Step S206: collect data from the target industrial equipment according to the collection rules and the preset collection frequency.
[0047] In the above step S206, the industrial gateway collects data from the target industrial equipment according to the collection rules and the preset collection frequency, such as real-time, timing or event-triggered. The collection rules are used to guide the specific operations of data collection, including which data points to read, which protocol to use, the logic of collection, etc. The preset collection frequency can be calculated by weighted average based on the level of data, the speed of change and historical data to ensure the real-time and accuracy of the data. For example, for parameters that change rapidly and need to be monitored in real time, the collection frequency may be set higher; while for parameters that change more slowly, the collection frequency is lower to balance the real-time and network load of the data.
[0048] Through the above steps S202 to S206, the purpose of simplifying the configuration process and improving the efficiency and accuracy of data collection is achieved, thereby achieving the technical effect of reducing the operation and maintenance cost of industrial gateways and promoting the standardization of industrial data integration and analysis, thereby solving the technical problems of protocol diversity, configuration complexity and maintenance difficulties in the data collection process of industrial gateways. The following is a detailed description.
[0049] In the above step S202, the industrial gateway device includes a protocol middleware, wherein the protocol middleware defines application function standards, and the application function standards are used to determine the operating environment requirements, configuration file requirements, data acquisition model parsing, data reporting methods and command structures of all industrial protocols in the industrial gateway device.
[0050] In the embodiment of the present application, the industrial gateway device realizes the unified management and efficient operation of multiple industrial protocols by integrating the protocol middleware. Among them, the application function standards defined by the protocol middleware cover the operating environment requirements of the industrial protocol, the specification of the configuration file, the parsing logic of the data acquisition model, the transmission protocol for data reporting, and the construction and parsing of commands. Specifically:
[0051] Operating environment requirements: The protocol middleware defines the minimum hardware and software environment required for the industrial protocol to run on the industrial gateway, ensuring the stability and compatibility of the protocol and reducing the uncertainty of on-site deployment.
[0052] Configuration file requirements: By setting a unified configuration file format and requirements, the gateway configuration work can be standardized, which simplifies the configuration process, reduces the possibility of configuration errors, and improves configuration efficiency.
[0053] Data collection model analysis: The data collection model analysis function in the protocol middleware can identify and analyze the data point models of different industrial equipment, automatically match the correct collection method, avoid the tedious work of manually configuring data points, and realize the automation of data collection.
[0054] Data reporting method: The protocol middleware unifies the transmission method of data reporting, such as through the MQTT protocol, ensuring the real-time and security of data transmission, while supporting multiple data reporting formats, improving data processability and analysis efficiency.
[0055] Command structure: The protocol middleware defines the command structure for communicating with industrial devices, enabling the industrial gateway to send instructions to different devices and receive feedback in a unified manner, enhancing the interoperability and flexibility of the gateway.
[0056] Optionally, the protocol middleware also includes a protocol information library, wherein the protocol information library is used to store the protocol structure, data acquisition model, function code and data type of all industrial protocols in the industrial gateway device.
[0057] In the embodiment of the present application, the protocol information library, as the core component of the protocol middleware, stores the key information of all industrial protocols in the industrial gateway device. Specifically:
[0058] Protocol structure: stores the basic framework and communication logic of various industrial protocols, ensuring that the gateway can understand and adapt to the communication mechanisms of different protocols and achieve interoperability between protocols.
[0059] Data collection model: Contains configuration information for data points, such as data address, data type, and collection frequency, so that the gateway can automatically identify and collect data based on these models without the need for complex configuration by on-site personnel.
[0060] Function code: As the key code in the industrial protocol, it determines the specific functions of the gateway's communication with the device, such as reading, writing or executing special functions. The function code set in the protocol information library provides a wealth of operating instructions to facilitate the gateway to perform various data collection tasks.
[0061] Data type: The protocol information library stores the data type information supported by different industrial protocols, which is crucial for data parsing and processing. It ensures that the gateway can correctly understand the data format sent by the device and perform accurate data conversion and reporting.
[0062] The existence of the protocol information library enables the protocol middleware to better manage industrial protocols. By storing key information of the protocol, it realizes the automatic configuration and standardized processing of data collection, reduces the complexity of on-site operations, improves the efficiency and accuracy of data collection, and also facilitates the maintenance and upgrade of industrial gateways. It is an important part of promoting the advancement of industrial Internet of Things data collection technology.
[0063] Optionally, the standardized configuration model is determined in the following manner: all industrial protocols in the industrial gateway device are decoupled according to the protocol information library to obtain decoupling information, wherein the decoupling information includes channel configuration information corresponding to the device configuration and data acquisition information corresponding to the data acquisition; and the standardized configuration model is determined based on the decoupling information.
[0064] In the embodiment of the present application, the process of determining the standardized configuration model is to deeply analyze and decouple all industrial protocols involved in the industrial gateway device, and this process is critically supported by the protocol information library. The specific process can be as follows:
[0065] First, based on the detailed information of all industrial protocols stored in the protocol information library, including protocol structure, data acquisition model, function code and data type, the protocol middleware is used to decouple various industrial protocols, that is, to separate and extract key information in the protocol that is directly related to device configuration and data acquisition, such as channel configuration information and data acquisition information. Channel configuration information defines the physical or logical path of the gateway to connect to the device, such as Ethernet port, serial port, etc., while data acquisition information clarifies the model, function code, data address and data type of the data point, which is the core of the data acquisition task.
[0066] Secondly, the decoupling information is used to build a dynamic standardized configuration model. The design of this standardized configuration model takes into account the commonalities and differences of different industrial equipment and can automatically generate configuration parameters suitable for specific equipment.
[0067] It should be noted that the generation of the standardized configuration model is based on a core assumption, that is, the public configuration of the same protocol under the industrial gateway is the same, which means that the model can generate a set of general configurations based on the characteristics of the protocol. At the same time, for the unique configuration of specific equipment, the model can generate customized parameters based on snapshots of point configuration and channel configuration, ensuring the accuracy and applicability of the configuration.
[0068] Through the above process, not only the decoupling of industrial protocols is achieved, so that different protocols and devices can be configured and managed under a unified framework, but also through the construction of a dynamic standardized configuration model, the gateway can automatically adapt to the configuration requirements of the equipment, greatly reducing the work difficulty of on-site operators and improving the efficiency and accuracy of data collection.
[0069] Furthermore, the above method also includes: determining a connection channel corresponding to the industrial equipment according to the channel configuration information; and determining a data acquisition model corresponding to the industrial equipment according to the data acquisition information.
[0070] In an embodiment of the present application, through the channel configuration information and data acquisition information in the protocol information library, the gateway can automatically determine the connection channel and data acquisition model corresponding to the industrial equipment. This process greatly simplifies the complexity of on-site configuration and improves the accuracy and efficiency of data acquisition.
[0071] Among them, the channel configuration information includes the details of the communication channel between the industrial gateway and the industrial equipment, such as the specific port number, baud rate, data bit, stop bit and other parameters of the Ethernet port and serial port, as well as whether encryption, authentication and other security configurations are required. Based on this information, the gateway can automatically identify and configure the connection channel with specific industrial equipment. For example, for devices based on Modbus TCP / IP, the gateway will configure the IP address and port number of the Ethernet port; for devices based on Modbus RTU, the serial port port number and baud rate will be configured. This automatic configuration process, while ensuring that the channel connection is correct, also greatly reduces the workload of on-site configuration, avoiding device connection failures or data transmission anomalies caused by manual configuration errors.
[0072] The data collection information covers key parameters such as the point configuration, function code, data address and data type of data collection. By parsing the data collection information, the gateway can generate data collection models for different industrial equipment. The data collection model defines how the gateway reads specific types of data from the device, including reading frequency, data parsing rules and data reporting format. For example, for sensor devices that need to collect real-time data such as temperature and pressure, the gateway will determine the data point model for high-frequency collection based on the data collection information; for PLC devices that need to read setting parameters, it will determine the data model for reading using specific function codes. The generation of these models enables the gateway to accurately identify the data structure and format of the device, ensuring the accuracy and completeness of data collection.
[0073] In the above step S206, the preset collection frequency is determined by: acquiring real-time data and historical data corresponding to the industrial equipment; determining the data level and data change rate of the real-time data, wherein the data level is used to indicate the degree of influence of the real-time data in the industrial production process; and determining the preset collection frequency based on the data level, data change rate and historical data.
[0074] In the embodiment of the present application, the method for determining the preset acquisition frequency is designed as a data-driven intelligent process, which comprehensively considers the data level, data change rate and historical data of real-time data, aiming to achieve a balance between the efficiency and accuracy of data acquisition. The specific process can be as follows:
[0075] First, the industrial gateway collects data such as real-time operating status, parameter settings, and fault information from industrial equipment through the established connection channel. At the same time, the gateway also obtains historical data of the equipment, including past operating parameters, fault records, and production efficiency, etc., to analyze the long-term change trends and periodic characteristics of the data.
[0076] Secondly, determine the data level and data change rate of real-time data. Among them, the data level of real-time data reflects the importance and impact of the data in the industrial production process. For example, the real-time data of the temperature sensor may have a direct impact on production safety and product quality, and is assigned a higher data level; while some non-critical parameters, such as the running time of the equipment, may have a lower data level. By monitoring the changes in real-time data in a short period of time (such as a few seconds or minutes), the gateway can determine the rate of change of the data. Data with a fast change rate (such as real-time parameters such as temperature and pressure) may require more frequent collection to ensure the real-time and accuracy of the data; while data with a slow change rate (such as equipment status or production batch information) can appropriately reduce the collection frequency to save network resources and processing overhead.
[0077] Finally, combining the data level and change rate of real-time data, as well as the analysis results of historical data, a weighted average calculation method is used to determine a reasonable preset collection frequency for each type of data. This frequency can ensure real-time monitoring of key data while avoiding excessive collection of non-key data, thus finding the best balance between the real-time nature and accuracy of data and the efficient use of system resources. For example, for data with high data levels and fast change rates, the preset collection frequency may be set to once per second; for data with low data levels and slow change rates, it may be set to once per hour or once per day.
[0078] Through the above process, the gateway can intelligently adjust the collection frequency, which not only meets the real-time data requirements of the industrial production process, but also reduces unnecessary data transmission and storage, improving the overall performance of the system. This design not only improves the intelligence level of data collection, but also provides key technical support for efficient data management of the Industrial Internet of Things.
[0079] Optionally, after collecting data from the target industrial equipment according to the collection rules and the preset collection frequency, the method also includes: uploading the collected data to the cloud platform for processing through a preset communication interface, wherein the collected data at least includes the operating status, parameter settings and fault information of the target industrial equipment.
[0080] In the embodiment of the present application, the industrial gateway uploads the collected data such as operating status, parameter settings and fault information to the cloud platform through the preset communication interface. This process not only realizes the real-time transmission of data, but also provides a rich data source for the cloud platform, supports advanced data analysis and decision support functions, and is a key step in data-driven production optimization and equipment health management in the industrial Internet of Things. The specific analysis is as follows:
[0081] First, the collected data includes the operating status, parameter settings and fault information of the target industrial equipment. Among them, the operating status data reflects the real-time operating status of the equipment, such as motor speed, temperature, pressure, etc., which is an important basis for evaluating the performance and health status of the equipment; the parameter setting data records the configuration parameters of the equipment, such as working mode, safety threshold, etc., which helps to understand the operating environment and settings of the equipment; the fault information includes the fault code and fault time of the equipment, which is crucial for fault diagnosis and preventive maintenance.
[0082] Secondly, the communication interface between the industrial gateway and the cloud platform is pre-set, and the most common one is the MQTT protocol or other IoT communication protocols. Among them, the MQTT protocol is lightweight and has low bandwidth usage, making it very suitable for data transmission in industrial IoT scenarios, especially in environments with unstable network conditions or limited bandwidth. The gateway will package the collected data and upload it to the cloud platform according to the preset communication configuration, such as server address, port number, topic, etc.
[0083] Finally, the data uploaded to the cloud platform will first be cleaned and preprocessed to remove invalid or abnormal data, and then stored in a time series database for historical query and trend analysis. The cloud platform will also use big data analysis technology to conduct in-depth data mining, such as predicting potential equipment failures through machine learning algorithms, optimizing production processes through real-time data analysis, and adjusting equipment operating parameters through equipment parameter setting data to improve equipment efficiency and safety.
[0084] Figure 3 Schematic diagram of a system architecture according to an embodiment of the present application. Figure 3 As shown in the figure, the system is an industrial Internet of Things data collection and management system that integrates the three-layer architecture of cloud, edge and end.
[0085] In the cloud, the gateway standard configuration module is responsible for generating standardized configuration files for different industrial protocols, while the data center module is used to store, analyze and manage data collected from industrial equipment. The edge layer, or the "edge" part, is composed of a Linux container environment, in which modules such as configuration file parsing, collection point model parsing, data processing and reporting configuration run in the container and interact directly with the industrial gateway. These modules are responsible for parsing the configuration sent by the cloud, processing data point models and configuration information, and reporting data to the cloud platform. At the bottom "end", industrial equipment such as PLC, CNC, and sensors are included. They are connected to the edge layer module through the industrial gateway and are the source of data collection. The figure also shows multiple protocol component instances of the industrial gateway, such as Modbus / S7 / MELSEC, etc. These instances run in the Linux container environment of the edge layer, which not only ensures the independence and interoperability of the protocol driver, but also facilitates management and upgrading. The connection channel configuration between the gateway and the device, such as Ethernet port, serial port, etc., and the data reporting configuration (such as MQTT protocol configuration) are all sent to the edge layer through the southbound interface of the cloud platform, realizing unified configuration management.
[0086] Figure 4 Schematic diagram of a business process according to an embodiment of the present application. Figure 4 As shown in the figure, the entire business process from gateway management to data reporting is explained in detail.
[0087] Specifically, the process starts from the platform part. The gateway management link ensures the association between the protocol and the device by installing the target protocol and binding it to a specific collection device, which is the basis for data collection. The interaction of device data is realized through the storage and reception functions of the platform, and further exchanges data with the opentsdb time series database for storage and analysis of the collected data. The edge gateway part shows the API interaction between the gateway and the edge engine. Through these interfaces, the protocol information can be transmitted, and the edge engine is responsible for processing specific data collection instructions. In the edge engine part, data processing, pulling protocol images and reporting data to the cloud platform are the core processes. The cloud platform sends configuration information through the southbound interface. After receiving it, the edge engine pulls the corresponding image from Harbor, installs the protocol component, and then collects data according to the configuration. The collected data is finally transmitted to the cloud platform through the data reporting configuration such as the MQTT protocol. The flowchart clarifies the association between data collection, configuration, monitoring and protocol, as well as key steps such as installation / upgrade, data synchronization and data monitoring test, ensuring the integrity of device data and the stability of the system.
[0088] In the embodiment of the present application, the long-standing problems of protocol diversity, configuration complexity and maintenance difficulties in traditional industrial data collection are effectively solved by intelligently configuring and managing the industrial gateway. By building a protocol middleware and a protocol information library, unified management and decoupling processing of different industrial protocols are achieved, thereby reducing the operating threshold of on-site installation and maintenance personnel; the introduction of a dynamic standardized configuration model enables the gateway to automatically generate configuration parameters according to equipment requirements, significantly improving the efficiency and accuracy of configuration; the intelligent determination algorithm of the preset acquisition frequency realizes the precision of data acquisition and the optimization of resource utilization based on data level, change rate and historical data analysis, avoiding the waste of resources caused by excessive acquisition; finally, unified management and analysis of data are achieved through the cloud platform, providing data support for the monitoring and fault prediction of industrial equipment.
[0089] Overall, this application innovatively integrates protocol decoupling, dynamic configuration, intelligent collection and cloud management technologies, providing a set of efficient, flexible and intelligent solutions for data collection and management of the Industrial Internet of Things, and promoting the process of industrial automation and digitalization.
[0090] According to an embodiment of the present application, a data acquisition device is provided. It should be noted that the data acquisition device of the embodiment of the present application can be used to execute the data acquisition method provided in the embodiment of the present application. The data acquisition device provided in the embodiment of the present application is introduced below.
[0091] Figure 5 is a structural diagram of a data acquisition device provided according to an embodiment of the present application. Figure 5 As shown, the device comprises:
[0092] A generation module 50, which is used to generate configuration parameters that meet the characteristics of industrial equipment through a standardized configuration model, wherein the configuration parameters at least include a data acquisition model and point configuration information corresponding to the industrial equipment. The standardized configuration model automatically generates configuration parameters corresponding to the characteristics of the industrial equipment to adapt to different industrial protocols and equipment acquisition requirements. The data acquisition model is used to define the structure and format of data acquisition, and the point configuration information is used to guide the industrial gateway device to collect data from the industrial equipment;
[0093] A determination module 52, for determining a collection rule for industrial equipment according to configuration parameters;
[0094] The collection module 54 is used to collect data from the target industrial equipment according to the collection rules and the preset collection frequency.
[0095] Through the generation module 50, determination module 52 and collection module 54 in the above-mentioned data acquisition device, the purpose of simplifying the configuration process and improving the efficiency and accuracy of data acquisition is achieved, thereby achieving the technical effect of reducing the operation and maintenance costs of industrial gateways and promoting the standardization of industrial data integration and analysis, and further solving the technical problems of protocol diversity, configuration complexity and maintenance difficulties existing in the data acquisition process of industrial gateways.
[0096] In the data acquisition device provided in the embodiment of the present application, the generation module is also used to decouple all industrial protocols in the industrial gateway device according to the protocol information library to obtain decoupling information, wherein the decoupling information includes channel configuration information corresponding to the device configuration and data acquisition information corresponding to the data acquisition; and determine the standardized configuration model based on the decoupling information.
[0097] In the data acquisition device provided in the embodiment of the present application, the generation module is also used to determine the connection channel corresponding to the industrial equipment based on the channel configuration information; and determine the data acquisition model corresponding to the industrial equipment based on the data acquisition information.
[0098] In the data acquisition device provided in the embodiment of the present application, the acquisition module is also used to obtain real-time data and historical data corresponding to industrial equipment; determine the data level and data change rate of the real-time data, wherein the data level is used to indicate the degree of influence of the real-time data in the industrial production process; and determine the preset acquisition frequency based on the data level, data change rate and historical data.
[0099] In the data acquisition device provided in the embodiment of the present application, the acquisition module is also used to upload the collected data to the cloud platform for processing through a preset communication interface, wherein the collected data at least includes the operating status, parameter settings and fault information of the target industrial equipment.
[0100] An embodiment of the present application also provides an electronic device, including: a memory and a processor, wherein the memory is used to store program instructions; the processor is connected to the memory and is used to execute and implement the above-mentioned data acquisition method.
[0101] It should be noted that the above electronic equipment is used to execute Figure 2 The data collection method shown, therefore the relevant explanations and instructions in the above data collection method are also applicable to the electronic device and will not be repeated here.
[0102] An embodiment of the present application further provides a non-volatile storage medium, which includes a stored computer program, wherein a device where the non-volatile storage medium is located executes the above-mentioned data acquisition method by running the computer program.
[0103] It should be noted that the above non-volatile storage medium is used to execute Figure 2The data acquisition method shown, therefore the relevant explanations in the above data acquisition method are also applicable to the non-volatile storage medium, and will not be repeated here.
[0104] The embodiment of the present application also provides a computer program product, including computer instructions, which implement the above-mentioned data collection method when executed by a processor.
[0105] It should be noted that the above-mentioned computer program product is used to execute Figure 2 The data collection method shown, therefore the relevant explanations in the above data collection method are also applicable to the computer program product and will not be repeated here.
[0106] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0107] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.
[0108] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.
[0109] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0110] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0111] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.
[0112] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. A data collection method, characterized in that: include: Generate configuration parameters that meet the characteristics of industrial equipment through a standardized configuration model, wherein the configuration parameters at least include a data acquisition model and point configuration information corresponding to the industrial equipment. The standardized configuration model automatically generates configuration parameters corresponding to the characteristics of the industrial equipment to adapt to different industrial protocols and equipment acquisition requirements. The data acquisition model is used to define the structure and format of data acquisition, and the point configuration information is used to guide the industrial gateway device to collect data from the industrial equipment. Determining a collection rule for the industrial equipment according to the configuration parameters; Data is collected from the target industrial equipment according to the collection rules and the preset collection frequency.
2. The method according to claim 1, characterized in that The industrial gateway device includes a protocol middleware, wherein the protocol middleware defines application function standards, and the application function standards are used to determine the operating environment requirements, configuration file requirements, data acquisition model parsing, data reporting methods and command structures of all industrial protocols in the industrial gateway device.
3. The method according to claim 2, characterized in that The protocol middleware also includes a protocol information library, wherein the protocol information library is used to store the protocol structure, data acquisition model, function code and data type of all industrial protocols in the industrial gateway device.
4. The method according to claim 3, characterized in that The standardized configuration model is determined in the following manner: Decoupling all industrial protocols in the industrial gateway device according to the protocol information library to obtain decoupling information, wherein the decoupling information includes channel configuration information corresponding to device configuration and data acquisition information corresponding to data acquisition; The standardized configuration model is determined according to the decoupling information.
5. The method according to claim 4, characterized in that The method further comprises: Determining a connection channel corresponding to the industrial device according to the channel configuration information; And determining a data acquisition model corresponding to the industrial equipment according to the data acquisition information.
6. The method according to claim 1, characterized in that The preset acquisition frequency is determined by: Acquiring real-time data and historical data corresponding to the industrial equipment; Determining a data level and a data change rate of the real-time data, wherein the data level is used to indicate the degree of influence of the real-time data in the industrial production process; The preset collection frequency is determined according to the data level, the data change rate and the historical data.
7. The method according to claim 1, characterized in that After collecting data from the target industrial equipment according to the collection rule and the preset collection frequency, the method further includes: The collected data is uploaded to the cloud platform for processing through a preset communication interface, wherein the collected data at least includes the operating status, parameter settings and fault information of the target industrial equipment.
8. A data collection device, characterized in that: include: A generation module, used to generate configuration parameters that meet the characteristics of industrial equipment through a standardized configuration model, wherein the configuration parameters at least include a data acquisition model and point configuration information corresponding to the industrial equipment, and the standardized configuration model automatically generates configuration parameters corresponding to the characteristics of the industrial equipment to adapt to different industrial protocols and equipment acquisition requirements, the data acquisition model is used to define the structure and format of data acquisition, and the point configuration information is used to guide the industrial gateway device to collect data from the industrial equipment; A determination module, used to determine the collection rules of the industrial equipment according to the configuration parameters; The acquisition module is used to collect data from the target industrial equipment according to the acquisition rules and the preset acquisition frequency.
9. An electronic device, characterized in that: include: A memory and a processor, wherein the memory is used to store program instructions; The processor is connected to the memory and is used to execute the data acquisition method described in any one of claims 1 to 7.
10. A non-volatile storage medium, characterized in that: The non-volatile storage medium includes a stored computer program, wherein the device where the non-volatile storage medium is located executes the data acquisition method according to any one of claims 1 to 7 by running the computer program.
11. A computer program product comprising computer instructions, characterized in that: When the computer instructions are executed by a processor, the data collection method described in any one of claims 1 to 7 is implemented.
Citation Information
Cited By
Data transmission method, system and device and storage medium
CN120729965A
Marine surveying and mapping base station control system and method
CN121397039A