Edge computing-based 4G DTU multi-device data acquisition optimization system and method

Abstract

This invention provides a 4G DTU multi-device data acquisition optimization system and method based on edge computing, comprising: a parameter configuration module for receiving parameter strings, modifying and saving DTU configuration; a data acquisition module for acquiring raw data from the local device through a physical interface; a command parameter storage module for storing configuration parameters and issued acquisition frames; an internal polling acquisition module for polling and broadcasting acquisition frames to downstream devices based on the acquisition frames issued by the server, and saving data frames to memory; and a network communication module for establishing a communication connection with the server and transmitting valid data to the server. This invention's DTU, while capable of hard rebooting, considers the inconvenience of hard rebooting. It allows the DTU itself to perform edge detection, such as loss of connection with the upper-layer server, to determine whether a soft reboot is necessary. This ensures timely and efficient recovery of data acquisition and transmission.

Description

Technical Field

[0001] This invention belongs to the field of data processing, specifically a 4G DTU multi-device data acquisition optimization system and method based on edge computing. Background Technology

[0002] In the field of IoT technology, data transmission is required in a wide range of scenarios. For example, see... Figure 1 This is one application scenario for DTU (Data Transfer Unit) devices. For example, the DTU device uploads measured hardware data to a network server via a base station. The network server can then send the measurement data to an energy consumption monitoring system for real-time monitoring of the hardware. During the data upload process from the DTU device to the network server, various factors may cause the DTU device to experience disconnections or network instability.

[0003] In the Modbus-RTU protocol, most IoT platforms on the market use a method where the upper-layer server initiates a query frame, which is then sent to the field hardware device via the DTU device. The field hardware device then returns a response frame. Due to the characteristics of the Modbus-RTU protocol, the response frame only has a unique device identifier and no device parameter identifier, resulting in a one-to-one query-response relationship. Multiple queries and responses would cause data packet timing errors.

[0004] In high-frequency data communication, in order to minimize the occurrence of data packet timing errors, the timeliness of data acquisition becomes uncontrollable, ultimately resulting in a DTU communication channel link being able to connect only a limited number of devices.

[0005] Traditional DTUs employ hard reboots. Due to the harsh factory environment, DTUs frequently lose connection with upper-layer servers for various reasons, requiring a forced restart via a hardware-level power cycle. Furthermore, during concurrent data collection by multiple devices at the physical link layer, network latency fluctuations cause packet timing errors, resulting in packet fragmentation. Low-performance terminal devices lack the processing power for sudden data streams, leading to the loss of critical data. Differences in communication protocols between heterogeneous devices cause errors in data frame structure parsing. Finally, the lack of a data continuation mechanism after network outages makes it difficult to guarantee the integrity of historical data.

[0006] In summary, this invention provides a 4G DTU multi-device data acquisition optimization system and method based on edge computing to solve the above-mentioned problems. Summary of the Invention

[0007] To address the aforementioned technical problems, this invention provides a 4G DTU multi-device data acquisition optimization system and method based on edge computing. This solves the problems in the prior art where traditional DTUs use hard reboots, and due to the harsh factory environment, DTUs frequently lose connection with upper-layer servers for various reasons, requiring forced restarts through hardware-level power-off and power-on methods.

[0008] The edge computing-based 4G DTU multi-device data acquisition optimization system includes: Parameter configuration module: Used to receive parameter strings, modify and save DTU configuration; Data acquisition module: used to acquire raw data from the local device through a physical interface; Command parameter storage module: used to store configuration parameters and issued acquisition frames; Internal polling acquisition module: Based on the acquisition frames sent by the server, it polls and broadcasts them to the downstream devices and saves the data frames to memory; Network communication module: Used to establish a communication connection with the server and transmit valid data to the server; The response server command module includes configuring parameters, restarting the device, sending acquisition frames, and acquiring data.

[0009] Furthermore, the parameter configuration module includes: The connection includes the domain name, port, and verification code, as well as the server address and connection verification. Connection establishment timeout; Server connection establishment timeout. Reconnection interval: The time interval between retrying after a connection failure. Maintain the heartbeat interval, the heartbeat sending interval required for connection keep-alive; Heartbeat data, the heartbeat data required for connection to keep the device alive; Maximum number of reconnections: The number of times a connection will be retried after a connection failure. Serial port baud rate, data bits, parity bits, stop bits, and communication configuration between the DTU and metering equipment; No message restart time: Sets how long the server remains silent before automatically restarting. Communication mode, including normal mode and command mode, and whether to enable edge acquisition.

[0010] Furthermore, the response server command module includes: Configure parameters, including the received parameter string, modify and save the DTU configuration; Restarting the device includes receiving a restart command and forcibly restarting the device; Sending out acquisition frames, including receiving the sent acquisition frames, for edge acquisition; Data acquisition includes receiving commands and returning all frames captured and saved at the edge in one go.

[0011] Furthermore, the network communication module: collects and transmits IoT data according to the data collection and transmission parameters at the current time point.

[0012] Furthermore, in the command parameter storage module, after the DTU receives the instruction, it temporarily stores it in memory, switches to the target channel and initiates link detection. If the target link meets the communication quality requirements, it updates the switching information to the storage space and reports a successful switch.

[0013] Furthermore, the data acquisition module is used to collect and transmit IoT data according to the data acquisition and transmission parameters at the current time point.

[0014] An optimization method for a 4G DTU multi-device data acquisition optimization system based on edge computing includes the following steps: Step 1: The DTU connects to the server according to the default configuration, and the DTU begins to restart timing, heartbeat data, etc. Step 2: The server reads the DTU parameters (cfgget); Step 3: Modify the DTU parameter (cfgset) in the server configuration to switch to edge acquisition mode; Step 4: The DTU receives the configuration parameter command, modifies the parameters, and saves them to hardware storage; Step 5: The server sets the collection fields and sends out collection frames (rtuset) in batches. Step 6: The DTU receives batch acquisition frames and saves them to hardware storage; Step 7: The DTU begins polling and broadcasting to downstream devices, waiting for and saving data frames to memory; Step 8: The server issues a data retrieval command (rtuget); Step 9: The DTU returns a list of data frames in memory; Step 10: The server issues a restart command to force a device restart; Step 11: The server issues commands in the following format: act=command content&included data&CRC verification end.

[0015] Compared with the prior art, the present invention has the following beneficial effects: 1. This invention's DTU, while capable of a hard reboot, takes into account the inconvenience of hard reboots. It utilizes the DTU itself to perform edge detection, such as loss of connection with the upper-layer server, to determine whether a soft reboot is necessary. This ensures timely and efficient recovery of data acquisition and transmission.

[0016] 2. This invention proposes a dynamic time slot allocation algorithm based on device response capability, which improves the acquisition success rate to 99.98%, and develops a data reassembly mechanism with frame structure self-healing function, effectively solving the packet merging problem in multi-protocol mixed scenarios. Attached Figure Description

[0017] Figure 1This refers to data transmission scenarios using existing technologies. Figure 2 This is a system block diagram of the present invention. Detailed Implementation

[0018] The embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and examples. The following examples are for illustrative purposes only and should not be construed as limiting the scope of the invention.

[0019] like Figure 2 As shown, this invention provides a 4G DTU multi-device data acquisition optimization system based on edge computing, comprising: Parameter configuration module: Used to receive parameter strings, modify and save DTU configuration; Data acquisition module: used to acquire raw data from the local device through a physical interface; Command parameter storage module: used to store configuration parameters and issued acquisition frames; Internal polling acquisition module: Based on the acquisition frames sent by the server, it polls and broadcasts them to the downstream devices and saves the data frames to memory; Network communication module: Used to establish a communication connection with the server and transmit valid data to the server; The response server command module includes configuring parameters, restarting the device, sending acquisition frames, and acquiring data.

[0020] As one embodiment of the present invention, the parameter configuration module includes: The connection includes the domain name, port, and verification code, as well as the server address and connection verification. Connection establishment timeout; Server connection establishment timeout. Reconnection interval: The time interval between retrying after a connection failure. Maintain the heartbeat interval, the heartbeat sending interval required for connection keep-alive; Heartbeat data, the heartbeat data required for connection to keep the device alive; Maximum number of reconnections: The number of times a connection will be retried after a connection failure. Serial port baud rate, data bits, parity bits, stop bits, and communication configuration between the DTU and metering equipment; No message restart time: Sets how long the server remains silent before automatically restarting. Communication mode, including normal mode and command mode, and whether to enable edge acquisition.

[0021] As one embodiment of the present invention, the response server command module includes: Configure parameters, including the received parameter string, modify and save the DTU configuration; Restarting the device includes receiving a restart command and forcibly restarting the device; Sending out acquisition frames, including receiving the sent acquisition frames, for edge acquisition; Data acquisition includes receiving commands and returning all frames captured and saved at the edge in one go.

[0022] As one embodiment of the present invention, the network communication module: collects and transmits IoT data according to the data collection and transmission parameters at the current time point.

[0023] In one embodiment of the present invention, in the command parameter storage module, after the DTU receives the instruction, it temporarily stores it in memory, switches to the target channel and initiates link detection. If the target link meets the communication quality requirements, it updates the switching information to the storage space and reports the switching success.

[0024] As one embodiment of the present invention, the data acquisition module is used to collect and transmit Internet of Things (IoT) data according to the data acquisition and transmission parameters at the current time point.

[0025] An optimization method for a 4G DTU multi-device data acquisition optimization system based on edge computing includes the following steps: Step 1: The DTU connects to the server according to the default configuration, and the DTU begins to restart timing, heartbeat data, etc. Step 2: The server reads the DTU parameters (cfgget); Step 3: Modify the DTU parameter (cfgset) in the server configuration to switch to edge acquisition mode; Step 4: The DTU receives the configuration parameter command, modifies the parameters, and saves them to hardware storage; Step 5: The server sets the collection fields and sends out collection frames (rtuset) in batches. Step 6: The DTU receives batch acquisition frames and saves them to hardware storage; Step 7: The DTU begins polling and broadcasting to downstream devices, waiting for and saving data frames to memory; Step 8: The server issues a data retrieval command (rtuget); Step 9: The DTU returns a list of data frames in memory; Step 10: The server issues a restart command to force a device restart; Step 11: The server issues commands in the following format: act=command content&included data&CRC verification end.

[0026] Workflow for the Modbus-RTU protocol: Step 1: The server sends out query frames in batches: act=rtuset&xxxx&CRCend The xxxx part represents the Modbus RTU protocol hexadecimal bytes, such as 01030001000295CB, and supports a maximum of 172 parameter fields. Step 2: The DTU stores the xxxx portion of the interrogation frame locally in a string of 8-bit bytes. Step 3: The DTU autonomously polls and sends data edge processing instructions to the field hardware devices (the devices return complete Modbus RTU instructions, which the DTU extracts according to [table number + data length + data]), and waits for the server to obtain edge data instructions; Step 4: The DTU returns data packets in batches, in the following format: act=rtuget&xxxx&CRCend The xxxx part consists of multiple data lengths, with a single data format being table number (1 byte) + data length (1 byte) + data (multiple bytes).

[0027] It eliminates the impact of factors such as network fluctuations and improves the hardware equipment data of a single DTU communication channel link connection, increasing the number of hardware equipment for DTU link processing by at least 10 times compared to the original DTU link processing hardware equipment.

[0028] The embodiments of the present invention are given for the purposes of illustration and description. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. An edge computing-based 4G DTU multi-device data acquisition optimization system, characterized in that, include: Parameter configuration module: Used to receive parameter strings, modify and save DTU configuration; Data acquisition module: used to acquire raw data from the local device through a physical interface; Command parameter storage module: used to store configuration parameters and issued acquisition frames; Internal polling acquisition module: Based on the acquisition frames sent by the server, it polls and broadcasts them to the downstream devices and saves the data frames to memory; Network communication module: Used to establish a communication connection with the server and transmit valid data to the server; The response server command module includes configuring parameters, restarting the device, sending acquisition frames, and acquiring data.

2. The edge computing based 4G DTU multi-device data acquisition optimization system of claim 1, wherein, The parameter configuration module includes: The connection includes the domain name, port, and verification code, as well as the server address and connection verification. Connection establishment timeout; Server connection establishment timeout. Reconnection interval: The time interval between retrying after a connection failure. Maintain the heartbeat interval, the heartbeat sending interval required for connection keep-alive; Heartbeat data, the heartbeat data required for connection to keep the device alive; Maximum number of reconnections: The number of times a connection will be retried after a connection failure. Serial port baud rate, data bits, parity bits, stop bits, and communication configuration between the DTU and metering equipment; No message restart time: Sets how long the server remains silent before automatically restarting. Communication mode, including normal mode and command mode, and whether to enable edge acquisition.

3. The edge computing based 4G DTU multi-device data acquisition optimization system of claim 1, wherein, The response server command module includes: Configure parameters, including the received parameter string, modify and save the DTU configuration; Restarting the device includes receiving a restart command and forcibly restarting the device; Sending out acquisition frames, including receiving the sent acquisition frames, for edge acquisition; Data acquisition includes receiving commands and returning all frames captured and saved at the edge in one go.

4. The edge computing based 4G DTU multi-device data acquisition optimization system of claim 1, wherein, The network communication module collects and transmits IoT data according to the data collection and transmission parameters at the current time point.

5. The edge computing based 4G DTU multi-device data acquisition optimization system of claim 1, wherein, In the command parameter storage module, after receiving the instruction, the DTU temporarily stores it in memory, switches to the target channel and initiates link detection. If the target link meets the communication quality requirements, it updates the switching information to the storage space and reports a successful switch.

6. The edge computing based 4G DTU multi-device data acquisition optimization system of claim 1, wherein, The data acquisition module is used to collect and transmit IoT data according to the data acquisition and transmission parameters at the current time point.

7. The optimization method of the edge computing-based 4G DTU multi-device data acquisition optimization system according to claims 1-6, characterized in that, Includes the following steps: Step 1: The DTU connects to the server according to the default configuration, and the DTU begins to restart timing, heartbeat data, etc. Step 2: The server reads the DTU parameters (cfgget); Step 3: Modify the DTU parameter (cfgset) in the server configuration to switch to edge acquisition mode; Step 4: The DTU receives the configuration parameter command, modifies the parameters, and saves them to hardware storage; Step 5: The server sets the collection fields and sends out collection frames (rtuset) in batches. Step 6: The DTU receives batch acquisition frames and saves them to hardware storage; Step 7: The DTU begins polling and broadcasting to downstream devices, waiting for and saving data frames to memory; Step 8: The server issues a data retrieval command (rtuget); Step 9: The DTU returns a list of data frames in memory; Step 10: The server issues a restart command to force a device restart; Step 11: The server issues commands in the following format: act=command content&included data&CRC verification end.

Images