Internet of things transmission dynamic tuning method and system

Abstract

The invention belongs to the technical field of Internet of Things. The invention provides the Internet of Things transmission dynamic tuning method and system, a control protocol covering a full transmission chain of an Internet of Things scene is established for server-side equipment, transmission equipment and acquisition equipment, self-adjustment of a transmission framework is realized, the problems of low resource utilization efficiency and poor service expansibility caused by solidification of the transmission framework are effectively solved, and the transmission efficiency of the Internet of Things scene is improved. The transmission framework can flexibly adapt to different application scene requirements; according to the invention, a self-adaptive transmission protocol selection and switching mechanism is designed, and the optimal transmission protocol is dynamically selected according to actual network conditions and data characteristics, so that the transmission efficiency is remarkably improved, and meanwhile, the transmission reliability and stability are ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of Internet of Things, and in particular to a method and system for dynamic tuning of Internet of Things transmission. Background Art

[0002] The statements in this section merely provide background art related to the present invention and do not necessarily constitute prior art.

[0003] The Internet of Things (IoT) connects various physical objects to the internet through information sensing devices, enabling information exchange and communication between objects and people, enabling intelligent identification, positioning, tracking, monitoring, and management. IoT transmission is a key component of the IoT, responsible for efficiently and reliably transmitting data captured by data collection devices to server-side devices, enabling real-time monitoring, analysis, and application of this data.

[0004] The current IoT transmission scenarios have the following shortcomings: (1) The transmission framework is rigid, and the flexibility of intelligent protocol selection and transmission strategy adjustment based on real-time network conditions and data characteristics is poor, resulting in low resource utilization efficiency and poor business scalability; (2) Existing transmission methods are difficult to adapt to complex and changing network environments, and cannot effectively deal with the volatility and instability of network status, resulting in reduced transmission quality; (3) Existing transmission optimization methods still have shortcomings in optimizing data transmission models, making it difficult to achieve more efficient and reliable data transmission, and unable to meet data transmission requirements under different network conditions; (4) The transmission framework lacks an effective dynamic scheduling mechanism, and cannot make intelligent transmission strategy adjustments based on the urgency of the data, the energy status of the node, and its communication quality, which affects the network's adaptability and communication efficiency. Summary of the Invention

[0005] In order to address the shortcomings of the existing technology, the present invention provides a method and system for dynamic tuning of IoT transmission. By establishing a control protocol covering the entire transmission chain of IoT scenarios, self-adjustment of the transmission framework is achieved, effectively solving the problems of low resource utilization efficiency and poor business scalability caused by the solidification of the transmission framework, so that the transmission framework can flexibly adapt to the needs of different application scenarios.

[0006] In order to achieve the above object, the present invention adopts the following technical solutions: In a first aspect, the present invention provides a method for dynamic tuning of Internet of Things transmission.

[0007] A method for dynamic tuning of Internet of Things transmission, applied to a server device, includes the following steps: Obtain the data change mechanism of the data reporting node of the collection device and adjust the reporting mechanism of the data reporting node through the control protocol; According to the behavior mechanism of the data reporting node, identify the optimal data type suitable for the data reporting node, and adjust the data transmission type and structure of the data reporting node through the control protocol; Dynamically adjust the control protocol based on the link resource usage and data accessibility of the control protocol; Adjust the processing principle according to the data priority, and dynamically adjust the data priority and data reporting node grouping according to the data utilization.

[0008] In an implementation of the first aspect of the present invention, obtaining a data change mechanism of a data reporting node of a collection device and adjusting the reporting mechanism of the data reporting node through a control protocol include: Build a data monitoring engine to record the number of changes and the time of change of data reporting nodes per unit time; According to the number of changes and the time of change, the change frequency of the data reporting nodes is predicted and the data reporting nodes are regrouped; The collection and reporting logic of the regrouped data reporting nodes is pushed to the collection device through the control protocol, so that the collection device performs the following change actions after receiving the control protocol: adjust the collection period of different groups according to the change frequency of the data reporting nodes, and adjust the reporting period of different groups according to the change frequency of the data reporting nodes.

[0009] In one implementation of the first aspect of the present invention, identifying an optimal data type suitable for the data reporting node based on a behavior mechanism of the data reporting node, and adjusting the data transmission type and structure of the data reporting node through a control protocol includes: Build a behavior mechanism engine for data reporting nodes; If within the set time range, it is detected that the actual value type of the data reporting node is different from the designed type, the data type will be automatically modified; Integrate all data reporting nodes that need to adjust the data type, assemble the rule change control protocol and push it to the collection device, so that the collection device performs the following change actions: integrate all data reporting nodes that need to change the rules, re-construct the reporting rules and data reporting node grouping rules, and push the changed reporting rules and data reporting node grouping rules to the server device through the control message; After receiving the changed reporting rules and data reporting node grouping rules from the collection device, a new data parsing logic is regenerated and executed.

[0010] In an implementation of the first aspect of the present invention, dynamically adjusting the control protocol based on link resource occupancy and data reachability by the control protocol includes: Calculate the protocol switching benefit based on the link status of the network; Develop a data control protocol selection strategy based on different packet loss rate network scenarios; Determine whether control protocol adjustment is required based on the protocol switching benefit and the packet loss rate. If adjustment is required, start link monitoring, assemble a protocol change message based on the selected control protocol adjustment strategy, and push it to the transmission device, so that the transmission device executes the control protocol switching and returns the execution result and the new link reception and parsing logic; After receiving the new link reception and parsing logic from the transmission device, the original link is closed and the control protocol change is completed.

[0011] In an implementation of the first aspect of the present invention, adjusting the processing principle according to data priority and dynamically adjusting the data priority and data reporting node grouping according to data utilization include: Establish data labeling rules, including: urgent, routine, and inert; Give priority to data packets with high priority; Monitor the number of reads and writes to the reported data cache to obtain data utilization; Adjust the grouping strategy of data reporting nodes according to utilization: data reporting nodes with utilization greater than a first set threshold are grouped as the emergency group, data reporting nodes with utilization less than or equal to the first set threshold and greater than a second set threshold are grouped as the regular group, and data reporting nodes with utilization less than or equal to the second set threshold are grouped as the inert group; Push the new grouping strategy to the collection device through the control message, so that the collection device regroups the data reporting nodes and establishes new data labeling rules; After receiving the grouping and data labeling rules of the data reporting nodes from the collection device, the grouping and data labeling rules of the data reporting nodes are adjusted.

[0012] In a second aspect, the present invention provides a method for dynamic tuning of Internet of Things transmission.

[0013] A method for dynamic tuning of Internet of Things transmission, wherein a server device is communicatively connected to a collection device via a transmission device, and the server device is configured to execute the method for dynamic tuning of Internet of Things transmission according to the first aspect of the present invention; The transmission device is configured to perform the following process: Establish link resource management and reuse mechanisms; Compare and screen the data frame structure and data, and filter out duplicate messages or data that is not within the change threshold range; Evaluate the current network status based on the detected link status and predict the link status in the future; Dynamically adjust the data reporting transmission protocol, mark the link packet loss rate in real time, and synchronize the data reporting protocol adjustment through the control protocol; Establish a dormancy mechanism and a wake-up mechanism for link resources.

[0014] In an implementation of the second aspect of the present invention, establishing a link resource management mechanism and a multiplexing mechanism includes: Define the link reuse decision threshold S based on the actual network scenario; Count the amount of data D within the unit time T; if , locate the data reporting node based on the group message, and re-report the data reporting node based on the data link; If there are two or more links , and the total amount of data per unit time Q is related to S: , then adjust the reporting group logic of the data reporting node and integrate the data reporting nodes of each link into one link for reporting; The protocol change message is assembled according to the new reporting grouping logic to obtain a grouping change message, and is pushed to the collection device and the server device, so that after receiving the grouping change message, the collection device executes the new reporting grouping logic and pushes the change result to the changed data reporting node, and after receiving the grouping change message, the server device initializes the new reporting grouping logic and pushes the result to the changed data reporting node.

[0015] In an implementation of the second aspect of the present invention, comparing and screening the data frame structure and the data, and filtering out duplicate messages or data that is not within a change threshold range, includes: The transmission equipment caches the reported data frames based on the link and data reporting node grouping, builds a differential transmission engine, performs hash comparison on consecutive messages, and only transmits the changed messages, discarding the unchanged messages; Set a threshold rule R for the data of the data reporting node; The transmission device monitors the received data reporting node data V. If the threshold rule R is not met, the data reporting node data V is discarded. Otherwise, the data reporting node data V is stored in the reporting cache. The reported data message is reorganized according to the data in the reported cache, and the data frame reconstruction flag and data parsing rules are marked in the reported data message, so that after the server device receives the reported data message, it performs data parsing according to the data parsing rules in the reported data message.

[0016] In an implementation of the second aspect of the present invention, evaluating the current network state based on the detected link state and predicting the link state for a period of time in the future includes: Calculate historical link status; Predict future link status based on historical link status; A machine learning algorithm is used to assess network overload risk based on current network load, historical link status, and predicted future link conditions. When the network overload risk exceeds a set threshold, a transmission adjustment mechanism is activated. Calculate multiple optional paths and select the path with the largest bandwidth and the smallest delay as the optimal transmission path; Dynamically adjust data transmission frequency and rate according to the current network status.

[0017] In an implementation of the second aspect of the present invention, dynamically adjusting the data reporting transmission protocol based on the obtained current network status, marking the link packet loss rate in real time, and adjusting the transmission protocol include: Calculate the link packet loss rate; Dynamically load new transmission protocol parameters through the multi-protocol stack switch based on the link packet loss rate; Adaptive switching of transmission protocols based on monitored link information; The transmission protocol change message is assembled according to the adaptively switched transmission protocol and pushed to the server device, so that after the server device receives the transmission protocol change message, it rebuilds the data reception and parsing rules according to the transmission protocol change message, and pushes the change completion synchronization message to the transmission device after the change is completed, and after the transmission device receives the change completion synchronization message, it reports the data according to the new reporting protocol and transmission parameters.

[0018] In an implementation of the second aspect of the present invention, the acquisition device is configured to perform the following process: Establish a dynamic adjustment mechanism for reporting data frames based on the control protocol, and adjust the reporting data frame structure according to the change message; Establish a data priority adjustment mechanism for acquisition equipment based on the control protocol; Establish a device sleep mechanism based on the control protocol.

[0019] As a further limitation of the second aspect of the present invention, a dynamic adjustment mechanism for reporting data frames is established based on the control protocol, and the structure of the reporting data frames is adjusted according to the change message, including: Define the data monitoring cycle threshold time; Monitoring data collection value within the monitoring cycle threshold time; If the actual value range of the collected value does not match the current design type range, the reported data structure is adjusted; The data change message is assembled and reported according to the adjustment action and pushed to the server device, so that after receiving the data assembly change message, the server device reconstructs the data parsing logic according to the change rules and pushes the change completion synchronization message to the collection device.

[0020] As a further limitation of the second aspect of the present invention, establishing a data priority adjustment mechanism for an acquisition device based on a control protocol includes: When receiving a node data priority adjustment message, the data reporting node to be adjusted and the level to be adjusted are identified according to the message information, and the data reporting node is grouped and reconstructed according to the level to be adjusted; When receiving the control message of the grouping reconstruction result, the new grouping is performed according to the grouping principle in the control message, and the event priority of the data collection and data reporting business on the collection device side is adjusted according to the new grouping; After receiving the reporting cycle adjustment message, adjust the cycle of the data reporting service.

[0021] In a third aspect, the present invention provides an Internet of Things transmission dynamic tuning system.

[0022] An Internet of Things transmission dynamic tuning system, comprising: a server device, a transmission device, and a collection device, wherein the server device is communicatively connected to the collection device via the transmission device, and the server device is configured to execute the method according to the first aspect of the present invention; The transmission device is configured to perform the following process: Establish link resource management and reuse mechanisms; Compare and screen the data frame structure and data, and filter out duplicate messages or data that is not within the change threshold range; Evaluate the current network status based on the detected link status and predict the link status in the future; Dynamically adjust the data reporting transmission protocol, mark the link packet loss rate in real time, and synchronize the data reporting protocol adjustment through the control protocol; Establishing dormancy and wake-up mechanisms for link resources; The acquisition device is configured to perform the following process: Establish a dynamic adjustment mechanism for reporting data frames based on the control protocol, and adjust the reporting data frame structure according to the change message; Establish a data priority adjustment mechanism for acquisition equipment based on the control protocol; Establish a device sleep mechanism based on the control protocol.

[0023] Compared with the prior art, the present invention has the following beneficial effects: 1. This invention innovatively proposes a method for dynamic tuning of IoT transmission. By establishing a control protocol covering the entire transmission chain of IoT scenarios, it realizes the self-adjustment of the transmission framework, effectively solving the problems of low resource utilization efficiency and poor business scalability caused by the solidification of the transmission framework, and enables the transmission framework to flexibly adapt to the needs of different application scenarios.

[0024] 2. The present invention adopts data type optimization and differential transmission technology. Through intelligent data type adjustment and data frame screening, it significantly reduces the amount of transmitted data, achieves higher data compression, and effectively solves the energy waste and network congestion problems caused by frequent communication in traditional methods.

[0025] 3. Based on the dynamic sleep mechanism and link resource reuse strategy of the acquisition device, the present invention continuously reduces the power consumption of the device end through intelligent sleep and wake-up control, achieves a higher power consumption optimization effect, and at the same time improves the link resource utilization efficiency and reduces the high-load link utilization rate.

[0026] 4. The present invention adopts an adaptive transmission protocol selection and switching mechanism to dynamically select the optimal transmission protocol according to the actual network conditions and data characteristics, thereby significantly improving the transmission efficiency while ensuring the reliability and stability of the transmission.

[0027] 5. The present invention realizes full-process monitoring and optimization of the transmission chain through the real-time monitoring and feedback mechanism of the link status of the server device, combined with the intelligent decision-making algorithm, effectively solving the problem of lack of comprehensive control of the entire transmission chain in the existing technology.

[0028] Advantages of additional aspects of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0030] Figure 1 A schematic diagram of a flow chart of an IoT transmission framework design provided by an exemplary embodiment of the present invention; Figure 2 A flowchart of a method for dynamic optimization of Internet of Things transmission provided by an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0031] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0032] It should be noted that the following detailed descriptions are exemplary and intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which the present invention belongs.

[0033] This implementation proposes a dynamic optimization method for IoT transmission, fully covering the entire data flow chain in IoT scenarios, involving server-side devices (terminal devices that receive and process data), transmission devices (data transmission layer devices), and acquisition devices (raw data end devices). The server-side device has the highest level of control in the entire model, while each sub-node device (i.e., transmission devices and acquisition devices) also has a certain degree of autonomous control capabilities under the transmission framework protocol. The ultimate goal is to coordinate the three end devices to achieve dynamic adjustments in resources, transmission protocols, data volume, and power consumption, striving to achieve high stability, high efficiency, and low resource consumption within a dynamic time period based on the framework protocol.

[0034] The design process of the IoT transmission framework of this implementation method specifically includes the following: S1: Design of control protocol messages.

[0035] The control protocol message specifies the standards for synchronizing, parsing, and executing related adjustments within the model framework. By defining the cross-layer control protocol, the following contents are clarified: how to assemble the change protocol message, how to parse the protocol message, and how to execute the protocol message.

[0036] The control protocol transmission channel in this implementation is not limited to a specific physical link. It can be a network-based (wired or wireless) socket link or an industrial field communication protocol link such as RS-485, RS-232, or CAN. The specific channel type used in the implementation is determined by the topology of the transmission model in the actual application scenario. The fundamental principle is to ensure that the relevant devices requiring framework protocol synchronization can be effectively connected through the selected transmission channel.

[0037] Specific message definitions include: { "Node ID", / / The identity of this device in the framework agreement "Target ID", / / Framework agreement changes the target device identifier "type", / / Protocol type, identifies the protocol type, such as: 1. Reporting data protocol 2. Control protocol "content", / / Protocol content: identifies detailed information about protocol changes, such as: 1. Identifies which reporting nodes the transmission device needs to migrate to which link; 2. Identifies which node data types on the collection device need to be adjusted from which type to which type.

[0038] {"action": / / specific control action type "info": / / Specific control content, identifying the change rules and information that the peer device needs to execute.

[0039] } } S2: Control logic design of server-side equipment.

[0040] The server-side device is mainly based on data applications, integrating data information (data volume, utilization, frequency), transmission information (link utilization, protocol packet loss rate), and overall control protocols to provide support for the self-adjustment of the transmission framework. The specific implementation is as follows: S201: The server device records the data change mechanism (frequency and time of change) of the data reporting node of the data collection device and adjusts the reporting mechanism of the data reporting node through the control protocol. It is important to note that, depending on the specific needs of the external scenario (collection and reporting), the data reporting node can be expressed as a data collection and data reporting node. For example, the data collection and reporting cycle can be adjusted for data with low change frequency or that changes only at fixed time points. The specific steps are as follows: S201-1: The server device builds a data monitoring engine to record in detail the number of changes and the time of change of the data reporting node within a unit time.

[0041] S201-2: Based on the two parameters of the number of changes and the time of change, the time series model (ARIMA / LSTM) is used to predict the frequency of data changes and regroup the data reporting nodes (define the collection period and reporting period).

[0042] S201-3: Push the collection and reporting logic of the newly created group to the collection device via a control message.

[0043] S201-4: After receiving the protocol change message, the acquisition device executes the change action: (1) Adjust the collection period of different data reporting node groups according to the frequency of data changes; (2) Adjust the reporting period of different data reporting node groups according to the frequency of data changes.

[0044] For example, automatically extend the reporting period of a low-change-rate data reporting node (for example, from 1 second to 30 minutes). The temperature sensor changes slowly at night, and the server device sends a command to adjust its collection and reporting period from 1 second to once every 30 minutes.

[0045] S202: The server device identifies the optimal data type for the data reporting node based on the behavior mechanism of the data reporting node, and synchronizes the data transmission type and structure to the device through the control protocol to greatly reduce the amount of data during transmission. The specific steps are as follows: S202-1: The server device builds a data point behavior mechanism engine to record and monitor the value range of the data point.

[0046] S202-2: If within the set time range, the actual value type of the monitored data point does not match the current design type, the data type is automatically increased or decreased (such as 32-bit integer → 8-bit integer, floating point → Boolean, etc.).

[0047] S202-3: Integrate all points that need to adjust the data type, assemble the rule change control message and push it to the collection device.

[0048] S202-4: After receiving the change message, the collection device executes the rule change action: (1) Integrate the relevant rule-changed data points, reconstruct the reporting framing rules and the grouping rules of the data reporting nodes; group the data reporting nodes of the same type into the same group, and reorganize the data structure of the low-value information points (for example, integrate the information of eight BOOL data points into one byte for reporting).

[0049] (2) Push the changed reporting rules to the server device through the control message.

[0050] S202-5: After receiving the protocol change report message, the server device regenerates the data parsing logic, executes the new parsing rules, and the changed logic takes effect.

[0051] For example: In the early stage of the acquisition system, the reporting data type of 8 data reporting nodes is designed to be 32-bit integer. However, in actual scenarios, there are fixed periods or continuous changes between the two states of 0 and 1. In this case, the reporting data type of these data reporting nodes can be dynamically adjusted to BOOL type and the information of the 8 points can be integrated into a single byte for combined reporting, reducing the single transmission volume by 96.8%.

[0052] S203: The server device dynamically adjusts the transmission protocol based on the link status (packet loss rate) of the actual scenario, based on two factors: the transmission protocol's occupation of link resources and data accessibility. The specific steps are as follows: S203-1: First, based on ICMP and the PING function, the link status (connectivity, packet loss rate) of the two network nodes is obtained in real time according to the lost package related parameters. A decision tree is built based on QoS to calculate the protocol switching benefits in real time. The specific process is as follows: (1) Establish an independent ping service.

[0053] (2) The device sends a ping command to the server, or the server sends a ping command to the device at a fixed period.

[0054] (3) Count the packet loss rate based on each ping action (the standard ping action is based on UDP sending 4 ICMP data frames. If the network condition is good, there will be no packet loss in 4 transmissions. If the network condition is bad or the target IP is unreachable, 1 to 4 ping packets will be lost).

[0055] S203-2: First, develop a data transmission protocol selection strategy based on different network scenarios (high packet loss rate, low packet loss rate). The goal is to use this strategy to minimize the use of link resources (interaction complexity, message data volume) under different network conditions while ensuring data accessibility.

[0056] (1) Good network environment, no packet loss: UDP > TCP > MQTT; (2) Moderate network environment, packet loss rate <5%: TCP > MQTT > UDP; (3) Poor network environment, packet loss rate > 5%: MQTT > TCP > UDP; S203-3: The server device determines whether the transmission protocol needs to be adjusted according to the above two steps. If so, it starts monitoring the new link and assembles a protocol change message and pushes it to the transmission device.

[0057] S203-4: After receiving the protocol change control message, the transmission device switches the reporting protocol (reinitializes the reporting data link) and pushes the execution result and the new link parsing logic to the protocol change initiating device (server device).

[0058] S203-5: After receiving the new receiving and parsing rules, the server device closes the old connection; the transmission protocol change is completed.

[0059] For example, during system startup, the default data transmission protocol is TCP. However, based on monitoring and expectations, the link status will remain good for some time in the future. In this case, the transmission protocol can be downgraded to UDP to reduce the amount of data exchanged and reduce link overhead.

[0060] S204: The server device establishes a data message processing priority policy and adjusts the processing principles based on the data priority. It also dynamically adjusts the data priority and data reporting node grouping based on data utilization (whether the reported data is processed and fed back by the server device in a timely manner). The specific steps are as follows: S204-1: Establish rules for labeling data (urgent, regular, lazy).

[0061] S204-2: The server device gives priority to processing data messages with higher priorities (this can be achieved by establishing a hierarchical data processing engine or process or thread preemption).

[0062] S204-3: The server device monitors the number of reads and writes to the reported data cache to obtain data utilization. Specifically, the acquisition device reports the information of the data reporting node, and the server device caches the relevant information. Then, the server device counts the utilization of the relevant data. If the data has not been used or the frequency of use is not that high, the reporting period of these "inert" data can be adjusted by changing the reporting rules.

[0063] S204-4: Adjust the grouping strategy of data reporting nodes based on utilization. Data reporting nodes with utilization > 80% are grouped as the emergency group, data reporting nodes with utilization > 50% are grouped as the regular group, and data reporting nodes with utilization less than 50% are grouped as the inert group.

[0064] S204-5: Push the new grouping strategy to the collection device via a control message.

[0065] S204-6: After receiving the change message, the collection device re-collects and reports the point grouping, and establishes a new reporting data label rule.

[0066] S204-7: The collection device synchronizes the execution results to the server device.

[0067] S204-8: After receiving the execution result, the server device adjusts the reporting data parsing rules, and the change is completed.

[0068] For example, initially, the system divides the temperature, humidity, and speed data reporting nodes into two groups. Temperature and humidity are in the emergency group (with a collection and reporting cycle of 1 minute), while speed is in the inert group (with a collection and reporting cycle of 10 minutes). However, after a period of operation, the server-side device discovers through monitoring that the humidity data in the emergency group has not been used by any business. In this case, the humidity node can be adjusted to the inert group. This can reduce the collection pressure on the device side and the data transmission volume of the overall framework, allowing the overall framework to be continuously optimized and adapted to actual conditions during dynamic adjustments.

[0069] S3: Control logic design of transmission equipment.

[0070] The transport layer establishes the rules for adjusting the transmission link selection, transmission protocol, and method from the control protocol, and also establishes a feedback mechanism. Specifically, it includes the following processes: S301: Establish a link resource management mechanism (reduce or increase links) and a multiplexing mechanism at the transport layer to dynamically improve the utilization efficiency of link resources. The specific steps are as follows: S301-1: Define the link multiplexing decision threshold S according to the actual scenario (e.g., 10KByte / second).

[0071] S301-2: Based on the reported packet messages, count the data volume D within the link channel per unit time T.

[0072] S301-3: If (D / T) > S, locate the data reporting node based on the packet message, and then re-report the packet by the data reporting node based on the data link (split the points in the current link into new links or other relatively idle link resources for reporting).

[0073] S301-4: If there are two or more links with (D / T) < S, and the total data volume Q of the relevant links per unit time has a relationship with S: Q / T < S, at this time, adjust the reporting packet strategy of the data reporting node (integrate the data reporting nodes of multiple links into one link for reporting).

[0074] S301-5: Assemble the protocol change message according to the new packet and push it to the relevant acquisition devices and server devices.

[0075] S301-6: After the acquisition device receives the packet change message, execute the new data reporting node grouping logic and push the change result to the relevant nodes of the change.

[0076] S301-7: After the server device receives the change message, initialize the new reporting packet parsing logic (establish or delete parsing processes and threads) and push the result to the change initiator.

[0077] S301-8: After the relevant nodes complete the change result synchronization by organizing the messages, the change is completed and the new transmission framework takes effect.

[0078] Example: When the system starts, group the data of 50 data reporting nodes and report them through two socket links. During the working process, monitor the data volume of the two links and satisfy the relationship: Q / T < S. At this time, one link can be closed and the data of 100 data reporting nodes can be integrated into one link for reporting (the reporting period is not affected). This method can not only reduce resource consumption but also flexibly adjust the threshold according to the data processing capacity of the server device, ensuring the adaptive link adjustment based on hardware resources to the greatest extent.

[0079] S302: The transport layer compares and screens the data frame structure and data, and removes duplicate messages or data that is not within the change threshold range to reduce the amount of data transmitted on the link. The specific steps are as follows: S302-1: Repeat the message screening mechanism steps (1) The transport layer device caches the reported data frames based on the link and the grouping information of the data reporting node.

[0080] (2) Build a differential transmission engine to perform hash comparison on consecutive messages, only transmit the changed messages (similar to GitDiff), and discard the other unchanged messages.

[0081] S302-2: Threshold screening step.

[0082] (1) Set the threshold rule R for the data of the relevant data reporting node; (2) The transport layer monitors the received data reporting node data V. If the data reporting node data V meets the threshold rule R, the reported point data is discarded. Otherwise, the node data information is stored in the reporting cache. (3) Reorganize the reported data message according to the node information in the reported cache, and mark the data frame reconstruction flag and data parsing rules in the reported data message; (4) After receiving the reconstructed message, the server device parses the data according to the parsing protocol in the message.

[0083] Example: 90% of the fields in the sensor data frame remain unchanged, and only the difference fields are transmitted, reducing the data volume to 10% of the original data.

[0084] S303: Integrate transmission information, evaluate the current network status based on the detected link status, and predict the link status in the future, so as to achieve self-adaptation and adjust the transmission model. The specific steps are as follows: S303-1: Calculate network delay and jitter. The Round-Trip Time (RTT) method is used to calculate network delay, measuring the round-trip delay by sending and receiving probe packets. A sliding window method is used to calculate jitter, with a window size of 10 seconds.

[0085] S303-2: Predict future link conditions based on network status. A network status prediction model is established using an LSTM neural network, consisting of an input layer, an LSTM layer, and a fully connected layer. The preprocessed network status data is converted into a network state vector, which is then fed into the LSTM model for prediction. The network status is then predicted for the next 10 seconds.

[0086] S303-3: Assess network overload risk. A machine learning algorithm is used to assess network overload risk based on current network load, historical data, and forecast data. If the risk exceeds 70%, the transmission frame adjustment mechanism is activated.

[0087] S303-4: Calculate multiple optional paths using the Dijkstra algorithm, select the path with the largest bandwidth and the smallest delay as the optimal path, adjust link utilization efficiency, and optimize the transmission path selection strategy.

[0088] S303-5: Adjust data transmission frequency and rate. Dynamically adjust the data transmission frequency and rate based on network status and service quality. When the network condition is good, the transmission frequency and rate are increased; when the network condition is poor, the transmission frequency and rate are reduced.

[0089] S304: Dynamically adjust the number of transmission protocols (delay, protocol layer retransmission strategy), mark the link packet loss rate in real time, adjust the transmission protocol, and feed back the adjustment information to the transmission model optimization strategy. The specific steps are as follows: S304-1: Statistical method for transport layer link packet loss rate.

[0090] For protocols that contain packet confirmation logic (such as TCP and other TCP-based transport protocols), packet loss rate statistics are calculated within the protocol stack by analyzing TCP-seq (TCP packet number) and TCP retransmission counts.

[0091] For protocols that do not have transmission packet confirmation logic (such as UDP), this includes: (1) Based on the link, a message number is added to the link transmission message header to form a self-numbered message.

[0092] (2) After receiving the self-numbered message, the server device synchronizes the self-numbered message reply frame to the reporting node.

[0093] (3) If the transmission link does not receive a reply within the threshold time T, it is considered a packet loss.

[0094] (4) Within the threshold time T, the link will not push new data messages before the self-numbered message reply confirmation is completed.

[0095] S304-2: Based on the above packet loss rate statistics, the multi-protocol stack switch dynamically loads new transmission protocol parameter adjustments and dynamically adjusts the maximum number of retransmissions according to the packet loss rate (for example, from 3 to 5 when the packet loss rate is greater than 10%).

[0096] S304-3: The transport layer device performs adaptive switching of the transport protocol based on the monitored link information.

[0097] (1) Good network environment, no packet loss: UDP > TCP > MQTT; (2) Moderate network environment, packet loss rate <5%: TCP > MQTT > UDP; (3) Poor network environment, packet loss rate > 5%: MQTT > TCP > UDP.

[0098] S304-4: Assemble the transmission protocol change message according to the adjustment content and push it to the server device.

[0099] S304-5: After receiving the transmission protocol change message, the server device rebuilds the data receiving and parsing rules according to the change information, and pushes a change completion synchronization message to the transport layer device after the change is completed.

[0100] S304-6: After receiving the change result synchronization message, the transport layer device reports the data according to the new reporting protocol and transmission parameters, and the framework change takes effect.

[0101] S305: Implement the sleep and wake-up mechanism of the transport layer link resources to continuously reduce the power consumption of the transmission framework. The specific steps are as follows: S305-1: Create high-precision timing services (high-precision timers, etc.) within the link layer device based on actual scenario needs S305-2: Define the period error range V.

[0102] S305-3: Record the node data reporting period parameter C.

[0103] S305-4: Create a high-precision scheduled task T (T time = CV) based on the above two parameters V and C.

[0104] S305-5: Start the scheduled task T to perform link wake-up and data transmission services.

[0105] S305-6: After completing the transmission task, the link is closed and the timed task T is started.

[0106] S4: Control logic design of acquisition equipment.

[0107] Design an adjustment model for data transmission structure, transmission protocol, and transmission frequency from the control protocol to the acquisition device, and design a feedback model at the control protocol level (to provide decision-making basis for other control terminals).

[0108] S401: Establish a dynamic adjustment mechanism for reporting data frames based on the control protocol, and adjust the reporting data frame structure according to the changed message, thereby improving the Q / S ratio (Q: data information volume, S: data volume). The specific steps are as follows: S401-1: Adaptive logic.

[0109] (1) Define the data monitoring cycle threshold time T.

[0110] (2) Monitor the collected values ​​of relevant node data within time T.

[0111] (3) If the actual value range of the node data collected during the monitoring time T is inconsistent with the current design type range (the design type is: UINT32, the actual value is: UINT8), the reporting data structure of the relevant node data is adjusted. At the same time, it is determined whether it is possible to compress the characters of the data of multiple data reporting nodes and report them in combination.

[0112] (4) Assemble the reported data framing change message according to the adjustment action and push it to the server device.

[0113] (5) After receiving the change message, the server device reconstructs the data parsing logic according to the change rules and pushes the change completion synchronization message to the acquisition device.

[0114] (6) After the acquisition device receives the synchronization message, the new reporting data frame structure takes effect and the frame adjustment is completed.

[0115] Example: When the system starts, 8 nodes report data in a structure designed as UINT8. However, during the T period, the actual scene values ​​of the 8 nodes are monitored to fluctuate between 0 and 127. In this case, the 8-node data can be compressed from the previous 8-byte report to a 4-byte report, reducing the data volume by 50%.

[0116]

[0117] S401-2: Passive receiving protocol change logic: (1) Monitor whether a protocol change message is received.

[0118] { "Node ID", / / The identity of this device in the framework agreement "Target ID", / / Framework agreement changes the target device identifier "type", / / Protocol type, identifies the protocol type: control protocol "content", / / Content of the agreement { "action": / / Action type: node data reporting data frame adjustment "info": / / Change message content, identifying which data points need to be reported with data structure changes, and what type of changes are required.

[0119] [ / / Array structure, convenient for information expansion { "node01": "name", / / node name, identifies the specific node on the device side "change": 0, / / The enumeration value of the data type reported by the node, which indicates the type of the node to be adjusted (0: BOOL, 1: UINT8, 2: INT8, 3: UINT16) } ] } } (2) Parse the change message to obtain node change information (which data points need to report data structure changes and what type of changes need to be made) (3) Reorganize (merge, split) the reporting data frame according to the analysis content.

[0120] (4) Assemble and report the synchronization message of data frame structure change and push it to the server device.

[0121] (5) After receiving the synchronization message, the server device reorganizes the reporting data parsing logic.

[0122] (6) The server device pushes the change completion message to the collection device.

[0123] (7) After the acquisition device receives the change completion message, it starts to push data according to the new reporting logic, and the framework adjustment is completed and takes effect.

[0124] S402: Establish a device-side data service priority adjustment mechanism based on the control protocol. For example, adjust the data reporting node collection and reporting grouping based on the inert nodes and data reporting node priorities fed back in the control message. At the same time, dynamically adjust the event (process, thread) priority of specific services to ensure the scientific nature (timely and efficient) of device-side data collection and reporting. The specific steps are as follows: S402-1: The device monitors whether a change message is received.

[0125] S402-2: The device receives a message regarding node data priority adjustment and needs to perform the following actions: (1) Identify the data points to be adjusted and the levels to be adjusted based on the message information.

[0126] (2) Reconstruct the grouping of nodes for collecting and reporting data according to the adjustment level.

[0127] S402-3: When receiving a control message indicating a grouping reconstruction result, it is necessary to perform new grouping according to the grouping principle in the control message.

[0128] S402-4: Adjust the event priority of data collection and data reporting services on the collection device side according to the new grouping status.

[0129] S402-5: After receiving the reporting cycle adjustment message, the device side needs to adjust the cycle of the data reporting service.

[0130] S402-6: Synchronize adjustment and execution result information to relevant nodes.

[0131] S402-7: Adjustments are completed and the new framework rules are effective.

[0132] S403: Establishing a device sleep mechanism based on the control protocol. The specific steps are as follows: S403-1: Monitor control protocol change messages.

[0133] S403-2: After receiving the change message, the device sleep time T (T <C&&T<R)。

[0134] S403-3: After the business layer collects and reports, a timer is used to put the device into sleep mode for a period of time T.

[0135] S403-4: After waking up, the device continues to perform related collection and reporting services.

[0136] In the present invention, the old configuration is saved before each control protocol adjustment. If the new configuration causes communication failure (such as three consecutive timeouts), it will automatically roll back to the previous version of the control protocol.

[0137] Based on the overall design of the above transmission framework, such as Figure 2 As shown, this implementation proposes a dynamic tuning method for IoT transmission, which is applied to the server device and includes the following processes: A201: Obtain the data change mechanism of the data reporting node of the collection device and adjust the reporting mechanism of the data reporting node through the control protocol; A202: Identify the optimal data type for the data reporting node based on the behavior mechanism of the data reporting node, and adjust the data transmission type and structure of the data reporting node through the control protocol; A203: Dynamically adjust the control protocol based on the link resource usage and data accessibility of the control protocol; A204: Adjust the processing principle according to data priority, and dynamically adjust the data priority and data reporting node grouping according to data utilization.

[0138] Based on the overall design of the transmission framework described above, this implementation proposes an IoT transmission dynamic tuning system, including a server device, a transmission device, and a collection device. The server device communicates with the collection device via the transmission device and is configured to perform the following process: Obtain the data change mechanism of the data reporting node of the collection device and adjust the reporting mechanism of the data reporting node through the control protocol; According to the behavior mechanism of the data reporting node, identify the optimal data type suitable for the data reporting node, and adjust the data transmission type and structure of the data reporting node through the control protocol; Dynamically adjust the control protocol based on the link resource usage and data accessibility of the control protocol; Adjust the processing principle according to the data priority, and dynamically adjust the data priority and data reporting node grouping according to the data utilization.

[0139] The transmission device is configured to perform the following process: Establish link resource management and reuse mechanisms; Compare and screen the data frame structure and data, and filter out duplicate messages or data that is not within the change threshold range; Evaluate the current network status based on the detected link status and predict the link status in the future; Dynamically adjust the data reporting transmission protocol, mark the link packet loss rate in real time, and synchronize the data reporting protocol adjustment through the control protocol; Establish a dormancy mechanism and a wake-up mechanism for link resources.

[0140] The acquisition device is configured to perform the following process: Establish a dynamic adjustment mechanism for reporting data frames based on the control protocol, and adjust the reporting data frame structure according to the change message; Establish a data priority adjustment mechanism for acquisition equipment based on the control protocol; Establish a device sleep mechanism based on the control protocol.

[0141] In summary, the transmission framework optimization solution proposed in this implementation method does not require reliance on software and hardware updates at all. It can adjust key parameters and application logic of the transmission framework, such as the amount of transmitted data, transmission protocol, and transmission frequency, and can achieve dynamic optimization of the transmission framework through self-adjustment of the transmission framework.

[0142] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be within the scope of protection of the present invention.

Claims

1. A method for dynamic tuning of Internet of Things transmission, characterized in that: Applied to server devices, The following processes are included: Obtain the data change mechanism of the data reporting node of the collection device and adjust the reporting mechanism of the data reporting node through the control protocol; According to the behavior mechanism of the data reporting node, identify the optimal data type suitable for the data reporting node, and adjust the data transmission type and structure of the data reporting node through the control protocol; Dynamically adjust the control protocol based on the link resource usage and data accessibility of the control protocol; Adjust the processing principle according to the data priority, and dynamically adjust the data priority and data reporting node grouping according to the data utilization.

2. The method for dynamic tuning of Internet of Things transmission according to claim 1, wherein: Obtain the data change mechanism of the data reporting node of the collection device and adjust the reporting mechanism of the data reporting node through the control protocol, including: Build a data monitoring engine to record the number of changes and the time of change of data reporting nodes per unit time; According to the number of changes and the time of change, the change frequency of the data reporting nodes is predicted and the data reporting nodes are regrouped; The collection and reporting logic of the regrouped data reporting nodes is pushed to the collection device through the control protocol, so that the collection device performs the following change actions after receiving the control protocol: adjust the collection period of different groups according to the change frequency of the data reporting nodes, and adjust the reporting period of different groups according to the change frequency of the data reporting nodes.

3. The method for dynamic tuning of Internet of Things transmission according to claim 1, wherein: Based on the behavior mechanism of the data reporting node, identify the optimal data type for the data reporting node and adjust the data transmission type and structure of the data reporting node through the control protocol, including: Build a behavior mechanism engine for data reporting nodes; If within the set time range, it is detected that the actual value type of the data reporting node is different from the designed type, the data type will be automatically modified; Integrate all data reporting nodes that need to adjust the data type, assemble the rule change control protocol and push it to the collection device, so that the collection device performs the following change actions: integrate all data reporting nodes that need to change the rules, re-construct the reporting rules and data reporting node grouping rules, and push the changed reporting rules and data reporting node grouping rules to the server device through the control message; After receiving the changed reporting rules and data reporting node grouping rules from the collection device, regenerate new data parsing logic and execute it; or, Dynamically adjust the control protocol based on the link resource usage and data accessibility of the control protocol, including: Calculate the protocol switching benefit based on the link status of the network; Develop a data control protocol selection strategy based on different packet loss rate network scenarios; Determine whether control protocol adjustment is required based on the protocol switching benefit and the packet loss rate. If adjustment is required, start link monitoring, assemble a protocol change message based on the selected control protocol adjustment strategy, and push it to the transmission device, so that the transmission device executes the control protocol switching and returns the execution result and the new link reception and parsing logic; After receiving the new link reception and parsing logic from the transmission device, the original link is closed and the control protocol change is completed; or, Adjust processing principles based on data priority, and dynamically adjust data priority and data reporting node grouping based on data utilization, including: Establish data labeling rules, including: urgent, routine, and inert; Give priority to data packets with high priority; Monitor the number of reads and writes to the reported data cache to obtain data utilization; Adjust the grouping strategy of data reporting nodes according to utilization: data reporting nodes with utilization greater than a first set threshold are grouped as the emergency group, data reporting nodes with utilization less than or equal to the first set threshold and greater than a second set threshold are grouped as the regular group, and data reporting nodes with utilization less than or equal to the second set threshold are grouped as the inert group; Push the new grouping strategy to the collection device through the control message, so that the collection device regroups the data reporting nodes and establishes new data labeling rules; After receiving the grouping and data labeling rules of the data reporting nodes from the collection device, the grouping and data labeling rules of the data reporting nodes are adjusted.

4. A method for dynamic tuning of Internet of Things transmission, characterized in that: The server device is communicatively connected to the collection device via the transmission device, and the server device is configured to execute the method for dynamic optimization of Internet of Things transmission according to any one of claims 1 to 3; The transmission device is configured to perform the following process: Establish link resource management and reuse mechanisms; Compare and screen the data frame structure and data, and filter out duplicate messages or data that is not within the change threshold range; Evaluate the current network status based on the detected link status and predict the link status in the future; Dynamically adjust the data reporting transmission protocol, mark the link packet loss rate in real time, and synchronize the data reporting protocol adjustment through the control protocol; Establish a dormancy mechanism and a wake-up mechanism for link resources.

5. The method for dynamic tuning of Internet of Things transmission according to claim 4, characterized in that: Establish link resource management and reuse mechanisms, including: Define the link reuse decision threshold S based on the actual network scenario; Count the amount of data D within the unit time T; if , locate the data reporting node based on the group message, and re-report the data reporting node based on the data link; If there are two or more links , and the total amount of data per unit time Q is related to S: , then adjust the reporting group logic of the data reporting node and integrate the data reporting nodes of each link into one link for reporting; The protocol change message is assembled according to the new reporting grouping logic to obtain a grouping change message, and is pushed to the collection device and the server device, so that after receiving the grouping change message, the collection device executes the new reporting grouping logic and pushes the change result to the changed data reporting node, and after receiving the grouping change message, the server device initializes the new reporting grouping logic and pushes the result to the changed data reporting node; or, Compare and screen the data frame structure and data, and filter out duplicate messages or data that is not within the change threshold, including: The transmission equipment caches the reported data frames based on the link and data reporting node grouping, builds a differential transmission engine, performs hash comparison on consecutive messages, and only transmits the changed messages, discarding the unchanged messages; Set a threshold rule R for the data of the data reporting node; The transmission device monitors the received data reporting node data V. If the threshold rule R is not met, the data reporting node data V is discarded. Otherwise, the data reporting node data V is stored in the reporting cache. Reorganize the reported data message according to the data in the reported buffer, and mark the data frame reconstruction flag and data parsing rules in the reported data message, so that after the server device receives the reported data message, it performs data parsing according to the data parsing rules in the reported data message; or, Evaluate the current network status based on the detected link status and predict the link status in the future, including: Calculate historical link status; Predict future link status based on historical link status; A machine learning algorithm is used to assess network overload risk based on current network load, historical link status, and predicted future link conditions. When the network overload risk exceeds a set threshold, a transmission adjustment mechanism is activated. Calculate multiple optional paths and select the path with the largest bandwidth and the smallest delay as the optimal transmission path; Dynamically adjust data transmission frequency and rate according to the current network status.

6. The method for dynamic optimization of Internet of Things transmission according to claim 4, wherein: Dynamically adjust the data reporting transmission protocol, mark the link packet loss rate in real time, and adjust the transmission protocol, including: Calculate the link packet loss rate; Dynamically load new transmission protocol parameters through the multi-protocol stack switch based on the link packet loss rate; Adaptive switching of transmission protocols based on monitored link information; The transmission protocol change message is assembled according to the adaptively switched transmission protocol and pushed to the server device, so that after the server device receives the transmission protocol change message, it rebuilds the data reception and parsing rules according to the transmission protocol change message, and pushes the change completion synchronization message to the transmission device after the change is completed, and after the transmission device receives the change completion synchronization message, it reports the data according to the new reporting protocol and transmission parameters.

7. The method for dynamic optimization of Internet of Things transmission according to claim 4, wherein: The acquisition device is configured to perform the following process: Establish a dynamic adjustment mechanism for reporting data frames based on the control protocol, and adjust the reporting data frame structure according to the change message; Establish a data priority adjustment mechanism for acquisition equipment based on the control protocol; Establish a device sleep mechanism based on the control protocol.

8. The method for dynamic tuning of Internet of Things transmission according to claim 7, characterized in that: A dynamic adjustment mechanism for reporting data frames is established based on the control protocol, and the structure of the reporting data frames is adjusted according to the change message, including: Define the data monitoring cycle threshold time; Monitoring data collection value within the monitoring cycle threshold time; If the actual value range of the collected value does not match the current design type range, the reported data structure is adjusted; The data change message is assembled and reported according to the adjustment action and pushed to the server device, so that after receiving the data assembly change message, the server device reconstructs the data parsing logic according to the change rules and pushes the change completion synchronization message to the collection device.

9. The method for dynamic optimization of Internet of Things transmission according to claim 7, wherein: Establish a data priority adjustment mechanism for acquisition devices based on the control protocol, including: When receiving a node data priority adjustment message, the data reporting node to be adjusted and the level to be adjusted are identified according to the message information, and the data reporting node is grouped and reconstructed according to the level to be adjusted; When receiving the control message of the grouping reconstruction result, the new grouping is performed according to the grouping principle in the control message, and the event priority of the data collection and data reporting business on the collection device side is adjusted according to the new grouping; After receiving the reporting cycle adjustment message, adjust the cycle of the data reporting service.

10. A dynamic tuning system for Internet of Things transmission, It is characterized by: The method comprises: a server device, a transmission device and a collection device, wherein the server device is communicatively connected to the collection device via the transmission device, and the server device is configured to execute the method according to any one of claims 1 to 3; The transmission device is configured to perform the following process: Establish link resource management and reuse mechanisms; Compare and screen the data frame structure and data, and filter out duplicate messages or data that is not within the change threshold range; Evaluate the current network status based on the detected link status and predict the link status in the future; Dynamically adjust the data reporting transmission protocol, mark the link packet loss rate in real time, and synchronize the data reporting protocol adjustment through the control protocol; Establishing dormancy and wake-up mechanisms for link resources; The acquisition device is configured to perform the following process: Establish a dynamic adjustment mechanism for reporting data frames based on the control protocol, and adjust the reporting data frame structure according to the change message; Establish a data priority adjustment mechanism for acquisition equipment based on the control protocol; Establish a device sleep mechanism based on the control protocol.

Images