Distributed Data Transmission Bypassing Main Control Bottleneck
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed network systems, especially those with a modular configuration, data collected by interface boards often aggregates at a main control board, leading to bottlenecks in data transmission, resulting in delayed and inaccurate network measurement results due to the limitations of TCP connections.
Innovation Solution
The method involves the main control board determining a second connection parameter for each interface board, allowing them to establish direct connections with the analysis device, thereby bypassing the need for data aggregation at the main control board, ensuring timely and accurate data transmission even with multiple interface boards collecting data simultaneously.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is aggregated through the main control board using TCP connections, then network measurement can be performed, but data transmission becomes a bottleneck when there are many interface boards
Solution Approach 1:
The patent segments the centralized data transmission path into multiple direct transmission paths. Each interface board establishes an independent connection to the analysis device, dividing the single bottleneck channel into multiple parallel channels. This segmentation eliminates the aggregation bottleneck at the main control board while maintaining reliable network measurement capability.
2Quantity of substance
If multiple interface boards send data through the main control board, then data collection is comprehensive, but the TCP connection bearer capability is exceeded
Solution Approach 1:
The patent changes the transmission topology from a two-dimensional hierarchical structure (interface boards → main control board → analysis device) to a multi-dimensional mesh structure where multiple interface boards connect directly to the analysis device through separate TCP connections. This dimensional change in the connection architecture allows comprehensive data collection from multiple interface boards without exceeding the bearer capability of any single connection.
3Ease of operation
If data is aggregated at the main control board, then centralized control is maintained, but data cannot be sent timely to the analysis device
Solution Approach 1:
The patent extracts the data transmission function from the main control board and assigns it directly to each interface board. Each interface board independently establishes TCP connections and transmits collected data directly to the analysis device, removing the time-consuming aggregation and forwarding process through the main control board. This extraction of the transmission function reduces data transmission delay while the analysis device still receives comprehensive data for centralized analysis.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
This application discloses a data transmission method and a related apparatus. A first device receives a connection establishment request and a target data feature that are sent from an analysis device, where the connection establishment request includes a first connection parameter of the analysis device; determines, based on the target data feature, a second device that collects to-be-analyzed data corresponding to the target data feature, where the first device and the second device belong to a same distributed system; determines a second connection parameter of the second device; and sends the first connection parameter, the second connection parameter, and the target data feature to the second device, so that the second device establishes a connection to the analysis device based on the first connection parameter and the second connection parameter, and transmits the to-be-analyzed data corresponding to the target data feature to the analysis device through the established connection. This application can avoid a problem that the data collected by the second device is aggregated in bulk to the first device, and consequently, the collected data cannot be sent to the analysis device in a timely manner, and a network measurement result obtained by the analysis device is not timely and accurate.