Concurrent Data Transmission via Dynamic Packet Splitting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data transmission methods in storage systems face challenges in completing incremental data replication within the Recovery Point Objective (RPO) time frame, leading to potential data loss and processor resource overload.
Innovation Solution
The method involves acquiring statistical data such as processor utilization rates and bandwidth utilization rates, calculating time consumption for data packet transmission, and determining the processing resources required for splitting and packaging data packets. An optimal split number is then calculated to concurrently transmit data packets, improving transmission speed and reducing processor resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data packets are split and concurrently transmitted to improve transmission speed, then data transmission speed is improved, but processor resource consumption increases and may cause processor overload
Solution Approach 1:
The patent divides a data packet into multiple sub-packets for concurrent transmission. The splitting module segments the original data packet into multiple smaller packets that can be transmitted simultaneously through different channels, thereby improving transmission speed while managing processor load through controlled segmentation
Solution Approach 2:
The patent dynamically adjusts the split number of data packets based on real-time processor utilization rate and bandwidth utilization rate. The determination module calculates the optimal split number by considering current system state, allowing the system to adapt processor resource allocation to actual transmission needs, preventing overload while maximizing transmission efficiency
2Reliability
If data replication is completed within RPO time frame to reduce data loss, then data safety is improved, but transmission time constraints increase system pressure
Solution Approach 1:
The patent performs preliminary calculations of the optimal split number before actual data transmission. By pre-calculating the required packet segmentation based on RPO requirements, processor utilization rate, and bandwidth conditions, the system prepares the transmission strategy in advance, ensuring data can be replicated within the required time frame without last-minute rushes that increase system pressure
Solution Approach 2:
The patent implements a feedback mechanism where the determination module continuously monitors processor utilization rate and bandwidth utilization rate during transmission. Based on this real-time feedback, the system adjusts the split number dynamically to ensure data replication completes within RPO time frame while adapting to changing system conditions, thereby maintaining data safety without excessive time pressure
3Productivity
If processor utilization rate is increased to handle more data transmission tasks, then data transmission capacity is improved, but processor performance degradation occurs due to overload
Solution Approach 1:
The patent applies partial action by calculating and using only the necessary split number of data packets required to achieve the desired transmission capacity, rather than maximizing processor utilization to the limit. The determination module computes the optimal split number that provides sufficient transmission capacity while leaving headroom to prevent processor overload and performance degradation
Data Source
AI summary
For concurrent data transmission, an example method includes acquiring a processor utilization rate related to transmission of historical data packet(s) and a bandwidth utilization rate of a data link within a target time period. A time consumption for transmitting a target data packet, a splitting processing resource related to a splitting operation, and a packaging processing resource related to a packaging operation are determined. Based on the processor utilization rate, the bandwidth utilization rate, the time consumption, the splitting processing resource, and the packaging processing resource, a split number is determined for the target data packet to concurrently transmit the target data packet. In this way, a data transmission speed can be improved, time consumed for transmitting the target data packet can be reduced, and meanwhile, it can also alleviate problems such as excessive processing resource consumption and overloaded operation of the processor caused by concurrent transmission.


