Bandwidth Allocation in Distributed Upload Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing network management systems struggle to optimize bandwidth allocation in distributed systems with frequent and large uploads from multiple endpoints to a central server, especially when endpoints are scattered across a wide area network, as they rely on independent client determination, leading to suboptimal bandwidth usage.
Innovation Solution
A computer-implemented method that generates a logical network topology based on measurements, allocates bandwidth using a tree traversal algorithm, and controls consumption to achieve optimal bandwidth allocation, employing convex optimization or max-min fairness techniques to ensure efficient and fair bandwidth distribution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If each endpoint determines independently whether to throttle its own uploading, then each endpoint can control its own bandwidth usage, but the overall bandwidth usage is suboptimal
Solution Approach 1:
The patent introduces a central server as an intermediary that collects network state information from all endpoints and makes centralized bandwidth allocation decisions. The server acts as a mediator between endpoints, distributing optimized bandwidth assignments back to them, thus resolving the contradiction between endpoint autonomy and overall bandwidth optimization.
Solution Approach 2:
The system implements a feedback mechanism where endpoints report their network conditions and bandwidth usage to the central server, which then adjusts bandwidth allocations based on this feedback. This closed-loop control enables the system to dynamically optimize overall bandwidth usage while maintaining endpoint autonomy through centralized coordination.
2Productivity
If multiple endpoints upload data simultaneously to a central server across a WAN, then data synchronization is achieved, but network congestion occurs
Solution Approach 1:
The patent implements dynamic bandwidth allocation where the central server continuously monitors network conditions and adjusts bandwidth assignments in real-time. This dynamic adaptation allows the system to maintain high data synchronization speeds while dynamically preventing network congestion by adjusting upload rates based on current network state.
Solution Approach 2:
The system changes bandwidth allocation parameters dynamically based on network conditions. The central server adjusts transmission parameters such as upload rates, timing, and prioritization for different endpoints, transforming the static bandwidth allocation into a dynamic parameter set that adapts to prevent congestion while maintaining synchronization speed.
3Productivity
If QoS policies are applied to control network traffic, then bandwidth can be managed effectively, but the system becomes more complex
Solution Approach 1:
The patent merges the bandwidth management function into a single central server that handles all bandwidth allocation decisions for multiple endpoints. This consolidation simplifies the system architecture by replacing complex distributed QoS policies with a unified centralized management approach, reducing overall system complexity while maintaining effective bandwidth control.
Data Source
AI summary
Techniques are disclosed herein for managing network bandwidth in a distributed system having multiple endpoints that upload data to a central server or server cluster. One embodiment provides a computer-implemented method that includes receiving a logical topology of the network that is determined based on network measurements. The method further includes generating a tree having links of the logical network topology as nodes, and allocating bandwidth during a traversal of the tree to obtain a bandwidth allocation scheme for the endpoints uploading data. In addition, the method includes controlling bandwidth consumption by the endpoints based on the determined bandwidth allocation scheme.