Flow-Aware Buffer Management for Data Center Switches
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data center switching elements face buffer overflow issues due to 'elephant' traffic flows, leading to bandwidth hogging and increased latency for 'mouse' flows, which negatively impacts user experience and customer satisfaction.
Innovation Solution
Implementing flow-aware buffer management by distinguishing between elephant and mouse flows, using packet marking or discarding to control elephant flows when buffer thresholds are met, thereby preventing buffer overflow and maintaining sufficient space for mouse flows.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If elephant flows are allowed to occupy buffer resources, then throughput for large flows is improved, but latency for mouse flows deteriorates and buffer overflow occurs
Solution Approach 1:
The patent segments buffer resources into different queues based on flow type (elephant flows vs. mouse flows). By classifying traffic into distinct categories and allocating buffer space accordingly, the system can guarantee minimum buffer resources for latency-sensitive mouse flows while still allowing elephant flows to utilize available capacity, thus resolving the contradiction between throughput and latency
Solution Approach 2:
The patent applies different buffer management policies to different flow types. Elephant flows receive buffer space when available, while mouse flows are guaranteed minimum buffer access. This localized differentiation of buffer quality and access rights allows each flow type to operate under optimal conditions without interfering with the other's performance characteristics
2Object-generated harmful factors
If buffer size is increased to accommodate elephant flows, then bandwidth hogging is reduced, but device complexity and cost increase
Solution Approach 1:
The patent implements dynamic buffer allocation where elephant flows can utilize buffer space when it is available but must yield when mouse flows require it. This dynamic sharing mechanism eliminates the need for oversized static buffers, as the buffer naturally adapts to traffic patterns without requiring excessive capacity to prevent bandwidth hogging
Solution Approach 2:
The buffer management system automatically classifies flows and allocates buffer resources without external intervention. The switch independently monitors buffer utilization and enforces flow control policies, eliminating the need for manual buffer size configuration or external traffic management infrastructure
3Reliability
If flow control is applied to elephant flows, then buffer overflow is prevented, but throughput for elephant flows decreases
Solution Approach 1:
The patent applies preliminary flow control to elephant flows by marking packets and implementing rate limiting before the buffer becomes full. This proactive approach prevents buffer overflow conditions from developing while allowing elephant flows to maintain high throughput during normal operating conditions, only applying restrictions when necessary
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods are provided that enable flow aware buffer management. The method includes storing in a queue of a buffer a first type of traffic, storing in the queue of the buffer a second type of traffic, wherein the first type of traffic is less sensitive to latency than the second type of traffic, and when an amount of the first type of traffic meets or exceeds a first threshold, effecting flow control of the first type of traffic to slow a flow of the first type of traffic into the buffer. Flow control can be effected using packet marking or discarding packets. The methodology has particular utility in connection with managing elephant and mouse flows in a network switch.