Switch Queuing Logic for Multi-Host NIC Bandwidth Mismatch
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-host network architectures, switches face challenges in efficiently forwarding packets to multiple physical computing units due to bandwidth mismatches, leading to traffic bottlenecks and packet loss, as they attempt to transmit packets at 'wire speed' without considering the varying communication channel bandwidths of individual units.
Innovation Solution
The implementation of control and queuing logic in network switches that separates and queues packets based on destination addresses, arbitrating their transmission to maintain rates within the bandwidth limits of individual communication channels, thereby preventing bottlenecks and optimizing resource utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If packets are transmitted at wire speed through a single egress port to multiple physical computing units, then transmission speed is improved, but packet loss occurs due to bandwidth mismatches between the egress port and individual communication channels
Solution Approach 1:
The patent segments the single egress port's traffic stream into multiple separate queues, with each queue dedicated to a specific physical computing unit. This segmentation allows independent rate control for each destination, preventing bandwidth mismatches from causing packet loss while maintaining high transmission speeds.
Solution Approach 2:
The patent performs preliminary queuing and rate limiting before packets are transmitted through the egress port. By organizing packets into destination-specific queues and applying rate limits in advance, the system prevents packet loss at the transmission point while maintaining wire-speed egress capability.
2Productivity
If a single egress port serves multiple physical computing units with different bandwidth requirements, then resource utilization is improved, but traffic bottlenecks occur due to bandwidth mismatches
Solution Approach 1:
The patent applies different transmission rates and queuing policies to different destinations based on their specific bandwidth requirements. Each physical computing unit receives tailored rate limiting and queuing treatment, optimizing resource utilization for each unit while preventing bottlenecks caused by uniform treatment of diverse bandwidth needs.
3Reliability
If packets are queued and arbitrated for multiple destinations through a single egress port, then packet loss is prevented, but device complexity increases due to control and queuing logic
Solution Approach 1:
The patent implements a universal queuing and arbitration mechanism that handles multiple destinations through a single egress port using a standardized control structure. This multi-functional approach manages diverse traffic flows with a unified logic framework, preventing packet loss while avoiding the need for separate complex control systems for each destination.
Data Source
AI summary
Communication apparatus includes multiple ports configured to serve as ingress and egress ports, such that the ingress ports receive packets from a packet data network for forwarding to respective egress ports. The ports include an egress port configured for connection to a network interface controller (NIC) serving multiple physical computing units, which have different, respective destination addresses and are connected to the NIC by different, respective communication channels. Control and queuing logic is configured to queue the packets that are received from the packet data network for forwarding to the multiple physical computing units in different, respective queues according to the destination addresses, and to arbitrate among the queues so as to convey the packets from the queues via the same egress port to the NIC, for distribution to the multiple physical computing units over the respective communication channels.