Server Fabric Adapter Packet Segmentation for Heterogeneous I/O Scaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing heterogeneous compute servers face bandwidth bottlenecks, complex packet processing, scaling limitations, insufficient load balancing, lack of visibility and control, and operational inefficiencies due to the use of network interface controllers (NICs) and private network fabrics, particularly in multiprocessor architectures with specialized processors.
Innovation Solution
A server fabric adapter (SFA) that separates network packets into portions and maps them to designated controlling hosts and endpoints, enabling efficient, scalable, and elastic communication across heterogeneous resources, with support for high-speed I/O and network throughput, and allowing parallel processing of protocol layers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If network interface controllers (NICs) and private network fabric are used in heterogeneous compute servers, then network communication functionality is provided, but bandwidth bottlenecks and scaling limitations occur
Solution Approach 1:
The patent segments the network packet processing by separating header processing from payload processing. The SFA divides incoming network packets into header portions and payload portions, routing them to different processing units. This segmentation eliminates the bandwidth bottleneck by allowing parallel processing of different packet components through different interfaces (PCIe for headers, CXL for payloads), thereby improving overall network communication throughput without increasing device complexity.
2Ease of operation
If NIC-based packet processing is used, then network communication is enabled, but complex packet processing and insufficient load balancing occur
Solution Approach 1:
The SFA acts as an intermediary device between the network fabric and the compute nodes. It receives packets from the network fabric, separates headers from payloads, and independently routes them to appropriate processing units. This intermediary approach simplifies packet processing by centralizing the complex separation and routing logic in the SFA, while enabling efficient load balancing across multiple processing units through intelligent routing decisions based on packet metadata.
3Adaptability or versatility
If traditional NIC architecture is used, then network interface functionality is provided, but lack of visibility and control over packet processing occurs
Solution Approach 1:
The SFA performs preliminary actions by separating packet headers from payloads before they reach the processing units. It extracts metadata from packet headers, makes routing decisions in advance, and prepares separate processing paths for different packet portions. This preliminary processing provides full visibility and control over packet processing, as the SFA can inspect, route, and manage each packet component independently before forwarding to the appropriate destination.
Data Source
AI summary
A server fabric adapter (SFA) communication system is disclosed. In some embodiments, the SFA communication system comprises an SFA communicatively coupled to a plurality of controlling hosts, a plurality of endpoints, and a plurality of network ports. The SFA is configured to receive a network packet from a network port of the plurality of network ports; separate the network packet into different portions, each portion including a header or a payload; map each portion of the network packet to: (i) a controlling host of the plurality controlling hosts, the controlling host being designated as a destination controlling host, or (ii) an endpoint of the plurality of endpoints, the endpoint being designated as a destination endpoint; and forward a respective portion of the network packet to the destination controlling host or the destination endpoint.