Data Forwarding Chip for Server I/O Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In servers with multiple processors sharing a network interface card, data transmission delays and increased I/O overheads occur due to the need for cross-chip data transmission through a communication bus, as only one processor is directly connected to the network interface card.
Innovation Solution
A data forwarding chip is introduced, connected to both the network interface card and processors via a bus, which receives data forwarding requests and forwards data through a target endpoint port directly connected to the relevant memory space, avoiding cross-chip transmission by determining the shortest path based on memory distribution information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If multiple processors share a single network interface card connected to only one processor, then device complexity is reduced, but data transmission delay increases and I/O overhead increases
Solution Approach 1:
The patent introduces a data forwarding chip that segments the data transmission path. Each processor connects to the data forwarding chip, which then connects to the network interface card. This segmentation allows any processor to access the network interface card through the forwarding chip, eliminating the need for cross-chip transmission through the processor bus and reducing data transmission delay.
Solution Approach 2:
The data forwarding chip acts as an intermediary between processors and the network interface card. It receives data forwarding requests from processors, determines the target endpoint port based on memory distribution information, and forwards data through the shortest path. This intermediary role eliminates direct cross-chip transmission requirements and reduces I/O overhead.
2Device complexity
If multiple processors share a single network interface card connected to only one processor, then device complexity is reduced, but I/O overhead increases
Solution Approach 1:
The data forwarding chip segments the I/O path by providing separate endpoint ports for different processors. Each processor has its own dedicated path through the forwarding chip to the network interface card, allowing concurrent I/O operations without interference and improving I/O operation efficiency.
Solution Approach 2:
The data forwarding chip mediates I/O operations by managing memory distribution information and determining optimal data paths. It processes data forwarding requests efficiently, routing data through the shortest path without requiring processors to wait for cross-chip transmission, thereby improving I/O productivity.
3Reliability
If data is transmitted through cross-chip transmission via communication bus between processors, then connectivity is achieved, but data transmission delay increases
Solution Approach 1:
The patent extracts the data forwarding function from the processor bus communication path. The data forwarding chip handles all data routing decisions and path determination externally, allowing processors to simply send data to the forwarding chip without waiting for cross-chip transmission through the bus. This extraction eliminates the time-consuming cross-chip transmission step.
Solution Approach 2:
The data forwarding chip serves as an intermediary that manages data routing between processors and the network interface card. It determines the shortest path based on memory distribution information and forwards data accordingly, eliminating the need for processors to perform cross-chip transmission through the communication bus and reducing data transmission delay while maintaining connectivity.
Data Source
AI summary
A data forwarding chip and a server are disclosed. The server includes a data forwarding chip, a network interface card, and a processor. The data forwarding chip is separately connected to the network interface card and the processor through a bus. After receiving a data forwarding request sent by the processor or the network interface card, the data forwarding chip forwards, based on a destination address of the data forwarding request through an endpoint port that is on the forwarding chip and that is directly connected to a memory space corresponding to the destination address of the data forwarding request, to-be-forwarded data specified in the data forwarding request, such that when the server sends or receives data, cross-chip transmission of data between processors occurs, thereby reducing a data transmission delay.