Data Transfer Controller Buffering for Switch Bandwidth Limits
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In systems with multiple accelerators, high data transfer volumes can exceed the bandwidth between a receiving device and a switch, leading to difficulties in normal data processing due to incomplete data transfer.
Innovation Solution
A data transfer controller manages data transfer by storing excess data in a first memory when the transfer volume exceeds the bandwidth, allowing second devices to acquire the data from the memory, thereby maintaining data processing without exceeding the bandwidth.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is transferred in parallel from the first device to multiple second devices, then data processing efficiency is improved, but the bandwidth between the first device and the switch is exceeded
Solution Approach 1:
The data transfer controller predicts the data transfer volume before actual transfer occurs. When the predicted volume exceeds the bandwidth between the first device and switch, the controller preemptively stores the data in a first memory instead of transferring it directly. This preliminary action prevents bandwidth overflow while maintaining the ability to supply data to multiple second devices.
Solution Approach 2:
A first memory is introduced as an intermediary storage buffer between the first device and the switch. The data transfer controller manages this memory to temporarily store data when direct transfer would exceed bandwidth limits. This intermediary allows decoupling of the data generation rate from the data transfer rate, enabling parallel transfers without overwhelming the switch bandwidth.
2Reliability
If data is stored in a first memory when transfer volume exceeds bandwidth, then data loss is prevented, but additional memory resources are required
Solution Approach 1:
The data transfer controller dynamically adjusts data storage and transfer operations based on real-time bandwidth conditions. When bandwidth is sufficient, data is transferred directly without using the first memory. When bandwidth is insufficient, the controller activates the first memory for temporary storage. This dynamic adaptation ensures data completeness while minimizing memory resource consumption to only when necessary.
Solution Approach 2:
The system changes the data transfer parameter from direct transfer to memory-based transfer based on bandwidth conditions. The data transfer controller monitors the bandwidth between the first device and switch, and switches between transfer modes (direct vs. via memory) accordingly. This parameter change allows the system to maintain data completeness while optimizing memory usage based on actual transfer needs.
Data Source
AI summary
A data transfer controller for controlling transfer of a plurality of data items from a first device to a plurality of second devices includes a processor configured to transfer at least one data item of a plurality of data items that is to be transferred from the first device to the plurality of second devices, to at least one first memory, upon occurrence of a condition in which an hourly transfer volume of the plurality of data items transferred from the first device to a switch exceeds a bandwidth between the first device and the switch, and to cause the plurality of second devices to acquire the at least one data item that is stored in the at least one first memory.