Dynamic Protocol Threshold for MPI Network Performance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing MPI libraries in high-performance computing environments use fixed protocol switching criteria that do not consider network characteristics and topology, leading to suboptimal data transmission performance.
Innovation Solution
A method to dynamically set and adjust the threshold value for switching between eager and rendezvous protocols based on network performance measurements, using test data to determine the optimal protocol switching criteria.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a fixed threshold value is used for protocol switching, then the system is simple to operate and implement, but the network performance cannot be optimized for different network characteristics and topologies
Solution Approach 1:
The patent implements dynamic protocol switching by automatically adjusting the threshold value based on real-time network performance measurements. The system performs benchmark tests to measure network bandwidth and latency, then dynamically sets the threshold value that optimizes the switching point between eager and rendezvous protocols. This transforms the static, fixed-threshold approach into a dynamic system that adapts to changing network conditions, resolving the contradiction between operational simplicity and performance optimization.
Solution Approach 2:
The patent changes the threshold parameter from a fixed value to a dynamically adjusted value based on network characteristics. By performing benchmark tests and calculating optimal threshold values based on measured network performance parameters (bandwidth, latency), the system adapts the switching criterion to match specific network topologies and characteristics, thereby improving network performance without significantly complicating the operation.
2Ease of manufacture
If manual setting of threshold value is used, then the implementation is straightforward, but the system cannot adapt to changes in network performance
Solution Approach 1:
The patent implements a self-service mechanism where the system automatically performs benchmark tests, analyzes network performance, and adjusts the threshold value without requiring manual intervention. The autonomous protocol switching mechanism continuously monitors network conditions and self-adjusts the switching criterion, enabling the system to adapt to network performance changes while maintaining implementation simplicity through automated processes.
Solution Approach 2:
The patent incorporates feedback mechanisms by continuously measuring network performance through benchmark tests and using this feedback to adjust the threshold value. The system performs repeated tests, collects performance data, and uses this feedback to optimize the protocol switching criterion, enabling automatic adaptation to network changes while keeping the implementation straightforward through automated feedback loops.
3Measurement precision
If repeated testing with increasing data size is performed, then the optimal threshold value can be accurately determined, but the time and computational resources increase
Solution Approach 1:
The patent applies partial action by performing a limited number of repeated tests with incrementally increasing data sizes rather than exhaustive testing. The system performs tests at multiple data size levels and stops when the optimal threshold is identified or when a predetermined number of iterations is reached, balancing measurement precision with acceptable testing time and resource consumption.
Data Source
AI summary
A method for optimizing network performance according to an embodiment of the present invention includes initializing a size of test data for network performance measurement, performing a test on the network performance by transmitting the test data to each of a first communication protocol and a second communication protocol, repeatedly performing the test, when the size of the test data is increased and then the increased size of the test data is a preset size or smaller based on a comparison between the increased size of the test data and the preset size, and setting a threshold value having a data size being a reference of switching between the first communication protocol and the second communication protocol, based on data collected through the performing of the test, when the increased size of the test data is larger than the preset size.