Explicit Multicast Local Identifier Assignment for HPC Subnets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High performance computing environments face challenges in efficient multicast local identifier assignment and management, particularly in cloud computing architectures, where traditional network and storage bottlenecks hinder effective communication and resource allocation.
Innovation Solution
The system and method for explicit multicast local identifier assignment for per-partition default multicast local identifiers defined as subnet manager policy input, which involves specifying a range of multicast local identifier (MLID) values, creating a multicast group within a partition, assigning an MLID from this range, and storing the mapping in a non-volatile format to support efficient multicast communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional network and storage architectures are used in high performance computing environments, then system compatibility and ease of deployment are maintained, but communication efficiency and resource allocation performance deteriorate due to network bottlenecks
Solution Approach 1:
The patent changes the addressing parameter system by introducing explicit multicast local identifier (MLID) assignment policies. Instead of using traditional network addressing, the system defines new parameters including MLID ranges, partition-based MLID allocation, and multicast group membership rules that optimize communication efficiency in HPC environments
Solution Approach 2:
The patent segments the network addressing space by introducing partition-based MLID allocation. Each partition receives dedicated MLID ranges, creating segmented multicast groups that improve communication efficiency by limiting multicast traffic scope to specific partitions rather than the entire network
2Ease of operation
If automated MLID assignment is implemented, then administrative overhead is reduced, but control and precision in multicast group management are lost
Solution Approach 1:
The patent implements a dynamic MLID assignment system where the subnet manager automatically assigns MLIDs based on real-time partition membership and policy rules. The system adapts to changing network conditions while maintaining precise control through configurable policies that govern MLID allocation, retention, and multicast group management
Solution Approach 2:
The system incorporates feedback mechanisms where the subnet manager monitors partition membership changes and automatically adjusts MLID assignments accordingly. The subnet manager receives updates about partition changes and uses this feedback to maintain accurate multicast group memberships and MLID mappings without manual intervention
3Productivity
If per-partition multicast groups are created with explicit MLID assignment, then communication efficiency is improved, but system complexity and configuration requirements increase
Solution Approach 1:
The patent implements preliminary action by pre-defining MLID ranges and assignment policies before the HPC system operates. The subnet manager is pre-configured with MLID ranges for each partition and policy rules that govern automatic assignment, eliminating the need for complex runtime configuration while maintaining efficient per-partition multicast groups
4Adaptability or versatility
If multicast local identifiers are assigned dynamically, then scalability is improved, but reliability and consistency of identifier assignment are compromised
Solution Approach 1:
The patent creates a universal MLID assignment system that serves multiple functions: it provides scalable dynamic assignment while maintaining consistency through centralized subnet manager control. The same subnet manager that handles traditional network management also manages MLID assignment, ensuring consistent and reliable identifier distribution across the entire HPC environment
Solution Approach 2:
The subnet manager acts as an intermediary between partition membership changes and MLID assignment. It mediates the assignment process by receiving partition updates, consulting policy rules, and assigning MLIDs in a controlled manner that ensures both scalability and reliability of identifier assignment
Data Source
AI summary
Systems and methods for providing explicit multicast local identifier assignment for per-partition default multicast local identifiers defined as subnet manager policy input in a high performance computing environment. In accordance with an embodiment, an explicit multicast local identifier (MLID) assignment policy can be provided (as, e.g., administrative input) that explicitly defines which MLIDs will be used for which partitions in a subnet. Further, an MLID assignment policy can also define which dedicated MLIDs will be associated with given multicast group identifiers (for example, partition independent MLIDs). By employing such an MLID assignment policy, a new or restarted master subnet manger can observe and verify the MLIDs used for existing partitions, instead of generating new MGID to MLID mappings. In this way, changes in MLID associations for any corresponding MGID can be avoided as a result of master SM restarts or failovers, or any subnet-merge operations.