Data Plane Separation for Reusing Virtual Network Addresses
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
InfiniBand networks face limitations in the assignment of Local Identifier (LID) space, leading to restricted scalability and communication constraints due to the limited number of host machines and ports per endpoint, which hinders efficient data transfer and communication in high-performance computing environments.
Innovation Solution
Implementing data plane separation using virtual network addresses and local port grouping, facilitated by a subnet manager, to enable concurrent and separate communication across different physical ports, allowing reuse of LIDs and optimizing network links for improved scalability and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If distinct identifiers are assigned to each IB port to enable communication, then communication functionality is achieved, but the number of host machines that can communicate on the network is limited
Solution Approach 1:
The patent segments the identifier space by introducing a hierarchical structure where global identifiers (GIDs) are divided into network prefixes and subnet identifiers. This segmentation allows the same GID prefix to be reused across different subnets, dramatically increasing the number of host machines that can communicate on the network without requiring unique identifiers for every port.
Solution Approach 2:
The patent adds a new dimension to the addressing scheme by introducing subnet identifiers as an additional layer in the identifier hierarchy. This dimensional expansion transforms the flat identifier space into a multi-layered structure, enabling exponential growth in the number of addressable hosts without proportionally increasing the complexity of identifier management.
2Adaptability or versatility
If more ports per endpoint are assigned unique identifiers, then communication capacity increases, but the limited LID space restricts scalability
Solution Approach 1:
The patent segments the LID space into multiple subnets, each with its own identifier range. This allows the limited LID space to be distributed across numerous subnets, enabling each endpoint to support more ports while maintaining overall network scalability. Each subnet can independently manage its identifier allocation without conflicting with other subnets.
Solution Approach 2:
The patent creates a universal addressing framework where the same GID prefix can serve multiple subnets and endpoints simultaneously. This multi-functional approach allows a single GID prefix to identify multiple ports across different subnets, greatly expanding communication capacity without requiring proportionally more unique LIDs.
3Ease of operation
If LIDs are assigned by number of endpoints or ports per endpoint, then identifier management is simplified, but network scalability is hindered
Solution Approach 1:
The patent segments the network into multiple subnets, each managing its own LID allocation independently. This segmentation allows each subnet to maintain simple identifier management within its local context while the overall network achieves scalability through the hierarchical GID structure that spans multiple subnets.
Solution Approach 2:
The patent introduces subnet identifiers as an additional dimensional layer that resolves the scalability conflict. This dimensional addition allows the system to maintain simple local identifier management while achieving global scalability, as the subnet identifier dimension provides the necessary differentiation across the expanded network.
Data Source
AI summary
Systems and methods herein are for one or more processing units that can communicate in a network using a subnet manager (SM) that includes a mapping of one virtual network address to two or more physical ports, where the one virtual network address may be associated with different switches of different data planes, and where data may be communicated concurrently and separately using the one virtual network address and using the two or more physical ports.