Network Virtualization in Multi-Node Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In parallel computing systems with multiple interconnected networks, managing communication between compute nodes is complex, requiring developers to handle multiple physical networks, which complicates application development and optimization.
Innovation Solution
Implementing network virtualization through a network driver and control system that abstracts multiple physical networks, allowing applications to interface with a virtual network, which routes traffic based on system and application requirements, simplifying development by decoupling the application from underlying physical networks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple physical networks are used to connect compute nodes in a parallel system, then network communication capability and system performance are improved, but application development complexity and network management difficulty increase
Solution Approach 1:
The patent introduces a network virtualization layer as an intermediary between applications and multiple physical networks. This virtualization layer provides a unified virtual network interface that abstracts the complexity of multiple physical networks, allowing applications to communicate across networks without directly managing the underlying physical network infrastructure. The virtual network device acts as a mediator that handles network packet routing, mapping, and transmission across the multiple physical networks.
2Adaptability or versatility
If multiple physical networks are used to connect compute nodes, then network utilization and system flexibility are improved, but network management complexity increases
Solution Approach 1:
The patent creates virtual copies of network interfaces that represent the multiple physical networks. Instead of requiring applications to directly manage multiple physical network interfaces, the system creates virtual network device copies that simplify the interface presentation. These virtual network devices provide a standardized interface while maintaining the ability to access and utilize multiple physical networks underneath, thereby improving ease of operation while preserving system flexibility.
3Speed
If applications directly interface with multiple physical networks, then network performance optimization is possible, but application complexity and development difficulty increase
Solution Approach 1:
The patent segments the network management functionality into two distinct layers: a virtualization layer that handles the complexity of multiple physical networks, and an application layer that focuses on computational tasks. The network driver and virtual network device are segmented to handle network-specific optimizations and management, while applications can focus on their core functionality. This segmentation allows network performance optimization to be achieved through the virtualization layer without increasing application complexity.
Data Source
AI summary
Embodiments of the present invention generally provide for network virtualization in a multi-network system. The virtual network may abstract multiple, underlying physical networks connecting compute nodes on a multi-node system. A network driver and control system may route traffic on the underlying physical networks according to system and/or application requirements, and a virtual-to-physical network mapping may be controlled by the driver and control system.