Distributed Smart NIC Offloading for Data Plane Acceleration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data networks lack efficient allocation of network address translation tables to specific processes, leading to suboptimal data processing performance, especially in cloud computing environments.
Innovation Solution
A system that includes a compute node and smart network interface controllers (NICs) managed by a smart NIC management system, allowing dynamic allocation and offloading of processing resources to distributed smart NICs across multiple servers, enabling efficient utilization of network resources and enhanced application performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If network address translation tables are used for all private network traffic over a public network, then network routing is enabled, but data processing performance is suboptimal due to lack of specific process allocation
Solution Approach 1:
The patent segments network address translation tables from a shared global resource into process-specific allocated tables. Each process receives a dedicated portion of the NAT table, enabling independent management and optimization. This segmentation resolves the contradiction by allowing high-performance dedicated processing while maintaining manageable allocation through systematic division of the overall NAT resource pool.
Solution Approach 2:
The patent implements dynamic allocation of NAT tables to processes based on real-time network traffic demands. The system monitors process-specific network activity and adjusts NAT table assignments dynamically, allocating more resources to high-traffic processes and reducing allocation to low-traffic ones. This dynamic approach enables optimal data processing performance while adapting to changing workload conditions without requiring complex static configurations.
2Adaptability or versatility
If processing resources are allocated dynamically based on computing service requests, then resource utilization is optimized, but system complexity increases
Solution Approach 1:
The patent creates a universal smart NIC management system that handles multiple functions: allocating NAT tables, managing process-specific network resources, monitoring traffic patterns, and coordinating with compute nodes. This multi-functional management layer provides adaptable resource allocation across diverse computing services while consolidating complexity into a single standardized system rather than requiring separate management mechanisms for each function.
Solution Approach 2:
The patent introduces a smart NIC management system as an intermediary layer between compute nodes and network resources. This intermediary handles the complexity of dynamic resource allocation, translating high-level computing service requests into specific NAT table assignments and network configurations. By placing this mediation layer, the system achieves flexible adaptability while shielding the complexity of resource management from both the compute nodes and the network infrastructure.
3Speed
If smart NICs are distributed across multiple servers, then data plane acceleration is achieved, but network resource coordination becomes more complex
Solution Approach 1:
The patent merges the intelligence of multiple distributed smart NICs into a coordinated system managed by a centralized smart NIC management system. While the smart NICs remain physically distributed across multiple servers to enable parallel data plane processing and acceleration, the management system unifies their operation by coordinating NAT table allocations and managing resource sharing. This merging of management control allows high-speed distributed processing while reducing coordination complexity through centralized oversight.
Data Source
AI summary
A system for processing data, comprising a compute node having a first processor that is configured to receive a digital data message containing a request for computing services and to allocate processing resources on a private network as a function of the request. A smart network interface controller (NIC) management system operating on a second processor and configured to cause the second processor to select a smart NIC associated with the private network to allocate the smart NIC to the computing services. The smart NIC includes a processor that is configured to interface with a public network and to send and receive data over the public network associated with the computing services.