Intelligent Controller for Smart NIC Flow Configuration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud providers face challenges in efficiently processing new flows in virtual networks without impacting network throughput or latency, and in configuring smart NICs effectively, which can lead to security issues and inconsistent implementations.

Innovation Solution

An intelligent controller is introduced to manage the configuration of smart NICs, allowing for workload-type-based configurations and dynamic flow management. The intelligent controller sends flow configurations to a privileged agent on each server, enabling efficient and secure management of smart NICs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If smart NICs are configured with generic configurations at the time of server deployment, then device complexity is reduced and ease of operation is improved, but adaptability to new flows and application-specific requirements deteriorates

Engineering Contradiction:
Improveease of smart NIC configurationVSAvoidadaptability to new flows
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary configuration of smart NICs with generic flows at deployment time, establishing a baseline operational state. This preliminary action enables immediate ease of operation while the system retains the capability to dynamically add application-specific flows later through the controller, thus resolving the contradiction between initial simplicity and future adaptability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system transitions from static generic configuration to dynamic adaptive configuration by introducing a controller that can programmatically modify smart NIC flows based on detected application types. This dynamic capability allows the system to adapt to new flows while maintaining the initial ease of deployment, resolving the contradiction between operational simplicity and adaptability

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If privileged access is provided to applications for configuring smart NICs, then adaptability to application-specific requirements is improved, but security and implementation consistency deteriorate

Engineering Contradiction:
Improveapplication-specific configuration capabilityVSAvoidsecurity and consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system introduces a controller as an intermediary between applications and smart NICs. The controller detects application types and programmatically configures appropriate flows on smart NICs, eliminating the need for privileged application access. This intermediary approach maintains security and consistency while achieving application-specific adaptability, resolving the contradiction between customization and reliability

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If packet processing tasks are offloaded to smart NICs, then productivity of CPU cores is improved, but device complexity and configuration difficulty increase

Engineering Contradiction:
ImproveCPU core capacity for cloud servicesVSAvoidsmart NIC configuration complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service configuration where the controller automatically detects application types and programmatically configures smart NIC flows without requiring manual intervention. This automation reduces the perceived complexity for users while maintaining the productivity benefits of task offloading, resolving the contradiction between CPU liberation and configuration difficulty

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12206554B2Intelligent controller for smart NICs and hardware accelerators
Publication Date: 2025.01.21 MICROSOFT TECHNOLOGY LICENSING LLC
  • US12206554B2 patent drawing
  • US12206554B2 patent drawing
  • US12206554B2 patent drawing

AI summary

Techniques are disclosed for configuring a hardware-based networking device in a virtualized computing network comprising a plurality of servers hosting virtual machines. The hardware-based networking device is configured to provide network interfaces for virtual machines hosted on the plurality of servers to enable virtual network communications within a virtual network in accordance with associated policies that are applied by the hardware-based networking device.