Smart Switch NPU Offloading for High-Bandwidth SDN Flows

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing software defined networks (SDNs) face inefficiencies in processing high-bandwidth data flows due to limited capacity in data processing units (DPUs) and network processing units (NPUs), leading to suboptimal use of computing resources and increased complexity in managing connections and policy enforcement.

Innovation Solution

The implementation of a smart switch that houses NPUs and DPUs, allowing for the offloading of high-bandwidth flows to a switching complex with NPUs, which processes data without intermediate delivery to DPUs, using FastPath++ packets to manage connections and policies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If high-bandwidth flows are processed by DPU complex, then policy enforcement is maintained, but network bandwidth capacity is limited

Engineering Contradiction:
Improvepolicy enforcementVSAvoidnetwork bandwidth
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the processing architecture by introducing an NPU complex that handles high-bandwidth flows separately from the DPU complex that handles policy enforcement. This segmentation allows each component to specialize: NPUs process bandwidth-intensive traffic while DPUs maintain security policies, resolving the contradiction between bandwidth capacity and policy enforcement capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism (FastPath++ packet and synchronization protocol) that enables collaboration between NPU complex and DPU complex. The intermediary allows the NPU to offload high-bandwidth flow processing while the DPU maintains policy enforcement, with synchronization ensuring both components operate cohesively.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If fast path packet processing is offloaded to NPU complex, then network bandwidth increases, but device complexity increases

Engineering Contradiction:
Improvenetwork bandwidthVSAvoidsystem architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The smart switch is designed with multi-functionality, housing both NPU complex for high-bandwidth processing and DPU complex for policy enforcement within a single device. This universality allows the system to handle diverse traffic types (high-bandwidth and policy-sensitive) without requiring separate specialized devices, thus increasing bandwidth while managing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges previously separate functions (NPU-based fast path processing and DPU-based policy enforcement) into a unified smart switch architecture. This combination allows the system to leverage both processing capabilities simultaneously, increasing effective bandwidth while maintaining a manageable single-device footprint.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If connection states are maintained across devices, then flow processing is efficient, but managing connections becomes complex

Engineering Contradiction:
Improveflow processing efficiencyVSAvoidconnection management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism through the FastPath++ packet and synchronization protocol. The DPU complex provides feedback to the NPU complex about policy requirements and connection states, enabling the NPU to efficiently process flows while maintaining awareness of policy constraints. This feedback loop streamlines connection management across the distributed architecture.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12418477B2Smart switch for offloading high bandwidth flows in a software defined network
Publication Date: 2025.09.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • US12418477B2 patent drawing
  • US12418477B2 patent drawing
  • US12418477B2 patent drawing

AI summary

Bidirectional flows of a communication session in a software defined network (SDN) are efficiently managed. A smart switch comprises a digital processing unit (DPU) complex comprising one or more DPUs, and a switching complex comprising one or more network processing units (NPUs). The DPU complex is configured to disaggregate enforcement of policies of the SDN from hosts of the SDN. The switching complex is configured to perform network routing of packets in the SDN. The hosts are implemented on servers communicatively coupled to network interfaces of the SDN. The switching complex is configured to perform policy enforcement of data flows for communication sessions that are offloaded from the DPU complex to the switching complex.