Smart NIC Lightweight Transport Protocol Host Offload

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing networking protocols and hardware, such as smart NICs, often require significant modifications to host-side software and hardware for upgrading, which can be costly and disruptive, and fail to effectively leverage advances in networking technology without modifying older protocols or their implementations.

Innovation Solution

A smart NIC that operates as an in-line device between a host's NIC and network, enabling pass-through transmission of network flows and implementing a lightweight transport protocol (LTP) for direct inter-NIC communication, allowing it to accelerate network performance without requiring host-side changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If smart NICs are used to offload transport protocol functionality from host CPU, then network performance and processing capability are improved, but host-side software and hardware modifications are required which increase complexity and upgrade cost

Engineering Contradiction:
Improvenetwork performanceVSAvoidhost-side software and hardware modifications
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces a protocol translator as an intermediary component that bridges the gap between traditional host-based networking and smart NIC offloading. The translator handles protocol conversion and compatibility management, allowing smart NICs to operate with existing host software without requiring modifications to the host operating system or standard protocols. This mediator approach enables performance improvement while avoiding the complexity of host-side changes.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If existing networking protocols are modified to accommodate new hardware capabilities, then protocol performance is improved, but backward compatibility and continuous inter-network operability are compromised

Engineering Contradiction:
Improveprotocol performanceVSAvoidbackward compatibility
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments the networking protocol into distinct functional components: a traditional protocol handler that maintains backward compatibility and a smart NIC handler that leverages new hardware capabilities. The protocol translator acts as an interface between these segments, allowing each to operate independently. This segmentation enables the system to maintain compatibility with existing networks while simultaneously utilizing advanced smart NIC features for improved performance.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If smart NICs replace ordinary NICs to provide enhanced functionality, then network capabilities are improved, but upgrade cost and disruption increase due to physical replacement requirements

Engineering Contradiction:
Improvenetwork capabilitiesVSAvoidupgrade cost and disruption
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent designs the smart NIC with universal functionality that encompasses both traditional NIC operations and advanced offloading capabilities. The smart NIC can function as a drop-in replacement that maintains compatibility with existing host configurations while providing enhanced features. This multi-functional design eliminates the need for complex host modifications and reduces upgrade disruption, making the transition to smart NICs more straightforward and cost-effective.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3298739B1Lightweight transport protocol
Publication Date: 2020.07.22 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3298739B1 patent drawingFigure 1
  • EP3298739B1 patent drawingFigure 2
  • EP3298739B1 patent drawingFigure 3

AI summary

A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.