Network Adapter Multi-Channel Send Queue Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for managing multiple channels in network adapters consume significant CPU cycles and bandwidth, leading to poor caching performance and increased storage requirements, especially in high-performance computing applications where hosts need to handle numerous connections efficiently.

Innovation Solution

A network adapter offloads communication management by retrieving Work Requests from a Multi-Channel Send Queue and distributing them among multiple Send Queues, using either Reliable-Connection or Dynamically Connected protocols, to reduce CPU burden and optimize storage usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the host CPU manages multiple communication channels directly, then connection control and management are achieved, but CPU cycles are consumed and processing efficiency decreases

Engineering Contradiction:
ImproveCPU processing efficiencyVSAvoidCPU involvement in communication management
Core Design Contradiction:
ProductivityVSExtent of automation

Solution Approach 1:

The patent extracts communication channel management functions from the host CPU and relocates them to the network adapter. The network adapter independently manages multiple send queues and handles work requests without CPU intervention, resolving the contradiction by removing the burden from the CPU while maintaining automated channel management.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The network adapter is designed to self-manage communication channels through internal mechanisms including multiple send queues, work request processing, and completion queue management. This self-service capability eliminates the need for CPU involvement in routine communication tasks, improving CPU efficiency while maintaining full automation of channel management.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If multiple send queues are implemented for managing multiple channels, then connection management capability is improved, but storage requirements increase

Engineering Contradiction:
ImproveMulti-channel connection management capabilityVSAvoidStorage space for queues
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent segments communication channel management into multiple send queues within the network adapter, each handling specific channels independently. This segmentation enables versatile multi-channel management while keeping each queue's storage requirements manageable. The work request mechanism further segments task distribution across queues, optimizing storage utilization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The send queues in the network adapter are designed with multi-functionality, serving multiple communication channels simultaneously. Each queue can handle different types of work requests and serve various targets, reducing the total number of queues needed and thereby optimizing storage space while maintaining high adaptability for channel management.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If the network adapter manages communication independently, then CPU burden is reduced, but device complexity increases

Engineering Contradiction:
ImproveCPU availability for computationVSAvoidNetwork adapter internal complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces completion queues as an intermediary mechanism between the network adapter's internal complex operations and the host CPU. The completion queues buffer status information and completion notifications, allowing the network adapter to manage complex multi-channel operations independently while presenting a simplified interface to the CPU, thus reducing CPU burden without exposing the full complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The network adapter implements self-service mechanisms including automatic work request processing, queue management, and status tracking. This self-service capability enables the adapter to handle complex communication management tasks internally without requiring proportional increases in CPU resources, effectively managing device complexity while maintaining high CPU availability.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11451493B2Connection management in a network adapter
Publication Date: 2022.09.20 MELLANOX TECHNOLOGIES LTD(IL)
  • US11451493B2 patent drawing
  • US11451493B2 patent drawing
  • US11451493B2 patent drawing

AI summary

A network adapter includes a network interface, a host interface and processing circuitry. The network interface connects to a communication network for communicating with remote targets. The host interface connects to a host that accesses a Multi-Channel Send Queue (MCSQ) storing Work Requests (WRs) originating from client processes running on the host. The processing circuitry is configured to retrieve WRs from the MCSQ and distribute the WRs among multiple Send Queues (SQs) accessible by the processing circuitry.