NIC Request Pacing for Response-Size Queue Congestion

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Network congestion is caused by disparities in the sizes of data requests and responses, leading to inefficiencies and congestion in network input queues due to the mismatch between request and response processing rates.

Innovation Solution

A network interface controller (NIC) equipped with a command queue, message chopping unit (MCU), and traffic management logic block that determines the type and size of data requests, throttling the request rate to match the NIC's response absorption capacity, thereby pacing commands to maintain response lengths within a threshold.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the NIC processes requests at a high rate, then productivity is improved, but network congestion occurs due to response size disparity

Engineering Contradiction:

Improverequest processing rateVSAvoidnetwork congestion

Core Design Contradiction:

ProductivityVSObject-generated harmful factors

Solution Approach 1:

The NIC monitors the size of incoming requests and dynamically adjusts the request processing rate based on the expected response size. When large responses are detected, the system automatically throttles the request rate to prevent queue congestion, creating a closed-loop control system that adapts to varying traffic conditions

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The request processing rate is made dynamic rather than static. The NIC continuously adapts the processing rate based on real-time conditions, particularly the size of pending responses and queue occupancy levels, allowing the system to optimize throughput while preventing congestion under varying workloads

Inventive Principle:

Principle #15Dynamics

2Quantity of substance

If the NIC accepts all requests without throttling, then quantity of processed data is improved, but input queue congestion increases

Engineering Contradiction:

Improvevolume of processed dataVSAvoidinput queue stability

Core Design Contradiction:

Quantity of substanceVSStability of the object's composition

Solution Approach 1:

The NIC performs preliminary assessment of incoming requests by examining their size and type before fully processing them. This advance evaluation allows the system to predict response sizes and adjust processing rates proactively, preventing queue overflow before it occurs

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system changes the processing parameter (request acceptance rate) based on the characteristics of the data being processed. When large responses are anticipated, the acceptance rate parameter is reduced; when small responses are expected, the rate is increased, optimizing both throughput and queue stability

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS20260030181A1System and method for facilitating data request management in a network interface controller (NIC)

Publication Date: 2026.01.29 HEWLETT PACKARD ENTERPRISE DEV LP

AI summary

A network interface controller (NIC) capable of facilitating efficient data request management is provided. The NIC can be equipped with a command queue, a message chopping unit (MCU), and a traffic management logic block. During operation, the command queue can store a command issued via a host interface. The MCU can then determine a type of the command and a length of a response of the command. If the command is a data request, the traffic management logic block can determine whether the length of the response is within a threshold. If the length exceeds the threshold, the traffic management logic block can pace the command such that the response is within the threshold.