NIC Queue Depth for CPU Power State Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current power management techniques for CPU cores in network devices do not account for future demand, leading to inefficient power state adjustments that can impact network performance.

Innovation Solution

Assessing the queue depth of network interface controller (NIC) receive queues to dynamically adjust the power state of CPU cores, ensuring optimal power usage based on predicted demand by mapping queues to CPU cores and using a power algorithm to adjust power states based on queue depth thresholds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by stationary object

If current power management techniques are used for CPU cores in network devices, then power state adjustments are made based on current activity, but future demand is not accounted for leading to inefficient power management and potential network performance impact

Engineering Contradiction:
Improvepower consumptionVSAvoidnetwork performance
Core Design Contradiction:
Use of energy by stationary objectVSReliability

Solution Approach 1:

The patent applies preliminary action by assessing the queue depth of NIC receive queues to predict future CPU core demand before it occurs. The power management system proactively adjusts CPU power states based on predicted demand from queue depth analysis, rather than reactively responding to current CPU activity. This allows the system to prepare power state transitions in advance, ensuring that CPU cores are in the appropriate power state when actual work arrives, thus maintaining network performance while optimizing power consumption.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If CPU power states are adjusted based on current activity, then immediate power savings are achieved, but future demand prediction is inaccurate leading to performance degradation

Engineering Contradiction:
Improvepower management efficiencyVSAvoidresponse time to demand
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent implements feedback by continuously monitoring NIC receive queue depths and using this information to dynamically adjust CPU power states. The queue depth serves as a feedback signal that reflects upcoming work load, allowing the power management system to make informed decisions about CPU power state transitions. This feedback mechanism ensures that power management actions are aligned with actual network traffic patterns, improving both power management efficiency and response time to demand.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11797076B2Using network interface controller (NIC) queue depth for power state management
Publication Date: 2023.10.24 INTEL CORP
  • US11797076B2 patent drawing
  • US11797076B2 patent drawing
  • US11797076B2 patent drawing

AI summary

A computer-implemented method can include receiving a queue depth for a receive queue of a network interface controller (NIC), determining whether a power state of a central processing unit (CPU) core mapped to the receive queue should be adjusted based on the queue depth, and adjusting the power state of the CPU core responsive to a determination that the power state of the CPU core should be adjusted.