IO Fabric Frequency Scaling for Traffic-Aware Power Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Datacenter processors maintain high IO fabric frequencies to ensure responsiveness, leading to excessive power consumption during low utilization periods, and sudden traffic bursts result in processing delays.

Innovation Solution

Implementing traffic detector circuits within the IO interface stack to dynamically adjust IO fabric frequency based on detected traffic levels, allowing for power-saving idle states and rapid frequency increases during traffic spikes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If high IO fabric frequency is maintained to ensure responsiveness, then IO responsiveness is improved, but power consumption increases

Engineering Contradiction:

ImproveIO fabric frequencyVSAvoidpower consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic frequency adjustment of the IO fabric based on real-time traffic conditions. The frequency is adjusted from a low initial state to a higher state when traffic demand is detected, and vice versa when traffic subsides. This dynamic adaptation allows the system to maintain responsiveness only when needed, resolving the contradiction between constant high frequency (responsive but power-consuming) and low frequency (power-saving but unresponsive).

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes the operating parameter (frequency) of the IO fabric based on detected traffic conditions. When traffic demand exceeds a threshold, the frequency parameter is increased to ensure responsive processing. When traffic is low, the frequency parameter is decreased to save power. This parameter adaptation resolves the contradiction by making frequency a variable rather than a fixed value.

Inventive Principle:

Principle #35Parameter changes

2Use of energy by moving object

If low IO fabric frequency is used during idle periods to save power, then power consumption is reduced, but processing delays occur during sudden traffic bursts

Engineering Contradiction:

Improvepower consumptionVSAvoidprocessing delay

Core Design Contradiction:

Use of energy by moving objectVSLoss of time

Solution Approach 1:

The patent implements a traffic detection mechanism that monitors incoming traffic patterns and triggers frequency adjustment before significant processing delays occur. The system detects traffic bursts early and proactively increases frequency to handle the incoming load, preventing delays rather than reacting to them after they've occurred.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent employs a feedback mechanism where traffic conditions are continuously monitored and this information feeds back to the frequency control system. When traffic demand is detected, the feedback loop triggers an increase in frequency to ensure timely processing. This closed-loop control resolves the contradiction by using real-time traffic information to dynamically adjust frequency, preventing delays while minimizing power consumption during low-traffic periods.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS20250217305A1IO fabric performance management

Publication Date: 2025.07.03 INTEL CORP

AI summary

In some embodiments, traffic detection circuits are provided to increase an IO fabric frequency when increased IO device traffic is detected.