Pipeline Ready Signal Delay for Voltage Droop Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Voltage droop occurs when multiple pipeline stages in a processing pipeline simultaneously transition from an idle to an active state, leading to reduced system performance due to sudden changes in power consumption.

Innovation Solution

The solution involves generating delayed ready signals and throttled valid signals to stagger the clock cycles at which pipeline stages restart, thereby smoothing the transition from an idle to an active state, reducing the voltage droop by controlling the propagation of ready signals through the pipeline stages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple pipeline stages simultaneously transition from idle to active state, then processing throughput is improved, but voltage droop increases

Engineering Contradiction:
Improveprocessing throughputVSAvoidvoltage stability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments the simultaneous activation of multiple pipeline stages into staggered time slots by delaying the propagation of ready signals. Instead of all stages transitioning at once, the ready signal is propagated sequentially through different pipeline stages across multiple clock cycles, dividing the current spike into smaller incremental increases that maintain voltage stability while still achieving high overall throughput.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by delaying the ready signal propagation in advance before pipeline stages transition to active state. The delay mechanism prepares the timing of activation sequences, ensuring that stages become active in a controlled staggered pattern rather than simultaneously, thereby preventing voltage droop before it occurs.

Inventive Principle:
Principle #10Preliminary action

2Speed

If ready signals propagate quickly through all pipeline stages, then processing speed is improved, but current spike increases

Engineering Contradiction:
Improvesignal propagation speedVSAvoidcurrent demand
Core Design Contradiction:
SpeedVSPower

Solution Approach 1:

The patent implements periodic action by introducing cyclic delays in the propagation of ready signals through pipeline stages. The ready signal propagates through stages at controlled intervals rather than continuously at maximum speed, creating a periodic pattern of activation that spreads current demand over time while maintaining efficient overall signal propagation.

Inventive Principle:
Principle #19Periodic action

3Reliability

If pipeline stages are stalled to prevent voltage droop, then voltage stability is improved, but processing throughput decreases

Engineering Contradiction:
Improvevoltage stabilityVSAvoidprocessing throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies dynamics by making the ready signal propagation adaptive and flexible rather than static. The delay mechanism dynamically adjusts the timing of signal propagation through different pipeline stages, allowing the system to maintain voltage stability while minimizing stalls and maximizing throughput through optimized sequential activation patterns.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9292295B2Voltage droop reduction by delayed back-propagation of pipeline ready signal
Publication Date: 2016.03.22 NVIDIA CORP
  • US9292295B2 patent drawing
  • US9292295B2 patent drawing
  • US9292295B2 patent drawing

AI summary

A system, method, and computer program product for generating flow-control signals for a processing pipeline is disclosed. The method includes the steps of generating, by a first pipeline stage, a delayed ready signal based on a downstream ready signal received from a second pipeline stage and a throttle disable signal. A downstream valid signal is generated by the first pipeline stage based on an upstream valid signal and the delayed ready signal. An upstream ready signal is generated by the first pipeline stage based on the delayed ready signal and the downstream valid signal.