Distributed Critical Path Monitors for Dynamic Frequency Margin Recovery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for determining the maximum operating frequency (FMAX) of a chip are inadequate due to reliance on average voltage and temperature measurements, failure to capture dynamic supply noise effects, and inability to accurately account for manufacturing process variations and chip aging, leading to excessive margins and reduced performance.

Innovation Solution

A method and system that utilize critical path monitors (CPM) to track real-time PVT effects by selecting a minimum number of replica paths based on root mean square error (RMSE) to dynamically adjust clock frequency, incorporating Monte Carlo simulations and workload-based calibration to minimize margins and improve FMAX tracking across the entire operating space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If exhaustive FMAX characterization across all parameters is performed, then frequency prediction accuracy is improved, but test time becomes prohibitively long

Engineering Contradiction:
Improvefrequency prediction accuracyVSAvoidtest time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent creates replica critical paths that copy the electrical characteristics of actual critical paths. These replicas are used to predict FMAX without exhaustive testing of the actual chip across all parameters. The replica paths are designed to have matching delay characteristics and are subjected to Monte Carlo simulations to predict the true FMAX accurately while requiring minimal physical testing.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary Monte Carlo simulations on replica critical paths during the design phase to establish FMAX predictions before actual chip manufacturing and testing. This preliminary characterization allows the system to predict FMAX for production chips without requiring exhaustive post-manufacturing testing, significantly reducing test time while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If chips are shipped at FMAX, then performance is improved, but reliability decreases due to worst-case frequency variations

Engineering Contradiction:
ImproveperformanceVSAvoidreliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements on-chip critical path monitors that continuously monitor the actual critical path delays during operation. This feedback mechanism allows the system to dynamically adjust the operating frequency based on real-time conditions, enabling chips to operate closer to their true FMAX while maintaining reliability by adjusting frequency when process variations or aging cause delays to increase.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent transitions from static frequency margining to dynamic frequency adjustment. The system uses on-chip monitors to continuously track critical path performance and dynamically adjusts the operating frequency accordingly. This allows the chip to operate at higher frequencies when conditions permit while automatically reducing frequency when process variations or aging affect performance, thus improving both productivity and reliability.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If average voltage and temperature measurements are used, then measurement simplicity is improved, but measurement precision deteriorates due to dynamic supply noise effects

Engineering Contradiction:
Improvemeasurement simplicityVSAvoidFMAX tracking accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent replaces direct electrical measurements of voltage and temperature with mechanical-like replica structures that physically replicate the critical path behavior. Instead of measuring electrical parameters and calculating FMAX, the system uses replica critical paths whose delay characteristics directly reflect the true FMAX under various conditions, providing more accurate measurements without complex instrumentation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10990732B1System frequency margin recovery via distributed critical path monitors (CPM)
Publication Date: 2021.04.27 NVIDIA CORP
  • US10990732B1 patent drawing
  • US10990732B1 patent drawing
  • US10990732B1 patent drawing

AI summary

Introduced herein is an improved technique of recovering system frequency margin via distributed CPMs. The introduced technique creates and distributes multiple sets of always sensitized critical path replicas across a chip and monitors them for timing failure. The introduced technique takes feedback from these critical path replicas and dynamically boosts the clock frequency of the chip to remove the margin. The introduced technique provides more accurate and more comprehensive coverage of a chip performance.