eDRAM Cache ECC for Low-Power Idle Refresh Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Embedded DRAM caches in processors face high power consumption due to frequent refresh requirements, especially in low-power states, as they are susceptible to device variations and leakage currents, leading to reduced availability and increased idle state power usage.

Innovation Solution

Implementing a low-latency, low-cost multi-bit error-correcting code (BCH code) with a flexible memory structure that dynamically identifies and compensates for weak cells, allowing for longer refresh periods and reduced power consumption without significant performance penalties, using a combination of quick ECC logic for minor errors and high-latency ECC logic for multi-bit corrections, along with repair mechanisms to minimize latency and overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If eDRAM cache is used to increase density, then memory capacity is improved, but power consumption increases due to frequent refresh requirements

Engineering Contradiction:
Improvememory capacityVSAvoidpower consumption
Core Design Contradiction:
Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The patent changes the refresh period parameter from traditional short intervals to extended intervals (e.g., 1ms, 10ms, or longer) by implementing error detection and correction mechanisms. This allows the eDRAM cache to retain data for longer periods without refresh operations, significantly reducing power consumption while maintaining memory capacity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces error detection and correction codes as an intermediary mechanism between the eDRAM cache and the CPU. These codes detect and correct bit errors that occur during extended refresh periods, enabling the system to use longer refresh intervals without data corruption, thus reducing refresh frequency and power consumption.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Use of energy by moving object

If refresh period is extended to reduce power consumption, then power consumption is improved, but data reliability deteriorates due to device variations and leakage currents

Engineering Contradiction:
Improvepower consumptionVSAvoiddata retention
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent applies error detection and correction codes in advance to cache lines before they are stored in eDRAM. This preliminary protection allows the system to extend refresh periods without risking data integrity, as any bit errors that occur during extended storage can be detected and corrected when the data is accessed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a feedback mechanism where error detection codes monitor cache line integrity during extended refresh periods. When errors are detected, correction codes automatically fix them, providing feedback that enables the system to maintain data reliability even with extended refresh intervals, thus allowing further power reduction.

Inventive Principle:
Principle #23Feedback

3Reliability

If traditional ECC is used to ensure data integrity, then data reliability is improved, but access latency increases due to full decoding requirements

Engineering Contradiction:
Improvedata integrityVSAvoidaccess latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements partial ECC decoding by first checking only syndrome bits to detect errors, and only performing full correction decoding when errors are actually detected. This partial action approach reduces the average access latency for error-free data while maintaining data integrity protection, as most cache accesses do not require full ECC processing.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent segments the ECC processing into two stages: a fast syndrome check stage that quickly detects errors with minimal latency, and a slower correction stage that only processes data when errors are detected. This segmentation allows the system to maintain high data reliability while minimizing the impact on access latency for the majority of error-free operations.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20110289380A1Method and apparatus for using cache memory in a system that supports a low power state
Publication Date: 2011.11.24 INTEL CORP
  • US20110289380A1 patent drawing
  • US20110289380A1 patent drawing
  • US20110289380A1 patent drawing

AI summary

A cache memory system is provided that uses multi-bit Error Correcting Code (ECC) with a low storage and complexity overhead. The cache memory system can be operated at very low idle power, without dramatically increasing transition latency to and from an idle power state due to loss of state.