Temperature-Gradient Aware Data Placement for 3D Stacked DRAMs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional DRAM refresh mechanisms are inefficient due to fixed refresh frequencies and lack of consideration for temperature gradients in stacked DRAM, leading to sub-optimal data placement and performance bottlenecks in memory-accessing workloads.

Innovation Solution

Implementing a method to selectively place and maintain frequently accessed data in regions of stacked DRAM with lower refresh rates by monitoring localized temperatures and dynamically adjusting refresh rates, allowing data to be moved based on detected refresh rate changes, thereby improving memory access performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional fixed refresh frequency is used for all DRAM regions, then implementation is simple, but memory access performance deteriorates due to refresh bottlenecks

Engineering Contradiction:
Improvememory access performanceVSAvoidrefresh control complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the DRAM memory space into multiple temperature zones based on thermal characteristics. Each zone is independently managed with its own refresh rate, allowing regions with different thermal profiles to be optimized separately. This segmentation enables selective refresh of only those zones that require it, reducing overall refresh overhead and improving memory access performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic refresh rate adjustment based on real-time temperature monitoring. Instead of using a fixed refresh frequency, the system continuously adapts refresh rates according to measured temperature conditions in each zone. This dynamic approach allows the memory system to respond to changing thermal conditions and optimize performance accordingly.

Inventive Principle:
Principle #15Dynamics

2Reliability

If data are placed without considering temperature gradients, then data placement is simple, but retention reliability deteriorates in hotter regions

Engineering Contradiction:
Improvedata retention reliabilityVSAvoiddata placement complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by assigning different data placement strategies to different temperature zones. Frequently accessed data are preferentially placed in cooler regions where longer retention times can be achieved, while less frequently accessed data are placed in hotter regions. This localized optimization improves overall data retention reliability by matching data placement decisions with local thermal conditions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent incorporates temperature monitoring feedback into the data placement decision-making process. The system continuously monitors temperature conditions and uses this information to dynamically adjust data placement strategies. This feedback mechanism ensures that data are placed in locations that will maintain their integrity under current thermal conditions, improving retention reliability.

Inventive Principle:
Principle #23Feedback

3Productivity

If entire DRAM regions are refreshed at the same rate, then control is simple, but performance deteriorates due to unnecessary refresh operations in cooler regions

Engineering Contradiction:
Improvememory bandwidthVSAvoidrefresh control mechanism
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the DRAM memory space into multiple temperature zones that are independently controlled. Each zone can be refreshed at its own optimized rate based on local thermal conditions, rather than forcing all regions to use a uniform refresh rate. This segmentation eliminates unnecessary refresh operations in cooler regions, improving memory bandwidth and overall productivity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the refresh rate parameter dynamically based on temperature conditions in different zones. Instead of using a single fixed refresh rate for the entire memory space, the system adjusts refresh rate parameters locally according to measured temperature values. This parameter adaptation allows cooler regions to operate at lower refresh rates, freeing up memory bandwidth for productive operations.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11556250B2Method and apparatus for temperature-gradient aware data-placement for 3D stacked DRAMs
Publication Date: 2023.01.17 ADVANCED MICRO DEVICES INC
  • US11556250B2 patent drawing
  • US11556250B2 patent drawing
  • US11556250B2 patent drawing

AI summary

A system including a stack of two or more layers of volatile memory, such as layers of a 3D stacked DRAM memory, places data in the stack based on a temperature or a refresh rate. When a threshold is exceeded, data are moved from a first region to a second region in the stack, the second region having one or both of a second temperature lower than a first temperature of the first region or a second refresh rate lower than a first refresh rate of the first region.