Dynamic Memory Power Management via Working Set Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The inefficiency in power management of memory chips, particularly in graphics processing units (GPUs), where large portions of memory are unused but continuously powered and refreshed, leading to wasted power and performance, due to the increasing complexity and heat generation in integrated circuits.

Innovation Solution

Implementing a working set monitor to track active memory usage and dynamically power down or power up memory chips based on application requirements, using a system architecture that couples GPUs with physical memory chips and enables flexible power modes, including shutting down unused memory ranks or channels to reduce power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If large capacity memory is continuously powered and refreshed, then memory availability is ensured, but power consumption increases and performance is wasted

Engineering Contradiction:
Improvememory availabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic power management by monitoring memory access patterns and adjusting power states accordingly. The system transitions memory from active to low-power states when not accessed, and wakes it up when needed, making the power consumption adaptive rather than static.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent employs a monitoring mechanism that tracks memory access patterns and provides feedback to the power management system. This feedback loop enables the system to make informed decisions about when to power down or wake up memory, optimizing the balance between availability and power consumption.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If additional functionality is integrated onto a single IC chip, then device capability increases, but heat generation and power consumption increase

Engineering Contradiction:
Improvedevice capabilityVSAvoidheat generation
Core Design Contradiction:
Adaptability or versatilityVSTemperature

Solution Approach 1:

The patent divides the integrated circuit into functional segments that can be independently powered. By segmenting the chip into separate power domains, the system can power down unused portions while keeping active portions running, reducing overall heat generation while maintaining necessary functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different power states to different regions of the chip based on their activity levels. Active regions receive full power while inactive regions are powered down, creating local quality variations in power delivery that reduce overall heat generation.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If additional components are added to an IC chip, then functionality increases, but signal switching increases generating more heat and consuming more power

Engineering Contradiction:
ImprovefunctionalityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent implements dynamic control of signal switching by enabling or disabling signal paths based on operational needs. The system dynamically activates only the signal switching required for current operations, reducing unnecessary power consumption from idle signal paths.

Inventive Principle:
Principle #15Dynamics

4Use of energy by moving object

If memory is powered down to save power, then power consumption decreases, but memory access time increases when waking up

Engineering Contradiction:
Improvepower consumptionVSAvoidmemory access time
Core Design Contradiction:
Use of energy by moving objectVSLoss of time

Solution Approach 1:

The patent performs preliminary monitoring of memory access patterns to predict when memory will be needed. By watching for access patterns in advance, the system can wake up memory slightly before actual access is needed, reducing the perceived latency while maintaining power savings.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10936214B2Power management of memory chips based on working set size
Publication Date: 2021.03.02 INTEL CORP
  • US10936214B2 patent drawing
  • US10936214B2 patent drawing
  • US10936214B2 patent drawing

AI summary

Briefly, in accordance with one or more embodiments, an apparatus comprises a memory comprising one or more physical memory chips, and a processor to implement a working set monitor to monitor a working set resident in the one or more physical memory chips. The working set monitor is to adjust a number of the physical memory chips that are powered on based on a size of the working set.