Dynamic Memory Power Management via Working Set Monitoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The inefficiency in power management of memory chips, particularly in graphics processing units (GPUs), where large portions of memory are unused but continuously powered and refreshed, leading to wasted power and performance, due to the increasing complexity and heat generation in integrated circuits.
Innovation Solution
Implementing a working set monitor to track active memory usage and dynamically power down or power up memory chips based on application requirements, using a system architecture that couples GPUs with physical memory chips and enables flexible power modes, including shutting down unused memory ranks or channels to reduce power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If large capacity memory is continuously powered and refreshed, then memory availability is ensured, but power consumption increases and performance is wasted
Solution Approach 1:
The patent implements dynamic power management by monitoring memory access patterns and adjusting power states accordingly. The system transitions memory from active to low-power states when not accessed, and wakes it up when needed, making the power consumption adaptive rather than static.
Solution Approach 2:
The patent employs a monitoring mechanism that tracks memory access patterns and provides feedback to the power management system. This feedback loop enables the system to make informed decisions about when to power down or wake up memory, optimizing the balance between availability and power consumption.
2Adaptability or versatility
If additional functionality is integrated onto a single IC chip, then device capability increases, but heat generation and power consumption increase
Solution Approach 1:
The patent divides the integrated circuit into functional segments that can be independently powered. By segmenting the chip into separate power domains, the system can power down unused portions while keeping active portions running, reducing overall heat generation while maintaining necessary functionality.
Solution Approach 2:
The patent applies different power states to different regions of the chip based on their activity levels. Active regions receive full power while inactive regions are powered down, creating local quality variations in power delivery that reduce overall heat generation.
3Adaptability or versatility
If additional components are added to an IC chip, then functionality increases, but signal switching increases generating more heat and consuming more power
Solution Approach 1:
The patent implements dynamic control of signal switching by enabling or disabling signal paths based on operational needs. The system dynamically activates only the signal switching required for current operations, reducing unnecessary power consumption from idle signal paths.
4Use of energy by moving object
If memory is powered down to save power, then power consumption decreases, but memory access time increases when waking up
Solution Approach 1:
The patent performs preliminary monitoring of memory access patterns to predict when memory will be needed. By watching for access patterns in advance, the system can wake up memory slightly before actual access is needed, reducing the perceived latency while maintaining power savings.
Data Source
AI summary
Briefly, in accordance with one or more embodiments, an apparatus comprises a memory comprising one or more physical memory chips, and a processor to implement a working set monitor to monitor a working set resident in the one or more physical memory chips. The working set monitor is to adjust a number of the physical memory chips that are powered on based on a size of the working set.


