Power-Aware Memory Allocation for Datacenter Energy Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Computer energy consumption in datacenters is high due to the power requirements of memory devices, leading to increased operational costs and cooling expenses, as existing technologies do not effectively manage energy usage and performance across different memory regions.

Innovation Solution

A memory management system that characterizes memory objects based on access frequency, movability, and performance requirements, placing them in appropriate memory regions to optimize energy consumption and performance by using policies that allow some processes to operate with reduced energy usage while others prioritize performance, and dynamically moving objects between regions to maintain optimal power states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If memory devices operate at high power to ensure performance, then access speed and reliability are improved, but energy consumption and cooling costs increase

Engineering Contradiction:
Improvememory access speedVSAvoidenergy consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The memory device is divided into multiple independently controllable memory regions, each capable of operating at different power states. This segmentation allows the system to optimize energy consumption by powering down unused regions while maintaining high performance for actively accessed regions, directly resolving the contradiction between overall performance and overall energy consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The memory regions dynamically transition between different power states (e.g., active, idle, sleep) based on real-time access patterns and system workload. This dynamic power management allows the system to adapt memory region states to actual usage requirements, reducing energy consumption during low-activity periods while ensuring fast access when needed.

Inventive Principle:
Principle #15Dynamics

2Reliability

If all memory regions are kept in high power state to maintain performance, then system reliability is improved, but operational costs and energy waste increase

Engineering Contradiction:
Improvesystem reliabilityVSAvoidenergy waste
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

By segmenting memory into multiple regions with independent power control, the system can reliably maintain only the regions that are actually in use, rather than keeping all regions active. This reduces energy waste while preserving system reliability for the subset of memory that needs to be accessible.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system predicts which memory regions will be needed based on access patterns and pre-activates those regions before they are actually accessed. This preliminary action ensures reliability is maintained only where needed, avoiding energy waste in regions that will not be used soon.

Inventive Principle:
Principle #10Preliminary action

3Use of energy by moving object

If memory objects are frequently moved between regions to optimize placement, then energy efficiency is improved, but system complexity and overhead increase

Engineering Contradiction:
Improveenergy efficiencyVSAvoidmemory management complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The memory management system automatically monitors access patterns and autonomously decides when to move memory objects between regions and when to keep them stationary. This self-service approach optimizes energy efficiency through intelligent placement without requiring complex external control mechanisms or manual intervention.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes parameters such as memory region power states, access thresholds, and placement policies based on observed workload characteristics. By adapting these parameters dynamically, the system achieves energy efficiency without requiring overly complex fixed rules, as the parameters self-adjust to current conditions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8321703B2Power aware memory allocation
Publication Date: 2012.11.27 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8321703B2 patent drawing
  • US8321703B2 patent drawing
  • US8321703B2 patent drawing

AI summary

A computer system may place memory objects in specific memory physical regions based on energy consumption and performance or other policies. The system may have multiple memory regions at least some of which may be powered down or placed in a low power state during system operation. The memory object may be characterized in terms of access frequency, movability, and desired performance and placed in an appropriate memory region. In some cases, the memory object may be placed in a temporary memory region and later moved to a final memory region for long term placement. The policies may allow some processes to operate while consuming less energy, while other processes may be configured to maximize performance.