Cloud Memory Allocation and Write Redirection for Thermal Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud computing systems face challenges in maintaining memory module reliability due to temperature-related failures, leading to potential downtime and reduced uptime of servers.

Innovation Solution

Implementing a system where hypervisors maintain temperature profiles of memory chips and automatically redirect memory write requests to chips that do not exceed temperature thresholds, and in case of threshold exceedance, migrate compute entities to cooler memory modules or servers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If memory modules are continuously used to maintain high productivity, then server uptime is improved, but temperature-related failures increase reducing reliability

Engineering Contradiction:
Improveserver uptimeVSAvoidmemory module reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system dynamically monitors temperature of memory modules in real-time and adaptively redirects compute entities between memory modules based on thermal conditions. This dynamic adjustment allows continuous operation while preventing thermal failures, resolving the contradiction between maintaining uptime and ensuring reliability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary temperature monitoring and proactive thermal management by identifying hot memory modules before failures occur. Compute entities are preemptively redirected from warming memory modules to cooler ones, preventing temperature-related failures and maintaining both uptime and reliability.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If temperature monitoring and redirection systems are implemented to improve reliability, then memory module reliability is improved, but device complexity increases

Engineering Contradiction:
Improvememory module reliabilityVSAvoidmemory management system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The memory management system performs self-service through automated temperature monitoring and compute entity redirection. The hypervisor and memory controller automatically detect thermal conditions and manage memory allocations without manual intervention, achieving improved reliability through automation rather than complex manual management procedures.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback loops where temperature sensors continuously monitor memory module thermal states and feed this information back to the memory controller. The controller automatically adjusts compute entity allocations based on this feedback, creating a self-regulating system that improves reliability without requiring complex external management infrastructure.

Inventive Principle:
Principle #23Feedback

3Reliability

If compute entities are migrated between host servers to manage temperature, then memory reliability is improved, but loss of time occurs during migration

Engineering Contradiction:
Improvememory operation reliabilityVSAvoidcompute entity migration time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs rapid compute entity migration when thermal conditions require it, completing the migration process quickly to minimize downtime. By optimizing the migration process and using hot-swappable memory modules, the system rushes through the necessary relocation to restore reliable operation with minimal time loss.

Inventive Principle:
Principle #21Skipping (Rushing through)

Solution Approach 2:

The system performs preliminary identification of suitable target memory modules before migration is needed. When thermal issues arise, compute entities can be quickly relocated to pre-identified cooler modules, reducing the actual migration time and minimizing the loss of operational time while maintaining reliability.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances memory management by preventing failures, increasing server uptime, and ensuring reliable operation by proactively managing temperature-related issues in cloud computing environments.

Implementation Method 1

maintaining a first temperature profile based on information received from a thermal sensor associated with each of a first plurality of memory chips

Methodology Applied
Scientific EffectThermal sensing: Thermocouple

Data Source

PatentEP4172767B1Allocating memory and redirecting memory writes in a cloud computing system based on temperature of memory modules
Publication Date: 2025.08.13 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP4172767B1 patent drawingFigure 1
  • EP4172767B1 patent drawingFigure 2
  • EP4172767B1 patent drawingFigure 3

AI summary

Systems and methods for allocating memory and redirecting data writes based on temperature of memory modules in a cloud computing system are described. A method includes maintaining temperature profiles for a first plurality of memory modules and a second plurality of memory modules. The method includes automatically redirecting a first request to write to memory from a first compute entity being executed by the first processor to a selected one of a first plurality of memory chips, whose temperature does not meet or exceed the temperature threshold, included in at least the first plurality of memory modules and automatically redirecting a second request to write to memory from a second compute entity being executed by the second processor to a selected one of the second plurality of memory chips, whose temperature does not meet or exceed the temperature threshold, included in at least the second plurality of memory modules.