Heterogeneous Memory Thermal Traffic Redirection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data flow management in heterogeneous memory devices is complex due to the mix of volatile and non-volatile memory, requiring a system that can adapt to thermal profiles to prevent performance bottlenecks and thermal incidents, as a one-controller-fits-all approach is inadequate.

Innovation Solution

A media controller in the heterogeneous memory device redirects traffic from thermally sensitive non-volatile memory to thermally tolerant non-volatile memory when temperature thresholds are reached, throttles traffic to the tolerant memory when temperatures rise, and redirects back to the sensitive memory when temperatures decrease, using on-chip thermal sensors to manage data flow based on predetermined thermal profile temperatures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a one-controller-fits-all approach is used for heterogeneous memory, then device complexity is reduced, but thermal management capability and reliability deteriorate

Engineering Contradiction:
Improvecontroller complexityVSAvoidthermal management capability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent divides the heterogeneous memory system into distinct thermal management zones with different temperature thresholds and policies. The controller segments memory access paths based on thermal states, routing traffic differently for thermally sensitive versus thermally tolerant memory regions, thereby managing thermal conditions without requiring multiple complete controllers.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller dynamically adjusts memory access policies based on real-time thermal conditions. It monitors temperature sensors and adaptively changes traffic routing decisions, enabling a single controller to respond to varying thermal states and maintain reliability across different operational conditions.

Inventive Principle:
Principle #15Dynamics

2Reliability

If traffic is redirected to thermally tolerant memory, then thermal incidents are prevented, but productivity decreases

Engineering Contradiction:
Improvethermal incident preventionVSAvoiddata throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies different quality levels of thermal tolerance to different memory regions. Instead of treating all memory uniformly, it identifies specific thermally tolerant regions and directs traffic selectively to those areas when thermal thresholds are exceeded, maintaining overall system productivity while preventing thermal incidents in sensitive regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The controller acts as an intermediary that monitors thermal conditions and mediates traffic flow between applications and memory regions. When thermal issues are detected, it redirects traffic through thermally tolerant intermediate paths, balancing thermal safety with continued data access capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If throttling is applied to reduce traffic, then thermal incidents are avoided, but speed deteriorates

Engineering Contradiction:
Improvethermal safetyVSAvoiddata access speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The system dynamically adjusts throttling intensity based on real-time thermal measurements and predicted thermal trends. Rather than applying fixed throttling, the controller modulates access rates adaptively, applying stronger throttling when thermal conditions are critical and reducing throttling when conditions improve, thereby maintaining speed when possible while ensuring thermal safety.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The controller performs preliminary thermal assessment before allowing high-speed access. By predicting future thermal states based on current conditions and access patterns, it proactively adjusts traffic flow to prevent thermal incidents before they occur, maintaining higher speeds than reactive throttling would allow.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11567668B1Data flow management in a heterogeneous memory device using a thermal profile
Publication Date: 2023.01.31 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11567668B1 patent drawing
  • US11567668B1 patent drawing
  • US11567668B1 patent drawing

AI summary

A computer-implemented method, a computer program product, and a computer system for data flow management in a heterogeneous memory device. A media controller redirects traffic from first non-volatile memory (NVM) to second NVM, in response to an instantaneous temperature of the first NVM reaches a first predetermined temperature at which redirecting the traffic is started. The media controller throttles to reduce the traffic to the second NVM, in response to determining that the instantaneous temperature is higher than a second predetermined temperature at which throttling is started. The media controller redirects the traffic back to the first NVM, in response to determining that the instantaneous temperature is not higher than the second predetermined temperature and lower than a third predetermined temperature at which throttling is ended. The first NVM is thermally sensitive, while the second NVM is thermally tolerant.