Self-Refresh Arbitration for CXL Memory Power Stability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

PCIe links face limitations in managing high-bandwidth and low-latency memory access, especially in environments with shared memory pools, leading to inefficiencies and voltage fluctuations during self-refresh operations in CXL systems, which can impact performance and power distribution.

Innovation Solution

Implementing an arbiter that receives self-refresh request signals and selectively provides enable signals using a round-robin scheme to manage self-refresh operations across multiple memory channels, preventing instantaneous power thresholds from being exceeded and optimizing memory input/output training.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If self-refresh operations are performed simultaneously across multiple memory channels, then memory data integrity is maintained, but voltage fluctuations occur and power thresholds are exceeded

Engineering Contradiction:
Improvememory data integrityVSAvoidinstantaneous power consumption
Core Design Contradiction:
ReliabilityVSPower

Solution Approach 1:

The patent segments the self-refresh operations across multiple memory channels by implementing an arbiter that distributes self-refresh requests to different channels in a round-robin manner. This segmentation prevents simultaneous activation of all memory channels, thereby controlling instantaneous power consumption while maintaining memory data integrity through periodic refresh operations across all channels over time.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If PCIe links are used for memory access, then system compatibility is improved, but bandwidth and latency performance deteriorate

Engineering Contradiction:
Improvesystem compatibilityVSAvoidmemory access bandwidth
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent introduces CXL (Compute Express Link) as an intermediary layer between the processor and memory systems. CXL provides enhanced bandwidth and lower latency compared to traditional PCIe links while maintaining compatibility through standard interfaces. The arbitration mechanism manages self-refresh operations over CXL links, optimizing memory access performance while preserving system compatibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If more memory channels are activated, then memory capacity utilization is improved, but power distribution stability deteriorates

Engineering Contradiction:
Improvememory capacity utilizationVSAvoidpower distribution stability
Core Design Contradiction:
ProductivityVSStability of the object's composition

Solution Approach 1:

The patent implements periodic self-refresh operations distributed across multiple memory channels using an arbiter. Instead of activating all channels simultaneously, the arbiter cycles through channels in a round-robin fashion, enabling each channel to perform refresh operations at periodic intervals. This periodic activation maintains memory capacity utilization while ensuring power distribution stability by preventing simultaneous high-power draws from multiple channels.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS20230342047A1Self-Refresh Arbitration
Publication Date: 2023.10.26 MICRON TECHNOLOGY INC
  • US20230342047A1 patent drawing
  • US20230342047A1 patent drawing
  • US20230342047A1 patent drawing

AI summary

Described apparatuses and methods relate to self-refresh arbitration. In a memory system with multiple memory components, an arbiter is configured to manage the occurrence of self-refresh operations. In aspects, the arbiter can receive one or more self-refresh request signals from at least one memory controller for authorization to command one or more memory components to enter a self-refresh mode. Upon receiving the one or more self-refresh request signals, the arbiter, based on a predetermined configuration, can transmit one or more self-refresh enable signals to the at least one memory controller with authorization to command the one or more memory components to enter the self-refresh mode. The configuration can ensure that fewer than all memory components simultaneously enter the self-refresh mode. In so doing, memory components can perform self-refresh operations without exceeding an instantaneous power threshold. The arbiter can be included in, for instance, a Compute Express Link™ (CXL™) memory module.