CXL Memory Expansion Card with On-Die ECC

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory expansion technologies face challenges in maximizing memory capacity and efficiency, particularly in high-speed data center applications, where redundant memory management and power consumption are concerns.

Innovation Solution

The development of a Compute Express Link (CXL) attached memory expansion card with on-die error correction code (ECC) circuitry and a controller that manages command and address signals, enabling efficient memory sharing and coherency between CPU and attached devices, while optimizing power usage through advanced PCIe/CXL interfaces and multi-channel operation modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If memory capacity is increased using traditional expansion methods, then storage capability is improved, but power consumption and system complexity increase

Engineering Contradiction:
Improvememory capacityVSAvoidpower consumption
Core Design Contradiction:
Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The memory system is segmented into multiple independent memory devices (e.g., 8 memory devices in embodiments) that can be individually managed and powered. Each device connects through separate PCIe/CXL channels, allowing selective activation and independent power management, thus increasing total capacity while controlling overall power consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The memory expansion card implements a universal interface supporting both PCIe and CXL protocols, enabling the same hardware infrastructure to serve multiple functions: traditional memory expansion, accelerated computing, and heterogeneous memory pooling. This multi-functionality reduces redundant components and power consumption across different operational modes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Quantity of substance

If traditional memory expansion is used, then capacity is increased, but redundant memory management complexity increases

Engineering Contradiction:
Improvememory capacityVSAvoidmemory management complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

A smart controller is introduced as an intermediary between the host system and multiple memory devices. This controller automatically manages memory allocation, address translation, and coherence protocols across heterogeneous memory types, eliminating the need for complex software management and reducing redundancy while expanding capacity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback mechanisms where the smart controller continuously monitors memory usage patterns, power consumption, and system demands to dynamically optimize memory allocation and activation. This feedback loop automatically manages expanded memory resources without increasing operational complexity.

Inventive Principle:
Principle #23Feedback

3Speed

If high-speed memory interfaces are implemented, then data transfer rate is improved, but power consumption increases

Engineering Contradiction:
Improvedata transfer rateVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The memory expansion card supports dynamic interface configuration, allowing PCIe and CXL channels to operate at variable speeds based on real-time system demands. High-speed modes are activated only when needed, while lower-speed modes handle routine operations, optimizing the balance between data transfer rate and power consumption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs periodic refresh and activation cycles for memory devices, where high-speed interfaces are activated in intervals rather than continuously. Memory devices can enter low-power states between active periods, maintaining data integrity through periodic refresh while significantly reducing average power consumption.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11983059B2Memory expansion card
Publication Date: 2024.05.14 MICRON TECHNOLOGY INC
  • US11983059B2 patent drawing
  • US11983059B2 patent drawing
  • US11983059B2 patent drawing

AI summary

The present disclosure includes apparatuses and methods related to a memory expansion card suitable for, relative to other memory solutions, a high-speed interface and low power consumption. The memory expansion card can have on-die error correction code (ECC) circuitry and, in some examples, additional on-board circuitry, components, or capability to manage, relative to other memory solutions, a large number of volatile or non-volatile memory devices. A memory expansion card may have a controller with a host interface capable of using or defined according to a quantity of bits (i.e., a bit width), which may be eight bits. The controller may coupled to memory devices via several channels, and each channel may have the bit width of the interface.