Stacked Memory Die Layout for Chip-Kill Data Protection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory systems face challenges in ensuring data protection and recovery when a constituent chip in a stack of memory dice fails, leading to potential single points of failure and data integrity issues during read and write operations.

Innovation Solution

The implementation of a 'chip kill' mechanism using Compute Express Link (CXL) compliant memory systems, which distributes error correction information across memory dice, allowing the system to maintain functionality even if one chip fails, by utilizing Compute Express Link (CXL) protocols and PCIe interfaces for managing host interfaces and error correction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If error correction information is concentrated in a single memory die, then the memory system structure is simpler, but the system becomes vulnerable to single points of failure

Engineering Contradiction:
Improvedata protectionVSAvoidmemory system structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides error correction information into multiple segments and distributes them across different memory dice within the stack. Each memory die stores a portion of the error correction code, so that no single point of failure can compromise the entire error correction capability. This segmentation approach maintains reliability while managing complexity through structured distribution.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a hierarchical nesting structure where error correction information is embedded within the memory stack architecture. The error correction codes are nested across multiple memory dice, with each die containing both data and portions of error correction information. This nested arrangement allows the system to maintain functionality even when individual components fail.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Reliability

If error correction information is distributed across multiple memory dice, then the system becomes more resilient to chip failures, but the memory system structure becomes more complex

Engineering Contradiction:
Improveresilience to chip failuresVSAvoidmemory system structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments error correction information across multiple memory dice, with each die holding a specific portion of the error correction code. This segmentation distributes the resilience function across the stack, ensuring that failure of any single die does not compromise the entire system's error correction capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extends the error correction architecture into the vertical dimension of the memory stack. Instead of horizontal distribution only, error correction information is distributed across multiple layers or levels of the stacked memory architecture, utilizing the third dimension to achieve redundancy and resilience while managing complexity through spatial organization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If traditional memory architectures are used without chip kill mechanisms, then the device complexity is lower, but data protection and recovery capabilities are insufficient

Engineering Contradiction:
Improvedata protection and recoveryVSAvoidmemory architecture
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements preliminary error correction by pre-distributing error correction information across memory dice before any failures occur. The chip kill mechanism is pre-configured with distributed error correction codes, enabling automatic detection and correction of failures without requiring complex real-time decision-making during operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces error correction information as an intermediary element that mediates between the stored data and potential failures. This intermediary layer of error correction codes acts as a buffer, allowing the system to recover from failures without directly exposing the complexity of the recovery mechanisms to the host system.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Speed

If high-speed data transfer protocols like CXL are implemented, then data transfer speed improves, but the system requires more sophisticated error correction mechanisms

Engineering Contradiction:
Improvedata transfer speedVSAvoiderror correction mechanisms
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent segments error correction processing across multiple memory dice, allowing parallel error correction operations to occur simultaneously. This segmentation enables high-speed data transfer by distributing the error correction workload, preventing any single bottleneck from limiting overall system performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements self-service error correction where each memory die autonomously handles its own error correction using locally stored error correction information. This self-service approach eliminates the need for complex centralized error correction mechanisms, reducing overall system complexity while maintaining high-speed data transfer capabilities.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11960776B2Data protection for stacks of memory dice
Publication Date: 2024.04.16 MICRON TECHNOLOGY INC
  • US11960776B2 patent drawing
  • US11960776B2 patent drawing
  • US11960776B2 patent drawing

AI summary

Some memory dice in a stack can be connected externally to the stack and other memory dice in the stack can be connected internally to the stack. The memory dice that are connected externally can act as interface dice for other memory dice that are connected internally thereto. Data protection and recovery schemes provided for the stacks of memory dice can be based on data that are transferred in a single data stream without a discontinuity between those data transfers from the memory dice of the stacks.