Hybrid eSCM DIMM Data Placement for Low Latency Storage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Storage Class Memory (SCM) technologies fail to achieve low power, high performance, and low latency while maintaining capacity, often compromising on either latency, cost, or capacity.

Innovation Solution

A hybrid storage system using a direct attached dual in line memory (DIMM) card with dynamic random access memory (DRAM) and non-volatile memory technologies like Phase Change Memory (PCM), Resistive RAM (ReRAM), and NAND Flash, where an eSCM processor dynamically moves data among these technologies based on data set size to optimize performance and power usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If non-volatile memory technologies are used for storage class memory, then non-volatility and capacity are improved, but latency and power consumption worsen

Engineering Contradiction:
Improvenon-volatilityVSAvoidlatency
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The storage class memory is segmented into multiple memory types (DRAM, SRAM, and non-volatile memory) organized in a hierarchical structure. Each segment serves different purposes: DRAM for frequently accessed data requiring low latency, SRAM for cache operations, and non-volatile memory for persistent storage. This segmentation allows the system to achieve non-volatility while maintaining low latency for active data through intelligent data placement and management.

Inventive Principle:
Principle #1Segmentation

2Stability of the object's composition

If non-volatile memory technologies are used for storage class memory, then non-volatility and capacity are improved, but power consumption worsens

Engineering Contradiction:
Improvenon-volatilityVSAvoidpower consumption
Core Design Contradiction:
Stability of the object's compositionVSUse of energy by moving object

Solution Approach 1:

The system employs periodic data migration between memory types based on access patterns and power states. During active periods, frequently accessed data is migrated to DRAM for low-latency access. During idle or low-power periods, data is migrated back to non-volatile memory to reduce overall power consumption. This periodic action allows the system to dynamically balance between performance and power efficiency while maintaining non-volatility.

Inventive Principle:
Principle #19Periodic action

3Speed

If DRAM is used for storage class memory, then bandwidth and latency are improved, but capacity and cost worsen

Engineering Contradiction:
Improvebandwidth and latencyVSAvoidcapacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The system merges multiple memory technologies (DRAM, SRAM, and non-volatile memory) into a unified storage class memory architecture. This combination allows the system to leverage the high speed of DRAM/SRAM for active data while utilizing the high capacity and low cost of non-volatile memory for persistent storage. The merged architecture presents a unified interface to the processor, hiding the complexity of data distribution across different memory types and providing both high performance and large capacity.

Inventive Principle:
Principle #5Merging (Combining)

4Stability of the object's composition

If non-volatile memory technologies are used for storage class memory, then non-volatility is improved, but cost worsens

Engineering Contradiction:
Improvenon-volatilityVSAvoidcost
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The system applies local quality by assigning different memory types to different data based on access patterns and importance. Critical and frequently accessed data resides in expensive but fast DRAM/SRAM, while less frequently accessed data is stored in cheaper non-volatile memory. This localized allocation of memory resources optimizes the overall cost-effectiveness of the storage class memory system while maintaining non-volatility for all data through the presence of non-volatile memory in the hierarchy.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10860477B2Apparatus and method for low power low latency high capacity storage class memory
Publication Date: 2020.12.08 WESTERN DIGITAL TECHNOLOGIES INC
  • US10860477B2 patent drawing
  • US10860477B2 patent drawing
  • US10860477B2 patent drawing

AI summary

A method and a storage system are provided for implementing enhanced solid state storage class memory (eSCM) including a direct attached dual in line memory (DIMM) card containing Dynamic Random Access Memory (DRAM), and at least one 5 non-volatile memory, for example, Phase Change Memory (PCM), Resistive RAM (ReRAM), Spin-Transfer-Torque RAM (STT-RAM), and NAND Flash chips. An eSCM processor controls selectively allocating data among the DRAM, and the at least one non-volatile memory primarily based upon a data set size.