Flash Memory Cache for DRAM Substitution Bandwidth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional DRAM technology is not suitable for high-speed applications due to bandwidth issues, making it difficult to directly substitute with existing DRAM applications, despite flash memory offering lower power consumption and higher density.

Innovation Solution

Implementing a system that utilizes flash memory technologies in computer memory subsystems by employing an application-specific integrated circuit (ASIC) to control timing, maintaining a DRAM buffer for high-speed write requirements, and using wear leveling mechanisms to prevent sector wear, along with operating system enhancements for memory management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If flash memory is used to replace DRAM, then power consumption is reduced and storage density is increased, but bandwidth and write speed are limited

Engineering Contradiction:
Improvepower consumptionVSAvoidbandwidth
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The memory system is segmented into two distinct parts: a DRAM buffer subsystem for high-speed temporary storage and a flash memory subsystem for non-volatile permanent storage. This segmentation allows each component to operate in its optimal performance regime, with DRAM handling bandwidth-intensive operations and flash providing energy-efficient long-term retention.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A DRAM buffer acts as an intermediary between the host system and the flash memory device. The buffer absorbs write bursts and manages data transfer rates, mediating between the high-speed requirements of the host and the slower flash memory interface, thereby enabling flash to replace DRAM while maintaining system performance.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Quantity of substance

If flash memory is used to replace DRAM, then storage density is increased, but write latency and bandwidth are limited

Engineering Contradiction:
Improvestorage densityVSAvoidwrite latency
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

Data is preliminarily stored in the DRAM buffer before being transferred to flash memory. This preliminary action in high-speed DRAM allows the system to accept writes at high rates without immediately bottlenecking on flash write latency, effectively preprocessing data before the slower storage operation occurs.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The DRAM buffer maintains continuous operation by accepting host writes continuously and managing their transfer to flash memory at appropriate rates. This continuity of useful action in the buffer prevents write stalls and maintains high effective throughput despite flash latency constraints.

Inventive Principle:
Principle #20Continuity of useful action

3Duration of action of stationary object

If flash memory sectors are frequently written, then data retention is improved, but sector wear and failure risk increase

Engineering Contradiction:
Improvedata retentionVSAvoidsector wear
Core Design Contradiction:
Duration of action of stationary objectVSReliability

Solution Approach 1:

The system creates a copy mechanism where frequently written data is stored in the DRAM buffer while the original or backup resides in flash memory. The buffer serves as a working copy that absorbs write operations, protecting the permanent flash storage from excessive write cycles and extending its operational life.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system changes the operational parameters of flash memory by reducing its write cycle frequency through the DRAM buffer intermediary. By altering the write pattern from direct host-to-flash to host-buffer-flash, the effective write count on flash sectors is reduced, improving reliability while maintaining data retention capabilities.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9015420B2Mitigate flash write latency and bandwidth limitation by preferentially storing frequently written sectors in cache memory during a databurst
Publication Date: 2015.04.21 SOUTHFORK IP HOLDINGS LLC
  • US9015420B2 patent drawing
  • US9015420B2 patent drawing
  • US9015420B2 patent drawing

AI summary

A method of operating a memory system is provided. The method includes a controller that regulates read and write access to one or more FLASH memory devices that are employed for random access memory applications. A buffer component operates in conjunction with the controller to regulate read and write access to the one or more FLASH devices. Wear leveling components along with read and write processing components are provided to facilitate efficient operations of the FLASH memory devices.