SSD Metadata Write Heat Segregation for Reduced Amplification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

NAND Flash-based solid-state drives (SSDs) face performance bottlenecks due to high write amplification, which increases the number of writes required over the SSD's lifespan, shortening its operational time and reducing random write performance, primarily caused by the need to erase and rewrite entire blocks of data, leading to inefficient garbage collection and metadata management.

Innovation Solution

Implementing a logical-to-physical translation layer with a controller that tracks and segregates metadata based on 'write heat' to prioritize and group metadata writes, using a non-durable cache to store frequently accessed metadata and reorder extent writes, thereby reducing write amplification by segregating hot and cold data and optimizing garbage collection processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If entire blocks of flash memory are erased and rewritten, then data can be stored and updated, but write amplification increases and SSD lifespan decreases

Engineering Contradiction:
Improvewrite speedVSAvoidSSD lifespan
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments metadata management by separating hot metadata (frequently updated) from cold metadata (less frequently updated). This is achieved by maintaining multiple metadata stripes with different heat characteristics, allowing the system to perform targeted operations on specific segments rather than entire blocks, thereby reducing write amplification and extending SSD lifespan while maintaining write performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different characteristics to different parts of the metadata structure. Specifically, hot metadata stripes are maintained with higher priority and different management policies compared to cold metadata stripes. This allows optimized handling of frequently accessed metadata without unnecessarily processing cold metadata, reducing overall write amplification.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If metadata is frequently updated, then data management accuracy improves, but write amplification increases and random write performance decreases

Engineering Contradiction:
Improvemetadata accuracyVSAvoidrandom write performance
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments metadata into multiple stripes with different heat characteristics (hot, warm, cold). This segmentation allows the system to manage frequently updated metadata separately from less frequently updated metadata. By confining frequent updates to specific hot metadata stripes rather than across the entire metadata structure, the system maintains metadata accuracy while reducing the overall impact on random write performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-allocating and pre-organizing metadata stripes according to their heat characteristics. This preliminary organization allows the system to efficiently handle frequent metadata updates in predetermined hot stripes without causing widespread write amplification across the entire flash memory structure, thereby preserving random write performance.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If garbage collection is performed to clean outdated data, then storage efficiency improves, but operation time increases and performance bottleneck occurs

Engineering Contradiction:
Improvestorage efficiencyVSAvoidgarbage collection time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent segments the garbage collection process by targeting only cold metadata stripes that contain outdated or less frequently accessed metadata. Instead of performing garbage collection across the entire flash memory structure, the system identifies and processes specific segments, significantly reducing the time required for garbage collection while maintaining storage efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and separates hot metadata from cold metadata, allowing garbage collection to focus exclusively on cold metadata stripes. This extraction enables the system to remove outdated data efficiently without interfering with frequently accessed metadata, reducing garbage collection time and eliminating the performance bottleneck.

Inventive Principle:
Principle #2Taking out (Extraction)

4Productivity

If metadata pages are relocated during garbage collection, then storage optimization improves, but write amplification increases

Engineering Contradiction:
Improvestorage optimizationVSAvoidwrite amplification
Core Design Contradiction:
ProductivityVSLoss of substance

Solution Approach 1:

The patent segments metadata relocation operations by confining them to cold metadata stripes only. Hot metadata stripes are preserved and not subjected to relocation, minimizing the amount of data that needs to be moved. This segmented approach achieves storage optimization through targeted relocation while significantly reducing write amplification compared to relocating all metadata.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by implementing different relocation policies for different metadata stripes. Cold metadata stripes undergo relocation and optimization, while hot metadata stripes maintain their original positions to avoid unnecessary writes. This localized approach achieves storage optimization with minimal write amplification.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240330173A1Management of metadata in a solid-state drive via write heat segregation
Publication Date: 2024.10.03 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20240330173A1 patent drawing
  • US20240330173A1 patent drawing
  • US20240330173A1 patent drawing

AI summary

A controller of the solid-state drive (SSD) maintains a logical-to-physical translation layer, wherein metadata for the logical-to-physical translation layer is stored in metadata pages in a flash memory of the SSD. The controller tracks a write heat of the metadata pages. The controller stores relatively more frequently accessed metadata pages in a non-durable cache of the SSD. The controller prioritized metadata write operations based on write heat of the metadata pages, such that a NAND flash block of the flash memory contains metadata pages with a similar write heat, wherein extents with similar write heats are grouped together into a stripe that stores extent data, and wherein write heats of the extents with the similar write heats do not differ from each other beyond a predetermined threshold.