Non-Volatile Memory Upgrade via Lock-Based Commit Throttling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing storage management systems face challenges in efficiently upgrading non-volatile memory from one version to another without causing I/O hiccups or disrupting system availability, particularly during the transition from a version that stores full pages to one that stores deltas, which requires blocking commits and managing inter-page dependencies.

Innovation Solution

Implementing a non-volatile lock to throttle metadata commits until the non-volatile memory reaches a threshold capacity, preventing data commits during formatting, flushing remaining commits, and releasing the lock only after the upgrade is complete, allowing transactions to be written in either the original or delta format based on the current version of the memory.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If commits are blocked during non-volatile memory formatting from first version to second version, then the memory format can be upgraded from full-page to delta-based format, but system availability and I/O performance deteriorate due to I/O hiccups

Engineering Contradiction:
Improvememory format versionVSAvoidsystem availability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent segments the non-volatile memory into multiple regions: a first region formatted with the first version format and a second region formatted with the second version format. This allows the system to progressively migrate data from the old format to the new format without blocking commits entirely, thereby maintaining system availability while enabling format upgrade.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-formatting a second region of the non-volatile memory with the second version format before fully committing to the new format. This allows the system to gradually transition between formats, avoiding complete commit blocking and reducing I/O hiccups during the upgrade process.

Inventive Principle:
Principle #10Preliminary action

2Quantity of substance

If metadata commits are throttled until non-volatile memory capacity reaches threshold, then memory capacity management is improved, but commit performance and system throughput deteriorate

Engineering Contradiction:
Improvememory capacityVSAvoidcommit throughput
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent dynamically adjusts the commit throttling behavior based on the current state of the non-volatile memory. Instead of applying a static threshold, the system monitors memory capacity and selectively throttles commits only when necessary to make room for format upgrade operations, thereby optimizing both capacity management and throughput.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the operational parameters of the non-volatile memory by introducing version-specific formatting (first version vs. second version) and dynamically adjusting commit behavior based on memory state. This allows the system to optimize capacity utilization while minimizing impact on commit performance through parameter-based control.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11899630B2System and method for non-disruptive upgrade for metadata log with minimal hiccup
Publication Date: 2024.02.13 EMC IP HLDG CO LLC
  • US11899630B2 patent drawing
  • US11899630B2 patent drawing
  • US11899630B2 patent drawing

AI summary

A method, computer program product, and computer system for controlling, by a computing device, access to a non-volatile memory using a non-volatile lock as a reader of the non-volatile memory. Metadata (MD) non-volatile memory commits may be throttled until capacity of the non-volatile memory is at a threshold capacity.