Virtual Storage Layer for Atomic Operations in Non-Volatile Devices

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current data storage systems face inefficiencies in managing storage capacity and reducing data loss, particularly in non-volatile storage devices where logical identifiers do not have a fixed relationship with physical addresses, leading to complexities in storage allocation and data retrieval.

Innovation Solution

A system that employs a log-based data format with a virtual storage layer to manage logical identifiers and physical storage locations, allowing for sequential storage operations and persistent metadata to maintain the sequence of storage operations, enabling efficient storage and retrieval while reducing data loss.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a log-based data format with virtual storage layer is employed to manage logical identifiers and physical storage locations, then data integrity and storage capacity management are enhanced, but device complexity increases due to the sequential storage operations and persistent metadata requirements

Engineering Contradiction:

Improvedata integrityVSAvoidstorage operation complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces a virtual storage layer as an intermediary between the host system and the physical storage media. This layer manages logical identifiers and their mapping to physical storage locations, abstracting the complexity of sequential log-based storage operations from the host system while ensuring data integrity through persistent metadata tracking

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The storage system is segmented into distinct functional layers: the virtual storage layer that handles logical identifier management and the physical storage layer that executes sequential log-based operations. This segmentation allows each layer to specialize in specific functions, improving data integrity while managing complexity through clear separation of concerns

Inventive Principle:

Principle #1Segmentation

2Productivity

If sequential storage operations with persistent metadata are used to maintain the sequence of storage operations, then data retrieval efficiency is improved, but loss of time increases due to the sequential nature of operations on non-volatile storage

Engineering Contradiction:

Improvedata retrieval efficiencyVSAvoidstorage operation time

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by maintaining persistent metadata that records the sequence of storage operations in advance. This metadata is updated and preserved during each storage operation, enabling efficient data retrieval without requiring time-consuming sequential scanning of the entire log structure

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical sequential access model with a metadata-driven retrieval mechanism. Instead of physically scanning through sequential log entries, the system uses persistent metadata structures (such as indexes or pointers) to directly locate data, substituting mechanical sequential access with faster metadata-based addressing

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If logical identifiers are decoupled from fixed physical addresses in non-volatile storage, then storage capacity management becomes more flexible, but measurement precision deteriorates due to the complexity in tracking storage allocation

Engineering Contradiction:

Improvestorage capacity management flexibilityVSAvoidstorage location tracking accuracy

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The virtual storage layer acts as an intermediary that maintains precise tracking of logical identifier to physical address mappings through persistent metadata. This metadata structure ensures measurement precision in storage location tracking while allowing flexible management of storage capacity, as the mapping can be dynamically updated without affecting the physical storage structure

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentEP2598996B1Apparatus, system, and method for conditional and atomic storage operations

Publication Date: 2019.07.10 SANDISK TECHNOLOGIES LLC

Figure 1
Figure 2
Figure 3

AI summary

A virtual storage layer (VSL) for a non-volatile storage device presents a logical address space of a non-volatile storage device to storage clients. Storage metadata assigns logical identifiers in the logical address space to physical storage locations on the non-volatile storage device. Data is stored on the non-volatile storage device in a sequential log-based format. Data on the non-volatile storage device comprises an event log of the storage operations performed on the non-volatile storage device. The VSL presents an interface for requesting atomic storage operations. Previous versions of data overwritten by the atomic storage device are maintained until the atomic storage operation is successfully completed. Data pertaining to a failed atomic storage operation may be identified using a persistent metadata flag stored with the data on the non-volatile storage device. Data pertaining to failed or incomplete atomic storage requests may be invalidated and removed from the non-volatile storage device.