Direct-Mapped Flash Storage for Small File Transfer Optimization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing storage systems face inefficiencies in data management and storage due to the reliance on traditional flash drives with built-in storage controllers, leading to redundant operations and decreased reliability.

Innovation Solution

The implementation of a direct-mapped flash storage system where the operating system initiates and controls processes, eliminating the need for lower-level processes in flash drive controllers, and utilizing non-volatile solid state storage units with embedded CPUs for advanced data management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional flash drives with built-in storage controllers are used, then data management is simplified through controller automation, but redundant write operations increase and reliability decreases

Engineering Contradiction:

Improvedata management automationVSAvoiddata storage reliability

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent extracts the storage controller functionality from the flash drive hardware and relocates it to the operating system level. This eliminates the redundant controller layer that causes harmful write operations, while maintaining data management capabilities through OS-based control. The OS directly manages flash memory operations without intermediary controller interference.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a file system layer as an intermediary between the OS and flash memory, replacing the traditional controller-mediated architecture. This file system acts as the new mediator that intelligently manages write operations, preventing redundant writes while maintaining ease of operation through standardized file access interfaces.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of manufacture

If traditional flash drive controllers are used, then hardware-based data management is achieved, but performance decreases due to redundant operations

Engineering Contradiction:

Improvehardware-based data managementVSAvoiddata transfer speed

Core Design Contradiction:

Ease of manufactureVSProductivity

Solution Approach 1:

The patent replaces the mechanical/hardware-based controller system with a software-based file system implementation. This substitution eliminates the performance bottlenecks caused by hardware controller overhead and redundant operations, while maintaining ease of manufacture through standard flash memory components without specialized controllers.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Quantity of substance

If small files are transferred using traditional protocols, then data transfer is achieved, but time is excessive due to protocol overhead

Engineering Contradiction:

Improvedata transfer volumeVSAvoidtransfer time

Core Design Contradiction:

Quantity of substanceVSLoss of time

Solution Approach 1:

The patent implements a threshold-based transfer mechanism where small files below a certain size threshold are transferred using optimized direct methods rather than traditional protocols. This partial application of different transfer strategies eliminates excessive protocol overhead for small files while maintaining compatibility for larger transfers, significantly reducing transfer time.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS20250190352A1Optimizing Transfer Of Small Files Of A Storage System

Publication Date: 2025.06.12 PURE STORAGE INC

AI summary

A method of data transfer between storage systems includes determining to transfer a dataset stored at a first storage system to a second storage system and invoking an operation to retrieve, for portions of the dataset having a size less than a threshold size, an identifier, metadata, and data stored in the portions of the dataset. The method further includes transmitting the identifiers, the metadata, and the data for the portions of the dataset having a size less than the threshold size to the second storage system.