Host-Controlled Flash Storage for Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional storage systems face inefficiencies in data management and storage operations, particularly in handling flash drives without integrated storage controllers, leading to unnecessary write operations and reduced reliability.

Innovation Solution

Implementing a direct-mapped flash storage system where the operating system initiates and controls processes, offloading device management from storage drives, and utilizing non-volatile RAM as a quickly accessible buffer to improve write latency and reliability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional storage systems with integrated storage controllers are used, then device management is handled by the storage controller, but this leads to unnecessary write operations and reduced reliability when flash drives lack integrated controllers

Engineering Contradiction:
Improvestorage system reliabilityVSAvoidstorage controller integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the storage controller functionality from the flash drive and relocates it to the host system. The host system's operating system and file system now perform functions previously handled by integrated storage controllers, including write caching, metadata management, and data organization. This eliminates the need for flash drives with integrated controllers while maintaining full device management capabilities.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a software-based intermediary layer (file system and operating system) that mediates between the host system and the flash drive. This intermediary handles all complex storage management tasks, translating high-level file operations into low-level flash memory operations, thereby compensating for the absence of integrated storage controllers.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If write operations are performed directly to flash memory, then storage operations are simple, but this causes write latency and reliability issues

Engineering Contradiction:
Improvewrite operation speedVSAvoiddata integrity
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements write caching in the host system's volatile memory before data is permanently written to flash memory. The file system prepares and buffers write operations in memory, allowing data to be staged and organized before actual flash memory programming occurs. This preliminary action in volatile memory significantly reduces write latency while ensuring data integrity through proper caching protocols.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent maintains continuous write operations by utilizing the host system's volatile memory as a buffer. While flash memory writes are正在进行, the system can continue accepting and buffering additional write operations in memory, ensuring continuous productivity without interruption. This continuous action in the host system compensates for the relatively slow flash memory write speeds.

Inventive Principle:
Principle #20Continuity of useful action

3Ease of operation

If flash drives have integrated storage controllers, then device management is automated, but this increases device complexity and cost

Engineering Contradiction:
Improvedevice managementVSAvoidstorage controller hardware
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the host system universal by enabling it to manage multiple types of flash drives regardless of whether they have integrated controllers. The operating system and file system provide a unified interface for storage management that works with various flash drive configurations, eliminating the need for specialized controller hardware in each flash drive while maintaining ease of operation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The host system's operating system and file system automatically perform all storage management functions without requiring dedicated controller hardware in the flash drive. The system self-manages write caching, data organization, error handling, and device coordination, providing automated device management through software rather than hardware controllers.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11604583B2Policy based data tiering
Publication Date: 2023.03.14 PURE STORAGE INC
  • US11604583B2 patent drawing
  • US11604583B2 patent drawing
  • US11604583B2 patent drawing

AI summary

Hybrid data tiering, including: replicating multiple data objects from a first storage location on a first computer system to a second storage location at a second computer system; receiving, from a client computing system, a retention policy specifying one or more rules or conditions to evaluate to determine whether to continue storing data at a first storage location in addition to storing the data at a second storage location; identifying, in accordance with the retention policy, some of the multiple data objects to continue storing at the first storage location, wherein all of the multiple data objects remain stored at the second storage location; and selecting the identified some of the multiple data objects to remain stored at the first storage location.