Caching Namespace Bypasses Throttling for Write Bandwidth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Nonvolatile storage devices face challenges in maintaining high write performance, particularly in scenarios requiring on-demand write bandwidth, as existing throttling mechanisms can hinder performance and limit the lifespan of memory cells, especially in cases sensitive to write latency.

Innovation Solution

Implementing an enhanced-write-bandwidth caching stream by apportioning a reserved logical namespace that is exempt from host-write throttling, allowing for continuous write operations without interference from garbage collection activities, and ensuring data invalidation occurs within the capacity of the reserved space to maintain optimal performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Duration of action of stationary object

If host-write throttling is implemented to balance write throughput with garbage collection activities, then storage device lifespan is extended, but write performance for latency-sensitive operations deteriorates

Engineering Contradiction:
Improvestorage device lifespanVSAvoidwrite performance
Core Design Contradiction:
Duration of action of stationary objectVSSpeed

Solution Approach 1:

The address space is divided into two separate namespaces: a first namespace subject to host-write throttling for general storage operations, and a second namespace exempt from throttling for latency-sensitive operations. This segmentation allows different write performance characteristics to coexist without interfering with each other, resolving the contradiction between extending device lifespan through throttling and maintaining high write performance for critical operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different quality levels of write service are provided to different parts of the address space. The second namespace receives premium service with guaranteed write bandwidth and no throttling, while the first namespace receives standard service with throttling. This local differentiation allows the system to simultaneously satisfy both lifespan extension requirements and high-performance write requirements for latency-sensitive operations.

Inventive Principle:
Principle #3Local quality

2Productivity

If write bandwidth is limited to allow garbage collection activities to keep up, then write amplification is reduced, but on-demand write bandwidth for latency-sensitive operations is limited

Engineering Contradiction:
Improvewrite bandwidthVSAvoidwrite latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The write operations are segmented into two independent streams: one for the first namespace subject to throttling to balance write amplification, and one for the second namespace exempt from throttling to guarantee low latency. This segmentation enables the system to optimize for write amplification control in the first namespace while ensuring on-demand bandwidth for the second namespace.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The storage device controller acts as an intermediary that manages the conflict between garbage collection activities and host write requests. For the second namespace, the controller ensures that garbage collection does not interfere with ongoing writes by reserving bandwidth and coordinating operations, thereby eliminating write latency while maintaining acceptable write amplification levels through the throttled first namespace.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If a caching namespace is created to provide unthrottled write bandwidth, then write performance for latency-sensitive operations is improved, but device complexity increases

Engineering Contradiction:
Improvewrite performanceVSAvoidnamespace management complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The storage device controller performs multiple functions: it manages throttling for the first namespace, provides unthrottled access for the second namespace, coordinates garbage collection activities, and handles data invalidation. By consolidating these functions in the existing controller rather than adding separate management hardware, the system achieves improved write performance without proportionally increasing device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system implements feedback mechanisms to track the number of host writes in the second namespace and manage data invalidation accordingly. The controller monitors write counts and coordinates invalidation operations to maintain performance guarantees. This feedback-based management allows the system to handle the complexity of dual-namespace operation through software control rather than additional hardware, minimizing the increase in device complexity.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10108350B2Method for providing nonvolatile storage write bandwidth using a caching namespace
Publication Date: 2018.10.23 WESTERN DIGITAL TECHNOLOGIES INC
  • US10108350B2 patent drawing
  • US10108350B2 patent drawing
  • US10108350B2 patent drawing

AI summary

An apparatus for implementing an enhanced-write-bandwidth caching stream includes a memory that stores machine instructions and a processor that executes the machine instructions. The apparatus apportions a first address space and a second address space that comprises a logical namespace. The apparatus also subjects the first address space to host-write throttling, and exempts the second address space from host-write throttling. The apparatus further requires that valid data in memory cells corresponding to the second address space be invalidated at an interval not to exceed a number of host writes equaling the capacity of the second address space.