Nested Suspend Resume Mechanism for SSD Read Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Solid State Drives (SSDs) face challenges in maintaining consistent Quality of Service (QoS) due to longer write and erase command completion times, which can lead to delayed read operations and poor performance, especially when multiple commands are outstanding.

Innovation Solution

Implementing write and erase command suspension policies, along with nested suspend/resume mechanisms, to allow read operations to proceed while write and erase operations are split into chunks, optimizing the SSD's resource utilization and minimizing performance impact.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If write and erase commands are executed continuously without suspension, then productivity is improved through continuous operation, but read latency increases and QoS deteriorates due to reads getting stuck behind writes and erases

Engineering Contradiction:
Improvecontinuous operation throughputVSAvoidread latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent segments write and erase commands into multiple smaller sub-commands or chunks. Instead of executing a single large write or erase command that blocks reads, the command is divided into smaller units that can be interleaved with read operations. This segmentation allows the SSD to process reads between sub-command executions, reducing read latency while maintaining overall productivity through continuous segmented operation.

Inventive Principle:
Principle #1Segmentation

2Productivity

If multiple commands are outstanding simultaneously, then productivity increases through parallel processing, but QoS deteriorates due to unpredictable command completion times and latency variations

Engineering Contradiction:
Improveparallel command processing throughputVSAvoidcommand completion time consistency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements dynamic command scheduling that adjusts the number and type of outstanding commands based on current workload conditions and QoS requirements. The system dynamically monitors command completion times and adjusts the command queue depth, suspending or prioritizing commands to maintain consistent completion times. This dynamic adaptation allows the system to achieve high throughput when conditions permit while ensuring QoS compliance when latency consistency is critical.

Inventive Principle:
Principle #15Dynamics

3Productivity

If write and erase operations are prioritized to maintain bandwidth, then productivity is improved, but read operations are delayed and QoS deteriorates

Engineering Contradiction:
Improveaverage bandwidth utilizationVSAvoidread operation responsiveness
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent applies different quality levels of service to different command types based on their requirements. Read commands receive high priority with guaranteed responsiveness and low latency, while write and erase commands are executed in the background with lower priority. The system locally optimizes resource allocation for each command type, ensuring reads get the necessary bandwidth and responsiveness while writes and erases maintain acceptable throughput through non-blocking execution.

Inventive Principle:
Principle #3Local quality

4Reliability

If suspension policies are implemented to allow reads through, then read latency is reduced and QoS improves, but device complexity increases due to nested suspend/resume mechanisms

Engineering Contradiction:
ImproveQoS consistencyVSAvoidsuspend/resume control logic
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a nested suspend/resume mechanism where suspension states are organized in hierarchical levels. When a read command arrives, the system suspends lower-priority write or erase commands, and if those commands have nested sub-commands, those are suspended in turn. This nested structure allows the system to systematically pause operations at multiple levels without requiring complex global coordination, reducing control logic complexity while maintaining QoS consistency through structured priority management.

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentUS10579269B2Method, system, and apparatus for nested suspend and resume in a solid state drive
Publication Date: 2020.03.03 SK HYNIX NAND PRODUCT SOLUTIONS CORP
  • US10579269B2 patent drawing
  • US10579269B2 patent drawing
  • US10579269B2 patent drawing

AI summary

A first type of command is suspended, by a controller of a non-volatile memory device, in response to determining that a second type of command is waiting for execution. The first type of command is split into a plurality of chunks based on a computed criteria. A second type of command is executed in between execution of at least two chunks of the first type of command.