Multi-stream SSD QoS Management via Host Interface Scheduling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multi-streaming Solid State Drives (SSDs) do not directly support Quality of Service (QoS) attributes, relying on host computers to manage these attributes, which limits their performance in ensuring bandwidth, priority, and latency for data streams.

Innovation Solution

Implementing a system within SSDs to manage QoS attributes by allowing hosts to set minimum and maximum bandwidth, priority levels, and latency for streams, enabling the SSD to allocate resources effectively and prioritize requests based on these settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If multi-streaming SSDs rely on host computers to manage QoS attributes, then device complexity is reduced, but QoS performance (bandwidth, priority, latency) deteriorates

Engineering Contradiction:
ImproveQoS management complexityVSAvoidQoS attribute guarantee
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent extracts QoS management functionality from the host computer and integrates it into the SSD controller. The controller now independently manages QoS attributes including bandwidth allocation, priority levels, and latency guarantees for different data streams, eliminating the need for host-based QoS management while improving QoS performance reliability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The SSD controller performs self-service QoS management by autonomously allocating bandwidth and prioritizing requests based on stream identifiers without requiring continuous host intervention. The controller internally tracks QoS parameters and adjusts resource distribution to meet guaranteed service levels for each stream.

Inventive Principle:
Principle #25Self-service

2Reliability

If the SSD implements internal QoS management, then QoS performance is improved, but device complexity increases

Engineering Contradiction:
ImproveQoS attribute guaranteeVSAvoidQoS management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments QoS management into stream-specific control structures within the controller. Each data stream is assigned a unique stream identifier that triggers separate QoS parameter tracking and bandwidth allocation. This segmentation allows the controller to manage multiple streams with different QoS requirements independently using standardized control blocks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The QoS management system dynamically adjusts bandwidth allocation and priority levels based on real-time stream characteristics and current system load. The controller monitors stream activity and adapts resource distribution to meet guaranteed service levels while optimizing overall system performance, rather than using static QoS configurations.

Inventive Principle:
Principle #15Dynamics

3Reliability

If bandwidth is allocated to satisfy QoS attributes, then QoS performance is improved, but available resources for other streams decrease

Engineering Contradiction:
ImproveQoS attribute satisfactionVSAvoidTotal throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The controller performs preliminary bandwidth allocation based on declared QoS requirements before actual data transfer begins. Streams with guaranteed QoS attributes receive pre-allocated bandwidth reserves that ensure minimum service levels. This preliminary action allows the system to meet QoS commitments while optimizing remaining resources for additional throughput.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically changes bandwidth allocation parameters based on actual stream performance and system conditions. When streams meet their QoS guarantees, the controller adjusts allocation parameters to allow more aggressive bandwidth distribution, thereby increasing total throughput while maintaining QoS compliance for all active streams.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12073125B2Multi-stream SSD QOS management
Publication Date: 2024.08.27 SAMSUNG ELECTRONICS CO LTD
  • US12073125B2 patent drawing
  • US12073125B2 patent drawing
  • US12073125B2 patent drawing

AI summary

A system and method for satisfying Quality of Service (QoS) attributes for a stream using a storage device with multi-stream capability is described. The storage device may include memory to store data. A host interface may receive requests, some of which may be associated with a stream. A host interface layer may schedule the requests in a manner that may satisfy the QoS attribute for the stream.