Adaptive I/O Device Latency Control via Workload Profiling

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Host device latency is affected by inconsistent input/output device latency, and existing technologies do not effectively account for how changes in input/output device latency and workload execution profiles impact overall system input/output performance, leading to degraded system responsiveness and throughput.

Innovation Solution

Implementing a workload execution profiler in input/output devices to assess host device performance and adjust attributes such as flash translation layer queue depth, data transfer scheduling, and command status notification timing to optimize host device latency and overall system input/output efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the host device uses fixed input/output device latency settings, then the device complexity is reduced, but the host device latency increases due to inconsistent input/output device latency

Engineering Contradiction:

Improveinput/output device control settingsVSAvoidhost device latency

Core Design Contradiction:

Device complexityVSLoss of time

Solution Approach 1:

The patent applies dynamics by making the input/output device control settings adjustable and adaptive rather than fixed. The system dynamically modifies flash translation layer queue depth, data transfer scheduling, and command status notification timing based on measured host device performance characteristics, allowing the device to adapt to different host workloads and reduce latency without requiring complex manual configuration.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by measuring host device performance attributes (such as command turnaround time and queue depth utilization) and using these measurements to automatically adjust input/output device settings. The workload execution profiler continuously monitors host behavior and feeds this information back to the controller, which then optimizes parameters like queue depth and notification timing to minimize host latency.

Inventive Principle:

Principle #23Feedback

2Productivity

If the input/output device adjusts settings based on host workload, then the host device execution efficiency is improved, but the device complexity increases

Engineering Contradiction:

Improvehost device execution efficiencyVSAvoidworkload execution profiler and control mechanism

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent applies self-service by enabling the input/output device to automatically profile and adapt to host workload characteristics without external intervention. The workload execution profiler autonomously measures host performance attributes, identifies workload patterns, and adjusts device settings accordingly, eliminating the need for manual configuration or complex external control systems while improving execution efficiency.

Inventive Principle:

Principle #25Self-service

3Quantity of substance

If the command status notification timing is delayed, then the flash translation layer queue depth is maintained, but the host device latency increases

Engineering Contradiction:

Improveflash translation layer queue depthVSAvoidcommand status host notification timing

Core Design Contradiction:

Quantity of substanceVSLoss of time

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting the command status notification timing parameter based on measured host device characteristics and workload conditions. Rather than using a fixed notification delay, the system modifies this parameter in real-time to optimize the balance between maintaining adequate queue depth and minimizing host latency, achieving both goals simultaneously through adaptive parameter tuning.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS10642764B1Data transfer command latency of a host device

Publication Date: 2020.05.05 SANDISK TECHNOLOGIES LLC

AI summary

An input/output device identifies a workload type for a connected host device. The input/output device applies settings for the workload type to affect one or more of a flash translation layer queue depth of the input/output device, a host device data transfer scheduler of the input/output device, and a command status host notification timing by the input/output device to the host device.