Storage I/O Response Time Control via Adaptive Delay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data storage systems face challenges in managing I/O response times to meet service level objectives, particularly in scenarios where observed I/O response times exceed specified performance levels, leading to inefficiencies and potential performance degradation.

Innovation Solution

A method is introduced to dynamically adjust I/O response times by applying response time delays to I/O operations based on observed performance metrics, involving a front-end component that delays responses if the initial observed I/O response time exceeds a threshold, and adjusts the delay based on subsequent measurements to ensure compliance with service level objectives, including the option to demote data to lower performance storage tiers when feasible.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If response time delay is applied to I/O operations to meet service level objectives, then I/O response time compliance is improved, but I/O performance and system efficiency deteriorate

Engineering Contradiction:
ImproveI/O response time complianceVSAvoidI/O performance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system dynamically adjusts the response time delay based on current I/O performance metrics and service level objective compliance. The delay is not fixed but adapts in real-time, increasing when compliance is needed and decreasing or removing when performance allows, thus resolving the contradiction between reliability and productivity

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the response time parameter dynamically by applying delays only when necessary to meet service level objectives. The response time delay threshold and actual applied delay are adjusted based on observed I/O response times and compliance status, allowing the system to maintain reliability while minimizing impact on productivity

Inventive Principle:
Principle #35Parameter changes

2Reliability

If I/O response time is increased to meet service level objectives, then compliance with minimum response time is improved, but overall system response speed deteriorates

Engineering Contradiction:
ImproveService level objective complianceVSAvoidI/O response speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The system monitors its own I/O response times and automatically applies response time delays when service level objectives are not met. This self-regulating mechanism ensures compliance without requiring external intervention, adjusting the speed parameter based on the system's own performance metrics

Inventive Principle:
Principle #25Self-service

3Reliability

If response time delay is applied to all I/O operations, then service level objectives are met, but system throughput and efficiency deteriorate

Engineering Contradiction:
ImproveService level objective adherenceVSAvoidSystem throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system applies response time delays locally and selectively rather than universally. Delays are applied only to specific I/O operations that would otherwise violate service level objectives, identified by comparing observed response times against the delay removal threshold and service level requirements, thus maintaining throughput for compliant operations

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10282107B1Controlling I/O response time to meet service levels
Publication Date: 2019.05.07 EMC IP HLDG CO LLC
  • US10282107B1 patent drawing
  • US10282107B1 patent drawing
  • US10282107B1 patent drawing

AI summary

Described are techniques for controlling I/O response time. It is determined whether a first observed I/O response time for a storage group exceeds I/O performance specified by a service level objective. If so, first processing may be performed to decrease I/O performance for the storage group. The first processing may include: for each I/O directed to the storage group that is received within a first subsequent time period, determining a first response time denoting an amount of time taken to service each I/O prior to returning a response for each I/O; determining whether the first response time for each I/O is less than a response time delay threshold; and if the first response time for each I/O is less than the response time delay threshold, applying a response time delay to each I/O prior to returning a response for each I/O.