Resource Allocation Thresholds for Storage I/O Scheduling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In computer systems with multiple data storage systems, efficiently allocating resources such as port bandwidth and I/O buffers becomes complex, especially when the allocation of one resource affects the usage of another, and external factors impact consumption, leading to potential bottlenecks and increased response times.

Innovation Solution

A method and system for allocating resources by providing thresholds for port bandwidth and I/O buffers, monitoring actual consumption, and adjusting the scheduling of processes to maintain resource usage within these thresholds, ensuring that migration processes do not exceed allocated limits and prioritize host I/O operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If resources are allocated to migration processes without thresholds, then data migration can proceed at maximum speed, but host I/O operations may experience bottlenecks and increased response times

Engineering Contradiction:
Improvedata migration speedVSAvoidhost I/O response time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system dynamically changes the parameter of migration process execution frequency based on resource consumption thresholds. When port bandwidth or I/O buffer consumption exceeds thresholds, the system adjusts the timing parameters of migration processes to reduce resource usage, thereby preventing host I/O bottlenecks while maintaining acceptable migration progress

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The resource allocation system transitions from static to dynamic control by continuously monitoring resource consumption and adjusting migration process scheduling in real-time. The system dynamically modifies execution timing based on current resource availability, ensuring host I/O operations receive adequate resources while allowing migration to proceed

Inventive Principle:
Principle #15Dynamics

2Productivity

If multiple resources are allocated to migration processes, then migration throughput increases, but resource allocation complexity increases due to interdependencies between resources

Engineering Contradiction:
Improvemigration throughputVSAvoidresource allocation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements feedback mechanisms that monitor actual consumption of port bandwidth and I/O buffers by migration processes. This feedback information is used to adjust scheduling decisions, allowing the system to manage multiple interdependent resources through a unified threshold-based control approach rather than complex independent allocations

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system segments resource management into separate controllable thresholds for different resource types (port bandwidth, I/O buffers). This allows independent configuration and monitoring of each resource type while maintaining overall system control, reducing the complexity of managing interdependent resources

Inventive Principle:
Principle #1Segmentation

3Productivity

If migration processes are allowed to consume resources freely, then migration completes faster, but system stability deteriorates due to resource exhaustion

Engineering Contradiction:
Improvemigration completion speedVSAvoidsystem stability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system establishes resource consumption thresholds before migration processes begin execution. These pre-defined thresholds act as preliminary constraints that prevent resource exhaustion before it occurs, ensuring system stability is maintained throughout the migration process while still allowing aggressive resource utilization within safe limits

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8667494B1Controlling resource allocation using thresholds and scheduling
Publication Date: 2014.03.04 EMC IP HLDG CO LLC
  • US8667494B1 patent drawing
  • US8667494B1 patent drawing
  • US8667494B1 patent drawing

AI summary

Described are techniques for allocating resources. Two consumer processes using two resources are provided. A first threshold of a first of the resources for a first of said two consumer processes is provided. A second threshold of a second of said resources for said first consumer process is provided. Consumption information is received regarding actual consumption of the two resources by the first consumer process. Execution of the first consumer process is scheduled in accordance with the first and the second thresholds and the consumption information.