Storage Resource Latency-Utilization Optimization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In networked storage environments, managing resources efficiently to balance throughput and latency is challenging as storage systems grow in size and complexity, requiring effective monitoring and optimization of resource utilization to maintain performance without excessive delay.

Innovation Solution

A method and system that generate a relationship between latency and utilization of resources using observation-based current and historical data, identifying an optimal point where further workload increases result in smaller throughput gains than increased latency, allowing for proactive management of resource utilization and headroom determination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If resource utilization is increased to improve throughput, then productivity is improved, but latency increases

Engineering Contradiction:

ImprovethroughputVSAvoidlatency

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system dynamically determines optimal resource utilization levels by analyzing latency-utilization relationships and adjusts resource allocation parameters accordingly. By changing utilization parameters based on observed latency characteristics, the system achieves optimal throughput while controlling latency increases.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The system continuously monitors latency and utilization data, generates latency-utilization relationships, and uses this feedback to determine optimal resource utilization points. This closed-loop feedback mechanism allows the system to adapt to changing conditions and maintain optimal performance.

Inventive Principle:

Principle #23Feedback

2Adaptability or versatility

If storage system size and complexity increase to provide more functionality, then adaptability is improved, but device complexity increases

Engineering Contradiction:

ImprovefunctionalityVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically monitors its own resources, generates latency-utilization relationships from observed data, and determines optimal utilization points without external intervention. This self-service capability simplifies management of complex storage systems while maintaining adaptability.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system replaces complex manual monitoring and tuning mechanisms with automated observation-based analysis. By substituting mechanical/ manual complexity with automated software-based monitoring and analysis, the system manages complexity while providing extensive functionality.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9594515B2Methods and systems using observation based techniques for determining performance capacity of a resource of a networked storage environment

Publication Date: 2017.03.14 NETAPP INC

AI summary

Methods and systems for managing resources in a networked storage environment are provided. One method includes generating a relationship between latency and utilization of a resource in a networked storage environment using observation based, current and historical latency and utilization data, where latency is an indicator of delay at the resource for processing any request and utilization of the resource is an indicator of an extent the resource is being used at any given time; and selecting an optimal point for the generated relationship between latency and utilization, where the optimal point is an indicator of resource utilization beyond which throughput gains for a workload is smaller than increase in latency.