Block Device Modeling for Latency Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing block storage systems lack a rigorous method to classify read and write operations as sequential or random, which affects system performance, and there is a need to optimize the placement of customer volumes based on historical operational data to minimize latency.

Innovation Solution

Implementing a system that calculates deltas between operations to determine the degree of sequentiality or randomness, using these classifications to optimize the placement of volumes across block storage devices and predict latency for future operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If block storage systems use traditional classification methods for read and write operations, then the system can operate with simple structure, but the system performance and latency optimization are insufficient

Engineering Contradiction:
Improvesystem performanceVSAvoidclassification system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments block storage operations into distinct categories (sequential reads, random reads, sequential writes, random writes) based on operational characteristics. This segmentation enables targeted optimization strategies for each operation type, improving overall system performance while maintaining manageable complexity through systematic classification.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces delta calculations as a new parameter to quantify the sequentiality or randomness of operations. By changing from simple operation counting to delta-based classification, the system achieves more precise operation categorization, enabling better performance optimization without excessive complexity.

Inventive Principle:
Principle #35Parameter changes

2Loss of time

If the system places all volumes on any block storage device without optimization, then the device utilization is simple to manage, but the latency for operations cannot be minimized

Engineering Contradiction:
Improveoperation latencyVSAvoidvolume placement management
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The patent performs preliminary classification of volumes based on their operational patterns (delta calculations) before placement. By pre-analyzing operation characteristics and categorizing volumes as sequential or random access patterns, the system optimizes placement decisions in advance, minimizing latency without requiring complex real-time management.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a model representation of block storage devices that includes classification information about volumes and operations. This modeling approach allows the system to simulate and evaluate different placement scenarios, finding optimal configurations that minimize latency while simplifying the actual placement management process.

Inventive Principle:
Principle #26Copying

3Measurement precision

If the system uses detailed delta calculations to classify operations, then the classification precision is improved, but the computational complexity increases

Engineering Contradiction:
Improveoperation classification precisionVSAvoidcalculation system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies delta calculations locally to pairs of adjacent operations rather than analyzing the entire operation history globally. This local approach maintains high classification precision by examining specific operation transitions while avoiding the computational complexity of comprehensive analysis, making the system efficient and scalable.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10565501B1Block device modeling
Publication Date: 2020.02.18 AMAZON TECH INC
  • US10565501B1 patent drawing
  • US10565501B1 patent drawing
  • US10565501B1 patent drawing

AI summary

Techniques are described for formally expressing whether sequences of operations performed on block storage devices are sequential or random. In embodiments, determinations of whether these sequences of operations are sequential or random may be used to predict latencies involved with running particular workloads, and to predict representative workloads for particular latencies.