Storage Configuration Generator for I/O Workload Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems lack an efficient method to determine optimal configurations that balance performance objectives, storage capacity, and cost, particularly in managing I/O workloads and adapting to changing cache sizes and storage capacities.
Innovation Solution
A method involving a data storage system configuration generator that takes performance objectives, storage capacity, and I/O workload characteristics as inputs to determine candidate configurations, selecting the configuration with minimum cost while meeting performance objectives, including cache size determination, physical device configuration, and workload estimation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a data storage system is configured with larger cache size and more physical devices to meet performance objectives, then I/O performance is improved, but system cost increases
Solution Approach 1:
The system dynamically adjusts configuration parameters (cache size, number of disk adapters, number of front end adapters) based on workload characteristics and performance objectives. The configuration generator evaluates multiple parameter combinations to find the optimal balance between performance and cost, rather than using fixed configurations.
Solution Approach 2:
The storage system configuration is made dynamic through the configuration generator that can reevaluate and reconfigure system parameters in response to changing workload conditions. This allows the system to adapt cache usage and device allocation dynamically, optimizing performance for different workload scenarios without permanently over-provisioning resources.
2Productivity
If the data storage system uses more physical devices and adapters to handle increasing I/O workload, then workload capacity is improved, but device complexity increases
Solution Approach 1:
The system segments the storage workload across multiple physical devices, disk adapters, and front end adapters. The configuration generator determines optimal segmentation by analyzing workload characteristics and distributing I/O operations across divided components, allowing scalable capacity without proportionally increasing complexity.
Solution Approach 2:
The configuration generator creates a universal framework that can handle different types of I/O workloads (sequential, random, read, write) using the same set of physical devices and adapters. By optimizing how existing multi-functional components are allocated and configured, the system increases workload capacity without adding specialized hardware for each workload type.
3Productivity
If the data storage system is optimized for specific workload characteristics, then I/O performance is improved, but adaptability to different workloads decreases
Solution Approach 1:
The system employs dynamic configuration through the configuration generator that continuously evaluates workload characteristics and adjusts cache size, device allocation, and adapter configuration accordingly. This dynamic adaptation allows the system to optimize performance for current workload conditions while maintaining the ability to adapt to different workload types without rehardwareing.
Solution Approach 2:
The configuration generator utilizes parameter changes to adapt system behavior to different workload characteristics. By modifying configuration parameters (cache allocation, device mapping, adapter settings) based on detected workload patterns, the system achieves both optimization for current workloads and adaptability to future workload variations.
Data Source
AI summary
Described are techniques for determining data storage system configurations. Inputs are provided to a data storage system configuration generator. The inputs include first inputs and second inputs. The first inputs include a performance objective, a storage capacity, and input(s) characterizing an I/O workload. The second inputs characterize performance of data storage system components and costs of the data storage system components. First processing is performed by the data storage system configuration generator in accordance with the inputs to determine a set of one or more candidate data storage system configurations. The data storage system configuration selects, in accordance with one or more criteria, a first candidate data storage system configuration from the set.