Predictive Model for Multi-Level Cache Configuration Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for configuring multi-level caching in storage area networks (SANs) face challenges in identifying optimal cache configurations, predicting performance under varying workloads, and comparing different configurations effectively, leading to inefficiencies and inefficiencies in resource allocation.

Innovation Solution

A predictive model that specifies workloads and cache characteristics to predict performance metrics, resource allocation, and provide recommendations for optimal cache configuration, including dynamic partitioning and data storage technology selection, to ensure efficient workload handling and cost optimization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple cache levels with variable characteristics are configured in a SAN, then data access efficiency is improved, but it becomes difficult to identify optimal cache configurations and predict performance under varying workloads

Engineering Contradiction:
Improvedata access efficiencyVSAvoidcache configuration complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by allowing cache characteristics (such as cache size, replacement policies, and associativity) to be dynamically adjusted based on workload conditions. The system models different cache configurations with varying parameters and selects optimal settings by predicting performance metrics under different parameter combinations, thus resolving the contradiction between improving data access efficiency and managing configuration complexity.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If a particular cache hierarchy configuration is optimized for a specific workload, then performance is improved, but the configuration becomes inefficient when workload conditions change

Engineering Contradiction:
Improvecache performanceVSAvoidworkload adaptability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamics by enabling the cache hierarchy configuration to adapt dynamically to changing workload conditions. The system uses predictive modeling to evaluate how different cache configurations will perform under various workload scenarios, allowing the configuration to be adjusted dynamically rather than remaining static. This resolves the contradiction by making the cache system both high-performing for specific workloads and adaptable when workloads change.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies preliminary action by using predictive modeling to anticipate future workload conditions and pre-determine optimal cache configurations. The system models expected workload patterns and predicts performance metrics in advance, allowing the cache hierarchy to be configured proactively before actual workload changes occur, thus maintaining optimal performance across varying conditions.

Inventive Principle:
Principle #10Preliminary action

3Ease of manufacture

If conventional systems use fixed cache configurations, then implementation is simple, but they fail to predict behavior across different workload portions and provide suboptimal performance

Engineering Contradiction:
Improveconfiguration implementation simplicityVSAvoidperformance prediction accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent applies copying by creating predictive models that simulate and copy the behavior of actual cache hierarchies under different workload conditions. Instead of requiring complex real-world experimentation, the system uses virtual copies (models) of cache configurations to predict performance metrics accurately. This approach maintains implementation simplicity while dramatically improving performance prediction accuracy compared to fixed configurations.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS8489816B1Predicting and optimizing I/O performance characteristics in a multi-level caching system
Publication Date: 2013.07.16 EMC IP HLDG CO LLC
  • US8489816B1 patent drawing
  • US8489816B1 patent drawing
  • US8489816B1 patent drawing

AI summary

A predictive model specifies a workload to be applied to a hierarchy of caches having multiple levels of caches. The predictive model defines a configuration for the hierarchy of caches by specifying cache characteristics of each level of the hierarchy of caches and the underlying storage pool and applies the workload to the configuration. For each level of the configuration, the predictive model computes a performance metric based on a portion of the workload satisfied at the level and the cache characteristics of the level. The predictive model computes resource allocation metrics based on the performance metric for the levels and a cost associated with the configuration. Based on the workload, the configuration, performance metrics, and resource allocation metrics, the predictive model creates a design time recommendation for the hierarchy of caches, a configuration time recommendation and run time recommendation for the hierarchy of caches.