Adaptive Smart Data Cache Eviction for SSD Lifespan

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data cache eviction in primary storage systems with SSDs is challenging due to limited write-erase cycles and capacity, leading to bottlenecks that degrade performance, especially in low IOPS environments, where HDDs cannot provide sufficient latency for primary-like workloads.

Innovation Solution

Implementing a smart weighted container data cache eviction policy that weights WEUs based on page statistics, evicting least frequently and recently accessed blocks to maintain high cache hit rates and extend SSD lifespan, while adapting to workload dynamics and processor availability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data cache eviction is implemented using traditional methods, then cache capacity is managed, but cache hit rate decreases and performance degrades

Engineering Contradiction:
Improvecache capacityVSAvoidcache hit rate
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent changes the parameter of eviction decision from simple LRU time-based metrics to a weighted composite parameter that includes access frequency, recency, and data characteristics. This allows the system to evict less important data while retaining frequently accessed data, thereby maintaining cache hit rate while managing capacity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system implements feedback mechanisms by continuously monitoring access patterns and adjusting eviction decisions based on real-time cache performance metrics. The weighted container structure provides feedback about data importance, enabling dynamic eviction policies that adapt to changing workload characteristics.

Inventive Principle:
Principle #23Feedback

2Productivity

If SSD capacity is increased to reduce eviction, then performance improves, but cost increases and write-erase cycle limitations are exacerbated

Engineering Contradiction:
ImproveIOPSVSAvoidSSD capacity
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent changes the eviction parameter from uniform treatment of all cached data to differentiated weighting based on access patterns and data characteristics. This allows more efficient utilization of limited SSD capacity by prioritizing retention of high-value data, effectively increasing performance without requiring additional capacity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the cache into weighted containers that categorize data based on access frequency and importance. This segmentation allows the system to manage limited SSD capacity more effectively by applying different retention strategies to different data segments, maximizing performance within capacity constraints.

Inventive Principle:
Principle #1Segmentation

3Productivity

If eviction frequency is increased to prevent bottlenecks, then cache performance is maintained, but SSD lifespan is reduced due to additional write operations

Engineering Contradiction:
Improvecache performanceVSAvoidSSD lifespan
Core Design Contradiction:
ProductivityVSDuration of action of stationary object

Solution Approach 1:

The patent changes the eviction parameter to include data importance weights, allowing the system to evict less critical data while retaining important data longer. This reduces overall eviction frequency and associated write operations, extending SSD lifespan while maintaining performance for critical data.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The weighted container system enables the cache to self-regulate eviction based on inherent data characteristics and access patterns. By automatically identifying and retaining high-value data, the system reduces unnecessary evictions and write operations, conserving SSD write-erase cycles while maintaining performance.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10102150B1Adaptive smart data cache eviction
Publication Date: 2018.10.16 EMC IP HLDG CO LLC
  • US10102150B1 patent drawing
  • US10102150B1 patent drawing
  • US10102150B1 patent drawing

AI summary

An adaptive smart data cache eviction method takes file-based quotas into account during eviction of WEUs as opposed to a default eviction policy that treats all files the same. Adaptive smart data cache eviction is a granular and dynamic eviction of the least frequently and least recently accessed blocks contained in a WEU for those files that have exceeded file-based quotas established for them or that are determined to be candidates for eviction based on the number of blocks stored for them relative to other files and how frequently and recently those blocks were accessed.