Caching Architecture Segmentation for Data Storage Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data storage systems, particularly hybrid disk drives with multiple levels of cache memory, face inefficiencies in storing and locating data, and require mechanisms to ensure data integrity and coherency across different cache levels and permanent storage.

Innovation Solution

A caching architecture that employs a cache table and segment control lists to efficiently manage host data units, utilizing a lookup table for data retrieval and implementing a caching policy based on priority metrics to determine which data to cache, evict, and store in solid-state memory, ensuring robustness and scalability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If multiple levels of cache memory are used to improve performance, then data access speed is improved, but system complexity increases

Engineering Contradiction:
Improvedata access speedVSAvoidcaching architecture complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent segments the caching architecture into multiple distinct levels (first level cache and second level cache), each with specific functions. The first level cache handles frequently accessed data while the second level cache stores less frequently accessed data, creating a hierarchical structure that improves access speed while managing complexity through functional segmentation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a coherence management unit as an intermediary component that mediates between multiple cache levels and permanent storage. This intermediary maintains data coherence by tracking valid data copies and managing synchronization, thereby handling the complexity of multi-level caching without requiring complex coordination logic throughout the entire system.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If cache memory is used to store frequently accessed data, then data retrieval efficiency is improved, but data integrity monitoring complexity increases

Engineering Contradiction:
Improvedata retrieval efficiencyVSAvoiddata integrity monitoring complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism through the coherence management unit that continuously monitors data validity and provides feedback about which cache copies are current. This feedback system tracks data writes to permanent storage and updates coherence information in the cache levels, enabling efficient data retrieval while automatically maintaining integrity without complex external monitoring.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The caching architecture performs self-service for data integrity monitoring through automated coherence tracking and validation mechanisms embedded within the cache management unit. The system automatically detects and manages invalid data copies without requiring external intervention, thereby maintaining data integrity while preserving retrieval efficiency.

Inventive Principle:
Principle #25Self-service

3Productivity

If data is stored in both cache memory and permanent storage, then system performance is improved, but the need for valid data copy tracking increases complexity

Engineering Contradiction:
Improvesystem performanceVSAvoidvalid data copy tracking complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The coherence management unit performs multiple functions simultaneously: it tracks valid data copies across cache levels, manages data coherence, handles synchronization between cache and permanent storage, and provides validity information to the data retrieval path. This multi-functional approach consolidates complexity into a single universal component rather than distributing it throughout the system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The coherence management unit acts as an intermediary layer between the cache memory subsystem and permanent storage, abstracting the complexity of tracking valid data copies. It maintains coherence information and provides a simplified interface for data access, thereby enabling performance benefits of dual storage without exposing the tracking complexity to the rest of the system.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8898423B1High performance caching architecture for data storage systems
Publication Date: 2014.11.25 WESTERN DIGITAL TECHNOLOGIES INC
  • US8898423B1 patent drawing
  • US8898423B1 patent drawing
  • US8898423B1 patent drawing

AI summary

A data storage system is disclosed that utilizes a high performance caching architecture. In one embodiment, the caching architecture utilizes a cache table, such as a lookup table, for referencing or storing host data units that are cached or are candidates for being cached in the solid-state memory. Further, the caching architecture maintains a segment control list that specifies associations between particular cache table entries and particular data segments. Such separation of activities related to the implementation of a caching policy from activities related to storing cached data and candidate data provides robustness and scalability while improving performance.