Host-Based Caching with Shared Cache Controller

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In conventional computer systems, each host maintains its own cache independently, leading to duplicate entries and increased latency for data retrieval, as hosts do not share cache data effectively, resulting in unnecessary disk accesses and higher storage costs.

Innovation Solution

Implementing host-based caching, where hosts share data by reserving sub-caches to identify and retrieve data from other hosts, using hash values and translation tables to determine ownership and facilitate data sharing, thereby reducing disk accesses and improving latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If each host maintains its own cache independently, then each host can access its own cached data quickly, but duplicate entries are created across hosts and cache hit rates decrease

Engineering Contradiction:
Improvedata retrieval latencyVSAvoidcache hit rate
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent merges previously independent host caches into a unified shared cache system where multiple hosts can access the same cached data. The cache controller manages a common cache space that all hosts can utilize, eliminating duplicate cache entries across different hosts while maintaining quick access through the shared caching mechanism.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of operation

If hosts do not share cache data, then each host has full control over its own cache, but unnecessary disk accesses occur and storage costs increase

Engineering Contradiction:
Improvecache management controlVSAvoidstorage device load
Core Design Contradiction:
Ease of operationVSLoss of energy

Solution Approach 1:

The patent introduces a cache controller as an intermediary between hosts and the shared cache. This controller manages cache operations, handles data requests from multiple hosts, and coordinates cache memory allocation. The intermediary enables efficient shared cache management while reducing unnecessary disk accesses by serving requests from the shared cache when data is available.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If a shared cache system is implemented, then cache hit rates improve and disk accesses decrease, but system complexity increases

Engineering Contradiction:
Improvedata access efficiencyVSAvoidcaching system structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the caching system into distinct functional components: multiple host processors, a separate cache controller, and shared cache memory. This segmentation allows each component to perform its specific function independently while working together as a unified system. The cache controller handles management tasks while hosts focus on data processing, simplifying the overall system architecture despite the shared cache implementation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11625329B2Method and system for host-based caching
Publication Date: 2023.04.11 EMC IP HLDG CO LLC
  • US11625329B2 patent drawing
  • US11625329B2 patent drawing
  • US11625329B2 patent drawing

AI summary

A method is used in host-based caching. A host receives a request for data, and identifies a host in a plurality of hosts that owns the data.