Hinting Driver Cache Management for High Priority Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In data storage systems, high priority data that is likely to be used in the near future may be removed from cache memory due to failing to satisfy a threshold heat quotient, leading to inefficiencies in cache management and system performance.

Innovation Solution

A cache management system incorporating a hinting driver and priority controller that intercepts data packets, generates pointers, and determines their priority level, allowing high priority data to be stored in cache memory regardless of the threshold heat quotient, thereby bypassing the hot spot detection algorithm.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data is stored in cache memory based on threshold heat quotient, then cache memory can be managed efficiently with standard algorithms, but high priority data that is likely to be used in the near future may be removed from cache memory

Engineering Contradiction:
Improvecache management efficiencyVSAvoiddata availability for high priority data
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments the data priority management into two distinct paths: a standard hot spot detection algorithm for regular data and a hint-based priority mechanism for high priority data. This segmentation allows each data type to be managed according to its specific requirements, preventing high priority data from being removed based on insufficient heat quotient while maintaining efficient cache management for standard data.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hinting driver as an intermediary component between the data transfer request and the cache management decision. This intermediary intercepts data packets and generates priority pointers that influence the cache management algorithm, enabling high priority data to bypass the standard heat quotient threshold and be stored in cache memory accordingly.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If standard hot spot detection algorithm is used for cache management, then cache memory can be filled with frequently used data, but high priority data with low heat quotient fails to satisfy the threshold and is not cached

Engineering Contradiction:
Improvecache fill rate for frequently used dataVSAvoidability to cache high priority data regardless of heat quotient
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent makes the cache management system dynamic by allowing the caching decision to vary based on data priority level. High priority data packets receive special treatment through hint-based pointers that override the standard heat quotient threshold, while standard data continues to be managed by the traditional hot spot detection algorithm. This dynamic adaptation ensures both efficient cache utilization and appropriate handling of critical data.

Inventive Principle:
Principle #15Dynamics

3Reliability

If high priority data is stored in cache memory regardless of heat quotient, then data availability and system performance improve, but cache memory may be filled with data that does not meet standard hot spot criteria

Engineering Contradiction:
Improvedata availabilityVSAvoidcache memory utilization efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies local quality by treating different data packets differently based on their priority level. High priority data packets are handled with special caching rules that prioritize their storage regardless of heat quotient, while standard data packets continue to follow traditional hot spot detection. This localized differentiation ensures that critical data receives appropriate caching attention without completely disregarding the performance benefits of heat quotient-based management for standard data.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9384135B2System and method of caching hinted data
Publication Date: 2016.07.05 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US9384135B2 patent drawing
  • US9384135B2 patent drawing
  • US9384135B2 patent drawing

AI summary

The disclosure is directed to a system and method of cache management for a data storage system. According to various embodiments, the cache management system includes a hinting driver and a priority controller. The hinting driver generates pointers based upon data packets intercepted from data transfer requests being processed by a host controller of the data storage system. The priority controller determines whether the data packets are associated with at least a first (high) priority level or a second (normal or low) priority level based upon the pointers generated by the hinting driver. High priority data packets are stored in cache memory regardless of whether they satisfy a threshold heat quotient (i.e. a selected level of data transfer activity).