Cache Stashing via Messaging Mechanism Parameters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data processing systems face inefficiencies in cache stashing due to the need for direct knowledge of physical devices and caches, limiting flexibility and scalability in data caching operations across multiple agents.

Innovation Solution

A data processing system with multiple agents and a messaging mechanism that allows selective caching of data based on message parameters and stashing control parameters, enabling caching without specifying physical devices, and using stashing management circuitry to determine caching locations dynamically.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If cache stashing is implemented with direct knowledge of physical devices, then caching performance can be optimized, but system flexibility and scalability are limited

Engineering Contradiction:
Improvecaching performanceVSAvoidsystem flexibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent introduces a messaging mechanism as an intermediary layer between data processing agents and the cache stashing system. Instead of agents directly managing physical caches, they communicate through messages that carry stashing control parameters. This mediator enables flexible, abstracted access to caching capabilities without requiring agents to know underlying physical device details, thus resolving the contradiction between optimization and flexibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the approach from direct physical cache management to parameter-based control through messaging. Stashing control parameters are conveyed via messages, allowing the system to optimize caching behavior through configurable parameters rather than hard-coded physical device knowledge. This enables both performance optimization and system flexibility by separating control logic from physical implementation.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If agents directly manage cache stashing, then caching control is precise, but device complexity increases

Engineering Contradiction:
Improvecaching control precisionVSAvoidagent complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts cache stashing control functionality from the data processing agents and consolidates it into a centralized messaging mechanism. Agents no longer directly manage caches; instead, they send messages containing stashing control parameters to a dedicated stashing management system. This extraction reduces agent complexity while maintaining precise caching control through the specialized messaging infrastructure.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The messaging mechanism serves multiple functions: it conveys data, carries stashing control parameters, and coordinates cache operations across the system. This universal message-based approach replaces complex direct cache management logic in agents, reducing their complexity while maintaining precise control through the multi-functional messaging layer.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If selective caching is implemented without physical device knowledge, then system flexibility improves, but caching efficiency may be compromised

Engineering Contradiction:
Improvesystem flexibilityVSAvoidcaching efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The messaging mechanism incorporates feedback loops where the stashing management system monitors message parameters and adjusts caching operations accordingly. The system uses feedback from message content and destination agent information to dynamically determine optimal caching strategies, maintaining high efficiency while preserving flexibility through parameter-based control rather than hard-coded physical knowledge.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary cache stashing based on message parameters before data is actually needed. By analyzing message content and destination information in advance, the stashing management system proactively positions data in appropriate caches, ensuring efficiency is maintained even without direct physical device knowledge. This preliminary action based on parameter analysis bridges the gap between flexibility and efficiency.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10877891B2Cache stashing in a data processing system
Publication Date: 2020.12.29 ARM LTD
  • US10877891B2 patent drawing
  • US10877891B2 patent drawing
  • US10877891B2 patent drawing

AI summary

A data processing system and a method of data processing are provided. The system comprises a first data processing agent, a second data processing agent, and a third data processing agent. Each of the second and third data processing agents have access to one or more caches. A messaging mechanism conveys a message from the first data processing agent to one of the second and third data processing agents specified as a message destination agent in the message. A stashing manager monitors the messaging mechanism and selectively causes data associated with the message to be cached for access by the message destination agent in a cache of the one or more caches in dependence on at least one parameter associated with the message and at least one stashing control parameter defined for a link from the first data processing agent to the message destination agent.