Configuration Cache Access for Low-Latency Transaction Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing systems face inefficiencies in memory access due to the need for repeated cache lookups and temporary storage of configuration data, leading to latency and increased circuit area and power consumption.
Innovation Solution
A configuration cache system where each transaction specifies a storage location for its corresponding unit of configuration data, allowing direct access without temporary storage, and uses usage counters to manage active transactions and evict data efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If configuration data is temporarily stored in the data processing apparatus, then fast access to configuration data is achieved, but circuit area and power consumption increase
Solution Approach 1:
The patent extracts the configuration data from the data processing apparatus and stores it externally in a configuration cache on the memory interface. This allows the data processing apparatus to access configuration data without having it permanently stored within its own circuitry, thereby reducing circuit area while maintaining access capability through the external cache mechanism.
Solution Approach 2:
The patent introduces a configuration cache as an intermediary component between the data processing apparatus and the memory system. This intermediary cache stores configuration data and provides fast access to the data processing apparatus without requiring the apparatus itself to contain the configuration data, thus resolving the contradiction between fast access and reduced circuit area.
2Speed
If configuration data is temporarily stored in the data processing apparatus, then fast access to configuration data is achieved, but power consumption increases
Solution Approach 1:
By extracting configuration data storage from the data processing apparatus to an external configuration cache, the patent eliminates the need for the apparatus to maintain configuration data in its own memory structures. This reduces the continuous power consumption associated with maintaining internal caches and temporary storage, while still enabling fast access when needed through the external cache.
Solution Approach 2:
The configuration cache operates as a self-service mechanism that provides configuration data to the data processing apparatus on demand. Instead of the apparatus continuously maintaining configuration data in its own circuits (consuming power), the external cache services the apparatus only when configuration data is actually needed, reducing overall power consumption while maintaining access speed.
3Reliability
If repeated cache lookups are performed to access configuration data, then configuration data can be retrieved, but latency increases
Solution Approach 1:
The patent implements preliminary action by pre-fetching and storing configuration data in the configuration cache before it is actually needed by the data processing apparatus. The memory interface proactively loads configuration data into the cache, so when the apparatus needs to access configuration data, it is already available in the cache, eliminating the need for repeated lookups and reducing latency.
Solution Approach 2:
The configuration cache maintains continuous availability of configuration data through proactive loading and caching mechanisms. Instead of the data processing apparatus repeatedly performing cache lookups (interrupting its main processing flow), the configuration data remains continuously available in the external cache, allowing the apparatus to access it without interruption and reducing overall system latency.
Data Source
AI summary
Apparatuses, systems, methods, computer-readable media, and computer code are disclosed. An apparatus comprises transaction circuitry configured to control transactions, wherein a configuration of each transaction is controlled by a corresponding unit of configuration data; and a configuration cache configured to hold a plurality of units of configuration data. Each transaction specifies a storage location in the configuration cache at which the corresponding unit of configuration data is stored, and the transaction circuitry is configured to access the corresponding unit of configuration data at the storage location to control each transaction.