N-Way Local Storage Access Restriction for Lower Power
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing apparatuses with local storage circuitry face inefficiencies in power consumption and performance due to unrestricted access to all ways of N-way associative storage structures, particularly for certain predefined types of memory access requests.
Innovation Solution
Implementing a restrictive access policy in N-way associative local storage circuitry that excludes an excluded subset of ways for predefined memory access requests, reducing power consumption and improving performance by tailoring associativity based on the type of memory access request.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by stationary object
If unrestricted access to all ways of N-way associative storage is used, then cache utilization is maximized, but power consumption increases and performance deteriorates for predefined memory access types
Solution Approach 1:
The patent applies dynamics by making the associativity configuration dynamic rather than fixed. The control circuitry dynamically adjusts the effective associativity based on the type of memory access request (e.g., memory copy, move, vector load), transitioning from full N-way access for general cases to restricted access for predefined types. This dynamic adaptation resolves the contradiction by reducing power consumption for specific access patterns while maintaining optimal cache utilization for others.
Solution Approach 2:
The patent applies local quality by implementing different access policies for different subsets of ways within the N-way associative storage. Instead of uniformly accessing all ways, the system selectively accesses only relevant ways based on the memory access type, effectively creating different 'qualities' of access control for different local regions of the storage structure.
2Productivity
If full N-way associative access is implemented, then performance is optimized for general memory access, but power consumption increases for predefined memory access types
Solution Approach 1:
The system dynamically adjusts the degree of associativity accessed based on the memory access type. For predefined types (memory copy, move, vector load), the control circuitry restricts access to reduce power consumption, while maintaining full N-way access for general memory operations. This dynamic behavior allows the system to optimize performance when needed while conserving energy during predictable access patterns.
Solution Approach 2:
The patent applies partial action by selectively accessing only the necessary subset of ways rather than always accessing all N ways. For predefined memory access types, the system uses a partial action approach by restricting access to specific ways, thereby reducing unnecessary power consumption while maintaining sufficient performance for these predictable access patterns.
3Use of energy by stationary object
If restrictive access policy is applied to predefined memory access types, then power consumption is reduced, but access time may increase
Solution Approach 1:
The control circuitry incorporates feedback mechanisms to monitor memory access patterns and determine when to apply restrictive access policies. By feedback-based decision making, the system can adaptively apply restrictions only when necessary, minimizing the impact on access time while maximizing power savings. The feedback loop allows the system to learn from access patterns and make intelligent decisions about policy application.
Data Source
AI summary
There is provided an apparatus, system, chip-containing product, method, and storage medium. The apparatus comprises memory access circuitry responsive to one or more types of memory access request, to retrieve specified data items from memory. The apparatus is also provided with local storage circuitry configured to store at least some of the retrieved data items. The local storage circuitry is N-way associative, and N is greater than 1. The apparatus is also provided with control circuitry responsive to an indication that an access request signalled to the local storage circuitry relating to an accessed data item corresponds to a predefined type of memory access request, to implement a restrictive access policy in relation to the accessed data item in the local storage circuitry. The restrictive access policy excludes at least one step of accessing an excluded subset of ways of the local storage circuitry.