Shared Cache Sector Division Ratio Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In high-performance computing systems, optimizing the sector division ratio of shared cache memory is challenging due to the need for dynamic adjustment based on multiple executing jobs and varying data access patterns, which affects cache hit rates and overall system performance.
Innovation Solution
A controller dynamically adjusts the sector division ratio of the shared cache memory by calculating the optimal ratio based on data access amounts and access counts of multiple jobs, using a mechanism that assigns ways to sectors according to data reusability levels, allowing for real-time optimization during job execution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the sector division ratio of shared cache memory is fixed, then the device complexity is reduced and ease of operation is improved, but the adaptability to different job execution patterns and data access behaviors deteriorates
Solution Approach 1:
The patent implements dynamic sector division ratio adjustment based on job execution characteristics. The controller monitors data access patterns, cache hit rates, and job types during runtime, then automatically adjusts the sector division ratio to optimize cache performance for different execution scenarios without requiring manual reconfiguration or complex static control logic
Solution Approach 2:
The system performs self-optimization by automatically detecting job execution patterns and data access behaviors, then autonomously adjusting the sector division ratio without external intervention. The controller uses feedback from cache performance metrics to dynamically reconfigure memory sectors, enabling the system to adapt to varying workloads independently
2Productivity
If the sector division ratio is dynamically adjusted based on data access patterns, then the cache hit rate and execution speed are improved, but the device complexity and control complexity increase
Solution Approach 1:
The patent employs feedback mechanisms where the controller continuously monitors cache hit rates, data access frequencies, and job execution characteristics. Based on this feedback, the system dynamically adjusts the sector division ratio to maintain optimal cache performance, creating a closed-loop control system that adapts to changing workload conditions without requiring overly complex external control infrastructure
Solution Approach 2:
The system optimizes cache performance by dynamically changing the sector division ratio parameter based on detected job execution patterns and data access behaviors. This parameter adjustment allows the cache memory to adapt its organizational structure to match current workload requirements, improving execution speed without requiring fundamental architectural changes
3Productivity
If multiple jobs with different data access patterns are executed in parallel, then the productivity and resource utilization are improved, but the difficulty of optimizing cache performance for all jobs simultaneously increases
Solution Approach 1:
The patent applies different sector division ratios to different cache sectors based on the specific access patterns detected for each job or data type. Instead of using a uniform cache configuration, the system creates locally optimized regions within the cache memory that are tailored to specific job requirements, allowing multiple parallel jobs with different access patterns to each receive customized cache allocation
Data Source
AI summary
An apparatus includes a shared cache memory and a controller. The shared cache memory is configured to be divided into sectors by assigning one or more ways to each sector in accordance with a reusability level of data. The controller changes a sector division ratio indicating a ratio between way counts of the divided sectors of the shared cache memory, where the way count is a number of ways assigned to each sector. When first and second jobs are being executed in parallel, in response to a designation of a program of the second job, the controller calculates the sector division ratio, based on data access amount including a size and an access count of data accessed by the first and second jobs and a volume of the shared cache memory, and changes the sector division ratio of the shared cache memory to the calculated sector division ratio.