Heterogeneous Core Memory Frequency Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Complex computer systems with heterogeneous processing cores face challenges in optimally balancing memory frequency to achieve both performance and power savings, as existing Dynamic Voltage and Frequency Scaling (DVFS) techniques lack sophistication in managing diverse core types and their varying bandwidth and latency needs.

Innovation Solution

Implementing a frequency optimization algorithm that differentiates frequency adjustments based on the type of core requesting bandwidth and response, increasing frequency more generously for high-performance cores and more sparingly for energy-efficient cores, while also considering the source of previous frequency requests to balance performance and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If memory frequency is increased to improve performance, then bandwidth and latency are improved, but power consumption increases

Engineering Contradiction:
Improvememory bandwidthVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by differentiating frequency adjustment policies based on core type. High-performance cores receive larger frequency increments when requesting bandwidth, while energy-efficient cores receive smaller increments. This localized differentiation resolves the contradiction by optimizing frequency allocation according to specific core requirements rather than applying a uniform policy, thereby improving performance when needed while conserving power when sufficient performance already exists.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamics through its frequency optimization algorithm that dynamically adjusts memory frequency based on real-time requests from different core types. The system continuously monitors bandwidth requests and adapts frequency levels accordingly, increasing frequency more aggressively for high-performance cores and more conservatively for energy-efficient cores. This dynamic adjustment resolves the contradiction by matching frequency levels to actual performance needs rather than maintaining static frequency settings.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If a uniform frequency adjustment policy is applied to all cores, then implementation is simple, but it fails to optimally balance performance and power for heterogeneous core types

Engineering Contradiction:
Improvecore type differentiationVSAvoidalgorithm complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent resolves this contradiction by implementing local quality through differentiated frequency adjustment policies for different core types. The algorithm identifies whether a request comes from a high-performance core or an energy-efficient core and applies appropriate frequency increment strategies. This approach provides the adaptability needed for heterogeneous architectures while maintaining reasonable algorithmic complexity through clear differentiation rules rather than overly complex decision-making logic.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies parameter changes by modifying the frequency adjustment parameter based on core type. When a high-performance core requests bandwidth, the system applies a larger frequency increment parameter. When an energy-efficient core requests bandwidth, a smaller increment parameter is applied. This parameter differentiation enables the system to adapt to different core types while keeping the algorithm structure relatively simple, resolving the contradiction between adaptability and complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240086088A1Dynamic voltage and frequency scaling for memory in heterogeneous core architectures
Publication Date: 2024.03.14 INTEL CORP
  • US20240086088A1 patent drawing
  • US20240086088A1 patent drawing
  • US20240086088A1 patent drawing

AI summary

Embodiments described herein may include apparatus, systems, techniques, and/or processes that are directed to optimizing memory frequency based on the bandwidth and latency needs of heterogeneous processing cores in a computer system. According to various embodiments, adjustments to the frequency of memory may be applied differently depending on the type of core requesting more bandwidth and/or faster response. According to various embodiments, the frequency is increased more sparingly for energy-efficient cores, while the frequency is increased more generously for high-performance cores. Additionally, when memory traffic decreases, the frequency of memory is decreased more generously when the previous request for higher frequency was from an energy-efficient core than a high-performance core. By considering the type of core that is requesting more bandwidth and/or faster response, performance and power consumption may be more optimally balanced.