Prefetch Engine Power State Adjustment via Queue Watermarks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Graphics pipelines in graphics processing units (GPUs) consume power regardless of their workload, leading to inefficiencies in power consumption without impacting performance.
Innovation Solution
Implementing a system where the power state of prefetch engines is dynamically adjusted based on queue occupancy, with high and low watermarks to reduce power consumption without affecting performance, by power-gating or adjusting clock frequencies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the prefetch engines operate at high power state continuously, then the packet supply to draw completion engine is ensured, but the overall power consumption increases
Solution Approach 1:
The patent applies dynamics by making the power state of prefetch engines adjustable rather than fixed. The system dynamically transitions prefetch engines between different power states (fully on, partially on, fully off) based on real-time queue occupancy levels, allowing the system to adapt power consumption to actual workload demands while maintaining reliable packet supply when needed
Solution Approach 2:
The patent implements feedback mechanisms through watermark monitoring. The system continuously monitors queue occupancy levels against high and low watermarks, and uses this feedback to control the power state of prefetch engines. When queue occupancy falls below the low watermark, the system activates prefetch engines; when it exceeds the high watermark, the system reduces their power state, creating a closed-loop control system that balances reliability and power consumption
2Use of energy by moving object
If the prefetch engines are power-gated to reduce power consumption, then the power consumption decreases, but the packet supply to draw completion engine may be interrupted
Solution Approach 1:
The patent applies preliminary action by maintaining a buffer of packets in the queue before power-gating the prefetch engines. The high watermark is set at a level that ensures sufficient packets are already in the queue to sustain the draw completion engine during periods when prefetch engines are powered down, preventing interruptions in packet supply
Solution Approach 2:
The patent uses the queue as an intermediary buffer between the prefetch engines and the draw completion engine. This intermediary structure decouples the two components, allowing the prefetch engines to be power-gated without directly impacting the draw completion engine, as long as the queue maintains sufficient packet occupancy above the low watermark
Data Source
AI summary
Systems, apparatuses, and methods for dynamically adjusting the power consumption of prefetch engines are disclosed. In one embodiment, a processor includes one or more prefetch engines, a draw completion engine, and a queue in between the one or more prefetch engines and the draw completion engine. If the number of packets stored in the queue is greater than a high watermark, then the processor reduces the power state of the prefetch engine(s). By decreasing the power state of the prefetch engine(s), power consumption is reduced. Additionally, this power consumption reduction is achieved without affecting performance, since the queue has a high occupancy and the draw completion engine can continue to read packets out of the queue. If the number of packets stored in the queue is less than a low watermark, then the processor increases the power state of the prefetch engine(s).