Foveated Display Power Saving via Gaze Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Dynamic foveation techniques in electronic displays can cause display artifacts such as low luminance levels, intermittent switching, and flashing due to sudden movement of the foveated areas, which negatively affect the user experience.

Innovation Solution

The implementation of a foveation system that adjusts the size and position of high brightness areas on an electronic display based on eye tracking data, while also using compensation techniques to mitigate display artifacts caused by gaze movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If dynamic foveation is implemented to reduce power consumption, then energy efficiency is improved, but display artifacts such as flashing and luminance instability occur

Engineering Contradiction:
Improvepower consumptionVSAvoiddisplay stability
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The system performs preliminary actions by predicting future gaze positions based on current eye tracking data and motion vectors. This allows the foveated regions to be pre-positioned in the next frame to match where the user's gaze will be, preventing sudden luminance changes and flashing artifacts while maintaining power savings from dynamic foveation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously receives feedback from the eye tracking system about actual gaze position and compares it with predicted positions. This feedback loop allows the system to adjust and refine gaze predictions, ensuring accurate foveated region positioning that prevents display artifacts while maintaining energy efficiency.

Inventive Principle:
Principle #23Feedback

2Use of energy by stationary object

If eye tracking data is used to dynamically adjust foveated regions, then power saving is improved, but temporal flashing and luminance artifacts become visible

Engineering Contradiction:
Improvedisplay powerVSAvoiddisplay artifacts
Core Design Contradiction:
Use of energy by stationary objectVSObject-affected harmful factors

Solution Approach 1:

Motion vectors serve as an intermediary between the current and predicted gaze positions. The system uses these motion vectors to smoothly interpolate and predict where foveated regions should be positioned in future frames, creating a transitional buffer that prevents sudden luminance changes and visible flashing artifacts.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system calculates predicted gaze positions in advance before rendering the next frame. This preliminary positioning of foveated regions ensures that when the frame is displayed, the high brightness areas are already in the correct locations, preventing temporal flashing and luminance artifacts that would occur with reactive adjustments.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12300139B1Foveated driving for power saving
Publication Date: 2025.05.13 APPLE INC
  • US12300139B1 patent drawing
  • US12300139B1 patent drawing
  • US12300139B1 patent drawing

AI summary

In an embodiment, an electronic display includes an active area including a plurality of pixels arranged in columns and a plurality of source drivers driving image data to columns of pixels. The electronic display also includes a first plurality of switches selectively coupling respective source drivers of the plurality of source drivers to one or more columns. Selective coupling enables the respective source drivers to, at different times, drive the image data to: a single column; and multiple columns. In another embodiment, an electronic display includes a display panel configured to operate using a reference voltage received via a resistive path having a routing resistance, a reference voltage source outputting the reference voltage, and a feedback circuit sensing an electrical parameter of the resistive path and producing a compensation voltage that, when added to the reference voltage, causes the reference voltage to remain substantially constant at the display panel.