Peripheral Luminance Remapping for Power Saving
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Foveation systems in electronic displays face issues when eye tracking is unavailable or fails, leading to reduced image quality and viewing comfort due to fixed high brightness areas that do not adjust according to the user's focal point.
Innovation Solution
Implementing power-saving techniques that adjust luminance and color levels dynamically across the display based on image content and user gaze, even without continuous eye tracking input, using image processing circuitry to counteract artifacts and ensure smooth transitions between foveated areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If dynamic foveation is implemented with eye tracking, then power consumption is reduced and image quality is improved, but the system becomes complex and unreliable when eye tracking fails
Solution Approach 1:
The patent implements dynamic foveation by continuously adjusting the foveated area position and size based on real-time eye tracking data, allowing the display to adapt luminance levels dynamically rather than using fixed patterns. This resolves the contradiction by making the system responsive to actual user gaze while providing fallback mechanisms when tracking fails
Solution Approach 2:
The system uses eye tracking feedback to continuously update the foveation parameters, creating a closed-loop control system. When eye tracking is unavailable, the system transitions to using content-based saliency detection as alternative feedback, ensuring continuous operation without complete failure and maintaining reliability while preserving power-saving benefits
2Device complexity
If the high brightness area is fixed in location, then the system is simple to implement, but image quality and viewing comfort deteriorate when eye tracking is unavailable
Solution Approach 1:
The patent segments the display into multiple luminance zones (foveated area with high brightness and peripheral areas with lower brightness) that can be independently controlled. This allows the system to maintain simple fixed patterns when needed while enabling complex dynamic adjustments when eye tracking is available, resolving the contradiction between simplicity and image quality
Solution Approach 2:
The system dynamically changes key parameters including the position, size, and luminance level of the foveated area based on eye tracking data and content characteristics. This enables the display to adapt to different viewing conditions and maintain high image quality without requiring complete system redesign, balancing complexity and performance
3Use of energy by moving object
If peripheral luminance is reduced for power saving, then energy consumption decreases, but temporal flashing artifacts may occur during gaze transitions
Solution Approach 1:
The patent implements smooth transitions between different foveation states by controlling the timing and rate of luminance changes. Rather than abrupt switches, the system uses gradual transitions that follow natural eye movement patterns, reducing temporal artifacts while maintaining power-saving benefits throughout the periodic updating of foveation parameters
Solution Approach 2:
The system prepares for potential gaze transitions by implementing smooth fade-in/fade-out transitions and anticipatory adjustments to peripheral luminance levels. This cushioning approach prevents abrupt changes that would cause temporal flashing artifacts, ensuring smooth visual experience while maintaining energy efficiency
Data Source
AI summary
In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.