Eye Tracking Rendering Adjustment for Visual Stability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current user interface technologies, particularly those relying on gesture recognition, face challenges in providing seamless and adaptive rendering of graphical user interfaces based on eye tracking, especially in dynamic environments where disturbances like shaking or vibration occur, leading to a suboptimal user experience.
Innovation Solution
An apparatus comprising a computing device with a camera and processor that captures pupil location and eye movement to identify the visual focal point and type of eye movement, allowing for real-time adjustment of user interface parameters such as screen resolution, brightness, and contrast, ensuring invariant and stable rendering even in the presence of disturbances, by dynamically skewing and distributing these parameters based on the user's eye position and movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If real-time eye tracking and dynamic rendering adjustment are implemented, then user experience and visual stability are improved, but device complexity and computational resource usage increase
Solution Approach 1:
The system pre-establishes rendering parameter mappings between different eye positions and focal points. When eye tracking detects a saccade or fixation, the system can immediately apply the corresponding pre-computed rendering adjustments without real-time calculation delays, maintaining visual stability while reducing computational complexity.
Solution Approach 2:
The system creates multiple copies of the graphical user interface at different rendering parameters corresponding to various eye positions. During eye movement, the system switches between these pre-rendered copies rather than dynamically re-rendering, which maintains visual continuity and reduces real-time computational demands.
2Manufacturing precision
If rendering parameters are dynamically adjusted based on eye position, then visual quality at focal point is improved, but power consumption increases
Solution Approach 1:
The system applies high rendering precision only to the region around the detected focal point and eye position, while using lower rendering precision for peripheral regions. This localized quality adjustment maintains visual acuity where the user is looking while significantly reducing overall computational and power requirements.
Solution Approach 2:
The system applies full rendering adjustments only during critical eye movements (saccades and fixations) detected by the eye tracker, rather than continuously adjusting rendering parameters. This partial action approach maintains visual stability during eye movements while reducing power consumption during stable viewing periods.
3Ease of operation
If continuous eye tracking and rendering adjustment are performed, then user experience is improved, but resource usage and power consumption increase
Solution Approach 1:
The system performs eye tracking and rendering adjustments periodically based on detected eye movement events (saccades, fixations) rather than continuously. The eye tracker monitors eye position continuously but triggers rendering adjustments only at periodic events when eye movements occur, maintaining user experience while reducing overall power consumption.
Solution Approach 2:
The system uses the eye tracking data to automatically determine when rendering adjustments are needed without requiring user input or external control. The eye movement detection itself triggers the rendering parameter changes, making the system self-regulating and reducing unnecessary processing that would consume additional power.
Data Source
AI summary
An apparatus having a computing device and a user interface—such as a user interface having a display that can provide a graphical user interface (GUI). The apparatus also includes a camera, and a processor in the computing device. The camera can be connected to the computing device and/or the user interface, and the camera can be configured to capture pupil location and/or eye movement of a user. The processor can be configured to: identify a visual focal point of the user relative to the user interface based on the captured pupil location, and/or identify a type of eye movement of the user (such as a saccade) based on the captured eye movement. The processor can also be configured to control parameters of the user interface based at least partially on the identified visual focal point and/or the identified type of eye movement.