Gaze-Based Window Adjustments for Display Resource Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Simultaneous use of multiple applications on computing devices often leads to conflicts, inefficiencies, and security issues due to conflicting hardware resource usage and manual switching complexities, particularly in videoconferencing scenarios where high refresh rates, audio interference, and privacy concerns arise.
Innovation Solution
Implementing a gaze-tracking system that uses a gaze tracking device and AI model to identify the user's focus on different windows, automatically adjusting display, audio, and privacy settings by blurring video and muting audio for windows outside the user's gaze region, thereby optimizing resource usage and enhancing security.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple applications are used simultaneously, then application functionality is improved, but hardware resource conflicts and system efficiency deteriorate
Solution Approach 1:
The system dynamically adjusts hardware resource allocation based on real-time gaze detection. When the user looks at a particular application window, the system automatically allocates more resources (higher refresh rate, audio output) to that application, and reduces resources for other applications. This dynamic adaptation allows multiple applications to run simultaneously while optimizing resource usage based on actual user attention.
2Ease of operation
If manual window switching is implemented, then application control is improved, but user error and complexity increase
Solution Approach 1:
The system automatically detects user attention through gaze tracking and autonomously manages window switching and resource allocation without requiring manual user input. The gaze detection system identifies which application the user is looking at, and the system automatically adjusts settings and switches focus accordingly, eliminating manual switching operations and reducing user error.
3Illumination intensity
If high refresh rate is maintained for all windows, then display quality is improved, but power consumption increases
Solution Approach 1:
The system applies different display quality settings to different windows based on user gaze detection. When the user looks at a specific window, that window receives high refresh rate and optimal display quality, while other windows operate at lower refresh rates or are blurred. This localized quality adjustment maintains display quality for the active application while reducing overall power consumption.
4Adaptability or versatility
If audio is output for all applications, then audio functionality is improved, but audio interference and privacy issues worsen
Solution Approach 1:
The system uses gaze detection as feedback to dynamically control audio output. When the user looks at a particular application window, the system detects this through the gaze tracking system and automatically routes audio output to that application while muting or reducing audio for other applications. This feedback-based control prevents audio interference between applications and maintains privacy by ensuring audio is only output for the application the user is actively viewing.
Data Source
AI summary
In one example in accordance with the disclosure, a computing device is described. An example computing device includes a gaze tracking device. An example gaze tracking device identifies, from a captured image, a gaze region for a user viewing a display device coupled to the example computing device. The gaze region indicates a location on the display device where the user is looking. The example computing device includes a controller. An example controller determines a first window on the display device that is aligned with the gaze region and based on a determination that the first window is aligned with the gaze region, adjusts a video setting of a second window that is outside the gaze region.