Dynamic Window Layout Adjustment via Eye Gaze Obstruction Scoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Computing devices often display overlapping application windows, which obstruct key content and require users to manually reposition them, wasting processing resources and user time, as current technologies lack the means to prevent this overlap.

Innovation Solution

A computer-implemented method that determines application window details, detects objects using object recognition, tracks user gaze to identify focused objects, generates obstruction scores, and adjusts the layout of overlapping windows to improve visibility of focused content, thereby preventing manual repositioning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple application windows are displayed simultaneously, then information availability is improved, but window overlap occurs obscuring key content

Engineering Contradiction:
Improvecontent visibilityVSAvoidwindow layout management
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system automatically detects and resolves window overlap issues without user intervention. The computing device autonomously monitors window positions, identifies obstructions to focused content, and repositions windows automatically, eliminating the need for manual window management by the user.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses eye-tracking data and application focus information as feedback to dynamically adjust window layouts. By continuously monitoring where the user is looking and which application is active, the system adapts window positions in real-time to ensure focused content remains visible.

Inventive Principle:
Principle #23Feedback

2Loss of information

If user manually repositions overlapped windows, then content visibility is improved, but computing resources and user time are wasted

Engineering Contradiction:
Improvecontent visibilityVSAvoiduser time and processing resources
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system proactively prevents window overlap before it occurs by predicting potential obstructions based on application focus and eye-tracking data. Windows are repositioned in advance to avoid covering focused content, eliminating the need for reactive manual intervention.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The automatic window management system handles layout adjustments without user involvement, saving both user time and computing resources by eliminating the manual repositioning cycle.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If picture-in-picture mode is used, then multitasking capability is improved, but key content may be obscured by small moveable windows

Engineering Contradiction:
Improvemultitasking capabilityVSAvoidsports scores visibility
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system uses eye-tracking feedback to determine when the user is attempting to view content in a picture-in-picture window. When focused content in the PiP window is detected to be obscured, the system automatically adjusts the PiP window position or size to maintain visibility.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The picture-in-picture window characteristics (position, size) are made dynamic rather than static. The system continuously adjusts PiP window parameters based on real-time eye-tracking data and application focus information to optimize content visibility while maintaining multitasking functionality.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11163433B2Displaying content without obscuring key details on a computer screen
Publication Date: 2021.11.02 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11163433B2 patent drawing
  • US11163433B2 patent drawing
  • US11163433B2 patent drawing

AI summary

A method, system and computer program product for displaying content without obscuring key details on a computer screen. After the computing system detects the display of overlapping application windows, objects in the application windows are detected using an object recognition service. A determination is then made as to which of these detected objects correspond to objects that are being focused by the user, will be focused by the user and/or have been focused by the user based on the tracking of the eye gaze of the user and/or prior recorded patterns of activity. A score may then be generated for each of these focused objects indicating a level of obstruction using the location of the focused objects, the location of overlays and/or prior recorded patterns of activity. An optimal layout of the overlapped application windows is determined in response to the score for the focused object(s) exceeding a threshold value.