3D Frustum Display for Eye-Tracking Window Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face challenges in managing multiple software application windows on limited computer displays, as they frequently minimize, toggle, and rearrange windows to view desired content, leading to inefficiencies in usability and space utilization.

Innovation Solution

A method and system that utilize eye-tracking techniques and 3D display technology to collect optical tracking information, determine viewing scores, and generate frustums with regions to prioritize frequently viewed areas, optimizing window management by adjusting display angles based on viewing scores to enhance usability and space utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multiple software application windows are displayed on a limited computer display, then more content is accessible, but the display space for each window is reduced and window management becomes more complex

Engineering Contradiction:
Improvenumber of windowsVSAvoiddisplay space per window
Core Design Contradiction:
Quantity of substanceVSArea of stationary object

Solution Approach 1:

The patent transitions from traditional 2D window management to 3D frustum-based display, where windows are arranged in three-dimensional space with depth, height, and width dimensions. This allows multiple windows to be positioned at different depths and angles, effectively increasing the available display space while maintaining accessibility to all windows simultaneously.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system dynamically adjusts window positions, sizes, and frustum parameters based on real-time eye-tracking data. As users move their gaze, the display automatically reconfigures window arrangements and frustum orientations to prioritize frequently viewed areas, creating an adaptive window management system that responds to user behavior patterns.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If users manually minimize, toggle, and rearrange windows to view desired content, then access to specific content is achieved, but time and operational effort are wasted

Engineering Contradiction:
Improvecontent accessibilityVSAvoidwindow management time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs automatic window management without requiring user intervention. Eye-tracking data is continuously collected and processed to determine viewing scores, and the system autonomously adjusts frustum parameters and window arrangements based on these scores, eliminating the need for manual minimize, toggle, or rearrange operations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements a closed-loop feedback mechanism where eye-tracking information continuously monitors user gaze patterns, viewing scores are calculated in real-time, and the display configuration is automatically adjusted based on this feedback. This creates an adaptive system that learns from and responds to user viewing behavior, prioritizing frequently accessed content without user effort.

Inventive Principle:
Principle #23Feedback

3Area of stationary object

If traditional 2D display arrangements are used, then simple display structure is maintained, but space utilization and user focus optimization are limited

Engineering Contradiction:
Improvedisplay space utilizationVSAvoiddisplay structure
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent introduces 3D frustums with depth, height, and width parameters into the display system, allowing windows to be positioned and sized in three-dimensional space. This dimensional expansion enables more efficient space utilization by arranging windows at different depths and angles, maximizing the use of available display real estate while maintaining clear visual hierarchy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10362302B2Managing a display
Publication Date: 2019.07.23 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10362302B2 patent drawing
  • US10362302B2 patent drawing
  • US10362302B2 patent drawing

AI summary

A system and computer implemented method for managing a display for a software application is disclosed. The software application may have a set of portions. The method can include collecting, for a first portion and a second portion of the set of portions, optical tracking information including a set of viewing coordinates having a temporal feature. The method can also include determining, based on the optical tracking information including the set of viewing coordinates having the temporal feature, a set of viewing scores including a first group of viewing scores and a second group of viewing scores. The method can also include generating a frustum having a set of regions. The set of regions can include a first region, to provide the first portion, based on the first group of viewing scores, and a second region, to provide the second portion, based on the second group of viewing scores.