Extended Reality Interface Eye Tracking Input Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for presenting system user interfaces in extended reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, often requiring excessive inputs and leading to errors, particularly in battery-operated devices where energy efficiency is a concern.

Innovation Solution

The implementation of a computer system that communicates with a display generation component and an input device, which receives user inputs to invoke operations and applies modifications to the display, presenting a system user interface with optimized user interface objects to reduce the number and nature of user inputs, enhance feedback, and conserve power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional methods are used to present system user interfaces in extended reality environments, then the interface can be displayed, but the process becomes cumbersome and creates significant cognitive burden on users

Engineering Contradiction:
Improveease of interface interactionVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically detects user intent through eye tracking and gaze analysis, allowing the interface to adapt and respond without requiring explicit user commands. The interface serves itself by interpreting visual attention patterns to determine which operations the user wants to perform, reducing cognitive burden and interaction complexity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces traditional mechanical input methods (buttons, switches, touch inputs) with optical detection methods using eye tracking cameras and gaze analysis. This substitution eliminates the need for physical interaction mechanisms, creating a more natural and less cumbersome interface experience

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If detailed feedback is provided to distinguish system user interface content from application content, then user understanding improves, but the system consumes more energy and takes longer to process

Engineering Contradiction:
Improveinformation feedback sufficiencyVSAvoidsystem energy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system provides feedback selectively based on detected user intent rather than continuously. By using eye tracking to determine when and what feedback is needed, the system avoids unnecessary processing and energy consumption while still providing sufficient information to distinguish system UI from application content

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system uses real-time eye tracking data as feedback to dynamically adjust the level and type of information presented to the user. This feedback loop allows the interface to provide only the necessary feedback to maintain user understanding without excessive energy consumption

Inventive Principle:
Principle #23Feedback

3Reliability

If the system waits for explicit user input before responding, then accuracy improves, but the interaction time increases and battery life decreases

Engineering Contradiction:
Improveinput accuracyVSAvoidinteraction time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of eye gaze patterns and visual attention to predict user intent before explicit input is given. By pre-processing visual data and detecting intent signals in advance, the system can respond more quickly while maintaining accuracy through the predictive nature of eye tracking analysis

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240404216A1Devices and methods for presenting system user interfaces in an extended reality environment
Publication Date: 2024.12.05 APPLE INC
  • US20240404216A1 patent drawing
  • US20240404216A1 patent drawing
  • US20240404216A1 patent drawing

AI summary

In accordance with some embodiments, a method for presenting a system user interface in an extended reality environment is described.