XR UI Activation Using Gaze-Input Distance Thresholds

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems struggle to accurately interpret user inputs in extended reality environments, particularly when gaze location and input location do not coincide, leading to unintended interactions with user interface elements.

Innovation Solution

A method that activates user interface elements based on both user input location and gaze location, distinguishing between intentional and inadvertent interactions by using a threshold distance criterion to determine the intended target.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the system activates user interface elements based solely on input location, then the operation is simple and fast, but unintended interactions occur when gaze and input locations do not coincide

Engineering Contradiction:
Improveaccuracy of user input interpretationVSAvoidcomplexity of input interpretation system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces gaze location as an intermediary factor between user input and UI element activation. The system uses both input location and gaze location to determine the intended target, with gaze serving as a mediator that helps distinguish intentional from inadvertent interactions. This resolves the contradiction by adding a layer of interpretation that improves reliability without excessive complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameters used for input interpretation from solely input location to a combination of input location and gaze location. By introducing gaze location as an additional parameter and using threshold distance comparisons, the system achieves more accurate interpretation of user intent while maintaining manageable system complexity through defined comparison criteria.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If the system requires gaze and input location to coincide for activation, then unintended interactions are reduced, but legitimate interactions may be missed when users naturally look away from the input device

Engineering Contradiction:
Improveaccuracy of user input interpretationVSAvoidconvenience of user interaction
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent applies different levels of gaze requirement to different scenarios. When input location is within the threshold distance of gaze location, activation occurs (local match). When input location is beyond the threshold, activation still occurs but with different behavior (remote match). This local differentiation resolves the contradiction by allowing flexibility in gaze requirements based on the specific interaction context.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent adds the dimension of threshold distance comparison between gaze and input locations. Instead of requiring exact coincidence (zero-dimensional match), the system uses a threshold-based approach that creates a zone of acceptable deviation. This dimensional change allows users to interact naturally while maintaining reliable intent detection.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If the system uses threshold distance comparison to determine intent, then accurate distinction between intentional and inadvertent interactions is achieved, but processing complexity increases

Engineering Contradiction:
Improveprecision in determining intended targetVSAvoidcomplexity of gaze and input comparison system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses threshold distance comparison as a simple parameter-based solution to determine whether gaze and input locations coincide. By defining a clear threshold parameter and comparing distances against it, the system achieves precise intent determination without complex algorithms. The threshold acts as a simple yet effective criterion for distinguishing intentional from inadvertent interactions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260016891A1Methods and Systems for Changing a Display Based on User Input and Gaze
Publication Date: 2026.01.15 APPLE INC
  • US20260016891A1 patent drawing
  • US20260016891A1 patent drawing
  • US20260016891A1 patent drawing

AI summary

In one implementation, a method of activating a user interface element is performed at a device including an input device, a display, one or more processors, and non-transitory memory. The method includes displaying, on the display, a plurality of user interface elements and receiving, via the input device, a user input including a gesture, the gesture having a first phase and a second phase separated by an amount of time. The method includes, in response to receiving the user input, determining whether to activate a first user interface element in a first mode based on a determination that the amount of time is within a threshold amount of time. The method includes, based on a determination to activate the first user interface element in the first mode, displaying the content in the first content pane by updating the first content pane.