Gaze-Based Interface Object Placement with Input Confirmation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional electronic devices rely on input mechanisms like keyboards and touch-screens for user interaction, which can be inefficient and unnatural, and existing gaze-based interfaces struggle with precision and stability in selecting and positioning objects.

Innovation Solution

Utilizing eye gaze and gestures for interaction, allowing users to select and manipulate objects through gaze direction and depth determination, combined with confirming actions to enhance precision and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional input mechanisms (keyboards, touch-screens) are used for user interaction, then device operation is reliable and precise, but the interaction becomes inefficient and unnatural

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidnaturalness of interaction
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent replaces mechanical input mechanisms (keyboards, touch-screens) with a gaze-based interface that uses eye tracking technology. The system detects gaze direction and depth through optical sensors and algorithms, substituting physical interaction with visual attention-based control. This allows users to interact with devices through natural eye movements rather than mechanical inputs, improving both efficiency and naturalness of interaction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If gaze-based interface is used for selecting objects, then interaction becomes more natural, but precision and stability in selecting objects deteriorates

Engineering Contradiction:
Improvenaturalness of interactionVSAvoidprecision in selecting objects
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary mechanism between gaze detection and object selection. Instead of directly selecting objects based on raw gaze data, the system uses gaze to indicate interest or intent, then requires a secondary confirmation action (such as a blink, head movement, or hand gesture) to finalize the selection. This intermediary step filters out accidental selections and improves precision while maintaining the naturalness of the initial gaze-based interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system provides visual feedback to indicate when an object is currently selected or highlighted by gaze. This feedback loop allows users to monitor their gaze-based selections in real-time and make corrections if needed, thereby improving precision. The feedback mechanism includes highlighting target objects, displaying selection indicators, and providing auditory or haptic confirmation when selections are finalized.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If gaze depth determination is implemented for 3D environments, then object manipulation precision improves, but system complexity increases

Engineering Contradiction:
Improveobject manipulation precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extends the gaze-based interface from 2D screen coordinates to 3D spatial coordinates by incorporating gaze depth determination. The system uses stereoscopic vision, focus accommodation, or time-of-flight measurements to estimate the depth of the user's gaze, enabling precise selection and manipulation of objects in three-dimensional virtual or augmented reality environments. This adds a depth dimension to the interaction model, improving manipulation precision while managing complexity through specialized algorithms for depth estimation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12405759B2Gaze-based user interactions
Publication Date: 2025.09.02 APPLE INC
  • US12405759B2 patent drawing
  • US12405759B2 patent drawing
  • US12405759B2 patent drawing

AI summary

In an exemplary process for interacting with user interface objects using an eye gaze, a placement point for a selected object is designated at a first position based on a gaze position. In response to a user input, the placement point is moved to a second position that is not based on the gaze position, and the object is placed at the second position.