Eye Gaze Text Input Selection via Sensor Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional electronic devices rely on cumbersome input mechanisms like keyboards and touch-screens for text input, which are not efficient or natural, especially in virtual, augmented, and mixed reality environments.

Innovation Solution

The system allows users to select a text input field using eye gaze by determining the gaze location with sensors and displaying text characters accordingly, enabling interaction through gaze direction and depth, with optional speech-to-text or touch-sensitive input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional input mechanisms (keyboards, touch-screens) are used for text input, then text input functionality is provided, but the interface becomes cumbersome and inefficient

Engineering Contradiction:
Improvetext input efficiencyVSAvoidinput mechanism convenience
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent replaces mechanical input mechanisms (keyboards, touch-screens) with an optical-based eye gaze tracking system. Gaze sensors detect eye movements and determine gaze locations to select text input fields and trigger text input, eliminating the need for physical interaction with traditional input devices.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If eye gaze is used to select text input field, then selection accuracy is improved, but system complexity increases due to gaze sensors

Engineering Contradiction:
Improvegaze location accuracyVSAvoidsystem structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces gaze sensors as intermediary devices that mediate between the user's eye movements and the computer system. These sensors capture eye gaze characteristics and convert them into actionable input signals, enabling natural interaction without requiring direct physical contact with the device.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If traditional input methods are used, then device compatibility is maintained, but user interaction becomes less natural

Engineering Contradiction:
Improveinterface adaptabilityVSAvoidinteraction naturalness
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent makes the interface adaptable by enabling multiple input modalities. The system can operate with eye gaze alone, or combine eye gaze with traditional input methods (keyboard, touch-sensitive surface, speech-to-text), allowing it to function across different device types and user needs while providing a more natural interaction experience.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method provides a more natural and efficient interface for text input, enhancing user interaction in various reality technologies by allowing selection and input through gaze alone, reducing the need for traditional input methods.

Implementation Method 1

determining, using the one or more gaze sensors, one or more characteristics of an eye gaze; determining, using the one or more characteristics of the eye gaze, a gaze location

Methodology Applied
Scientific EffectEye gaze detection:

Data Source

PatentUS11314396B2Selecting a text input field using eye gaze
Publication Date: 2022.04.26 APPLE INC
  • US11314396B2 patent drawing
  • US11314396B2 patent drawing
  • US11314396B2 patent drawing

AI summary

In an exemplary process for selecting a text input field using an eye gaze, a graphical object including the text input field is displayed. The text input field is associated with one or more respective locations on one or more displays. Characteristics of an eye gaze are determined using gaze sensors, and a gaze location is determined using the characteristics. Input is received from an input device corresponding to one or more text characters. If the gaze location corresponds to the one or more respective locations, then the one or more text characters are displayed in the text input field. If the gaze location does not correspond to the one or more respective locations, then the one or more text characters are not displayed in the text input field.