Eye Tracking Control for Computing Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current eye tracking technologies lack efficient methods for users to control computing devices using eye movements, limiting intuitive interaction with objects and applications on screens.

Innovation Solution

A system that utilizes a front-facing camera and infrared LEDs to capture and analyze eye movements, determining the point of regard on a display, allowing users to interact with objects and applications through gaze-based control, combined with input modalities like touch sensors or biometric signals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If eye tracking is implemented using traditional methods, then eye movement detection is achieved, but interaction control efficiency is insufficient

Engineering Contradiction:
Improveinteraction control efficiencyVSAvoidintuitive interaction
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system continuously tracks eye movements and provides real-time feedback by highlighting or selecting objects based on gaze position. This feedback loop enables efficient control by allowing users to navigate and select items through natural eye movements combined with occasional confirmation inputs, significantly improving interaction control efficiency and intuitiveness

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces traditional mechanical input devices (mouse, keyboard) with a gaze-based control system. By substituting physical mechanical interactions with eye movement detection and processing, the system achieves more intuitive and efficient control, particularly beneficial for users with motor impairments or those seeking more natural interaction

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If gaze-based control is added to existing input methods, then interaction options increase, but device complexity increases

Engineering Contradiction:
Improveinteraction optionsVSAvoidsystem structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system integrates multiple input modalities (eye tracking, touch, biometric signals) into a single unified control framework. This multi-functional approach allows the same system to serve multiple purposes: gaze-based navigation, touch input, and biometric authentication, increasing adaptability without proportionally increasing complexity through shared hardware and software resources

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines eye tracking technology with existing input methods (touch sensors, biometric signals) into an integrated control system. By merging these technologies rather than operating them separately, the system achieves versatile interaction options while managing complexity through unified processing and shared infrastructure

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If continuous eye tracking is performed, then gaze accuracy is maintained, but power consumption increases

Engineering Contradiction:
Improvegaze accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

Instead of continuous tracking, the system employs periodic eye movement detection at key interaction moments (when objects need selection or confirmation is required). This periodic approach maintains sufficient gaze accuracy for control purposes while dramatically reducing power consumption compared to continuous high-frequency tracking

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system applies eye tracking at the minimum necessary frequency and duration to achieve accurate gaze-based control. By using partial action (tracking only when needed rather than continuously), the system maintains measurement precision for interaction control while optimizing power consumption

Inventive Principle:
Principle #16Partial or excessive action

4Ease of operation

If eye tracking system is integrated into computing device, then control functionality is enhanced, but manufacturing complexity increases

Engineering Contradiction:
Improvecontrol functionalityVSAvoidintegration complexity
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The system uses existing multi-functional components (front-facing cameras, infrared LEDs) that serve both eye tracking and other device functions. This approach enhances control functionality while avoiding increased manufacturing complexity by leveraging already-integrated components rather than adding dedicated specialized hardware

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to control computing devices by directing gaze at objects on the screen, enhancing intuitive interaction and reducing the need for traditional input methods, while optimizing power consumption and accommodating head pose variance.

Implementation Method 1

a front-facing camera and infrared LEDs to capture and analyze eye movements

Methodology Applied
Scientific EffectLight Emitting Diode: Light Emitting Diode

Implementation Method 2

capture eye movements, determining the point of regard on a display

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS10459520B2Systems and methods of eye tracking control
Publication Date: 2019.10.29 META PLATFORMS TECHNOLOGIES LLC
  • US10459520B2 patent drawing
  • US10459520B2 patent drawing
  • US10459520B2 patent drawing

AI summary

Methods and systems to facilitate eye tracking control are provided. A user input is received at a computing device. Point of regard information associated with a user of the computing device is determined while the user input is being received. The point of regard information indicates a location on a display of the computing device at which the user is looking. An operation associated with a display object identified based on the point of regard information is performed when receipt of the user input is determined to have terminated.