Eye Tracking Control System Without Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for user communication through eye tracking lack flexibility and accessibility, particularly for individuals with paralysis or temporary communication impairments, as they often require calibration, specific lighting conditions, and visual interfaces.

Innovation Solution

A computerized system that uses a camera to track eye movements and physiological signals, employing machine learning techniques to classify gestures into commands, allowing users to navigate and select menu items without a screen, and operate computers or devices through eye movements, blinks, and respiratory patterns, with optional audio or visual feedback, and adaptable to various lighting conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If eye-tracking systems use traditional calibration and visual interface methods, then measurement precision is improved, but ease of operation and accessibility are worsened

Engineering Contradiction:
Improveeye position detection accuracyVSAvoidsystem setup and usage simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically performs calibration by capturing eye images and determining pupil positions without requiring user interaction with visual targets or manual calibration procedures. The camera mounted on the head-mounted device continuously captures eye movements and the processor automatically processes this data to establish baseline eye position information, enabling the system to self-calibrate and eliminate the need for traditional calibration routines.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system replaces traditional visual interface-based eye tracking with a mechanical camera-based approach. Instead of requiring users to follow visual targets on a screen for calibration, the system uses a camera to capture eye images and a processor to analyze pupil positions, substituting the visual-mechanical interaction with an automated image processing system that works independently of display devices.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If eye-tracking systems require specific lighting conditions, then measurement precision is improved, but adaptability to different environments is worsened

Engineering Contradiction:
Improveeye image capture qualityVSAvoidlighting condition flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system is designed to function across multiple lighting conditions without requiring specific environmental constraints. The camera captures eye images in various lighting scenarios (bright, dim, varying light directions) and the processor is configured to determine pupil positions from these images regardless of lighting conditions, making the system universally applicable in different environments without sacrificing measurement precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If the system uses screen-based visual interfaces for communication, then information feedback is improved, but accessibility for individuals with visual impairments is worsened

Engineering Contradiction:
Improveuser feedback and communication clarityVSAvoidaccessibility to visually impaired users
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The system introduces an intermediary audio feedback mechanism that translates eye movement data into audible information. Instead of relying on screen-based visual feedback, the system provides communication options and status information through audio output, allowing users with visual impairments to receive the same information feedback through a different sensory modality while maintaining the core eye-tracking control mechanism.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables individuals with paralysis or communication impairments to communicate effectively and independently, without the need for calibration or specific lighting, by translating eye movements and physiological signals into actionable commands, facilitating interaction with computers and devices.

Implementation Method 1

a camera configured for continuously capturing images of one or both of a user's eye and eyelid and generating image data representative thereof

Methodology Applied
Scientific EffectImage capture: Photography

Data Source

PatentUS11612342B2Eye-tracking communication methods and systems
Publication Date: 2023.03.28 EYEFREE ASSISTING COMM LTD
  • US11612342B2 patent drawing
  • US11612342B2 patent drawing
  • US11612342B2 patent drawing

AI summary

Provided is a control system that interfaces with an individual through tracking the eyes and/or tracking other physiological signals generated by an individual. The system, is configured to classify the captured eye images into gestures, that emulate a joystick-like control of the computer. These gestures permit the user to operate, for instance a computer or a system with menu items.