Portable Eye Tracker with Multi-Camera Gaze Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing portable eye tracking systems suffer from performance degradation due to movement relative to the wearer's head, strong light sources, and obstruction issues, such as eyelashes, leading to inaccurate gaze direction detection, especially at the extremities of the user's field of view.

Innovation Solution

A portable eye tracker device integrated into an eyeglass frame with optics holding members containing illuminators and image sensors, coupled with a control unit that selectively illuminates and captures images of the user's eyes, determining gaze direction based on image data, and dynamically adjusts settings to compensate for ambient light and movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single-camera portable eye tracking system is used, then the device complexity is reduced, but the measurement precision degrades under certain conditions including strong light sources, direct sunlight, and when the view is obstructed

Engineering Contradiction:
Improvedevice complexityVSAvoidgaze direction detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system divides the optical path into multiple independent channels by using multiple cameras positioned at different locations on the eyeglass frame. Each camera captures images from its specific viewpoint, allowing the system to process multiple perspectives simultaneously and maintain accuracy under varied lighting conditions and obstructions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single-camera two-dimensional imaging approach to a multi-camera three-dimensional imaging arrangement. By positioning cameras at different spatial locations and orientations, the system gains depth information and multiple viewing angles, enabling robust gaze detection even when individual camera views are obstructed or compromised by ambient light.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If portable eye tracking equipment is made wearable on the user's face, then the adaptability is improved, but the reliability degrades when the equipment moves relative to the wearer's head

Engineering Contradiction:
ImprovewearabilityVSAvoidgaze detection accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system incorporates dynamic calibration and tracking mechanisms that continuously adapt to movements of the eyeglass frame relative to the user's face. The multiple cameras work together to detect eye position and gaze direction in real-time, compensating for shifts in positioning through active adjustment of the tracking algorithm rather than requiring rigid fixed positioning.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from multiple cameras to continuously monitor and adjust the gaze detection parameters. By comparing images from different camera viewpoints, the system can detect movements of the eyeglass frame and compensate accordingly, maintaining accurate gaze detection despite changes in the relative position between the device and the user's eyes.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the illuminator intensity is increased to compensate for ambient light, then the measurement precision is improved, but the use of energy increases

Engineering Contradiction:
Improveeye image capture qualityVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

Instead of continuous illumination, the system uses periodic or pulsed illumination where the illuminator is activated only during specific capture cycles. The control unit coordinates the illumination timing with the camera exposure timing, providing sufficient light for accurate eye image capture while minimizing overall energy consumption through intermittent rather than continuous operation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts the illuminator intensity and duration parameters based on ambient light conditions detected by the cameras. In low-light environments, the illuminator operates at higher intensity for longer durations, while in bright conditions it operates at lower intensity or for shorter periods, optimizing the balance between image quality and energy consumption through adaptive parameter modification.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution provides accurate and reliable gaze direction detection, even in varying light conditions and with head movement, by using multiple image sensors and illuminators, and adaptive light control, enhancing the accuracy and robustness of the eye tracking system.

Implementation Method 1

at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user

Methodology Applied
Scientific EffectLight emission: Light

Implementation Method 2

The infrared light is directed towards the pupil of a user and the reflection of the light is captured by an image sensor

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

the reflection of the light is captured by an image sensor. Through analysis of the reflection point, the direction of the user's gaze may be calculated

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS10686972B2Gaze assisted field of view control
Publication Date: 2020.06.16 TOBII TECH AB
  • US10686972B2 patent drawing
  • US10686972B2 patent drawing
  • US10686972B2 patent drawing

AI summary

A method for rotating a field of view represented by a displayed image is disclosed. The method may include displaying a first image representing a first field of view. The method may also include determining a gaze direction of a user toward the first image. The method may further include identifying a subject in the first image at which the gaze direction is directed, wherein the subject is in a first direction from a center of the first image. The method may further include receiving a directional input in a second direction. The method may additionally include, based at least in part on the second direction being substantially the same as the first direction, displaying a second image representing a second field of view, wherein the subject is centered in the second image.