Retinal Eye Tracking via Selective Light Source Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Retinal imaging-based eye tracking systems face challenges with high power consumption and unwanted glare from non-retinal eye surfaces, such as the cornea and crystalline lens, which affect accuracy and efficiency.

Innovation Solution

The use of a subset of multiple light sources, selectively illuminated based on gaze direction and retinal mapping, to reduce glare and energy consumption, with specific sources disabled during static gaze conditions and all sources enabled for dynamic gaze tracking to cover the entire retinal field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If all light sources are enabled to illuminate the entire retina, then complete retinal coverage is achieved, but power consumption increases significantly

Engineering Contradiction:
Improveretinal coverage areaVSAvoidpower consumption
Core Design Contradiction:
Area of stationary objectVSUse of energy by moving object

Solution Approach 1:

The retina is divided into multiple regions, each illuminated by a dedicated light source. The system segments the retinal imaging task into multiple zones that can be independently illuminated, allowing selective activation of light sources based on the required field of view rather than illuminating the entire retina at all times.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses only the necessary subset of light sources required for the current imaging task rather than all available light sources. During static gaze conditions, a minimal subset suffices, while during saccades, additional light sources are activated temporarily to cover the expanded retinal area, then deactivated afterward.

Inventive Principle:
Principle #16Partial or excessive action

2Area of stationary object

If multiple light sources are used to cover different retinal regions, then comprehensive retinal imaging is achieved, but glare from non-retinal surfaces increases

Engineering Contradiction:
Improveretinal imaging coverageVSAvoidglare from cornea and lens
Core Design Contradiction:
Area of stationary objectVSObject-generated harmful factors

Solution Approach 1:

Different light sources are assigned to illuminate specific retinal regions, and their activation is segmented based on the current gaze direction and required retinal coverage. This spatial and temporal segmentation allows the system to activate only the light sources that will not cause glare for the current imaging task.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses feedback from gaze tracking and retinal image analysis to dynamically control light source activation. When glare is detected or anticipated based on current eye position and imaging parameters, the control system adjusts which light sources are active, turning off those that would cause harmful reflections.

Inventive Principle:
Principle #23Feedback

3Area of stationary object

If all light sources are activated during retinal imaging, then complete retinal field is captured, but image saturation occurs

Engineering Contradiction:
Improveretinal field coverageVSAvoidimage saturation
Core Design Contradiction:
Area of stationary objectVSIllumination intensity

Solution Approach 1:

The retinal imaging field is segmented into multiple regions, each with its own light source. This allows the system to illuminate only the specific retinal region currently being imaged rather than all regions simultaneously, distributing the illumination load and preventing overall image saturation while maintaining complete retinal field coverage over time.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Light sources are activated in a periodic or sequential manner rather than continuously simultaneously. During saccadic movements, light sources are activated temporarily to capture the changing retinal field, then deactivated. This periodic activation pattern allows complete retinal coverage to be achieved over time without any single frame being overexposed.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances gaze tracking by reducing glare, image saturation, and energy consumption while maintaining accurate gaze detection, allowing for efficient retinal imaging-based eye tracking.

Implementation Method 1

an illumination source to direct light towards the retina

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

an image sensor to generate images including light reflected from the retina

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS12073018B2Multiple gaze dependent illumination sources for retinal eye tracking
Publication Date: 2024.08.27 APPLE INC
  • US12073018B2 patent drawing
  • US12073018B2 patent drawing
  • US12073018B2 patent drawing

AI summary

Various implementations disclosed herein include devices, systems, and methods that provide retinal imaging-based gaze tracking In some implementations, a user's gaze is tracked based on a retinal imaging technique that selectively uses a subset of multiple light sources (222, 310, 610) that illuminate different portions of the user's retina (352). In some implementations, a method (700) includes selecting (710) a subset of light sources, where the subset of the light sources includes less than all of the light sources. In some implementations, one or more portions of a retina (352) are illuminated (720) by producing light using the subset of the light sources. In some implementations, sensor data is received (730) at a sensor (224, 340, 814), the sensor data corresponding to the light detected during retinal imaging, and an eye characteristic is determined (740) based on the sensor data.