Eye Tracking Combiner With Multiple Perspectives

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current eye-tracking systems in near-eye display systems face challenges in accurately tracking eye movements with high precision and robustness, especially when dealing with extreme changes in viewing direction and variations in facial features, while also being cost-effective and power-efficient.

Innovation Solution

The implementation of an eye-tracking system that includes one or more light sources for illuminating the user's eye and a substrate with two or more light deflectors to direct reflected light at different angles, forming multiple images of the eye within a single image frame, using combinations of reflective optics such as Fresnel lenses, mirrors, and gratings to enhance tracking accuracy and reduce power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are used to track eye movements from different perspectives, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improveeye tracking accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple light deflectors (first light deflector and second light deflector) into a single substrate, allowing multiple images of the eye to be captured by one camera. This merging approach achieves the measurement precision of multiple cameras while reducing device complexity by consolidating components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a dimensional transformation by using light deflectors to capture eye images from multiple perspectives (different angles) and projecting them onto a two-dimensional image sensor. This allows a single camera to effectively capture data that would traditionally require multiple cameras positioned at different locations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple cameras are deployed to capture eye images, then measurement precision improves, but power consumption increases

Engineering Contradiction:
Improveeye tracking accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent merges the functionality of multiple cameras into a single camera system by using light deflectors to redirect light paths. This consolidation maintains measurement precision while significantly reducing power consumption by eliminating the need for multiple camera sensors and processing units.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If multiple cameras are used to track extreme eye movements, then reliability improves, but device complexity increases

Engineering Contradiction:
Improvetracking robustnessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses light deflectors to capture eye images from multiple angular perspectives, transforming spatial information into a format that can be captured by a single camera. This provides robust tracking for extreme eye movements while avoiding the complexity of multiple camera systems.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Device complexity

If a single camera is used without light deflectors, then device complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improvesystem simplicityVSAvoideye tracking accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces light deflectors as intermediary optical elements between the eye and the camera. These deflectors act as mediators that redirect light from multiple eye perspectives to the single camera sensor, thereby maintaining measurement precision while keeping the device simple.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables more accurate and robust eye tracking with reduced power consumption, allowing for precise determination of gaze direction and eye position, even under varying conditions, without the need for multiple cameras, thus improving user interaction in augmented and virtual reality applications.

Implementation Method 1

direct light reflected by the user's eye to the camera at different angles

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

Fresnel lenses with reflective coating, Fresnel mirrors, tilted concave or flat mirrors

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 3

one or more light sources configured to emit light invisible to a user's eye for illuminating the user's eye

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Data Source

PatentUS10852817B1Eye tracking combiner having multiple perspectives
Publication Date: 2020.12.01 META PLATFORMS TECHNOLOGIES LLC
  • US10852817B1 patent drawing
  • US10852817B1 patent drawing
  • US10852817B1 patent drawing

AI summary

Techniques for eye-tracking in a near-eye display system are disclosed. One example of a near-eye display system includes a waveguide-based display substrate transparent to visible light and configured to be placed in front of a user's eye. The waveguide-based display substrate includes a first light deflector configured to direct a first portion of invisible light reflected by the user's eye to a camera to form a first image of the user's eye in a first area of an image frame, and a second light deflector configured to direct a second portion of the invisible light reflected by the user's eye to the camera to form a second image of the user's eye in a second area of the image frame.