Eye Gesture Tracking Using Phase-Based Depth Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current eye gesture tracking technologies are limited in their ability to provide accurate and dynamic gaze information for controlling human-machine interaction and enhancing viewing experiences, particularly in virtual reality and augmented reality applications, due to constraints in detection regions and the need for complex computational algorithms for 3D rendering.

Innovation Solution

The method involves obtaining an electrical signal from a photodetector measuring optical signals reflected from the eye, generating a depth map based on phase differences, and using this information to determine gaze data, which is then used to control tunable optical elements for real-time focusing and refocusing, enabling nausea-free and enhanced 3D viewing experiences across various platforms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complex computational algorithms are used for 3D rendering and gaze tracking, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvegaze information accuracyVSAvoidcomputational algorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex computational algorithms with simple optical tuning mechanisms. By using tunable optical elements that physically adjust light paths based on eye gesture detection, the system achieves accurate 3D rendering and gaze tracking without relying on heavy computational processing, thus reducing device complexity while maintaining measurement precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes optical parameters in real-time by tuning optical elements according to detected eye gestures. Instead of using complex algorithms to calculate 3D rendering parameters, the system directly adjusts optical properties (focal length, light path) based on detected gaze direction, simplifying the overall system while improving response accuracy

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the detection region is extended to cover more eye gestures, then adaptability is improved, but device complexity increases

Engineering Contradiction:
Improveeye gesture detection rangeVSAvoiddetection system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal optical detection system that can identify multiple types of eye gestures (gaze direction, blinking, eye movements) using a single integrated approach. The system uses tunable optical elements that can be adjusted to detect various gesture types without requiring separate specialized sensors or complex detection algorithms for each gesture type, thereby extending adaptability while controlling device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If real-time optical element tuning is implemented, then productivity is improved, but use of energy increases

Engineering Contradiction:
Improvereal-time focusing speedVSAvoidenergy for optical tuning
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system implements periodic or event-driven optical tuning rather than continuous adjustment. The tunable optical elements are adjusted in real-time only when eye gestures are detected, rather than continuously tuning throughout operation. This periodic action maintains high productivity for actual viewing tasks while significantly reducing energy consumption during idle periods or between gesture detections

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for cross-platform peripheral control, extended operation regions, and nausea-free viewing experiences by dynamically adjusting light focus based on eye gestures, providing a natural 3D effect through simple tunable optics rather than complex algorithms.

Implementation Method 1

determining a depth map of the eye based on phase differences between an electrical signal generated by the photodetector and a reference signal

Methodology Applied
Scientific EffectPhase difference detection: Homodyne Detection

Implementation Method 2

Light can be directed towards an eye and reflected light may be observed. The reflected light can be processed to determine information pertaining to the eye

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

refocus tunable optical elements in real time to alter light incident on the eye

Methodology Applied
Scientific EffectOptical focusing: Focusing

Implementation Method 4

dynamically refocused optical elements, providing for example three-dimensional (3D) foveated imaging

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS12141351B2Eye gesture tracking
Publication Date: 2024.11.12 ARTILUX INC
  • US12141351B2 patent drawing
  • US12141351B2 patent drawing
  • US12141351B2 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for eye gesture recognition. In one aspect, a method includes obtaining an electrical signal that represents a measurement, by a photodetector, of an optical signal reflected from an eye and determining a depth map of the eye based on phase differences between the electrical signal generated by the photodetector and a reference signal. Further, the method includes determining gaze information that represents a gaze of the eye based on the depth map and providing output data representing the gaze information.