Resonant MEMS Eye-Tracking for VR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional eye-tracking technologies are bulky, expensive, power-hungry, and limited in resolution, making them unsuitable for mobile and wearable applications, particularly in Virtual and Augmented Reality (VR/AR) due to high power consumption and computational expense, and they struggle with seamless human-computer interaction in mobile and wearable contexts.

Innovation Solution

The use of a microelectromechanical system (MEMS) operating at a resonant frequency to steer a beam of light onto the corneal surface and detect the reflected light, facilitating eye-tracking with a MEMS scanner module and photodiode system that is compact, low-cost, and efficient, enabling precise and seamless interaction with smart devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If video-based image processing systems are used for eye tracking, then eye tracking functionality is achieved, but the systems become bulky, expensive, power-hungry, and slow

Engineering Contradiction:
Improveeye tracking precisionVSAvoidsystem size
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces video-based image processing systems with a light-based optical system. A light source emits light that reflects off the cornea, and photodetectors detect the reflected light to determine eye position. This mechanical-to-optical substitution eliminates the need for cameras and complex image processing, resulting in a compact, low-power system that achieves high measurement precision without the bulk and computational expense of video-based approaches.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If video-based image processing systems are used for eye tracking, then eye tracking functionality is achieved, but power consumption exceeds 150 mW

Engineering Contradiction:
Improveeye tracking precisionVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent replaces power-intensive video-based image processing with a passive optical detection system. The light source emits light that passively reflects off the cornea, and photodetectors detect the reflection without requiring active illumination or complex processing. This eliminates the need for high-power cameras and image processing algorithms, reducing power consumption to well below 150 mW while maintaining eye tracking precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If camera-based eye tracking systems are used, then eye tracking is achieved, but resolution is limited by pupil dilation and ringing effects

Engineering Contradiction:
Improvetracking resolutionVSAvoidpupil dilation and ringing effects
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent replaces camera-based systems that are susceptible to pupil dilation and ringing artifacts with an optical reflection-based system. By measuring the reflection of light off the cornea rather than imaging the pupil, the system avoids the harmful effects of pupil dynamics. The photodetectors detect subtle changes in reflected light position and intensity, achieving high tracking resolution without being affected by pupil dilation or ringing effects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach results in a compact, cost-effective, and power-efficient eye-tracking system that provides high-resolution, real-time velocity measurements of saccades, enabling on-the-fly prediction of fixations and enhancing user interaction in VR/AR environments without the need for head stabilization or high computational expense.

Implementation Method 1

systems, methods and structures according to the present disclosure operate the MEMS at a resonant frequency

Methodology Applied
Scientific EffectResonance: Resonance

Implementation Method 2

detecting the light reflected from the corneal surface

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS11379035B2System and method for resonant eye-tracking
Publication Date: 2022.07.05 GOOGLE LLC
  • US11379035B2 patent drawing
  • US11379035B2 patent drawing
  • US11379035B2 patent drawing

AI summary

Aspects of the present disclosure describe systems, methods, and structures that provide eye-tracking by 1) steering a beam of light through the effect of a microelectromechanical system (MEMS) operating at a resonant frequency onto a corneal surface; and 2) detecting the light reflected from the corneal surface.