Head-Mounted Display Eye-Gesture Control for Virtual Content

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing virtual and augmented reality systems lack efficient and natural methods for user interaction, particularly in translating subtle eye inputs such as gaze direction, eyelid motions, and other eye gestures into commands for content interaction.

Innovation Solution

A head-mounted display system equipped with inward-facing cameras to detect eye states, including closure and vergence, and processing electronics to alter virtual content presentation based on these inputs, enabling intuitive interaction through gaze and eye gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional information input tools (mouse, keyboard, handheld controllers) are used, then user interaction is achieved, but the interaction lacks naturalness and requires discrete dedicated input tools

Engineering Contradiction:

Improvenaturalness of interactionVSAvoidneed for discrete input tools

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system uses the user's own eyes as the input device, eliminating the need for separate controllers. The eyes naturally perform the input function by simply gazing or blinking, making the user's body serve as the input tool itself

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces mechanical input devices (mouse, keyboard, controller) with an optical detection system that captures eye movements and gestures through cameras and sensors, substituting physical mechanical interaction with optical field-based detection

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If eye metrics are used for content interaction, then natural and efficient control is achieved, but the detection of subtle eye inputs becomes more complex

Engineering Contradiction:

Improveefficiency of content interactionVSAvoiddetection of eye gestures

Core Design Contradiction:

ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The inward-facing cameras serve multiple functions: they capture eye metrics for interaction control, track gaze direction for content navigation, and detect eye closure states for system responses, making a single component perform multiple detection tasks

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses software processing electronics as an intermediary to translate complex raw eye movement data into simplified interaction commands, mediating between the subtle physical eye gestures and the discrete digital control signals

Inventive Principle:

Principle #24Intermediary (Mediator)

3Ease of operation

If the system responds to eye closure, then intuitive interaction is achieved, but the system must distinguish between intentional gestures and natural blinking

Engineering Contradiction:

Improveintuitiveness of interactionVSAvoiddistinguishing gesture from blink

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The system dynamically adjusts its response based on the duration of eye closure by implementing different threshold values: shorter durations are interpreted as natural blinks while longer durations are interpreted as intentional interaction gestures, allowing the same sensor to differentiate meanings through temporal dynamics

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS12481160B2Content interaction driven by eye metrics

Publication Date: 2025.11.25 MAGIC LEAP INC

AI summary

A head mounted display system for displaying image content to a user comprises at least one display configured to be worn by a user to present virtual content to first and second eyes of a user, one or more inwardly facing sensors or camera configured to monitor one or both of the users eye and processing electronics. This head mounted display system is configured such that virtual content activity can be initiated and/or driven from eye inputs such as gaze direction, eyelid motions (e.g., blinking), and/or other eye gestures.