Eye-Tracked HMD Interaction Using Gaze, Blink, and Vergence
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual and augmented reality systems lack efficient and natural methods for user interaction, particularly in translating subtle eye inputs such as gaze direction, eyelid motions, and other eye gestures into commands for modifying virtual content presentation.
Innovation Solution
A head-mounted display system equipped with inward-facing cameras and processing electronics that detect eye closure and vergence to alter the presentation of virtual content, including changes in color, position, and audio characteristics based on eye states, allowing for intuitive interaction without dedicated input tools.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional input tools (mouse, keyboard, controller) are used for virtual reality interaction, then user input can be reliably detected, but the interaction is not natural and requires dedicated hardware devices
Solution Approach 1:
The system uses the user's own eye movements and gaze direction as the input mechanism, eliminating the need for external input devices. The eyes themselves serve as the input tool by naturally directing attention to virtual objects, and the system automatically detects and responds to these eye movements through camera-based tracking.
Solution Approach 2:
The patent replaces mechanical input devices (mouse, keyboard, controller) with an optical detection system. Instead of requiring physical manipulation of input tools, the system uses cameras to capture eye movements and gaze direction, converting biological signals into digital input commands for virtual reality interaction.
2Ease of operation
If eye metrics are used for content interaction, then interaction becomes more natural and intuitive, but detecting and measuring eye inputs becomes more difficult
Solution Approach 1:
The system introduces camera-based imaging as an intermediary between the user's eye movements and the virtual reality system. The cameras capture images of the user's eyes and gaze direction, serving as a mediator that translates subtle biological eye movements into measurable digital signals that can be processed to control virtual content interaction.
3Device complexity
If passive detection of eye inputs is implemented, then dedicated input tools are eliminated, but the system requires sophisticated sensor technology and processing
Solution Approach 1:
The system continuously monitors eye movements and gaze direction through camera input, processes this information to determine user intent, and provides real-time feedback by adjusting virtual content presentation accordingly. This closed-loop feedback enables the system to adapt dynamically to user attention and interaction needs without requiring manual input commands.
Data Source
AI summary
A head mounted display system for displaying image content to a user comprises at least one display configured to be worn by a user to present virtual content to first and second eyes of a user, one or more inwardly facing sensors or camera configured to monitor one or both of the users eye and processing electronics. This head mounted display system is configured such that virtual content activity can be initiated and/or driven from eye inputs such as gaze direction, eyelid motions (e.g., blinking), and/or other eye gestures.