Eye Gesture Navigation for Head-Mountable Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mountable devices (HMDs) lack intuitive navigation and selection methods for graphical displays, relying primarily on manual inputs which can be cumbersome and obstructive, especially in wearable computing applications where minimal obtrusiveness is desired.
Innovation Solution
Implementing a system that detects eye gestures using sensors to generate commands for navigating and selecting items within a graphical display, allowing users to interact with content using eye movements and gaze tracking, thereby reducing the need for manual inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual inputs are used for navigation and selection in HMDs, then device control functionality is achieved, but user convenience deteriorates and obtrusiveness increases
Solution Approach 1:
The patent replaces manual mechanical input devices (buttons, joysticks, touchscreens) with an optical detection system that tracks eye movements and gestures. Sensors detect eye position, gaze direction, and eye movements to generate navigation and selection commands, eliminating the need for physical manual inputs and improving ease of operation.
Solution Approach 2:
The system uses the user's natural eye movements and gestures as the input mechanism, allowing the eyes themselves to serve as the control interface. The eye tracking system detects and interprets natural eye behavior patterns (gaze fixation, saccades, blinks) to perform navigation and selection functions without requiring additional manual devices or actions.
2Ease of operation
If eye gesture detection is implemented, then ease of operation improves, but device complexity increases due to additional sensors and processing
Solution Approach 1:
The eye tracking system serves multiple functions: it detects gaze direction for navigation, identifies eye gestures for selection, and can potentially provide other input commands. This multi-functionality justifies the added complexity by consolidating multiple control functions into a single detection system rather than requiring separate mechanisms for each function.
Solution Approach 2:
The patent introduces an intermediary processing layer that translates raw sensor data from eye tracking into meaningful commands. The system processes eye position and movement data through algorithms that interpret gaze patterns and gesture sequences, acting as a mediator between the physical eye movements and the digital interface commands, thereby managing complexity through structured data transformation.
Data Source
AI summary
Systems and methods for navigation and selection with eye gestures in a graphical display are provided, in which a graphical display of content may be provided to a wearer of a head-mountable device. A first signal may be received from a first sensor configured to detect an eye gesture of a first eye of the wearer. A second signal may then be received from a second sensor configured to detect an eye gesture of a second eye of the wearer. The first signal may be associated to a first command to navigate through or select an item in the graphical display of content provided by the head-mountable device, and the second signal may be associated to a subsequent command, based at least in part on a given output of the first command, to navigate through or select another item in the graphical display of content.