Eye-Tracked Object Selection in Wearables Without Gestural Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for object selection in wearable devices, such as smart glasses, often rely on disruptive forms of user interaction like gestural or audible inputs, leading to inaccuracies and discomfort.
Innovation Solution
Utilizing eye gaze tracking to isolate a specific pixel area on a display corresponding to the user's gaze, allowing for accurate object identification and selection without disruptive input methods.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If gestural or audible input methods are used for object selection in wearable devices, then user interaction can be achieved, but accuracy and comfort deteriorate due to disruptive nature of these input methods
Solution Approach 1:
The patent replaces mechanical gestural input methods with optical eye tracking to detect user gaze direction. The eye tracking system captures images of the user's eyes and calculates gaze position to identify selected objects, eliminating the need for disruptive hand gestures while improving selection accuracy and comfort
Solution Approach 2:
The patent introduces an intermediary eye tracking system that mediates between the user and the object selection process. By tracking eye gaze as an intermediate signal, the system translates subtle eye movements into accurate object selection without requiring direct disruptive gestures or audible commands
2Measurement precision
If eye tracking is used to identify objects in the ambient environment, then object selection accuracy is improved, but device complexity increases due to multiple sensors and processing requirements
Solution Approach 1:
The patent makes the camera system multi-functional by using it for both capturing ambient environment images and tracking eye gaze. This single camera serves dual purposes, reducing the need for separate dedicated eye tracking sensors and thereby limiting the increase in device complexity while maintaining high gaze detection accuracy
3Speed
If the wearable device continuously captures images and processes gaze data, then object selection responsiveness is improved, but energy consumption increases
Solution Approach 1:
The patent implements periodic image capture and gaze data processing instead of continuous operation. The system captures images at intervals sufficient to maintain responsive object selection while allowing energy consumption to be reduced during non-critical periods, achieving a balance between response speed and energy efficiency
Data Source
AI summary
A wearable computing device includes a frame, a camera mounted on the frame so as to capture images of an environment outside of the wearable computing device, a display device mounted on the frame so as to display the images captured by the camera, and at least one eye gaze tracking device mounted on the frame so as to track a gaze directed at the images displayed by the display device. In response to the detection of a fixation of the gaze on the display of images, the system may identify a pixel area corresponding to a fixation point of the fixation gaze on the display of images. The system may identify an object in the ambient environment corresponding to the identified pixel area, and set the identified object as a selected object for user interaction.