Wearable Optical Sightline Tracking with Peripheral Eye Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional eye sensor systems struggle to accurately track a user's gaze in dynamic environments, such as augmented reality, due to changing relative frames of reference, and lack portability and flexibility in positioning cameras relative to the user's eyes.
Innovation Solution
A wearable device with integrated illuminators and imaging arrays positioned peripherally around the eyes measures a three-dimensional origin point and computes angular coordinates to track the user's sightline, allowing for accurate positioning of virtual objects and biometric verification in dynamic environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional eye sensor systems use fixed cameras mounted on or adjacent to displays, then the system structure is simple and easy to manufacture, but the system cannot accurately track gaze in dynamic environments with changing relative frames of reference
Solution Approach 1:
The patent transitions from fixed cameras to movable/wearable cameras that can dynamically adjust their position and orientation relative to the user's eyes. The wearable device allows the camera to move with the user's head and maintain proper alignment, enabling accurate gaze tracking in dynamic environments where the relative frame of reference changes continuously.
Solution Approach 2:
The patent introduces an intermediary processing system that captures images from multiple cameras positioned at different locations, computes three-dimensional eye positions and gaze directions through coordinate transformations, and integrates data from multiple sources. This intermediary computational layer reconciles the complex multi-camera setup with accurate gaze measurement.
2Measurement precision
If cameras are placed very close to the eye for retinal scanning, then biometric identification accuracy is improved, but the device becomes less portable and more intrusive
Solution Approach 1:
The patent divides the biometric sensing function into multiple segments: multiple cameras are positioned at different locations around the user's eyes rather than requiring a single camera extremely close to the eye. This segmentation allows each camera to capture specific eye features from its own perspective, and the system integrates these segmented views to achieve accurate biometric identification while maintaining portability.
Solution Approach 2:
The patent transitions from two-dimensional image capture to three-dimensional gaze and eye position tracking by using multiple cameras positioned at different spatial locations. By adding the third dimension (depth) through stereoscopic imaging and coordinate transformations, the system achieves accurate biometric identification without requiring cameras to be placed extremely close to the eye surface.
3Ease of operation
If cameras are positioned farther from the eyes for gaze monitoring applications, then user comfort and portability are improved, but measurement precision for detecting subtle pupil responses decreases
Solution Approach 1:
The patent merges multiple camera views into a unified three-dimensional model of the user's eyes and gaze direction. By combining images from multiple cameras positioned at comfortable distances, the system achieves both user comfort and accurate pupil response detection through integrated processing and coordinate transformations that reconstruct eye geometry from the merged perspectives.
Solution Approach 2:
The patent replaces the mechanical constraint of placing cameras close to the eye with a computational approach. Instead of relying on physical proximity for measurement accuracy, the system uses image processing algorithms, coordinate transformations, and three-dimensional reconstruction to achieve accurate pupil response detection from cameras positioned at comfortable distances.
4Adaptability or versatility
If conventional systems use fixed camera positions relative to displays, then device complexity is reduced, but adaptability to changing environments and user movements is lost
Solution Approach 1:
The patent implements a dynamic tracking system where cameras are mounted on wearable devices that move with the user's head. The system continuously adjusts camera positions and orientations to maintain proper alignment with the user's eyes during natural head movements, providing adaptability to dynamic environments while managing complexity through real-time coordinate transformations.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The wearable device provides accurate sightline tracking and biometric verification, enabling enhanced augmented reality experiences and biometric identification by computing a three-dimensional origin point and angular measurements, even in changing environments.
Implementation Method 1
a first illuminator integrated with the wearable structure at a first temporal side of a first eye of the user to project illumination across a first cornea of the first eye
Implementation Method 2
a first imaging array integrated with the wearable structure at the first temporal side to generate first imagery of the first eye
Data Source
AI summary
Techniques are described for optical sightline tracking in a wearable system. Embodiments include a wearable structure that includes at least one integrated illuminator and at least one integrated imaging array. Each illuminator and imaging array is disposed in the periphery of an eye of a user wearing the structure. From the peripheral viewpoint, embodiments measure a three-dimensional origin point of one or both eyes and can compute angular coordinate measurements for one or both eyes based on the imaging to indicate the direction in which the user's eyes are looking (a sightline). Embodiments can track changes in the sightline to support various applications, such as positioning of display of virtual objects in virtual or augmented reality environments. Some embodiments can also use the obtained imagery for biometric verification and/or identification, detection of changes in pupillary response, etc.