Eye Tracking via Alternating Camera Sampling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR, AR, and MR technologies face challenges in providing a comfortable and natural-feeling presentation of virtual image elements amidst real-world imagery, due to complexities in human visual perception and the need for accurate depth cues.
Innovation Solution
An eye tracking system that includes two cameras, one for each eye, capturing visual data at different sampling rates and processing electronics to estimate visual data for one eye during sampling times when the other eye's data is not captured, allowing for determination of eye movement and adjustment of virtual content presentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If visual data is captured simultaneously for both eyes at the same sampling time, then synchronization accuracy is improved, but device complexity and data processing load increase
Solution Approach 1:
The patent divides the sampling process into alternating segments where one camera captures data at odd sampling times and the other camera captures data at even sampling times. This segmentation allows each camera to operate independently at full resolution without requiring simultaneous capture coordination, reducing overall system complexity while maintaining synchronization through temporal alternation.
Solution Approach 2:
The system implements periodic alternating sampling where cameras switch capture roles in a regular cycle. This periodic action pattern enables the system to achieve synchronized eye tracking data without requiring complex simultaneous capture mechanisms, as the periodic alternation naturally coordinates the sampling timing between the two cameras.
2Measurement precision
If sampling rate is increased to improve eye movement tracking precision, then measurement precision is improved, but loss of energy increases
Solution Approach 1:
The patent segments the sampling task between two cameras operating at different times. Each camera captures data at a lower individual sampling rate (e.g., 30Hz) but the combined alternating sampling achieves the desired effective rate (e.g., 60Hz) without requiring both cameras to operate at high rates simultaneously, thereby reducing total energy consumption while maintaining tracking precision.
Solution Approach 2:
The system uses partial sampling by capturing only one eye's data at each sampling instant rather than both eyes simultaneously. This partial action approach reduces the immediate energy demand on each camera while the alternating pattern compensates to provide sufficient combined sampling rate for accurate eye movement tracking.
Data Source
AI summary
An eye tracking system can include a first camera configured to capture a first plurality of visual data of a right eye at a first sampling rate. The system can include a second camera configured to capture a second plurality of visual data of a left eye at a second sampling rate. The second plurality of visual data can be captured during different sampling times than the first plurality of visual data. The system can estimate, based on at least some visual data of the first and second plurality of visual data, visual data of at least one of the right or left eye at a sampling time during which visual data of an eye for which the visual data is being estimated are not being captured. Eye movements of the eye based on at least some of the estimated visual data and at least some visual data of the first or second plurality of visual data can be determined.