Staggered Binocular Eye Tracking for VR Input Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with computing devices, particularly in virtual and augmented reality environments, are inadequate as they often require physical touch or the use of accessories like keyboards and mice, which can be cumbersome when wearing head-mounted displays.
Innovation Solution
A high-speed staggered binocular eye tracking system that tracks the user's gaze to provide quicker and more accurate input by identifying areas of interest on a display without the need for physical interaction, using a method where one eye camera captures images of the user's eye at different intervals to enhance processing speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If traditional eye tracking methods are used in virtual reality environments, then basic gaze detection is achieved, but interaction speed and precision are insufficient for immersive experiences
Solution Approach 1:
The patent divides the eye tracking task into separate temporal segments using staggered sampling. Instead of simultaneously capturing both eyes at the same moment, the system alternates between capturing the left and right eyes in rapid succession, allowing each eye to be tracked at higher speed while maintaining binocular gaze precision through computational integration of the sequential data
Solution Approach 2:
The system performs preliminary calibration of the eye tracking system before actual use, establishing baseline measurements and transformation matrices that enable rapid gaze estimation during operation. This preliminary setup allows the staggered sampling method to achieve high-speed tracking without sacrificing precision during the actual interaction phase
2Ease of operation
If physical input devices like keyboards and mice are used with head mounted displays, then precise input control is achieved, but ease of operation deteriorates due to the cumbersome nature of accessories
Solution Approach 1:
The patent replaces mechanical input devices (keyboards, mice, touchscreens) with an optical-based eye tracking system. By using cameras to capture eye movements and translating these into cursor control and selection actions, the system eliminates the need for physical accessories while maintaining input precision through high-resolution gaze detection and mapping algorithms
3Speed
If simultaneous binocular eye tracking is implemented, then accurate gaze direction is achieved, but processing speed decreases due to the complexity of processing both eyes at the same time
Solution Approach 1:
The system implements periodic alternating sampling of the left and right eyes rather than continuous simultaneous capture. Each eye is sampled in periodic intervals, creating a staggered sequence of measurements that reduces computational load and increases processing speed while maintaining accurate gaze information through temporal interpolation and fusion of the periodic measurements
Data Source
Figure 1
Figure 2
Figure 3~4A
AI summary
A method, an electronic device and a non-transitory computer readable medium for are provided. The method includes capturing a first eye and a second eye. The method also includes identifying a first position of the first eye and a second position the second eye. Additionally, the method includes staggering the capture of the first eye and the second eye, wherein the first eye is captured prior to capturing the second eye. The method also includes identifying the first gaze direction with respect to a display. The method further includes mapping the second gaze direction of the second eye based on the identified first gaze direction, prior to capturing the second eye.