Autostereoscopic Eye Tracking With Sensor Fusion for Low Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autostereoscopic display systems suffer from high latency due to eye tracker delays, impairing user performance and experience, particularly in handheld devices with intense movements.
Innovation Solution
A method using a tracking system with a camera-based tracking system for positional data and a secondary system for speed and/or acceleration data, combined via sensor fusion to reduce latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a camera-based eye tracking system is used to capture eye position, then measurement precision is improved, but latency increases
Solution Approach 1:
The patent segments the eye tracking system into two independent parts: a camera-based system for precise positional measurement and an IMU-based system for low-latency motion detection. Each system handles specific aspects of the tracking task, with the camera providing accuracy and the IMU providing speed with minimal delay.
Solution Approach 2:
The patent merges the output of two different tracking systems through sensor fusion. The camera-based positional data and IMU-based velocity data are combined to produce final eye position estimates that achieve both high precision and low latency, resolving the contradiction between these two requirements.
2Measurement precision
If only positional data is collected from the tracking camera, then measurement precision is maintained, but the system cannot compensate for motion blur and intensity variations
Solution Approach 1:
The IMU system acts as an intermediary that provides additional motion information between the camera and the final tracking result. The IMU data serves as a mediator that helps disambiguate camera measurements affected by motion blur and intensity variations, improving reliability without sacrificing precision.
3Device complexity
If a single tracking system is used, then device complexity is reduced, but latency cannot be optimized for both precision and speed
Solution Approach 1:
The patent divides the tracking functionality into separate modules: a camera-based module for precise positioning and an IMU-based module for low-latency motion tracking. This segmentation allows each module to be optimized for its specific function, with the IMU handling speed and the camera handling position, thereby reducing overall latency despite increased complexity.
Data Source
AI summary
The invention relates to a method for tracking a facial characteristic of a viewer of an autostereoscopic display device. the method comprising obtaining first sequential data on the position of the facial characteristic relative to the autostereoscopic display device: and comprising second sequential data on the speed and/or acceleration of the facial characteristic relative to the autostereoscopic display device. The first sequential data are obtained at a first latency and the second sequential data are obtained at a second latency that is lower than the first latency. As a final step. sensor fusion is performed to combine the first sequential data and the second sequential data to generate final sequential data on the position of the facial characteristic relative to the autostereoscopic display device. In this way. the final sequential data are available at a final latency that is lower than the first latency. A viewer of an autostereoscopic display device can so be presented with an improved stereoscopic image and/or have an improved virtual reality experience, when he moves and rotates his head relative to the autostereoscopic display device.