3D Gaze Tracking via Stereo Camera Coordinate Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current line-of-sight tracking technologies for vehicle drivers are limited to two-dimensional environments, failing to accurately detect the direction of a driver's gaze in three-dimensional settings, which is crucial for real-time road image provision and safety applications.
Innovation Solution
A display system and method utilizing a line-of-sight tracking camera and stereo cameras to convert two-dimensional line-of-sight information into three-dimensional coordinates by applying pre-stored position and rotation information, enabling precise detection of a driver's line-of-sight in a 3D environment through equations that transform monocular eye points and vectors into stereo camera-based coordinates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If two-dimensional line-of-sight tracking is used, then the system complexity is reduced and ease of manufacture is improved, but measurement precision of the driver's gaze direction in three-dimensional space deteriorates
Solution Approach 1:
The patent transitions from two-dimensional line-of-sight tracking to three-dimensional gaze detection by introducing stereo camera pairs that capture depth information. The coordinate conversion process transforms 2D camera coordinates into 3D space coordinates, enabling accurate measurement of the driver's gaze direction in three-dimensional space while maintaining reasonable system complexity through mathematical transformations rather than complex hardware additions.
2Measurement precision
If stereo camera-based three-dimensional detection is implemented, then measurement precision of the driver's line-of-sight is improved, but device complexity and manufacturing difficulty increase
Solution Approach 1:
The patent employs parameter changes by establishing coordinate conversion relationships between different camera systems. Through predefined conversion formulas that account for camera positions, orientations, and optical parameters, the system transforms stereo camera measurements into accurate three-dimensional gaze coordinates, simplifying the manufacturing process while maintaining high measurement precision.
3Adaptability or versatility
If coordinate conversion between different camera systems is performed, then adaptability of the system to multiple camera configurations is improved, but calculation time and processing complexity increase
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing conversion parameters such as camera positions, orientations, and optical characteristics during system initialization. This allows the coordinate conversion process to use pre-defined formulas and lookup tables, significantly reducing real-time processing requirements while maintaining adaptability to different camera configurations.
Data Source
AI summary
A display system includes a line-of-sight tracking camera to detect an eyeball of a driver, first and second stereo cameras, a controlling unit, and a storing unit. The first and second stereo camera photographs a range corresponding to a field-of-view based on stereo camera-based line-of-sight information that is changed based on line-of-sight tracking camera-based line-of-sight information, and provide a photographed image. The controlling unit converts the line-of-sight tracking camera-based line-of-sight information into first and second stereo camera-based line-of-sight information based on pre-stored position and rotation information of the tracking camera and the first and second stereo cameras, and project the converted information onto the first and second stereo cameras, such that a three-dimensional line-of-sight coordinate is calculated. The storing unit stores information related to a system as well as the position and rotation information of the tracking camera and the first and second stereo cameras.