Gaze Point Calculation Using Panoramic Imaging and 3D Models
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing eye tracking technologies face challenges in accurately tracking eye gaze direction in 3D models due to the need for multiple infrared devices and cameras, resulting in high equipment costs and low accuracy.
Innovation Solution
A gaze point calculation method that determines a 3D model of a scene, obtains a panoramic image, and calculates the spatial location and gaze direction of a face within the image to accurately determine the eye gaze target, using a single photographing device and reducing the need for multiple devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple infrared devices and cameras are used to track eye gaze, then the coverage and detection capability are improved, but the equipment cost increases
Solution Approach 1:
The patent combines multiple functions (panoramic image capture, face detection, gaze direction calculation, and 3D scene understanding) into a single photographing device and processing system. This integration eliminates the need for multiple separate infrared devices and cameras while maintaining comprehensive eye gaze tracking capability through unified data processing pipelines.
Solution Approach 2:
The photographing device is designed to perform multiple functions: capturing panoramic images, detecting faces, determining gaze directions, and working with 3D scene models. This multi-functional approach replaces the need for specialized infrared devices, reducing overall system complexity while maintaining tracking accuracy.
2Measurement precision
If multiple infrared devices and cameras are used to track eye gaze, then the detection coverage is improved, but the equipment cost increases
Solution Approach 1:
The patent combines multiple functions (panoramic image capture, face detection, gaze direction calculation, and 3D scene understanding) into a single photographing device and processing system. This integration eliminates the need for multiple separate infrared devices and cameras while maintaining comprehensive eye gaze tracking capability through unified data processing pipelines.
3Device complexity
If traditional eye tracking methods are used, then the equipment setup is simple, but the accuracy of tracking eye gaze in 3D model is low
Solution Approach 1:
The patent introduces 3D scene models and spatial reasoning capabilities to enhance 2D image data from the photographing device. By integrating depth information, angular coordinates, and 3D object models, the system achieves accurate eye gaze tracking in three-dimensional space while maintaining relatively simple equipment configuration.
Solution Approach 2:
The patent uses 3D scene models and intermediate calculation steps (angular coordinates, radial distances, gaze direction vectors) as mediators between the 2D image data and the final 3D eye gaze target. These intermediaries enable accurate 3D tracking without requiring complex multi-device hardware setups.
Data Source
AI summary
The embodiments of the present disclosure provide a gaze point calculation method, apparatus and device. The method includes: determining a 3D model of a first scene; obtaining a first panoramic image captured in the first scene, the first panoramic image includes a face image of a face; determining a spatial location of the face according to the first panoramic image; determining a gaze direction corresponding to the face according to the first panoramic image; and determining an eye gaze target according to the 3D model, the spatial location and the gaze direction. The accuracy of tracking the eye gaze in 3D model is improved.