Gaze Angle Determination Using Facial Heatmap Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gaze tracking technologies are inconvenient and costly due to the need for additional hardware and precise pupil positioning, and are limited by their inability to accurately determine gaze angles at varying facial orientations and distances, making them unsuitable for general use in factories and shopping malls.
Innovation Solution
A determination apparatus and method that uses an image capturing device and processor to analyze facial triaxial positioning values and landmark points, generate a heatmap, and perform facial correction to determine gaze angles without requiring additional hardware, allowing for accurate gaze angle determination at various facial angles and distances.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If conventional gaze tracking technology is used without additional hardware, then installation cost is reduced, but measurement precision deteriorates due to inability to accurately track pupil position
Solution Approach 1:
The patent replaces the mechanical/optical sensor-based pupil tracking system with a computer vision-based image processing system. The processor analyzes facial images to identify eye regions and track pupil movement through software algorithms, eliminating the need for specialized hardware sensors while maintaining gaze tracking functionality
Solution Approach 2:
The patent creates a virtual model of the user's face and eye features by processing images through the processor. This digital representation allows for accurate pupil position tracking and gaze angle calculation without requiring physical sensors to be placed on or near the user's eyes
2Measurement precision
If precise pupil positioning is required for accurate gaze tracking, then measurement precision is improved, but device complexity increases due to additional sensors and positioning systems
Solution Approach 1:
The patent replaces complex mechanical positioning systems and specialized sensors with a software-based image processing approach. The processor uses computer vision algorithms to automatically locate and track pupil features in standard images, achieving precise positioning without additional hardware complexity
Solution Approach 2:
The patent makes the image capturing device serve multiple functions: it captures both the facial image for analysis and provides sufficient resolution for pupil tracking. The same camera system used for facial recognition is also used for gaze tracking, eliminating the need for separate specialized sensors
3Measurement precision
If the camera is installed close to the user for clear facial images, then measurement precision is improved, but ease of operation deteriorates due to complicated positioning process
Solution Approach 1:
The patent performs preliminary facial feature detection and positioning through the processor before gaze angle determination. The system automatically identifies facial landmarks, eye positions, and pupil locations in advance, eliminating the need for users to manually position themselves or undergo complex setup procedures
Solution Approach 2:
The patent enables the system to automatically adapt to different users and distances through image processing. The processor analyzes the captured image quality and automatically adjusts analysis parameters, making the system self-adapting without requiring user intervention for positioning or configuration
4Device complexity
If conventional technology only considers frontal face images, then device complexity is reduced, but adaptability deteriorates due to inability to handle skewing and rotating faces
Solution Approach 1:
The patent transforms the static frontal-face assumption into a dynamic system that can handle various facial orientations. The processor analyzes images regardless of the user's distance, angle, or facial orientation, automatically adapting the gaze angle calculation to match the actual captured image geometry
Solution Approach 2:
The patent changes the analysis parameters based on the captured image characteristics. The processor adjusts the coordinate system, reference points, and calculation methods according to the actual facial orientation and distance in the image, enabling accurate gaze tracking across diverse conditions without increasing hardware complexity
Data Source
AI summary
A determination apparatus and method for gaze angle are provided. The apparatus analyzes an image to generate a plurality of facial triaxial positioning values and a plurality of facial landmark points. The apparatus obtains a plurality of specific facial landmark points from the facial landmark points to generate a heatmap, and compares the heatmap with a standard heatmap to generate an image compensation value. The apparatus performs a facial correcting process based on the image and the image compensation value to generate a virtual corrected image. The apparatus analyzes the virtual corrected image to obtain a displacement of pupil. The apparatus determines a gaze angle of a user according to a determination model for gaze angle, the facial triaxial positioning values and the displacement of pupil.