Eye Tracking Camera Alignment via Infrared Pupil Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In portable electronic devices like smartphones and tablets, there is a discrepancy between the imaging direction and angle of view of the camera and the user's line of sight and viewing angle, leading to a mismatch between the captured image and the actual view of the user.
Innovation Solution
Irradiating infrared light towards the user's pupils to detect the reflected light position with a first camera, tracking the line of sight, and calculating the viewing angle, which allows the second camera to align its imaging direction and angle of view with the user's, ensuring the captured image coincides with the actual view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the camera is fixed in a standard position, then the device structure is simple, but the imaging direction and angle of view cannot coincide with the user's line of sight and viewing angle
Solution Approach 1:
The system uses an infrared camera to detect the user's pupil position and line of sight, then feeds back this information to adjust the imaging direction and angle of view of the main camera, creating a closed-loop control system that continuously aligns the camera view with the user's natural view
Solution Approach 2:
The patent introduces an infrared camera and pupil detection algorithm as intermediary components between the user's eyes and the main camera. This intermediary system translates the user's line of sight into camera control signals, enabling indirect control of imaging parameters through eye tracking
2Reliability
If the camera imaging direction is fixed, then the control system is simple, but the captured image does not match the user's actual view
Solution Approach 1:
The system enables the camera to automatically adjust its imaging parameters based on the user's natural eye movements. The user simply needs to look at the desired scene, and the system autonomously adjusts the camera to match the user's view without requiring manual operation
3Measurement precision
If infrared light irradiation is added to detect pupil position, then line of sight tracking accuracy is improved, but energy consumption and device complexity increase
Solution Approach 1:
The infrared light source operates periodically rather than continuously, activating only when eye tracking is needed. This periodic operation reduces energy consumption while maintaining detection accuracy during critical moments
Solution Approach 2:
The system extracts only the essential infrared illumination function needed for pupil detection, separating it from continuous lighting functions. This allows the infrared source to be activated selectively only when eye tracking is required, minimizing energy waste
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method enables the captured image to accurately represent the user's view, allowing for continuous alignment and improved user experience by synchronizing the camera's imaging direction and angle of view with the user's line of sight and viewing angle.
Implementation Method 1
a position of infrared light reflected from the pupils of the eyes of the user may be detected by a first camera to track a line of sight of the user
Data Source
AI summary
In a system and a method of controlling an imaging direction and an angle of view of a camera according to an aspect of the present disclosure, infrared light may be irradiated toward pupils of eyes of a user, and a position of infrared light reflected from the pupils of the eyes of the user may be detected by a first camera to track a line of sight of the user and calculate a viewing angle of the user. In addition, an imaging direction of a second camera may coincide with the line of sight of the user and an angle of view of the second camera may coincide with the viewing angle of the user to allow an image actually viewed by the user and an image captured by the camera to coincide with each other.