Eye Window Frame Reference for Viewed Point Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera systems face challenges in accurately estimating the viewed point, particularly when the user shifts their head relative to the viewfinder, leading to reduced precision due to translational motion and oblique look-through states, which are exacerbated by factors like wearing glasses or using VR glasses.
Innovation Solution
An electronic device captures an eye image through an eye window frame, using a processor to estimate the viewed point based on pupil and Purkinje image positions, and detects shifted viewing states to improve precision by adjusting the image display range and switching off ghost-inducing light sources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the user shifts head relative to the viewfinder causing large translational motion, then the pupil image and Purkinje image perform large translational motion on the eye image, but the viewed point cannot be estimated with high precision
Solution Approach 1:
The patent introduces an eye window frame as an intermediary reference structure that remains stationary relative to the camera body. By detecting the position of the eye window frame in the eye image, the system establishes a stable reference frame that is independent of head translational motion. This intermediary reference allows the system to distinguish between eye movement and head movement, thereby maintaining viewed point estimation precision even when the user shifts their head.
2Measurement precision
If a configuration for capturing an image of the entire face is used, then the viewed point estimation precision is improved by taking into consideration head position and incline, but the complexity and cost of the device increases
Solution Approach 1:
The patent extracts and utilizes only the necessary reference elements (eye window frame) from the full face capture approach. Instead of requiring a complete face image and complex head pose estimation algorithms, the system focuses solely on detecting the eye window frame position, which provides sufficient reference information to correct for head translational motion while significantly reducing system complexity.
3Productivity
If eyeball lamps are provided for focus point detection, then the focus point can be detected by switching the used eyeball lamp, but a ghost image generated by the eyeball lamp may appear on the eye image making it impossible to estimate the viewed point with high precision
Solution Approach 1:
The patent uses the eye window frame as an intermediary reference that is independent of the eyeball lamp illumination. By baselining the eye window frame position before eyeball lamp activation and comparing subsequent eye image features against this baseline, the system can detect viewed point information without being interfered by ghost images from the eyeball lamps, thus maintaining high precision while preserving focus point detection capability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables precise viewed point estimation even in oblique look-through states, reducing errors and improving user experience by detecting and correcting viewing position deviations and minimizing ghost image interference.
Implementation Method 1
an eye image sensor 17 that forms an eye image of the eyeball 14
Data Source
AI summary
An electronic device according to the present invention is an electronic device capable of acquiring an eye image by capturing an image of an eye looking at a screen of a display through an eye window frame, and includes at least one memory and at least one processor which function as: an estimating unit configured to estimate a viewed point of the eye on the screen on a basis of the eye image; and a detecting unit configured to detect a shifted viewing state in which the eye shifts from a position corresponding to a center of the screen on the eye image, on a basis of a position of a pupil image or a Purkinje image on the eye image.