Binocular Gaze Detection for Accurate AR Object Focus
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing line-of-sight detection techniques in head-mounted display devices, such as AR and MR devices, struggle to accurately determine whether a user is gazing at an object, leading to inaccurate processing based on line-of-sight information due to factors like pupil diameter changes and convergence angle limitations.
Innovation Solution
An electronic apparatus that includes processors to acquire and process right and left line-of-sight information, determining distances and controlling processing based on the difference between these distances to accurately assess user gaze, using methods like line-of-sight detection and convergence angle analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If pupil diameter detection is used to determine user gaze, then the detection can be implemented, but the measurement precision deteriorates because pupil diameter changes depending on light quantity rather than just gaze
Solution Approach 1:
The patent introduces an intermediary approach by using iris recognition technology to detect the user's line of sight. Instead of directly measuring pupil diameter (which is affected by light), the system detects the iris pattern and its movement relative to the pupil center. The iris serves as a more stable intermediary marker that isn't as strongly influenced by lighting conditions, allowing for more accurate gaze determination.
Solution Approach 2:
The patent changes the detection parameter from pupil diameter to iris position and pattern. By shifting from measuring the pupil's size (which varies with light) to tracking the iris's position and characteristics (which remain relatively stable), the system achieves more reliable gaze detection. The iris recognition algorithm analyzes subtle movements and positional changes of the iris relative to the pupil center to determine line of sight.
2Device complexity
If convergence angle alone is used to determine user gaze, then the detection method is simple, but the measurement precision deteriorates because convergence angle alone cannot accurately determine whether the user is gazing
Solution Approach 1:
The patent merges multiple detection parameters into a unified gaze determination system. It combines convergence angle detection with iris recognition technology, analyzing both the angle between the two eyes and the positional relationship between the iris and pupil center. This multi-parameter approach maintains relative simplicity while significantly improving measurement precision by cross-validating multiple indicators of gaze direction.
Solution Approach 2:
The patent creates a multi-functional detection system that can determine gaze through multiple mechanisms. The same imaging and processing system can analyze convergence angle, iris position, pupil center location, and their relationships, providing universal gaze detection capability that works across different viewing conditions and distances, rather than relying on a single limited parameter.
3Productivity
If line-of-sight processing is performed without accurate gaze determination, then processing can be executed, but reliability deteriorates due to unintended processing from inaccurate line-of-sight information
Solution Approach 1:
The patent implements feedback mechanisms where the system continuously monitors multiple parameters (iris position, pupil center, convergence angle) and uses this information to verify and adjust gaze determination. The feedback loop ensures that processing is only triggered when the system is confident in the gaze determination, preventing unintended processing while maintaining high productivity through rapid continuous verification.
Data Source
AI summary
An electronic apparatus according to the present invention acquires right line-of-sight information on a line-of-sight of a right eye of a user, and a left line-of-sight information on a line-of-sight of a left eye of the user, determines a first distance, which is a distance from the user to an intersection of the line-of-sight of the right eye and the line-of-sight of the left eye, and a second distance, which is a distance from the user to an object existing between the user and the intersection, on a basis of the right line-of-sight information and the left line-of-sight information; and controls setting of predetermined processing based on the right line-of-sight information and the left line-of-sight information, on a basis of a difference between the first distance and the second distance.