3D Gaze Detection Using Bitmap Masks and Depth Buffers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gaze tracking technologies face inefficiencies in 3D environments, particularly in computer games and virtual reality, due to the complexity of creating interaction masks and handling occluders, leading to high computational costs and reduced accuracy.
Innovation Solution
A method involving the creation of a bitmap representing the location of gaze-interactable zones in a projected 3D scene, allowing for dynamic and efficient generation of an interactor mask, which reduces the burden on developers and enables more effective gaze interaction in 3D scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional interaction masks are used in 3D environments, then gaze tracking can detect zones of interest, but the computational cost increases significantly due to the complexity of handling occluders and creating masks for each viewpoint
Solution Approach 1:
The patent segments the 3D scene into two separate bitmaps: a depth buffer storing distance information and a stencil buffer storing zone of interest identifiers. This segmentation allows independent processing of geometric occlusion (depth) and zone identification (stencil), reducing the computational burden of creating interaction masks while maintaining accurate gaze detection.
Solution Approach 2:
The patent creates simplified 2D projections (bitmaps) of the 3D scene that copy essential information (depth and zone IDs) without replicating the full 3D complexity. These bitmap copies enable efficient screen-space operations that avoid the computational expense of processing complete 3D models and occluders for each viewpoint.
2Measurement precision
If interaction masks are created for each viewpoint in 3D scenes, then accurate gaze tracking is possible, but the process becomes extremely complex due to varying object locations and occluders
Solution Approach 1:
The patent creates universal bitmaps (depth and stencil) that function across all viewpoints without needing to be regenerated for each perspective. These multi-functional buffers serve both occlusion testing and zone identification purposes simultaneously, simplifying implementation while maintaining accuracy across dynamic 3D scenes.
Solution Approach 2:
The patent replaces the mechanical process of creating complex interaction masks for each viewpoint with automated bitmap generation using standard graphics pipeline operations (depth testing and stencil buffering). This substitution eliminates manual mask creation complexity while maintaining gaze detection accuracy through programmable, viewpoint-independent buffer operations.
3Measurement precision
If a cone-shaped search area is used to account for gaze tracking error, then accuracy is improved, but processing efficiency decreases due to the increased search space
Solution Approach 1:
The patent dynamically adjusts the effective search area by using depth buffer comparison operations that automatically constrain the gaze ray intersection tests to only those pixels within the error cone that are actually visible and within the correct depth range. This dynamic constraint reduces the processing workload compared to a static cone-shaped search while maintaining accuracy.
Solution Approach 2:
The patent performs partial action by testing only the necessary portion of the search space - specifically, only those pixels within the error cone that pass depth and stencil buffer tests. This avoids the excessive action of processing the entire cone volume, achieving adequate accuracy with reduced computational effort by focusing only on relevant regions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach simplifies the process of determining if a user's gaze is directed at a zone of interest in 3D scenes, reducing computational expenses and improving accuracy by transforming the problem into a screen-space issue, thus enhancing the efficiency and practicality of gaze tracking in complex 3D environments.
Implementation Method 1
illuminating a region in which the eye is sought with infrared radiation
Implementation Method 2
A separate, smaller bright spot (also referred to as a glint) is created by the cornea
Implementation Method 3
light enters the eye and is reflected or absorbed and re-emitted through the pupil, making the pupil appear brighter than the rest of the eye and the face
Data Source
AI summary
A method for determining if a user's gaze is directed in the direction of a zone of interest in a 3D scene comprises: providing a 3D scene containing a zone of interest; associating a property with the zone of interest; creating a bitmap representing the location of the zone of interest in a projected view of the 3D scene, each pixel of the bitmap to which the zone of interest is projected storing the property of the zone of interest; detecting the direction of the user's gaze; using the bitmap to determine if the detected user's gaze is directed in the direction of the zone of interest.