Variable-Focus Camera Focusing Using Gaze and Depth Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera systems in mixed reality applications suffer from latency and visual flickering due to the need for trial and error to find the correct focus distance, which is inefficient and unpleasant for users.
Innovation Solution
A computer-implemented method and system that uses gaze and depth-based focusing, employing gaze-tracking and depth maps to determine optical depths and convergence distances for variable-focus cameras, allowing for accurate and efficient selection of the focus distance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If trial and error method is used to find correct focus distance by trying multiple focus distances, then the camera can achieve correct focus, but it results in latency and visual flickering
Solution Approach 1:
The system performs preliminary actions by using gaze-tracking to predict the user's region of interest and depth map to estimate depth information before actual focusing is needed. This allows the variable-focus camera to pre-adjust to the predicted focus distance, eliminating the need for trial-and-error searching and reducing latency.
Solution Approach 2:
The patent introduces intermediary elements (gaze-tracking means and depth map) that mediate between the user's visual attention and the camera's focus adjustment. These intermediaries provide predictive information about where the user will look and what the depth structure is, allowing the system to determine focus distance without trial-and-error.
2Measurement precision
If trial and error method is used to select focus distance, then correct focus can be achieved, but visual flickering occurs during the searching process
Solution Approach 1:
The system performs preliminary actions by using gaze-tracking to predict the user's region of interest and depth map to estimate depth information before actual focusing is needed. This allows the variable-focus camera to pre-adjust to the predicted focus distance, eliminating the need for trial-and-error searching and reducing latency.
Solution Approach 2:
The system uses feedback from gaze-tracking means and depth map analysis to continuously monitor and adjust the focus distance. By incorporating real-time feedback about user attention and scene depth, the system can make precise focus adjustments without trial-and-error, thereby eliminating visual flickering.
3Measurement precision
If manual region-of-interest selection is required by tapping on display screen, then precise region can be selected, but it increases device complexity and reduces ease of operation
Solution Approach 1:
The system performs self-service by using gaze-tracking means to automatically identify the user's region of interest based on where the user is looking. This eliminates the need for manual tapping or explicit user input to select the region, making the operation intuitive and convenient while maintaining precise region selection through eye-gaze detection.
Solution Approach 2:
The gaze-tracking means serves multiple functions: it identifies the region of interest, estimates user attention, and provides input for focus distance calculation. This multi-functionality eliminates the need for separate manual region selection mechanisms, simplifying the interface while maintaining precision.
Data Source
AI summary
Disclosed is computer-implemented method including marching first ray and second ray, along first gaze direction and second gaze direction that are estimated using gaze-tracking means, from given viewpoint into depth map, to determine first optical depth and second optical depth corresponding to first eye and second eye, respectively; calculating gaze convergence distance, based on first gaze direction and second gaze direction; detecting whether first optical depth lies within predefined threshold percent from second optical depth; and when it is detected that first optical depth lies within predefined threshold percent from second optical depth, selecting given focus distance as an average of at least two of: first optical depth, second optical depth, gaze convergence distance; and employing given focus distance for capturing given image using at least one variable-focus camera.