Gaze Tracking Autofocus for AR VR Headsets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) head-mounted displays (HMDs) often autofocus on objects the user is not looking at, leading to vergence/convergence mismatch issues, causing eye strain due to the discrepancy between the apparent distance of virtual objects and their display on flat panels.
Innovation Solution
The implementation of a gaze tracking system in AR/VR HMDs that adjusts the focus of eye lenses and external cameras based on the user's gaze direction, ensuring proper vergence matching the user's eye convergence, using gaze tracking information to direct the autofocus mechanism and adjust the focus of eye lenses to align with the user's line of sight.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If conventional autofocus mechanism is used in AR HMDs, then the camera can focus on objects automatically, but the focus may not align with the user's gaze direction, causing vergence/convergence mismatch
Solution Approach 1:
The system uses gaze tracking information as feedback to continuously adjust the autofocus mechanism. The controller receives real-time gaze data from the gaze tracking system and uses this feedback to direct the autofocus mechanism to focus on objects in the direction of the user's gaze, ensuring focus alignment with user attention.
Solution Approach 2:
The HMD system integrates multiple functions into a unified focus control mechanism. The same gaze tracking information is used to control both the external camera autofocus and the eye lenses focus, ensuring coordinated operation and eliminating the need for separate control systems.
2Device complexity
If virtual content is displayed on flat panels, then the display structure is simple, but the apparent distance of virtual objects does not match their physical display position, causing eye strain
Solution Approach 1:
The eye lenses are made dynamically adjustable to change their focal length based on the displayed content's apparent distance. The controller adjusts the eye lenses' focus in real-time according to the virtual content's depth information and the user's gaze direction, allowing the optical system to adapt to different virtual distances while maintaining a simple flat panel display structure.
Solution Approach 2:
The system changes the optical parameters of the eye lenses by adjusting their focal length to match the apparent distance of virtual objects. This parameter adjustment allows the physical display position on the flat panel to correspond with the perceived virtual distance, eliminating vergence/convergence mismatch and reducing eye strain.
3Manufacturing precision
If gaze tracking system is added to AR/VR HMDs, then the focus accuracy is improved, but the device complexity increases
Solution Approach 1:
The system merges the gaze tracking function with the focus control function into a unified system. The same gaze tracking information is used to control multiple components (external camera autofocus and eye lenses focus), reducing the need for separate sensing and control systems while improving focus accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution effectively reduces eye strain by ensuring that virtual content is displayed at the correct distance, aligning with the user's gaze, and maintaining proper vergence, enhancing the immersive experience and comfort during AR and VR applications.
Implementation Method 1
adjust the focus of the eye lenses so that the virtual content that the user is currently looking at has the proper vergence to match the convergence of the user's eyes
Implementation Method 2
the autofocus mechanism of the external cameras to focus in the direction of the user's gaze so that the external cameras focus on objects in the environment
Data Source
AI summary
Methods and apparatus for focusing in virtual reality (VR) or augmented reality (AR) devices based on gaze tracking information are described. Embodiments of a VR/AR head-mounted display (HMD) may include a gaze tracking system for detecting position and movement of the user's eyes. For AR applications, gaze tracking information may be used to direct external cameras to focus in the direction of the user's gaze so that the cameras focus on objects at which the user is looking. For AR or VR applications, the gaze tracking information may be used to adjust the focus of the eye lenses so that the virtual content that the user is currently looking at on the display has the proper vergence to match the convergence of the user's eyes.