Varifocal HMD with Eye-Tracking Depth Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current artificial reality systems struggle to provide a visually accurate and realistic three-dimensional experience due to vergence-accommodation conflict and limitations in depth of field reconstruction in pass-through or mixed reality experiences.
Innovation Solution
The use of a varifocal head-mounted display (HMD) combined with advanced image processing techniques, including eye-tracking and depth sensing, to dynamically adjust the focal length and apply depth blur filters, thereby mimicking the user's natural depth of field and reducing vergence-accommodation conflict.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If real-world image data is captured and reconstructed with a large depth of field focused at infinity, then the pass-through or mixed reality experience is provided, but the vergence-accommodation conflict increases and the three-dimensional experience becomes less realistic
Solution Approach 1:
The patent applies dynamics by making the depth of field and focal length adjustable rather than fixed. The system dynamically changes the focal length of the display based on the detected focal point of real-world objects, allowing the depth of field to adapt to different distances. This dynamic adjustment resolves the vergence-accommodation conflict by synchronizing the display's focal length with the user's natural focusing distance, thereby improving the realism of the three-dimensional experience while maintaining ease of operation in pass-through or mixed reality modes
2Ease of operation
If real-world image data is captured and reconstructed with a large depth of field, then the pass-through or mixed reality experience is provided, but the three-dimensional experience becomes less realistic
Solution Approach 1:
The patent applies parameter changes by modifying the focal length parameter of the display based on the detected focal point distance of real-world objects. Instead of using a fixed large depth of field, the system adjusts the focal length parameter to match the user's natural focusing distance. This parameter adjustment creates a more realistic three-dimensional experience by replicating natural depth perception, while still providing the functionality of pass-through or mixed reality experiences
3Reliability
If a varifocal HMD with dynamic focal length adjustment is implemented, then the vergence-accommodation conflict is reduced and three-dimensional realism is improved, but the device complexity increases
Solution Approach 1:
The patent applies the intermediary principle by introducing a focal point detection module as a mediator between the real-world scene and the display. This intermediary component detects the focal point of real-world objects and translates it into appropriate display parameters (focal length and depth of field). By using this intermediary, the system achieves vergence-accommodation conflict reduction and improved three-dimensional realism without requiring the entire HMD structure to be overly complex, as the focal point detection module serves as a coordinating element that simplifies the overall system architecture
Data Source
AI summary
The disclosure describes artificial reality systems and techniques for providing artificial reality content to a user. For example, an artificial reality system includes a head-mounted display (HMD) configured to output artificial reality content, the HMD including a set of second image capture devices configured to capture image data indicative of a focal point of a gaze of the user and a varifocal display having a focal length that is modifiable based on the focal point of the user. Additionally, the system includes a depth engine configured to generate, based on the real-world image data and depth data associated with the real-world image data, a three-dimensional (3D) scene of the physical environment of the user and generate artificial reality content as an overlay to the 3D scene of the physical environment for display on the varifocal display of the HMD based on the focal point of the user.