HMD Electronic Display Structured Light Facial Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted displays (HMDs) face challenges in providing facial tracking systems that are portable, lightweight, and high-performance due to the need for dedicated hardware like structured light projectors, which add weight and bulk.
Innovation Solution
The HMD uses its electronic display to illuminate the user's face with structured light, allowing the camera assembly to capture images and process facial data, eliminating the need for additional hardware like structured light projectors by embedding illumination into the display content or emitting it separately.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a dedicated structured light projector is used for facial tracking, then facial tracking performance is improved, but device weight and bulk increase
Solution Approach 1:
The electronic display is designed to perform dual functions: displaying visual content to the user and projecting structured light patterns for facial tracking. By making the display multi-functional, the system eliminates the need for a separate dedicated projector, thereby reducing device weight and bulk while maintaining facial tracking performance
Solution Approach 2:
The patent combines the content display function and the structured light projection function into a single electronic display component. This merging of functions allows the system to use the display's light output for both viewing content and illuminating structured light patterns for depth camera-based facial tracking, eliminating redundant hardware
2Measurement precision
If a dedicated structured light projector is used for facial tracking, then facial tracking performance is improved, but device complexity increases
Solution Approach 1:
The electronic display serves multiple purposes simultaneously - it displays content to the user and projects structured light patterns for facial tracking. This multi-functionality reduces the number of separate components needed, thereby simplifying the overall device architecture and reducing complexity
Solution Approach 2:
The patent extracts the structured light projection function from a separate dedicated projector and integrates it into the existing electronic display system. This extraction and integration approach eliminates the need for additional hardware components, simplifying the device structure
3Measurement precision
If a dedicated structured light projector is used for facial tracking, then facial tracking performance is improved, but computational resources required increase
Solution Approach 1:
The electronic display automatically provides the structured light illumination needed for facial tracking as part of its normal operation. The display's light output is utilized efficiently for both content display and structured light projection, eliminating the need for separate illumination hardware and reducing overall system energy consumption and computational overhead
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach results in a more compact, lightweight HMD that requires less computational resources while maintaining effective facial tracking and immersive virtual or augmented reality experiences.
Implementation Method 1
The HMD uses an electronic display to illuminate a portion of the face of the user inside the HMD. The electronic display may illuminate the face using structured light having a pattern of monochrome colors
Data Source
AI summary
A head mounted display (HMD) displays content to a user wearing the HMD, where the content may be based on a facial model of the user. The HMD uses an electronic display to illuminate a portion of the face of the user with. The electronic display emits a pattern of structured light and/or monochromatic light of a given color. A camera assembly captures images of the illuminated portion of the face. A controller processes the captured images to determine depth information or color information of the face of the user. Further, the processed images may be used to update the facial model, for example, which is represented as a virtual avatar and presented to the user in a virtual reality, augmented reality, or mixed reality environment.