XR Headset Eye Capture via Lighting Deactivation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In holographic calls within artificial reality systems, the eye region of a user wearing an XR headset cannot be accurately captured by external image capture devices due to applied lighting effects, leading to incomplete or inaccurate representation of the user's emotions and gaze.
Innovation Solution
The XR headset temporarily deactivates its tint and display for a brief, imperceptible period, allowing an external image capture device to capture the user's eyes by synchronizing timers or using event-based triggers, ensuring accurate rendering of the eye region in holograms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If lighting effects are applied to the XR headset lenses to enable XR experience display, then the XR experience can be rendered, but the eye region cannot be captured by external image capture devices
Solution Approach 1:
The system periodically alternates between applying lighting effects for XR experience display and deactivating lighting effects for eye region capture. This periodic switching allows both functions to coexist by allocating different time intervals for each purpose, resolving the contradiction between illumination intensity and measurement precision
Solution Approach 2:
The system briefly deactivates lighting effects before external image capture occurs, ensuring the eye region is visible during the capture moment. This preliminary adjustment of lighting conditions enables accurate eye region measurement without compromising the overall XR experience capability
2Illumination intensity
If the XR headset display is activated to show content, then the user can experience XR content, but the display light prevents external capture of the user's eyes
Solution Approach 1:
The display is periodically deactivated during brief intervals when eye region capture is required, allowing external devices to capture eye information without interference from display light. This periodic switching ensures both XR content delivery and eye region information preservation
Solution Approach 2:
The system maintains continuous XR experience delivery by quickly switching the display off and on, ensuring the overall useful action of providing XR content continues without significant interruption while still enabling eye region capture during the brief off periods
3Object-affected harmful factors
If the tint on the XR headset is applied to block external light, then the user can focus on XR content, but the tint obscures the user's eyes from external capture devices
Solution Approach 1:
The tint is periodically adjusted or deactivated during eye region capture intervals, allowing external devices to see through the headset and capture eye information. During non-capture intervals, the tint remains active to block external light and enhance XR experience, thus resolving the contradiction between light blocking and eye visibility
Data Source
AI summary
In holographic calling, it is difficult to capture the eyes of a caller due to lighting effects on an artificial reality (XR) headset. However, it can be important to capture the eyes when rendering the caller as they can show emotion, gaze, physical characteristics, etc., that aid in natural communication. Thus, implementations can capture the eyes of the caller using an external image capture device by briefly turning off the lighting effects on the XR headset. Some implementations can trigger the image capture device to capture an image of the eyes by temporal multiplexing in which timers on both the image capture device and the XR headset are synchronized. In other implementations, the image capture device can be an event-based camera that is automatically triggered to capture an image of the eyes based on a detected pixel change caused by deactivation of the lighting effects on the XR headset.