MR Headset Imaging and Illumination Layout for Object Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
MR headsets face challenges in accurately detecting user interactions due to varying lighting conditions and audio disruptions, which affect immersion and engagement in mixed-reality environments.
Innovation Solution
Incorporating a resonant frequency dampening channel within the MR headset housing to manage cooling and an object-tracking assembly with aligned imaging devices and illumination devices, configured to generate ambient lighting conditions for accurate object tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If imaging devices are used to detect user interactions in MR headset, then interaction detection capability is provided, but detection accuracy deteriorates under varying lighting conditions
Solution Approach 1:
An illumination device is introduced as an intermediary element between the imaging devices and the external environment. This illumination device actively compensates for insufficient or varying lighting conditions by providing supplemental light, thereby ensuring that the imaging devices can consistently capture high-quality images for accurate hand gesture detection regardless of ambient lighting levels.
2Measurement precision
If multiple imaging devices and illumination devices are added to improve tracking accuracy, then object-tracking precision is improved, but device complexity increases
Solution Approach 1:
The imaging devices and illumination device are merged into a single integrated object-tracking assembly. This consolidation allows the components to work together as a unified system, sharing common mounting structures, control circuits, and spatial arrangements, thereby achieving high tracking precision while minimizing the increase in overall device complexity.
3Area of stationary object
If imaging devices are positioned to capture wide field of view for hand gesture detection, then interaction coverage is improved, but image quality deteriorates due to insufficient lighting
Solution Approach 1:
The illumination device is positioned and configured to provide localized lighting enhancement specifically in the regions where hand gestures are most likely to occur within the field of view. This targeted illumination approach ensures that the extended field of view maintains high image quality and sufficient lighting levels across the entire detection area, rather than uniformly illuminating all regions.
Data Source
Figure 1A
Figure 1B
Figure 1C~1D
AI summary
A housing of an MR device includes one or more displays within an interior surface of the housing configured to cause presentation of an extended reality environment. And the housing includes an object-tracking assembly disposed on an exterior surface of the housing. The object-tracking assembly includes a plurality of imaging devices aligned along a first axis, and an illumination device aligned along a second axis, perpendicular to the first axis, the illumination device disposed at a predetermined intermediate distance between at least two respective imaging devices of the plurality of imaging devices. While the MR head-wearable device is performing operations, the object-tracking assembly is configured to determine, based on imaging data obtained by the plurality of imaging devices while the illuminating device is generating ambient lighting conditions, that the obtained imaging data satisfies an object- tracking threshold for causing presentation of a tracked object via the one or more displays.