Mixed Reality Headset Camera Interference Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mixed reality (MR) headsets face interference issues where projected information overlaps with real-world views, hindering the accurate identification of real-world features due to the dual role of the headset lens or mirror in reflecting both virtual and real-world content.
Innovation Solution
A portable electronic device with a processor that alternates between displaying information and ceasing its display, controlling video frame processing to reduce the occurrence of projected information in video frames, thereby improving the capture and identification of real-world features by prioritizing display quality or camera video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Duration of action of moving object
If the display device continuously projects information onto the headset lens, then the user can continuously view virtual information, but the camera cannot accurately capture real-world features due to interference from projected information
Solution Approach 1:
The system implements periodic action by alternating between display phases and camera capture phases. The display device projects virtual information during display phases, then ceases projection during camera capture phases. This periodic switching allows the camera to capture clean images of real-world features without interference from projected information, while still providing continuous virtual information display over time through repeated cycles.
Solution Approach 2:
The system segments the operation into distinct time phases: display phases where virtual information is projected, and camera capture phases where the camera records real-world features. By dividing the continuous operation into these separate segments, the system eliminates interference between the display and camera functions, allowing each to operate optimally during its designated phase.
2Productivity
If the camera continuously captures video frames, then real-world features can be tracked continuously, but the display quality degrades due to the need to cease information projection
Solution Approach 1:
The system uses periodic action to switch between camera capture and display phases at high frequency. By optimizing the phase duration and switching frequency, the system maintains the illusion of continuous tracking and display for the user, while actually alternating between these functions in discrete time slots to eliminate interference.
Solution Approach 2:
The system dynamically adjusts the timing and duration of display and camera capture phases based on operational requirements. The phase switching is not fixed but can be adapted in real-time to prioritize either display quality or tracking continuity depending on the current operational context, allowing flexible optimization of both functions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enhances the accuracy of real-world feature identification and image quality by minimizing the overlap of projected information in video frames, allowing for more robust tracking and improved user experience in MR environments.
Implementation Method 1
The lens 110 reflects the light toward the user's eyes (e.g., along path 200b, predominantly by virtue of specular reflection)
Implementation Method 2
The lens 100 is at least partially transparent (i.e., see-through) to allow ambient light to pass through for viewing by a user
Implementation Method 3
The lens 110 may or may not have light concentrating or light dispersing effects (e.g., magnifying light from real-world features)
Data Source
Figure 1~2
Figure 3
Figure 4~5
AI summary
A portable electronic device is used with a mixed reality (MR) headset. The MR headset includes a lens and a holder that retains the portable electronic device in a defined orientation relative to the lens. The portable electronic device includes a camera, a display device, and a processor. The camera outputs video frames and is arranged to view the lens. The display device is arranged to display information that is projected on the lens for reflection directly or indirectly toward the user's eyes and the camera. The processor performs operations that include processing (400) the video frames from the camera to identify locations of at least one real-world feature, displaying (402) information on the display device, and controlling (404) at least one of the processing of the video frames and the displaying of the information on the display device to at least partially reduce occurrence in the video frames of the displayed information.