VR Headset Pass-Through Modes for Real-World Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR systems lack adaptable transparency and resolution settings for pass-through modes, leading to user disorientation and safety risks due to abrupt visual changes between virtual and real-world environments, and limited interaction with real-world objects.
Innovation Solution
A VR HMD system that allows users to control pass-through mode operation with context-aware switching, applying different visual effects based on environmental context and user inputs, enabling seamless interaction with real-world objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a pass-through mode is activated to view the external environment, then user awareness of the real world is improved, but user immersion in the virtual reality environment deteriorates
Solution Approach 1:
The system dynamically adjusts the pass-through mode based on real-time detection of external objects and user context. The processor monitors the external environment and automatically switches between different pass-through transparency levels, allowing the system to adapt to changing situations rather than using a fixed mode. This resolves the contradiction by making immersion and awareness context-dependent rather than mutually exclusive.
Solution Approach 2:
The system applies different transparency levels to different regions or contexts of the external environment. When certain external objects or conditions are detected, the processor selectively adjusts pass-through visibility for those specific areas while maintaining VR immersion in other areas. This localized approach allows users to maintain awareness of critical external elements without completely breaking immersion.
2Adaptability or versatility
If multiple pass-through modes with different transparencies and resolutions are provided, then user adaptability to different environments is improved, but device complexity deteriorates
Solution Approach 1:
The system automatically selects and switches between different pass-through modes based on real-time environmental detection and user context, eliminating the need for manual user configuration. The processor monitors external conditions and autonomously adjusts transparency and resolution settings, allowing the system to serve itself rather than requiring complex user intervention to manage multiple modes.
Solution Approach 2:
The system changes key parameters (transparency and resolution) of the pass-through mode based on detected external conditions. Rather than requiring users to manually configure multiple modes, the processor dynamically adjusts these parameters in response to environmental context, simplifying the user interface while maintaining high adaptability.
3Speed
If abrupt visual changes occur when switching between VR and pass-through modes, then quick response to external environment is improved, but user disorientation and safety risks increase
Solution Approach 1:
The system prepares for mode transitions by detecting external objects and conditions in advance. Before switching between VR and pass-through modes, the processor monitors the external environment and predicts when a transition may be needed, allowing users to mentally prepare for the visual change. This cushioning effect reduces disorientation by providing advance warning of upcoming transitions.
Solution Approach 2:
The system continuously monitors external environment detection results and uses this feedback to smoothly transition between modes. The processor analyzes real-time data about external objects and conditions, adjusting the timing and nature of mode switches to minimize disorientation. This feedback loop ensures that transitions occur at optimal moments rather than abruptly without context.
Data Source
AI summary
A method performed by a virtual reality (VR) head mounted device (HMD) includes displaying, by a display of the HMD, a VR environment, obtaining, by a processor of the HMD, a video feed of an external environment from an exterior-facing camera of the HMD, and determining, by the processor, to activate one of a plurality of pass-through modes for the video feed based on at least one of a user input or a state of the external environment, wherein the plurality of pass-through modes have different transparencies, different resolutions, or both. The method further includes rendering, by the processor based on the activated pass-through mode, the video feed for overlay onto at least a portion of the VR environment, and displaying, by the display, the rendered video feed overlaid onto the portion of the VR environment.