XR Partial Pass-Through for Seeing Surroundings Without Exiting VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial reality (XR) devices require users to exit immersive virtual reality (VR) experiences or remove their head-mounted displays (HMDs) to see their surroundings, lacking seamless integration between VR and real-world environments, and consume excessive computational resources for full rendering.
Innovation Solution
Implementing partial pass-through functionality on XR devices, allowing users to selectively view real-world environments alongside VR experiences through voice commands or user interface controls, while conserving computational resources by not rendering the entire VR experience during pass-through.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If full pass-through rendering is implemented on XR devices, then users can see their surroundings while wearing the device, but computational resources are excessively consumed
Solution Approach 1:
The patent segments the XR display into multiple regions, with pass-through content displayed in specific portions rather than the entire display. This allows the system to provide situational awareness in targeted areas while conserving computational resources by not rendering full pass-through across the complete display area.
Solution Approach 2:
The patent implements partial pass-through functionality where only selected portions of the display show real-world content. This partial action approach provides sufficient environmental awareness for safety and context without the excessive computational burden of full pass-through rendering across the entire display.
2Ease of operation
If users exit VR experiences to see surroundings, then they can perceive real-world environment, but immersion is broken and time is lost
Solution Approach 1:
The patent divides the display into multiple regions, allowing pass-through content to be visible in specific portions while maintaining the VR experience in other portions. This enables users to perceive their surroundings without breaking immersion or exiting the VR experience, eliminating time loss associated with entering and exiting VR modes.
Solution Approach 2:
The patent merges VR content and pass-through content into a single unified display experience. By combining both types of content simultaneously in different display regions, users can maintain VR immersion while also perceiving their real-world surroundings, eliminating the need to exit VR to check the environment.
3Use of energy by moving object
If partial pass-through is implemented, then resource consumption is reduced, but integration between VR and real-world environments is less seamless
Solution Approach 1:
The patent strategically segments the display into regions optimized for different content types. By carefully selecting which portions show pass-through content versus VR content, the system achieves an optimal balance between resource consumption and seamless integration, providing environmental awareness exactly where needed without requiring full pass-through rendering.
Data Source
AI summary
Some aspects of the present disclosure are directed to providing partial pass-through on an artificial reality (XR) device, such as a head-mounted display (HMD). Some implementations can allow a user to turn on selective areas of pass-through on the XR device, such that one or more portions of a real-world environment physically surrounding the user can be seen. In some implementations, a user can control the area of pass-through by specifying a percentage of the real-world environment he wishes to see, e.g., 50%. In some implementations, a user can control the area of pass-through by specifying an area of XR device she wishes to see, e.g., the top portion of the view. In some implementations, a user can control the area of pass-through by specifying a physical object in the real-world environment he wishes to see, e.g., a real-world desk.