VR Local Perspective Display Using Hand-Tracked Real-Scene Windows
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual reality (VR) equipment lacks a method to seamlessly integrate real-world perspective viewing without disrupting the immersive experience, particularly during activities like using a mobile phone or drinking water.
Innovation Solution
A local perspective method and device for VR equipment that identifies user hand actions to trigger a local perspective function, determining a display area based on hand positions to show real-world views within the VR scene, allowing users to perform tasks without fully exiting the immersive environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If camera-based perspective function is used to display external real world scene, then users can perceive external information, but users can no longer see the content of the virtual scene and immersive experience is greatly affected
Solution Approach 1:
The patent segments the display area into virtual scene content and real world perspective content. Instead of completely switching between virtual and real views, the system divides the field of view to show both simultaneously, with the real world perspective occupying a portion of the display area while virtual content remains visible in other regions. This segmentation allows users to access external information without completely losing immersion in the virtual environment.
Solution Approach 2:
The patent applies local quality by displaying real world perspective in specific local regions of the display area rather than globally replacing the virtual scene. The system determines specific display areas within the overall display where real world content is shown, allowing different parts of the display to serve different functions - some regions maintain virtual immersion while others provide real world awareness.
2Ease of operation
If complete switching between virtual scene and real world perspective is used, then users can access external information, but user experience is greatly affected especially in scenarios such as movie viewing
Solution Approach 1:
The patent implements dynamic adjustment of the real world perspective display area based on user actions and environmental context. The system can dynamically change the size, position, and shape of the perspective display region according to user hand gestures, head movements, or detected environmental factors. This dynamic behavior allows the system to adapt to different usage scenarios - for example, showing larger real world views when users need to check external information while maintaining smaller views during immersive activities like movie viewing.
Solution Approach 2:
The patent creates a universal perspective display system that can serve multiple functions across different application scenarios. The same basic mechanism of displaying real world perspective within the virtual environment can be applied to various use cases including gaming, virtual meetings, training simulations, and entertainment. The system adapts its behavior to suit different scenarios rather than requiring separate solutions for each application type.
3Ease of operation
If local perspective display area is determined according to user hand action position, then users can perform operations in real scene without interrupting immersive experience, but system complexity increases
Solution Approach 1:
The patent implements self-service by using the user's own hand actions as the basis for determining the perspective display area. The system automatically tracks hand position and uses this information to dynamically adjust where real world perspective content is displayed, without requiring separate control interfaces or complex configuration. The user's natural hand movements directly control the display behavior, simplifying the interaction model while maintaining sophisticated adaptive capabilities.
Data Source
AI summary
A local perspective method and device of a virtual reality equipment and a virtual reality equipment are disclosed. The local perspective method of a virtual reality equipment includes: detecting a user's hand gesture; displaying a real scene in a local perspective display area in a virtual scene according to a position of the user's hand gesture in response to that the user's hand gesture satisfies a preset trigger gesture; tracking the position of the user's hand gesture which satisfies the preset trigger gesture; and adjusting the local perspective display area in the virtual scene according to the position of the user's hand gesture.