Blended Reality Gesture Control for Physical Environment Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of virtual reality systems have limited ability to interact with their environment, especially when using head-mounted displays.
Innovation Solution
A blended reality user interface and gesture control system that combines live reality feeds with virtual reality feeds using sensors and a blending engine to create a blended view on a head-mounted display, allowing users to interact more naturally with their surroundings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users wear head-mounted displays for virtual reality, then immersion in virtual environment is improved, but ability to interact with physical environment deteriorates
Solution Approach 1:
The system merges virtual reality feeds with live reality feeds to create a blended view, allowing users to see both virtual and physical environments simultaneously through the head-mounted display. This combines the immersion benefits of VR with the awareness benefits of seeing the physical world, resolving the contradiction between these two capabilities.
Solution Approach 2:
The system dynamically adjusts the blending between virtual and live reality feeds based on user gestures and commands. The blending engine continuously modifies the mix ratio between virtual and physical environment visibility in real-time, allowing users to transition between immersive VR mode and physical awareness mode as needed.
2Adaptability or versatility
If users are fully immersed in virtual reality, then virtual interaction capability is improved, but awareness of physical surroundings deteriorates
Solution Approach 1:
The system performs preliminary actions by capturing live reality feeds and pre-processing virtual reality feeds before blending them. The blending engine prepares both feeds in advance, tracking user movement and gesture commands to determine the optimal blend ratio, ensuring that physical surroundings information is preserved and accessible when needed.
Solution Approach 2:
The blending engine acts as an intermediary between the virtual reality feed and live reality feed, mediating how these two information streams are combined. It processes both feeds, tracks user gestures, and creates a unified blended view that preserves both virtual interaction capabilities and physical surroundings awareness.
3Ease of operation
If gesture control is added to blended reality system, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The system uses self-service principles by having the blending engine automatically track user gestures and commands without requiring external controllers or complex input devices. The sensors detect natural user movements and the blending engine autonomously adjusts the mix ratio based on these gestures, simplifying the interaction interface while reducing the need for additional hardware.
Data Source
AI summary
A blended reality control system includes one or more sensors, a display, and a blending engine. The blending engine is configured to receive one or more live video and virtual reality feeds, track movement using the sensors, detect a command based on the tracked movement, blend the live video feeds and virtual reality feeds into a blended view based on the detected command, and display the blended view on a display. In some embodiments, the blending engine is further configured to detect an amount of head tilt of the user and adjust a blending factor controlling an amount of transparency of the live reality feed within the blended view based on the amount of head tilt. In some embodiments, the blending engine is further configured to detect manipulation of a controller by a user and adjust the blending factor based on the detected manipulation.