VR Blending Control for Physical Object Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality systems face issues with usability and immersion due to frequent transitions between virtuality and reality, leading to difficulties in recognizing and interacting with physical objects, resulting in collisions and repetitive grasping attempts.
Innovation Solution
An electronic apparatus and method that determine interaction states for physical objects in the real world, providing customized blending techniques to create a virtual environment that enhances usability and immersion by classifying interaction states and applying appropriate blending techniques based on these determinations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a technique that replaces real-world objects with virtual objects is used, then immersion in virtual environment is improved, but usability and recognition of physical objects deteriorate
Solution Approach 1:
The system dynamically adjusts the blending technique based on the interaction state between the user and physical objects. When the user is far from objects, virtual object replacement is applied for immersion. When the user approaches or interacts with objects, the system transitions to pass-through or augmented reality modes to maintain usability and recognition of physical objects.
Solution Approach 2:
The system changes the parameter of reality-virtuality blending ratio based on interaction state. It uses distance thresholds and interaction detection to determine when to switch between different blending modes (virtual replacement, augmented reality, pass-through), optimizing both immersion and usability for different scenarios.
2Loss of information
If frequent transitions between virtuality and reality are implemented, then information availability is improved, but immersion and interaction accuracy deteriorate
Solution Approach 1:
The system implements dynamic transitions based on interaction state rather than frequent arbitrary switches. It monitors user distance, hand gestures, and object proximity to determine optimal transition timing, reducing unnecessary transitions that would break immersion while maintaining information availability when needed.
Solution Approach 2:
The system uses feedback from sensors (cameras, depth sensors, motion trackers) to detect user interaction state and automatically adjusts the blending technique accordingly. This feedback mechanism ensures smooth transitions only when interaction state changes, maintaining immersion while providing necessary real-world information.
3Ease of operation
If physical objects are fully visible in real world, then recognition and interaction accuracy are improved, but immersion in virtual environment deteriorates
Solution Approach 1:
The system applies different rendering qualities to different regions of the field of view. In the periphery or when user is distant, virtual objects are displayed for immersion. When the user focuses on or approaches specific objects, those local regions transition to show real objects with higher fidelity to improve recognition and interaction accuracy.
Solution Approach 2:
The system changes the visibility parameter of physical objects based on interaction state. It uses depth information, hand tracking, and gaze detection to determine which objects should be fully visible versus virtually represented, dynamically adjusting the reality-virtuality blend ratio for different spatial locations and interaction contexts.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Proposed are an apparatus and method for supporting interaction between a virtual environment and the real world. According to an embodiment disclosed herein, there is provided an electronic apparatus including: memory; and a controller configured to determine an interaction state for a physical object in the real world and provide a virtual environment according to a blending technique selected based on determination results.