Cross-Reality Object Blending for VR Interaction Usability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality systems face issues with usability and immersion due to frequent transitions between virtuality and reality, leading to difficulties in recognizing physical objects and interacting with them, resulting in collisions and repetitive grasping attempts.
Innovation Solution
An electronic apparatus and method that determine interaction states for physical objects in the real world, providing a virtual environment through a blending technique selected based on these determinations, enabling smooth transitions and customized interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a technique that replaces real-world objects with virtual objects is used, then immersion in virtual environment is improved, but usability of interaction with physical objects deteriorates
Solution Approach 1:
The system dynamically adjusts the blending between virtual and real object representations based on the user's interaction state. When the user is not interacting with an object, virtual representations are emphasized for immersion. When interaction is detected, the system transitions to showing more real-world visual information to improve usability and recognition.
Solution Approach 2:
The system changes the parameter of visual representation blending ratio based on interaction detection. The blending technique adjusts the proportion of virtual versus real object visibility according to whether the user is currently interacting with the object, optimizing both immersion and usability for different states.
2Ease of operation
If a technique that projects camera view of real world onto virtual environment is used, then usability of interaction with physical objects is improved, but immersion in virtual environment deteriorates
Solution Approach 1:
The system dynamically controls when to project camera views based on interaction state. Camera views are projected selectively during interaction moments to improve usability, while maintaining virtual environment immersion during non-interaction periods.
Solution Approach 2:
The blending technique adjusts the parameter of real-world view projection intensity based on interaction detection, increasing projection during interaction for usability and decreasing it during non-interaction to maintain immersion.
3Loss of information
If frequent transition between virtuality and reality is implemented, then information about physical objects is provided, but recognition of physical objects deteriorates
Solution Approach 1:
The system implements periodic transitions between virtual and real views synchronized with interaction events rather than continuous switching. This periodic action provides necessary information while minimizing disruption to object recognition by timing transitions at appropriate moments in the interaction sequence.
4Reliability
If blending technique is applied to maintain presence, then immersion is improved, but interaction accuracy with physical objects deteriorates
Solution Approach 1:
The system dynamically adjusts the strength of blending techniques based on interaction state. Stronger blending is applied during non-interaction periods to maintain presence and immersion, while blending is reduced or paused during interaction moments to improve accuracy and recognition of physical objects.
Data Source
AI summary
Proposed are an apparatus and method for supporting interaction between a virtual environment and the real world. According to an embodiment disclosed herein, there is provided an electronic apparatus including: memory; and a controller configured to determine an interaction state for a physical object in the real world and provide a virtual environment according to a blending technique selected based on determination results.