Real Object Tracking for Immersive VR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented and virtual reality systems face limitations in user interaction due to occlusion and lack of realistic haptic feedback, particularly with wand controllers in world-fixed displays like CAVE systems.
Innovation Solution
Systems and methods utilizing sensors to detect and track the position, trajectory, and attitude of a real object within a three-dimensional coordinate system, allowing users to interact with virtual objects by moving or orienting the real object, which corresponds to the virtual object's position and orientation, providing a more immersive experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If wand controllers are used for user interaction in world-fixed displays, then user interface functionality is provided, but occlusion and lack of realistic haptic feedback occur
Solution Approach 1:
The patent uses a physical copy (real-world object) as the user interface instead of a virtual wand controller. The system tracks the real object's position, orientation, and movement to control virtual objects, providing authentic tactile feedback while eliminating occlusion issues. This copying approach allows users to interact with virtual environments using familiar physical objects with inherent haptic properties.
2Ease of operation
If wand controllers are used for user interaction, then interaction capability is enabled, but occlusion of virtual objects occurs
Solution Approach 1:
By using a real-world object as the interface controller rather than a virtual wand, the system eliminates occlusion. The physical object does not block the user's view of virtual objects in the display, while still providing full interaction capability through tracking the object's spatial properties and movement.
3Reliability
If real object tracking is implemented, then realistic haptic feedback and presence are improved, but system complexity increases
Solution Approach 1:
The system uses a universal real-world object that can serve multiple functions: it acts as both the user interface controller and the source of haptic feedback. The object's inherent physical properties (weight, shape, texture) provide realistic tactile sensation, while its tracked position and movement enable virtual object manipulation, eliminating the need for specialized complex controllers.
Solution Approach 2:
The patent replaces complex mechanical tracking systems with optical or electromagnetic tracking methods. Instead of using mechanical sensors attached to the object, the system uses external tracking infrastructure to detect the object's position, orientation, and movement, significantly reducing mechanical complexity while maintaining tracking accuracy.
Data Source
AI summary
Systems and methods for using positions of detected, real object boundaries to enable user interaction with a virtual object are disclosed. A system can include one or more sensors or trackers configured to detect boundaries of a transparent, real object within a three-dimensional coordinate system. A computing device configured to track positions of the detected boundaries of the real object within the three-dimensional coordinate system. The computing device may also track a position of a virtual object within the three-dimensional coordinate system. The computing device may determine whether the position of the virtual object is within the positions of the detected boundaries of the real object. The computing device may also enable user interaction with the virtual object via user interface and receive input for interacting with the virtual object in response to determining that the position of the virtual object is within the positions of the detected boundaries.