AR Proxy Object Overlay With Dynamic Feature Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current AR systems fail to align virtual models accurately with physical proxy objects, leading to protrusions, alignment issues, and occlusion errors that disrupt the user's immersive experience and cause glitches or disappearance of the virtual model.
Innovation Solution
An AR system that detects features on physical and occluding objects, anchors virtual content to both, and adjusts alignment dynamically to maintain visibility and alignment during interactions, using techniques like image inpainting to conceal occluded portions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the virtual model is overlaid over the physical proxy object to allow tactile feedback interaction, then user immersion is improved, but alignment accuracy deteriorates causing protrusions and visual discrepancies
Solution Approach 1:
The system dynamically adjusts the virtual model's position and orientation based on real-time detection of the proxy object's features. The virtual model is not statically positioned but continuously repositioned to maintain alignment with the proxy object as it moves, preventing protrusions and visual discrepancies while preserving tactile feedback interaction.
Solution Approach 2:
The system uses computer vision to detect features on the proxy object and provides feedback by adjusting the virtual model's position accordingly. This closed-loop feedback mechanism ensures the virtual model remains aligned with the physical proxy object during user interaction, resolving the alignment accuracy issue while maintaining immersion.
2Ease of operation
If the proxy object is made larger to improve tactile feedback, then interaction realism is improved, but occlusion of virtual model increases causing visibility loss
Solution Approach 1:
The system applies different rendering qualities to different regions of the virtual model. Portions of the virtual model that are occluded by the proxy object are rendered with higher priority or enhanced visibility characteristics, while visible portions maintain normal rendering. This local differentiation allows the proxy object to remain large for tactile feedback while minimizing the visual impact of occlusion.
3Stability of the object's composition
If the virtual model is anchored to the proxy object using detected features, then alignment stability is improved, but robustness to occlusion deteriorates causing glitches when features are hidden
Solution Approach 1:
The system implements multiple feature detection mechanisms and anchoring methods that can function interchangeably. When one set of features is occluded, the system can switch to alternative features or anchoring techniques, ensuring continuous stable alignment without glitches. This multi-functional approach provides robustness against occlusion while maintaining alignment stability.
Solution Approach 2:
The system prepares backup anchoring features and alternative alignment methods in advance. When occlusion is detected, the system can immediately switch to pre-prepared alternative anchoring points, preventing alignment instability and glitches. This proactive preparation ensures reliability during occlusion events while maintaining stable alignment.
4Manufacturing precision
If the system continuously tracks the proxy object to maintain virtual model position, then alignment accuracy is improved, but computational complexity increases causing performance degradation
Solution Approach 1:
The system divides the tracking task into discrete feature point tracking rather than continuous full-object tracking. By identifying and tracking only the critical feature points on the proxy object, the system maintains alignment accuracy while significantly reducing computational complexity compared to tracking the entire object surface or volume.
Solution Approach 2:
The system performs partial tracking by focusing only on essential feature points rather than complete object tracking. This selective approach provides sufficient alignment accuracy for the virtual model while avoiding the excessive computational burden of comprehensive tracking, achieving an optimal balance between precision and performance.
Data Source
AI summary
To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.