AR Display Device Localizing Physical Devices via Sensor Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems face challenges in accurately identifying and localizing devices within an environment, leading to potential occlusion of physical manifestations and suboptimal user experiences.
Innovation Solution
An augmented reality display device uses on-board sensors to detect and communicate with devices, instructing them to modulate physical manifestations such as lights or sounds, allowing for precise localization and adaptation of augmented reality content to avoid occlusion and enhance user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If augmented reality systems display virtual content in the environment, then the AR experience is enhanced, but physical devices may be occluded leading to poor user experience
Solution Approach 1:
The system performs preliminary localization of physical devices using sensors (cameras, microphones, RFID readers) before rendering AR content. This advance knowledge of device positions allows the system to pre-plan AR content placement that avoids occluding physical devices, resolving the contradiction between enhancing AR experience and avoiding occlusion.
Solution Approach 2:
The system continuously monitors the environment using on-board sensors to detect physical devices and their positions. This feedback loop allows dynamic adjustment of AR content placement in real-time, ensuring that virtual content does not occlude physical devices while maintaining an engaging AR experience.
2Measurement precision
If the AR system uses sensors to detect and communicate with devices, then localization precision is improved, but device complexity increases
Solution Approach 1:
The AR display device integrates multiple types of sensors (cameras, microphones, RFID readers, accelerometers) that serve multiple functions: environmental mapping, device localization, orientation detection, and motion tracking. This multi-functionality approach improves localization precision without proportionally increasing system complexity, as a single sensor suite performs diverse tasks.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Examples are disclosed herein that relate to identifying and localizing devices in an environment via an augmented reality display device. One example provides, on a portable augmented reality computing device, a method including establishing a coordinate frame for an environment, and discovering, via a location-sensitive input device, a location of a physical manifestation of the device in the environment, assigning a device location for the device in the coordinate frame based upon the location of the physical manifestation, and modifying an output of the portable augmented reality computing device based upon a change in relative position between the portable augmented reality computing device and the physical manifestation in environment.