AR Environmental Map Update via Sensor-Attached Object Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) systems face challenges in accurately mapping and updating environmental maps to reflect changes in real-world objects, leading to artifacts and poor user experiences due to slow response times and the complexity of tracking systems.
Innovation Solution
The method involves using sensors attached to physical objects to provide real-time position data to an AR system, which updates the environmental map accordingly, allowing for more accurate representation of object movements and changes, such as opening or closing of doors or lighting conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If mapping algorithms are used to generate environmental maps, then virtual depictions of real-world objects are created, but the algorithms are unable to properly map moving real-world objects resulting in artifacts and misrepresented objects
Solution Approach 1:
The system segments the tracking problem by dividing the environment into static objects (mapped using SLAM) and dynamic objects (tracked using VPS). Each object type is handled by a specialized algorithm, allowing moving objects to be tracked accurately without compromising the overall mapping system.
Solution Approach 2:
Visual position markers serve as intermediaries between the camera system and moving objects. These markers enable the system to track moving objects by providing recognizable visual features that can be followed across frames, bridging the gap between static environmental mapping and dynamic object tracking.
2Measurement precision
If tracking systems are used to track movement of real-world objects, then updating of environmental maps is improved, but the tracking systems are expensive and complex
Solution Approach 1:
The visual position recognition system serves multiple functions: it enables tracking of moving objects, provides feedback for AR object positioning, and works across different environments. This multi-functionality eliminates the need for separate specialized tracking hardware, reducing overall system complexity and cost.
Solution Approach 2:
The system uses visual copies (images) of position markers that can be reproduced and recognized by the camera. These visual copies serve as lightweight, inexpensive alternatives to complex physical tracking markers, enabling accurate tracking through software-based image recognition rather than expensive hardware systems.
3Productivity
If SLAM algorithms are used for mapping, then environmental maps are generated, but the response time to moving objects is slow resulting in poor user experience
Solution Approach 1:
The system performs preliminary actions by pre-identifying and tracking visual position markers in the environment. When an object moves, the system has already established visual tracking of position markers, enabling immediate detection and response to movement without waiting for the slower SLAM algorithm to re-process the entire environment.
Solution Approach 2:
The system transitions from static SLAM-based mapping to dynamic VPS-based tracking for moving objects. This dynamic approach allows the system to adapt its processing method based on object motion, using fast visual tracking for moving objects while maintaining comprehensive mapping through SLAM for static elements, thereby improving overall response speed.
Data Source
AI summary
Embodiments provide for an augmented reality (AR) system able to track the movement of real-world objects and apply that movement to virtual objects. The AR system includes a radio configured to receive first sensor data from a sensor attached to a first physical object in physical space. The AR system further includes a processor configured to determine when a physical object changes from a first state to a second state object based on the first sensor data, and update an environmental map based on the change from the first state to the second state of the first physical object.