Headset Auxiliary Tracking After SLAM Loss Near Flat Surfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
SLAM systems in electronic headsets lose tracking when they fail to detect geometrical information from walls or large surfaces, leading to disrupted user experiences and limited operational range.
Innovation Solution
Implement an auxiliary tracking mode that utilizes fingerprint detection on flat surfaces and an external LPS/IMU system to maintain localization and orientation when SLAM tracking is lost, switching seamlessly between modes based on confidence levels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If SLAM system uses edge detection to identify geometry among walls and surfaces, then localization accuracy is improved, but tracking is lost when a wall occupies the entire field of view
Solution Approach 1:
The patent introduces an auxiliary tracking mode that uses LPS (local positioning service) and IMU (inertial measurement unit) as intermediary systems to maintain tracking when SLAM fails. The LPS provides global positioning data and the IMU provides orientation data, serving as mediators that bridge the gap when the primary SLAM system loses tracking capability due to wall occupation of the field of view.
Solution Approach 2:
The system dynamically changes operational parameters by switching between SLAM mode and auxiliary tracking mode based on confidence level thresholds. When SLAM confidence drops below a threshold, the system transitions to using LPS and IMU data, effectively changing the parameters of the tracking system to maintain reliability under different environmental conditions.
2Reliability
If user stays clear of walls to avoid SLAM tracking loss, then tracking reliability is improved, but usable space and user experience deteriorate
Solution Approach 1:
The LPS and IMU system acts as an intermediary that enables reliable tracking without requiring users to maintain distance from walls. This intermediary system provides the necessary positioning and orientation data that would otherwise be provided by SLAM edge detection, freeing users from the constraint of staying clear of walls.
Solution Approach 2:
The system prepares for potential SLAM failure by having an auxiliary tracking mode ready in advance. This cushioning approach ensures that even if SLAM tracking is lost near walls, the system can seamlessly transition to the auxiliary mode, preventing tracking disruptions and maintaining usability in previously restricted spaces.
3Adaptability or versatility
If conventional SLAM system operates near walls, then adaptability is improved, but tracking accuracy deteriorates due to loss of geometrical information
Solution Approach 1:
The system achieves multi-functionality by combining SLAM, LPS, and IMU into a unified tracking system that can operate effectively in diverse environments. The auxiliary tracking mode using LPS and IMU provides universal positioning capability that works near walls where SLAM alone fails, while maintaining accuracy through the complementary nature of these systems.
Solution Approach 2:
LPS and IMU serve as intermediary systems that restore tracking accuracy in environments where SLAM alone cannot provide sufficient geometrical information. The LPS provides accurate global positioning that mediates the loss of local feature-based tracking, while IMU provides orientation data that compensates for the lack of edge detection near walls.
Data Source
AI summary
A method, apparatus, and computer program product maintains the ability of an electronic headset to localize and orient itself in space upon a loss of tracking by a SLAM (simultaneous localization and mapping) system by switching to an auxiliary tracking mode upon detection of a loss of accurate tracking by the SLAM system. In one example, the auxiliary tracking mode is based upon detection of a “fingerprint” on a flat surface imaged by one or more cameras in the headset. The fingerprint is defined by a pattern of photographically-identifiable features on the flat surface, such as a pattern of colors and/or textures. In another example, the auxiliary tracking mode is based upon a location of the headset as obtained from an external LPS (local positioning service) and an orientation of the headset as measured by an IMU (inertial measurement unit) provided in the headset.