Hybrid AR Motion Stabilization for Readable In-Vehicle Overlays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems fail to maintain the readability and usability of graphical elements during sudden motion, such as in vehicles, due to insufficient compensation for user head movements and display instability, leading to motion artifacts and impaired interaction.
Innovation Solution
An AR system that incorporates hybrid anchoring using dynamic pose analysis of the user's eye, updating a 3D view frustum and maintaining a spatial anchor to stabilize graphical elements during sudden motion, with adaptive rendering modes based on predefined thresholds and real-world reference objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If graphical elements are anchored to real-world objects using world-locking techniques, then spatial consistency with the physical world is maintained, but readability and usability deteriorate during sudden motion due to motion artifacts
Solution Approach 1:
The system dynamically switches between two anchoring modes: world-locking for normal conditions and eye-tracking-based anchoring for sudden motion detection. This dynamic adaptation allows the system to maintain spatial consistency during stable periods while prioritizing readability during motion events, resolving the contradiction between these two requirements.
Solution Approach 2:
The system changes the anchoring parameter from world-coordinate-based positioning to eye-coordinate-based positioning when motion is detected. This parameter change enables the graphical elements to stabilize relative to the user's gaze during sudden motion, improving readability while maintaining spatial awareness through the hybrid approach.
2Object-affected harmful factors
If graphical elements are anchored to optical infinity to reduce parallax, then shaking effects are partially mitigated, but association with near-field real-world objects is lost
Solution Approach 1:
The system dynamically adjusts the virtual depth of graphical elements based on the anchoring mode. During eye-tracking-based stabilization, elements are rendered at optimized virtual depths to minimize parallax effects and shaking artifacts. During world-locking mode, elements are properly associated with near-field objects at their correct spatial depths, preserving spatial information.
Solution Approach 2:
The system introduces an intermediary rendering layer that decouples the graphical elements from direct world-locking during motion events. This intermediary layer allows elements to be stabilized relative to the eye while maintaining their logical association with real-world objects through the AR system's spatial understanding, preventing loss of spatial information.
3Reliability
If eye-tracking is used to stabilize graphical elements during motion, then interaction reliability improves, but system complexity increases
Solution Approach 1:
The system applies eye-tracking-based stabilization selectively only during detected sudden motion events rather than continuously. This partial application of the complex eye-tracking functionality reduces the overall system complexity burden while maintaining interaction reliability when it is most needed, avoiding unnecessary computational overhead during normal operation.
Solution Approach 2:
The system uses feedback from motion detection algorithms to trigger eye-tracking stabilization only when required. This feedback-based activation allows the system to manage complexity by engaging the more sophisticated eye-tracking subsystem only during motion events, while relying on simpler world-locking techniques during stable periods.
Data Source
AI summary
When a relative position of a given eye with respect to an optical combiner changes by more than a predefined threshold at least a predefined number of times over a predefined time period, then for a subsequent time period, a three-dimensional (3D) view frustum corresponding to the given eye is updated, in response to the changes in the relative position of the given eye. A spatial anchor is maintained at a predefined position within the 3D view frustum. Corresponding positions for a graphical element are determined in images to be presented to the given eye, based on the predefined position of the spatial anchor within the 3D view frustum. The images are generated for presenting the graphical element to the given eye, positioning the graphical element at the corresponding positions.