AR Navigation Label Placement Using Depth and Line of Sight
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Challenges exist in determining optimal placement of graphical objects in augmented reality (AR) video streams to ensure user readability and safety during navigation, particularly with obstacles obstructing the line of sight.
Innovation Solution
A computing device uses camera depth information to determine precise location, selects AR labels based on distance, priority, and line of sight criteria, and adjusts label placement and orientation to enhance readability and safety.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple candidate AR labels are placed along the route, then the navigation information is more comprehensive, but it becomes difficult to determine optimal placement locations that ensure adequate user readability
Solution Approach 1:
The system assigns different priorities to different AR labels based on their importance and visibility characteristics. High-priority labels (e.g., upcoming turns, destinations) are placed optimally regardless of distance, while lower-priority labels are placed only when they meet visibility criteria. This differential treatment resolves the contradiction by ensuring comprehensive information delivery while maintaining readability through selective optimization.
Solution Approach 2:
The system dynamically adjusts label placement parameters including distance thresholds, priority weights, and line-of-sight requirements based on the specific navigation context. By changing these parameters adaptively, the system can accommodate multiple labels while ensuring each one maintains adequate readability, thus resolving the contradiction between information completeness and placement optimality.
2Loss of information
If AR labels are placed at greater distances from the user, then more navigation information is visible, but the labels become harder to read and may obstruct the user's view of the real environment
Solution Approach 1:
The system applies different placement strategies based on label priority and type. Critical navigation information (high-priority labels) is placed at optimal distances that balance visibility and readability, while less critical information may be placed farther away. This localized quality approach ensures that important labels remain readable and do not obstruct the user's view, while still providing comprehensive navigation information.
Solution Approach 2:
The system places labels at varying distances based on their importance, using a partial action approach where not all labels are placed at the same distance. High-priority labels are placed within optimal reading distance, while lower-priority labels may be placed farther away or omitted if they would compromise user safety or readability. This resolves the contradiction by applying distance placement selectively rather than uniformly.
3Loss of information
If the system selects AR labels based on multiple criteria (distance, priority, line of sight), then the most relevant labels are presented, but the selection process becomes more complex
Solution Approach 1:
The label selection process is segmented into distinct evaluation stages: first filtering by minimum distance criteria, then by line-of-sight availability, and finally by priority ranking. This segmentation breaks down the complex multi-criteria selection into manageable steps, making the process more tractable while still achieving comprehensive and relevant label presentation.
Solution Approach 2:
The system performs preliminary filtering of candidate labels based on distance and line-of-sight criteria before applying priority-based selection. By pre-filtering the candidate set, the system reduces the complexity of the final selection process while ensuring that only potentially relevant labels are considered, thus maintaining information relevance without excessive computational complexity.
4Adaptability or versatility
If the user is allowed to move while viewing the AR video stream, then the navigation experience is more dynamic, but the user may be harmed by not being aware of their real-world surroundings
Solution Approach 1:
The system dynamically monitors user motion during AR stream viewing and adjusts the AR label presentation accordingly. When motion is detected, the system can update label positions, adjust visibility, or provide haptic feedback to alert the user of their surroundings. This dynamic adaptation allows the navigation experience to remain engaging while mitigating safety risks through real-time responsiveness to user movement.
Solution Approach 2:
The system implements feedback mechanisms that monitor user motion and provide alerts or warnings when the user moves while viewing the AR stream. This feedback loop maintains the dynamic navigation experience by allowing movement while protecting user safety through timely warnings, thus resolving the contradiction between experience versatility and safety.
Data Source
AI summary
In some implementations, a computing device can present augmented reality (AR) labels in an AR video stream. For example, the computing device can obtain route information for a route requested by a user and can determine locations along the route for placing candidate AR labels. The computing device can determine the precise location of the computing device using camera depth information obtained in response to the user scanning the local real-world environment with a camera of the computing device. The computing device can select an AR label and/or label placement location for presentation in an AR video stream based on various criteria, including the distance between the candidate AR labels and the precise location of the computing device, priorities assigned to each candidate AR label, and/or whether a clear line of sight exists between the precise location of the computing device and the candidate AR label location.


