Augmented Reality Label Placement Using Camera Depth and Line of Sight
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Presenting graphical objects in augmented reality (AR) video streams is challenging, particularly in navigation applications, as it is difficult to determine optimal placement of labels like road signs and directions to ensure user readability and safety.
Innovation Solution
A computing device determines the precise location using camera depth information and selects AR label placements based on distance, priority, and clear line of sight criteria to improve legibility and safety in AR video streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If AR labels are placed in the AR video stream without considering placement criteria, then the quantity of information presented increases, but the legibility and readability of labels deteriorates
Solution Approach 1:
The patent applies local quality by evaluating each candidate AR label placement location individually based on specific criteria including clear line of sight, distance from the user, and priority of the label. Each label is assessed for its local visibility conditions and only selected if it meets the legibility thresholds, ensuring that labels are placed in optimal locations rather than uniformly distributed.
Solution Approach 2:
The system performs preliminary evaluation of candidate AR label placement locations before actually presenting labels to the user. The computing device pre-assesses multiple potential label positions against visibility criteria (clear line of sight, distance, priority) and selects the optimal placements in advance, ensuring legibility before the user views the AR stream.
2Loss of information
If multiple candidate AR labels are presented simultaneously, then the information completeness improves, but the difficulty of selecting relevant labels increases
Solution Approach 1:
The patent implements partial action by not presenting all candidate AR labels simultaneously, but rather selecting and presenting only those labels that meet specific visibility and priority criteria. The system evaluates multiple candidates but presents a filtered subset, avoiding information overload while maintaining completeness of essential navigation information.
Solution Approach 2:
The system changes parameters by applying multiple selection criteria (clear line of sight, distance thresholds, priority levels) to filter candidate labels. These parameter-based filters transform the set of all candidate labels into a optimized subset that is both informative and easily distinguishable, resolving the difficulty of selecting relevant labels among many candidates.
3Ease of operation
If AR video stream is made available during user movement, then the usability for navigation improves, but the safety of the user deteriorates
Solution Approach 1:
The patent applies dynamics by making the availability of the AR video stream conditional and adaptive based on user movement state. The system dynamically adjusts whether the AR stream is presented based on real-time detection of user movement, transitioning between states of availability and unavailability to balance usability and safety.
Solution Approach 2:
The system implements preliminary anti-action by detecting user movement and preventing presentation of the AR video stream before harm can occur. The movement detection mechanism proactively blocks AR stream access when movement is detected, counteracting the potential safety hazard before the user can be harmed by distracted walking.
Data Source
AI summary
In some implementations, a computing device can present augmented reality (AR) labels in an AR video stream. For example, the computing device can obtain route information for a route requested by a user and can determine locations along the route for placing candidate AR labels. The computing device can determine the precise location of the computing device using camera depth information obtained in response to the user scanning the local real-world environment with a camera of the computing device. The computing device can select an AR label and/or label placement location for presentation in an AR video stream based on various criteria, including the distance between the candidate AR labels and the precise location of the computing device, priorities assigned to each candidate AR label, and/or whether a clear line of sight exists between the precise location of the computing device and the candidate AR label location.