AR Navigation Label Placement Using Depth and Line of Sight

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Challenges exist in determining optimal placement of graphical objects in augmented reality (AR) video streams to ensure user readability and safety during navigation, particularly with obstacles obstructing the line of sight.

Innovation Solution

A computing device uses camera depth information to determine precise location, selects AR labels based on distance, priority, and line of sight criteria, and adjusts label placement and orientation to enhance readability and safety.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple candidate AR labels are placed along the route, then the navigation information is more comprehensive, but it becomes difficult to determine optimal placement locations that ensure adequate user readability

Engineering Contradiction:
Improvenavigation information completenessVSAvoidlabel placement readability
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system assigns different priorities to different AR labels based on their importance and visibility characteristics. High-priority labels (e.g., upcoming turns, destinations) are placed optimally regardless of distance, while lower-priority labels are placed only when they meet visibility criteria. This differential treatment resolves the contradiction by ensuring comprehensive information delivery while maintaining readability through selective optimization.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts label placement parameters including distance thresholds, priority weights, and line-of-sight requirements based on the specific navigation context. By changing these parameters adaptively, the system can accommodate multiple labels while ensuring each one maintains adequate readability, thus resolving the contradiction between information completeness and placement optimality.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If AR labels are placed at greater distances from the user, then more navigation information is visible, but the labels become harder to read and may obstruct the user's view of the real environment

Engineering Contradiction:
Improvenavigation information visibilityVSAvoiduser safety and readability
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system applies different placement strategies based on label priority and type. Critical navigation information (high-priority labels) is placed at optimal distances that balance visibility and readability, while less critical information may be placed farther away. This localized quality approach ensures that important labels remain readable and do not obstruct the user's view, while still providing comprehensive navigation information.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system places labels at varying distances based on their importance, using a partial action approach where not all labels are placed at the same distance. High-priority labels are placed within optimal reading distance, while lower-priority labels may be placed farther away or omitted if they would compromise user safety or readability. This resolves the contradiction by applying distance placement selectively rather than uniformly.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If the system selects AR labels based on multiple criteria (distance, priority, line of sight), then the most relevant labels are presented, but the selection process becomes more complex

Engineering Contradiction:
Improvelabel relevanceVSAvoidlabel selection process
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The label selection process is segmented into distinct evaluation stages: first filtering by minimum distance criteria, then by line-of-sight availability, and finally by priority ranking. This segmentation breaks down the complex multi-criteria selection into manageable steps, making the process more tractable while still achieving comprehensive and relevant label presentation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary filtering of candidate labels based on distance and line-of-sight criteria before applying priority-based selection. By pre-filtering the candidate set, the system reduces the complexity of the final selection process while ensuring that only potentially relevant labels are considered, thus maintaining information relevance without excessive computational complexity.

Inventive Principle:
Principle #10Preliminary action

4Adaptability or versatility

If the user is allowed to move while viewing the AR video stream, then the navigation experience is more dynamic, but the user may be harmed by not being aware of their real-world surroundings

Engineering Contradiction:
Improvenavigation experienceVSAvoiduser safety
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system dynamically monitors user motion during AR stream viewing and adjusts the AR label presentation accordingly. When motion is detected, the system can update label positions, adjust visibility, or provide haptic feedback to alert the user of their surroundings. This dynamic adaptation allows the navigation experience to remain engaging while mitigating safety risks through real-time responsiveness to user movement.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback mechanisms that monitor user motion and provide alerts or warnings when the user moves while viewing the AR stream. This feedback loop maintains the dynamic navigation experience by allowing movement while protecting user safety through timely warnings, thus resolving the contradiction between experience versatility and safety.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12524968B2Presenting labels in augmented reality
Publication Date: 2026.01.13 APPLE INC
  • US12524968B2 patent drawing
  • US12524968B2 patent drawing
  • US12524968B2 patent drawing

AI summary

In some implementations, a computing device can present augmented reality (AR) labels in an AR video stream. For example, the computing device can obtain route information for a route requested by a user and can determine locations along the route for placing candidate AR labels. The computing device can determine the precise location of the computing device using camera depth information obtained in response to the user scanning the local real-world environment with a camera of the computing device. The computing device can select an AR label and/or label placement location for presentation in an AR video stream based on various criteria, including the distance between the candidate AR labels and the precise location of the computing device, priorities assigned to each candidate AR label, and/or whether a clear line of sight exists between the precise location of the computing device and the candidate AR label location.