AR Navigation Overlay with Object Masking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional navigation systems rely on stored maps that do not account for new or mobile objects in the user's path, leading to potential confusion and safety issues, as guidance indicators may overlap with dynamic objects like vehicles or pedestrians.

Innovation Solution

An augmented reality navigation system that uses real-time image processing and artificial intelligence to generate guidance indicators that adapt to changing objects in the environment, creating an overlay effect where the indicators appear to lie underneath pathway objects rather than blending with them, thereby enhancing safety and realism.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional navigation systems display guidance indicators over stored maps, then navigation directions can be provided, but the indicators may overlap with dynamic objects like vehicles or pedestrians causing confusion and safety issues

Engineering Contradiction:
Improvenavigation safetyVSAvoidvisibility of dynamic objects
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system transitions from static map-based navigation to dynamic real-time navigation by continuously capturing images and detecting moving objects. The guidance indicator dynamically adjusts its position and appearance based on detected objects, ensuring it does not overlap with vehicles or pedestrians while providing accurate navigation directions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system introduces an intermediary layer between the guidance indicator and the background scene by detecting moving objects and adjusting the indicator's rendering. This intermediary processing ensures that guidance indicators are rendered only in areas not occupied by dynamic objects, preventing confusion and safety issues.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Illumination intensity

If guidance indicators are made prominent and large, then they are more visible to users, but they may obscure important dynamic objects in the user's path

Engineering Contradiction:
Improveguidance indicator visibilityVSAvoidobscuration of dynamic objects
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The system applies local quality by rendering the guidance indicator with varying transparency or visibility in different regions. The indicator is made prominent in areas without dynamic objects but becomes transparent or adjusts its appearance when approaching detected objects, ensuring both visibility and safety.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The guidance indicator's visual properties are dynamically adjusted based on the presence and position of detected objects. The system continuously modifies the indicator's appearance to maintain prominence when safe and reduce obscuration when objects are detected, creating a responsive navigation display.

Inventive Principle:
Principle #15Dynamics

3Reliability

If the system processes real-time images to detect moving objects, then navigation safety is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improvenavigation safetyVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments the image processing task by focusing detection efforts on specific regions of interest, such as the road surface and areas where dynamic objects are likely to appear. This segmentation reduces the overall computational complexity while maintaining safety through targeted object detection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements partial action by detecting only the most critical moving objects (vehicles and pedestrians) rather than analyzing all possible elements in the scene. This selective detection approach maintains navigation safety while reducing computational burden compared to comprehensive scene analysis.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11448518B2Augmented reality navigational overlay
Publication Date: 2022.09.20 GOOGLE LLC
  • US11448518B2 patent drawing
  • US11448518B2 patent drawing
  • US11448518B2 patent drawing

AI summary

A system and method may generate a more realistic augmented reality (AR) overlay by generating a segmentation image and blending it with one or more other images. The system may generate a segmentation image based on an input image. The segmentation image may be blended with an AR path overlay image to generate an object-masked AR path overlay image. The object-masked AR path overlay image may be blended with the input image to generate an output image.