AR Navigation Positioning via Computer Vision Landmark Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) navigation systems fail to integrate graphics seamlessly with the real landscape, resulting in a poor user experience due to the lack of alignment between AR visual indicators and the actual environment, as they are not positioned accurately using traditional GPS with significant margins of error.

Innovation Solution

Implementing a computer vision-based positioning system that uses techniques like Visual Odometry, Visual Inertial Odometry, and Simultaneous Localization and Mapping to generate a 3D map of the environment, allowing AR visual indicators to be accurately positioned and integrated into the real-world scene, such as on roads or paths, by determining the relative position of landmarks and transforming the display accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional GPS positioning is used for AR navigation, then the system is simple to implement, but the positioning accuracy is poor due to significant margins of error

Engineering Contradiction:
Improvepositioning accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple positioning technologies (GPS, visual odometry, inertial measurement units, and computer vision algorithms) into a unified AR navigation system. This integration allows the system to leverage the strengths of each individual technology while compensating for their weaknesses, thereby achieving high positioning accuracy without excessive complexity increase.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system employs a multi-functional positioning architecture that can operate using different methods depending on environmental conditions. The computer vision system can function as GPS when satellite signals are unavailable, and the inertial measurement unit provides continuous positioning data regardless of external signals, creating a universal positioning solution.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If AR graphics are painted on the display without considering the actual environment, then the system is simple to implement, but the user experience is poor due to poor integration with the real landscape

Engineering Contradiction:
Improveuser experienceVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system applies different processing and rendering techniques to different regions of the AR display based on the underlying real-world features. Navigation indicators are positioned and scaled according to their relationship with specific environmental elements like roads, sidewalks, and buildings, creating locally optimized visual integration throughout the scene.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent replaces traditional mechanical GPS-based positioning with computer vision-based visual positioning. By using image processing and feature recognition algorithms, the system determines device position and orientation through visual analysis of the environment rather than relying on satellite signals, enabling more accurate and context-aware AR graphic placement.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11333506B2Computer-vision based positioning for augmented reality navigation
Publication Date: 2022.05.17 GOOGLE LLC
  • US11333506B2 patent drawing
  • US11333506B2 patent drawing
  • US11333506B2 patent drawing

AI summary

Systems and methods for a more usable Augmented Reality (AR) display of navigation indications is described. A live camera image of a scene may be captured from a device. Navigation instructions may be generated from a navigation system and a navigation indication may be generated for display. A computer vision-based positioning algorithm may be performed on the camera image to determine the relative position between the viewpoint of the device and one or more landmarks in the live camera image. The location or shape of the visual display of the navigation indication may be determined based on the computer vision-based positioning algorithm.