AR Navigation Sidewall Overlay for Positioning Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The accuracy of positioning technology, such as GPS, used in augmented reality guidance is relatively low, leading to misaligned or inaccurate navigational information, potentially confusing users and causing them to be directed to cross streets unnecessarily.

Innovation Solution

A method that determines the position and orientation of a mobile terminal, uses map data to augment the display of visible images by presenting navigational information on sidewall surfaces within the image, ensuring accurate and intuitive direction signs, even when the terminal's orientation or position changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If GPS positioning technology is used to determine user location in augmented reality guidance, then the system can provide directional information and navigation guidance, but the positioning accuracy is relatively low causing misalignment between navigational information and visual representation

Engineering Contradiction:
Improvepositioning accuracyVSAvoidnavigation information accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces an intermediary system that includes a camera to capture real-time images of the user's surroundings, image processing algorithms to identify physical landmarks and features, and a mapping system to correlate these visual features with GPS coordinates. This intermediary layer compensates for GPS inaccuracies by using visual recognition to determine the user's precise location and orientation relative to physical structures, thereby aligning navigational information with the actual visual representation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges multiple data sources including GPS positioning data, camera-captured images, image recognition results, and map data into a unified augmented reality display. By combining these diverse data streams, the system achieves higher overall accuracy than GPS alone, as the visual recognition component corrects positioning errors and the integrated display presents navigational information that is accurately overlaid on the real-world view.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of operation

If directional arrows are displayed in augmented reality to indicate travel direction, then users receive navigation guidance, but low positioning accuracy causes the arrows to be displaced from the actual user location and misaligned with streets and sidewalks

Engineering Contradiction:
Improvenavigation guidanceVSAvoiddirectional information alignment
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system uses image recognition as an intermediary to identify physical landmarks, street layouts, and sidewalk features in the captured images. This visual information serves as a reference framework that corrects the displacement and misalignment caused by inaccurate GPS data, allowing directional arrows to be properly positioned and oriented relative to actual streets and sidewalks rather than being offset from the user's true location.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If GPS positioning is used to determine user location, then navigation information can be provided, but users may be directed to cross streets unnecessarily due to difficulty in pinning down the precise location

Engineering Contradiction:
Improvenavigation efficiencyVSAvoidunnecessary street crossings
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system implements feedback by continuously comparing the user's GPS-reported location with the actual visual features detected by the camera and image recognition system. This real-time feedback loop allows the system to detect and correct positioning errors, preventing the user from being misled into unnecessary street crossings. The navigational directions are dynamically adjusted based on the corrected position, ensuring efficient routing that avoids wasteful maneuvers.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3098569B1Method, apparatus and computer program code for providing navigation information in relation to augmented reality guidance
Publication Date: 2020.04.01 HERE GLOBAL BV
  • EP3098569B1 patent drawingFigure 1
  • EP3098569B1 patent drawingFigure 2
  • EP3098569B1 patent drawingFigure 3

AI summary

A method, apparatus and computer program code are provided to provide navigational information in conjunction with augmented reality guidance. In the context of a method, the position of a mobile terminal is determined. The method also includes determining an orientation of the mobile terminal. Based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, the method further includes providing for augmentation of a display of at least a portion of an image associated with the position. The method provides for augmentation of the display of at least the portion of the image by causing navigational information to be presented upon a sidewall surface of a structure within the image. A corresponding apparatus and computer program code are also provided.