AR Navigation Route Guide Alignment via Server Image Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing navigation methods using Augmented Reality (AR) on mobile terminals often fail to accurately match route guide objects with preview images, leading to incorrect guidance in complex downtown areas, as the route guide objects appear to float on the road rather than aligning with the actual street view.

Innovation Solution

A method and system that generates and displays route guide information by matching camera-captured preview images with pre-stored street view images on a server, using location and direction information to accurately overlay virtual route guide objects on the actual street view, ensuring accurate navigation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional AR navigation is applied without modification, then the system is simple to implement, but the route guide objects do not accurately match the preview image and appear to float on the road

Engineering Contradiction:
Improvealignment accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary processing system that includes image matching module, viewpoint information generation module, and route guide object generation module. This intermediary layer processes the preview image to extract viewpoint information (location, direction, pitch, roll, yaw) and uses this information to accurately position route guide objects, resolving the alignment accuracy issue without requiring complete system redesign

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a virtual copy of the real-world environment by generating a virtual viewpoint that matches the camera's preview image. Route guide objects are then positioned in this virtual space based on extracted viewpoint information, allowing accurate alignment with the real-world preview without physically modifying the camera or display system

Inventive Principle:
Principle #26Copying

2Reliability

If route guide objects are overlaid on camera preview, then navigation information is provided in real-time, but the objects may guide users to incorrect roads in complicated downtown areas

Engineering Contradiction:
Improvenavigation accuracyVSAvoidenvironmental complexity
Core Design Contradiction:
ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements feedback by continuously extracting viewpoint information (location, direction, pitch, roll, yaw) from the camera preview and using this information to adjust and reposition route guide objects in real-time. This closed-loop feedback ensures that even in complicated downtown areas, the navigation objects remain accurately aligned with the actual road layout

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary action by pre-processing the preview image to extract viewpoint information before generating route guide objects. This preliminary extraction of location, direction, and orientation data ensures that route guide objects are positioned correctly from the start, preventing guidance to incorrect roads

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2672232B1Method for Providing Navigation Information and Server
Publication Date: 2022.03.02 SAMSUNG ELECTRONICS CO LTD
  • EP2672232B1 patent drawingFigure 1
  • EP2672232B1 patent drawingFigure 2
  • EP2672232B1 patent drawingFigure 3

AI summary

A method for providing navigation information, a machine-readable storage medium, a mobile terminal and a server are provided. The method includes generating a preview image captured by a camera and location information of the mobile terminal; transmitting the preview image and location information to a server, receiving, from the server, route guide information generated based on the preview image and the location information, and displaying the route guide information to a user.