Portable Terminal Camera Image Matching with Map Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of portable navigation systems must manually match visual objects on the street with digital map displays, which is cumbersome, especially for distant objects, and requires physical verification, limiting the efficiency of travel route guidance.

Innovation Solution

A method that uses a portable terminal equipped with GPS, azimuth, and inclination sensors to match camera-photographed images with map data by calculating location information, extracting object contours, and overlaying text information from the map data onto the images, allowing for accurate object identification and travel route guidance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a user manually checks and matches objects on the map with actual objects on the street one-by-one, then the user can identify the correct object, but the process becomes time-consuming and cumbersome

Engineering Contradiction:
Improveobject identification accuracyVSAvoidtime for manual matching
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent captures an actual image of the object on the street using a camera and displays it on the terminal screen, creating a visual copy of the real-world object. This allows the user to directly compare the captured image with the map display without manually searching through multiple map objects, significantly reducing the time required for object identification while maintaining accuracy

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent merges the map display and the captured actual object image into a single integrated view on the terminal screen. By overlaying or juxtaposing the map information with the real-world photograph, the system combines digital map data with physical world visualization, enabling simultaneous verification of both map accuracy and real-object identification in one action

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If the object building is located far away from the user's current location, then the user can still access map information, but the user must physically move to the object location to verify and obtain accurate information

Engineering Contradiction:
Improveaccess to distant object informationVSAvoideffort to obtain object information
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The camera captures an image of the distant object, creating a visual replica that can be displayed and analyzed on the terminal without requiring physical proximity. This allows users to obtain and verify information about distant objects remotely, eliminating the need to travel to the object's location while maintaining the ability to accurately identify and gather information about it

Inventive Principle:
Principle #26Copying

3Ease of operation

If the navigation system displays only a digital map, then the system remains simple, but the user has difficulty visually matching map objects with actual street objects

Engineering Contradiction:
Improvevisual matching easeVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system merges the digital map display with the captured photograph of the actual object on the street, presenting both visual references simultaneously on the terminal screen. This integration allows users to directly compare map representations with real-world objects without switching between separate applications or devices, greatly enhancing visual matching ease while adding only minimal complexity through the camera function

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient matching of camera-photographed images with map data, reducing the need for manual verification and enhancing the accuracy and convenience of travel route guidance by displaying relevant text information and icons on the terminal.

Implementation Method 1

Each GPS satellite circles the earth approximately every 12 hours to transmit navigation messages. A GPS receiver receives the navigation messages periodically transmitted from at least four or more GPS satellites

Methodology Applied
Scientific EffectGPS satellite signal transmission:

Implementation Method 2

determining an azimuth angle of a central axis of the camera using an azimuth sensor disposed on the portable terminal

Methodology Applied
Scientific EffectAzimuth detection:

Implementation Method 3

determining an inclination of the camera using an inclination sensor disposed on the portable terminal

Methodology Applied
Scientific EffectInclination detection:

Implementation Method 4

photographing at least one object with a camera disposed on a portable terminal

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP2840358B1Matching camera-photographed image with map data in portable terminal
Publication Date: 2017.09.06 LG ELECTRONICS INC
  • EP2840358B1 patent drawingFigure 1
  • EP2840358B1 patent drawingFigure 2
  • EP2840358B1 patent drawingFigure 3

AI summary

The present invention relates to matching a camera-photographed image with map data in a portable terminal. Location information of objects of images photographed by a camera and location information of display objects, such as a building included in the map data are calculated based on location information of the camera, and the calculated location information is used to match the objects with the display objects. The image photographed by the camera is displayed on a screen, and text information of display objects matched to the objects is read out from the map data and is displayed on the locations of the objects displayed on the screen. If a user moves, a travel route is guided using the matching information between the objects and display objects, so the user can be guided with the travel route while personally checking objects such as a building.