Real-Time POI Overlay on Mobile Camera Views

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional map programs on smartphones do not provide real-time information on the user's surroundings, making it difficult for users to navigate as they may not recognize their environment due to changes such as new buildings or outdated POI labels.

Innovation Solution

A system and method that captures real-time images using a mobile device's camera, determines the device's location, sends this information to a server, and superimposes Point of Interest (POI) information, including labels and navigation directions, onto the image displayed on the device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional map programs use pre-stored map images with labels, then the system complexity is low and energy consumption is minimal, but the information is not real-time and users cannot recognize current surroundings

Engineering Contradiction:
Improvereal-time information accuracyVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges real-time camera imaging with map information display, combining the live visual feed from the camera module with overlaid POI labels and navigation data to create an augmented reality navigation experience that provides both real-time visual confirmation and informational context

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system transitions from static pre-stored map images to dynamic real-time camera feeds that continuously update based on user movement, with POI information dynamically overlaid on the current view to reflect the user's changing position and orientation

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If conventional map programs display static images, then energy consumption is low, but the navigation accuracy and user orientation in changing environments deteriorates

Engineering Contradiction:
Improvenavigation accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system uses periodic updates of camera feeds and POI information at optimized intervals, balancing the need for real-time navigation accuracy with energy conservation by not requiring continuous high-frequency updates when the user is moving slowly or stationary

Inventive Principle:
Principle #19Periodic action

3Ease of operation

If the system superimposes POI information on real-time images, then the ease of operation and user understanding improves, but the device complexity and processing requirements increase

Engineering Contradiction:
Improveuser understandingVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system applies POI information locally by selectively overlaying labels only on relevant features visible in the current camera view, such as buildings or landmarks directly in front of the user, rather than displaying all possible information, which reduces processing complexity while maintaining ease of operation

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9699373B2Providing navigation information to a point of interest on real-time street views using a mobile device
Publication Date: 2017.07.04 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US9699373B2 patent drawing
  • US9699373B2 patent drawing
  • US9699373B2 patent drawing

AI summary

Method of and systems for providing point of interest (POI) information on a mobile device is described. The method of providing point of interest (POI) information on a mobile device including a non-transitory computer readable medium including a program, a processor, and a computer executable program code includes: initiating capture of a real-time image by a camera module of a mobile device; determining location information of the mobile device; sending the location information to a server; receiving POI information from the server, wherein the POI information relates to at least one object near the mobile device and currently appearing in the real-time image; and displaying the POI information, superimposed on the real-time image, on the mobile device.