Indoor Video Localization via Feature Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing localization technologies, particularly GPS devices, are inadequate for indoor use due to signal interference, and there is a need for improved methods to provide accurate location information and multimedia annotation in indoor environments.

Innovation Solution

A mobile device system that uses a video camera to detect feature points, track locations, and associate annotations with current positions, employing an Extended Kalman Filter for estimation, and outputs annotations superimposed on a live video feed for user guidance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If GPS devices are used for localization, then location information accuracy is improved, but usability in indoor environments deteriorates due to signal blockage

Engineering Contradiction:
Improvelocation information accuracyVSAvoidindoor environment usability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system segments the localization problem into two distinct modes: outdoor GPS-based localization and indoor video-based localization. The mobile device automatically switches between these segments based on GPS signal availability, allowing high precision outdoors while maintaining adaptability indoors through the alternative video-based approach.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces video-based feature point tracking as an intermediary localization method that bridges the gap when GPS signals are unavailable. This intermediary approach uses visual features from the camera to estimate position, enabling continuous localization functionality across both outdoor and indoor environments without complete reliance on GPS.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If video-based localization is implemented, then indoor localization capability is improved, but device complexity increases due to additional processing requirements

Engineering Contradiction:
Improveindoor localization capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-detecting and tracking feature points in the video stream before localization is needed. Feature points are identified and continuously tracked in advance, so when localization is required, the system can quickly compute position from pre-processed feature data, reducing real-time processing complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The mobile device serves itself by using its own camera and processing capabilities to perform localization without requiring external infrastructure. The device independently detects features, tracks them, and computes its position, eliminating the need for complex external systems while maintaining indoor localization capability.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If real-time annotation display is provided, then user navigation experience is improved, but energy consumption increases due to continuous video processing

Engineering Contradiction:
Improveuser navigation experienceVSAvoidenergy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system implements periodic action by updating annotations at specific intervals rather than continuously. The mobile device processes video frames periodically to detect feature points and update location, then displays annotations at these discrete intervals. This periodic approach maintains real-time navigation experience while significantly reducing energy consumption compared to continuous processing.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS9536152B2Methods and systems for multimedia trajectory annotation
Publication Date: 2017.01.03 GENESEE VALLEY INNOVATIONS LLC
  • US9536152B2 patent drawing
  • US9536152B2 patent drawing
  • US9536152B2 patent drawing

AI summary

A system and method of providing annotated trajectories by receiving image frames from a video camera and determining a location based on the image frames from the video camera. The system and method can further include the steps of determining that the location is associated with a preexisting annotation and displaying the preexisting annotation. Additionally or alternatively, the system and method can further include the steps of generating a new annotation automatically or based on a user input and associating the new annotation with the current location.