SLAM Model Training Using Visual Landmarks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current GPS-based localization systems for motor vehicles face accuracy limitations, especially in urban canyons and adverse weather conditions, degrading to 20-30 meters, which affects navigation and mapping precision.

Innovation Solution

A system utilizing dashboard cameras to capture and upload images to an image server, combining GPS data with aerial imagery to train SLAM models, allowing for accurate localization and mapping by triangulating vehicle location and correcting GPS errors using feature representations from road images and map tiles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If GPS-based localization is used, then coverage area is large, but localization accuracy degrades to 20-30 meters in urban canyons and adverse weather

Engineering Contradiction:
Improvelocalization accuracyVSAvoidperformance in urban canyons and adverse weather
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent introduces visual landmarks (buildings, signs, road features) as intermediary reference points between the vehicle and GPS satellites. By detecting and recognizing these landmarks through cameras and comparing them with map data, the system creates a mediator that enables accurate localization even when GPS signals are unavailable or inaccurate in urban canyons and adverse weather conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical/electromagnetic GPS positioning system with a visual-based localization system using cameras and image recognition. This substitution allows the vehicle to determine its position through visual landmarks and map matching, providing accurate localization independent of GPS signal quality, thereby solving the accuracy degradation problem in urban environments and bad weather.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If visual data from multiple sources is integrated, then localization accuracy improves to meter-level precision, but system complexity increases

Engineering Contradiction:
Improvelocalization accuracyVSAvoidsystem architecture complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the localization system into distinct functional modules: camera subsystem for capturing visual data, processing subsystem for extracting features and matching with maps, and positioning subsystem for calculating vehicle location. This segmentation allows each module to handle specific tasks independently, reducing overall system complexity while maintaining high localization accuracy through coordinated operation of simplified components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal localization framework that can process multiple types of visual data (road images, aerial imagery, satellite maps) and apply the same core algorithmic principles across different data sources. This multi-functionality approach allows the system to achieve meter-level precision by integrating diverse visual information without proportionally increasing complexity, as the same processing pipeline handles various data types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If GPS accuracy is improved by integrating multiple sensors, then localization precision improves, but the system still degrades to 20-30 meters in challenging environments

Engineering Contradiction:
Improvelocalization accuracyVSAvoidconsistency across different environments
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies local quality by using region-specific visual landmarks and map data tailored to each location's unique characteristics. Instead of relying on uniform GPS processing, the system detects and utilizes locally relevant features (specific buildings, signs, road configurations) to provide accurate localization for each environment. This ensures consistent high accuracy across diverse settings including urban canyons, rural areas, and adverse weather conditions, as each location's local visual characteristics are leveraged appropriately.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11428537B2Localization and mapping methods using vast imagery and sensory data collected from land and air vehicles
Publication Date: 2022.08.30 NEXAR LTD
  • US11428537B2 patent drawing
  • US11428537B2 patent drawing
  • US11428537B2 patent drawing

AI summary

A system for training simultaneous localization and mapping (SLAM) models, including a camera, mounted in a vehicle and in communication with an image server via a cellular connection, that captures images labeled with a geographic position system location and a timestamp, and uploads them to an image server, a storage device that stores geographical maps and images, and indexes the images geographically with reference to the geographical maps, an images server that receives uploaded images, labels the uploaded images with a GPS location and a timestamp, and stores the uploaded images on the storage device, and a training server that trains a SLAM model using images labeled with a GPS location and a timestamp, wherein the SLAM model (i) receives an image as input and predicts the image location as output, and/or (ii) receives an image having error as input and predicts a local correction for the image as output.