Vehicle Localization Using IMU, GPS, and Visual Odometry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle localization methods for autonomous vehicles are costly and inefficient, relying on expensive equipment and complex technologies like Differential GPS (DGPS) or Real Time Kinematic (RTK) for accurate positioning, which increases operational expenses.

Innovation Solution

A cost-effective vehicle localization system utilizing a combination of an inertial measurement unit (IMU), a global positioning system (GPS), and a visual odometry module, with a localization engine that integrates data from these sources using a rotation matrix and translation vector, and employs an extended Kalman filter for accurate state estimation, allowing for the use of less expensive components like gray scale cameras and simplified processing techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If expensive equipment like Differential GPS or RTK is used for accurate vehicle positioning, then measurement precision is improved, but device cost increases

Engineering Contradiction:
Improvevehicle positioning accuracyVSAvoidequipment cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple positioning technologies (GPS, visual odometry, inertial measurement) into a unified localization system. The localization engine integrates data from GPS receivers, cameras, and IMU sensors to achieve accurate vehicle positioning without relying on expensive single-point solutions like RTK or DGPS.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The localization engine serves multiple functions simultaneously: it processes GPS data, performs visual odometry through image processing, integrates inertial measurement data, and provides comprehensive vehicle localization. This multi-functional approach replaces the need for specialized expensive equipment with a versatile integrated system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If complex technologies like RTK or DGPS are employed for precise localization, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvepositioning accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The localization system is divided into distinct functional modules: a GPS module for satellite positioning, a visual odometry module with cameras for image-based positioning, an inertial measurement unit for motion sensing, and a localization engine for data integration. This segmentation allows each component to perform its specific function independently while contributing to the overall accurate localization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The localization engine acts as an intermediary that receives data from multiple sources (GPS, visual odometry, IMU), processes and integrates this information, and produces the final localized position. This intermediary approach simplifies the system by providing a centralized processing point rather than requiring complex direct integration between all components.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If expensive positioning equipment is used, then measurement precision is improved, but operational expenses increase

Engineering Contradiction:
Improvelocation determination accuracyVSAvoidoperational cost
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent employs cost-effective components such as standard GPS receivers, conventional cameras for visual odometry, and affordable IMU sensors instead of expensive specialized equipment. These cheaper components are integrated through sophisticated algorithms in the localization engine to achieve positioning accuracy that would otherwise require much more expensive hardware.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS11372115B2Vehicle localization
Publication Date: 2022.06.28 CYNGN INC
  • US11372115B2 patent drawing
  • US11372115B2 patent drawing

AI summary

The localization of a vehicle is determined using less expensive and computationally robust equipment compared to conventional methods. Localization is determined by estimating the position of a vehicle relative to a map of the environment, and the process thereof includes using a map of the surrounding environment of the vehicle, a model of the motion of the frame of reference of the vehicle (e.g., ego-motion), sensor data from the surrounding environment, and a process to match sensory data to the map. Localization also includes a process to estimate the position based on the sensor data, the motion of the frame of reference of the vehicle, and/or the map. Such methods and systems enable the use of less expensive components while achieving useful results for a variety of applications, such as autonomous vehicles.