Vehicle Display System Heading Correction via Visual Odometry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display systems in vehicles, especially those without inertial units, face inaccuracies in true heading determination due to poor magnetometer performance, which is disruptive for head-up and helmet-mounted displays, especially in environments with poor visibility or complex navigation requirements.

Innovation Solution

A display system equipped with an image sensor, image processing module, and modules for determining drift and true heading, which uses environmental images to calculate and correct the true heading in real-time, allowing for accurate projection of synthetic images and symbology on the user's field of view without the need for expensive inertial units or complex databases.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a low-cost AHRS with magnetometer is used to determine heading, then the device cost is reduced, but the true heading accuracy deteriorates

Engineering Contradiction:
Improvedevice costVSAvoidtrue heading accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary system consisting of an image sensor, image processing module, and visual odometry algorithm that mediates between the low-cost magnetometer and the required accurate heading. The image sensor captures environmental images, the image processing module extracts feature points and calculates drift, and this drift information is used to correct the magnetometer-based heading, achieving accurate true heading without expensive inertial units

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the traditional mechanical/inertial heading determination system with an optical-based system using image sensors and visual odometry. Instead of relying solely on magnetometers and inertial measurement units, the system uses environmental image analysis to calculate device drift and correct heading, substituting mechanical sensing with optical processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If visual odometry with database of points of interest is used to correct heading, then true heading accuracy is improved, but the system complexity and implementation difficulty increase

Engineering Contradiction:
Improvetrue heading accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements a self-service system where the image processing module automatically performs feature point detection, matching, and drift calculation without requiring external databases or manual intervention. The system uses real-time environmental images to self-correct heading accuracy, eliminating the need for complex pre-stored databases of points of interest

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces expensive, complex database systems with a lightweight, computation-based approach using standard image processing algorithms. Instead of relying on costly pre-mapped environmental databases, the system uses affordable image sensors and algorithmic feature matching that can operate in diverse environments without requiring expensive infrastructure

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Measurement precision

If visual odometry is used to determine drift and correct heading, then true heading accuracy is improved, but the system becomes inoperable in poor visibility conditions

Engineering Contradiction:
Improvetrue heading accuracyVSAvoidoperability in various environments
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent implements a dynamic system that adapts its operation based on environmental conditions. The image processing module continuously monitors image quality and feature point detection success, dynamically adjusting its operation. When visibility is poor and visual odometry cannot provide sufficient correction, the system gracefully degrades to use the uncorrected magnetometer heading, ensuring continuous operation across all environmental conditions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent prepares for poor visibility conditions by implementing a fallback mechanism that cushions against the failure of visual odometry. The system is designed to switch between visual correction mode and magnetometer-only mode, ensuring that heading information remains available even when environmental conditions prevent successful image-based drift calculation

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS10802276B2Display system, related display method and computer program
Publication Date: 2020.10.13 THALES SA
  • US10802276B2 patent drawing
  • US10802276B2 patent drawing

AI summary

The invention relates to a display system included in a device for traveling a path between at least two distinct points and for using at least one heading datum, wherein the display system comprises at least:an image sensor configured to acquire environmental images during the path traveled by the device;an image processing module capable of determining the drift of the device in real time;a module for determining information that is representative of the route taken by the device,a module for real-time determination of the true heading followed by the device from the information that is representative of the route and the drift of the device,a module for returning to the user information that is representative of the true heading.