Multi-Camera Visual Odometry for GPS-Denied Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional navigation systems, such as GPS, are ineffective in GPS-denied environments and fail to provide comprehensive visual odometry, limiting their ability to determine the location and orientation of objects or individuals in unknown environments, and do not efficiently share navigational information among team members.

Innovation Solution

A vision-based navigation system using multiple video cameras to capture and process visual data, integrating with secondary sensors like IMUs and GPS, to estimate 3D coordinates and orientation, and recognize landmarks for accurate localization and drift correction, enabling precise navigation and information sharing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If GPS is used for navigation, then location information can be obtained, but it cannot work reliably in GPS-denied environments such as indoors, forests, and urban areas

Engineering Contradiction:
Improvenavigation reliabilityVSAvoidenvironmental adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The navigation system is segmented into multiple independent components: GPS receiver for open environment navigation, visual odometry system for GPS-denied environments, and sensor fusion module. This segmentation allows each component to specialize in specific environments, resolving the contradiction between reliability and environmental adaptability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements multi-functionality by integrating GPS-based navigation and visual odometry-based navigation in a unified platform. The system can automatically switch between GPS mode and visual odometry mode depending on environment, making it universally applicable across both GPS-available and GPS-denied environments.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multiple cameras are used for visual odometry, then comprehensive visual information can be captured, but the relative poses of cameras are fixed and known which constrains the single-camera results

Engineering Contradiction:
Improvevisual odometry precisionVSAvoidmulti-camera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system dynamically determines relative poses of multiple cameras rather than using fixed predetermined poses. The camera pose determination module continuously calculates relative poses based on visual features and sensor data, allowing the system to adapt to different camera configurations and improving measurement precision while managing complexity through dynamic adjustment.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback mechanisms where visual odometry results from individual cameras are continuously evaluated and used to refine the relative pose estimates. This feedback loop allows the system to overcome the constraints of fixed camera configurations by continuously optimizing pose estimates based on actual visual measurements.

Inventive Principle:
Principle #23Feedback

3Productivity

If visual odometry is applied to each camera individually, then pose estimation can be performed, but the results do not take into account data processed by other cameras in the multi-camera system

Engineering Contradiction:
Improvenavigation information processing speedVSAvoidpose estimation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system merges visual data and pose estimation results from multiple cameras through a unified processing framework. The camera pose determination module integrates observations from all cameras to compute consistent relative poses, combining the strengths of each camera while maintaining processing efficiency through coordinated computation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9734414B2Unified framework for precise vision-aided navigation
Publication Date: 2017.08.15 SRI INTERNATIONAL
  • US9734414B2 patent drawing
  • US9734414B2 patent drawing
  • US9734414B2 patent drawing

AI summary

A system and method for efficiently locating in 3D an object of interest in a target scene using video information captured by a plurality of cameras. The system and method provide for multi-camera visual odometry wherein pose estimates are generated for each camera by all of the cameras in the multi-camera configuration. Furthermore, the system and method can locate and identify salient landmarks in the target scene using any of the cameras in the multi-camera configuration and compare the identified landmark against a database of previously identified landmarks. In addition, the system and method provide for the integration of video-based pose estimations with position measurement data captured by one or more secondary measurement sensors, such as, for example, Inertial Measurement Units (IMUs) and Global Positioning System (GPS) units.