Reliability-Based Keyframe Switching for ICP Visual Odometry Drift

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional visual odometry systems using iterative closest point (ICP) methods suffer from accumulated drift due to sensor noise, necessitating a novel method to enhance performance and reliability.

Innovation Solution

A reliability-based keyframe switching system that includes a camera, a matching device, a transformation device, and a reliability device to determine the reliability of ICP operations, replacing the current keyframe with a new one if the operation is deemed unreliable, and performing transformation estimation to minimize distances between point-pairs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional frame-to-frame alignment method using ICP is used, then computational cost is reduced and matching speed is improved, but drift accumulates due to sensor noise

Engineering Contradiction:
ImproveICP operation speedVSAvoiddrift accumulation
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary keyframe selection and reliability assessment before ICP operations. By pre-identifying reliable keyframes and assessing their quality metrics, the system prepares in advance to avoid drift accumulation, rather than correcting drift after it has accumulated through continuous frame-to-frame alignment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces keyframes as intermediary reference points between distant frames. Instead of directly aligning all consecutive frames which accumulates drift, the system uses selected keyframes as stable intermediaries to break the continuous alignment chain, thereby reducing drift accumulation while maintaining computational efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If keyframe-based pose SLAM method is used to limit drift, then reliability is improved, but device complexity increases due to additional operations

Engineering Contradiction:
Improvedrift reductionVSAvoidsystem operation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system extracts only the essential keyframe selection and reliability assessment functions from the complete SLAM pipeline. By taking out and focusing on these critical sub-functions, the system achieves drift reduction without implementing the full complexity of keyframe selection, loop closure detection, and map optimization required by conventional SLAM systems.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system changes the parameter of reference frame selection from continuous frame-to-frame alignment to discrete keyframe-based alignment with reliability thresholds. This parameter change simplifies the system operations while maintaining drift reduction benefits, as the system only needs to monitor and switch between keyframes based on reliability metrics rather than performing continuous complex SLAM operations.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If continuous frame-to-frame alignment is performed, then measurement precision is maintained, but drift accumulates due to error propagation

Engineering Contradiction:
Improvealignment accuracyVSAvoiddrift accumulation
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary reliability assessment of keyframes before using them for alignment. By pre-evaluating the quality and reliability of potential reference frames, the system ensures that only high-precision, low-error frames are selected for alignment operations, thereby maintaining measurement precision while preventing drift accumulation from unreliable frames.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces reliably selected keyframes as intermediary reference points that break the error propagation chain. Instead of continuously propagating errors through frame-to-frame alignment, the system uses stable keyframes as intermediaries to reset the alignment reference, thereby maintaining precision without accumulating drift.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11080862B2Reliability based keyframe switching system and method adaptable to ICP
Publication Date: 2021.08.03 HIMAX TECH LTD
  • US11080862B2 patent drawing
  • US11080862B2 patent drawing
  • US11080862B2 patent drawing

AI summary

A reliability based keyframe switching system adaptable to iterative closest point (ICP) includes a camera that captures frames; a matching device that determines corresponding pairing between the frames for an ICP operation to form a set of plural point-pairs; a transformation device that performs transformation estimation to estimate transformation that minimizes distances of the point-pairs, and determines whether the estimated transformation converges; and a reliability device that determines whether the ICP operation is reliable, and replaces a current keyframe with a new keyframe if the ICP operation is determined to be unreliable.