VSLAM Relocation and Reinitialization After Tracking Loss

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Robotic devices equipped with monocular image sensors for visual SLAM often lose tracking in abnormal environments due to poor illumination, featureless environments, or moving objects, making it difficult to resume localization and mapping.

Innovation Solution

The method involves concurrent relocation and reinitialization of the robotic device's pose by capturing and comparing sensor data with stored data, using descriptor-based features to identify and relocate the device, and correlating the new pose with a stored map to resume tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If VSLAM is used for localization and mapping, then the robotic device can construct and update a map of the environment, but tracking is lost in abnormal environments such as poor illumination, featureless environments, or moving objects

Engineering Contradiction:
Improvetracking reliabilityVSAvoidenvironmental adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system segments the localization problem into two independent modules: relocation module that uses sensor data matching to find candidate poses, and reinitialization module that performs feature-based localization. This segmentation allows each module to specialize in handling different aspects of tracking failure, improving overall reliability in abnormal environments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary sensor data capture and storage during normal operation before tracking failure occurs. When tracking is lost, the relocation module can immediately compare pre-captured sensor data with stored data to quickly identify candidate poses, reducing the time to recover from tracking failure without requiring real-time processing during the critical failure period.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If concurrent relocation and reinitialization processes are executed, then resumption of tracking is faster and more reliable, but device complexity increases

Engineering Contradiction:
Improvetracking resumption speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system merges the relocation process and reinitialization process into a single concurrent execution framework. Both processes run simultaneously and share common resources such as sensor data buffers, stored environment data, and coordinate system transformations. This merging reduces redundant operations and allows the system to benefit from both approaches without proportionally increasing complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system introduces a coordination mechanism that acts as an intermediary between the relocation module and reinitialization module. This intermediary manages the concurrent execution, handles resource allocation, and determines which module's results to use based on success criteria. The intermediary abstracts the complexity of concurrent process management, allowing the individual modules to remain relatively simple while achieving high productivity through parallel operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11340615B2Concurrent relocation and reinitialization of VSLAM
Publication Date: 2022.05.24 QUALCOMM INC
  • US11340615B2 patent drawing
  • US11340615B2 patent drawing
  • US11340615B2 patent drawing

AI summary

Various embodiments include processing devices and methods for relocation and reinitialization for a robotic device. Various embodiments may include concurrently relocating a second pose of the robotic device and reinitializing a third pose of the robotic device in response to failing to determine a first pose of the robotic device in the environment and determining that tracking of the robotic device is lost. Various embodiments may include pre-relocating a second pose of the robotic device in the environment in response to failing to determine the first pose of the robotic device in the environment and determining that tracking of the robotic device is lost, relocating a third pose of the robotic device in response to successfully pre-relocating the second pose of the robotic device, and reinitializing a fourth pose of the robotic device in response to unsuccessfully pre-relocating the second pose of the robotic device.