Multi-Modal SLAM Mapping for Low-Cost Robot Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current localization systems for robots are expensive and not all robots can be equipped with high-accuracy systems like LiDAR or GPS, making it difficult to accurately determine their location in various environments, especially in warehouses where metal structures interfere with satellite signals.

Innovation Solution

A multi-modal localization approach using a combination of high-cost, high-accuracy modules (such as LiDAR and UWB) and low-cost, low-accuracy modules (like cameras and IMUs) to generate two types of maps: a feature-rich map for devices with high-accuracy localization and a feature-poor map for devices with lower accuracy, enabling improved localization capabilities for robots and mobile devices with varying sensor capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-accuracy localization systems like LiDAR or UWB are equipped on robots, then localization accuracy is improved, but device cost increases

Engineering Contradiction:
Improvelocalization accuracyVSAvoiddevice cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The system segments the localization service into two parts: (1) a centralized server that performs computationally intensive SLAM processing using high-accuracy data from LiDAR/UWB, and (2) lightweight client devices that only need to collect sensor data and communicate with the server. This allows high-accuracy localization to be achieved without requiring expensive hardware in every device.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A centralized localization server acts as an intermediary between the robot's sensors and the localization output. The server receives raw sensor data from various modules (LiDAR, UWB, cameras, IMUs), performs sophisticated SLAM processing, and returns refined position estimates. This intermediary enables low-cost devices to access high-accuracy localization services by offloading the computational burden to the server.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multi-modal sensors are integrated for SLAM, then localization accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvelocalization accuracyVSAvoidsensor integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The localization server provides a universal platform that can process data from multiple sensor types (LiDAR, UWB, cameras, IMUs) using a unified SLAM framework. This multi-functional approach allows the same system to work with different sensor configurations without requiring separate processing pipelines for each sensor type, thereby reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically fuses data from multiple sensor modalities and performs SLAM processing without requiring manual configuration or complex integration logic in the client devices. The server autonomously handles sensor calibration, data synchronization, and fusion algorithms, reducing the complexity burden on individual devices while maintaining high localization accuracy.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11561553B1System and method of providing a multi-modal localization for an object
Publication Date: 2023.01.24 VECNA ROBOTICS INC
  • US11561553B1 patent drawing
  • US11561553B1 patent drawing
  • US11561553B1 patent drawing

AI summary

An example method includes gathering, via a first module of a first type, first simultaneous localization and mapping data and gathering, via a second module of a second type, second simultaneous localization and mapping data. The method includes generating, via a simultaneous localization and mapping module, a first map based on the first simultaneous localization and mapping data and the second simultaneous localization and mapping data, the first map being of a first map type and generating, via the simultaneous localization and mapping module, a second map based on the first simultaneous localization and mapping data and the second simultaneous localization and mapping data, the second map being of a second map type. The map of the first type is used by vehicles with module(s) of the first and/or second types and the map of the second type is used by vehicles with a module of the second type exclusively.