Hybrid Localization Using Directed Graphs and 3D Point Clouds

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing navigation and localization mechanisms are complex and provide unsatisfactory performance in building metric-accurate maps of environments, which are essential for precise agent location and navigation.

Innovation Solution

A hybrid approach using a directed graph for topological representation and a 3D point cloud for metric-accurate mapping, allowing probabilistic location determination and navigation within the environment, enabling direct movement between locations without following edges and avoiding obstacles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a metric-accurate map is built using traditional SLAM approaches, then localization precision is improved, but system complexity and computational requirements increase significantly

Engineering Contradiction:
Improvelocalization precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the mapping and localization problem into two distinct components: a topological map (directed graph) for navigation planning and a metric map (3D point cloud) for precise localization. This segmentation allows each component to specialize - the topological map simplifies navigation decisions while the metric map provides accurate position estimation, avoiding the need for a single complex system to handle both functions simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary module that fuses data from both the topological map and metric map. This intermediary processes observations from sensors, compares them against both map representations, and integrates the results to produce accurate localization. The intermediary acts as a mediator that reconciles the different levels of abstraction between topological and metric representations, enabling the system to leverage benefits of both approaches.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a detailed metric-accurate map is maintained, then navigation accuracy is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvenavigation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system segments map representation into topological (for routing) and metric (for positioning) components. This allows the navigation system to quickly query the topological map for path planning without processing heavy metric data, while only engaging the computationally intensive metric map processing when precise position estimation is needed, thereby reducing overall processing time.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs partial processing by maintaining the metric map at a level of detail sufficient for localization purposes without processing all possible environmental data in full metric accuracy. The 3D point cloud is constructed selectively from sensor data, focusing on features that are most useful for localization while omitting redundant details, thus achieving acceptable navigation accuracy with reduced computational burden.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If traditional SLAM is used to build metric maps, then localization capability is improved, but the system becomes less adaptable to dynamic environments

Engineering Contradiction:
Improvelocalization capabilityVSAvoidadaptability to dynamic environments
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system segments the mapping functionality into topological and metric components, where the topological map can be more easily updated and restructured in response to environmental changes. The directed graph structure allows for flexible addition, removal, or modification of nodes and edges as the environment changes, while the metric map maintains stable geometric references. This segmentation enables independent adaptation of each component to dynamic conditions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic adaptability by allowing the topological map to be continuously updated as the agent explores new areas or discovers changes in the environment. The directed graph structure naturally accommodates dynamic modifications - new nodes can be added, existing edges can be modified or removed - without requiring complete remapping. This dynamic restructuring capability makes the system highly adaptable to changing environments while maintaining localization accuracy through the stable metric map component.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10088317B2Hybrid-approach for localization of an agent
Publication Date: 2018.10.02 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10088317B2 patent drawing
  • US10088317B2 patent drawing
  • US10088317B2 patent drawing

AI summary

Methods and systems for determining the location of an agent within an environment using a hybrid approach are provided. The hybrid approach allows a potentially large physical space to be compressed in the form of a directed graph, in which edges are paths and nodes are locations. An image comparison produces observations for each location and path, which can be used to probabilistically locate the agent in the environment and to select a portion of the 3D point cloud for comparison. The agent can then be localized within the 3D point cloud, or metric-accurate map, using the same features utilized for image matching in the probabilistic location.