Coarse Relocalization via Signal Fingerprint Stitching

Solution Overview

Problem

Conventional methods for self-orientation of devices like mixed-reality head-mounted displays and robots require large memory and long load times due to the need to load all map data sets before determining their position in a three-dimensional coordinate space, which is inefficient and resource-intensive.

Innovation Solution

A method involving a client fingerprint program that generates a current fingerprint based on sensor data, compares it to stored fingerprint data, and requests corresponding map data sets from a remote system to stitch into local maps, allowing for efficient loading and orientation within the physical environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all map data sets are loaded into memory before device orientation, then complete environmental map data is available for accurate localization, but memory requirements increase and load times become longer

Engineering Contradiction:

Improvelocalization accuracyVSAvoidmemory requirements

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent segments the complete map data into multiple map data sets, each associated with specific geographic regions or areas. Instead of loading all map data at once, the system loads only the relevant map data set corresponding to the device's current location, determined through fingerprint matching. This segmentation approach reduces memory requirements while maintaining localization accuracy by loading data in manageable portions.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary action by pre-computing and storing fingerprint data for different map data sets in advance. When the device needs to localize, it quickly compares sensor-generated fingerprints against these pre-stored fingerprints to identify the current location, then loads the corresponding map data set. This preliminary preparation enables fast location identification without requiring complete map data to be loaded into memory first.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If all map data sets are loaded into memory before device orientation, then complete environmental map data is available for accurate localization, but load time increases

Engineering Contradiction:

Improvelocalization accuracyVSAvoidload time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the complete map data into multiple map data sets, each associated with specific geographic regions or areas. Instead of loading all map data at once, the system loads only the relevant map data set corresponding to the device's current location, determined through fingerprint matching. This segmentation approach reduces memory requirements while maintaining localization accuracy by loading data in manageable portions.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary action by pre-computing and storing fingerprint data for different map data sets in advance. When the device needs to localize, it quickly compares sensor-generated fingerprints against these pre-stored fingerprints to identify the current location, then loads the corresponding map data set. This preliminary preparation enables fast location identification without requiring complete map data to be loaded into memory first.

Inventive Principle:

Principle #10Preliminary action

3Quantity of substance

If signal fingerprint comparison is used to identify current location, then memory requirements and load times are reduced, but the process becomes more complex

Engineering Contradiction:

Improvememory requirementsVSAvoidrelocalization process complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent introduces fingerprint data as an intermediary between the device sensors and the map data sets. Instead of directly matching device position against complete map data, the system uses fingerprint comparison as an intermediate step to identify the current location. This intermediary approach simplifies the overall process by breaking it into manageable steps: generate fingerprint, compare with stored fingerprints, identify location, then load corresponding map data set.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10600252B2Coarse relocalization using signal fingerprints

Publication Date: 2020.03.24 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

A first display device and method are provided for accelerating the coarse relocalization process of the first display device by generating a session-specific identifier and sending it to a second display device, which transmits the identifier to a cloud service, which returns at least a portion of a map data set corresponding to the identifier. The returned map data set is then stitched into the local map data of the first display device to create an integrated map, which is used to render one or a plurality of holograms. The first display device may comprise a processor, a memory operatively coupled to the processor, and a fingerprint program stored in the memory and executed by the processor.