Passive Relocalization Using Broadcast 3D Map Packages

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing artificial reality systems face challenges in providing continuous and accurate localization in new environments without relying on power-intensive two-way communication methods, which also raises privacy concerns due to the need to transmit sensitive user data.

Innovation Solution

A passive relocalization technique using feature maps, where a sequence of map packages comprising feature descriptors is broadcast from base stations, allowing artificial reality devices to determine their pose without transmitting information, thereby optimizing power consumption and maintaining user privacy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If two-way communication methods are used for localization, then localization accuracy is improved, but power consumption increases and user privacy is compromised

Engineering Contradiction:

Improvelocalization accuracyVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent inverts the traditional localization approach by having base stations broadcast map data to devices instead of devices requesting and receiving localization data from servers. This passive reception method eliminates the need for devices to transmit data back, reducing power consumption while maintaining localization accuracy through the broadcasted map packages containing feature descriptors and pose information.

Inventive Principle:

Principle #13The other way round (Inversion)

Solution Approach 2:

The system enables devices to perform localization autonomously by receiving pre-packaged map data that contains all necessary information for determining device pose. The device independently processes the broadcasted map packages and feature descriptors to calculate its location without requiring continuous two-way communication or server interaction, thus saving power while maintaining accuracy.

Inventive Principle:

Principle #25Self-service

2Measurement precision

If two-way communication methods are used for localization, then localization accuracy is improved, but user privacy is compromised

Engineering Contradiction:

Improvelocalization accuracyVSAvoidprivacy concerns

Core Design Contradiction:

Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent reverses the data flow direction so that base stations unidirectionally broadcast map packages to devices without requiring devices to transmit any information back. This eliminates the transmission of sensitive user data over networks, addressing privacy concerns while maintaining localization accuracy through the use of broadcasted feature descriptors and pose information.

Inventive Principle:

Principle #13The other way round (Inversion)

3Measurement precision

If continuous data transmission is performed for localization, then localization accuracy is maintained, but power consumption increases

Engineering Contradiction:

Improvelocalization accuracyVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSLoss of energy

Solution Approach 1:

The system uses periodic broadcasting of map packages by base stations at scheduled intervals, allowing devices to receive localization data passively without continuous transmission. Devices can determine their pose from these periodic broadcasts, maintaining localization accuracy while significantly reducing power consumption compared to continuous two-way communication.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

Devices independently process the periodically broadcasted map packages and feature descriptors to maintain accurate localization without requiring continuous server communication. This autonomous processing approach maintains localization precision while eliminating the energy costs associated with continuous data transmission and processing.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS12299918B2Methods and systems to facilitate passive relocalization using three-dimensional maps

Publication Date: 2025.05.13 META PLATFORMS TECHNOLOGIES LLC

AI summary

A method includes accessing map data of an area of a real environment, the map data comprising three-dimensional feature descriptors describing features visible in the real environment. A plurality of map packages are generated based on the map data, wherein each of the map packages (1) corresponds to a two-dimensional sub-area within the area of the real environment, and (2) comprises a subset of the three-dimensional feature descriptors describing features visible in the sub-area. A first sequence of the plurality of map packages are broadcast through one or more base stations, wherein the first sequence is based on the two-dimensional sub-area of each of the map packages, wherein each of the map packages is configured to be received and used by an artificial-reality device to determine a pose of the artificial-reality device in the associated sub-area based on the associated subset of the three-dimensional feature descriptors.