Dynamic Indoor Positioning Map via AR Depth Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing indoor positioning systems require significant infrastructure and are not capable of dynamically creating or updating maps, leading to accuracy issues due to environmental changes.

Innovation Solution

A system utilizing an augmented reality (AR) device with depth sensors and a computing device to dynamically create and update three-dimensional indoor positioning maps through simultaneous location and mapping (SLAM) techniques, incorporating various environmental data such as RF signals, magnetic fields, and lighting conditions, and providing guidance for missing or outdated data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional indoor positioning systems use RF anchor nodes and signal strength mapping, then positioning functionality is achieved, but the system requires significant infrastructure capital expenditure and the map accuracy deteriorates over time due to environmental changes

Engineering Contradiction:
Improvemap accuracyVSAvoidinfrastructure requirements
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system enables self-service mapping where the AR device automatically creates and updates the indoor positioning map using its own sensors (depth sensors, cameras, IMU) and SLAM algorithms, without requiring pre-deployed anchor nodes or infrastructure. The device serves itself to generate the positioning data it needs

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical/physical infrastructure of RF anchor nodes and signal strength mapping systems with optical and computational methods. Depth sensors capture spatial information, and SLAM algorithms process this data to create the map, substituting physical infrastructure with sensor-based detection and computational processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If static indoor positioning maps are created using traditional methods, then initial positioning is achieved, but the map becomes inaccurate over time due to environmental changes

Engineering Contradiction:
Improvemap update capabilityVSAvoidpositioning accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system transitions from static mapping to dynamic mapping where the indoor positioning map is continuously updated in real-time. As the AR device moves through the environment, it collects new sensor data and updates the map dynamically, allowing the system to adapt to environmental changes and maintain accuracy over time

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback mechanisms where the AR device continuously compares its current sensor readings with the existing map data, identifies discrepancies or outdated information, and automatically updates the map to reflect current environmental conditions, ensuring ongoing accuracy

Inventive Principle:
Principle #23Feedback

3Measurement precision

If comprehensive environmental data is collected for accurate positioning, then positioning precision is improved, but data collection time and processing complexity increase

Engineering Contradiction:
Improvepositioning precisionVSAvoiddata collection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs data collection continuously as the AR device moves through the environment during normal operation, rather than requiring separate dedicated mapping sessions. The depth sensors, cameras, and other sensors continuously capture data that is immediately processed and integrated into the positioning map, eliminating idle data collection time

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent merges multiple sensing functions (depth sensing, visual capture, inertial measurement) and positioning tasks (mapping, localization, navigation) into a single integrated system. The AR device simultaneously performs environment scanning, map creation, and self-localization, reducing total time by combining multiple operations into one continuous process

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables real-time, accurate, and omni-directional mapping of indoor environments, improving positional accuracy and reducing the need for extensive infrastructure, while allowing for continuous updates and guidance to ensure map relevance.

Implementation Method 1

The AR device also has one or more depth sensors for gathering mapping data of physical objects in the environment

Methodology Applied
Scientific EffectDepth sensing:

Implementation Method 2

The dynamic creation and/or updating of the 3D indoor positioning map may include utilizing simultaneous location and mapping (SLAM) techniques for positioning within the 3D map

Methodology Applied
Scientific EffectSLAM (Simultaneous Localization and Mapping):

Implementation Method 3

The environmental data collected may include any available environmental data, including, but not limited to, all available RF signals, magnetic fields, lighting conditions

Methodology Applied
Scientific EffectRF signal detection:

Implementation Method 4

The environmental data collected may include any available environmental data, including, but not limited to, all available RF signals, magnetic fields, lighting conditions

Methodology Applied
Scientific EffectMagnetic field sensing: Magnetic Field

Data Source

PatentEP3165939B1Dynamically created and updated indoor positioning map
Publication Date: 2020.05.06 HAND HELD PRODS INC
  • EP3165939B1 patent drawingFigure 1
  • EP3165939B1 patent drawingFigure 2

AI summary

A system for creating and/or dynamically updating indoor positioning maps includes an augmented reality (AR) device and a computing device communicatively coupled to the AR device. The AR device has a display for displaying AR content to a user that overlaps the AR device's perspective view of an environment. The AR device also has one or more depth sensors for gathering mapping data of physical objects in the environment. The computing device has a processor that is configured by software to create a three-dimensional (3D) indoor positioning map of the environment in a building based on the mapping data gathered by the AR device, and/or dynamically update the 3D indoor positioning map of the environment in the building based on the mapping data gathered by the AR device.