Augmented Reality Indoor Location Tagging via Depth Sensor Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing navigation systems, particularly GPS-based technologies, face challenges in providing precise location tagging in indoor areas due to weak satellite signals and inability to differentiate between closely spaced objects, limiting the ability to effectively tag or identify unknown objects.

Innovation Solution

An augmented reality-based electronic device equipped with an image capture unit, depth sensor, and circuitry that determines a reference point, tracks relative motion, and computes location within an indoor area, allowing for the display of augmented reality content such as annotations, 3D audio, and videos based on object position in a geographic coordinate system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If GPS sensor is used for location tagging, then outdoor location information can be provided, but location precision deteriorates in indoor areas due to weak satellite signals

Engineering Contradiction:
Improvelocation precisionVSAvoidsignal strength
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces an intermediary system consisting of wireless access points and mobile devices that act as mediators between satellite signals and indoor locations. When GPS signals are unavailable indoors, the system uses wireless network infrastructure to relay location information, enabling continuous tracking across both outdoor and indoor environments without direct satellite contact.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent makes the location tagging system universal by enabling it to function in both outdoor GPS-based environments and indoor wireless-network-based environments. The system automatically switches between GPS sensor mode and wireless network mode depending on the environment, providing consistent location tagging capabilities across diverse settings without requiring separate specialized systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If GPS-based geo-tagging system is used, then location information can be provided, but ability to differentiate closely spaced objects deteriorates due to location estimation errors

Engineering Contradiction:
Improveobject informationVSAvoidlocation estimation accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent adds temporal dimension to location tagging by continuously tracking the movement history of mobile devices. Instead of relying solely on spatial precision at a single moment, the system uses the trajectory and movement patterns over time to distinguish between closely spaced objects. This temporal layer of information compensates for spatial measurement limitations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent implements feedback mechanisms where the system continuously monitors location data, compares it with known object positions, and refines its tagging accuracy. By feeding back movement patterns and location history, the system can distinguish between closely spaced objects even when individual position estimates have errors, as the contextual information from continuous tracking provides disambiguation.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate location tagging and identification of objects within indoor areas by creating a local 3D scene map and providing informative content, enhancing navigation and object recognition beyond the limitations of traditional GPS systems.

Implementation Method 1

a depth sensor to a measure a distance to an object

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS10921127B2Augmented reality based electronic device to provide location tagging assistance in an indoor or outdoor area
Publication Date: 2021.02.16 SONY GROUP CORP
  • US10921127B2 patent drawing
  • US10921127B2 patent drawing
  • US10921127B2 patent drawing

AI summary

An augmented reality based electronic device to provide location tagging assistance in an indoor or outdoor area, comprises an image-capture unit, a depth sensor, and circuitry. The circuitry determines a first reference point in a defined indoor area based on a selection of a first location on an application interface rendered at the first electronic device. A second location of the first electronic device in the defined indoor area may be computed based on the track of a relative motion from the first reference point. Output of first augmented reality content for at least a first object viewed through the image-capture unit in the defined indoor area, may be controlled based on a first position of the first object in a specified geographic coordinate system.