Augmented Reality Platform Multi-Sensor Fusion Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality technologies face challenges in accurately placing and re-localizing digitally rendered objects in a digitally enhanced environment, particularly due to limitations in camera-based systems that struggle with occlusion and precision accuracy, hindering shared experiences between users.

Innovation Solution

An augmented reality platform utilizing an array of locationing devices that determine perspective values through visual-inertial odometry, radio wave positioning, and acoustic positioning, with a server processing these values to maintain a digital map for precise geospatial correlation of physical and virtual objects, enabling accurate rendering and sharing of augmented reality experiences across connected devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If camera-based systems are used for augmented reality placement, then the system is easy to operate, but measurement precision and re-localization accuracy deteriorate

Engineering Contradiction:
Improveease of useVSAvoidplacement accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent combines multiple positioning technologies (visual-inertial odometry, radio wave positioning, acoustic positioning) into a unified system. This merging of different measurement methods enables the system to achieve high precision placement and re-localization while maintaining ease of operation through automated multi-sensor fusion.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a server as an intermediary that receives data from multiple locationing devices, processes the information, and determines decided values for physical objects. This intermediary coordinate system acts as a mediator between various positioning methods and the final augmented reality placement, ensuring high accuracy without requiring complex user calibration.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If complex calibrated equipment is used for accurate placement, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improveplacement accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs self-calibration and self-positioning through automated sensor fusion. The multiple locationing devices automatically determine their positions and orientations relative to each other and to physical objects without requiring manual calibration by users. This self-service approach maintains high precision while minimizing the complexity of user operations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent creates a universal coordinate system that can be used across multiple devices and applications. The server maintains a digital map and digital library that serve multiple functions: storing spatial information, enabling re-localization, and supporting various augmented reality applications. This multi-functionality reduces the need for separate calibration equipment for different use cases.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If occlusion handling is improved through precise metrics, then measurement precision improves, but the difficulty of detecting and measuring increases

Engineering Contradiction:
Improveobject metrics accuracyVSAvoidocclusion detection difficulty
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent moves the complexity of occlusion detection from the 2D camera view to a 3D spatial coordinate system. By establishing precise three-dimensional positions and orientations of physical objects through multi-sensor fusion, the system can accurately determine occlusion relationships without the difficulty of analyzing 2D image data alone. The added spatial dimension simplifies occlusion detection while improving measurement precision.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances the precision and accuracy of augmented reality experiences by providing a platform for improved geolocationing and spatial correlation, allowing for precise placement and sharing of virtual objects in real-time across multiple devices, overcoming previous limitations in occlusion and re-localization.

Implementation Method 1

an array of locationing devices determines a perspective value of a physical object within a space based on visual-inertial odometry

Methodology Applied
Scientific EffectVisual-inertial odometry:

Implementation Method 2

radio wave positioning

Methodology Applied
Scientific EffectRadio wave positioning: Radar

Implementation Method 3

acoustic positioning

Methodology Applied
Scientific EffectAcoustic positioning: Sonar

Data Source

PatentUS11573317B2Augmented reality platform and method for use of same
Publication Date: 2023.02.07 PFNGT LLC
  • US11573317B2 patent drawing
  • US11573317B2 patent drawing
  • US11573317B2 patent drawing

AI summary

An augmented reality platform and method for use of the same are provided. In one embodiment, an array of locationing devices determine a perspective value of a physical object within a space based on visual-inertial odometry, radio wave positioning, and acoustic positioning. A server determines a decided value of the physical object based on a plurality of perspective values of the physical object received from the array of locationing devices. A digital map and digital library maintained by the server maintain the location of physical objects and spatial experiential objects in order to provide the spatial experiential object to an augmented reality device.