AR Model Positioning Correction via Inertial Sensor Mediation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) systems experience jumps or sudden movements of AR models due to errors in visual odometry, leading to misalignment with the actual environment, especially when visual tracking is difficult or not available.

Innovation Solution

The method involves receiving GNSS position data and camera image information to determine camera position and orientation, detecting changes in the AR model's position or rotation, and adjusting the AR reference frame relative to the geospatial reference frame using inertial sensor data to align the AR model with the actual environment, thereby correcting for jumps and maintaining accurate positioning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If visual odometry is used to track AR model position, then the AR model can be displayed in the real-world environment, but jumps and misalignment occur due to errors in visual tracking

Engineering Contradiction:
ImproveAR model positioning accuracyVSAvoidvisual tracking precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary correction mechanism that uses inertial sensor data as a mediator between the visual odometry system and the AR model positioning. The inertial sensors provide alternative position and orientation measurements that serve as a reference to detect and correct jumps caused by visual tracking errors, thereby improving positioning reliability without requiring perfect visual tracking precision

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback by continuously monitoring AR model position changes using both visual odometry and inertial sensors, comparing the measurements, and applying corrections when discrepancies exceed a threshold. This closed-loop feedback mechanism detects jumps in real-time and compensates for them, maintaining accurate AR model positioning despite visual tracking errors

Inventive Principle:
Principle #23Feedback

2Measurement precision

If multiple sensor types are integrated to correct positioning errors, then positioning accuracy improves, but device complexity increases

Engineering Contradiction:
ImproveAR model positioning precisionVSAvoidsensor integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the positioning system into distinct functional modules: visual odometry module, inertial sensing module, and correction module. Each module operates independently with specific responsibilities, and they are integrated through a standardized interface that compares measurements and applies corrections. This segmentation allows for easier implementation and maintenance while achieving improved positioning precision through multi-sensor integration

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3901668B1Methods of displaying an augmented reality model on an augmented reality device
Publication Date: 2024.01.31 TRIMBLE INC
  • EP3901668B1 patent drawingFigure 1
  • EP3901668B1 patent drawingFigure 2
  • EP3901668B1 patent drawingFigure 3

AI summary

Methods for displaying an augmented reality (AR) model on an AR device are disclosed. Alignment between a geospatial reference frame and an AR reference frame is monitored and adjusted to improve placement of the AR model displayed on the AR device.