AR Initialization Interface for 3D Model Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems require time-consuming and frustrating manual or semi-manual initialization to align 3-D models with physical environments, especially when viewed from different perspectives, leading to user confusion and difficulty in defining correspondence.

Innovation Solution

A specialized initialization user-interface that simultaneously displays top-down and first-person views of a 3-D model and the physical environment, allowing users to interactively align and anchor the model by adjusting lateral position, orientation, and altitude, and then defining correspondence between model and environment features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual or semi-manual initialization is used to align 3-D model with physical environment, then correspondence can be defined, but the process becomes time-consuming and frustrating

Engineering Contradiction:
Improvealignment accuracyVSAvoidinitialization time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary alignment by automatically defining correspondence between 3-D model elements and physical environment features before user interaction. This preliminary action establishes an initial alignment that serves as a starting point, reducing the time required for manual adjustment while maintaining accuracy through subsequent user refinement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides visual feedback by displaying both the 3-D model and physical environment simultaneously with highlighted corresponding elements. This feedback mechanism allows users to verify alignment accuracy in real-time and make precise adjustments, reducing frustration and improving both speed and accuracy of the initialization process.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If 3-D model and physical environment are displayed from different points of view, then comprehensive visualization is achieved, but user confusion increases and correspondence definition becomes difficult

Engineering Contradiction:
Improvevisualization capabilityVSAvoiduser ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system merges multiple views by displaying the 3-D model and physical environment simultaneously in a unified interface. Corresponding elements are highlighted together, allowing users to see both perspectives while maintaining clear visual association between model elements and their real-world counterparts, thus reducing confusion while preserving comprehensive visualization.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system introduces visual highlights and correspondence indicators as intermediary elements that bridge the gap between different viewpoints. These visual mediators make the relationship between 3-D model elements and physical environment features explicit, enabling users to easily define correspondence even when viewing from different perspectives.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9881419B1Technique for providing an initial pose for a 3-D model
Publication Date: 2018.01.30 BENTLEY SYSTEMS INC
  • US9881419B1 patent drawing
  • US9881419B1 patent drawing
  • US9881419B1 patent drawing

AI summary

In one embodiment, augmented reality is facilitated by a special initialization user interface that shows multiple views of a three-dimensional (3-D) model and a representation of a physical environment captured by a camera, where each of the multiple views is updated substantially in real-time as changes are made in another of the multiple views. An approximate lateral position of the representation of the physical environment with respect to the 3-D model is received through user interaction with a first of the views. An approximate orientation of the representation of the physical environment with respect to the 3-D model is received through user interaction with a second of the views. Correspondence is established between a plurality of portions of the 3-D model and a plurality of portions of the representation of the physical environment to anchor the 3-D model to the representation of the physical environment.