Augmented Reality Annotation Alignment with Transparent 3D Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current state-of-the-art technology limits interaction with 3D CAD models in real-world environments, particularly in augmented reality, by superimposing annotations on real-world objects without allowing for effective visualization and manipulation of model-based definition data.

Innovation Solution

A computer-implemented method that generates a 3D model of a real-world object, aligns it with the corresponding real-world object in a real-world environment, reduces the visibility of the 3D model's geometric entities, and displays annotations on the real-world object, enabling interaction and annotation within an augmented reality setting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If annotations are superimposed on real-world objects in augmented reality, then annotation visibility is improved, but interaction with the 3D model is lost

Engineering Contradiction:
Improveannotation visibilityVSAvoidinteraction with 3D model
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent introduces a transparent 3D model as an intermediary between the real-world object and the annotations. The transparent model allows users to interact with the model geometry while maintaining visibility of the real object, and serves as a carrier for annotations that would otherwise be superimposed directly on the real object. This mediator enables both interaction and annotation visibility simultaneously.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent moves annotations from being superimposed on the 2D camera view of the real object to being attached to the 3D model in three-dimensional space. This dimensional transition allows annotations to be positioned relative to the model geometry while the transparent model allows users to see through to the real object, resolving the contradiction between annotation visibility and interaction capability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If a 3D model is displayed in augmented reality, then model-based definition data visualization is improved, but the real-world object becomes less visible

Engineering Contradiction:
ImproveMBD data visualizationVSAvoidreal-world object visibility
Core Design Contradiction:
Loss of informationVSIllumination intensity

Solution Approach 1:

The patent applies transparency (a visual property similar to color/optical changes) to the 3D model, making it partially transparent so that users can see through the model to the real-world object. This allows the MBD data visualization to be displayed on the model while maintaining visibility of the real object, resolving the contradiction between information visualization and object visibility.

Inventive Principle:
Principle #32Color changes

3Measurement precision

If annotations are displayed on the 3D model, then annotation precision is improved, but annotation visibility in real-world context is reduced

Engineering Contradiction:
Improveannotation precisionVSAvoidannotation visibility
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The transparent 3D model serves as a mediator that carries precise annotations in 3D space while allowing users to see through it to the real object. The annotations maintain their precision relative to the model geometry, and the transparency ensures they remain visible in the real-world context by not completely obscuring the underlying object.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10013506B2Annotating real-world objects
Publication Date: 2018.07.03 DASSAULT SYSTEMES SOLIDWORKS CORP
  • US10013506B2 patent drawing
  • US10013506B2 patent drawing
  • US10013506B2 patent drawing

AI summary

A computer-implemented method and system enables visualization of a computer-generated annotation on a real-world object in a real-world environment on a computerized system. The method and system creates a three-dimensional (3D) model of the real-world object, simultaneously displays the 3D model, the real-world object, and the real-world environment on a computer screen, and aligns the displayed 3D model and the displayed real-world object. The visibility of the 3D model is reduced and the 3D model is annotated in a real-world context. Reducing the visibility of the 3D model causes the annotation to appear on the displayed real-world object.