AR Equipment Information Tagging for Accurate POI Linking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality configurations for industrial equipment require manual and lengthy processes to define points of interest and link relevant documentation, leading to inaccurate information access and inefficiencies, especially when documents are modified.

Innovation Solution

A method that constructs a database with electronic tags for equipment information, identifies equipment using markers, and creates points of interest for direct access to specific documentation, allowing for automatic and accurate linking of information in augmented reality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual configuration of points of interest and documentation links is used, then information can be accessed in augmented reality, but the configuration process becomes highly lengthy and complex

Engineering Contradiction:
Improveease of information accessVSAvoidconfiguration complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically extracts documentation links and creates points of interest by analyzing technical documents, eliminating the need for manual configuration. The AI-based extraction process self-services the entire workflow from document upload to AR point creation, reducing configuration complexity while maintaining information accessibility.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of configuring points of interest and documentation links is replaced with an automated AI-based system that extracts and associates information programmatically. This substitution transforms a labor-intensive manual process into an efficient automated workflow.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of manufacture

If manual indexing of documentation is used, then points of interest can be created, but access accuracy to specific document locations deteriorates

Engineering Contradiction:
Improveease of POI creationVSAvoidinformation access accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

Manual indexing and link creation is replaced with automated AI-based extraction that precisely identifies and associates documentation links with corresponding points of interest. The system automatically analyzes document structures and creates accurate links without manual intervention, improving both ease of creation and access precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system provides feedback by automatically verifying the accuracy of extracted documentation links against the actual document content. This feedback mechanism ensures that points of interest are correctly associated with the precise locations in documents, maintaining high access accuracy.

Inventive Principle:
Principle #23Feedback

3Reliability

If preconfigured points of interest are used, then information can be displayed in augmented reality, but the process requires multiple manual steps and time consumption

Engineering Contradiction:
Improveinformation availabilityVSAvoidconfiguration time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary action by automatically extracting and organizing documentation links before creating points of interest. This preliminary processing eliminates the need for multiple subsequent manual steps, reducing configuration time while ensuring information availability is maintained through systematic extraction and association.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Multiple manual steps including document analysis, link extraction, point of interest creation, and association are merged into a single automated workflow. The AI-based system combines these previously separate tasks into one unified process, dramatically reducing configuration time while maintaining reliable information delivery.

Inventive Principle:
Principle #5Merging (Combining)

4Adaptability or versatility

If manual documentation updates are used, then document modifications can be made, but data coherence in augmented reality deteriorates

Engineering Contradiction:
Improvedocument flexibilityVSAvoiddata coherence
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The system implements continuous feedback by automatically re-analyzing updated documents and refreshing associated points of interest. When documents are modified, the AI-based extraction process is triggered again to ensure data coherence is maintained, providing real-time synchronization between document changes and AR display data.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system transitions from static manual updates to dynamic automated updates. The AI-based extraction process continuously monitors and adapts to document changes, automatically refreshing points of interest and documentation links to maintain data coherence. This dynamic approach ensures the system remains synchronized with the latest document versions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11816802B2Method for configuring and displaying, in augmented or mixed or extended reality, the information relating to equipment installed in a real site, and associated computer program product and electronic device
Publication Date: 2023.11.14 SCHNEIDER ELECTRIC IND SAS
  • US11816802B2 patent drawing
  • US11816802B2 patent drawing
  • US11816802B2 patent drawing

AI summary

A method for configuring and displaying, in augmented or mixed or extended reality, the information relating to equipment installed in a real site, including:constructing a database in which each document or each selected part of a document is associated with a corresponding electronic tag that contains an address which leads to the document or to the selected part of the document associated therewith;unequivocally identifying the equipment installed in the real site;associating the identified equipment with an electronic tag;creating one or more first points of interest linked to at least one electronic tag and configured to be superposed on a first document or on a first selected part of a corresponding document;creating one or more second points of interest to be displayed in a manner superposed on the equipment; andassociating a second point of interest with at least one first point of interest.