AR Equipment Information Overlay With Linked Document POIs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) configurations for industrial equipment require manual definition of points of interest (POIs) and lack direct linking to specific document locations, leading to inefficient and error-prone information access.

Innovation Solution

A method involving a database construction with electronic tags, unique equipment identification, and automated POI creation, allowing direct superimposition of AR information on equipment, with branching links for seamless document navigation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual configuration of points of interest is used, then information can be accessed in augmented reality, but the configuration process becomes very long and complex

Engineering Contradiction:
Improveease of AR configurationVSAvoidconfiguration time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system automatically extracts technical information from equipment images using optical character recognition and document analysis algorithms. The AR application self-configures points of interest by identifying equipment markers, retrieving relevant documentation, and generating interactive hotspots without requiring manual configuration by technicians or administrators.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of configuring AR points of interest is replaced by an automated digital system. The system uses image recognition, OCR, and document processing algorithms to automatically create and configure AR content, substituting the manual configuration workflow with an automated computational process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If manual creation of points of interest is used, then information can be linked to equipment, but the process requires multiple manual steps and is error-prone

Engineering Contradiction:
Improveaccuracy of information linkingVSAvoidconfiguration process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system automatically retrieves documentation based on equipment identification and generates accurate links to relevant information sections. The automated document analysis and information extraction processes eliminate manual errors in linking equipment to their technical documentation, ensuring high reliability without complex manual procedures.

Inventive Principle:
Principle #25Self-service

3Loss of time

If points of interest are pre-configured with document links, then information can be accessed, but the links open to the first page instead of the exact location

Engineering Contradiction:
Improveinformation search timeVSAvoiddocument location accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The system uses automated document analysis and information extraction algorithms to identify the exact location of relevant information within documents. The AR application automatically generates hyperlinks that jump to the precise section or paragraph containing the required information, replacing manual page navigation with automated digital document positioning.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Reliability

If manual documentation linking is used, then information can be associated with equipment, but inconsistencies occur when documents are updated

Engineering Contradiction:
Improvedata consistencyVSAvoidease of configuration
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The system establishes automated feedback loops between equipment data, documentation databases, and AR content. When documentation is updated, the system automatically detects changes, retrieves updated information, and refreshes the corresponding AR points of interest. This continuous feedback mechanism ensures data consistency without requiring manual reconfiguration of AR content.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP4016382B1Method for configuring and displaying, in augmented, mixed or extended reality, information relating to a device installed on a real site, associated computer program product and electronic device
Publication Date: 2025.12.03 SCHNEIDER ELECTRIC IND SAS
  • EP4016382B1 patent drawingFigure 1
  • EP4016382B1 patent drawingFigure 2
  • EP4016382B1 patent drawingFigure 3

AI summary

Method (100) for configuring and displaying information relating to equipment installed in a real-world setting using augmented, mixed, or extended reality, comprising: - (110): constructing a database in which each document or each selected part of a document is associated with a corresponding electronic tag containing an address referring to the document or the selected part of the document associated with it; - (120): uniquely identifying the equipment installed in the real-world setting; - (130): associating the identified equipment with an electronic tag; - (140): creating one or more first points of interest linked to at least one electronic tag and configured to be superimposed on a first document or a first selected part of a corresponding document; - (150): creating one or more second points of interest to be displayed superimposed on the equipment;- (160): associate a second point of interest with at least one first point of interest.