AR Procedural Guidance Using Ontology-Based Error Prevention

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems lack efficient mechanisms for providing accurate procedural guidance and error prevention in work environments, particularly in laboratories, due to the complexity of object and material identification and interaction, leading to potential operator errors and inefficiencies.

Innovation Solution

Implementing hierarchical classification and cross-classification using Directed Acyclic Graphs (DAGs) and ontologies to encode relationships among objects and materials, combined with computer vision and machine learning, to provide real-time procedural guidance and error detection in augmented reality systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If hierarchical classification and cross-classification using DAGs and ontologies are implemented, then object and material identification accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveobject identification accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments object identification into hierarchical levels using DAGs, where general object categories are broken down into increasingly specific subcategories. This segmentation allows the system to match objects at appropriate levels of detail without requiring complete classification at every level, reducing computational complexity while maintaining identification accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces ontological dimensions beyond simple hierarchical classification, adding semantic relationships and cross-classifications that enable objects to be identified through multiple pathways. This dimensional expansion allows the system to resolve ambiguities without increasing the depth of hierarchical traversal, managing complexity through alternative identification routes.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If real-time procedural guidance and error detection are provided, then operator safety and error prevention are improved, but processing time and system resource consumption increase

Engineering Contradiction:
Improveerror prevention capabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary classification and ontology matching in advance, building object models and relationships before procedural execution begins. This pre-processing allows real-time error detection to operate on already-structured data rather than raw sensor inputs, reducing processing time during actual procedures while maintaining comprehensive safety monitoring.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback loops where procedural guidance systems continuously monitor operator actions against the ontological model and provide real-time error detection. The feedback mechanism uses the pre-established hierarchical relationships to quickly determine whether deviations from procedure represent actual errors or acceptable variations, enabling rapid response without excessive processing time.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If comprehensive object and material characterization is implemented, then procedural guidance accuracy is improved, but information processing load increases

Engineering Contradiction:
Improveprocedural guidance accuracyVSAvoidinformation processing load
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system applies local quality by characterizing objects and materials with different levels of detail depending on their relevance to the current procedure. The ontological framework allows the system to retrieve only the specific attributes and properties necessary for the task at hand rather than processing all possible characteristics, reducing information processing load while maintaining guidance accuracy for relevant parameters.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent creates a universal ontological framework that serves multiple functions: object identification, material characterization, procedural guidance, and error detection. This multi-functional system eliminates the need for separate processing pipelines for each function, reducing redundant information processing while enabling comprehensive object and material characterization across all procedural contexts.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12567214B2Control structures for procedural guidance systems
Publication Date: 2026.03.03 LABLIGHTAR INC
  • US12567214B2 patent drawing
  • US12567214B2 patent drawing
  • US12567214B2 patent drawing

AI summary

An augmented reality system includes a knowledge base and an ontology. The knowledgebase includes properties of objects, substances, and materials found in work environments, and the ontology includes settings for permitted entities, objects and materials, and properties and relations including dependency relationships among them, such that the ontology encodes procedures carried out in the work environment in a computable format.