AR Glasses Interface for Hands-Free Plant Equipment Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Industrial plants face challenges in producing chemical or biological products with consistent and predictable quality due to complex dependencies on production parameters and the lack of timely access to plant status information, leading to inefficiencies in controlling and maintaining automated production processes.

Innovation Solution

An augmented reality-based automation system using AR glasses with executable program logic to display virtual objects linked to plant equipment, enabling hands-free selection and interaction, allowing users to access relevant information and control processes without manual handling, and dynamically adjusting the display based on user position and orientation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If all equipment data and plant status information are displayed simultaneously on AR glasses, then complete information availability is achieved, but information overload occurs making it difficult for users to process

Engineering Contradiction:
Improveinformation availabilityVSAvoidinformation processing ease
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent segments plant equipment into multiple hierarchical levels (e.g., production areas, equipment groups, individual devices). Users can selectively access information at different segmentation levels through natural language commands, receiving only the specific data needed rather than overwhelming comprehensive displays.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The AR display dynamically adapts its content based on user needs, equipment status, and operational context. Information is presented in real-time and can be expanded or contracted through voice commands, allowing the display to transition between summary views and detailed information as required.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If manual handling is required for selecting and interacting with virtual objects, then precise selection is achieved, but hands are occupied preventing simultaneous equipment operation

Engineering Contradiction:
Improveselection precisionVSAvoidhands-free operation capability
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces manual mechanical interaction (hand gestures, button presses) with voice-based acoustic commands. Users can select virtual objects and trigger actions through spoken instructions, maintaining precise selection capability while keeping hands free for physical equipment manipulation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces voice recognition technology as an intermediary between the user and the AR interface. The voice command system accurately translates spoken instructions into precise object selections and control actions, bridging the gap between natural speech and system commands.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If specialized knowledge personnel are deployed to maintain equipment, then maintenance quality is improved, but response time increases due to personnel shortage

Engineering Contradiction:
Improvemaintenance qualityVSAvoidresponse time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The AR system enables operators to perform self-service maintenance by providing real-time access to equipment manuals, diagnostic information, and step-by-step repair procedures directly in their field of view. This reduces dependency on specialized personnel while maintaining maintenance quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system prepares maintenance information and diagnostic data in advance, making it immediately accessible when operators approach equipment. Common maintenance procedures and troubleshooting steps are pre-loaded and ready for rapid deployment, reducing response time without sacrificing maintenance quality.

Inventive Principle:
Principle #10Preliminary action

4Manufacturing precision

If comprehensive plant status information is made accessible, then production control quality is improved, but system complexity increases

Engineering Contradiction:
Improveproduction control qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The AR glasses serve multiple functions: displaying equipment data, providing maintenance instructions, enabling communication with control systems, and offering diagnostic capabilities. This consolidates multiple information delivery mechanisms into a single universal interface, managing system complexity while comprehensive information access.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250208607A1An augmented reality based automation system with a hands free selection of a virtual object
Publication Date: 2025.06.26 BASF SE
  • US20250208607A1 patent drawing
  • US20250208607A1 patent drawing
  • US20250208607A1 patent drawing

AI summary

An automation system controls an automated production process of an industrial plant. The industrial plant includes a plurality of equipment for performing the production process, where each equipment of the plurality of equipment is associated with one or more corresponding virtual objects. The automation system includes an augmented reality system including augmented reality glasses and an executable program logic. The program logic receives a spatial position of a user wearing the augmented reality glasses from a positioning system, display, via the augmented reality glasses, one or more virtual objects associated with one or more equipment proximate to the spatial position of the user, receive a signal indicating a hands-free selection, by the user, of a virtual object linked to a respective secondary virtual object, and display, via the augmented reality glasses, a respective secondary virtual object and/or trigger an action associated with the selected virtual object.