AR Workflow Visualization for Industrial Automation Remote Support
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators in industrial automation environments face challenges in performing tasks efficiently due to the need to memorize device-specific procedures and identify changes in industrial automation devices, leading to potential errors and increased downtime.
Innovation Solution
An interactive augmented reality (AR) user experience (UX) system that provides visualizations of real-world and computer-generated content, guiding operators through maintenance and operation procedures by overlaying instructions and virtual objects onto real-time images of industrial automation devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If operators rely on memorization of device-specific procedures, then they can perform tasks without external aids, but error rates increase and confidence decreases
Solution Approach 1:
The patent introduces an augmented reality system as an intermediary between the operator and the industrial automation device. This system displays visualized procedures overlaid on the actual device, serving as a mediator that guides the operator without requiring full memorization. The AR interface acts as a cognitive aid that reduces the mental burden while maintaining operational reliability.
Solution Approach 2:
The system prepares and displays procedural information in advance, showing operators the sequence of actions needed before they begin tasks. By presenting the workflow and required actions beforehand through visualized procedures, operators can plan their actions without needing to memorize complex sequences, thereby reducing errors and increasing confidence.
2Adaptability or versatility
If operators must identify changes in industrial automation devices, then they can adapt to new configurations, but task completion time increases
Solution Approach 1:
The augmented reality system uses visual differentiation to highlight changes in device configurations. By displaying annotated images that show modified components or altered states through visual emphasis, the system enables operators to quickly identify adaptations needed without time-consuming manual inspection, thus maintaining adaptability while reducing task completion time.
3Manufacturing precision
If detailed procedural information is provided to operators, then task accuracy improves, but information overload occurs and ease of operation decreases
Solution Approach 1:
The system applies the principle of local quality by providing procedural information specifically at the location where it is needed - overlaying instructions directly on the relevant components of the industrial automation device through augmented reality. This localized information delivery ensures operators receive detailed guidance exactly where required without being overwhelmed by unrelated information, maintaining task accuracy while improving ease of operation.
4Reliability
If remote support is provided through traditional communication methods, then operators can receive guidance, but communication efficiency decreases and downtime increases
Solution Approach 1:
The system creates a visual copy of the industrial automation device and the procedural information, displaying both the device appearance and the required actions through augmented reality. This visual copying allows operators to see exactly what the device looks like and what actions are needed without lengthy verbal or written communication, significantly reducing downtime while maintaining support effectiveness.
Data Source
AI summary
A system may include a processor and a memory including computer-executable code that, when executed by the processor, causes the processor to receive a service request from a first device and to transmit a workflow dataset associated with an industrial automation device to the first device and the second device. The service request may cause a computing system to communicatively couple the first device to a second device. The workflow dataset may include one or more instructions associated with one or more operations for the industrial automation device and one or more virtual objects associated with the one or more instructions and the industrial automation device. The memory may include computer-executable code that, when executed by the processor, causes the processor to receive an input to the image data from the second device and to transmit the one or more additional visualizations to the first device for display.