QCS Scanner Mixed Reality Guidance for Remote Troubleshooting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The aging workforce and lack of expertise in handling Quality Control System (QCS) scanners in industrial plants lead to competency gaps, making installation, maintenance, and troubleshooting challenging, particularly due to the need for skilled domain expertise and physical training environments.

Innovation Solution

Implementing a 360° assistance system that combines mixed reality (MR) and machine learning technologies, including augmented and virtual reality, along with Chatbot solutions, to provide interactive guidance for installation, commissioning, troubleshooting, and training of QCS scanners, enabling remote expert support and reducing the reliance on physical hardware for training.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If physical training on actual QCS scanner is provided, then training effectiveness is improved, but training time and cost increase

Engineering Contradiction:
Improvetraining effectivenessVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent creates virtual copies of the QCS scanner and training environments through MR technology. These virtual replicas allow trainees to practice procedures, troubleshoot issues, and learn operations without needing access to physical scanners, thereby maintaining training effectiveness while eliminating time constraints and reducing costs associated with physical training resources.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The MR system acts as an intermediary between the trainee and the actual QCS scanner. It provides a simulated environment that mediates the learning process, allowing users to interact with virtual representations of scanner components and procedures, thus achieving training objectives without direct physical engagement with expensive or limited scanner resources.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If expert support is provided for troubleshooting, then issue resolution accuracy is improved, but response time varies due to expert availability

Engineering Contradiction:
Improveissue identification accuracyVSAvoidtroubleshooting time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The MR system enables self-service troubleshooting by providing embedded guidance, procedural checklists, and diagnostic tools directly within the virtual environment. Users can independently resolve issues using the system's built-in expertise, eliminating waiting time for external experts while maintaining high accuracy through standardized procedures and real-time feedback.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements continuous feedback mechanisms that monitor user actions, compare them against correct procedures, and provide real-time corrections and guidance. This immediate feedback loop ensures accurate issue identification and resolution without requiring external expert intervention, thereby reducing troubleshooting time while maintaining high precision.

Inventive Principle:
Principle #23Feedback

3Stability of the object's composition

If standardized procedures are implemented, then operation consistency is improved, but adaptability to unique situations decreases

Engineering Contradiction:
Improveprocedure consistencyVSAvoidflexibility in handling unique issues
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The MR system provides dynamic procedures that can adapt in real-time based on the specific situation encountered. While maintaining standardized core protocols for consistency, the system allows users to deviate from scripted procedures when necessary, providing guidance for handling unique or unexpected issues while still ensuring safe and effective outcomes through structured decision-making frameworks.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3935461B1360° assistance for QCS scanner with mixed reality and machine learning technology
Publication Date: 2024.12.11 HONEYWELL LTD(CA)
  • EP3935461B1 patent drawingFigure 1
  • EP3935461B1 patent drawingFigure 2
  • EP3935461B1 patent drawingFigure 3~4

AI summary

An apparatus, a method and a non-transitory machine-readable medium for providing 360° assistance for a quality control scanner with mixed reality and machine learning technology using an optical sensor, a display, a chatbot, a cloud service and a processor operably connected to the optical sensor and the display, wherein the processor receives diagnostic information from a server related to a field device in an industrial process control and automation system to identify and detects issues of the field device using optical sensor and guides a user to a location and a scanner part of the field device using the display to take steps or actions to resolve the issue; and connects to a cloud server to get modules of installation, commissioning, annual maintenance and training for a quality control system.