Image-Based Process Monitoring for Real-Time Error Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual process steps in industrial production often lead to errors, resulting in system downtime and resource wastage, as errors are typically discovered late in the quality assurance phase, and there is a need for efficient monitoring and documentation of these steps.

Innovation Solution

A monitoring system utilizing a machine learning system with a decision algorithm that processes digital image data from image sensors to determine process states, providing real-time feedback through visual, acoustic, or haptic outputs to prevent errors and enhance quality assurance, incorporating artificial neural networks and mobile devices like augmented reality glasses for data collection and analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual process steps are used for quality assurance inspection, then flexibility and adaptability are maintained, but errors are discovered late leading to system downtime and resource wastage

Engineering Contradiction:
Improveerror detection timingVSAvoidsystem downtime
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system implements real-time feedback by continuously capturing images during manual process steps, analyzing them through machine learning algorithms, and immediately notifying operators of detected errors or deviations. This closed-loop feedback mechanism enables immediate correction of errors during the process rather than discovering them late in quality assurance, thereby reducing system downtime and resource wastage while maintaining the flexibility of manual operations

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary quality checks by analyzing images in real-time during the manual process steps themselves. By detecting errors, deviations, or safety issues before the process completes, the system enables preventive action to be taken during the process rather than requiring post-process inspection, thus preventing system downtime and resource wastage while preserving operator flexibility

Inventive Principle:
Principle #10Preliminary action

2Reliability

If manual process steps are implemented, then human judgment and adaptability are utilized, but errors occur leading to resource wastage

Engineering Contradiction:
Improveprocess accuracyVSAvoidresource wastage
Core Design Contradiction:
ReliabilityVSLoss of substance

Solution Approach 1:

The system provides real-time feedback to operators about detected errors, deviations, or safety issues during manual process steps. This immediate feedback enables operators to correct mistakes before they result in defective products or resource wastage, thereby improving process accuracy while maintaining the benefits of human judgment and adaptability in manual operations

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system supplements human manual inspection with automated image capture and machine learning-based analysis. This hybrid approach replaces purely manual quality assurance with an augmented system that combines human adaptability with automated detection capabilities, thereby reducing errors and resource wastage while preserving the flexibility of manual process steps

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If quality assurance inspection is performed manually, then human expertise is applied, but errors are only discovered at the end of the process

Engineering Contradiction:
Improveinspection accuracyVSAvoiddetection delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system implements continuous real-time feedback by capturing images during manual process steps, analyzing them through machine learning algorithms, and immediately notifying operators of detected errors or deviations. This enables detection and correction of issues during the process rather than waiting until the end, thereby improving detection timing while maintaining inspection accuracy through both automated analysis and human expertise

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system enables continuous quality monitoring throughout the manual process steps by continuously capturing and analyzing images in real-time. This continuous inspection process eliminates gaps between process steps where errors might occur undetected, ensuring that quality assurance is performed continuously rather than only at the end, thereby reducing detection delay while maintaining high inspection accuracy

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS20210390303A1Method and device for monitoring an industrial process step
Publication Date: 2021.12.16 WAGO VERW GMBH
  • US20210390303A1 patent drawing
  • US20210390303A1 patent drawing
  • US20210390303A1 patent drawing

AI summary

A method for monitoring an industrial process step of an industrial process by a monitoring system. A machine learning system of the monitoring system is provided that contains a correlation between digital image data as input data and process states of the industrial process step to be monitored as output data using at least one machine-trained decision algorithm. Digital image data is recorded by at least one image sensor of at least one image acquisition unit of the monitoring system. At least one current process state is determined using the decision algorithm by generating at least one current process state of the industrial process step as output data rom the recorded digital image data as input data of the machine learning system. The industrial process step is monitored by generating a visual, acoustic and/or haptic output as a function of the at least one determined current process state.