Inspection Workflow Guiding via Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Complex and lengthy inspection processes in multi-equipment environments often lead to errors and excessive downtime due to inexperienced operators or unfamiliarity with the inspection environment, resulting in incomplete data collection and inefficient maintenance.

Innovation Solution

A system and method for guiding inspection workflows using an inspection tool equipped with a processor, user interface, and memory, which provides instructions for data collection, including displaying available equipment, parameters, and reference images, and automatically acquiring and saving inspection data, utilizing imaging tools like electromagnetic and acoustic sensors to streamline the process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual inspection processes are used in multi-equipment environments, then operators can perform inspections, but errors increase and inspection time becomes excessive due to inexperience and unfamiliarity with the environment

Engineering Contradiction:
Improveinspection data accuracyVSAvoidinspection duration
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent introduces a mobile computing device as an intermediary between the operator and the inspection environment. This device provides turn-by-turn navigation instructions, equipment location guidance, and inspection parameter displays, effectively mediating the interaction and reducing operator cognitive load. The system acts as a mediator that bridges the gap between operator knowledge and environmental complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by pre-planning inspection routes, pre-identifying equipment locations, and pre-displaying inspection parameters before the operator arrives at each equipment. The mobile device provides advance navigation directions and equipment information, allowing operators to prepare mentally and physically for upcoming inspection tasks, thereby reducing on-site decision time and errors.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If comprehensive inspection data collection is performed across multiple pieces of equipment, then complete maintenance information is obtained, but the inspection process becomes complex and lengthy

Engineering Contradiction:
Improveinspection data completenessVSAvoidinspection process complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the comprehensive inspection process into discrete, manageable tasks for each piece of equipment. The mobile computing device presents inspection parameters and data collection requirements individually for each equipment item, breaking down the complex multi-equipment inspection into a sequence of simple, focused tasks. This segmentation reduces cognitive complexity while ensuring complete data collection across all equipment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adapts the inspection process based on operator location and equipment sequence. The mobile device updates navigation directions, equipment information, and inspection parameters in real-time as the operator moves through the environment. This dynamic presentation of information simplifies the perceived complexity by always showing only the relevant next steps rather than the entire inspection protocol at once.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If operators navigate to equipment locations without guidance, then movement freedom is maintained, but location accuracy decreases and inspection time increases

Engineering Contradiction:
Improveequipment location accessibilityVSAvoidtime to reach equipment
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The mobile computing device provides continuous feedback to the operator regarding location status and navigation progress. The system displays turn-by-turn directions, confirms when equipment is reached, and updates the remaining inspection sequence. This feedback loop enables operators to maintain movement freedom while receiving real-time guidance that accelerates location accuracy and reduces overall inspection time.

Inventive Principle:
Principle #23Feedback

4Measurement precision

If multiple inspection parameters are collected for each equipment, then diagnostic accuracy improves, but data collection time and process length increase

Engineering Contradiction:
Improveequipment parameter accuracyVSAvoidinspection throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary action by pre-displaying all required inspection parameters and data collection methods for each equipment before the operator begins measurement. The mobile device shows the complete parameter list, measurement techniques, and acceptance criteria in advance, allowing operators to prepare and execute measurements efficiently without needing to reference manuals or recall procedures during the actual inspection, thereby maintaining precision while improving throughput.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enhances data collection reliability and efficiency by guiding users through inspection processes, reducing errors and downtime, and improving maintenance management through automated data recording and analysis, facilitating predictive maintenance.

Implementation Method 1

Inspection data can include image data, such as acoustic image data, infrared image data, and/or visible light image data

Methodology Applied
Scientific EffectElectromagnetic radiation detection: Electromagnetic Induction

Data Source

PatentUS12088910B2Inspection workflow using object recognition and other techniques
Publication Date: 2024.09.10 FLUKE CORP
  • US12088910B2 patent drawing
  • US12088910B2 patent drawing
  • US12088910B2 patent drawing

AI summary

Systems for guiding a user through a workflow routine can include an inspection tool, a user interface, memory, and a processor. The processor can provide instructions via the user interface to perform a workflow routine using the inspection tool and save acquiring inspection data to memory. Instructions can direct a user to which equipment to inspect and/or how to collect inspection data associated with one or more pieces of equipment. Systems can determine which equipment is available for inspection by the user, such as via image recognition or proximity detection, and instruct a user to acquire inspection data associated with such equipment. Workflow routine instructions can be provided to the user via various devices, such as an inspection tool, smartphone, or a tablet.