Automated Issue Detection System Using Image Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current maintenance practices for objects and systems are costly and inefficient due to the need for frequent periodic inspections, which may not capture all issues in a timely manner, especially in environments where external factors can significantly affect the lifespan and condition of these objects and systems.

Innovation Solution

A method and system for reporting, tracking, and managing issues within an environment using image analysis and machine learning to identify, log, and prioritize issues, providing a severity rating, and routing them to appropriate service providers for resolution, incorporating crowd-sourced information and augmented reality for issue localization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If periodic inspections are performed to monitor object and system conditions, then issues can be detected, but the cost and labor required become substantial

Engineering Contradiction:

Improveissue detection capabilityVSAvoidcost and labor

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The system enables self-service monitoring where the infrastructure itself generates detectable signals (images, sensor data) that automatically indicate its condition. Objects and systems essentially monitor themselves by providing data that the processing system analyzes, eliminating the need for external inspectors to physically examine each component.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical inspection processes with automated image capture and processing systems. Instead of human inspectors physically examining infrastructure, the system uses cameras, sensors, and automated image analysis algorithms to detect and assess issues, substituting mechanical human labor with automated technological systems.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If inspection frequency is increased to capture all issues timely, then detection accuracy improves, but cost becomes prohibitive

Engineering Contradiction:

Improveissue detection accuracyVSAvoidinspection cost

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The system implements periodic automated image capture and analysis at optimized intervals. Rather than continuous monitoring or fixed-schedule manual inspections, the system performs periodic automated assessments that balance detection accuracy with resource efficiency, analyzing images only when changes are detected or at strategically determined intervals.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

Automated image processing and analysis algorithms continuously evaluate captured images to detect issues with high precision. The system uses computer vision, machine learning, and pattern recognition to achieve accurate issue detection without requiring frequent manual inspections, thereby maintaining high measurement precision while reducing overall inspection costs.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If manual inspection methods are used to identify issues, then detailed assessment is possible, but productivity is reduced

Engineering Contradiction:

Improveissue assessment completenessVSAvoidissue identification speed

Core Design Contradiction:

Loss of informationVSProductivity

Solution Approach 1:

The system replaces manual visual inspection with automated image capture and computer vision analysis. Cameras and sensors automatically capture images of infrastructure, while processing systems rapidly analyze these images to identify and assess issues. This substitution maintains comprehensive issue assessment capability while dramatically increasing productivity through automated parallel processing of multiple images and locations.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs preliminary automated analysis of images to identify potential issues before human review. Image processing algorithms pre-screen captured images, flagging areas with detected issues for further examination. This preliminary action filters out normal conditions, allowing rapid processing of large volumes of images while ensuring comprehensive assessment of problematic areas.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20220284693A1Method, apparatus and computer program product for managing identified issues

Publication Date: 2022.09.08 THE BOEING CO

AI summary

Embodiments described herein may provide a method for reporting, tracking, and managing resolution of issues. Methods may include: receiving at least one image in which a new issue is identified; receiving information relating to the new issue identified in the at least one image; determining a location of the new issue; identifying any existing issues corresponding to the new issue; generating a severity rating corresponding to the new issue; logging the new issue in a database stored in a memory, where logging the new issue in the database includes adding the new issue to an existing issue in response to the new issue corresponding to the existing issue, and logging the new issue in the database includes generating a new issue entry in the database in response to the new issue failing to correspond to an existing issue; and providing the new issue to a service provider for the service provider to resolve.