Multi-Stage Object Classification Pipeline for Infrastructure Inspection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional infrastructure maintenance and reliability assessments are time-consuming, labor-intensive, and lack scalability, relying on human operators for visual inspection and requiring specialized knowledge, which is inefficient for assessing hundreds or thousands of components.

Innovation Solution

A computer-program product using a multi-stage object classification and condition pipeline that includes a localization machine learning model for detecting and classifying infrastructure components, utilizing downsampled image data to identify and extract target objects, and routing them through object-condition classification models for accurate assessment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If human operators perform visual inspection of infrastructure components, then assessment accuracy can be maintained with specialized knowledge, but the process becomes time-consuming and labor-intensive

Engineering Contradiction:
Improveassessment accuracyVSAvoidinspection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical visual inspection process performed by human operators with an automated machine learning system. The system uses image processing algorithms and neural networks to detect, localize, and assess infrastructure components automatically, eliminating the need for manual visual inspection while maintaining assessment accuracy through trained models.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The machine learning system performs self-assessment of infrastructure components by automatically analyzing images, identifying objects, and evaluating their condition. The system serves itself by processing images through multiple stages (detection, localization, assessment) without requiring human intervention at each step, thereby reducing inspection time while maintaining precision.

Inventive Principle:
Principle #25Self-service

2Reliability

If human operators assess infrastructure components, then specialized knowledge can be applied, but the process fails to scale effectively for hundreds or thousands of components

Engineering Contradiction:
Improveassessment qualityVSAvoidassessment throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the assessment process into distinct machine learning stages: object detection, localization, and condition assessment. Each stage is handled by specialized models that can be independently trained and optimized. This segmentation allows the system to process multiple components simultaneously, scaling productivity while maintaining reliable assessment quality through dedicated functionality at each stage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The machine learning system provides universal assessment capability across multiple infrastructure component types. A single automated system can assess various objects (power lines, transformers, poles, etc.) by routing images through appropriate specialized models, enabling scalable processing of hundreds or thousands of components while maintaining consistent assessment quality through standardized procedures.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If traditional visual inspection methods are used, then human expertise can be applied, but the process requires high levels of specialized knowledge and training

Engineering Contradiction:
Improveinspection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the complex human expertise requirement with automated machine learning models that encode specialized knowledge. The system substitutes human operators' specialized knowledge with trained algorithms that automatically perform detection, localization, and assessment, reducing the complexity barrier while maintaining or improving inspection accuracy through consistent algorithmic application.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Productivity

If automated machine learning systems are implemented, then productivity and scalability are improved, but system complexity increases

Engineering Contradiction:
Improveassessment throughputVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent manages system complexity by segmenting the automated assessment process into distinct, modular stages: detection models, localization models, and assessment models. Each module performs a specific function and can be independently developed, trained, and maintained. This segmentation enables high productivity through automated processing while controlling complexity through modular architecture and clear separation of concerns.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11836968B1Systems and methods for configuring and using a multi-stage object classification and condition pipeline
Publication Date: 2023.12.05 SAS INSTITUTE INC
  • US11836968B1 patent drawing
  • US11836968B1 patent drawing
  • US11836968B1 patent drawing

AI summary

A system, method, and computer-program product includes detecting, via a localization machine learning model, a target object within a scene based on downsampled image data of the scene, identifying a likely position of the target object within original image data of the scene, extracting, from the original image data of the scene, a target sub-image containing the target object, classifying, via an object classification machine learning model, the target object to a probable object class of a plurality of distinct object classes, routing the target image resolution of the target sub-image to a target object-condition machine learning classification model of a plurality of distinct object-condition machine learning classification models, classifying, via the target object-condition machine learning classification model, the target object to a probable object-condition class, and displaying, via a graphical user interface, a representation of the target object in association with the probable object-condition class.