STRNet Deep Learning for Concrete Crack Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for detecting concrete cracks in complex scenes face challenges such as high computational cost, inability to handle complex backgrounds, improper evaluation metrics, and potential for overfitting due to small training datasets and errors in ground truth data.

Innovation Solution

A novel computer-implemented method using a deep convolutional neural network (STRNet) that incorporates an attention-based encoder and decoder, coarse upsampling, and a focal-Tversky loss function to efficiently detect and segment concrete cracks in complex scenes, achieving real-time processing with large input images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional image processing methods are used for damage detection, then the approach is simple and interpretable, but it cannot effectively handle complex scenes and provides insufficient localization precision

Engineering Contradiction:
Improvelocalization precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing task into distinct functional modules: encoder for feature extraction, decoder for localization, and loss function components for different optimization goals. This modular segmentation allows the system to achieve high localization precision through specialized sub-components while managing overall system complexity through clear functional separation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from traditional 2D image processing to 3D feature space representation through the encoder-decoder architecture, enabling the network to capture spatial relationships and contextual information in multiple dimensions. This dimensional expansion improves localization precision by considering broader contextual patterns beyond local pixel variations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If deep learning-based object detection algorithms are used, then processing speed improves compared to sliding window technique, but bounding box localization is too coarse for precise damage quantification

Engineering Contradiction:
Improveprocessing speedVSAvoiddamage quantification precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments the detection task into two stages: object detection using Faster R-CNN for rapid identification, followed by pixel-level segmentation using a dedicated decoder module for precise boundary delineation. This segmentation allows the system to maintain high processing speed from the detection stage while achieving precise damage quantification in the segmentation stage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from coarse bounding box representation to fine-grained pixel-level segmentation by introducing a decoder that processes feature maps at multiple scales. This dimensional refinement enables precise damage quantification while maintaining processing efficiency through hierarchical feature reuse.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If pixel-level object segmentation methods are used, then precise crack segmentation is achieved, but the network cannot handle complex backgrounds and objects effectively

Engineering Contradiction:
Improvecrack segmentation precisionVSAvoidcomplex scene handling capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies local quality by using attention mechanisms that dynamically adjust feature weights based on local contextual information. The network learns to focus on crack-relevant features while suppressing background distractions in different regions, enabling precise segmentation in complex scenes through location-adaptive feature processing.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent creates a universal encoder-decoder architecture that can handle diverse crack types and complex backgrounds through learned feature representations. The shared encoder processes various input conditions uniformly, while the decoder adapts to different segmentation challenges, providing both precision and versatility across varied scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Loss of time

If small training datasets are used, then training time is reduced and computational cost decreases, but the network is prone to overfitting and produces unreliable检测结果

Engineering Contradiction:
Improvetraining timeVSAvoiddetection reliability
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent employs data augmentation techniques that generate synthetic training samples through geometric transformations, color adjustments, and noise addition. This partial expansion of the training dataset increases detection reliability by exposing the network to varied crack appearances and conditions, while avoiding the need for extensive manual data collection and annotation.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent implements cross-validation and performance monitoring during training to detect overfitting early. The feedback mechanism adjusts training parameters and regularization strength based on validation set performance, maintaining detection reliability even with limited training data by preventing the network from memorizing training samples.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12315238B2Computer-implemented arrangements for processing image having article of interest
Publication Date: 2025.05.27 UNIVERSITY OF MANITOBA
  • US12315238B2 patent drawing
  • US12315238B2 patent drawing
  • US12315238B2 patent drawing

AI summary

A computer-implemented method for analyzing an image to detect an article of interest (AOI) comprises processing the image using a machine learning algorithm configured to detect the AOI and comprising a convolutional neural network (CNN); and displaying the image with location of the AOI being indicated if determined to be present. The CNN comprises an input module configured to receive the image and comprising at least one convolutional layer, batch normalization and a nonlinear activation function; an encoder thereafter and configured to extract features indicative of a present AOI to form a feature map; a decoder thereafter and configured to discard features from the feature map that are not associated with the present AOI and to revert the feature map to a size matching an initial image size; and a concatenation module configured to link outputs of the input module, the encoder and the decoder for subsequent segmentation.