Guided Deep Learning Error Analysis Using Neural Template Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Nontechnical users face challenges in performing sophisticated error analysis for machine learning models due to the technical complexity of interpreting model outputs, leading to inefficiencies and inaccuracies, particularly when noise is equally weighted with significant conditions and uniform processing is applied across all image pixels.

Innovation Solution

A guided workflow system utilizing the Neural Template Matching (NTM) algorithm to identify correlated images and prompt users through a series of simple tasks, enabling non-technical users to improve model performance by focusing on regions of interest and implementing heuristic best practices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If naive attempts equally bias whole images to detect conditions, then the processing is simple and uniform, but the model accuracy deteriorates because noise is equally weighted with significant conditions

Engineering Contradiction:
Improvesimplicity of processingVSAvoidmodel accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent applies local quality by differentiating the treatment of different image regions. Instead of uniformly biasing the entire image, the system identifies and focuses processing on specific regions containing conditions of interest. This allows significant conditions to be detected with appropriate weighting while noise in other regions receives different or reduced weighting, thereby improving model accuracy without sacrificing processing simplicity.

Inventive Principle:
Principle #3Local quality

2Device complexity

If equal processing power is applied to all pixels, then the mechanism is simple and uniform, but efficiency deteriorates because conditions may appear in only a small subset of pixels

Engineering Contradiction:
Improveuniformity of processing mechanismVSAvoiddetection efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent implements segmentation by dividing the image processing task into distinct regions. Instead of applying equal processing power to all pixels, the system segments the image to identify regions containing conditions of interest and concentrates processing resources on those specific segments. This segmentation approach maintains a relatively simple overall mechanism while dramatically improving detection efficiency by avoiding wasted processing on regions without conditions.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If experienced machine learning engineers perform error analysis, then sophisticated error analysis is achieved, but accessibility deteriorates because nontechnical users cannot carry out error analysis

Engineering Contradiction:
Improvesophistication of error analysisVSAvoiduser accessibility
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies self-service by enabling nontechnical users to perform error analysis themselves through an automated system. The system provides guided workflows that walk users through error identification and analysis processes, automatically interpreting model outputs and presenting findings in accessible formats. This eliminates the need for users to possess specialized technical knowledge while maintaining sophisticated error analysis capabilities through the underlying automated systems.

Inventive Principle:
Principle #25Self-service

4Ease of operation

If guided workflows with NTM algorithm are implemented, then user accessibility is improved, but system complexity increases due to automation requirements

Engineering Contradiction:
Improveuser accessibilityVSAvoidsystem automation complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent employs an intermediary approach by introducing a guided workflow system that mediates between the complex NTM algorithm and the end user. The workflow system acts as an intermediary layer that automatically handles the complexity of the NTM algorithm while presenting simplified interactions to users. This intermediary structure improves user accessibility by shielding them from technical complexity while still leveraging the sophisticated capabilities of the underlying algorithm.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20250285422A1Guided workflow for deep learning error analysis
Publication Date: 2025.09.11 LANDINGAI INC
  • US20250285422A1 patent drawing
  • US20250285422A1 patent drawing
  • US20250285422A1 patent drawing

AI summary

A model management system performs error analysis on results predicted by a machine learning model. The model management system identifies an incorrectly classified image outputted from a machine learning model and identifies using the Neural Template Matching (NTM) algorithm, an additional image correlated to the selected image. The system outputs correlated images based on a given image and a selection by a user through a user interface of a region of interest (ROI) of the given image. The region is defined by a bounding polygon input and the correlated images include features correlated to the features within the ROI. The system prompts a task associated with the additional image. The system receives a response that includes an indication that the additional image is incorrectly labeled and including a replacement label and instruct that the machine learning model be retrained using an updated training dataset that includes the replacement label.