Vision Inspection Classifier With Human-in-the-Loop Retraining
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing automated optical inspection (AOI) systems in manufacturing have high false positive and false negative rates, requiring significant manual intervention and labor to correct, especially during new product introductions, due to insufficiently tuned classification rules and the need for extensive human supervision.
Innovation Solution
A Vision Analytics and Validation (VAV) system utilizing a deep convolutional neural network (CNN) for weakly supervised learning, with a three-way classification (good, bad, and do not know) to reduce false positives and negatives, and a stacked ML system for component-independent evaluation, enabling rapid adaptation to new defects and conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional AOI classification rules are used, then inspection coverage is comprehensive, but false positive rate increases significantly
Solution Approach 1:
The patent transforms the inspection system from rule-based classification to deep learning-based classification. The neural network models dynamically adjust classification parameters based on learned patterns from training data, replacing static human-defined rules with adaptive algorithms that can distinguish between genuine defects and normal variations, thereby reducing false positives while maintaining comprehensive inspection coverage
Solution Approach 2:
The patent replaces the mechanical rule-based inspection system with an intelligent deep learning system. Traditional AOI used explicit classification rules that manually defined acceptable variations, while the new system uses neural networks that automatically learn patterns from data, substituting rigid mechanical logic with flexible computational intelligence that adapts to complex manufacturing variations
2Reliability
If manual review of all failed boards is performed, then defect detection is thorough, but labor cost and time increase significantly
Solution Approach 1:
The patent implements a self-service inspection system where the deep learning models autonomously perform classification and defect detection without requiring manual intervention for each board. The system automatically learns from training data, makes independent classification decisions, and only flags uncertain cases for human review, enabling thorough defect detection while significantly improving inspection throughput by eliminating redundant manual checking
Solution Approach 2:
The patent incorporates feedback mechanisms where inspection results are continuously fed back into the system to refine and retrain the neural network models. This feedback loop allows the system to learn from actual defect patterns and improve its classification accuracy over time, enabling more accurate automated inspection that reduces the need for manual review while maintaining high defect detection accuracy
3Reliability
If classification rules are extensively tuned, then inspection accuracy improves, but system complexity and training time increase
Solution Approach 1:
The patent uses copying by creating synthetic training data that replicates real manufacturing variations. Instead of manually tuning rules for each variation, the system generates artificial images and defect patterns that mimic real-world conditions, allowing the neural network to learn from these copies and generalize to actual production environments, thereby improving classification accuracy without proportionally increasing system complexity
Solution Approach 2:
The patent performs preliminary training of neural network models on extensive datasets before deployment to production lines. The models are pre-trained to recognize defect patterns and normal variations in advance, so that during actual inspection operations, the system can make accurate classifications without requiring complex real-time rule tuning or adjustment, reducing operational system complexity while maintaining high accuracy
4Adaptability or versatility
If new products are introduced to production, then product variety increases, but inspection reliability decreases due to lack of training data
Solution Approach 1:
The patent implements a dynamic inspection system where the neural network models can be quickly retrained or fine-tuned for new product types. The system adapts its classification parameters dynamically based on the specific product being inspected, allowing high reliability for new products without requiring manual reconfiguration of inspection rules. The model can learn new defect patterns and variations specific to each product type through rapid retraining on available training data
Solution Approach 2:
The patent creates a universal inspection system where a single neural network architecture can be applied across multiple product types through transfer learning. The base model learns general defect detection capabilities and can be fine-tuned for specific products using relatively small training datasets, enabling the system to maintain high reliability for diverse product types without requiring separate specialized inspection systems for each product category
Data Source
AI summary
A vision analytics and validation (VAV) system for providing an improved inspection of robotic assembly, the VAV system comprising a trained neural network three-way classifier, to classify each component as good, bad, or do not know, and an operator station configured to enable an operator to review an output of the trained neural network, and to determine whether a board including one or more “bad” or a “do not know” classified components passes review and is classified as good, or fails review and is classified as bad. In one embodiment, a retraining trigger to utilize the output of the operator station to train the trained neural network, based on the determination received from the operator station.


