Synthetic Defect Data Generation Using Latent Vector Mixing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for detecting defects in LED panels, such as image processing algorithms and machine learning, face challenges in efficiently generating training data sets due to the low frequency of defective products, making it difficult to construct accurate and diverse defect data sets.
Innovation Solution
A method involving the mixing of latent vectors between good product images and defective parts in a latent space of an artificial neural network, using encoders and decoders to create synthetic defect data by transforming and adjusting the position, size, and shape of the defective parts within a depth map or segmentation mask.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If machine learning algorithms are introduced to detect defects automatically, then detection accuracy and productivity are improved, but the need for sufficient diverse defect training data becomes a limiting factor due to low defect occurrence frequency
Solution Approach 1:
The patent uses Generative Adversarial Networks (GANs) to generate synthetic defect images that copy the characteristics of real defects. The generator network creates artificial defect samples by learning from limited real defect data, effectively multiplying the training dataset without requiring additional physical defective products. This allows the machine learning model to be trained on sufficient diverse data while overcoming the low frequency of actual defect occurrence.
Solution Approach 2:
The patent transforms real defect images into augmented training samples by applying parameter changes such as rotation, scaling, cropping, and color adjustments. These transformations create variations of the same defect type, expanding the diversity and quantity of training data. The system modifies parameters like position, size, and orientation of defects to generate multiple training instances from limited original defect images.
2Reliability
If more real defect data is collected to improve training data diversity, then model accuracy is improved, but the low frequency of defective products makes data collection inefficient and costly
Solution Approach 1:
Instead of collecting more real defect data through time-consuming inspection processes, the system copies existing defect characteristics through GAN-based synthetic image generation. The generator learns the distribution of real defects and produces artificial samples that preserve essential defect features while eliminating the need for extensive physical data collection. This dramatically reduces the time and resources required to build diverse training datasets.
Solution Approach 2:
The system performs preliminary action by pre-processing and augmenting available defect images before training begins. Defect images are pre-augmented with various transformations (rotation, scaling, translation) to create a expanded dataset in advance. This preliminary data preparation ensures sufficient training data availability without requiring extensive real-time data collection during the modeling process.
3Ease of manufacture
If traditional image processing algorithms with fixed rules are used, then implementation simplicity is maintained, but the ability to handle varied defect shapes and sizes is limited
Solution Approach 1:
The patent transitions from fixed-rule algorithms to parameter-based machine learning models that can adapt to various defect types. Instead of hardcoding detection rules for specific defect shapes and sizes, the system uses learnable parameters in neural networks that automatically adjust to different defect characteristics. The model learns optimal detection parameters from training data, enabling flexible handling of diverse defect variations while maintaining implementation simplicity through automated training.
Solution Approach 2:
The system uses synthetic defect images generated by GANs to teach the machine learning model various defect patterns. By copying and transforming real defect characteristics into synthetic samples, the model learns to recognize diverse defect types without requiring complex hand-crafted rules. This approach maintains implementation simplicity while achieving high adaptability to varied defect shapes, sizes, and orientations.
Data Source
AI summary
The present invention relates to a data set generation method and an electronic device supporting the same. The method includes collecting an original good product image and an original defect image for the purpose of generating a training data set, extracting a defective part from the original defect image, and mixing the extracted defective part with the original good product image. In the method, mixing includes performing mixing of latent vectors between the defective part and the original good product image.


