Synthetic Defect Data Generation Using Latent Vector Mixing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for detecting defects in LED panels, such as image processing algorithms and machine learning, face challenges in efficiently generating training data sets due to the low frequency of defective products, making it difficult to construct accurate and diverse defect data sets.

Innovation Solution

A method involving the mixing of latent vectors between good product images and defective parts in a latent space of an artificial neural network, using encoders and decoders to create synthetic defect data by transforming and adjusting the position, size, and shape of the defective parts within a depth map or segmentation mask.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If machine learning algorithms are introduced to detect defects automatically, then detection accuracy and productivity are improved, but the need for sufficient diverse defect training data becomes a limiting factor due to low defect occurrence frequency

Engineering Contradiction:
Improvedefect detection automationVSAvoidtraining data quantity
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent uses Generative Adversarial Networks (GANs) to generate synthetic defect images that copy the characteristics of real defects. The generator network creates artificial defect samples by learning from limited real defect data, effectively multiplying the training dataset without requiring additional physical defective products. This allows the machine learning model to be trained on sufficient diverse data while overcoming the low frequency of actual defect occurrence.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms real defect images into augmented training samples by applying parameter changes such as rotation, scaling, cropping, and color adjustments. These transformations create variations of the same defect type, expanding the diversity and quantity of training data. The system modifies parameters like position, size, and orientation of defects to generate multiple training instances from limited original defect images.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If more real defect data is collected to improve training data diversity, then model accuracy is improved, but the low frequency of defective products makes data collection inefficient and costly

Engineering Contradiction:
Improvedefect detection accuracyVSAvoiddata collection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

Instead of collecting more real defect data through time-consuming inspection processes, the system copies existing defect characteristics through GAN-based synthetic image generation. The generator learns the distribution of real defects and produces artificial samples that preserve essential defect features while eliminating the need for extensive physical data collection. This dramatically reduces the time and resources required to build diverse training datasets.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary action by pre-processing and augmenting available defect images before training begins. Defect images are pre-augmented with various transformations (rotation, scaling, translation) to create a expanded dataset in advance. This preliminary data preparation ensures sufficient training data availability without requiring extensive real-time data collection during the modeling process.

Inventive Principle:
Principle #10Preliminary action

3Ease of manufacture

If traditional image processing algorithms with fixed rules are used, then implementation simplicity is maintained, but the ability to handle varied defect shapes and sizes is limited

Engineering Contradiction:
Improvealgorithm implementation simplicityVSAvoiddefect detection flexibility
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent transitions from fixed-rule algorithms to parameter-based machine learning models that can adapt to various defect types. Instead of hardcoding detection rules for specific defect shapes and sizes, the system uses learnable parameters in neural networks that automatically adjust to different defect characteristics. The model learns optimal detection parameters from training data, enabling flexible handling of diverse defect variations while maintaining implementation simplicity through automated training.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system uses synthetic defect images generated by GANs to teach the machine learning model various defect patterns. By copying and transforming real defect characteristics into synthetic samples, the model learns to recognize diverse defect types without requiring complex hand-crafted rules. This approach maintains implementation simplicity while achieving high adaptability to varied defect shapes, sizes, and orientations.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240070851A1Method for Generating Data Set for Training and Electronic Device Supporting the Same
Publication Date: 2024.02.29 SK PLANET CO LTD
  • US20240070851A1 patent drawing
  • US20240070851A1 patent drawing
  • US20240070851A1 patent drawing

AI summary

The present invention relates to a data set generation method and an electronic device supporting the same. The method includes collecting an original good product image and an original defect image for the purpose of generating a training data set, extracting a defective part from the original defect image, and mixing the extracted defective part with the original good product image. In the method, mixing includes performing mixing of latent vectors between the defective part and the original good product image.