Variable Mix Ratio Data Generation for GAN Convergence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Generative Adversarial Networks (GANs) face inefficiencies in learning, requiring extensive time for the Generator and Discriminator to converge effectively.

Innovation Solution

A data generation apparatus and method that incorporates a mix data generation unit to mix real and fake data at a variable mix ratio based on data element position or time, allowing the Discriminator to learn from a mix of real, fake, and mix data, thereby optimizing the learning process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the Generative Adversarial Network is used to generate fake data and train the Discriminator, then the model can learn to discriminate real from fake data, but the learning process requires enormously much time and is difficult to perform efficiently

Engineering Contradiction:
Improvediscrimination accuracyVSAvoidlearning time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-processing the training data through mixing real and fake data at different ratios before feeding it to the Discriminator. The mix data generation unit creates augmented training samples in advance, allowing the Discriminator to learn from diverse data distributions without requiring extensive training time. This pre-prepared mixed data serves as enhanced training material that accelerates the learning process while maintaining high discrimination accuracy.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If the mix ratio is kept constant for all data elements, then the data processing is simple, but the learning efficiency is reduced

Engineering Contradiction:
Improvelearning efficiencyVSAvoiddata processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements local quality by varying the mix ratio according to the position of each data element within the data sequence. Instead of applying a uniform mix ratio to all data elements, the system adjusts the mix ratio locally based on positional information, allowing different regions of the training data to have optimized mixing characteristics. This position-dependent mix ratio strategy enhances learning efficiency by providing spatially varied training examples while maintaining manageable processing complexity through a systematic approach.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20220366228A1Data generation apparatus, data generation method, learning apparatus and recording medium
Publication Date: 2022.11.17 NEC CORP
  • US20220366228A1 patent drawing
  • US20220366228A1 patent drawing
  • US20220366228A1 patent drawing

AI summary

A data generation apparatus (2) has: an obtaining unit (21) that obtains real data (D_real); a fake data generating unit (22) that generates fake data (D_fake) that imitates the real data; and a mix data generating unit (23) that generates mix data (D_mix) by mixing the real data and the fake data at a desired mix ratio (a), the mix data generating unit changes the mix ratio that is used to generate a data element of the mix data based on a position of the data element in the mix data.