Multi-Discriminator GAN with Deformation Operators for Learning Stability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Generative adversarial networks (GANs) face instability in learning and deterioration of generated data quality, especially in high-dimensional data such as speech and images, making it challenging to produce high-quality outputs.

Innovation Solution

An improved GAN implementation using multiple discriminators and deformation operators, where each discriminator receives data subjected to different deformation processing, updates the generator and discriminators to enhance accuracy and stability, allowing for better learning and higher quality data generation in high-dimensional models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a conventional GAN with single discriminator is used, then the structure is simple, but the learning stability deteriorates

Engineering Contradiction:
ImproveGAN structureVSAvoidlearning stability
Core Design Contradiction:
Device complexityVSStability of the object's composition

Solution Approach 1:

The patent divides the single discriminator into multiple discriminators (first discriminator and second discriminator), each performing discrimination from different perspectives. This segmentation allows the system to maintain simpler individual components while achieving improved overall learning stability through coordinated multi-perspective discrimination.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If the number of dimensions of learning sample is increased, then the data representation becomes more comprehensive, but the quality of generated data deteriorates

Engineering Contradiction:
Improvedata dimensionsVSAvoidgenerated data quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent introduces a new dimensional perspective by applying different deformation processing (spatial transformations) to the input data before discrimination. This allows the discriminators to evaluate generated data from multiple transformed viewpoints, effectively handling high-dimensional data while maintaining quality through multi-angle verification.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Stability of the object's composition

If multiple discriminators with deformation processing are introduced, then the learning stability and generated data quality improve, but the device complexity increases

Engineering Contradiction:
Improvelearning stabilityVSAvoidGAN structure
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent designs multiple discriminators that share a common architecture and deformation processing mechanisms, allowing them to perform multiple functions simultaneously. Each discriminator can process different types of deformed data while using the same underlying structure, reducing redundant complexity while maintaining the benefits of multi-perspective discrimination.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Manufacturing precision

If multiple discriminators with deformation processing are introduced, then the generated data quality improves, but the computational resources required increase

Engineering Contradiction:
Improvegenerated data qualityVSAvoidcomputational resources
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent merges the deformation processing functionality across multiple discriminators, allowing them to share computational operations. By combining their efforts in a coordinated manner during the discrimination process, the system achieves high-quality generated data while reducing redundant computational overhead compared to completely independent discriminators.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11568270B2Non-transitory computer-readable storage medium storing improved generative adversarial network implementation program, improved generative adversarial network implementation apparatus, and learned model generation method
Publication Date: 2023.01.31 PREFERRED NETWORKS INC
  • US11568270B2 patent drawing
  • US11568270B2 patent drawing
  • US11568270B2 patent drawing

AI summary

A generation function to generate and output generated data from an input, a discrimination function to cause each discriminator to discriminate whether the data to be discriminated is based on the training data or the generated data and to output a discrimination result. Also an update function to update the discriminator that has output the discrimination result such that the data to be discriminated is discriminated with higher accuracy, and to further update the generator to increase a probability of discriminating that the generated data-based data to be discriminated is the training data-based data, and a whole update function to cause the updates to be executed for the generator and all the discriminators.