GAN-Based Training Data Recovery for Pre-Trained Classifiers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is no existing technique to extract the training data from a trained machine learning model, which is essential for evaluating the quality of the model and determining if sufficient training data was used.

Innovation Solution

A method is provided that uses a generative adversarial network (GAN) to generate simulated data samples that approximate the training data used to train a pre-trained classifier model, allowing for the recovery and evaluation of the original training data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a pre-trained classifier model is deployed for service, then the model can be used effectively for classification tasks, but the training data becomes inaccessible for quality evaluation

Engineering Contradiction:
Improvemodel effectivenessVSAvoidtraining data availability
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent creates a copy of the training data distribution by training a GAN to generate synthetic data samples that follow the same distribution as the original training data. The generator model learns to produce data samples that are statistically indistinguishable from the original training data, enabling quality evaluation without accessing the original data.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a GAN-based intermediary system that acts as a mediator between the deployed classifier model and the need for training data evaluation. The GAN generates synthetic training data that serves as a proxy for the original training data, allowing quality assessment of the classifier without direct access to the original training dataset.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If typical GAN networks are used to generate data, then data following the training data distribution can be produced, but data not included in the original distribution cannot be recovered or generated

Engineering Contradiction:
Improvedata distribution coverageVSAvoidunseen data recovery
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent inverts the typical GAN training approach by using the pre-trained classifier model as part of the training objective. Instead of training the GAN to only match the training data distribution, the classifier loss function guides the generator to produce data that the classifier would have seen during its training, enabling recovery of unseen training data characteristics.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent implements a feedback mechanism where the pre-trained classifier model provides classification signals back to the GAN generator during training. The classifier loss computed on generated samples feeds back to refine the generator, creating a closed-loop system that enables the GAN to learn and reproduce the training data distribution even for classes not explicitly present in the generation process.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12307377B2Generating data based on pre-trained models using generative adversarial models
Publication Date: 2025.05.20 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12307377B2 patent drawing
  • US12307377B2 patent drawing
  • US12307377B2 patent drawing

AI summary

Techniques for generator model training are provided. A classifier model that was trained using one or more data samples in a target class is received, and a generative adversarial network (GAN) is trained to generate simulated data samples for the target class, comprising: generating a first simulated data sample using a generator model, computing a first discriminator loss by processing the first simulated data sample using a discriminator model, computing a classifier loss by processing the first simulated data sample using the classifier model, and refining the generator model based on the first discriminator loss and the classifier loss.