GAN-Based Training Data Recovery for Pre-Trained Classifiers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is no existing technique to extract the training data from a trained machine learning model, which is essential for evaluating the quality of the model and determining if sufficient training data was used.
Innovation Solution
A method is provided that uses a generative adversarial network (GAN) to generate simulated data samples that approximate the training data used to train a pre-trained classifier model, allowing for the recovery and evaluation of the original training data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a pre-trained classifier model is deployed for service, then the model can be used effectively for classification tasks, but the training data becomes inaccessible for quality evaluation
Solution Approach 1:
The patent creates a copy of the training data distribution by training a GAN to generate synthetic data samples that follow the same distribution as the original training data. The generator model learns to produce data samples that are statistically indistinguishable from the original training data, enabling quality evaluation without accessing the original data.
Solution Approach 2:
The patent introduces a GAN-based intermediary system that acts as a mediator between the deployed classifier model and the need for training data evaluation. The GAN generates synthetic training data that serves as a proxy for the original training data, allowing quality assessment of the classifier without direct access to the original training dataset.
2Adaptability or versatility
If typical GAN networks are used to generate data, then data following the training data distribution can be produced, but data not included in the original distribution cannot be recovered or generated
Solution Approach 1:
The patent inverts the typical GAN training approach by using the pre-trained classifier model as part of the training objective. Instead of training the GAN to only match the training data distribution, the classifier loss function guides the generator to produce data that the classifier would have seen during its training, enabling recovery of unseen training data characteristics.
Solution Approach 2:
The patent implements a feedback mechanism where the pre-trained classifier model provides classification signals back to the GAN generator during training. The classifier loss computed on generated samples feeds back to refine the generator, creating a closed-loop system that enables the GAN to learn and reproduce the training data distribution even for classes not explicitly present in the generation process.
Data Source
AI summary
Techniques for generator model training are provided. A classifier model that was trained using one or more data samples in a target class is received, and a generative adversarial network (GAN) is trained to generate simulated data samples for the target class, comprising: generating a first simulated data sample using a generator model, computing a first discriminator loss by processing the first simulated data sample using a discriminator model, computing a classifier loss by processing the first simulated data sample using the classifier model, and refining the generator model based on the first discriminator loss and the classifier loss.


