Synthetic Data Generation Using Multi-Model Hyperparameter Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current techniques for generating synthetic data are limited in their ability to closely mimic real data, which is essential for effective machine learning model training and decision-making.

Innovation Solution

A method involving multiple trained machine learning models is used to generate synthetic data vectors by iteratively updating hyperparameters based on error functions that assess similarity, prediction, and bias, ensuring the synthetic data closely resembles real data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If current techniques are used to generate synthetic data, then the generation process is simple, but the synthetic data cannot closely mimic real data properties

Engineering Contradiction:
Improvesimilarity to real dataVSAvoidcomplexity of generation process
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the synthetic data generation process into multiple independent components: a base distribution model for generating base features, a conditional distribution model for generating conditional features, and a combination model that integrates both. This segmentation allows each component to be optimized independently while working together to produce high-quality synthetic data that closely mimics real data properties.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a nested structure where the conditional distribution model operates within the framework of the base distribution model. The base model generates foundational features, and the conditional model builds upon these to generate additional features conditioned on the base features. This nested arrangement enables the system to capture complex dependencies while maintaining computational efficiency.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Manufacturing precision

If multiple models and iterative updates are used to improve synthetic data quality, then the synthetic data more accurately reflects real data, but the computation time increases

Engineering Contradiction:
Improveaccuracy of synthetic dataVSAvoidcomputation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-training the base distribution model and conditional distribution model separately before combining them. The base model is trained to capture fundamental data patterns, and the conditional model is trained to capture relationships between features. This preliminary training enables the combination model to quickly generate accurate synthetic data without requiring extensive computation during the actual generation process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent incorporates feedback mechanisms where the combination model uses predictions from both the base and conditional models to generate synthetic data, and these predictions are continuously refined. The system iteratively updates the models based on the quality of generated data, allowing the models to learn from their own predictions and improve accuracy over time without requiring complete retraining.

Inventive Principle:
Principle #23Feedback

3Reliability

If the system uses multiple trained machine learning models with different hyperparameters, then the synthetic data captures complex probability distributions, but the system complexity increases

Engineering Contradiction:
Improvecapture of probability distributionsVSAvoidnumber of models and hyperparameter sets
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent designs the base distribution model and conditional distribution model to serve multiple functions. The base model not only generates base features but also provides a framework for understanding overall data patterns. The conditional model not only generates conditional features but also captures relationships between features. This multi-functionality reduces the need for separate specialized models, thereby reducing overall system complexity while maintaining the ability to capture complex probability distributions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent manages system complexity by systematically varying hyperparameters within each model rather than creating entirely separate models for different data characteristics. The base model and conditional model each have their own hyperparameter sets that can be independently optimized. By changing parameters rather than creating new models, the system maintains flexibility in capturing different probability distributions while avoiding the complexity of managing multiple distinct model architectures.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250363185A1Techniques for generating synthetic data
Publication Date: 2025.11.27 SAS INSTITUTE INC
  • US20250363185A1 patent drawing
  • US20250363185A1 patent drawing
  • US20250363185A1 patent drawing

AI summary

A system and method include generating synthetic data by generating a first set of hyperparameters for a first trained machine learning model and a second set of hyperparameters for a second trained machine learning model, generating a plurality of synthetic data vectors using the first and second trained machine learning models, computing an error function for the first and second set of hyperparameters using a third machine learning model, computing an objective function value, responsive to determining that the objective function value is not an optimal value, updating the first set of hyperparameters and the second set of hyperparameters or responsive to determining that the objective function value is an optimal value outputting the plurality of synthetic data vectors as a set of synthetic data.