Bootstrapped Simulation Data for ML Model Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Machine learning models trained on limited datasets may produce inaccurate predictions due to their narrow range of scenarios, leading to suboptimal decision-making and resource inefficiencies.

Innovation Solution

The system generates bootstrapped simulation data by simulating various scenarios based on the outputs of a first prediction model, using a simulation engine to create a simulated dataset. This dataset is then used to train a set of second prediction models, which estimate features of the first prediction model. These second models are aggregated into an aggregated model that can generate new predictions and perform automated actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If machine learning models are trained on limited datasets, then training time and computational resources are reduced, but prediction accuracy deteriorates due to narrow scenario coverage

Engineering Contradiction:
Improvetraining efficiencyVSAvoidprediction accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary actions by generating synthetic training data through simulation before actual model training occurs. The simulation engine creates bootstrapped simulated data that expands the training dataset, allowing models to be trained on broader scenarios without requiring extensive real-world data collection, thus improving prediction accuracy while maintaining training efficiency

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates copies of existing data through simulation and bootstrapping techniques. By generating synthetic data that replicates real-world scenarios and patterns, the system expands the training dataset without requiring additional real data collection, thereby improving model generalization and prediction accuracy across diverse scenarios

Inventive Principle:
Principle #26Copying

2Measurement precision

If machine learning models are trained on diverse datasets covering broader scenarios, then prediction accuracy improves, but data collection time and computational resources increase

Engineering Contradiction:
Improveprediction accuracyVSAvoiddata collection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Instead of collecting diverse real-world data over extended periods, the system creates synthetic copies through simulation engines that replicate various scenarios. This approach provides broad scenario coverage for improved prediction accuracy without the time investment required for extensive real data collection

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system replaces the mechanical process of physical data collection with computational simulation. The simulation engine generates synthetic data that covers diverse scenarios without requiring actual field data collection, thereby improving prediction accuracy while eliminating time losses associated with data gathering

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If machine learning models are trained on diverse datasets covering broader scenarios, then prediction accuracy improves, but computational resources and processing power increase

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary data generation through simulation before model training. By pre-generating bootstrapped simulated data that covers diverse scenarios, the system enables models to achieve high prediction accuracy without requiring computationally intensive processing of extensive real-world datasets during training

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses computationally efficient synthetic data copying through simulation rather than processing large volumes of real data. The bootstrapped simulated datasets provide diverse scenario coverage with lower computational overhead compared to training on extensive real-world datasets

Inventive Principle:
Principle #26Copying

4Adaptability or versatility

If machine learning models are deployed to handle incomplete information scenarios, then decision-making capability improves, but model reliability deteriorates due to lack of sufficient training data

Engineering Contradiction:
Improvedecision-making capabilityVSAvoidmodel reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system creates synthetic training examples through simulation that represent incomplete or uncertain scenarios. By copying and expanding these scenarios in the training data through bootstrapping, the model learns to handle incomplete information reliably while maintaining adaptability to various decision-making situations

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system preliminarily prepares the model for incomplete information scenarios by including simulated cases with missing or uncertain data in the training phase. This preliminary exposure enables the model to make reliable decisions in incomplete information scenarios without compromising model reliability

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250117688A1Bootstrapped simulated data for model simulation and selection
Publication Date: 2025.04.10 CAPITAL ONE SERVICES LLC
  • US20250117688A1 patent drawing
  • US20250117688A1 patent drawing
  • US20250117688A1 patent drawing

AI summary

In some implementations, a device may receive an input for a first prediction model. The device may execute, using the input, the first prediction model to generate a set of outputs, wherein the set of outputs is based on a set of inputs to a data processing pipeline associated with the first prediction model. The device may generate using a simulation engine and based on the set of outputs of the first prediction, a set of simulations of a set of results of implementing a set of actions associated with the first prediction model, wherein the set of simulations is associated with a simulated dataset representing a set of forecasts for simulating the set of results of implementing the set of actions. The device may output the simulated dataset to a model generation pipeline.