Generative-Discriminative Ensemble for User Lifetime Value Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for predicting user lifetime value rely on either generative or discriminative models, which have limitations such as rigid assumptions, inability to handle new features, and reliance on stale data, leading to inaccurate predictions.

Innovation Solution

An ensemble approach combining generative and discriminative models, with a meta-model to weigh their outputs and adjust feature importance, maximizing training data usage and improving prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If generative models are used to predict lifetime value, then the amount of training data that can be utilized is maximized, but prediction accuracy for individual users deteriorates due to aggregate-level predictions

Engineering Contradiction:
Improveamount of training dataVSAvoidprediction accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent combines generative models and discriminative models into an ensemble system. The generative model processes all available training data to capture aggregate patterns, while the discriminative model processes a holdout set to capture individual user patterns. Their predictions are merged through a meta-model that learns optimal weighting, thereby achieving both maximum data utilization and high individual prediction accuracy.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If discriminative models are used to predict lifetime value, then per-user prediction accuracy is improved, but the amount of training data that can be utilized deteriorates due to holdout period requirements

Engineering Contradiction:
Improveper-user prediction accuracyVSAvoidamount of training data
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent segments the training data into two distinct portions: a primary training set used by the generative model and a holdout set used by the discriminative model. This segmentation allows each model to specialize - the generative model learns from the bulk of data for aggregate patterns, while the discriminative model learns from the holdout set for individual user patterns, thereby maximizing overall data utilization while maintaining high accuracy.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If generative models are used to predict lifetime value, then flexibility in handling new features is improved, but ability to account for personalized user behaviors deteriorates

Engineering Contradiction:
Improveflexibility in handling new featuresVSAvoidpersonalized user behavior prediction
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent introduces a meta-model as an intermediary that receives predictions from both the generative model (which handles new features flexibly) and the discriminative model (which captures personalized behaviors). The meta-model learns optimal weighting strategies to combine these predictions, thereby inheriting the flexibility of the generative model while incorporating the personalization capabilities of the discriminative model.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If an ensemble of generative and discriminative models is used, then prediction accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The meta-model serves as an intermediary layer that simplifies the ensemble system by automatically learning optimal weighting strategies between the generative and discriminative models. This intermediary handles the complexity of coordinating multiple models, allowing the overall system to achieve high prediction accuracy while managing complexity through automated weight optimization rather than manual configuration.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20230128579A1Generative-discriminative ensemble method for predicting lifetime value
Publication Date: 2023.04.27 AMPERITY INC
  • US20230128579A1 patent drawing
  • US20230128579A1 patent drawing
  • US20230128579A1 patent drawing

AI summary

The example embodiments are directed toward predicting the lifetime value of a user using an ensemble model. In an embodiment, a system is disclosed, including a generative model for generating a first prediction representing a first lifetime value of a user during a forecasting period and a discriminative model configured for generating a second prediction representing a second lifetime value of the user during the forecasting period. The system further includes a meta-model for receiving the first prediction and the second prediction and generating a third prediction based on the first prediction and the second prediction, the third prediction representing a third lifetime value of the user during the forecasting period.