Causal Inference Engine for Digital Action Uplift

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for determining causal treatment effects of actions performed on websites or applications are inefficient and not scalable, especially with the increasing number of possible actions, requiring extensive experimentation or manual construction of observational studies.

Innovation Solution

A machine learning system that uses interaction data to generate a feature matrix, identifies confounding variables, and trains a regression model to compute projected causal treatment effects, allowing for efficient estimation and adaptation to different websites or applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If controlled experiments (A/B tests) are performed to determine causal treatment effects, then measurement precision is improved, but productivity deteriorates due to the extensive time required (months to years)

Engineering Contradiction:
Improvecausal treatment effect estimation accuracyVSAvoidexperiment execution speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary actions by collecting and storing interaction data, feature matrices, and user attributes in advance. This allows the causal inference engine to quickly estimate treatment effects without conducting time-consuming controlled experiments at the moment of analysis, thus improving productivity while maintaining measurement precision through pre-prepared data structures.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a simulated environment by generating synthetic control and treatment groups from historical interaction data, copying real user behavior patterns. This allows causal inference to be performed on copied data rather than requiring actual controlled experiments, dramatically reducing execution time while preserving the ability to measure causal effects accurately.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If the number of actions on a website or application increases, then adaptability is improved, but device complexity worsens making causal inference increasingly difficult

Engineering Contradiction:
Improvenumber of performable actionsVSAvoidcausal inference complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the complex causal inference problem into distinct components: interaction data collection, feature matrix generation, confounding variable identification, and treatment effect estimation. Each component is handled by a specialized module, making the overall system manageable despite the increasing number of actions. The feature matrix itself segments user interactions into structured features that can be processed independently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary layer of confounding variable identification and feature engineering between the raw interaction data and the causal treatment effect estimation. This intermediary processing transforms the complex high-dimensional action data into a manageable feature space, reducing the complexity of causal inference while maintaining adaptability to numerous actions.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If observational studies are manually constructed to solve causal inference, then measurement precision is improved, but loss of time worsens due to exceptionally long construction time

Engineering Contradiction:
Improvecausal effect projection accuracyVSAvoidstudy construction time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system implements self-service by automatically constructing observational studies without manual intervention. The causal inference engine automatically identifies confounding variables, generates feature matrices, and projects causal effects from historical data. This automated self-service eliminates the exceptionally long manual construction time while maintaining the measurement precision of carefully designed observational studies.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by pre-processing interaction data into feature matrices and pre-identifying potential confounding variables before causal inference is needed. This preliminary preparation dramatically reduces the time required to construct observational studies, as the heavy lifting of data transformation and feature engineering is completed in advance rather than at the moment of analysis.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If human experts manually select actions for observational studies, then measurement precision is improved, but loss of information worsens due to human bias

Engineering Contradiction:
Improveaction selection accuracyVSAvoidhuman bias in action selection
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system replaces human experts with an automated causal inference engine that objectively selects actions and identifies confounding variables based on statistical relationships in the data rather than human judgment. This self-service approach eliminates human bias entirely while maintaining or improving measurement precision through data-driven selection criteria that consider all available actions without subjective filtering.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes the selection criterion from human expert judgment to algorithmic optimization based on statistical parameters. The causal inference engine evaluates actions and confounding variables based on quantitative measures of their relationship with the target metric, replacing subjective human parameters with objective data-driven parameters that eliminate bias while preserving measurement precision.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12288144B2Machine learning system to predict causal treatment effects of actions performed on websites or applications
Publication Date: 2025.04.29 AMPLITUDE INC
  • US12288144B2 patent drawing
  • US12288144B2 patent drawing
  • US12288144B2 patent drawing

AI summary

Systems and methods for computing a causal uplift in performance of an output action for one or more treatment actions in parallel are described herein. In an embodiment, a server computer receives interaction data for a particular period of time which identifies a plurality of users and a plurality of actions that were performed by each user of the plurality of users through a particular graphical user interface during the particular period of time. The server computer uses the interaction data to generate a feature matrix of actions for each user, and a set of confounding variables included to minimize spurious correlations. The feature matrix is then used to train a machine learning system, using data identifying a user's performance or non-performance of each action as inputs and data identifying performance or non-performance of a target output action as the output. A treatment effect is then computed for a treatment action by generating a simulated treatment matrix where all values for the treatment action are set to true, computing an average of outputs from the machine learning system using the simulated treatment matrix, generating a simulated control matrix where all values for the treatment action are set to false, computing an average of outputs from the machine learning system using the simulated control matrix, and computing a difference between the two average outputs.