Deep Neural Network User Segmentation via Feature Embedding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for managing user behavior in online products are inefficient in analyzing complex historical user features, leading to challenges in predicting user retention and churn rates, and providing personalized recommendations to maintain engagement.

Innovation Solution

A deep neural network system processes time-stamped user interaction features to identify user segments and predict churn rates, using natural language processing to generate personalized recommendations and increase product engagement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If deep neural network is used to process user behavior features, then user segmentation accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveuser segmentation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments users into distinct cohorts based on their behavior patterns, transforming complex user data into manageable groups. This segmentation approach allows the deep neural network to process user features more effectively by dividing the large-scale user base into smaller, analyzable segments, thereby improving segmentation accuracy while managing system complexity through structured data organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing layer that transforms raw user behavior data into meaningful features before feeding them to the deep neural network. This intermediary step includes feature extraction, selection, and engineering processes that simplify the input data structure, reducing the complexity burden on the neural network while maintaining or enhancing segmentation accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If complex historical user features are analyzed, then prediction accuracy is improved, but processing time increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-processing and engineering user behavior features before the main analysis. This includes creating aggregated metrics, transforming raw data into meaningful indicators, and preparing feature sets in advance. By performing these preparatory steps beforehand, the system reduces the processing time required during actual prediction while maintaining comprehensive analysis of historical user features for accurate predictions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts only the most relevant and informative features from the complex historical user data, rather than processing all available data. This feature extraction process identifies and isolates key behavioral indicators that drive prediction accuracy, eliminating redundant or less significant features. By taking out only the essential features, the system achieves high prediction accuracy with reduced processing time.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11954577B2Deep neural network based user segmentation
Publication Date: 2024.04.09 INTUIT INC
  • US11954577B2 patent drawing
  • US11954577B2 patent drawing
  • US11954577B2 patent drawing

AI summary

A computer-implemented method and system having computer-executable instructions stored in a memory for processing user behavior features by neural networks to identify user segments. The method includes receiving user datasets from a database along with respective user identifiers, retention labels, static user features and interactive user features associated with an online product during a time period. A first neural network processes the interactive user features to generate a time distributed concatenation representation. A second neural network is configured to generate a vector by embedding the time distributed concatenation representation and the static user features through an embedding layer. The second neural network is configured to process the vector through a plurality of layers. A cluster model is used to determine user segments based on values extracted from nodes of a second to last layer of the second neural network.