RNN Model Training with Behavioral Data Sequences

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems fail to leverage behavioral data effectively to train Recurrent Neural Network (RNN) machine learning models, such as Long Short-Term Memory (LSTM), for accurate predictions, particularly in fraud detection, as they rely on data captured at a single snapshot in time rather than sequential information.

Innovation Solution

The system trains an RNN model using behavioral data sequences generated from event codes, which represent features of transactions, allowing the model to account for dynamic user behavior and improve prediction accuracy by utilizing sequential data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional systems use data captured at a single snapshot in time for training machine learning models, then the system complexity remains low, but the prediction accuracy deteriorates because sequential behavioral patterns cannot be captured

Engineering Contradiction:
Improveprediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system transitions from static snapshot data to dynamic sequential data by implementing behavioral data sequences that capture user actions over time. The RNN model processes this temporal sequence of events, allowing the system to adapt to changing behavioral patterns and improve prediction accuracy through dynamic analysis of user behavior evolution.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system adds a temporal dimension to the data by creating behavioral sequences that incorporate time-ordered user actions. Instead of analyzing isolated transactions, the system now processes sequences of events with temporal relationships, enabling the model to detect patterns across multiple time points and significantly improve fraud detection accuracy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If conventional systems rely on isolated transaction data without behavioral context, then the data processing speed remains high, but the fraud detection accuracy deteriorates due to lack of behavioral pattern recognition

Engineering Contradiction:
Improvefraud detection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary processing by pre-computing and storing behavioral data sequences that capture user behavior patterns over time. This preprocessing creates ready-to-analyze sequential data structures that can be quickly fed into the trained RNN model during fraud detection, eliminating the need for complex real-time sequence construction and reducing processing time while maintaining high accuracy.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the system implements RNN models with behavioral data sequences, then the ability to detect fraudulent patterns improves, but the computational resources required increase

Engineering Contradiction:
Improvefraud detection reliabilityVSAvoidcomputational energy
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs model training and sequence processing in advance, creating a pre-trained RNN model that can quickly evaluate new transactions. By completing the computationally intensive sequence analysis during the training phase rather than during real-time fraud detection, the system achieves high detection reliability while minimizing energy consumption during actual transaction processing.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12014372B2Training a recurrent neural network machine learning model with behavioral data
Publication Date: 2024.06.18 PAYPAL INC
  • US12014372B2 patent drawing
  • US12014372B2 patent drawing
  • US12014372B2 patent drawing

AI summary

Event data of a first entity is accessed. The first entity has been flagged as having a predefined status. The event data corresponds to a plurality of events involving the first entity that occurred within a predefined first time period. Based on the accessing of the event data, behavioral data of the first entity is generated. The behavioral data is formatted as a data sequence. A machine learning model is trained using the behavioral data of the first entity as training data. Using the trained machine learning model, a determination is made as to whether a second entity has the predefined status.