Ensemble Prediction for Dynamic Conversational Responses

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing conversational systems face challenges in accurately anticipating user intent due to limited features and web pages, leading to difficulty in distinguishing between multiple intents that use the same features or web pages, resulting in biased responses.

Innovation Solution

The system employs ensemble prediction using multiple machine learning models, including convolutional neural networks for image processing and Weight of Evidence analysis for time-dependent user account information, to generate dynamic conversational responses by aggregating multi-modal feature inputs and preventing bias across different data sources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the system uses limited features and web pages to determine user intent, then the system complexity is reduced, but the accuracy of intent determination deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidintent determination accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system segments the intent determination process by dividing features into multiple modalities (textual, visual, audio, contextual) and processing them through separate specialized models before aggregation. This segmentation allows each model to focus on specific feature types, improving overall accuracy without requiring a single monolithic complex system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges multiple machine learning models that process different feature modalities into an ensemble approach. By combining predictions from text classification models, visual recognition models, audio processing models, and contextual analysis models, the system achieves higher intent determination accuracy than any single model could provide alone.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If the system uses multiple machine learning models to improve prediction accuracy, then the measurement precision improves, but the device complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the prediction task by assigning different machine learning models to process different feature modalities. Textual features are processed by classification models, visual features by recognition models, audio features by processing models, and contextual features by analysis models. This segmentation allows for specialized processing while maintaining overall system manageability through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements a universal ensemble framework that can accommodate multiple types of machine learning models for different purposes. The commonality in the ensemble approach allows the system to handle diverse prediction tasks using the same architectural pattern, reducing the complexity burden of managing multiple specialized systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If the system aggregates multi-modal feature inputs to prevent bias, then the reliability improves, but the processing time increases

Engineering Contradiction:
Improveresponse pertinenceVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary processing of multi-modal features by pre-extracting and pre-processing information from different modalities before the final aggregation step. Features such as textual embeddings, visual descriptors, audio transcriptions, and contextual metadata are prepared in advance, allowing for faster aggregation and reducing real-time processing requirements while maintaining response pertinence.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous processing of multi-modal features through streaming approaches where features are continuously aggregated and processed as they become available. This continuous action allows the system to update predictions in real-time without requiring complete reprocessing of all features, thus reducing processing time while maintaining high reliability through ongoing multi-modal analysis.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS20250023833A1Systems and methods for generating dynamic conversational responses using ensemble prediction based on a plurality of machine learning models
Publication Date: 2025.01.16 CAPITAL ONE SERVICES LLC
  • US20250023833A1 patent drawing
  • US20250023833A1 patent drawing
  • US20250023833A1 patent drawing

AI summary

Methods and systems are described for generating dynamic interface options using machine learning models. The dynamic interface options may be generated in real time and reflect the likely goals and/or intents of a user. The machine learning model may provide these features by interpreting multi-modal feature inputs. For example, the machine learning model may include a first machine learning model, wherein the first machine learning model comprises a convolutional neural network, and a second machine learning model, wherein the second machine learning model performs a Weight of Evidence (WOE) analysis.