Hybrid Dialog Management System for Open-Domain Fluency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Achieving high levels of fluency and coherence in responses from automated agents in large or open-domain dialog-driven applications remains a non-trivial technical challenge, especially with the complexity of interactions and the need for logical correctness in task-oriented dialog management.

Innovation Solution

A hybrid approach combining machine learning methodologies, such as skip-connection models, with state-response mapping entries trained on human interactions, where accumulated dialog state information is used to select responses from a repository of trusted agent responses, ensuring higher fluency and coherence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a scripted approach is used with limited domains, then the application can achieve good performance with simple implementation, but the application cannot handle large or open-domain dialog-driven tasks

Engineering Contradiction:
Improvedomain coverageVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments dialog management into multiple independent modules: policy module (decides what to say), response generation module (generates responses), and response selection module (selects from alternatives). Each module handles specific aspects of dialog management, allowing the system to tackle complex open-domain tasks while maintaining manageable complexity through modular architecture

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adapts its behavior based on dialog state and context. The response generation and selection processes adjust their strategies according to the current dialog situation, enabling the system to handle diverse open-domain tasks effectively while maintaining appropriate complexity only when needed

Inventive Principle:
Principle #15Dynamics

2Reliability

If machine learning models are used to improve fluency and coherence, then the quality of automated responses improves, but the resource usage and computational requirements increase

Engineering Contradiction:
Improvefluency and coherence qualityVSAvoidcomputational resource usage
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system applies machine learning techniques selectively to specific aspects of dialog management where they provide the most value (response generation and selection), rather than applying them uniformly throughout the entire system. This localized application maintains high fluency and coherence quality while minimizing unnecessary computational resource usage in other parts of the system

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses pre-trained language models and pre-generated response templates that can be copied and adapted for different dialog scenarios. This approach maintains high response quality through proven ML models while reducing computational overhead by reusing pre-processed knowledge rather than generating everything from scratch

Inventive Principle:
Principle #26Copying

3Reliability

If complex machine learning methodologies are deployed, then the fluency and coherence of responses improve, but the system cannot be implemented on small-footprint devices

Engineering Contradiction:
Improveresponse qualityVSAvoiddevice footprint
Core Design Contradiction:
ReliabilityVSVolume of moving object

Solution Approach 1:

The system segments the heavy computational workload of machine learning into separate, optimized components that can be distributed or selectively deployed. The policy module can run on resource-constrained devices with simpler logic, while the response generation module uses pre-trained models that require less computational power during inference, enabling deployment on small-footprint devices while maintaining response quality

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs computationally intensive machine learning operations in advance during training phases, creating pre-trained models and response templates. During actual dialog execution on small-footprint devices, the system only needs to perform lighter inference operations using these pre-processed artifacts, making high-quality response generation feasible on resource-constrained hardware

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11797769B1Artificial intelligence system using hybrid technique for task-oriented dialog management
Publication Date: 2023.10.24 AMAZON TECH INC
  • US11797769B1 patent drawing
  • US11797769B1 patent drawing
  • US11797769B1 patent drawing

AI summary

In response to determining that a particular sequence of natural language input has been generated by a first entity participating in a multi-interaction dialog, a first representation of accumulated dialog state associated with the sequence is obtained from a machine learning model at an artificial intelligence service. Based on the first representation, a state response entry is selected from a collection of state response entries. The state response entry indicates a mapping between a second representation of accumulated dialog state, and a response recorded in a training example of the model. The recorded response is implemented.