Dialog Act Selection via Controlled Randomness and ML Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Voice browsing systems face challenges in effectively selecting dialog acts to engage users, often leading to user dissatisfaction due to excessive questioning or inappropriate timing, which can result in abandoned goals or low satisfaction.

Innovation Solution

The implementation of controlled randomness and machine learning to select dialog acts by determining context features from user invocations, calculating estimated reward scores for dialog acts, and presenting them based on probability, ensuring a successful conversation outcome.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the system asks more questions to clarify user goals, then the accuracy of goal identification improves, but user satisfaction deteriorates due to excessive questioning

Engineering Contradiction:
Improvegoal identification accuracyVSAvoiduser satisfaction
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system applies partial action by selecting a subset of potentially useful dialog acts rather than asking all possible questions. The dialog act selection model prioritizes which questions to ask based on expected value, asking only the most necessary questions to achieve sufficient goal identification accuracy without overwhelming the user with excessive questioning.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system dynamically adapts the number and type of questions asked based on the current conversation state, user responses, and confidence in goal identification. The dialog act selection model adjusts its questioning strategy in real-time, asking more questions when uncertainty is high and fewer questions when the goal is well-understood, optimizing the balance between accuracy and user satisfaction.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the system asks relevant questions at the right time, then goal identification improves, but system complexity increases due to timing and selection requirements

Engineering Contradiction:
Improvegoal identification accuracyVSAvoiddialog act selection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The dialog act selection model automatically determines which dialog acts to present based on the current state, eliminating the need for manual configuration or complex external control systems. The system self-adjusts its questioning strategy by evaluating the expected value of different dialog acts and selecting the optimal ones autonomously, reducing overall system complexity while maintaining high goal identification accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from user responses to continuously refine its dialog act selection. Each user response updates the conversation state and informs the selection of subsequent dialog acts, creating a closed-loop system that adapts to user needs. This feedback mechanism enables precise goal identification through a streamlined selection process rather than complex predetermined question sequences.

Inventive Principle:
Principle #23Feedback

3Loss of information

If the system presents more dialog act options to users, then the completeness of information gathering improves, but conversation length increases leading to user abandonment

Engineering Contradiction:
Improveinformation completenessVSAvoidconversation length
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system applies partial action by presenting only the most valuable dialog act options rather than all possible questions. The dialog act selection model evaluates which questions will provide the most information gain relative to conversation length, selecting a optimized subset that achieves sufficient information completeness without unnecessarily extending the conversation and causing user abandonment.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11776542B1Selecting dialog acts using controlled randomness and offline optimization
Publication Date: 2023.10.03 AMAZON TECH INC
  • US11776542B1 patent drawing
  • US11776542B1 patent drawing
  • US11776542B1 patent drawing

AI summary

Dialog acts (e.g., questions) are selected for voice browsing by a machine learning model trained to identify a dialog act that is most likely to lead to a desired outcome. When an invocation is received from a user, a context of the invocation is determined, and a pool of dialog acts is scored based on the context by a machine learning model. Dialog acts are selected from the pool and presented to the user in accordance with a randomization policy. Data regarding the dialog acts and their success in achieving a desired outcome is used to train one or more machine learning models to select dialog acts in response to invocations.