Branching Dialogue Structure for Conversational Interface Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conversational computing interfaces face challenges in efficiently maintaining and accessing a large, diverse set of annotated dialogues due to storage burdens, redundancy, and skewing of dialogue distributions, which affects training and performance.

Innovation Solution

A method of configuring conversational computing interfaces using a branching dialogue structure that represents multiple multi-turn conversations with a shared prefix and counterfactual branches, stored in a dialogue store data structure, allowing for efficient retrieval and modification of dialogues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If many different dialogues are accessed and maintained for training, then training diversity and coverage are improved, but storage burden and data maintenance costs increase

Engineering Contradiction:
Improvetraining diversityVSAvoidstorage burden
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent merges multiple dialogue variations into a single branching dialogue structure where shared prefixes are stored once and reused across different branches. This eliminates redundant storage of common dialogue segments while maintaining access to diverse dialogue paths for training.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent segments dialogues into a tree structure with shared prefixes and unique branches. Each node represents a dialogue state, and branches represent different possible responses. This segmentation allows efficient storage by sharing common segments while maintaining diversity through branches.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If many different dialogues are maintained, then training coverage is improved, but dialogue distribution becomes skewed toward duplicative and infrequently used dialogues

Engineering Contradiction:
Improvetraining coverageVSAvoiddialogue distribution accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent incorporates frequency metadata that tracks how often each dialogue path is accessed or used. This feedback mechanism allows the system to identify and prioritize frequently used dialogues in training, preventing skew toward infrequently used variations while maintaining comprehensive coverage.

Inventive Principle:
Principle #23Feedback

3Quantity of substance

If a large number of similar dialogues are stored, then training data volume increases, but processing efficiency decreases due to redundancy

Engineering Contradiction:
Improvetraining data volumeVSAvoidprocessing efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent combines identical or similar dialogue segments into a single shared node in the branching structure. This merging eliminates redundant processing of common segments while maintaining the full training data volume needed for comprehensive learning.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11308940B2Counterfactual annotated dialogues for conversational computing
Publication Date: 2022.04.19 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11308940B2 patent drawing
  • US11308940B2 patent drawing
  • US11308940B2 patent drawing

AI summary

A method of configuring a conversational computing interface. The method comprises maintaining a branching dialogue representing a plurality of multi-turn conversations each including a plurality of turns, wherein a turn indicates one or both of a conversational computing interface action and a conversation event, the branching dialogue including a shared prefix of turns common to the plurality of multi-turn conversations and at least two different counterfactual branches descending from the shared prefix of turns, each different counterfactual branch including one or more descendent turns corresponding to a different multi-turn conversation of the plurality of multi-turn conversations. The method further comprises providing the branching dialogue in a computer-readable format traversable to retrieve a particular multi-turn conversation of the plurality of multi-turn conversations, the particular multi-turn conversation represented by the shared prefix of turns and a particular counterfactual branch including descendent turns corresponding to the particular multi-turn conversation.