Expandable Dialogue System Training via Weak Supervision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing dialogue systems are not expandable to allow non-expert administrators to enhance their capabilities without significant engineering and developer resources, being constrained by predefined dialogue patterns and limited compositionality, which restricts expressible meanings and problem-solving capabilities.

Innovation Solution

A method for training a dialogue learning model that allows non-engineers to expand dialogue systems through a user interface, using a knowledge representation module, learning model, and data collection module, enabling the annotation of user utterances and generation of rules for computing various results without programming or AI knowledge.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If constrained grammars are employed to limit combinatorial explosion, then system complexity is reduced, but many meanings are not expressible

Engineering Contradiction:
Improvesystem complexityVSAvoidexpressible meanings
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by transitioning from static constrained grammars to dynamic neural network-based parsing. The system uses trained neural networks that can adaptively parse utterances into structured representations, allowing the system to handle diverse meanings without requiring exhaustive predefined grammatical constraints. This dynamic approach enables the system to learn and generalize from training data, expressing meanings that would be impossible to capture with fixed grammatical rules.

Inventive Principle:
Principle #15Dynamics

2Stability of the object's composition

If predefined dialogue patterns are used, then system stability is improved, but expandability to non-expert administrators is prevented

Engineering Contradiction:
Improvesystem stabilityVSAvoidexpandability
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent applies copying by enabling non-expert administrators to create new dialogue patterns through weak supervision without requiring deep understanding of system internals. Administrators can annotate training data and supervise learning processes, effectively copying and adapting system capabilities to new domains. The system learns from these annotated examples, allowing expansion to new functionalities while maintaining stability through the underlying neural network architecture and training frameworks.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If significant engineering resources are allocated for system expansion, then system functionality is improved, but resource efficiency deteriorates

Engineering Contradiction:
Improvesystem functionalityVSAvoidengineering resources
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent applies self-service by enabling the system to expand its own functionality through weakly supervised learning. Non-expert administrators can annotate training data and supervise the learning process without requiring significant engineering intervention. The neural network automatically learns from these annotations, allowing the system to self-expand to new domains and functionalities. This dramatically reduces the need for engineering resources compared to traditional approaches requiring manual pattern definition and system reconfiguration.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11842724B2Expandable dialogue system
Publication Date: 2023.12.12 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11842724B2 patent drawing
  • US11842724B2 patent drawing
  • US11842724B2 patent drawing

AI summary

A method for training a dialogue learning model includes presenting, via a user interface of a computing device, an utterance and a list of actions based on the utterance. A selection of an action from the list of actions is received via the user interface. A designated span of the utterance is received via the user interface. The selected action and the designated span of the utterance is provided to a computing system for training the dialogue learning model.