Prompt Model Canonical Form Generation for Dialogue Intent

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Developing high-quality task-oriented conversational interfaces is challenging due to the need for extensive rule-based grammar or datasets, making it difficult for developers to create intuitive and efficient conversational models that can handle novel intents and utterances.

Innovation Solution

The system uses a prompt model to translate text into a canonical form, allowing a dialogue manager to interpret and perform tasks, even with novel intents, by generating a constrained semantic representation using a language model, reducing the need to train the language model and requiring less data and computational resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If extensive rule-based grammar or large datasets are used to train task-oriented dialogue systems, then the system can handle a wide range of intents and utterances, but the complexity of development and computational resources required increase significantly

Engineering Contradiction:
Improveability to handle various intents and utterancesVSAvoiddevelopment complexity and computational resources
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a prompt model as an intermediary component between the user input and the language model. This prompt model generates specialized prompts that guide the language model to produce canonical forms without requiring extensive training data. The prompt model acts as a mediator that translates diverse user utterances into structured queries that the language model can process efficiently, thereby reducing both development complexity and computational resource requirements while maintaining versatility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system segments the dialogue processing task into distinct components: the prompt model that handles intent classification and canonical form generation, and the language model that processes the prompted queries. This segmentation allows each component to specialize in specific functions, reducing the overall complexity compared to training a single large model to handle all aspects of dialogue understanding.

Inventive Principle:
Principle #1Segmentation

2Productivity

If a small amount of example utterances is used to fine-tune models for specific intents, then the training process becomes easier and faster, but the system fails to process novel intents or unseen utterances

Engineering Contradiction:
Improvetraining efficiency and speedVSAvoidability to process novel intents and unseen utterances
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The language model, being a large pre-trained model, possesses inherent knowledge of language patterns and semantics from its extensive pre-training. The prompt model leverages this self-service capability of the language model by crafting prompts that activate the model's existing knowledge to handle novel intents without requiring retraining. The system uses the language model's own pre-learned capabilities to adapt to new intents dynamically.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Instead of changing the model weights through fine-tuning (which requires extensive data), the system changes the input parameters (prompts) to the language model. By modifying the prompt structure and content based on the detected intent, the system can guide the language model to produce appropriate canonical forms for both seen and unseen intents, achieving adaptability without additional training data.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If detailed rule-based grammar is created to define intents and slots, then the system can provide structured output for dialogue management, but the development process becomes unintuitive and time-consuming

Engineering Contradiction:
Improvestructured output quality for dialogue managementVSAvoidease of development and model creation
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The patent replaces the mechanical approach of manually defining detailed rule-based grammar with a learning-based approach using a prompt model. Instead of manually creating complex grammatical rules to extract intents and slots, the prompt model automatically learns to generate prompts that elicit structured canonical forms from the language model, significantly simplifying the development process while maintaining output quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes from a static rule-based grammar approach to a dynamic prompt-based approach. The prompt model generates different prompts based on the input context, allowing the language model to adapt its output structure dynamically. This parameter change from fixed rules to flexible prompts makes the system easier to develop while preserving the structured output needed for dialogue management.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240062014A1Generating canonical forms for task-oriented dialogue in conversational ai systems and applications
Publication Date: 2024.02.22 NVIDIA CORP
  • US20240062014A1 patent drawing
  • US20240062014A1 patent drawing
  • US20240062014A1 patent drawing

AI summary

In various examples, techniques for training and using a task-oriented dialogue system are described. Systems and methods are disclosed for determining, using a prompt model(s) and based at least in part on text data, prompt data representing one or more prompts. Additionally, systems and method are disclosed for determining, using a language model(s) and based at least in part on the text data and the prompt data, a canonical form associated with the text data. In some examples, the prompt model(s) is trained to generate the prompt data that causes the language model(s) to output the canonical form. Systems and method are further disclosed for using the canonical form to determine at least an intent associated with the text data. A dialogue manager may then use the intent to perform one or more actions associated with the text data.