Dialogue State Tracking Using Dual Dynamic Graph Neural Network
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing dialogue state tracking (DST) devices struggle to accurately track dialogue states in multiturn and multidomain dialogues, particularly when state values of slots have the same indicating words, and fail to distinguish between values with similar features.
Innovation Solution
A DST device and method that hierarchically classify each slot based on multiple features of domain-specific slots, using a dual dynamic graph neural network to extract state values for categorical and span slots, thereby accurately tracking dialogue states.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If graph model-based DST devices learn only domain-slot relationships considering a single feature of a slot, then the device complexity is reduced, but the measurement precision of state values with the same indicating words deteriorates
Solution Approach 1:
The patent segments the slot feature learning process into multiple independent feature dimensions. Instead of learning a single aggregated feature, the system learns multiple feature vectors (e.g., semantic feature, positional feature, contextual feature) separately for each slot, then combines them through attention mechanisms. This segmentation allows the system to capture different aspects of slot features independently, improving measurement precision without excessive complexity increase.
Solution Approach 2:
The patent transitions from single-dimensional slot feature representation to multi-dimensional feature space. By introducing additional feature dimensions (semantic, positional, contextual, hierarchical), the system can distinguish between slots with the same indicating words through their different feature vectors. This dimensional expansion enables precise differentiation while maintaining manageable complexity through efficient feature combination strategies.
2Measurement precision
If the system tracks dialogue states in multidomain dialogues with multiple features, then the measurement precision improves, but the device complexity increases
Solution Approach 1:
The patent segments the multidomain dialogue tracking into domain-specific slot tracking modules. Each domain has its own slot feature learning and state tracking mechanism, allowing independent optimization for each domain. This segmentation enables precise tracking within each domain while managing overall system complexity through modular architecture.
Solution Approach 2:
The patent implements a universal feature extraction and combination framework that works across multiple domains. The attention mechanism and feature combination strategies are domain-agnostic, allowing the same core architecture to handle different domains with their specific slot features. This universality reduces redundant complexity while maintaining high measurement precision across all domains.
3Reliability
If the system distinguishes between values with the same indicating words using multiple features, then the reliability of dialogue state tracking improves, but the loss of information in feature processing increases
Solution Approach 1:
The patent performs preliminary feature extraction and encoding before the main distinction process. By pre-processing slot features into comprehensive feature vectors that include semantic, positional, and contextual information, the system prepares all necessary information in advance. This preliminary action ensures that when values with the same indicating words need to be distinguished, all relevant features are already available, minimizing information loss during the distinction process.
Solution Approach 2:
The patent introduces attention mechanisms as intermediary components that selectively weigh and combine multiple slot features. These attention mechanisms act as mediators that preserve important information from different feature dimensions while filtering out redundant or conflicting information. The attention weights dynamically adjust to retain the most informative features, reducing overall information loss while maintaining reliability in distinguishing values with the same indicating words.
Data Source
AI summary
Provided are a device and method for dialogue state tracking (DST). With the device and method for DST, an appropriate dialogue state for a user's intention is tracked by hierarchically classifying each slot in consideration of multiple features of domain-specific slots extracted from a dialogue with the user and tracking a state value of each of the hierarchically classified slots using a dual dynamic graph neural network.


