Synonym Score Generation for Dialogue Knowledge Expansion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing dialogue systems face challenges in automatically and accurately expanding their knowledge databases to handle diverse user utterances, as they rely on costly synonym and paraphrase dictionary upgrades and require user confirmation for determining synonyms and paraphrases.
Innovation Solution
An information processing method that uses a knowledge bank with hierarchized synonym dictionaries, where synonyms are evaluated based on context and similarity scores, allowing for automatic expansion of the knowledge database by extracting and evaluating synonym candidates through user input and log data analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual preparation of question and answer pairs is performed to handle diverse user utterances, then the dialogue system can respond accurately to various ways of saying, but the cost becomes high
Solution Approach 1:
The system performs self-learning by automatically analyzing dialogue logs to extract synonym relationships between user utterances and standard questions. The synonym extraction unit autonomously identifies and adds synonym pairs to the knowledge base without requiring manual intervention, enabling the system to expand its capability to handle diverse user expressions while reducing labor costs
Solution Approach 2:
The manual mechanical process of preparing question and answer pairs is replaced by an automated information processing system. The system uses computational methods including similarity calculation, frequency analysis, and pattern recognition to automatically extract synonym relationships from dialogue logs, substituting human labor with automated processing
2Adaptability or versatility
If existing synonym and paraphrase dictionaries are used for knowledge upgrading, then the system can handle various expressions, but upgrading dictionaries for each case is costly
Solution Approach 1:
The system autonomously extracts synonym relationships from its own dialogue logs and automatically updates its knowledge base. The synonym extraction unit identifies patterns in user utterances and generates synonym pairs that are specific to the system's operational context, eliminating the need for expensive external dictionary upgrades
Solution Approach 2:
The system proactively monitors dialogue logs and automatically extracts synonym relationships before they are needed for handling new user expressions. By continuously analyzing user interactions and pre-building synonym knowledge, the system prepares itself to handle diverse expressions without requiring reactive dictionary updates
3Measurement precision
If user confirmation is required to determine synonyms and paraphrases, then the accuracy of synonym identification improves, but the time and complexity increase
Solution Approach 1:
The manual confirmation process is replaced by automated computational methods. The system uses similarity calculation based on dialogue logs, frequency analysis, and pattern recognition to automatically determine synonym relationships with high accuracy, eliminating the time-consuming user confirmation step while maintaining or improving identification accuracy
Solution Approach 2:
The system uses feedback from dialogue logs to continuously refine its synonym extraction. By analyzing successful matching patterns and user responses, the system learns and improves its synonym identification accuracy over time, replacing the need for explicit user confirmation with intelligent automated judgment
Data Source
AI summary
An information processing device includes an input device, an output device, a processing device, a storage device, and a generating unit. The generating unit includes a first function of inputting text data; a second function of inputting a synonym dictionary including synonyms; a third function of extracting a first piece of text data from the multiple pieces of text data; a fourth function of extracting from the synonym dictionary synonyms in which a certain word in the first piece of text data is included; a fifth function of extracting from the text data second multiple pieces of text data including a synonym belonging to the extracted synonyms; and a sixth function of generating a score to evaluate a relationship between the first piece of text data and the extracted synonyms from a relationship between the first piece of text data and the second multiple pieces of text data.