Synonym Detection Model Using Multi-Level Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Analysts face challenges in automatically identifying and grouping synonyms and antonyms in customer complaint reports due to existing methods' inability to distinguish between them and their subjective nature, leading to inefficiencies in analysis.
Innovation Solution
A computer-implemented method involving a mathematical model trained in two steps to detect synonyms and antonyms, using annotated input text and adjusting weighting values for classification levels, allowing for independent training and tuning, and utilizing surface form, word type, pointwise mutual information, and embedding-based similarities to provide indicators for synonyms, antonyms, or neutrality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If embedding-based similarities are used to detect synonyms, then the method can process text automatically, but it cannot distinguish between synonyms and antonyms
Solution Approach 1:
The patent segments the similarity measurement into multiple classification levels (lexical, syntactic, semantic, contextual) rather than using a single embedding-based approach. Each level captures different aspects of word relationships, enabling the system to distinguish between synonyms and antonyms by evaluating multiple dimensions simultaneously.
Solution Approach 2:
The patent transitions from two-dimensional embedding-based similarity to a multi-dimensional classification framework with four distinct levels of analysis. This dimensional expansion allows the system to capture nuanced differences between word pairs that embedding methods alone cannot resolve, particularly for antonyms.
2Measurement precision
If multiple classification levels are used to improve synonym detection accuracy, then the identification rate increases, but the model complexity increases
Solution Approach 1:
The patent performs preliminary classification at each level independently before integrating results. By pre-processing and evaluating each classification level separately, the system reduces the complexity of integrating multiple dimensions while maintaining high accuracy. The preliminary action at each level prepares simplified outputs that are easier to combine.
Solution Approach 2:
The patent divides the complex synonym detection task into four independent classification levels, each handled by simpler models. This segmentation allows the system to manage complexity through modular architecture while achieving high overall accuracy through the combination of results from simpler individual levels.
3Measurement precision
If the mathematical model is trained on annotated text, then the synonym detection accuracy improves, but the training time and data requirements increase
Solution Approach 1:
The patent performs preliminary training on annotated data to establish basic synonym detection capabilities, then uses this pre-trained model for subsequent inference. This preliminary action reduces the time required for final accurate detection by leveraging the foundational knowledge gained during initial training on annotated texts.
Solution Approach 2:
The patent segments the training process into different phases: initial training on annotated data to learn classification patterns, followed by optimization phases that refine the model without requiring re-processing of all annotated data. This segmentation reduces overall training time while maintaining accuracy.
4Adaptability or versatility
If the model is tuned separately from training, then the adaptability to different use cases improves, but the overall system complexity increases
Solution Approach 1:
The patent segments the model development into independent training and tuning phases. The training phase establishes the model's basic capabilities using annotated data, while the tuning phase independently optimizes the model for specific use cases by adjusting classification level weights. This segmentation enables adaptability without requiring complete model retraining, managing complexity through modular optimization.
Solution Approach 2:
The patent introduces dynamic adjustability in the tuning phase, where the weights of different classification levels can be optimized for specific use cases. This dynamic capability allows the model to adapt to different linguistic contexts and requirements without changing the fundamental training architecture, achieving versatility while managing complexity through parameter optimization rather than structural changes.
Data Source
Figure 1~2
Figure 3
AI summary
The present invention relates to a computer-implemented method (100) for identification of linguistic information in a text. The method (100) comprising: - training (101) a mathematical model to automatically detect synonyms in a text, - automatically tune (103) the mathematical model (219) to achieve the highest possible identification rate, - outputting (105) an indicator for two words being synonyms, wherein training (101) comprises providing input text to the mathematical model (219) that comprises annotated synonyms, wherein the mathematical model (219) is configured to calculate a value for a plurality of classification levels (205, 207, 209, 211), and wherein tuning (103) comprises adjusting only weighting values for weighting an influence of an output of a particular classification level (205, 207, 209, 211).