Text Classification Model Training Data Verification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Text classification systems require manually generated training data, which is time-consuming and prone to misclassification due to similarity with other classes, leading to incorrect classification of input data.
Innovation Solution
A method that identifies text samples more similar to a different class than their intended class, modifies these samples by deleting words associated with the similar class and adding words from the intended class, and uses the corrected samples to train a text classification model, ensuring accurate classification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If training data is generated manually by human operators, then the training data can be created, but the process is time-consuming and expensive
Solution Approach 1:
The system performs preliminary verification of training data samples before they are used for model training. A verification module checks whether each training sample is more similar to its intended class or to other classes, and automatically corrects misaligned samples by adding or removing words. This preliminary action ensures that only high-quality, accurately classified training data is used, improving classification accuracy without requiring more time for manual generation.
2Reliability
If training data is generated manually, then training data can be produced, but it may drift across classification boundaries due to similarity with other classes
Solution Approach 1:
The verification module implements a feedback mechanism that automatically checks each training sample to determine whether it is more similar to its intended class or to other classes. When a sample is found to be misaligned (i.e., more similar to another class), the system provides feedback by automatically correcting the sample through word addition or removal. This closed-loop feedback ensures that training data maintains high classification precision and does not drift across class boundaries.
3Reliability
If manual generation of training data is used, then training data can be created, but the process is expensive
Solution Approach 1:
The system implements self-service by enabling automatic verification and correction of training data samples without requiring continuous human intervention. The verification module autonomously checks training samples, identifies misclassified samples, and corrects them by adding or removing words based on similarity metrics. This self-service capability significantly improves training data generation efficiency and reduces the time and cost associated with manual data preparation.
Data Source
AI summary
Methods and systems for text classification include identifying a text sample, classified according to a first class in a set of hierarchical graphs of classes, that is more similar to a second class in the set of hierarchical graphs of classes than to the first class according to a similarity metric. A word is deleted from the identified text sample that is associated with the second class. A word is added to the identified text sample that is associated with the first class. A text classification model is trained using the text sample as training data. Text classification is performed on an input text using the trained text classification model implemented on a processor device.


