Text Classification Model Training Data Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Text classification systems require manually generated training data, which is time-consuming and prone to misclassification due to similarity with other classes, leading to incorrect classification of input data.

Innovation Solution

A method that identifies text samples more similar to a different class than their intended class, modifies these samples by deleting words associated with the similar class and adding words from the intended class, and uses the corrected samples to train a text classification model, ensuring accurate classification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If training data is generated manually by human operators, then the training data can be created, but the process is time-consuming and expensive

Engineering Contradiction:
Improveclassification accuracyVSAvoidtraining data generation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary verification of training data samples before they are used for model training. A verification module checks whether each training sample is more similar to its intended class or to other classes, and automatically corrects misaligned samples by adding or removing words. This preliminary action ensures that only high-quality, accurately classified training data is used, improving classification accuracy without requiring more time for manual generation.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If training data is generated manually, then training data can be produced, but it may drift across classification boundaries due to similarity with other classes

Engineering Contradiction:
Improveclassification accuracyVSAvoidtraining data classification precision
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The verification module implements a feedback mechanism that automatically checks each training sample to determine whether it is more similar to its intended class or to other classes. When a sample is found to be misaligned (i.e., more similar to another class), the system provides feedback by automatically correcting the sample through word addition or removal. This closed-loop feedback ensures that training data maintains high classification precision and does not drift across class boundaries.

Inventive Principle:
Principle #23Feedback

3Reliability

If manual generation of training data is used, then training data can be created, but the process is expensive

Engineering Contradiction:
Improveclassification accuracyVSAvoidtraining data generation efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system implements self-service by enabling automatic verification and correction of training data samples without requiring continuous human intervention. The verification module autonomously checks training samples, identifies misclassified samples, and corrects them by adding or removing words based on similarity metrics. This self-service capability significantly improves training data generation efficiency and reduces the time and cost associated with manual data preparation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11144581B2Verifying and correcting training data for text classification
Publication Date: 2021.10.12 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11144581B2 patent drawing
  • US11144581B2 patent drawing
  • US11144581B2 patent drawing

AI summary

Methods and systems for text classification include identifying a text sample, classified according to a first class in a set of hierarchical graphs of classes, that is more similar to a second class in the set of hierarchical graphs of classes than to the first class according to a similarity metric. A word is deleted from the identified text sample that is associated with the second class. A word is added to the identified text sample that is associated with the first class. A text classification model is trained using the text sample as training data. Text classification is performed on an input text using the trained text classification model implemented on a processor device.