Explainable NLP Classification Through Ranked Token Similarity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Neural network-based natural language processing (NLP) systems often generate classification errors due to a lack of transparency, making it challenging to understand the reasoning behind their predictions.
Innovation Solution
The process involves tokenizing an input passage into n-grams, projecting token vectors to a higher dimensional space, and generating similarity scores to provide a ranked list of tokens that influence the classification, offering human-interpretable explanations for the classification outcomes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If neural network-based classification is used, then classification accuracy is improved, but transparency and interpretability deteriorate
Solution Approach 1:
The patent introduces an intermediary explanation generation module that translates the internal reasoning of the neural network into human-interpretable natural language explanations. This mediator component bridges the gap between the black-box classifier and the user, preserving classification accuracy while recovering transparency through generated rationales that explain why certain classifications were made.
Solution Approach 2:
The patent replaces the opaque mechanical reasoning process of neural networks with a generative explanation system that produces human-readable text. Instead of relying on users to interpret weight matrices and activation patterns, the system substitutes this with natural language generation that articulates the reasoning behind classifications, making the system's decision-making process transparent without sacrificing accuracy.
2Reliability
If explainability features are added to NLP systems, then user trust is improved, but system complexity increases
Solution Approach 1:
The patent implements a universal explanation generation framework that can be applied across multiple NLP tasks and domains without requiring task-specific customization. The same core architecture generates explanations for different types of classifications, reducing overall system complexity while maintaining high user trust through consistent, reliable explainability across applications.
Solution Approach 2:
The explanation generation system is designed to be self-sufficient, automatically generating rationales without requiring manual annotation or external intervention. The model uses its own internal representations and attention mechanisms to produce explanations, eliminating the need for separate complexity-heavy annotation pipelines while building user trust through autonomous, consistent explanation generation.
Data Source
AI summary
An embodiment includes tokenizing an input passage into an n-gram sequence of tokens. The embodiment also includes evaluating the input passage using a trained classification model that generates an output indicative of a classification of the input passage. The embodiment also includes generating a first token vector for a first token of the sequence of tokens and projecting the first token vector to a higher dimensional space, resulting in a first projected token vector. The embodiment also includes generating a first similarity score for the first projected token vector based on comparisons of the first projected token vector to each of a plurality of class representations. The embodiment also includes generating a ranked list of the tokens, wherein the generating of the ranked list includes ranking the first token among others of the tokens based on the first similarity score.


