Explainable NLP Classification Through Ranked Token Similarity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Neural network-based natural language processing (NLP) systems often generate classification errors due to a lack of transparency, making it challenging to understand the reasoning behind their predictions.

Innovation Solution

The process involves tokenizing an input passage into n-grams, projecting token vectors to a higher dimensional space, and generating similarity scores to provide a ranked list of tokens that influence the classification, offering human-interpretable explanations for the classification outcomes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If neural network-based classification is used, then classification accuracy is improved, but transparency and interpretability deteriorate

Engineering Contradiction:
Improveclassification accuracyVSAvoidtransparency of reasoning
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent introduces an intermediary explanation generation module that translates the internal reasoning of the neural network into human-interpretable natural language explanations. This mediator component bridges the gap between the black-box classifier and the user, preserving classification accuracy while recovering transparency through generated rationales that explain why certain classifications were made.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the opaque mechanical reasoning process of neural networks with a generative explanation system that produces human-readable text. Instead of relying on users to interpret weight matrices and activation patterns, the system substitutes this with natural language generation that articulates the reasoning behind classifications, making the system's decision-making process transparent without sacrificing accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If explainability features are added to NLP systems, then user trust is improved, but system complexity increases

Engineering Contradiction:
Improveuser trustVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a universal explanation generation framework that can be applied across multiple NLP tasks and domains without requiring task-specific customization. The same core architecture generates explanations for different types of classifications, reducing overall system complexity while maintaining high user trust through consistent, reliable explainability across applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The explanation generation system is designed to be self-sufficient, automatically generating rationales without requiring manual annotation or external intervention. The model uses its own internal representations and attention mechanisms to produce explanations, eliminating the need for separate complexity-heavy annotation pipelines while building user trust through autonomous, consistent explanation generation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12373650B2Explainable passage classification
Publication Date: 2025.07.29 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12373650B2 patent drawing
  • US12373650B2 patent drawing
  • US12373650B2 patent drawing

AI summary

An embodiment includes tokenizing an input passage into an n-gram sequence of tokens. The embodiment also includes evaluating the input passage using a trained classification model that generates an output indicative of a classification of the input passage. The embodiment also includes generating a first token vector for a first token of the sequence of tokens and projecting the first token vector to a higher dimensional space, resulting in a first projected token vector. The embodiment also includes generating a first similarity score for the first projected token vector based on comparisons of the first projected token vector to each of a plurality of class representations. The embodiment also includes generating a ranked list of the tokens, wherein the generating of the ranked list includes ranking the first token among others of the tokens based on the first similarity score.