Document Representation Learning for Radiology Report Clustering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In radiology imaging, comparing the progress of a patient's disease is inefficient due to unstructured text reports, where exact keyword matching is not effective and semantical understanding is necessary to identify similar reports, leading to potential overlook of critical information.

Innovation Solution

A visualization framework based on document representation learning that converts free text documents into word vectors using machine learning models like Siamese LSTM, creating a fixed-dimensional semantic representation space where related documents are closer, enabling clustering and efficient information retrieval.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If exact keyword matching is used for report comparison, then the process is simple and fast, but it fails to capture semantical similarity and overlooks critical information

Engineering Contradiction:
Improvereport comparison efficiencyVSAvoidreport similarity accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent transforms the comparison parameter from exact keyword matching to semantic similarity measurement using trained machine learning models. Document representations are generated in a fixed-dimensional semantic space where cosine similarity captures meaningful relationships between reports, resolving the contradiction between simple matching and accurate similarity detection.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the mechanical keyword-matching system with a semantic understanding system based on trained neural network models. The Siamese LSTM and other ML models learn to represent documents in a way that captures clinical meaning, substituting rigid textual matching with flexible semantic comparison.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If semantical understanding is implemented through trained ML models, then report similarity accuracy is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improvereport similarity accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-training machine learning models on large corpora of radiology reports before deployment. The Siamese LSTM and other models are trained offline to learn document representations, so that during actual use, similarity computation becomes a straightforward vector comparison rather than complex real-time analysis.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates simplified copies of documents in the form of fixed-dimensional vector representations. Instead of processing full text documents during comparison, the system uses compact document representations that capture essential semantic information, reducing computational complexity while maintaining accuracy.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If unstructured text format is used for radiology reports, then reporting flexibility is maintained, but automatic matching and information retrieval become difficult

Engineering Contradiction:
Improvereporting flexibilityVSAvoidinformation retrieval ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements a universal document representation system that handles unstructured text while enabling multiple functions: semantic similarity search, clustering, and visualization. The fixed-dimensional vector representations serve as a common interface that maintains the flexibility of unstructured reporting while enabling efficient automated processing and retrieval.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11176188B2Visualization framework based on document representation learning
Publication Date: 2021.11.16 SIEMENS HEALTHINEERS AG
  • US11176188B2 patent drawing
  • US11176188B2 patent drawing
  • US11176188B2 patent drawing

AI summary

A visualization framework based on document representation learning is described herein. The framework may first convert a free text document into word vectors using learning word embeddings. Document representations may then be determined in a fixed-dimensional semantic representation space by passing the word vectors through a trained machine learning model, wherein more related documents lie closer than less related documents in the representation space. A clustering algorithm may be applied to the document representations for a given patient to generate clusters. The framework then generates a visualization based on these clusters.