Multi-task Neural Network for Clinical Text Assertion Scope Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current natural language processing (NLP) techniques for clinical text in medical data are limited by data scarcity and oversimplification, particularly when dealing with multi-labeled clinical text where multiple classes and scopes are present in a single sentence, which is common in frequent physician visits or long hospitalizations.

Innovation Solution

A machine learning model, such as a convolutional neural network, is trained using multi-task learning to identify both the scope and class of clinical text in a single stage, end-to-end operation, minimizing both scope and class losses, allowing for the prediction of multiple labels and their corresponding scopes in clinical text.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional NLP techniques are used for clinical text analysis, then the system is simpler to implement, but the accuracy of assertion detection deteriorates due to data scarcity and oversimplification

Engineering Contradiction:
Improveassertion detection accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines scope localization and assertion classification into a single multi-task learning model. The model simultaneously performs both tasks by sharing common layers and having separate output heads for scope prediction and class prediction, thereby improving assertion detection accuracy while managing complexity through unified architecture

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The multi-task learning model serves multiple functions: it localizes the scope of clinical assertions, classifies the assertion type (present, absent, conditional, hypothetical, possibility, AWSE), and handles multi-labeled text. This universal model replaces multiple separate NLP tasks with a single system that improves overall accuracy

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If single-label classification is used, then the model is simpler, but it cannot handle multi-labeled clinical text which is common in frequent physician visits or long hospitalizations

Engineering Contradiction:
Improvemulti-label handling capabilityVSAvoidmodel architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The model is designed to handle multiple labels simultaneously by using multi-task learning with shared representations. It can identify multiple assertion scopes and their corresponding classes within the same clinical text, making it adaptable to complex medical scenarios where patients have multiple conditions or visit reasons

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The model segments the clinical text into multiple scope regions, each potentially having different assertion classes. By dividing the text processing into identifiable scope segments and applying classification to each, the model handles multi-labeled text effectively while maintaining structured output

Inventive Principle:
Principle #1Segmentation

3Productivity

If two-stage process is used (first classify then detect scope), then the processing steps are clearer, but the efficiency deteriorates and performance is suboptimal compared to joint learning

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidprocessing pipeline complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the classification and scope detection tasks into a single end-to-end training process. The model learns to perform both tasks simultaneously through joint optimization, eliminating the need for separate processing stages and improving processing efficiency while reducing the complexity of coordinating multiple independent models

Inventive Principle:
Principle #5Merging (Combining)

4Adaptability or versatility

If clinical text is limited to one class or particular length, then the model training is simpler, but the applicability to real-world clinical reports deteriorates

Engineering Contradiction:
Improveclinical text applicabilityVSAvoidtraining data requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The model is trained to handle variable-length clinical text and multiple assertion classes simultaneously. It processes text of any length by dynamically identifying scope regions and applies to all assertion types (present, absent, conditional, hypothetical, possibility, AWSE), making it universally applicable to diverse clinical reports without requiring separate models for different scenarios

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11809826B2Assertion detection in multi-labelled clinical text using scope localization
Publication Date: 2023.11.07 SIEMENS HEALTHINEERS AG
  • US11809826B2 patent drawing
  • US11809826B2 patent drawing
  • US11809826B2 patent drawing

AI summary

For assertion detection from clinical text in a medical system, a model, such as a neural network, is trained to operate on multi-labeled clinical text. Using multi-task learning, both the scope and the class losses are minimized. As a result, a machine learning model can predict both the scope and class of clinical text for a patient where the clinical text is not limited to one class or a particular length.