Multi-task Neural Networks for Clinical Note Section Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for organizing clinical notes into distinct sections often fail to correctly classify sections across different healthcare systems, leading to missed critical patient-related information due to their assumption of a given partition, which decreases their utility in practice.

Innovation Solution

A multi-task neural network system that includes a shared neural network, a segmentation neural network, and a section type classification neural network, jointly trained to segment unstructured text in clinical notes into sections, determine section titles, and classify section types, enabling accurate identification of sections and their types across different healthcare systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If conventional methods assume a given partition to organize clinical notes, then the process is simple, but the classification accuracy across different healthcare systems deteriorates

Engineering Contradiction:
Improvesimplicity of organization processVSAvoidclassification accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent segments the clinical note organization task into multiple independent neural networks: a shared neural network for generating text embeddings, a segmentation neural network for identifying section titles, and a section type classification neural network for classifying section types. This segmentation allows each network to specialize in a specific function, improving overall accuracy while maintaining manageable complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The shared neural network serves multiple functions: it processes input text, generates text embeddings, and provides features to both the segmentation neural network and section type classification neural network. This multi-functionality reduces redundancy and improves efficiency while maintaining high classification accuracy across different healthcare systems through unified representation learning.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If conventional methods use fixed partition assumptions, then the system complexity is low, but the adaptability to different healthcare systems deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidadaptability to different healthcare systems
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent employs parameter changes through neural network training on diverse clinical notes from different healthcare systems. The models learn to adapt to varying section structures, terminology, and formatting styles by adjusting their internal parameters during training, enabling them to generalize accurately across different healthcare systems without requiring system-specific customization.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces conventional mechanical parsing methods with neural networks that use deep learning to understand and interpret clinical note structures. This substitution enables the system to handle variability in formatting, terminology, and organization styles through probabilistic models rather than rigid rules, significantly improving adaptability while increasing computational complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If conventional methods fail to understand section type correlations, then the processing is faster, but the information extraction completeness deteriorates

Engineering Contradiction:
Improveprocessing speedVSAvoidinformation extraction completeness
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The shared neural network performs preliminary processing by generating comprehensive text embeddings that capture semantic meaning, context, and relationships before the segmentation and classification stages. This preliminary action enriches the data representation, enabling subsequent networks to accurately identify section titles and classify types while maintaining processing efficiency through optimized neural network architectures.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms through the joint training of multiple neural networks with shared parameters. The segmentation neural network and section type classification neural network both process the same text embeddings and provide feedback during training to refine the shared representations. This feedback loop ensures that section type correlations are captured accurately while maintaining fast inference through pre-trained models.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240111999A1Segmenting and classifying unstructured text using multi-task neural networks
Publication Date: 2024.04.04 GOOGLE LLC
  • US20240111999A1 patent drawing
  • US20240111999A1 patent drawing
  • US20240111999A1 patent drawing

AI summary

A multi-task neural network system is described. The system includes a shared neural network configured to receive as input a text span from a clinical note, and for each of one or more text segments in the text span, processing the text segment to generate a set of text segment embeddings. The system further includes a segmentation neural network configured to, for each of the one or more text segments, process the respective set of text segment embeddings to determine whether the text segment is a section title or not. The system further includes a section type classification neural network configured to, for each of the one or more text segments, process the respective set of text segment embeddings to classify the text segment into a section type of a plurality of section types.