NLP Structured Labels for Medical Image Training

Solution Overview

Problem

Unstructured medical notes pose significant challenges in retrieving relevant patient information, supporting medical decision-making, and training machine learning models, due to their unstandardized and time-consuming nature.

Innovation Solution

A method using a natural language processor (NLP) to generate structured labels from free-text medical reports, which are then associated with medical images, enabling a computer vision system to classify or generate structured labels from image pixels alone.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If unstructured medical notes are used for downstream processing, then the natural language format preserves clinical nuance and detail, but retrieval efficiency and machine learning applicability deteriorate

Engineering Contradiction:
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent segments unstructured medical text into structured components by training a natural language processor to extract specific clinical variables (e.g., symptoms, diagnoses, treatments) as separate structured fields. This segmentation enables efficient querying and machine learning processing while preserving the original clinical information in its contextual form.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a natural language processor as an intermediary layer between unstructured medical notes and downstream applications. This intermediary automatically generates structured representations (JSON, databases) from free-text inputs, enabling both efficient retrieval and machine learning applicability without losing the nuance of the original clinical narratives.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If manual structuring of medical notes is performed, then data quality and standardization improve, but time consumption and labor costs increase

Engineering Contradiction:
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements self-service by training a natural language processor to automatically structure medical notes without human intervention. The system reads free-text medical reports and autonomously extracts clinical variables, generates structured outputs, and creates standardized datasets, eliminating the need for manual structuring while maintaining high data quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical process of manual data structuring with an automated natural language processing system. Instead of clinicians or staff manually extracting and organizing information, the NLP model performs this function computationally, dramatically reducing time and labor while maintaining consistency and precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of manufacture

If simple string matching is used for text retrieval, then implementation simplicity is maintained, but retrieval specificity and accuracy deteriorate

Engineering Contradiction:
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent changes the parameter of text processing from simple string matching to structured field-based querying. By transforming unstructured text into structured data with defined fields (e.g., diagnosis codes, symptom categories), the system enables precise retrieval based on multiple parameters simultaneously, dramatically improving specificity while maintaining implementation feasibility through automated structuring.

Inventive Principle:
Principle #35Parameter changes

4Adaptability or versatility

If structured data is generated from unstructured text, then machine learning applicability improves, but processing complexity and computational resources increase

Engineering Contradiction:
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-processing and structuring medical text data before it is needed for machine learning applications. The natural language processor continuously structures incoming medical notes into standardized formats, creating ready-to-use structured datasets that can be immediately fed into machine learning models without additional processing complexity at the point of use.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3753025B1Automated extraction of structured labels from medical text using deep convolutional networks and use thereof to train a computer vision model
Publication Date: 2025.04.09
  • EP3753025B1 patent drawingFigure 1
  • EP3753025B1 patent drawingFigure 2
  • EP3753025B1 patent drawingFigure 3

AI summary

A method is provided for processing medical text and associated medical images. A natural language processor configured as a deep conventional neural network is trained on a first corpus of curated free-text, medical reports each of which having one or more structured labels assigned by an medical expert. The network is trained to learn to read additional free-text medical reports and produce predicted structured labels. The natural language processor is applied to a second corpus of free-text medical reports that are associated with medical images. The natural language processor generates structured labels for the associated medical images. A computer vision model is trained using the medical images and the structured labels generated. The computer vision model can thereafter assign a structured label to a further input medical image. In one example, the medical images are chest X-rays.