Montage Interface for Medical Image Classification Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Machine learning systems for medical image classification face challenges in accuracy due to inconsistent labeling of training data, as reviewers cannot directly compare multiple images, leading to reduced accuracy in object classification and potential misdiagnosis.

Innovation Solution

A system presents medical images as montages, allowing reviewers to classify multiple images simultaneously, ensuring consistency through contextual information, and includes control images for validation, with dynamic updates to improve classification accuracy and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If reviewers classify medical images individually one at a time, then the interface complexity is reduced, but classification consistency and accuracy deteriorate

Engineering Contradiction:
Improveinterface simplicityVSAvoidclassification accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent combines multiple medical images into a single montage display, allowing reviewers to view and classify multiple images simultaneously. This merging of multiple individual image views into one consolidated interface enables direct comparison and maintains classification consistency while simplifying the review process.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The montage serves as an intermediary structure that bridges the reviewer's cognitive process with the classification task. By presenting multiple images in a unified context, the montage enables contextual comparison and consistent labeling without requiring the reviewer to mentally juggle multiple separate image windows.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If reviewers view and classify images one at a time, then the system complexity is reduced, but training data accuracy deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidtraining data accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system merges multiple image viewing and classification operations into a single integrated montage interface. This consolidation allows the system to maintain simplicity while improving training data accuracy by ensuring consistent, contextualized labeling across multiple images simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system incorporates feedback mechanisms where the montage display provides contextual information about multiple images at once, enabling reviewers to verify classification consistency. This feedback loop ensures that training data is labeled accurately and consistently, improving the reliability of machine learning models.

Inventive Principle:
Principle #23Feedback

3Stability of the object's composition

If multiple medical images are presented simultaneously in a montage, then classification consistency improves, but the initial interface complexity increases

Engineering Contradiction:
Improveclassification consistencyVSAvoidinterface complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The montage interface segments the display into multiple manageable regions, each showing a different medical image. This segmentation allows the complex task of viewing and comparing multiple images to be broken down into manageable visual units, reducing the perceived interface complexity while maintaining the ability to view all images simultaneously for consistent classification.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10607122B2Systems and user interfaces for enhancement of data utilized in machine-learning based medical image review
Publication Date: 2020.03.31 MERATIVE US LP
  • US10607122B2 patent drawing
  • US10607122B2 patent drawing
  • US10607122B2 patent drawing

AI summary

Systems and techniques are disclosed for improvement of machine learning systems based on enhanced training data. An example method includes generating an interactive classification user interface concurrently displaying a first group of medical images and a second group of medical images, each group depicting objects associated with a respective classification. User input indicating movement of medical images from the first group to the second group is detected. The moved medical images are classified according to the second group. The re-classified medical images are provided to a machine learning system, with the machine learning system updating based on analysis of object characteristics of the re-classified medical images to increase accuracies associated with automated assignment of classifications.