Web-Based Medical Image Annotation Platform

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge lies in obtaining large, labeled datasets for deep learning in healthcare, particularly for 3D and 4D medical imaging, due to the scarcity of clinical experts and the complexity of annotating volumetric data, which hinders the development of scalable decision support systems.

Innovation Solution

A web-based platform for cross-validated annotation of large image datasets, allowing multiple remote users to annotate medical images using standardized templates, with features for data management, search, and performance tracking, facilitating the creation and organization of image collections for training and testing machine learning algorithms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple remote users annotate medical images using standardized templates, then annotation productivity increases, but annotation consistency and quality control become more difficult to maintain

Engineering Contradiction:
Improveannotation productivityVSAvoidannotation consistency
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system changes the parameters of annotation by implementing standardized templates that define specific annotation categories, formats, and requirements. These templates standardize how annotations are created across multiple users, ensuring consistency while maintaining high productivity through automated guidance and validation rules.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If large-scale annotation of medical images is performed, then dataset size for machine learning increases, but the burden on clinical experts increases

Engineering Contradiction:
Improvedataset sizeVSAvoidannotation system complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The system uses copying by allowing multiple remote users to create annotations based on standardized templates rather than requiring expert-level judgment for each annotation. This enables scalable annotation of large datasets while maintaining quality through template-based guidance, reducing the burden on clinical experts.

Inventive Principle:
Principle #26Copying

3Reliability

If cross-validation among multiple annotators is implemented, then annotation reliability improves, but the time required for annotation increases

Engineering Contradiction:
Improveannotation reliabilityVSAvoidannotation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system implements feedback mechanisms where multiple annotators work on the same images and their annotations are compared and validated against each other. This cross-validation process provides feedback that improves annotation reliability by identifying and resolving discrepancies, while the standardized templates help streamline the process to minimize time loss.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11194853B2Rapid cross-validated ground truth annotation of large image datasets for image analytics
Publication Date: 2021.12.07 MERATIVE US LP
  • US11194853B2 patent drawing
  • US11194853B2 patent drawing
  • US11194853B2 patent drawing

AI summary

Annotation of large image datasets is provided. In various embodiments, a plurality of medical images is received. At least one collection is formed containing a subset of the plurality of medical images. One or more image from the at least one collection is provided to each of a plurality of remote users. An annotation template is provided to each of the plurality of remote users. Annotations for the one or more image are received from each of the plurality of remote users. The annotations and the plurality of medical images are stored together.