Medical Image Augmentation Using Anatomical Probability Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge in medical imaging is the difficulty in obtaining large, high-quality annotated datasets for training machine learning models, particularly in specialized fields like medical imaging, due to the labor-intensive and knowledge-specific requirements.

Innovation Solution

A medical imaging system that performs image augmentation by using probability data to determine augmentation positions and operations, such as adding or removing features like lesions, based on anatomical knowledge and symmetry, through processes like inpainting and image blending, leveraging anatomical atlases and spatial probability maps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual annotation is used to create training datasets, then annotation quality can be ensured, but the time and labor required increase significantly

Engineering Contradiction:
Improveannotation qualityVSAvoidannotation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by using unsupervised segmentation to pre-identify and pre-annotate anatomical structures and features in medical images. This preliminary annotation creates a foundation that reduces the time required for manual annotation while maintaining quality, as experts only need to review and refine the pre-generated annotations rather than create them from scratch

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates synthetic training datasets by copying and transforming existing medical images through various augmentation techniques including geometric transformations, intensity modifications, and noise addition. This allows the generation of large numbers of training samples without requiring equivalent manual annotation effort for each new image

Inventive Principle:
Principle #26Copying

2Productivity

If more annotated data is collected for machine learning training, then model performance improves, but the cost and complexity of data preparation increase

Engineering Contradiction:
Improvemodel training effectivenessVSAvoiddata preparation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements a multi-functional automated annotation pipeline that can handle multiple types of medical images and annotate multiple different anatomical structures and pathologies using the same unsupervised segmentation algorithms. This universal approach reduces the complexity of data preparation by eliminating the need for separate manual annotation processes for different image types

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system generates additional training data by creating synthetic copies of existing annotated images through augmentation techniques, effectively multiplying the available training data without requiring proportional increases in manual annotation resources or complexity

Inventive Principle:
Principle #26Copying

3Measurement precision

If specialized domain knowledge is used for annotation, then annotation accuracy improves, but the requirement for expert annotators increases resource constraints

Engineering Contradiction:
Improveannotation accuracyVSAvoidannotation throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary annotation using unsupervised segmentation algorithms that automatically identify anatomical structures and features without requiring expert domain knowledge. This preliminary action produces annotations that are sufficiently accurate for training purposes and dramatically increases throughput, while expert annotators are only needed for review and refinement of a smaller subset of cases

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service annotation by using unsupervised segmentation methods that automatically generate annotations without human intervention. This self-annotating capability maintains reasonable accuracy while eliminating the bottleneck of expert annotator availability, allowing the system to scale annotation production without proportionally increasing expert resources

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240144472A1Medical image augmentation
Publication Date: 2024.05.02 CANON KK
  • US20240144472A1 patent drawing
  • US20240144472A1 patent drawing
  • US20240144472A1 patent drawing

AI summary

A medical imaging system comprising: a data storage resource configured to store probability data representing probability information for a location of a feature of interest in an anatomical region; processing circuitry configured to: receive medical image data representing a medical image of at least an anatomical region; retrieve the probability data from the data storage resource; process the medical image data to perform at least one image augmentation operation on the received medical image for at least one feature of interest based on the probability information for the location of the at least one feature of interest in the anatomical region.