Dynamic Image Annotation System for Medical Reporting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing structured reporting methods in medical imaging rely on subjective textual annotations, which can lead to variability and misinterpretation, especially when canonical images do not closely resemble the current patient image, limiting the accuracy of tissue annotation.

Innovation Solution

A system that identifies and displays the previously annotated medical images with the greatest similarity to the input image for each annotation, allowing users to select the most appropriate annotation based on visual similarity, and includes this annotation in an electronic report.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If fixed canonical images are used for visual reporting, then subjectivity is reduced and common understanding is achieved, but the visual similarity between example images and current patient images may be insufficient, limiting annotation accuracy

Engineering Contradiction:
Improveconsistency of annotationVSAvoidvisual similarity
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The system dynamically selects and displays example images based on similarity metrics calculated between the current patient image and stored example images. Instead of using fixed canonical images, the system adapts the displayed examples to match the specific characteristics of each patient's image, thereby maintaining both consistency and visual similarity

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of image selection from static (fixed canonical images) to dynamic (similarity-based selection). By calculating similarity metrics and selecting images that exceed a threshold or represent top matches, the system adjusts which examples are displayed based on the current image's characteristics

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If a large database of previously annotated images is used to improve matching accuracy, then the quality of annotation improves, but the time and computational resources required to search and compare images increases

Engineering Contradiction:
Improveannotation accuracyVSAvoidimage comparison time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Instead of comparing the current image against all images in the database, the system performs partial comparison by selecting and displaying only a subset of top-matching images (e.g., top 3-5 matches). This reduces the computational burden and time required while still providing sufficiently accurate annotation support

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system pre-calculates and stores similarity metrics or feature representations of images in the database beforehand. This preliminary processing allows for faster comparison during actual annotation, reducing the time required when a user needs to annotate a new image

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3191991B1Image report annotation identification
Publication Date: 2021.01.13 KONINKLIJKE PHILIPS NV
  • EP3191991B1 patent drawingFigure 1
  • EP3191991B1 patent drawingFigure 2~3
  • EP3191991B1 patent drawingFigure 4

AI summary

A method for creating a report with an annotation includes receiving an input image to annotate. The method further includes comparing the input image with a set of previously annotated images. The method further includes generating a similarity metric for each of the previously annotated images based on a result of a corresponding comparison. The method further includes identifying a previously annotated image with a greatest similarity for each of a plurality of predetermined annotations. The method further includes visually displaying the identified image for each annotation along with the annotation. The method further includes receiving an input signal identifying one of the displayed images. The method further includes annotating the input image with the identified one of the displayed images. The method further includes generating, in an electronic format, a report for the input image that includes the identified annotation.