Display Control Device for Highlighting Corresponding Regions in Multi-View Medical Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In medical image diagnosis, particularly in mammography, it is challenging to understand the correspondence relationship between regions of interest in breast images captured from different imaging directions, such as cranio-caudal (CC) and medio-lateral oblique (MLO) views, due to the difficulty in visually distinguishing marked regions of interest when multiple pairs are present.

Innovation Solution

A display control device that acquires and displays images from different angles, allowing users to designate positions to highlight corresponding regions of interest, with the ability to specify and highlight matching regions of interest in both images, even when multiple regions are present, enhancing visual clarity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If marks having the same shape are attached to corresponding regions of interest in multiple images to identify correspondence, then the correspondence relationship can be identified, but it becomes difficult to understand the correspondence relationship at a glance when there are multiple pairs of corresponding regions

Engineering Contradiction:
Improvecorrespondence identification accuracyVSAvoidvisual understanding efficiency
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent applies local quality by making each mark unique rather than uniform. Specifically, marks are assigned different shapes, sizes, or patterns based on their specific location or characteristics, allowing multiple corresponding region pairs to be distinguished simultaneously. This transforms the uniform marking approach into a differentiated marking system where each mark's local characteristics convey specific correspondence information.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent utilizes visual property changes by varying the appearance characteristics of marks (such as shape, size, color, or pattern) to encode different correspondence relationships. This allows multiple pairs of corresponding regions to be visually distinguished at a glance, resolving the contradiction between maintaining reliable correspondence identification and improving visual understanding efficiency.

Inventive Principle:
Principle #32Color changes

2Loss of information

If all regions of interest are displayed in multiple images, then complete information is provided, but it becomes difficult to distinguish which regions correspond to each other

Engineering Contradiction:
Improveregion of interest information completenessVSAvoidcorrespondence detection difficulty
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies local quality by assigning distinctive visual characteristics to marks based on their specific correspondence relationships. Each mark's local properties (shape, size, pattern) are tailored to its specific region, enabling simultaneous display of multiple regions of interest while maintaining clear visual distinction between different correspondence pairs.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent uses copying by creating visual representations of correspondence relationships through marks that are placed on corresponding regions across multiple images. These marks serve as visual copies or indicators that replicate the correspondence information, allowing users to understand relationships without losing the completeness of region information.

Inventive Principle:
Principle #26Copying

3Reliability

If marks are displayed for each pair of corresponding regions of interest, then correspondence can be identified, but the number of marks becomes large making it difficult to understand at a glance

Engineering Contradiction:
Improvecorrespondence identification accuracyVSAvoiddisplay element quantity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies merging by combining multiple pieces of correspondence information into a unified visual system. Instead of treating each mark as a separate, independent element, the system integrates them into a coherent marking scheme where the collective pattern of marks conveys the overall correspondence relationships, reducing the perceived complexity despite the presence of multiple marks.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent reduces display complexity through local quality by making each mark distinctive and information-rich. Rather than using simple, identical marks that require counting and matching, each mark's local characteristics (shape, size, pattern) encode specific correspondence information, allowing users to understand relationships more quickly with fewer visual processing steps.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11449999B2Display control device, method for operating display control device, and program for operating display control device
Publication Date: 2022.09.20 FUJIFILM CORP
  • US11449999B2 patent drawing
  • US11449999B2 patent drawing
  • US11449999B2 patent drawing

AI summary

A display control device including a display and a processor configured to acquire a first image of an object and a second image of the same object as the first image; display the first image including one or more of first regions of interest and the second image including one or more of second regions of interest on the display; receive designation of a position in the first image displayed on the display; specify a designated first region of interest and a designated second region of interest corresponding to the designated first region of interest on the basis of the designation of the position, wherein, in a case in which the processor receives the designation of the position with a state that a plurality of first regions of interest or a plurality of second regions of interest are present in at least one of the first image or the second image, the processor is further configured to display the designated second region of interest so as to be highlighted on the display.