Medical Image Processing Path-Based Sequential Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In medical imaging, three-dimensional images of human body structures with tree structures, such as blood vessels or bronchi, are difficult to observe due to obstruction by surrounding structures, especially when the target structure's distribution is complex.

Innovation Solution

An image processing device and method that sets a target place within a three-dimensional image, determines a path from a reference point on the tree structure's upstream branch to the target, and generates and displays images prioritizing the anatomical regions outside the path based on their proximity to the target, allowing for clearer observation of the target and surrounding structures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the entire target human body structure is displayed in the SR image or VR image, then the three-dimensional structure can be visualized, but the place of interest is obstructed by surrounding structures and is difficult to observe

Engineering Contradiction:
Improveease of observationVSAvoidcomplexity of display
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the display into multiple components: a main display area showing the entire three-dimensional structure, and multiple overlay display areas showing enlarged views of specific regions of interest. This segmentation allows the observer to view both the overall structure and detailed areas without obstruction, resolving the contradiction between complete visualization and ease of observation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a nested display structure where enlarged images of specific regions are overlaid on top of the main three-dimensional structure display. The overlay images are positioned within the context of the overall structure, allowing detailed views to be nested within the broader visualization without losing contextual information.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Loss of information

If the three-dimensional running or distribution of the target human body structure is complicated, then complete structural information is captured, but the place of interest is difficult to observe due to obstruction by surrounding structures

Engineering Contradiction:
Improveinformation completenessVSAvoiddifficulty of detection
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent divides the complex three-dimensional structure into manageable segments by identifying regions of interest and creating separate overlay displays for each. This allows the observer to focus on specific complicated areas without being overwhelmed by the entire complex structure, while still maintaining information about the overall distribution.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces overlay images as intermediary elements that bridge the gap between the complete three-dimensional structure and the specific regions of interest. These overlays act as mediators that highlight difficult-to-detect areas while preserving the context of the overall structure, making detection easier without losing information completeness.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9905004B2Image processing device, method, and recording medium having stored therein program
Publication Date: 2018.02.27 FUJIFILM CORP
  • US9905004B2 patent drawing
  • US9905004B2 patent drawing
  • US9905004B2 patent drawing

AI summary

A target place is set in an area of a human body structure having a tree structure in a three-dimensional image. The tree structure of the human body structure is extracted. A path from a reference point set on a branch upstream side of the target place on the tree structure to the target place is determined. Priority is set for respective portions of the tree structure of the human body structure outside the path based on a positional relationship between the portions and the target place. An initial image representing only a portion of the path and images for confirmation of each step sequentially representing the respective portions of the human body structure outside the path according to the priority are generated from the three-dimensional image. The initial image is displayed, and then, the generated images for confirmation of each step are displayed.