Virtual Endoscopic Projection Image Generation for Hollow Organ Observation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating projection images of hollow organs, such as those proposed in JP1998-234663A and JP2007-537771A, face challenges in observing surface shapes due to overlapping wall surfaces and increased time required for image confirmation, respectively.

Innovation Solution

A projection image generating device and method that sets a viewpoint inside a hollow organ, uses a clip plane to divide the field of view into two ranges, and projects images using templates defining opacity relationships to draw inner wall surfaces and contact surfaces, allowing for the generation of a complete projection image that includes obscured areas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a view point is placed inside a hollow organ to generate a virtual endoscopic image, then the organ interior can be observed, but portions of the wall surfaces are blocked by folds or front walls and cannot appear on the image

Engineering Contradiction:
Improvevisibility of blocked wall surfacesVSAvoidobservation of surface shapes
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent segments the projection image into multiple regions: a first region showing the virtual endoscopic view from inside the hollow organ, and a second region showing the corresponding projection image from outside. This segmentation allows simultaneous display of both visible and blocked wall surface portions, resolving the contradiction between observing organ interior and accessing blocked surfaces.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single two-dimensional virtual endoscopic image to a multi-dimensional projection image display that includes both internal viewpoint (first dimension) and external projection viewpoint (second dimension). This dimensional expansion enables observation of blocked surfaces that would otherwise be invisible in conventional virtual endoscopy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If multiple images are displayed side by side to show different viewpoints, then comprehensive observation is enabled, but the number of images to be confirmed increases and time is consumed

Engineering Contradiction:
Improvecompleteness of observationVSAvoidimage confirmation time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent merges the virtual endoscopic image and the projection image into a single integrated display. The first region and second region are combined in one image output, allowing simultaneous viewing of both internal and external perspectives without requiring separate image confirmation steps, thus reducing time loss while maintaining observation completeness.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The projection image serves multiple functions simultaneously: it displays the virtual endoscopic view, shows the corresponding external projection view, and highlights blocked wall surface portions. This multi-functionality eliminates the need for multiple separate images, reducing confirmation time while providing comprehensive observation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If wall surfaces are drawn in overlapping manner to show blocked portions, then surface shape observation is enabled, but the complexity of the displayed images increases

Engineering Contradiction:
Improvevisibility of blocked portionsVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies different rendering qualities to different regions: the first region uses virtual endoscopic rendering for internal views, while the second region uses projection rendering for external views. This local differentiation allows blocked portions to be displayed with appropriate clarity without requiring complex overlapping of multiple wall surface images, reducing overall processing complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9585569B2Virtual endoscopic projection image generating device, method and program
Publication Date: 2017.03.07 FUJIFILM CORP
  • US9585569B2 patent drawing
  • US9585569B2 patent drawing
  • US9585569B2 patent drawing

AI summary

A view point is set inside a hollow organ, a clip plane crossing an internal cavity of the hollow organ is set in a position spaced apart in a visual line direction from the view point, a field of view from the view point is divided into a first field-of-view range in which the inside of the hollow organ is viewed and a second field-of-view range other than the first field-of-view range, a projection image is acquired using a template which is defined so that an inner wall surface of a large intestine is able to be drawn in the first field-of-view range, a projection image is acquired using a template which is defined so that a contact surface with the inner wall surface of the air region of the large intestine is able to be drawn in the second field-of-view range, and the projection images are connected.