Image Processing Apparatus for Enhanced Region-of-Interest Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In medical diagnostics, combining endoscopic images with X-ray or ultrasound images on a single monitor can be burdensome for operators due to the small ratio of the picture portion to the entire image, making it difficult to observe lesions or relevant areas effectively.

Innovation Solution

An image processing apparatus that detects blank portions in X-ray or ultrasound images, sets an initial region-of-interest based on these detections, and generates a region-of-interest image signal, allowing for the enlargement or reduction of this signal to optimize its display on a screen, thereby increasing the visibility of the picture portion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If an X-ray image or ultrasound image is input into an endoscope processor and displayed simultaneously with an endoscopic image on one monitor using parent-child screen display, then the operator can compare both images on a single monitor, but the picture portion occupies a small ratio of the entire image, making it difficult to observe lesions or relevant areas effectively

Engineering Contradiction:
Improveease of comparison between imagesVSAvoidarea of picture portion
Core Design Contradiction:
Ease of operationVSArea of moving object

Solution Approach 1:

The display screen is segmented into multiple regions: a parent screen displaying the endoscopic image and child screens displaying the X-ray or ultrasound images. This segmentation allows both types of images to be displayed simultaneously while dedicating specific areas to each, improving the visibility and observable area of the picture portion without requiring a single overwhelming full-screen display.

Inventive Principle:
Principle #1Segmentation

2Area of moving object

If the picture portion is enlarged to increase visibility of lesions, then the observation effectiveness improves, but the ability to display multiple images simultaneously for comparison is reduced

Engineering Contradiction:
Improvearea of picture portionVSAvoidability to display multiple images
Core Design Contradiction:
Area of moving objectVSAdaptability or versatility

Solution Approach 1:

The display system uses a nested structure where child screens (displaying X-ray or ultrasound images) are positioned within or adjacent to the parent screen (displaying the endoscopic image). This nesting allows multiple images to be displayed simultaneously in a hierarchical arrangement, enabling both enlarged viewing of the primary image and comparative viewing of secondary images without mutual interference.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Measurement precision

If the display is optimized for one image type, then the clarity of that image improves, but the flexibility to switch between different image combinations is reduced

Engineering Contradiction:
Improveimage clarityVSAvoidflexibility of display configuration
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The parent-child screen display configuration is made dynamic and adjustable. Operators can flexibly configure which images are displayed as parent screens and which are child screens, adjust the size and position of child screens, and switch between different image combinations based on diagnostic needs. This dynamic adaptability maintains high image clarity for each display type while providing versatility in display configurations.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10210610B2Image processing apparatus for generating combined image signal of region-of-interest image signal and second image signal, the region-of-interest image signal being generated based on blank portion and initial region-of-interest of first image signal
Publication Date: 2019.02.19 OLYMPUS CORPORATION(JP)
  • US10210610B2 patent drawing
  • US10210610B2 patent drawing
  • US10210610B2 patent drawing

AI summary

An image processing apparatus processes a first image signal including pixel signals, the first image signal having a picture portion in which a subject is shown and having a blank portion surrounding the picture portion. The apparatus includes: a blank detection unit configured to set similar frames different in size from one another within a display area of a screen representing the first image signal, in a stepwise manner from an outer periphery, and to detect the blank portion based on whether or not a part of the pixel signals belonging to a region outside each of the similar frames has the uniform color or brightness; a region-of-interest setting unit configured to set an initial region-of-interest corresponding to the picture portion in the first image signal, based on the blank portion; and a region-of-interest image generation unit configured to generate a region-of-interest image signal representing the initial region-of-interest.