Composite Image Generation Using Depth-Based Narrowband Blending

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing technologies fail to effectively combine narrowband and white light image characteristics without altering the original view of structures in white light images, limiting detailed observation of superficial and deep blood vessels in mucous membranes.

Innovation Solution

An image processing apparatus that acquires narrowband and white light images and generates a composite image by combining narrowband image information based on the depth of submucosal objects, using specific formulas to integrate intensity or frequency information from narrowband images into white light images, thereby preserving the original view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If narrowband image information is combined with white light image, then observation capability of blood vessels is improved, but the original view of white light image structure is changed

Engineering Contradiction:
Improveobservation capabilityVSAvoidoriginal view
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The patent applies local quality by selectively combining narrowband and white light image information based on depth. Superficial blood vessels are enhanced using narrowband images while deep structures maintain their original white light appearance. This is achieved through depth estimation algorithms that determine which regions should display narrowband-enhanced features versus original white light features, preserving the overall structural integrity while locally improving observation capability.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces an intermediary processing mechanism that acts as a mediator between narrowband and white light images. This intermediary system estimates depth information and uses it to control the blending process, ensuring that narrowband information is integrated without disrupting the original white light image structure. The intermediary depth map serves as a guide for selective combination, maintaining stability while enabling enhanced observation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple narrowband images are combined, then depth-related features are improved, but processing complexity increases

Engineering Contradiction:
Improvedepth-related featuresVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the image processing into distinct functional modules: narrowband image acquisition, depth estimation, selective combination, and composite image generation. Each module handles a specific aspect of the processing, making the overall complex system more manageable. The depth estimation is further segmented into different depth ranges, with different combination strategies applied to superficial versus deep structures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements partial action by selectively applying narrowband enhancement only to regions where it provides value (superficial blood vessels), rather than processing the entire image uniformly. The system performs depth-based filtering to apply enhancement only where needed, reducing unnecessary processing complexity while maintaining depth-related feature accuracy in critical regions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10555660B2Image processing apparatus, image processing method, and image processing program
Publication Date: 2020.02.11 OLYMPUS CORPORATION(JP)
  • US10555660B2 patent drawing
  • US10555660B2 patent drawing
  • US10555660B2 patent drawing

AI summary

An image processing apparatus includes: a narrowband image acquisition unit configured to acquire a narrowband image showing inside of a lumen; a white light image acquisition unit configured to acquire a white light image showing the inside of the lumen; and a composite image generation unit configured to combine information of the narrowband image to the white light image, according to a depth of a submucosal object, to generate a composite image for display.