Endoscope Image Processing Combining Special Light Frequency Components

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing endoscope systems face challenges in effectively combining feature information from special light observation images with normal light observation images without altering the tone of the combined image, particularly in visualizing capillary blood vessels and fine patterns on mucous membranes.

Innovation Solution

An image processing apparatus that acquires data from pixels sensitive to red, green, blue, and narrow band lights, performs demosaicing, color space conversion, extracts specific frequency components, and combines them to generate color image data, preventing tone changes in the combined image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If feature information from special light observation images is combined with normal light observation images using high-pass filter and band-pass filter, then capillary blood vessels and fine patterns can be visualized, but the tone of the combined image changes

Engineering Contradiction:
Improvevisualization precision of capillary blood vessels and fine patternsVSAvoidtone stability of combined image
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The patent segments the image processing into distinct frequency components using multiple filters (high-pass filter for capillary blood vessels, band-pass filter for fine patterns, low-pass filter for overall structure). Each filter extracts specific frequency ranges from the special light observation image, allowing selective combination of different anatomical features while maintaining tone stability through controlled integration of these segmented components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the wavelength parameters of illumination light to achieve different observation modes. By using narrow band light with specific wavelength ranges (e.g., 415±10nm for blue narrow band, 540±10nm for green narrow band) compared to white light, the system enhances contrast for specific structures while maintaining overall image tone through controlled parameter adjustments in the combination process.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If narrow band light with wider wavelength band is used, then more structures can be observed, but contrast for specific structures decreases

Engineering Contradiction:
Improveobservation range of structuresVSAvoidcontrast precision for capillary blood vessels
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent implements dynamic switching between different narrow band light wavelengths and filter combinations based on the observation target. The system can dynamically adjust which wavelength band (blue narrow band at 415±10nm, green narrow band at 540±10nm, or red narrow band at 630±10nm) is used and which frequency filters are applied, allowing optimal contrast for different structures while maintaining versatility in observing various anatomical features.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables high-contrast special light images to be combined with normal light images without tone changes, enhancing visualization of capillary blood vessels and fine patterns.

Implementation Method 1

acquiring image data generated by an image sensor formed by a predetermined array pattern using a first pixel that receives light having a red wavelength band, a second pixel that receives light having a green wavelength band, a third pixel that receives light having a blue wavelength band, and a fourth pixel that receives narrow band light

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10863149B2Image processing apparatus, image processing method, and computer readable recording medium
Publication Date: 2020.12.08 OLYMPUS CORPORATION(JP)
  • US10863149B2 patent drawing
  • US10863149B2 patent drawing
  • US10863149B2 patent drawing

AI summary

An image processing apparatus includes a processor configured to execute: acquiring image data; generating first interpolation image data associated with light having a red wavelength band, second interpolation image data associated with light having a green wavelength band, third interpolation image data associated with light having a blue wavelength band, and fourth interpolation image data associated with narrow band light; performing a color space conversion process for converting each of the first to the third interpolation image data to a luminance component and a color difference component; extracting a first specific frequency component included in the fourth interpolation image data; combining the converted luminance component with the extracted first specific frequency component; and generating color image data based on a combination result obtained by the combining and based on the color difference component.