Endoscope Image Registration for Multi-Light Frame Rate
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies face challenges in accurately capturing the structure of a subject using multiple observation lights without significantly decreasing the frame rate, as they struggle to separate and accurately combine images from different wavelength ranges, leading to inconsistent and less accurate representations.
Innovation Solution
An image processing device that inputs images captured with different observation lights, calculates registration parameters to align and correct these images, and displays them sequentially, ensuring minimal frame loss and accurate structure observation by applying these parameters to generate a registered image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If images captured with multiple observation lights are simultaneously acquired, then comprehensive structural information is obtained, but frame rate substantially decreases
Solution Approach 1:
The patent applies image registration parameters calculated from a reference image to subsequent images captured with different observation lights. This preliminary calculation and application of registration parameters allows rapid alignment without re-calculating for each image pair, maintaining high frame rate while achieving accurate structural overlay
Solution Approach 2:
The patent uses a reference image as a template and applies transformation parameters to copy and align subsequent images to this reference frame. This approach avoids processing all images equally and maintains a consistent reference framework, enabling efficient multi-light image integration without frame rate loss
2Measurement precision
If images from different wavelength ranges are combined, then complete structural information is achieved, but wavelength separation and mixing issues reduce accuracy
Solution Approach 1:
The patent segments the image processing into distinct stages: capturing images with different observation lights at different times, calculating registration parameters separately for each image against a reference, and applying these parameters sequentially. This segmentation prevents wavelength mixing by processing images individually rather than simultaneously
Solution Approach 2:
The patent introduces image registration parameters as an intermediary element that mediates between images captured with different observation lights. These parameters serve as a transformation bridge that aligns images from different wavelength ranges without direct mixing, ensuring accurate structural representation
3Ease of operation
If color conversion is applied to generate pseudo-color images, then visual interpretation is improved, but accurate structural representation is lost
Solution Approach 1:
Instead of converting images to pseudo-color and then trying to preserve structural information, the patent inverts the approach by first ensuring accurate structural alignment through registration parameters, then allowing optional color display enhancements. The structural integrity is maintained as the primary goal, with color conversion as a secondary visualization aid
Data Source
AI summary
An object of the present invention is to provide an image processing device, an endoscope system, and an image processing method capable of observing an accurate structure of a subject while preventing a substantial decrease in a frame rate in a case where an image is acquired using a plurality of observation lights. An image processing device according to a first aspect of the present invention includes an image input unit that inputs a first image and a second image captured at different times, in which the image input unit inputs the first image captured with first observation light and the second image captured with second observation light different from the first observation light; a parameter calculation unit that calculates a parameter for registering the first image and the second image; an image generation unit that applies the parameter to the first image to generate a registered first image; and a display control unit that causes a display device to sequentially display the input first image and the generated registered first image.