Endoscopic Fiber Pattern Artifact Removal via Delaunay Triangulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The combination of hyperspectral imaging and optical fiber bundles in endoscopic devices is hindered by image artifacts caused by the cladding, complicating spectral analysis and image interpretation.
Innovation Solution
A computer-implemented method for image reconstruction using Delaunay triangulation and Barycentric interpolation to remove fiber pattern artifacts, which involves determining fiber core locations, performing spectral correction, and reshaping reflectance matrices to correct distortions, allowing for semi-real-time processing of hyperspectral images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If optical fiber bundles with cladding are used in endoscopic systems, then the system can transmit optical signals and enable imaging, but comb pattern artifacts are introduced in the images that complicate image analysis and spectral processing
Solution Approach 1:
The patent extracts and removes the harmful cladding components from the optical fiber bundle structure. By using a computational method that identifies fiber core locations and interpolates missing information, the system effectively removes the cladding's harmful comb pattern artifacts from the images while retaining the useful optical signal transmission through the fiber cores.
Solution Approach 2:
The patent introduces an intermediary computational processing step between the optical fiber bundle and the final image output. This intermediary process uses algorithms to identify fiber core locations, perform interpolation, and remove artifacts, acting as a mediator that transforms the raw image data into clean, artifact-free images while preserving the optical transmission capability.
2Strength
If cladding is present in optical fiber bundles, then the fibers can be protected and structured, but the cladding creates comb pattern artifacts that divide the image and complicate spectral analysis
Solution Approach 1:
The patent extracts only the useful optical information through the fiber cores while removing the cladding's harmful visual presence. The computational method identifies and isolates fiber core locations, allowing the system to retain the protective function of the cladding structure while eliminating its artifact-causing visual presence from the images.
Solution Approach 2:
The patent creates a computational copy or representation of the fiber core locations and uses this copy to generate corrected images through interpolation. Instead of physically removing cladding, the system creates a digital model of where fiber cores should be and uses this model to reconstruct clean images, effectively copying the desired output without the harmful artifacts.
3Measurement precision
If image reconstruction methods are applied to remove fiber pattern artifacts, then image quality is improved and spectral analysis becomes accurate, but processing time and computational complexity increase
Solution Approach 1:
The patent performs preliminary identification and classification of fiber core locations before the main image reconstruction process. By pre-determining which pixels correspond to fiber cores and which to tissue, the system prepares the data structure needed for efficient interpolation and artifact removal, reducing the computational burden during actual image processing.
Solution Approach 2:
The patent segments the image data into distinct components: fiber core pixels, cladding artifacts, and tissue regions. This segmentation allows the system to apply different processing strategies to each component, efficiently removing artifacts from specific regions while preserving tissue information, thereby reducing overall processing time compared to processing the entire image uniformly.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method effectively removes fiber pattern artifacts, enhancing image quality and enabling accurate spectral analysis without the need for scanning opto-mechanics or special controllers, thus improving the combination of hyperspectral imaging with endoscopic systems.
Implementation Method 1
an optical fiber bundle including a plurality of optical fibers, wherein each of the plurality of optical fibers is surrounded by cladding
Implementation Method 2
localizing fiber core pixels using a reference image and a two dimensional Gaussian function to model light coming out from each of the plurality of optical fibers
Implementation Method 3
performing Barycentric interpolation using the triangulation data to produce the missing information
Data Source
AI summary
Implementations of the present disclosure include methods, systems, and computer-readable storage mediums for image reconstruction. Actions include receiving an image acquired by an endoscopic system including an optical fiber bundle with multiple optical fibers, each optical fiber being surrounded by cladding, determining in the image fiber core locations corresponding to the optical fibers, reconstructing missing information from the image using interpolation performed in accordance with the fiber core locations, the missing information corresponding to artifacts in the acquired image that result from the cladding, and providing a fiber-pattern removed image, in which the artifacts in the acquired image are removed using the missing information.