Microscope Imaging With Disparity-Map Optical Information Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern microscopes face challenges in effectively processing and presenting images acquired through multiple imaging modalities, often failing to intuitively convey the full range of optical and spatial information due to hardware limitations and processing algorithms.
Innovation Solution
An imaging system for microscopes that utilizes a processor to generate a disparity map from multiple images, allowing the extraction of additional optical information by offsetting one image based on the disparity map, and enabling flexible display modes to highlight and enhance spatio-optical features.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple imaging modalities are utilized to acquire images, then the quantity of optical information is improved, but the difficulty of processing and presenting the information intuitively worsens
Solution Approach 1:
The patent combines multiple imaging modalities (visible light, NIR, fluorescence) into a unified processing framework where images from different modalities are integrated through the disparity map. The processor merges these diverse optical information sources to generate a composite fourth image that presents unified spatial-optical information, resolving the complexity of handling separate modalities independently.
Solution Approach 2:
The disparity map serves as an intermediary data structure that mediates between multiple input images and the final processed output. This intermediate representation encodes spatial relationships and enables the system to integrate information from different imaging modalities without directly processing all combinations of raw images, thus reducing processing complexity while preserving optical information.
2Loss of information
If multiple imaging modalities are utilized to acquire images, then the quantity of optical information is improved, but the ease of presenting information intuitively worsens
Solution Approach 1:
The patent segments the presentation of optical information by providing multiple output images with different functions: the fourth image presents integrated spatial-optical information, while individual modality images (first, second, third images) can be displayed separately when needed. This segmentation allows users to access comprehensive information or focus on specific modalities, improving ease of presentation through selective display options.
Solution Approach 2:
The patent adds a new dimension to information presentation by generating the fourth image that exists in a different informational dimension than the input images. This fourth image represents a transformed space where spatial relationships from the disparity map are applied to optical information, creating a new visual representation that intuitively combines multiple modalities rather than merely displaying them side-by-side.
3Device complexity
If hardware limitations and processing algorithms are used, then the system complexity is reduced, but the information conveyed in the output image deteriorates
Solution Approach 1:
The system performs preliminary computation of the disparity map from image pairs before applying it to generate the fourth image. This preliminary action extracts and stores spatial relationship information in advance, allowing the final image generation to proceed efficiently without repeatedly calculating complex spatial transformations, thus maintaining information quality while managing system complexity.
Solution Approach 2:
The patent creates a computational copy of spatial relationships through the disparity map, which replicates the geometric transformations needed to align and integrate images from different modalities. This copied spatial information can be applied to multiple different optical images without requiring the original complex multi-view geometry calculations, preserving information while reducing computational burden.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
An imaging system for a microscope is disclosed, including a processor configured to receive first, second, and third images. The processor determines a disparity map from the second image and the third image. A fourth image is determined from the first image and the disparity map. A surgical microscope that includes the imaging system is disclosed. Furthermore, a method of determining an image is disclosed, the method including receiving a first, second, and third image; determining a disparity map; and determining a fourth image from the first image based on the disparity map.