Stereo-Microscope Image Segmentation for Obstructed Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current microscopes face challenges in creating stereoscopic images when dilators are used, as they limit the stereo basis, leading to either two-dimensional imaging or limited depth information, making surgical procedures more difficult in partially obstructed views.
Innovation Solution
The system processes image data from two stereoscopic imaging sensors to combine stereoscopic and two-dimensional views, allowing for a larger stereo basis and peripheral views by generating a combined image data set with a stereoscopic view in one region and a two-dimensional view in another, using image processing to handle partial obstructions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If a dilator is used to reduce wound size, then the wound tract size is reduced, but the ability to create stereoscopic images is limited
Solution Approach 1:
The image data is segmented into multiple regions: a first region containing stereoscopic image data from both imaging sensors, and a second region containing two-dimensional image data from one imaging sensor. This segmentation allows the system to preserve stereoscopic imaging capability in the central region while utilizing peripheral regions for additional contextual information, thereby maintaining imaging quality despite the physical constraints imposed by the dilator.
2Measurement precision
If a small stereo basis is used to get clear images with a dilator, then image clarity is improved, but depth information is limited
Solution Approach 1:
The system transitions from relying solely on spatial stereo basis to utilizing the temporal and data-combination dimensions. By capturing images at different positions of the imaging sensors and computationally combining them to generate a merged image with enhanced depth information, the system recovers depth perception that would otherwise be lost due to the small physical stereo basis required by the dilator constraint.
3Device complexity
If two-dimensional imaging is used when a dilator is present, then imaging is simpler, but the surgical procedure becomes harder to perform
Solution Approach 1:
The system dynamically changes the imaging parameters by adjusting the positions of the first and second imaging sensors relative to each other. By capturing image data at multiple sensor positions and combining them through image processing, the system generates merged images with enhanced depth information and stereoscopic views, thereby improving surgical visibility and ease of operation while maintaining manageable system complexity through automated processing.
Data Source
Figure 1a
Figure 1b~1c
Figure 2~3a
AI summary
Examples relate to a system (110), a method and a computer program for a microscope (120), and to a microscope system (100) comprising the microscope (120) and a system which comprises one or more processors and one or more storage devices. The system is configured to obtain first image data of a sample from a first optical imaging sensor of the microscope. The system is configured to obtain second image data of the sample from a second optical imaging sensor of the microscope. The system is configured to combine the first image data and the second image data to obtain combined image data. A first region of the combined image data comprises a stereoscopic view of a first region of the sample that is based on the first and the second image data. A second region of the combined image data comprises a two-dimensional view of a second region of the sample that is based on one of the first image data and the second image data.