Multi-Sensor Endoscope Image Stitching for High Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current endoscopes face challenges in achieving high resolution images while maintaining a small bore diameter, as well as providing wide-angle perspectives and high resolution image capture within the practical limitations of endoscopy.
Innovation Solution
The use of multiple image sensors, each capturing a portion of the image, with one sensor receiving two portions of image light from opposing sides, allows for the combination and manipulation of these images into a single high-resolution image. This setup includes light directing elements to direct image light to the multiple sensors, enabling wide-angle viewing and high-resolution image capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single high-resolution image sensor is used, then image resolution is improved, but the device size and power consumption increase beyond practical endoscopic limitations
Solution Approach 1:
The patent divides a single large high-resolution sensor into multiple smaller sensors (e.g., four 1/3-inch sensors instead of one large sensor). Each sensor captures a portion of the overall image, and the images are combined through image processing to achieve the resolution equivalent to a single large sensor, thereby reducing individual sensor size and power consumption while maintaining high resolution
2Area of stationary object
If multiple image sensors are used to capture wide-angle perspectives, then field of view is improved, but device complexity increases
Solution Approach 1:
The field of view is divided into multiple segments captured by separate sensors positioned at different angles. Each sensor captures a specific angular portion of the scene, and the segments are stitched together through image processing to form a complete wide-angle view, thereby expanding the field of view without requiring a single complex wide-angle lens system
Solution Approach 2:
Multiple images captured from different angular perspectives by separate sensors are merged through image processing algorithms to create a single composite wide-angle image. This combining process integrates the segmented views into a unified perspective, achieving wide-angle coverage while maintaining manageable system complexity through modular sensor arrangement
3Measurement precision
If multiple image sensors are used to achieve high resolution, then image resolution is improved, but image processing complexity increases
Solution Approach 1:
The high-resolution image is segmented across multiple sensors, with each sensor capturing a specific portion of the overall image at high resolution. The segmentation allows each sensor to operate independently at optimal resolution settings while the overall system achieves ultra-high resolution through combination of the segmented high-resolution portions
Solution Approach 2:
The image processing system creates multiple copies of the image data from different sensor perspectives and combines them through alignment and stitching algorithms. This copying and recombination process reconstructs a single high-resolution composite image from the multiple sensor inputs, managing the complexity of multiple high-resolution sources through systematic data replication and integration
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables the creation of high-resolution images with wide-angle perspectives, allowing for digital zoom and pan capabilities without compromising image quality, while also addressing the limitations of space and power in endoscopic instruments.
Implementation Method 1
an optical channel assembly including a single channel lens system optically arranged to receive image light from an object space and condition the image light in a single optical channel to create an image space
Implementation Method 2
The first and second light directing elements are positioned in the image space of the optical channel assembly to receive the second and third portions of the image light from the optical channel assembly and direct them toward respective first and second portions of the second image sensor
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
An endoscope or other endoscopic instrument is provided with multiple image sensors, each capturing a portion of the image provided from an optical imaging system. One sensor receives two portions of the image light at opposing sides of the image. The output from the multiple sensors is combined and manipulated into a single high resolution image which can then be displayed to the user. A virtual horizon rotation feature is also provided which can rotate a displayed image within a combined field of view including data from the multiple image sensors. Various light directing element designs are provided to direct image light to the multiple sensors.