Composite Image Display for Surgical Context and Detail
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Surgical interventions face limitations due to compact image capture systems providing only a limited field of view, making it difficult for surgeons to visualize the local treatment area in context, especially when using mobile devices like X-ray or endoscopes.
Innovation Solution
A method that integrates additional 2D image data of a smaller object area into pre-recorded 2D or 3D image data of a larger area, aligning with the projection geometry, to extend the displayable area, enhancing resolution and contrast, and allowing for real-time, high-resolution display of critical areas within a larger context image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If compact mobile image capture devices are used, then device portability and ease of operation are improved, but the field of view and displayable area are limited
Solution Approach 1:
The patent combines multiple image data sets with different fields of view into a single composite image. The first image data set provides a wide field of view from pre-acquired 3D data, while the second data set provides high-resolution details from the mobile device. By merging these data sets through registration and integration, the system achieves both portability and extended displayable area.
2Measurement precision
If high-resolution additional 2D image data are integrated into lower-resolution overall images, then local detail resolution is improved, but image processing complexity increases
Solution Approach 1:
The patent applies local quality by integrating high-resolution additional 2D image data specifically into the regions of interest within the lower-resolution overall image. Instead of processing the entire image at high resolution, the method selectively enhances local areas where additional detail is needed, thereby improving local detail resolution while limiting the increase in overall processing complexity.
Solution Approach 2:
The patent segments the image processing into distinct steps: first acquiring and processing the overall low-resolution image data, then separately processing the high-resolution additional 2D image data, and finally integrating them through registration. This segmentation allows each processing stage to be optimized independently, managing overall complexity while achieving high local resolution.
3Loss of information
If multiple image data sets are integrated and registered, then situational awareness and context visualization are improved, but processing time and computational requirements increase
Solution Approach 1:
The patent applies preliminary action by pre-acquiring 3D image data of the entire object region before the surgical intervention. This pre-acquired data is processed into a first image data set that provides the overall context. By preparing this contextual framework in advance, the system reduces the processing time required during the actual intervention when additional 2D image data need to be rapidly integrated.
Solution Approach 2:
The patent uses copying by creating a registered representation of the pre-acquired 3D image data that matches the geometry and perspective of the additional 2D image data. Instead of re-processing the entire 3D data set in real-time, the system creates a suitable copy or projection of the pre-processed 3D data that can be quickly integrated with the new 2D data, thereby reducing computational requirements and processing time.
Data Source
AI summary
In a method to extend the display range of 2D image recordings of an object region, particularly in medical applications, first 2D or 3D image data are acquired from a larger object region, and at least one additional set for 2D image data of a smaller object region is acquired that lies within the larger object region The first 2D or 3D image data are brought into registration with the additional 2D image data with a projection geometry. From the first 2D or 3D image data, an image data set is generated for an image display of the first object region, which is suitable for combination with the additional 2D image data. In the image display of the larger object region, at least temporarily, at least one display of the additional 2D image data is integrated, by image data in the first image data set, for the image display of the larger object region, being replaced with image data from the additional 2D image data representing the smaller image region. An overview of the larger object region is thus enabled, with the smaller object region of interest being displayed within the image in a more up-to-date fashion, as well as with higher resolution and/or higher contrast.