Intermediate Medical Imaging Frames With Motion-Based Extrapolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Medical imaging technologies face challenges with low frame rates leading to jerky graphical representations and delayed image displays, which hinder real-time observation and response, particularly in procedures requiring rapid feedback like cardiac catheterization.
Innovation Solution
Generate intermediate images using motion information from sources independent of the imaging sensor, such as cameras or EEG devices, to create a smooth video impression by temporal extrapolation, allowing higher frame rates without additional latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If intermediate images are calculated using conventional methods requiring the next image in the video sequence, then the visual impression becomes smoother, but the display latency increases by half an image recording period
Solution Approach 1:
The patent performs temporal extrapolation to generate intermediate images using only previously displayed image data, without waiting for the next image to arrive. This preliminary action allows intermediate images to be calculated in advance based on historical motion patterns, maintaining smooth visual presentation while avoiding the latency penalty of conventional methods that require future image data.
Solution Approach 2:
The patent introduces motion information from independent capturing facilities (such as optical cameras or motion sensors) as an intermediary to bridge the gap between sequential X-ray images. This intermediary motion data enables more accurate temporal extrapolation of intermediate frames without requiring future X-ray image data, thus improving smoothness while maintaining low latency.
2Object-affected harmful factors
If a low frame rate is selected to reduce X-ray dose, then radiation exposure decreases, but the graphical representation becomes jerky and less smooth
Solution Approach 1:
The patent creates synthetic copies of intermediate image frames through temporal extrapolation based on motion patterns from previous frames and independent motion capturing facilities. These copied intermediate frames fill the temporal gaps between low-frame-rate X-ray images, providing a smooth visual presentation without requiring additional actual X-ray exposures, thus maintaining low radiation dose while improving visual smoothness.
Solution Approach 2:
The patent applies periodic temporal extrapolation between sequentially recorded X-ray images to generate intermediate frames at higher effective frame rates. By periodically inserting these computationally generated intermediate images into the video sequence, the system achieves smooth visual presentation at the original low X-ray frame rate, eliminating the jerky appearance while maintaining reduced radiation exposure.
3Loss of time
If temporal extrapolation is performed without new image data available, then display latency is reduced, but the extrapolated image may deviate from the future actual image
Solution Approach 1:
The patent employs feedback mechanisms by continuously comparing the temporally extrapolated intermediate images with subsequently captured actual images. When deviations are detected, the system adjusts its extrapolation parameters and motion models to improve future predictions. This feedback loop maintains high accuracy in temporal extrapolation while preserving low latency, ensuring that generated intermediate images remain consistent with actual future image content.
Solution Approach 2:
The patent uses dynamic motion models that adapt to changing motion patterns in real-time, leveraging motion information from independent capturing facilities to continuously update extrapolation parameters. This dynamic approach allows the system to accurately predict intermediate image content even when motion patterns change, maintaining precision while avoiding the latency of waiting for next-frame data.
Data Source
AI summary
In medical imaging, image sequences may be perceived more smoothly. Therefore, a method for generating an intermediate image in medical imaging is provided. A first image and a second image of an object are obtained with an imaging sensor. In the first image, an image section of the object and a further image section are represented in a relative position to one another. Further, motion information relating to the object is obtained independently of the first image and the second image of the imaging sensor. An intermediate image is generated for presentation between the first image and the second image. In the intermediate image, a relative position between the image section of the object and the further image section is changed in dependence on the motion information compared to the first image. The intermediate image is generated before the second image is available for presentation.