Dynamic 2D-3D Image Registration for Fluctuating Projection Angles
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional medical imaging systems struggle to coherently display live two-dimensional images alongside pre-acquired three-dimensional images, especially when the live image's projection angle fluctuates, making it difficult for physicians to accurately guide treatments.
Innovation Solution
The system combines a two-dimensional image with a three-dimensional image by determining the projection axis and embedding the two-dimensional image orthogonally within the three-dimensional image, using digitally-reconstructed radiographs for registration, and allowing for real-time updates and opacity control to enhance alignment and visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a two-dimensional live image is displayed as a static background to a three-dimensional planning image with fixed orientation, then the display is simple, but the alignment accuracy deteriorates when the live image projection angle fluctuates
Solution Approach 1:
The system dynamically adjusts the display orientation and position of the two-dimensional live image based on real-time projection angle information. The image processing system calculates the appropriate rotation and translation parameters to maintain accurate alignment between the live image and three-dimensional planning image, transforming the static display into a dynamic adaptive display that responds to angle changes.
Solution Approach 2:
The system changes the spatial parameters (position, orientation, scale) of the two-dimensional image within the composite display based on the projection angle characteristics. By adjusting these parameters in real-time, the system maintains accurate spatial relationships between the live image and three-dimensional image despite fluctuations in projection angle.
2Measurement precision
If additional three-dimensional images are acquired during treatment to guide intervention, then the treatment guidance accuracy is improved, but the radiation exposure and procedure time increase
Solution Approach 1:
The system makes the existing three-dimensional planning image serve multiple functions: it acts as both the pre-treatment planning reference and the real-time guidance reference. By enabling accurate superposition of the live two-dimensional image with the pre-acquired three-dimensional image, the system eliminates the need to acquire additional three-dimensional images during treatment, allowing the same image data to be used for both planning and intervention guidance.
Solution Approach 2:
The three-dimensional planning image is acquired and prepared in advance before the treatment procedure. The system then utilizes this pre-acquired image data in real-time during treatment by dynamically aligning it with the live two-dimensional image, eliminating the need for additional real-time three-dimensional image acquisition and reducing procedure time.
3Loss of information
If the two-dimensional live image is embedded within the three-dimensional image, then the anatomical information access is improved, but the image processing complexity increases
Solution Approach 1:
The system introduces an image processing intermediary layer that handles the complexity of aligning and embedding the two-dimensional image with the three-dimensional image. This intermediary processing layer automatically calculates spatial transformations, registers the images, and manages the composite display, shielding the user from the underlying computational complexity while providing enhanced anatomical information access.
Data Source
AI summary
A system and method includes determination of a projection axis associated with the two-dimensional projection image, generation of a second two-dimensional image from the three-dimensional image based on the projection axis, registration of the two-dimensional projection image with the second two-dimensional image, combination of the registered two-dimensional projection image with the three-dimensional image in a plane of the three-dimensional image substantially orthogonal to the projection axis, and display of the combined image.