CBCT-MR Registration via Occluded Shape Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image-guided medical procedures for liver cancer treatment, such as TACE, face challenges in integrating three-dimensional information from pre-operative MRI or MDCT images with real-time two-dimensional CBCT images, due to differences in imaging modalities, contrast agent delivery pathways, and incomplete CBCT field of view, leading to difficulties in accurate registration and fusion of images.
Innovation Solution
The solution involves spatial registration of CBCT images with pre-operative medical images using point set registration of segmented liver surfaces, which includes segmenting the liver surface in both images, warping one image to match the other, and optionally employing occluded shape reconstruction to address incomplete CBCT views, facilitating the generation of fused images for improved real-time guidance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If conventional independent display of multiple imaging modalities is used, then information from multiple sources is provided to the surgeon, but accurate spatial integration and fusion of 3D pre-operative MRI/MDCT with 3D intra-procedural CBCT information is not achieved
Solution Approach 1:
The patent merges multiple imaging modalities (pre-operative MRI/MDCT and intra-procedural CBCT) into a single fused three-dimensional image that integrates anatomical structures from different sources. This combining approach allows the surgeon to view integrated spatial information from both imaging modalities simultaneously, resolving the technical contradiction by achieving complete spatial integration while managing system complexity through automated registration algorithms.
2Productivity
If CBCT imaging is used for real-time guidance, then near real-time feedback on contrast agent deposition is provided, but incomplete CBCT field of view and modality differences lead to registration difficulties
Solution Approach 1:
The patent introduces a three-dimensional image fusion system as an intermediary that bridges the gap between CBCT and pre-operative MRI/MDCT modalities. This intermediary performs automated spatial registration and fusion algorithms that compensate for modality differences and incomplete field of view, allowing real-time feedback to be achieved while maintaining registration accuracy through computational correction of the inherent limitations.
3Loss of information
If multiple imaging modalities are used independently, then comprehensive information is available, but the surgeon receives no assistance in merging 3D information from pre-operative and intra-procedural images
Solution Approach 1:
The patent implements automated spatial registration and image fusion algorithms that perform the merging of multiple 3D imaging modalities without requiring manual intervention from the surgeon. The system self-services by automatically aligning and fusing pre-operative MRI/MDCT with intra-procedural CBCT images, preserving spatial correlation information while eliminating the operational burden of manual image merging.
Data Source
AI summary
In an image guidance method, a stream of cone-beam computed tomography (CBCT) images of an anatomical organ is acquired using a CBCT imaging device (34). For each CBCT image (44), the surface of the organ in the CBCT image is segmented to generate a segmented surface (70) of the anatomical organ in the CBCT image. Occluded shape reconstruction (66) using a statistical shape prior (68) may be used to reconstruct a missing or occluded surface portion. A pre-operative medical image (12) of the anatomical organ and the CBCT image are spatially registered by warping one of the images to the other of the images using point set registration of a segmented surface (30) of the organ in the preoperative medical image and the segmented surface of the organ in the CBCT image. A fused image (82) is displayed that combines the warped image and the other image.