3D Image Reconstruction via Ray Integration for Real-Time Medical Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D reconstruction methods are computationally expensive and limited by speed, making real-time reconstruction of fast-moving objects challenging, especially in applications like fluoroscopy and electrophysiology where precise and rapid image processing is required.
Innovation Solution
A method for 3D image reconstruction using multiple 2D images and projection information, involving ray projection, pixel correspondence determination, and multi-channel 3D reconstruction with filtering to reduce ghosting artifacts, allowing for real-time rendering and catheter tracking with GPU acceleration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full-volume 3D reconstruction is performed using traditional methods, then complete volumetric information is obtained, but computational expense increases and reconstruction speed decreases
Solution Approach 1:
The patent extracts only the necessary volumetric information directly from 2D images through ray projection and integration, rather than performing complete full-volume reconstruction. This selective extraction approach obtains sufficient 3D data for medical visualization while significantly reducing computational expense and enabling real-time processing speeds
Solution Approach 2:
The patent performs partial reconstruction by integrating rays only through regions containing instruments or structures of interest, rather than reconstructing the entire volume. This partial action approach maintains measurement precision for critical areas while reducing overall computational burden to achieve real-time reconstruction speeds
2Measurement precision
If traditional 3D reconstruction methods are used, then volumetric data is reconstructed, but ghosting artifacts appear in the reconstructed images
Solution Approach 1:
The patent uses the known projection information and ray geometry to identify and correct ghosting artifacts rather than treating them as pure noise. By understanding the projection relationships between multiple 2D images, the system can distinguish true 3D structures from ghosting artifacts and eliminate them, converting the harmful artifact problem into a solvable geometric constraint problem
Solution Approach 2:
The patent changes the approach from traditional volume rendering parameters to ray-based integration parameters, using projection information to control ray paths and integration regions. This parameter change allows precise control over which structures are reconstructed and eliminates ghosting by ensuring rays only integrate through valid object regions
3Productivity
If real-time reconstruction is attempted with fast-moving objects, then reconstruction speed is increased, but accuracy and precision are compromised
Solution Approach 1:
The patent performs preliminary determination of correspondence information between pixels in different 2D images before performing ray integration. This preliminary action establishes accurate pixel matching relationships in advance, allowing the subsequent 3D reconstruction to proceed rapidly without compromising precision, even for fast-moving objects captured in sequential frames
Data Source
AI summary
A method for reconstructing a three-dimension image includes receiving a plurality of two-dimensional images and projection information of the two-dimensional images, projecting a plurality of rays onto the plurality of two-dimensional images, determining correspondence information between pixels of different ones of the plurality of two-dimensional images, determining a value of each of the pixels, and reconstructing a three-dimension image by integrating the plurality of rays, wherein a position on each ray can be associated to one pixel of the plurality of two-dimensional images.