Multi-Modal Medical Image Alignment Using Infrared Shape Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing medical imaging techniques, such as PAT and MRI, face challenges in accurately aligning images due to differences in characteristics and insufficient outer shape information, making it difficult to align PAT images with MRI or CT images effectively.
Innovation Solution
An image processing apparatus that obtains images from different modalities and uses alignment units to deform and align MRI or CT images with PAT images by estimating rigid transformation and compression deformation parameters, utilizing infrared camera images to enhance superficial vessel visualization and improve alignment accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image matching technique is used to align PAT image with MRI image, then alignment between images is achieved, but accurate alignment cannot be executed due to differences in imaging characteristics and insufficient outer shape information in PAT image
Solution Approach 1:
The patent introduces an infrared camera as an intermediary device to capture outer shape information of the subject. This captured image serves as a mediator that bridges the gap between PAT image (lacking outer shape info) and MRI image, enabling accurate alignment by providing the missing outer shape characteristics for matching
Solution Approach 2:
The patent combines multiple imaging modalities (PAT imaging, MRI imaging, and infrared camera imaging) into an integrated alignment system. By merging the strengths of each modality - PAT for functional information, MRI for detailed anatomy, and infrared for outer shape - the system achieves comprehensive alignment that none of the individual techniques could accomplish alone
2Length of moving object
If PAT apparatus images deep portion of human body, then imaging depth is increased, but imaging capability is limited compared to X-rays due to low energy of near-infrared pulses
Solution Approach 1:
The patent creates a multi-functional imaging system where different imaging modalities serve complementary functions. PAT imaging handles functional information and moderate depths, while MRI provides deep anatomical structure information, and infrared imaging captures surface characteristics. This universal system allows the diagnostic workflow to leverage the appropriate modality for each specific imaging need
3Manufacturing precision
If breast is held by flat plates to reduce thickness for PAT imaging, then imaging quality is improved, but compression deformation occurs requiring alignment with MRI image
Solution Approach 1:
The patent performs preliminary capture of the breast's outer shape using an infrared camera before or during the compression imaging process. This preliminary information about the original shape is stored and later used as a reference to compensate for and correct the compression deformation effects in the final aligned images
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables accurate alignment of MRI or CT images with PAT images, improving diagnostic efficiency by aligning observation information and enhancing the visualization of superficial vessels, thus facilitating better medical diagnosis.
Implementation Method 1
The PAT apparatus excites an absorbing substance in a subject by irradiating the subject with optical pulses, and detects a photoacoustic signal generated by the thermoelastic expansion of the absorbing substance
Implementation Method 2
detects a photoacoustic signal generated by the thermoelastic expansion of the absorbing substance
Implementation Method 3
a third image by imaging the object using an image capturing unit whose position is associated with the second imaging apparatus
Data Source
AI summary
An image processing apparatus includes: an image obtaining unit configured to obtain a first image by imaging an object using a first imaging apparatus, a second image by imaging the object using a second imaging apparatus, a third image by imaging the object using an image capturing unit whose position is associated with the second imaging apparatus; and an alignment unit configured to align the object in the first image with the object in the second image so that observation information of the object in the first image matches observation information of the object in the third image.