Ultrasonic Reference Image Alignment for Diagnostic Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current ultrasonic diagnosis systems face challenges in recognizing the association relationship between ultrasonic images and reference images from other diagnostic modalities like CT or MRI, due to differences in image format and magnification, and in accurately positioning the ultrasonic scan plane relative to a target specified on a reference image.
Innovation Solution
The system reconstructs and displays ultrasonic images and reference images on the same screen, with the reference image adjusted to match the fan-shaped view area and magnification of the ultrasonic image, and includes features like acoustic shadow simulation, composite image display, and dynamic adjustment of image size and frame rate to facilitate alignment and observation. Additionally, it uses sensors to determine the positional relationship between the ultrasonic probe and the patient, allowing for real-time alignment and correction of image coordinates based on patient movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a CT image or MR image is merely rendered as the reference image, then the reference image can be displayed, but it becomes a great burden on the operator to recognize an association relationship between the images
Solution Approach 1:
The reference image is segmented into multiple regions corresponding to different ultrasonic scan planes. Each region is extracted and displayed separately to show the association relationship with the corresponding ultrasonic image, making it easier for the operator to recognize the relationship without being overwhelmed by the entire reference image at once.
Solution Approach 2:
The patent transforms the two-dimensional reference image into a three-dimensional volume image, allowing multi-planar reconstruction. This enables the display of reference images in different orientations (axial, coronal, sagittal planes) to match the ultrasonic scan planes, facilitating better spatial understanding and association recognition.
2Ease of operation
If the reference image and ultrasonic image are displayed with different magnifications and formats, then both images can be displayed, but it is difficult to recognize an association relationship of portions to be observed
Solution Approach 1:
The display system dynamically adjusts the magnification and format of the reference image and ultrasonic image based on the selected region of interest. When the operator selects a specific portion for observation, the system automatically scales and positions both images to match, ensuring optimal comparison while preserving detailed information through adaptive resolution adjustment.
Solution Approach 2:
The patent applies different display qualities to different regions of the images. High-resolution detailed views are provided for regions of interest where comparison is needed, while lower-resolution views are used for peripheral areas. This allows effective comparison in critical areas without losing overall contextual information.
3Ease of operation
If the ultrasonic scan plane is not aligned with the reference image, then the ultrasonic probe can be positioned freely, but accurate positioning relative to a target specified on the reference image becomes difficult
Solution Approach 1:
The system provides real-time feedback by displaying the current ultrasonic scan plane position overlaid on the reference image. When the scan plane does not align with the target, visual indicators show the misalignment and guide the operator to adjust the probe position. This continuous feedback loop enables accurate positioning without complex manual coordinate calculations.
Solution Approach 2:
The patent implements an asymmetric coordinate system association where the reference image coordinate system is fixed while the ultrasonic scan plane coordinate system is dynamically adjusted based on probe position and orientation. This asymmetric approach simplifies the positioning process by allowing free probe movement while maintaining accurate target localization through software-based coordinate transformation.
Data Source
AI summary
An ultrasonic image 105, 106 is captured by an ultrasonic probe 104. A reference image 111 is obtained by extracting a tomographic image corresponding to the scan plane of the ultrasonic image from volume image data that is pre-obtained by a diagnostic imaging apparatus 102 and that is stored in a volume-data storing unit 107. The ultrasonic image and the reference image 111 are displayed on the same screen 114. In this case, of the reference image, a portion corresponding to the view area of the ultrasonic image is extracted and the resulting reference image having the same region as the ultrasonic image is displayed as a fan-shaped image.