Image processing device, method and program

Abstract

A three-dimensional moving image and an ultrasonic moving image showing a body part making periodic motion are obtained, and, from the moving images, a characteristic part having a shape that changes with the periodic motion is extracted. Phases of the periodic motion captured in the moving images are obtained. For at least one of the moving images, the phases are obtained based on the shape of the extracted characteristic part. For each phase, the positions of the characteristic part shown in the three-dimensional moving image and the ultrasonic moving image are associated with each other based on the extracted characteristic part and the obtained phases. A superimposed image is generated by aligning, for each phase, the positions of the characteristic part shown in the three-dimensional moving image and the ultrasonic moving image with each other based on the associated positions of the characteristic part and the phases, and displayed.

Description

BACKGROUND OF THE INVENTION[0001]1. Field of the Invention[0002]The present invention relates to an image processing device, an image processing method and an image processing program for aligning and displaying a three-dimensional moving image taken with a CT or MR apparatus with a two-dimensional or three-dimensional moving image taken with an ultrasonic diagnostics apparatus.[0003]2. Description of the Related Art[0004]In the medical field, detailed three-dimensional moving images, which are obtained by imaging a body part of a patient making a predetermined periodic motion, such as the heart, with a modality having high spatial resolution and contrast resolution, such as a CT or MR apparatus, are widely used for imaging diagnosis.[0005]On the other hand, ultrasonic moving images taken with an ultrasonic diagnostics apparatus, which has no problem of radiation exposure, etc., allows examination with a simple device, and provides information about blood flow based on reflection of...

AI Technical Summary

Benefits of technology

[0010]In view of the above-described circumstances, the present invention is directed to providing an image processing device, an image processing method and an image processing program that facilitate aligning a three-dimensional moving image taken with a CT or MR apparatus with an ultrasonic moving image with respect to phases of a periodic motion and the position thereof to generate and display a superimposed image of the three-dimensional moving image taken with a CT or MR apparatus and the ultrasonic moving image.

[0022]According to the image processing device, method and program of the invention, a three-dimensional moving image showing a body part, which makes a predetermined periodic motion, of a patient and an ultrasonic moving image showing the body part are obtained; from a plurality of frame images forming the obtained three-dimensional moving image and ultrasonic moving image, a predetermined characteristic part having a shape that changes in response to the periodic motion is extracted; phases of the periodic motion captured in each of the three-dimensional moving image and the ultrasonic moving image are obtained, wherein, for at least one of the three-dimensional moving image and the ultrasonic moving image, the phases are obtained based on the shape of the extracted characteristic part; for each phase, a position of the characteristic part in a frame image forming the three-dimensional moving image corresponding to the phase is associated with a position of the characteristic part in a frame image forming the ultrasonic moving image corresponding to the phase based on the extracted characteristic part and the obtained phases; a superimposed image of the three-dimensional moving image and the ultrasonic moving image is generated by aligning, for each phase, a position of the characteristic part in a frame image forming the three-dimensional moving image corresponding to the phase with a position of the characteristic part in a frame image forming the ultrasonic moving image corresponding to the phase based on the associated positions of the characteristic part and the phases; and the generated superimposed image is displayed on a display device. Therefore, even when there is no electrocardiographic data available, the superimposed image of the three-dimensional moving image and the ultrasonic moving image can easily be generated based on the shape of the characteristic part. With this superimposed image, the user can understand the object of observation by compensating for low resolution areas of the ultrasonic moving image with the high spatial resolution of the three-dimensional moving image, and can easily understand the information that is obtained only from the ultrasonic moving image at the same time. Therefore, the user can efficiently and accurately conduct the imaging diagnosis.

Problems solved by technology

Therefore, it is difficult to identify the position and direction of the ultrasonic image relative to the subject.

Therefore, it imposes significant time and labor on the user to display these moving images in a manner allowing comparison therebetween.

However, with the technique taught in Patent Document 1, a three-dimensional moving image taken with a CT apparatus and an ultrasonic moving image cannot be associated with the phases of heart beat, and therefore it is difficult to display the superimposed moving images such that they show the same phase and the same spatial position.

Therefore, in a case where the electrocardiographic data corresponding to one of or both of the moving images is not available, it is difficult to associate the corresponding phases of heart beat shown in the moving images with each other.

Images