A method for modality synthesis of medical images

A medical image and modality technology, applied in image enhancement, image analysis, graphics and image conversion, etc., can solve the problems of limited universality, inability to guarantee the correspondence of individual images, approaching the mapping relationship of modality medical images, etc., and achieve prediction accuracy high effect

Active Publication Date: 2018-10-26
SOUTHERN MEDICAL UNIVERSITY
View PDF1 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Ordinary digital image processing methods are difficult to apply to the image data acquired by most existing imaging equipment and conventional imaging methods when establishing physical models, and have limited universality and narrow application range. However, the atlas method is applicable to limited parts, and the accuracy of modal synthetic images is limited. It cannot be guaranteed that all individual images correspond well to the atlas, and atlas registration is very time-consuming. Establishing a regression prediction model can only extract a small The image features of the region are difficult to approximate the complex mapping relationship between different modalities of medical images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for modality synthesis of medical images
  • A method for modality synthesis of medical images
  • A method for modality synthesis of medical images

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] A method for modality synthesis of medical images, comprising the following steps:

[0055] The first step is to normalize the spatial resolution of the source modal image. All the source modal images are spatially reduced by downsampling or enlarged by interpolation, so that the resolution of the image is normalized to same size;

[0056] In the second step, the gray value of the source modal image is standardized or normalized, and the gray value of the source modal image processed in the first step is normalized to a mean value of 0 and a standard deviation of 1;

[0057] In the third step, the processed source modal image is used as input, predicted by the convolutional neural network, and the two-dimensional data, three-dimensional volume data or adjacent layers in the source modal image data processed in the second step The image is input to predict the target modality image corresponding to the source modality, and the convolutional neural network architecture a...

Embodiment 2

[0097] see Figure 1-2 , a technical solution provided by this embodiment: the image data of a certain source modality is known, and the image synthesis of a corresponding target modality is predicted by the present invention, including the following basic steps:

[0098] (1) Normalize the spatial resolution of the source modal image, and reduce all the source modal images spatially by downsampling or enlarge them by interpolation, so that the resolution of the image is normalized to the same size, in this embodiment, the N3 algorithm is used to de-bias the source modality image (MR image); and then use the target modality image (CT image) of a certain patient as a template to convert all other source modality The image (MR image) and the image (CT image) of the target modality carry out image registration with the flirt algorithm; and the input image pixel size is normalized to 512 * 512, the present invention is based on the image produced by the existing imaging equipment, ...

Embodiment 3

[0142] A convolutional neural network method for medical image modality synthesis, other are the same as embodiment 1 or 2, specifically adopt the following features to carry out:

[0143] like Figure 4 As shown, the convolutional neural network prediction output is an image of the target modality (CT image) corresponding to the source modality image (MR image); firstly, the N3 algorithm is used to de-bias the source modality image (MR image) Processing; then using the target modality image (CT image) of a certain patient as a template, all other source modality images (MR images) and target modality images (CT images) are image-registered using the flirt algorithm; And normalize the input image pixel size to 512×512.

[0144] The convolutional network includes a convolutional layer with an image size of 512×512, and a convolutional layer with a size of 256×256, 128×128, 64×64, and 32×32 through pooling and downsampling in turn, except The convolution kernel size of the fir...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a medical image modal synthesis method. Source modal image space resolution normalization processing is carried out, resolutions of images are made to be the same through normalization, source modal image gray value standardization or normalization processing is carried out, normalization of source modal image gray values after first-step processing is carried out to acquire a mean value of 0, standard deviation is 1, the source modal images after processing are inputted, prediction is carried out through a convolutional neural network, a convolutional neural network prediction result is outputted to carry out linear transformation to generate a target modal image; a purpose of linear transformation is realized, and the target modal image is generated. Medical image modal synthesis can be rapidly and effectively realized through the convolutional neural network acquired through learning, different-scale and multi-layer image characteristics can be automatically learned and optimized through training the convolutional neural network, a time-consuming image registering process is not needed, and rapid and accurate modal synthesis can be accomplished.

Description

technical field [0001] The invention relates to the technical field of digital image processing, in particular to a method for modality synthesis of medical images. Background technique [0002] Synthesis and virtual reconstruction of corresponding images through computer simulation of another imaging device's imaging method, this process is called modality synthesis, such as reconstruction of ultrasound images from X-ray computed tomography image data, images obtained by magnetic resonance imaging equipment Data prediction and synthesis of corresponding CT images, etc. The purpose of the present invention is to provide an effective modality synthesis method to realize modality synthesis of medical images quickly and effectively. The results generated by modality synthesis can be used to simplify multimodal medical image registration problems, attenuation correction in PET / MRI imaging systems, radiation dose distribution calculation in radiotherapy, etc. [0003] Ordinary ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/50G06T3/40
CPCG06T3/4007G06T5/50G06T2207/20084G06T2207/20221
Inventor 阳维冯前进林莉燕钟丽明陈武凡
Owner SOUTHERN MEDICAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products