Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-modal image registration method and device, electronic equipment and storage medium

A technology of multimodal images and imaging equipment, applied in the field of medical imaging, can solve problems such as increasing the difficulty of registration processing

Active Publication Date: 2020-06-19
NEUSOFT MEDICAL SYST CO LTD
View PDF10 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, different types of equipment have different coverages of images collected. CT (Computed Tomography) and PET (Positron Emission Computed Tomography) can obtain whole-body images, while MR (Magnetic Resonance) can only obtain images of a small field of view; Even if multi-modal images collect images of the same part, their characteristics are significantly different. CT images clearly reflect the contours of dense tissues such as bones, PET images are sensitive to abnormal areas of physiological metabolism, and MR images have high contrast to soft tissues; Modal images are often collected by different devices at different times. Due to changes in the patient's body position, the size and shape of the organs in the image will change, which increases the difficulty of registration processing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal image registration method and device, electronic equipment and storage medium
  • Multi-modal image registration method and device, electronic equipment and storage medium
  • Multi-modal image registration method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0201] The registration reference images shown in Fig. 8(a)-8(c) are brain CT images collected by GE Discovery STE equipment. The images to be registered shown in Fig. 8(d)-8(f) are FLAIRMR images of the same patient collected by GE Genesis_Signa equipment. It can be seen from Figures 8(a)-8(f) that CT data contains complete brain information, while MR only provides part of the brain information, and there is a significant difference in the image directions between the two. Since CT equipment and MR equipment are different, the image position information provided by them cannot be directly used for fine registration.

[0202] Figures 8(g)-8(i) show that the registration information of the image to be registered and the reference reference image is determined through the multimodal image registration method provided by the embodiment of the present invention, and the registration information to be registered is based on the registration information The result of fusion of an i...

example 2

[0204] Figures 9(a)-9(i) are examples of PET-CT registration of the buttocks of another patient. The reference images shown in Figures 9(a)-9(c) are CT images of the torso collected by GE Discovery STE equipment. The moving images shown in Figures 9(d)-9(f) are the axial PET data of the same patient collected by GE equipment. It can be seen from Figure 9(a)-9(f) that CT data contains complete torso information, while PET contains hip information, and there is a difference in FOV between the two.

[0205] Figures 9(g)-9(i) show that the registration information of the image to be registered and the reference reference image is determined through the multimodal image registration method provided by the embodiment of the present invention, and the registration information to be registered is based on the registration information The result of fusion of an image with a reference reference image. The results show that after the coarse registration process is performed on the imag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-modal image registration method and device, electronic equipment and a storage medium. The method comprises the following steps: judging whether a to-be-registered areaexists in a to-be-registered image and a registration reference image or not, wherein the to-be-registered image and the registration reference image are medical images acquired by using imaging equipment with different modes; performing two-dimensional sliding window search in a first image direction and two-dimensional sliding window search in a second image direction perpendicular to the firstimage direction on the to-be-registered image and the registration reference image under the condition that the to-be-registered area exists in the to-be-registered image and the registration reference image; and determining registration information of the to-be-registered image registered to the registration reference image according to a sliding window search result. Coarse registration of themulti-modal image is realized, the calculation amount is small, and the efficiency is high.

Description

technical field [0001] The invention relates to the technical field of medical imaging, in particular to a multimodal image registration method, device, electronic equipment, and storage medium. Background technique [0002] Image registration is a necessary processing step for clinical application requirements such as medical image comparison, data fusion, and change analysis. In image registration, it is often necessary to perform registration processing on images from different imaging devices (multimodal image registration technology), and complementary fusion of information characteristics of different modalities is of great significance for applications such as medical diagnosis and surgical planning. [0003] Multimodal image registration is the registration of images of the same patient acquired by different types of medical equipment. Due to the differences in imaging mechanisms of different devices, multimodal image registration faces more challenges. For example...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/33
CPCG06T7/33G06T2207/10081
Inventor 白璐李广朱传伟
Owner NEUSOFT MEDICAL SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products