Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and system for fundus image registration based on multispectral

A fundus image and multi-spectral technology, applied in image analysis, image enhancement, graphics and image conversion, etc., can solve the problems of fundus deformation, cost a lot of energy, and it is difficult to get aligned images, so as to achieve acceleration speed and accuracy, and avoid excessive Fitting effect

Active Publication Date: 2022-03-29
SHANDONG NORMAL UNIV
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The second difficulty is that the movement of the eyeball causes the deformation of the fundus
However, in fact, obtaining accurate segmentation information is very expensive, requiring corresponding experts to spend a lot of energy on labeling
The second is a learning-based registration method, which requires pre-aligned image pairs to train a multimodal registration network, but it is difficult to obtain precisely aligned image pairs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for fundus image registration based on multispectral
  • A method and system for fundus image registration based on multispectral
  • A method and system for fundus image registration based on multispectral

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] The present disclosure provides a multispectral-based fundus image registration system, the method comprising:

[0063] Step (1): collect fundus images under different spectra, determine the template fundus image and the fundus image to be registered;

[0064] Step (2): Construct a regression network model based on the feature balance layer and pyramid structure, and obtain the spatial transformation matrix between the template fundus image and the fundus image to be registered;

[0065] Step (3): Train the regression network with a weak supervision method, use the segmentation map of the fundus image as the label, obtain the template fundus image and the blood vessel label map of the fundus image to be registered, use the Gaussian filter to process the blood vessel label map, and use the processed Correct the spatial transformation of the template fundus image and the fundus image to be registered, so that the regression network model outputs approximately smooth resul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present disclosure provides a registration method based on multispectral fundus images. A registration method based on multispectral fundus images, including: using RHA to obtain multispectral fundus images, selecting a template fundus image and a fundus image to be registered; constructing a regression network to obtain the deformation between the template fundus image and the fundus image to be registered field, and add a feature balance layer and pyramid structure to the regression network; construct a loss function, including the similarity loss of the blood vessel label map and the flattening constraint of the deformation field; train the network in a weakly supervised manner, and use the processed fundus image Segmentation maps serve as labels for training the network. This disclosure uses the segmentation map as a guide to train the registration model in a weakly supervised manner. Practice has proved that this method can effectively solve the problem of multispectral fundus image registration, and can achieve good results, and weakly supervised segmentation-oriented registration The method can be extended to more multimodal image registration problems.

Description

technical field [0001] The present disclosure belongs to the field of image registration, and in particular relates to a multispectral-based fundus image registration method and system. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art. [0003] Medical image registration is a basic task in medical image processing and a hotspot in medical image processing at present, which has very important significance in clinical diagnosis and disease treatment. Medical image registration is to find an ideal spatial transformation between two images, so that the corresponding points of the two images achieve a complete match in terms of spatial and anatomical positions, or at least all clinical diagnosis concerns are matched. [0004] The multi-spectral fundus image is a special fundus imaging, which uses different monochromatic LED light sources to project into...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/33G06T7/38G06T7/11G06T3/00G06N3/04G06N3/08
CPCG06T7/344G06T7/38G06T7/11G06T3/0068G06N3/08G06T2207/20016G06T2207/20081G06T2207/20182G06T2207/30041G06T2207/30101G06N3/045
Inventor 郑元杰连剑张冉丛金玉贾伟宽
Owner SHANDONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products