The invention discloses a method for performing joint segmentation on an optic cup and an
optic disk of an eye
fundus image based on an MTS-Net neural network combining a VisionTransform and MedNext structure, relates to the field of
deep learning and medical
image processing, and comprises
data processing and segmentation prediction of a visual result network. The overall process is as shown in Figure 1. The method comprises the following steps: step 1, the preprocessing network firstly carries out center
cutting, edge
cutting and normalization operation on a collected picture; 2, constructing a segmentation model, wherein the segmentation model comprises a deep
convolution module, a multi-head self-attention module and a decoding module; wherein the deep
convolution module comprises four sub-modules, namely a Depthwise deep
convolution module, a feature expansion layer, a channel reduction module and a point-by-point convolution module, the deep convolution module is used as an
encoder module of the MTS-Net network, and the deep convolution module extracts features in three stages; the VisionTransform module is used for making up the defect of global feature capture of convolution in the MedNext module in the
feature extraction process, and the decoding module uses a structure symmetrical to the encoding module and is mainly used for gradually recovering spatial resolution in three steps and carrying out
feature fusion, so that
image segmentation is carried out in the later period. And step 3, realizing the eye
fundus image optic cup and
optic disc segmentation task through the MTS-Net network trained in the step 4. The method is used for solving the problems of prediction errors and too slow training speed of a balance
network model in an optic cup and
optic disk proportion
estimation task in
glaucoma screening at the present stage.