Breast cancer image recognition method and system based on multi-stage multi-feature deep fusion

Abstract

The invention belongs to the technical field of image processing, and discloses a breast cancer image recognition method based on multi-stage multi-feature deep fusion, and the method comprises the steps: extracting the Gist, SIFT, HOG, LBP, VGG16, ResNet and DenseNet features of an image from multiple angles of shape, texture and deep learning; deeply mining cross-modal pathological semantics contained in different features; performing feature fusion through early fusion, middle fusion and post fusion; constructing a multi-stage multi-feature fusion model integrating early fusion, middle fusion and post fusion; and classifying, identifying and processing the breast lumps and outputting a processing result. According to the method, traditional features and deep learning features of mammography images are extracted, cross-modal pathological semantics among different features are deeply mined, and a multi-stage multi-feature fusion strategy is designed to complete breast cancer image recognition. Meanwhile, the dimensionality of the core features is compressed to improve the real-time efficiency of the diagnosis model.

Description

technical field [0001] The invention belongs to the technical field of information processing, and in particular relates to a breast cancer image recognition method and system based on multi-stage multi-feature deep fusion. Background technique [0002] At present, the commonly used technologies in the industry are as follows: breast cancer is the cancer with the highest incidence rate among women, and it is also a complex clinical heterogeneous disease with a very high mortality rate. The survival rate and the improvement of the quality of life of patients are of great significance. Computer-aided automatic diagnosis of breast cancer has become a common concern of academia and industry. Mammography images (X-ray photography images) can better reflect a variety of abnormalities in breast tissue, so based on mammography images, pathologists can make correct diagnostic decisions. However, the size and shape of the lumps in mammography images are diverse, and the density of br...

AI Technical Summary

Problems solved by technology

Its main problem: the pre-trained weights are based on the ImageNet dataset, which does not contain any medical images, so the pre-trained weights are not very helpful for mammography images

The main disadvantage of this method: the neural network contains a large number of parameters, and the modulation parameters take a very long time

[0011] In summary, the deep learning method can improve the diagnostic performance of breast cancer, but it also has key problems such as high requirements on machine hardware, long training time, high complexity and strict requirements on image size when training the model

[0012] In summary, the existing problems in the prior art are: (1) the feature extraction method in the existing mammography image recognition model is complex, has high professional requirements, cannot be universally applied, and the extraction efficiency is not high; In the process, the traditional feature discrimination ability is weak; the accuracy of the traditional mammography image recognition method is not high, and the practical value is affected

The deep learning method training model has high requirements on machine hardware, long training time, high complexity and strict requirements on image size

[0013] (2) The feature fusion method adopted by the existing method is relatively simple, and the complementarity of different features in breast mass recognition is not considered

In addition, the "cross-modal pathological semantics" between features has not been effectively utilized, and high-quality cross-modal discriminant information needs to be further excavated, and high-dimensional features lead to high time complexity of the model;

[0014] (3) In the training process of the neural network, a large number of parameters need to be modulated, and the parameter modulation is difficult, so the model training time is relatively long

The neural network model has extremely high requirements on the hardware configuration of the machine, and it will cost a lot of money to purchase a high-performance server containing multiple GPUs

[0015] (4) The pre-trained neural network model has strict requirements on the size of the input image. For the original mammography image with higher resolution, it is easy to lose the key discriminant information if the image size is greatly reduced, which will affect the final recognition performance.

[0016] (5) Some models based on the image block level need to complete the accurate labeling of the lesion area first, and the cost of high-quality medical image labeling is extremely high

[0017] Difficulty in solving the above technical problems: There are many types of image features. When selecting features, it is necessary to take into account the differences in the angles of different features for visual content description, and also consider that there should be certain complementarity between features; different image features are heterogeneous to each other. The maximum typical correlation between them can be accurately found; it takes a lot of time to use the medical image pre-training neural network model, and the effect of a single deep learning model is not good (see the results in Table 9); the training of the deep learning model Relying on high-performance GPU servers, purchasing high-performance servers requires a lot of equipment costs; if the recognition model is trained based on lesion areas, it needs to obtain accurate labels first, and labeling lesion areas requires a lot of labor costs; the size of mammography images cannot be greatly reduced, which will Seriously affect the visual information in the image, and then interfere with the accurate recognition of the model

Images