Traditional Chinese medicine tongue image tooth mark automatic detection method based on convolutional neural network multi-scale feature fusion

Abstract

The invention discloses a traditional Chinese medicine tongue image tooth mark automatic detection method based on convolutional neural network multi-scale feature fusion. The method comprises steps: using convolutional neural network VGG16 as a basic network to extract features; providing a multi-scale feature fusion module and a feature enhancement module which are respectively used for fusing different scale features of the convolutional neural network and enhancing the fused features to form four detection layers; and finally, respectively carrying out tooth mark detection on the four detection layers by adopting an SSD method, and fusing all detection results by adopting a non-maximum suppression method to obtain a final tooth mark detection result. The method can improve the feature expression capability of each detection layer, achieves the automatic and accurate detection of the tooth marks in the traditional Chinese medicine tongue image, has obvious advantages in the detection precision compared with a traditional method, and can meet the actual application demands. According to the invention, the complexity of a network model is greatly reduced. The method has obvious advantages in detection precision, and can meet actual application requirements.

Description

technical field [0001] The invention belongs to the field of computer vision and TCM diagnostics, and specifically relates to technologies such as computer image processing, deep learning, and TCM tongue diagnosis. Background technique [0002] The automatic analysis of TCM tongue characteristics is the core content of the objectification of tongue diagnosis, and the accuracy of the analysis results determines the reliability of the follow-up treatment and the acceptance of TCM practitioners. According to the diagnosis principle of TCM, the changes in the characteristics of the tongue reflect the functional pathological changes of the viscera of the human body. Tooth marks are one of the important tongue features, mostly caused by qi deficiency, spleen deficiency or yang deficiency. Teeth-marked tongue is caused by the inability of the spleen to transport water and dampness, resulting in a fat tongue that is compressed by the teeth margins. It has great guiding significance...

AI Technical Summary

Problems solved by technology

However, unlike traditional target detection objects, the color of the tooth mark area of ​​the tongue image is similar to the color of the surrounding tongue body, and the tooth mark area also lacks clear semantic information. In order to achieve accurate detection of tooth marks, it is necessary to improve the expressive ability of depth features.

Images