The invention relates to a method for
accurate segmentation and registration of a multispectral tongue image, and belongs to the technical field of
image processing. Firstly, a multispectral camera is used for shooting
tongue body image data sets of a subject, a trained U-Net model is used for accurately segmenting each
tongue body image in each group of data sets, and
tongue body areas are extracted. Secondly, performing registration operation on the same group of tongue
body images according to the segmented contour feature points, and then
processing non-rigid deformation of fine textures in the tongue body by combining a dense
optical flow method and a multi-stage registration strategy; and finally, enhancing the number and distribution of the control points by introducing free
shape transformation (FFD) and an improved thin plate spline (TPS)
algorithm. Experimental results show that color information of each image is reserved, the registration effect of tongue texture details is remarkably improved, and a reliable data basis is provided for subsequent tongue diagnosis analysis and multi-spectral
information fusion.