The invention discloses a
traditional Chinese medicine tongue diagnosis intelligent
analysis method based on a visual
language model, and belongs to the cross technical field of
artificial intelligence and
traditional Chinese medicine diagnosis. According to the method, firstly, a high-quality tongue picture-tongue diagnosis structured description
data set is constructed, a mode of 'GPT automatic labeling +
traditional Chinese medicine expert auditing' is introduced, the manual labeling cost is remarkably reduced, and the
data consistency is improved. On the basis, a Qwen-VL-based traditional Chinese
medicine tongue diagnosis visual
large model framework is provided, unified modeling of tongue picture understanding and tongue diagnosis generation is realized, and a structured
JSON result containing indexes such as tongue color and
tongue coating color and corresponding
natural language description can be automatically generated according to a tongue picture image. Besides, a knowledge guide
fine tuning mechanism is designed, and tongue diagnosis knowledge prompt is injected in a model
fine tuning stage, so that the model is constrained by traditional Chinese
medicine knowledge in the semantic recognition and
generation process of the
tongue body, the
tongue coating and the like, and the accuracy of tongue diagnosis feature understanding and the consistency of generation are improved. According to the method, objective, standardized and intelligent development of tongue diagnosis is remarkably promoted.