The invention discloses a method for improving the model
picture recognition capability based on a multi-
modal large model, and relates to the technical field of image recognition, and the method comprises the steps: building an infrastructure of the multi-
modal large model, and training the multi-
modal large model as a basic model through a large number of pictures; newly added images are collected, and corresponding standard
questions and answers describing picture contents are prepared in combination with the images; and according to a
picture recognition task requirement, designing a corresponding instruction, namely a cue word, and guiding the large model to carry out
picture recognition. The multi-modal large model is trained by using massive pictures, the accuracy of a picture recognition technology can be optimized by fully utilizing a picture feature
library of the multi-modal large model when the multi-modal large model is applied to the field of picture recognition, and the magnitude order of training pictures can be greatly reduced by using
fine tuning training of the multi-modal large model, so that the accuracy of the picture recognition technology is improved. After composite
fine tuning training is carried out, the multi-modal large model can have the recognition capability of generalizing trained pictures, and the number of pictures needing to be used for training can be greatly reduced.