The invention relates to a multisource pavement
disease identification method based on a language and an image
large model, and the method comprises the following steps: collecting related standards of road pavement
disease detection, building a knowledge corpus, and reading a road
disease image through a large
language model LLM; when it is determined by the LLM that the crack crosses the whole image,
cutting is carried out in the direction perpendicular to the crack by passing through the center point of the image, and the image is
cut into two images; afterwards, all images and corresponding text prompts are input, target detection is carried out on pavement diseases by using a visual language
large model VLM, and a prediction box is output; and performing fine adjustment on the SAM by using the image marked with the disease
mask to obtain the RoadSAM adapted to the road disease segmentation task. According to the method, a large
language model, a visual language
large model and a segmentation large model are combined, corresponding fine adjustment is carried out on the segmentation large model SAM, dependence on a large amount of
annotation data is reduced, and meanwhile unified segmentation of multi-source and multi-mode pavement disease images is achieved.