The invention discloses an open vocabulary instance segmentation method based on image title alignment and generation. An open vocabulary instance segmentation model based on image title alignment and generation is established; a
loss function of model training comprises image title alignment loss and image title
generation loss; in the image title alignment loss, only using a
noun representing an object as an alignment object; according to the image title
generation loss, a training mode based on an image title generation task is adopted, an image title predicted by a model is compared with a
real image title, and then the loss is calculated; generating a
mask of the object according to the potential features of the object; predicting the object category according to the potential features of the object and the similarity of the category vocabularies; and the
mask and the prediction category are combined to form an instance segmentation result, namely, open vocabulary instance segmentation based on image title alignment and generation is realized. The method can improve the segmentation accuracy, is simple and efficient, and is convenient to reproduce.