The invention discloses a short text clustering method and device based on a large
language model, and belongs to the technical field of
natural language processing, and the method comprises the steps: converting a short text into vector representation, and carrying out the preliminary clustering of the vector representation through a clustering
algorithm, and obtaining an initial category; for all the corresponding short texts in each initial category, generating an abstract by using a large
language model, generating a plurality of theme titles for summarizing the core meanings of the texts according to the abstract, respectively taking the theme titles as sub-titles, inputting the plurality of sub-titles into the large
language model, and carrying out theme combination to obtain a parent title, constructing the parent title and the child titles into a hierarchical theme
system; the large language model allocates to-be-classified short texts to one or more categories according to the hierarchical topic
system to complete short text clustering; and performing quality evaluation and error
pattern analysis on a short text clustering result to optimize a clustering
algorithm and a large language model. According to the method, the theme of the short text can be automatically found and classified, and the classification accuracy and efficiency are improved.