The invention discloses an automatic large
language model selection method based on multi-dimensional evaluation and dynamic
weight adjustment, and aims to solve the problems of low
text generation quality, inaccurate dialogue
questions and answers, low online assistant
task completion rate and the like in an existing large
language model by introducing a multi-dimensional evaluation mechanism. According to the method, a plurality of evaluation dimensions such as ROUGE index evaluation, text quality evaluation,
semantic similarity evaluation, safety compliance evaluation, front suitability evaluation, question and answer evaluation, dialogue evaluation, online customer service evaluation and online assistant evaluation are comprehensively considered, the performance of the large
language model is comprehensively evaluated, and through analysis of operation data and
user feedback, the evaluation accuracy of the large language model is improved. And dynamically adjusting the weight of each evaluation dimension to adapt to continuously changing application requirements and
user expectations. And finally, according to the comprehensive
score, an optimal large language model is automatically selected, and high quality and
user satisfaction of Web services are ensured.