The invention provides a large
language model vertical field multi-task objective question evaluation set automatic generation method, and relates to the technical field of
artificial intelligence, and the method comprises the steps: for each text in a
vertical field plain text data set, according to a plurality of preset task types, calling a
problem solver to carry out task suitability discrimination on the text, and obtaining a task suitability discrimination result; when the judgment result is appropriate, generating at least one initial objective question stem of the task type; performing
ambiguity detection on the initial objective question stem, and calling a question
solver to rewrite the ambiguous initial objective question stem to obtain a rewritten objective question stem; and finally, calling a question
solver to generate corresponding objective question options, objective question answers and objective
question answer analyses for each rewritten objective question stem, and taking the objective question options, objective question answers and objective
question answer analyses as an objective question evaluation set of a corresponding task type. By means of the method and device, the problems that in the prior art, time and labor are consumed in the
large model evaluation dataset construction process, and automatic generation of the evaluation dataset in the specific
vertical field cannot be achieved are solved.