The invention discloses an automatic calculation method and
system for a
technical support question answering system, and the method comprises the steps: constructing a large language evaluation model, and carrying out the matching
verification calculation of the accuracy of
key terms in answers through the key term completion of the large language evaluation model, so as to obtain a key term set which fails in matching; reconstructing operation steps in the reference answers according to the answers through a large language evaluation model, and calculating whether the answers contain
correctness and integrity of all the operation steps mentioned in the reference answers or not to obtain a step sequence
correctness calculation result and a step integrity calculation result; and obtaining a final calculation
score based on the key term set which fails in matching, a step sequence
correctness calculation result and a step integrity calculation result. According to the method, two technical means ClozeFact and StepRestore are adopted and used for evaluating the accuracy of the
key terms and the sequence and integrity of the operation steps respectively, and the defects of an existing evaluation method are overcome.