The invention provides a test method and
system for a mathematical character question
solver, and the
system comprises a data preprocessing module which is used for integrating a multi-source mathematical character question
data set, carrying out the standardized
processing and marking of questions in the mathematical character question
data set, and outputting a data instance with a unified
data structure; the
solver module is used for decomposing a solving
algorithm into different basic function components as
algorithm components, calling related
algorithm components to form a corresponding
solver according to a logic sequence of a to-be-tested solving algorithm, and solving a mathematical problem by using the solver based on an input data instance to generate a solving answer; and the perspective
confusion comparison module is used for receiving the solving answer and comprehensively evaluating a solver corresponding to the algorithm to be measured through three dimensions of question type classification, key question solving steps and an algorithm component. According to the invention, multi-
source data sets can be integrated, automatic and reproducible test workflows are provided, and fine-grained and multi-dimensional performance tests are supported.