The invention discloses a test
system and method for generating capability evaluation based on a
large model, and the method comprises the steps: S1, carrying out
threat modeling, and generating a
test case, including classifying a
threat scene and generating an automatic
test case, the generation content of the
test case including generation of an adversarial sample and generation of a privacy test case; s2, a multi-dimensional test is executed, the multi-dimensional test comprises a dynamic test engine and real-time defense detection, and test indexes of the dynamic test engine comprise a sensitive
information leakage rate, a malicious instruction execution rate and a prejudice index; s3, performing
vulnerability diagnosis, including analyzing attention weight and tracing privacy leakage; and S4, performing
verification and iterative repair, including collecting
vulnerability samples, performing mixed training, adjusting a
loss function and performing
regression testing. Through
threat modeling and
attack scene classification, various potential attacks can be identified and covered, test comprehensiveness is ensured, neglected potential safety hazards can be found, and test effectiveness is improved.