This invention provides an scalable AI
attack benchmark testing method and
system. A model conversion module transforms the tested model according to its type and framework, obtaining a converted model that matches the
attack framework. The dataset attacks the converted model, yielding a test result. The
attack framework invokes various attack algorithms with a standardized format, generates corresponding attack scripts, and then performs several attacks on the converted model, resulting in
multiple attack results. When testing the next tested model, the model conversion module again transforms its framework according to its type before launching the attack. The advantages are: it can flexibly convert for different AI models, attacking the converted model to obtain attack results, without needing to rebuild test modules for different AI models, improving attack efficiency, reducing testing costs, and solving the problem of existing testing methods (frameworks) being limited by the tested model and language.