The application relates to a GPU progressive optimization method for neural operator
backbone network reasoning and belongs to the
electronic information technical field.The method comprises the following steps: step S1, initializing constraints and tolerances;step S2, obtaining baseline
execution time and reference results through baseline measurement;step S3, obtaining an estimated split value based on a
working set model and expanding;step S4, performing KSweep evaluation and consistency checking, and preferably obtaining; a process of scanning and measuring each candidate set is called KSweep; step S5, fixing, adding fusion reasoning optimization, and performing consistency
verification, if the consistency
verification is passed, outputting and saving the optimal configuration, and directly loading and executing in the running stage; otherwise,
backtracking or adjusting and recalibrating, and returning to step S3. The application shortens the reuse distance between adjacent
layers, reduces the round-trip overhead of intermediate activation between the
video memory and the cache, and thus improves the reasoning efficiency.