The invention discloses an AI (
artificial intelligence) model training-oriented automatic elastic computing
power capacity expansion and
contraction method and an AI model training-oriented automatic elastic computing
power capacity expansion and contraction
system. According to the method, training indexes and overall
resource use information are collected, a resource demand curve is generated in combination with a lightweight prediction model, and whether capacity expansion and shrinkage are needed is judged based on a resource mapping matching degree
score. And when it is detected that the resources are insufficient or over-matched, the
system sequentially executes actions such as training fine adjustment, structured
slicing, transverse expansion and contraction, topological adjustment and task-level arrangement so as to realize on-demand dynamic adjustment of the resources. The corresponding
system comprises a
training performance acquisition module, a resource monitoring module, an
elastic scheduling strategy module, a resource control execution module and a training
task management module, resource application or release can be completed under the condition that training is not interrupted, and the consistency of the training process is guaranteed. Compared with a traditional fixed allocation scheme, the
resource utilization rate can be remarkably increased, the
training time can be shortened, resource abnormity alarms can be reduced, and a user can obtain an efficient and low-cost training process without manual intervention.