The invention discloses a method, device and
system for executing AI
training simulation in batches, the
system for executing AI
training simulation in batches comprises a
system simulator, a built-in communication simulator and a cross-
machine network simulator, the system simulator is used for controlling and scheduling the AI
training simulation process, and the built-in communication simulator is used for controlling and scheduling the AI training
simulation process. The built-in communication simulator is used for carrying out
collective communication operation in the
server between the GPUs, and the cross-
machine network simulator is used for registering a plurality of point-to-point cross-
network communication in the system simulator. According to the method, the process synchronization overhead is reduced, the
cache hit rate is increased, cross-experiment
batch processing and parallelization opportunities neglected by an existing method can be fully utilized, the system can
package data in a mode of uniformly
processing the steps of the
simulation process so as to obtain the advantages of parallelism and cache efficiency, and during the system execution period, the system can be quickly executed. And the adjacent threads of the continuous entities in the
processing table keep consistent access to the component data, so that the
advantage of cache efficiency is brought.