The invention discloses a recalculation
perception model splitting method and
system oriented to
assembly line parallel training, and belongs to the field of
artificial intelligence of
computer science. The method specifically comprises the steps that a dijkstra
algorithm and two-layer binary search are used, and the minimum value of the sum of
forward propagation time and reverse
propagation time of
assembly line microbatch under re-calculation
perception model splitting is calculated; and an intermediate result obtained by a dijkstra
algorithm in a search process is used to calculate and output an approximately optimal model splitting strategy for re-calculation
perception. According to the method, the model splitting method and
system are designed by utilizing the model characteristics of a Tasformer
large model and the characteristics of an
assembly line parallel mode, the model is non-uniformly split to each stage of the
assembly line, so that the calculation load of each stage of the
assembly line is balanced when re-calculation is started, and the calculation efficiency is improved. Therefore, the overall performance of
large model pipeline parallel training and the utilization efficiency of cluster equipment are improved.