The invention discloses a large
language model zero-order
fine tuning method and
system based on low-rank projection matrix learning, and belongs to the technical field of model
fine tuning, and the method comprises the steps: during low-rank projection matrix learning, freezing large
language model parameters to be used for
text processing, utilizing small-
batch training sample data, updating a low-rank projection matrix through zero-order optimization, and carrying out zero-order
fine tuning on the low-rank projection matrix; the low-rank projection matrix can be multiplied with the low-dimensional
random matrix when the
model parameters are updated, disturbance with the same dimension as the
model parameters is constructed, and the disturbance direction in a low-rank disturbance space formed by the low-rank projection matrix can be close to the descending direction of the
loss function by adjusting the low-rank disturbance space; and constructing a low-rank disturbance matrix by utilizing the low-rank projection matrix obtained by learning when
model parameters are updated, and performing zero-order
gradient estimation and updating on the model parameters of the large
language model by combining all training sample data. Therefore, the
text processing capability of the large language model is improved while the optimization efficiency in the high-dimensional parameter space is improved and the gradient variance is reduced.