Provided in the present application are a large-model training method, apparatus and device, and a storage medium. A
large model comprises an adaptor header, a model main body and an adaptor
tail, wherein the adaptor header comprises a first cloud part and a first local part, and the adaptor
tail comprises a second cloud part and a second local part; and during the process of training the
large model, the first cloud part, the model main body and the second cloud part are deployed on the cloud, and the first local part and the second local part are deployed on a local
client. In the method, only the adaptor header and the adaptor
tail are distributed to the cloud and the
client, encrypted
client data is used to perform model training for an adaptor part, the majority of the structure of the model remains on the cloud, and
cloud computing power is used to perform training and
inference, thereby ensuring the computing
power performance; in addition, an adaptor fine-tuning mechanism is effectively used, thereby realizing effective training of the
large model while securely and fully utilizing the computing power.