The invention relates to the technical field of
artificial intelligence, in particular to a field adaptive
large model fine tuning method and
system based on enterprise private data, and the method comprises the steps: extracting the feature representation of local data by each participating
client through a unified pre-training model, generating a prototype set representing local region category features by adopting a mean value, clustering or random sampling method;
gaussian random noise is added to the prototype set,
differential privacy protection is achieved, and then the prototype set is uploaded to a
server; the
server summarizes prototypes of all the clients, constructs a global prototype
training set, performs global training of a single communication round on the adapter module by using
supervised learning classification loss under the condition that similar prototypes of different clients are not averaged, obtains a global adapter model and issues the global adapter model to the clients; and the
client initializes a local model based on the global adapter model, performs
fine tuning by using a small amount of data with labels, and meanwhile, prevents catastrophic forgetting through knowledge
distillation constraint by taking the
global model as a teacher, so that balance between global knowledge retention and local
performance improvement is realized. According to the method, the problem that the expression of the model in a cross-domain reasoning task is remarkably reduced due to the fact that domain characteristics of different enterprises cannot be effectively aligned in the prior art can be solved.