This application discloses a method, apparatus, and electronic device for fine-tuning a
large model based on
hybrid experts, belonging to the field of
artificial intelligence technology. It addresses the problem that current
large model technologies struggle to meet the application needs of multi-task scenarios in
network management. The method includes: initializing a
hybrid expert network for a pre-trained
large model, the
hybrid expert network comprising a task-level gating network and multiple task-level expert groups (each group containing a character-level gating network and multiple character-level experts), the hybrid expert network being embedded in specific
layers of the pre-trained large model; inputting training data and a first prompt word into the pre-trained large model, guiding the pre-trained large model to output sample prediction results through the first prompt word; determining the loss result of the pre-trained large model based on the true
label results corresponding to the training data, the sample prediction results, and the target
loss function; and fine-tuning the network parameters of specific
layers of the pre-trained large model based on the loss result to obtain a
network management model for multi-task scenarios.