The invention relates to the
artificial intelligence technology, can be applied to
service system platforms such as
medical health and financial science and technology, and discloses a
data processing method, device, equipment and medium based on a
hybrid expert model.The method comprises the steps that to-be-processed data is input into the
hybrid expert model, routing probability distribution is obtained, the Tsallis entropy of the routing probability distribution is calculated, and the Tsallis entropy of the routing probability distribution is calculated; generating a prediction result according to the Tsallis entropy; evaluating loss based on an auxiliary entropy
loss function, constructing a subspace, and adjusting pre-training parameters in the subspace to obtain an optimized
hybrid expert model; and obtaining a target prediction result according to the optimized hybrid expert model. According to the dynamic routing mechanism, experts are flexibly selected, an entropy
loss function is assisted to optimize a
routing decision, uncertainty is reduced, and model convergence is accelerated; and interference of new tasks on old tasks is eliminated through re-parameterization and subspace design, so that the model achieves good balance between stability and
plasticity, and generalization and adaptability of model
data processing are improved.