The application provides a kind of
clinical research test abstract key word intelligent extraction method based on
large model, it is related to
data analysis technical field.Adopt parameter inheritance
system strategy training network, introduce load balancing loss optimization MoE model.Structured feature embedding is integrated on the basis vector to obtain the input vector, input
large model to obtain token level context representation and test level backbone feature, combine task prompt vector input MoE model to obtain test level enhanced feature, respectively input multi-field classification head and multi-
label output head to obtain field probability distribution and key word activation probability;Joint dynamic threshold, and then get structured field and key word set.Using the
parallel design of pre-trained
large model and MoE model and multi-field classification head and multi-
label output head ensures the comprehensiveness and accuracy of information.Overcome the problems such
as element loss, unstable generalization ability and poor robustness when
processing clinical research abstracts in the prior art.