A method, device and equipment for constructing a military field knowledge extraction large model

Abstract

The application discloses a kind of military field knowledge extraction large model construction method, device and equipment, comprising: obtaining military field original text and pre-processing and marking, generate training sample;According to corresponding target complexity interval from training sample corresponding sample is screened, constitute the candidate training set of current training stage;Based on dynamic data matching strategy from candidate training set is sampled to construct training batch, to large language model is supervised fine-tuning;Knowledge extraction is carried out to input text using the model after supervision fine-tuning, obtain knowledge extraction result, calculate knowledge extraction result using composite reward function, obtain reward value;Based on reward value, the model parameter of model is reinforced learning optimization, and the performance of model is periodically evaluated;After judging the performance of model in current training stage reaches convergence condition, the model parameter of model is used as the initial parameter of next training stage and continues to iterate training, obtains military field knowledge extraction large model.

Images