Corpus detection method and device based on mask language model, equipment and medium

Abstract

The invention relates to artificial intelligence, and particularly discloses a corpus detection method, device and equipment based on a mask language model and a medium, and the method comprises the steps: inputting a to-be-trained corpus word into a generator for training, and obtaining the probability distribution corresponding to the corpus word; inputting the probability distribution into thediscriminator for training to obtain a prediction result corresponding to the probability distribution, wherein the prediction result includes a result of whether the corpus word is replaced or not, and the prediction result is stored in a blockchain node; inputting a classification label into the discriminator according to the category of the corpus word, and adjusting the prediction result basedon the classification label and the corpus word through the discriminator to obtain a context vector; and detecting the state of the corpus word to be trained according to the context vector. The model training efficiency is effectively improved, and the abnormal condition of the log file can be efficiently and accurately judged.

Description

technical field [0001] The present application relates to the technical field of intelligent decision-making, and in particular to a masked language model-based corpus detection method, device, computer equipment and media. Background technique [0002] In text processing, anomaly detection of log files plays an important role in the management of modern large-scale distributed systems, and it is widely used in logs that record system runtime information. Currently, operation and maintenance personnel usually use keyword search and rule matching to check and match logs. However, as the workload and business requirements increase, the time required for manual inspection also increases accordingly, making it more time-consuming and labor-intensive. In order to reduce the manual workload and at the same time improve the accuracy of the current detection, the application of log anomaly detection methods based on deep learning in the direction of anomaly detection is gradually i...

AI Technical Summary

Problems solved by technology

[0003] The current popular text processing model is based on the mask pre-training language model, but due to its high requirements for computing resources, the training cost and running time limit the modification and training of the model.

Images