Language model training method, device, phrase recommendation method and device

Abstract

The invention provides a language model training method, a device, a phrase recommendation method and a device.The language model training method comprises the steps of obtaining a historical input statement, wherein the historical input statement carries scene attribute information, and an association tag exists between two words in the historical input statement; inputting sample words in the historical input statement into the neural network model to obtain a first prediction result; based on the weight corresponding to the scene attribute information, performing weighting operation on the first prediction result to obtain a weighting result; according to the difference between the weighting result and the label information, adjusting the model parameters and the weight of the neural network model, and returning to execute the step of inputting the sample words in the historical input statement into the neural network model to obtain a first prediction result; and when a training stop condition is met, obtaining a trained language model. According to the scheme, personalized phrase recommendation can be carried out according to the input habits and input scenes of the user.

Description

technical field [0001] The present application relates to the technical field of phrase recommendation, in particular to a language model training method. The present application also relates to a phrase recommendation method, a language model training device, a phrase recommendation device, a computing device, and a computer-readable storage medium. Background technique [0002] With the continuous development of computer technology and network technology, the application of computers in people's life and work is becoming more and more common. In the process of using a computer, it is inevitable to use the input method. In order to improve the efficiency and convenience of using a computer to input text, input method application programs generally provide a phrase recommendation function. Specifically, the phrase recommendation function refers to recommending related phrases of the word according to the input word. Associated phrase "sun". [0003] In related technologi...

AI Technical Summary

Problems solved by technology

[0004] However, the above-mentioned co-occurrence probability is a fixed value obtained by pre-statistics. Therefore, any input requirements are recommended according to the same fixed co-occurrence probability, which leads to the problem of insufficient personalization of the phrase recommendation.

Images