Language model training method, device, phrase recommendation method and device

A language model and training method technology, applied in the field of phrase recommendation, can solve the problems of insufficient personalization of phrase recommendation

Pending Publication Date: 2021-11-05
BEIJING KINGSOFT DIGITAL ENTERTAINMENT CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the above-mentioned co-occurrence probability is a fixed value obtained by pre-statistics. Therefore, any input requirements are recom

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Language model training method, device, phrase recommendation method and device
  • Language model training method, device, phrase recommendation method and device
  • Language model training method, device, phrase recommendation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the application. However, the present application can be implemented in many other ways different from those described here, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

[0040] Terms used in one or more embodiments of the present application are for the purpose of describing specific embodiments only, and are not intended to limit the one or more embodiments of the present application. As used in one or more embodiments of this application and the appended claims, the singular forms "a", "the", and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a language model training method, a device, a phrase recommendation method and a device.The language model training method comprises the steps of obtaining a historical input statement, wherein the historical input statement carries scene attribute information, and an association tag exists between two words in the historical input statement; inputting sample words in the historical input statement into the neural network model to obtain a first prediction result; based on the weight corresponding to the scene attribute information, performing weighting operation on the first prediction result to obtain a weighting result; according to the difference between the weighting result and the label information, adjusting the model parameters and the weight of the neural network model, and returning to execute the step of inputting the sample words in the historical input statement into the neural network model to obtain a first prediction result; and when a training stop condition is met, obtaining a trained language model. According to the scheme, personalized phrase recommendation can be carried out according to the input habits and input scenes of the user.

Description

technical field [0001] The present application relates to the technical field of phrase recommendation, in particular to a language model training method. The present application also relates to a phrase recommendation method, a language model training device, a phrase recommendation device, a computing device, and a computer-readable storage medium. Background technique [0002] With the continuous development of computer technology and network technology, the application of computers in people's life and work is becoming more and more common. In the process of using a computer, it is inevitable to use the input method. In order to improve the efficiency and convenience of using a computer to input text, input method application programs generally provide a phrase recommendation function. Specifically, the phrase recommendation function refers to recommending related phrases of the word according to the input word. Associated phrase "sun". [0003] In related technologi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08
CPCG06N3/08
Inventor 吴伟彤李长亮郭馨泽
Owner BEIJING KINGSOFT DIGITAL ENTERTAINMENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap