Text processing model training method and text processing method and device

A technology for text processing and training methods, applied in neural learning methods, electrical digital data processing, natural language data processing, etc. The effect of smooth, high quality and improved accuracy
CN112487182APending Publication Date: 2021-03-12HUAWEI TECH CO LTD
6 Cites 17 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
HUAWEI TECH CO LTD
Publication Date
2021-03-12

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a text processing model training method, a text method and a device in the field of natural language processing in the field of artificial intelligence. The training method comprises the steps of obtaining a training text; respectively inputting the training text into a teacher model and a student model to obtain sample data output by the teacher model and prediction data output by the student model, the teacher model and the student model respectively comprising an input layer, one or more intermediate layers and an output layer, wherein the sample data comprises sample semantic features output by a middle layer of the teacher model and sample labels output by an output layer, and the prediction data comprises prediction semantic features output by the middle layerof the student model and prediction labels output by the output layer; and training model parameters of the student model based on the sample data and the prediction data to obtain a target student model. According to the technical scheme, knowledge migration is effectively carried out on the student model, so that the accuracy of the text processing result of the student model is improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present application relates to the field of natural language processing, and more specifically, to a text processing model training method, text processing method and device. Background technique

[0002] Artificial intelligence (AI) is a theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is the branch of computer science that attempts to understand the nature of intelligence and produce a new class of intelligent machines that respond in ways similar to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines, so that the machines have the functions of perception, reasoning and decision-making.

[0003] With the continuo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More