Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Natural language processing model training method and natural language processing method and device

A natural language processing and modeling technology, applied in neural learning methods, biological neural network models, speech analysis, etc., to solve the problem that semantic understanding models do not have the ability to generate language

Active Publication Date: 2021-09-07
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, at present, research on language models for different tasks such as semantic understanding and language generation in the industry is generally carried out independently. Semantic understanding models do not have the ability to generate language, and vice versa.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural language processing model training method and natural language processing method and device
  • Natural language processing model training method and natural language processing method and device
  • Natural language processing model training method and natural language processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0025] In the technical solution of the present disclosure, the acquisition, storage and application of the user's personal information involved are in compliance with relevant laws and regulations, and do not violate public order and good customs.

[0026] The application of natural language processing models is becoming more and more extensive, and semantic understand...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a training method of a natural language processing model, and relates to the field of artificial intelligence, in particular to the field of natural language processing. According to the specific implementation scheme, the following steps are included: carrying out semantic learning aiming at multiple tasks on an input text, obtaining semantic features aiming at the multiple tasks, wherein the multiple tasks comprise multiple branch tasks; performing feature learning for each branch task based on the semantic features to obtain a first output result for each branch task; calculating loss for each branch task according to the first output result for each branch task; and adjusting parameters of the natural language processing model according to the loss of each branch task. The invention further provides a natural language processing model training device, a natural language processing method and device, electronic equipment and a storage medium.

Description

technical field [0001] The present disclosure relates to the technical field of artificial intelligence, in particular to natural language processing technology. More specifically, the present disclosure provides a natural language processing model training method and device thereof, a natural language processing method and device thereof, electronic equipment, and a storage medium. Background technique [0002] In recent years, with the continuous development of natural language processing technology, the pre-trained language model based on large-scale corpus has gradually become a classic framework. However, at present, research on language models for different tasks such as semantic understanding and language generation in the industry is generally carried out independently. Semantic understanding models do not have the ability to generate language, and vice versa. [0003] Therefore, how to make a model capable of both semantic understanding and language generation has ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F40/30G06N3/04G06N3/08
CPCG06F40/30G06N3/08G06N3/045G10L15/063G10L15/16G10L15/02G10L15/18
Inventor 丁思宇庞超王硕寰赵晏彬尚骏远孙宇冯仕堃田浩吴华王海峰
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com