Semantic representation model processing method and device, electronic equipment and storage medium

A semantic representation and model technology, applied in the computer field, can solve the problems of limited semantic representation model capability, difficult to learn semantic representation model, and poor semantic representation accuracy, so as to enrich semantic representation capability, improve text input efficiency, and improve accuracy. Effect

Active Publication Date: 2020-01-21
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF5 Cites 34 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, current technologies such as BERT and XLNet have a single task goal during training, which makes it difficult for the semantic representation model trained by the existing technology to fully learn the various levels of information in the training corpus, which limits the ability of the existing semantic representation model. Semantic representation is less accurate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semantic representation model processing method and device, electronic equipment and storage medium
  • Semantic representation model processing method and device, electronic equipment and storage medium
  • Semantic representation model processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0067] figure 1 It is a schematic diagram of the first embodiment of the present application. Such as figure 1 As shown, the flow chart of the embodiment of the processing method of the semantic representation model of the present application is introduced in detail. Such as figure 1 As shown, the processing method of the semantic representation model in this emb...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a semantic representation model processing method, a semantic representation model processing device, electronic equipment and a storage medium, and relates to the technical field of artificial intelligence. According to the specific implementation scheme, a training corpus set comprising a plurality of training corpuses is collected; and training a semantic representationmodel based on at least one of word segments, sentences and articles by adopting the training corpus set. According to the method and the apparatus, the unsupervised or weakly supervised pre-trainingtasks of three different levels of word segments, sentences and articles are constructed, so that the semantic representation model can learn knowledge of different levels of the word segments, the sentences and the articles from mass data, the capability of general semantic representation is enhanced, and the processing effect of the NLP task is improved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to artificial intelligence technology, and in particular to a processing method, device, electronic equipment and storage medium for a semantic representation model. Background technique [0002] Artificial Intelligence (AI) is a new technical science that studies and develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence. Artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a manner similar to human intelligence. Research in this field includes robotics, language recognition, image recognition, Natural Language Processing (NaturalLanguage Processing; NLP) and expert systems, etc. Especially in the field of NLP, it has become a hot direction of AI research in recent years. [0003] In t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/30
CPCG06F40/30G06F40/268G06F40/253G06F40/279G06N20/00G06F40/40
Inventor 孙宇王海峰王硕寰李宇琨冯仕堃田浩吴华
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap