Negative sample mining method, device, electronic equipment and storage medium

A negative sample and sample technology, which is applied in the fields of negative sample mining methods, devices, electronic equipment and storage media, to achieve automatic mining, improve data utilization, and improve model training effects

Active Publication Date: 2021-10-26
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

As for how to mine weak negative samples in this scenario, there is currently no better way to implement it.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Negative sample mining method, device, electronic equipment and storage medium
  • Negative sample mining method, device, electronic equipment and storage medium
  • Negative sample mining method, device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0026] In addition, it should be understood that the term "and / or" in this article is only an association relationship describing associated objects, which means that there may be three relationships, for example, A and / or B may mean: A exists alone, and A exists at the same time. and B, there are three cases of B alone. In addition, the character " / " in this articl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application discloses a negative sample mining method, device, electronic device and storage medium, and relates to the fields of artificial intelligence such as deep learning and natural language processing. The method may include: when using at least two graphics processors to perform multi-machine model training, Any graphics processor performs the following processing: in any training batch, each query in the training batch is regarded as a pending query; for each pending query, the other queries in the training batch except the pending query are respectively Each query and each query in the training batch corresponding to each graphics processor except itself are used as an associated query, and the sample corresponding to each associated query is used as a weak negative sample corresponding to the query to be processed, and the corresponding samples include positive samples and / or or strong negative samples. By applying the solution described in this application, the model training effect and data utilization rate can be improved.

Description

technical field [0001] This application relates to the field of artificial intelligence technology, and in particular to a negative sample mining method, device, electronic equipment and storage medium in the field of deep learning and natural language processing. Background technique [0002] Negative sample mining (or called negative example mining) is the core problem of deep semantic matching. In the search business, the semantic matching problem can be regarded as a sorting task, corresponding to a given query (query), it is hoped that through the calculation of the semantic matching model, the higher the score of the relevant document (Document), that is, the positive sample, the higher the ranking. On the contrary, it is hoped that the score of irrelevant documents, that is, negative samples, will be lower, and the ranking will be lower. Therefore, in the training of the semantic matching model, negative samples will inevitably be used. [0003] Usually, the document...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62G06N20/00
CPCG06N20/00G06F18/214
Inventor 陈徐屹卢宇翔冯仕堃
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap