Text matching model training method and device, equipment and storage medium

A technology of matching models and training methods, applied in the computer field, can solve problems such as poor text matching effect, and achieve the effect of improving context understanding ability

Active Publication Date: 2021-10-29
MASHANG CONSUMER FINANCE CO LTD
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the above method performs text matching by calculating the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text matching model training method and device, equipment and storage medium
  • Text matching model training method and device, equipment and storage medium
  • Text matching model training method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0068] First, some technical terms involved in this application are explained:

[0069] Bidirectional Encoder Representations from Transformers (BERT) model, which is a bidirectional Transformer encoder model, is usually divided into two stages when used: (1) pre-training stage, that is, pre-training language model; ( 2) Fine-tuning stage, that is, f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a text matching model training method and device, equipment and a storage medium, and the method comprises the steps: obtaining a plurality of first sample pairs, each first sample pair comprises two texts and a matching result of the two texts, carrying out the mask processing of entity nouns and/or verbs contained in the texts in each first sample pair, obtaining corresponding second sample pair, performing iteration pre-training on the initial text matching model based on the second sample pair to obtain a pre-trained text matching model, obtaining a plurality of third sample pairs corresponding to the preset business scene, wherein each third sample pair comprises two texts and a matching result of the two texts, based on the third sample pairs, performing iterative fine tuning training on the pre-trained text matching model to obtain a text matching model corresponding to the preset business scene. According to the invention, text matching can be carried out more accurately.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a text matching model training method, device, equipment and storage medium. Background technique [0002] With the development of Internet technology, the intelligent dialogue system can carry out semantic recognition of user input information, determine the user's dialogue intention, and has a wide range of applications in e-commerce, smart devices, etc. Frequently Asked Questions (FAQ) dialogue system is a method commonly used in intelligent customer service. After customers enter the questions they want to inquire on the intelligent dialogue system, the intelligent dialogue system will automatically identify the semantic information of the text and return the answer. In this process, the text matching method used by the intelligent dialogue system is a key part that affects the accuracy of the entire dialogue system. [0003] At present, in the intelligent dialog...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/33G06F16/332G06F40/295G06F40/30G06K9/62
CPCG06F16/3344G06F16/3329G06F40/30G06F40/295G06F18/214
Inventor 李长林王洪斌蒋宁吴海英席泽西
Owner MASHANG CONSUMER FINANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products