Data processing method and device and computer equipment

Abstract

The embodiment of the invention discloses a data processing method and device and computer equipment. The method comprises the steps: obtaining question and answer pair data which comprises a plurality of pieces of first type text data and second type text data corresponding to each piece of first type text data; clustering multiple pieces of first type text data to obtain at least one question and answer pair set comprising at least one piece of first type text data and corresponding second type text data; clustering the second type of text data included in each question and answer pair set to obtain a candidate data set corresponding to each question and answer pair set, the candidate data set comprising at least one second type of text data; and determining a target question and answer pair set based on each question and answer pair set and the corresponding candidate data set. By adopting the scheme, corpus data can be automatically processed, a reference question and answer corpus is efficiently generated, the method is not limited by the magnitude of the corpus data, and the universality is high.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a data processing method, device and computer equipment. Background technique [0002] With the development of artificial intelligence, the application of intelligent machine customer service is becoming more and more extensive, especially in various B2B (Business to Business, that is, the mode of transactions between enterprises to enterprises through the network) or B2C (Business-to-Consumer , that is, transactions between enterprises and consumers), machine customer service can replace human customer service to communicate with users and answer common questions. Usually, a human-machine dialogue corpus needs to be built in advance to ensure the accuracy of the machine customer service answering questions. Among them, there are two ways to use human customer service corpus to generate man-machine dialogue corpus: one is to manually mark common questions in sequence...

AI Technical Summary

Problems solved by technology

[0003] However, the above-mentioned first method relies on manual search for similar questions and answers to frequent questions, and the efficiency of generating a man-machine dialogue corpus is low. The second method requires a large amount of artificial customer service corpus to train the generation model, and for some subdivided fields , the artificial customer service corpus is less, and the effect of using this method to generate a man-machine dialogue corpus may not be good

Images