Automatic question-answering method based on deep learning

Abstract

The invention discloses an automatic question-answering method based on deep learning, and aims to provide an algorithm-based fully-automatic question-answering scheme for a user. According to the method, question and answer pairs crawled from websites are used as data sources, and questions with more complicated forms can be answered. According to the method, on the basis of traditional similar-question retrieval, a BOW model, a TFIDF model and a Word2Vec model are utilized to represent text contents of questions as vectors, similar questions are resorted and screened out through calculatingsimilarity between vectors, semantic knowledge can be introduced, the semantic gulf problem in traditional question retrieval processes can be solved, and validity of candidate answers can be improved. In addition, based on deep learning, the method utilizes a neural network model, which is obtained by training, for matching scoring on a question and the candidate answers, and can automatically extract high-layer matching features between the question and the answers, automatically give an answer of the question, improve accuracy of an automatic question-answering system, reduce manual intervention at the same time, and reduce system development costs.

Description

technical field [0001] The invention relates to the fields of information retrieval, text representation method, text similarity calculation, and automatic question answering in the field of natural language processing, and specifically relates to an automatic question answering method based on deep learning. Background technique [0002] With the rapid development of the Internet, a large number of electronic documents appear on the Internet. When users are looking for an answer to a question, traditional information retrieval cannot directly give the answer, but can only give thousands of webpage links, so it can automatically The automatic question answering technology that gives the best answer is getting more and more attention. The research on automatic question answering methods is mainly divided into template matching methods, information retrieval methods and deep learning methods. [0003] The method based on template matching needs to manually write a large numbe...

AI Technical Summary

Problems solved by technology

In question retrieval, similarity calculation methods such as BM25 and TFIDF based on character coincidence are most commonly used, but there is a semantic gap problem, and the semantics of the text cannot be truly understood

Images