A Chinese question mapping method based on lda

A mapping method and problem technology, applied in the field of computer software, can solve the problems of dependence accuracy, large classification accuracy, errors, etc., and achieve the effect of reasonable design and improved accuracy

Active Publication Date: 2021-03-02
识因智能科技(北京)有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Now the machine learning method based on statistics occupies a dominant position. The more representative one is to use the SVM (Support Vector Machine) algorithm to classify problems. The analysis determines that using this method to classify Chinese questions will bring a large error

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Chinese question mapping method based on lda
  • A Chinese question mapping method based on lda
  • A Chinese question mapping method based on lda

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039]The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0040] see figure 1 , a method for mapping Chinese questions based on LDA, including the following steps:

[0041] Step A, first use the LDA topic model to train the document library D, and the document d can be obtained t theme z j ,z j ∈T, T={z 1 ,...,z 2 ,z k} and its distribution p(z j │d t ), and you can also get the topic z j the term w r ,w r ∈v, v={w 1 ,...,w 2 ,w r} and its distribution p(z j │w r ), by the definition of conditional pro...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an LDA-based Chinese question mapping method, which includes using the LDA topic model to classify the document base, and then using the Softmax regression model to classify the part-of-speech of the question, and according to the difference of the part-of-speech classification, the weight of the content word is higher than that of the function word High, but the weights of different parts of speech in content words are not the same, and then use the syntactic analysis based on dependency grammar to find out the dependency relationship of words in the sentence, and give different weights according to the different components of words in the sentence, so the problem The weight of each word in is obtained by the product of two parts, and finally, according to Bayesian rules, the connection is established through the weighted distribution of words in the question and the distribution of topics and terms in the document. The topic model based on LDA classifies the documents, and at the same time, assigns different weights by referring to the part of speech of the terms in the question sentence and the components in the sentence, so as to improve the role of important terms in classification and improve the mapping of Chinese questions. accuracy.

Description

technical field [0001] The invention relates to a Chinese question mapping method, in particular to an LDA-based Chinese question mapping method, and belongs to the field of computer software. Background technique [0002] With the rapid development of Internet technology, search engines can provide people with various online information quickly and conveniently. Early search engines required users to submit keywords for query, and then the system returned to the user a list of web documents related to the query. Such limited keywords sometimes cannot fully express the user's query intention, and even not all users can accurately Give all kinds of keywords you want to query. Therefore, people urgently need a more efficient and convenient way to obtain information from the Internet. The question answering system was born under such a background. It allows users to ask questions in natural language and then directly returns accurate answers. [0003] Automatic question answe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/35G06F16/332
CPCG06F16/3329G06F16/35
Inventor 王春辉
Owner 识因智能科技(北京)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap