Method for remotely supervising the noise reduction of retrieved data

A technology for retrieving data and remote supervision, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems that open domain question answering applications cannot achieve ideal results, achieve good practicability, improve stability, and improve The effect of the Q&A effect

Active Publication Date: 2018-12-21
TSINGHUA UNIV
View PDF8 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the above method of dividing answer generation into two modules can

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for remotely supervising the noise reduction of retrieved data
  • Method for remotely supervising the noise reduction of retrieved data
  • Method for remotely supervising the noise reduction of retrieved data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028]In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are the embodiment of the present invention. Some, but not all, embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0029] Aiming at the problems in the prior art that when performing open-domain question answering tasks, it is easy to be disturbed by noise, and the information of multiple retrieved paragraphs cannot be fully utilized, resulting in poor question answering effect, the embodiment of the present invention proposes a remote supervised retrieval data noise reduction metho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method for remotely supervise noise reduction of retrieved data includes calculating probability distributions of answers to a given question on each paragraph for a given question and a plurality of paragraph retrieved based on that given question, calculating the probability distributions of the answers to the given question on each paragraph, calculating the probability distributions of the answers to the given question on each paragraph; extracting at least one specific sub-string corresponding to the answer in the paragraph using a paragraph reader based on a given question and any paragraph, and calculating a probability of the specific sub-string being an answer to the paragraph as a first probability until all paragraphs are traversed; Selecting a corresponding paragraph to answer a given question based on the probability distribution and a first probability corresponding to a particular substring in all paragraphs; Where a particular substring is a word string consisting ofone or more words. The invention can more fully utilize all paragraphs in the retrieved related text which are helpful to answer the questions, thereby more effectively improving the question answering effect of the open domain question answering, improving the stability of the model, and having good practicability.

Description

technical field [0001] The present invention relates to the technical field of natural language processing and information extraction, and more specifically, to a noise reduction method for remote supervision and retrieval data. Background technique [0002] In recent years, reading comprehension of a given document and answering specific questions about the document has become a hotspot in natural language processing research. At present, many reading comprehension systems for natural language processing have been implemented, and these reading comprehension systems have achieved good results in many open source evaluations. The multi-level structure and selective attention mechanism of these system models make it possible to reason in documents for a given question. Thus, existing reading comprehension systems have demonstrated the capabilities of neural network models for reading, processing, and understanding natural language texts. [0003] Although existing reading c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 刘知远林衍凯计昊哲孙茂松
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap