Informative text filter method and system

A text filtering and text technology, applied in the field of information services, can solve problems such as difficulty in ensuring recognition accuracy and real-time updating of classifiers, and achieve the effect of rapid adaptive learning, improving practicability and recognition accuracy

Active Publication Date: 2014-12-17
CHINA TELECOM CORP LTD
View PDF5 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in reality, the existing content filtering devices are difficult to quickly and effectively build a training sample library, and cannot quickly converge adaptive learning in

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Informative text filter method and system
  • Informative text filter method and system
  • Informative text filter method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] The technical solutions of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments.

[0071] Such as figure 1 As shown, it is a schematic flowchart of an embodiment of the information text filtering method of the present invention. In this embodiment, the information text filtering method includes:

[0072] Step 101. Preprocessing the information text to be reviewed to obtain a plurality of words corresponding to the information text to be reviewed;

[0073] Step 102, calling the semantic expansion parameter table, and mapping the information text to be reviewed from the word space to the determined subject space according to the plurality of words and the semantic expansion parameter table;

[0074] Step 103, transfer classifier parameters, perform statistical semantic analysis on the information text to be reviewed according to the classifier parameters, give the category label corresponding to the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an informative text filter method and system. The informative text filter method comprises the steps that informative text to be audited is preprocessed, and multiple corresponding terms are obtained; a semantic extension parameter table is called in, and the informative text to be audited is mapped to a determined theme space from a term space according to the terms and the semantic extension parameter table; classifier parameters are called in, statistical semantic analysis is conducted on the informative text to be audited according to the classifier parameters, and corresponding classification labels are given and stored into a training sample library. According to the informative text filter method and system, the classification labels corresponding to the informative text to be audited can be obtained by conducting preprocessing, mapping to the theme space from the term space and statistical semantic analysis on the informative text to be audited, the classification labels are stored into the training sample library together with the informative text to be audited after being obtained, an audited training set is automatically expanded, fast self-adaptive learning of training samples is achieved, and thus the practicability and the recognition accuracy of informative text filter are improved.

Description

technical field [0001] The invention relates to the field of information services, in particular to an information text filtering method and system. Background technique [0002] With the rapid development of the mobile Internet, convenient information services have profoundly changed the way people live and work. On the other hand, due to the huge influence of information services, the resulting content security issues cannot be ignored. [0003] With the rise and maturity of content filtering technology based on statistical pattern recognition methods, high-precision filtering has become a reality, and its premise is the supervised learning of a large number of training samples. Due to the dynamic changing characteristics of human natural language, it is of great significance to quickly construct a training sample library and implement fast adaptive learning for misjudged samples to improve the practical application value of content filtering devices. [0004] However, i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F17/27
CPCG06F16/335G06F40/30
Inventor 刘东鑫刘国荣沈军
Owner CHINA TELECOM CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap