Rubbish text recognition method and system

Abstract

The invention discloses a method and a system for recognizing spam texts, which comprises the following steps: extracting features of spam samples, confirming spam features from all the features of the spam samples according to the probability of the spam texts attribute to the texts including the features, endowing a spam weight for each spam feature and forming a spam feature database by all the spam features endowed with spam weights; matching pending texts with the spam features in the spam feature database, and judging whether the pending texts are spam texts according to the spam weights matched with all the spam features. The system comprises the spam feature database and a spam text recognizing device, wherein, the spam feature database is used for storing the spam features endowed with spam weights; and the spam text recognizing device is used for receiving the pending texts, matching the pending texts with the spam features in the spam feature database and judging whether the pending texts are spam texts according to the spam weights matched with all the spam features. Moreover, the invention can enhance the accuracy of recognizing spam texts.

Description

technical field [0001] The invention relates to the technical field of Internet information processing and pattern recognition, in particular to a method and system for recognizing junk text. Background technique [0002] In the Internet field, in order to provide Internet users with the information they need, information filtering is required. Information filtering means that the computer identifies the information that meets the user's needs from the dynamically changing information flow according to the template information that reflects the user's needs, and eliminates the information that is irrelevant to the user's needs or harmful to the user's needs. [0003] A typical application of information filtering is to filter junk texts from news texts in the Internet, question or answer texts in Q&A interactive platforms, so that the news texts, question texts and answer texts provided to users can meet the needs of users text. [0004] In the process of filtering junk te...

AI Technical Summary

Problems solved by technology

[0011] Depend on figure 1 It can be seen that in the existing method for identifying junk text, as long as the text to be processed contains sensitive words, it will be identified as junk text, but in fact, the sensitive words contained in the text to be processed are different, or the number of sensitive words contained At different times, the probability of belonging to junk text is also different. figure 1 The method shown has a higher probability of identifying non-spam text as spam text

Images