N-Gram participle model-based reverse neural network junk mail filter device

Abstract

The invention relates to the technical field of text processing, in particular to an N-Gram participle model-based reverse neural network junk mail filter device. Customized word characteristic items are added to mail particles by using N-Gram technology, and judgment and filter of junk mails are implemented by combining a reverse neural network. The device is implemented by the following steps of: firstly, processing the mails by using a Markov chain and an N-Gram technique, extracting mail sample characteristics, and obtaining a sample mail word-document space by weight calculation and characteristic selection; secondly, matching a mail sample by using the customized word characteristic items to generate a customized characteristic-document space, and combining the document characteristics generated by the two methods to generate a new mail vector space; thirdly, constructing a reverse neural network model, generating characteristic vectors corresponding to network neurons according to the characteristic items of a mail training sample space, and training the network model by using the mail training sample vector space to obtain a trained mail classifier; and finally, generating a test sample vector space by the mail test sample according to the generated characteristic vectors corresponding to the network neurons, and testing the mail type judgment accuracy of the trained mail classifier. The embodiment of the invention can judge the junk mails so as to filter the junk mails.

Description

technical field [0001] The invention relates to Internet technology, in particular to a reverse neural network spam filtering device based on an N-Gram word segmentation model. Background technique [0002] With the wide application of the Internet, e-mail is favored by people for its fast, simple and cheap advantages, and has become an efficient mass communication medium. At the same time, a large number of useless emails poured into people's mailboxes, bringing disasters to their studies and lives. Spam is what users hate most, because they waste users' time, money, and network bandwidth, and at the same time, mess up users' mailboxes, and some emails are even harmful, such as containing pornographic content or viruses. According to relevant research reports, more than 10% of emails in the world are spam every day. Therefore, it is necessary to find a method for effectively intercepting and filtering spam. [0003] Anti-spam technology can be divided into two categories...

AI Technical Summary

Problems solved by technology

Spam is what users hate the most, because they waste users' time, money, and network bandwidth, and at the same time, mess up users' mailboxes, and some emails are even harmful, such as those containing pornographic content or viruses, etc.

Images