Method for real time filtering large scale rubbish SMS based on content

Abstract

The invention discloses a real time filtrating method for large-scale garbage message based on the content, including the steps as following: 1, pre-filtrating by using the black list and the white list; 2, carrying out the online filtrating by using the filtrating module based on the frequency; 3, carrying out the fast filtrating for the message content by using the method of twice hashing; 4, carrying out the pretreating of the message text for suspicion message, and converting the same into the phase vector; 5, judging the suspicion message by using the method of combination of Naive Bayesian classifier and support vector classifier. The invention can greatly improve the filtrating speed of garbage message, and efficiently reduce the produced erroneous judgement rate in the conventional key word filtrating method; can efficiently solve the problem of group sending garbage messages with malicious intent in the short time; can efficiently avoid to mistake the common message as the garbage message so as to reduce the erroneous judgement, and efficiently improve the filtrating accuracy of whole system by analyzing the message content on the semantics.

Description

technical field

[0001] The invention relates to a spam short message filtering method, in particular to a content-based large-scale real-time spam short message filtering method. Background technique

[0002] With the rapid development of mobile communication technology and the continuous improvement of mobile phone penetration rate, mobile phone text messages have become an important communication and communication method due to their advantages of shortness, rapidity, simplicity, and low price, and are increasingly favored by people. While the short message service brings convenience to the majority of users, problems such as the flood of spam short messages, short message fraud, and short message rumors have appeared, which have brought many negative effects on people's work and life, and even become a major social nuisance. According to statistics, a provincial-level mobile communication operator suffers a direct loss of nearly 10 million yuan each year due to spam text ...

Examples

Embodiment Construction

[0028] Main principle of the present invention is as follows:

[0029] 1) Use two filtering modules of blacklist and whitelist to perform pre-filtering. The short message first enters the white list module, and if it belongs to the white list, it is directly released; otherwise, it enters the black list module, and if it belongs to the black list, the calling number is rejected. If it does not belong to the black list, then the short message enters the next step.

[0030] 2) When a malicious SMS group event occurs, traditional monitoring solutions usually cannot respond in a short time to intercept spam messages, so such events often cause huge losses to mobile communication operators in a short period of time. The goal of the frequency-based filtering module is to solve the problem of mass sending of malicious SMS. Its core idea is to model the sending characteristics of all real-time online valid users, and record the number of SMS sent by each user within a sliding time win...

technical field

[0001] The invention relates to a spam short message filtering method, in particular to a content-based large-scale real-time spam short message filtering method. Background technique

[0002] With the rapid development of mobile communication technology and the continuous improvement of mobile phone penetration rate, mobile phone text messages have become an important communication and communication method due to their advantages of shortness, rapidity, simplicity, and low price, and are increasingly favored by people. While the short message service brings convenience to the majority of users, problems such as the flood of spam short messages, short message fraud, and short message rumors have appeared, which have brought many negative effects on people's work and life, and even become a major social nuisance. According to statistics, a provincial-level mobile communication operator suffers a direct loss of nearly 10 million yuan each year due to spam text ...

Examples

Embodiment Construction

[0028] Main principle of the present invention is as follows:

[0029] 1) Use two filtering modules of blacklist and whitelist to perform pre-filtering. The short message first enters the white list module, and if it belongs to the white list, it is directly released; otherwise, it enters the black list module, and if it belongs to the black list, the calling number is rejected. If it does not belong to the black list, then the short message enters the next step.

[0030] 2) When a malicious SMS group event occurs, traditional monitoring solutions usually cannot respond in a short time to intercept spam messages, so such events often cause huge losses to mobile communication operators in a short period of time. The goal of the frequency-based filtering module is to solve the problem of mass sending of malicious SMS. Its core idea is to model the sending characteristics of all real-time online valid users, and record the number of SMS sent by each user within a sliding time win...

Images