Unlock instant, AI-driven research and patent intelligence for your innovation.

Message filtering method and device

A message filtering and message technology, which is applied in the network field, can solve the problems of low message filtering accuracy and inability to effectively filter junk messages, etc., and achieve the effects of reducing the number of messages, improving accuracy, and reducing noise information

Active Publication Date: 2016-04-13
SHENZHEN GLOBEBILL TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a message filtering method and device to solve the problem that the accuracy of message filtering in the existing automatic text classification technology is not high, and junk messages cannot be effectively filtered out

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Message filtering method and device
  • Message filtering method and device
  • Message filtering method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] refer to figure 1 , shows a flow chart of steps of a message filtering method according to Embodiment 1 of the present invention.

[0026] The message filtering method of the present embodiment includes the following steps:

[0027] Step S102: Use the first filtering rule to filter the messages, and filter out the messages conforming to the set format among the messages.

[0028] By analyzing the spam messages, it can be seen that many spam messages can be identified by a certain format, such as by URL suffix identification, etc. Those skilled in the art can set the format of the spam messages to be filtered in the first filtering rule, and filter some of them. Spam messages are filtered out.

[0029] For example, if the first filtering rule is set as a rule to filter URLs in non-text format according to the URL (UniformResourceLocator, Uniform Resource Locator) suffix of the message, then when this rule is used to filter the message, the Packets are filtered out. O...

Embodiment 2

[0036]refer to figure 2 , shows a flow chart of steps of a message filtering method according to Embodiment 2 of the present invention.

[0037] The message filtering method of the present embodiment includes the following steps:

[0038] Step S202: Perform preliminary filtering on the message according to the URL of the message using the first filtering rule, and filter out the message whose URL in the message matches the URL in the set format.

[0039] The message data accessed from the operator contains a large number of spam messages, such as additional messages generated by user access, message information generated by client software, etc., some of which are additional messages in the format of .jpg and .css Filtering can be realized by simple rules, that is, preliminary filtering is performed by first filtering rules, and the preliminary filtering of messages can remove blacklist URLs in specific formats such as .jpg and .css formats, thereby reducing a large amount o...

Embodiment 3

[0056] refer to image 3 , shows a flow chart of steps of a message filtering method according to Embodiment 3 of the present invention.

[0057] The message filtering method of the present embodiment includes the following steps:

[0058] Step S302: Perform preliminary filtering on the message by using the first filtering rule.

[0059] In this embodiment, according to URL suffixes and some other rules, URLs in a certain format, such as URLs in non-text formats such as .jpg and .css, are filtered.

[0060] Step S304: Use the black and white lists to further filter the initially filtered messages.

[0061] Including: firstly judge the blacklist and whitelist of the pre-filtered message, if it hits the blacklist, it will filter, if it hits the whitelist, it will return the corresponding data in the historical whitelist, and skip the subsequent web page analysis. This filtering can be achieved through two bloomfilters (Bloom filters).

[0062] Step S306: Crawling the web pag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a message filtering method and device. The message filtering method comprises the steps of filtering messages according to a first filtering rule to filter out messages which are compliant with a set format in all messages; judging whether the messages obtained after filtration are matched with messages in a black list or a white list or not; if not, obtaining text information and / or webpage state codes corresponding to the unmatched messages; and filtering the unmatched messages according to the text information and / or the webpage state codes. By adopting the message filtering method, the message filtering accuracy is effectively improved.

Description

technical field [0001] The invention relates to the field of network technology, in particular to a message filtering method and device. Background technique [0002] Junk message filtering is an important task in Internet technology. It generally filters out the part of obviously abnormal user access messages through certain rules or following certain statistical rules, thereby reducing the transmission pressure and storage pressure of the Internet. It also reduces the system pressure for later extraction and identification of user messages. Spam filtering can effectively improve the efficiency of analyzing user messages, especially in the Internet era when computing power has become a resource. The filtering rate and quality of spam affect the efficiency and quality of downstream data processing. [0003] Existing spam filtering mainly adopts webpage automatic classification technology, which extracts webpage text content and label information, and assigns different weigh...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/06
Inventor 罗峰黄苏支李娜
Owner SHENZHEN GLOBEBILL TECH CO LTD