System and method for filtering text information of webpage

Abstract

The invention discloses a system and a method for filtering the text information of a webpage. The system comprises a webpage browsing terminal, a proxy server, a network host and a text filtering center module, wherein the webpage browsing terminal receives, analyzes and sends a target request through a browser; the proxy server receives the target request, sends the target request to the network host, acquires returned source code information and sends the source code information to the text filtering center module for filtering; meanwhile, the proxy server is used for receiving a filtering result which is returned by the text filtering center module; the network host is used for receiving the target request and returning the source code information; and the text filtering center module is used for analyzing, filtering and determining the source code information and returning the filtering result. The invention has the advantages that: by using an object-oriented programming idea, a text is filtered and developed; by combining various data structures, the system is fully optimized; modules are independent of one another; and the reusability and the expandability of the system are greatly improved.

Description

technical field [0001] The invention relates to a webpage information filtering system and method, in particular to a webpage text information filtering system and method capable of filtering bad content in webpage text information. Background technique [0002] At present, there are mainly four kinds of filtering technologies for web page content identification at home and abroad, namely filtering based on Internet Content Classification Platform (PICS), database filtering (IP library, URL library), keyword filtering and intelligent content understanding filtering. [0003] Since criminals generally do not take the initiative to label the bad information they disseminate in accordance with the PICS standard, PICS-based filtering is not effective in practical applications; the database filtering method cannot filter many bad information that is parasitic in comprehensive websites. It is also impossible to filter websites containing bad information that frequently change IP a...

AI Technical Summary

Problems solved by technology

[0003] Since criminals generally do not take the initiative to label the bad information they disseminate in accordance with the PICS standard, PICS-based filtering is not effective in practical applications; the database filtering method cannot filter many bad information that is parasitic in comprehensive websites. It is also impossible to filter websites containing bad information that frequently change IP and URL, or adopt multi-level proxy methods; bad information filtering technology based on keywords can obtain faster filtering speed, but often does not consider context relevance, The rate of false negatives and false negatives is high, and keywords are commonly used words by people at present. Some publishers of information content may deliberately avoid using these words and replace them with other words or pictures, so that the information filtering mechanism based on keywords cannot Recognition; intelligent content understanding and filtering technology is immature, with a large amount of calculation and slow filtering speed

Images