Hyper text transfer protocol (HTTP)-analysis-based uniform resource locator (URL) automatically classifying and grading system and method

An automatic classification and grading system technology, applied in the transmission system, digital transmission system, electrical components, etc., can solve the problems of increasing system time and space overhead, long duration of TCP stream, increasing judgment complexity, etc., to achieve system saving The effect of time and space overhead

CN102882703AActive Publication Date: 2013-01-16CERNET CORP
7 Cites 30 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
Publication Date
2013-01-16

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a hyper text transfer protocol (HTTP)-analysis-based uniform resource locator (URL) automatically classifying and grading system and an HTTP-analysis-based URL automatically classifying and grading method. The system comprises an HTTP request / response message preprocessor, an HTTP request message resolving server, an HTTP response message resolving server, a switch, an HTTP storage and correlation server and an HTTP grading and classifying server, wherein the HTTP request / response message preprocessor is used for distributing an HTTP request / response message image data flow; the HTTP request message resolving server is used for recombining the HTTP request message image data flow; the HTTP response message resolving server is used for recombining the HTTP response message image data flow; the HTTP storage and correlation server is used for storing message information; and the HTTP grading and classifying server is used for automatically classifying and grading URLs. The method comprises the following steps of: preprocessing an HTTP message image data flow to acquire the HTTP request / response message image data flow, and distributing the HTTP request / response message image data flow; recombining the request / response message image data flow, and storing the message information which is extracted from recombined data; correlating the stored information; and classifying and grading the URLs according to correlated information. By the system and the method, the URLs can be efficiently classified and graded.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to the technical field of network behavior monitoring and network behavior management, and more specifically, to a system and method for automatically classifying and grading URLs based on HTTP analysis. Background technique

[0002] According to the statistical report of Internet tracking agency Netcraft on October 9, 2011, the total number of global websites is about 500 million, of which only 150 million are actually active. According to data analysis: At present, the total number of websites in the world is huge, and "spam websites" exceed 50%, and they are in a growing trend. The Internet environment needs to be cleaned and purified. According to the "New Media Blue Book" released by the Chinese Academy of Social Sciences in 2011, the total number of Internet sites in China reached 1.91 million in 2010, and the number of web pages reached 60 billion.

[0003] As we all know, web pages and all other resources on the I...

Examples

Embodiment Construction

[0025] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings. Details and functions that are unnecessary to the present invention have been omitted during the description to prevent obscuring the understanding of the present invention.

[0026] figure 1 It is a structural diagram of the URL automatic classification and grading system based on HTTP analysis of the present invention, such as figure 1 As shown, according to one aspect of the present invention, a kind of URL automatic classification and grading system based on HTTP analysis is proposed, and the system includes: HTTP request / response Request / Response message preprocessor, HTTP request Request message parsing server, HTTP response Response message analysis server, switch, HTTP storage association server and HTTP classifica...