Filtering method and system for Gzip compressed data

A technology of compressing data and filtering methods, which is applied in the computer field, can solve the problems of reduced filtering performance, high overall time, complex and changeable network flow, etc., and achieve the effect of reducing the number of matching times, increasing the matching speed, and solving matching problems

Active Publication Date: 2018-05-29
INST OF INFORMATION ENG CHINESE ACAD OF SCI
View PDF1 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Pattern matching technology is one of the key technologies of intrusion detection systems and network application firewalls. However, with the development of the information age, pattern matching technology faces new problems: the amount of data increases sharply, the network flow is complex and changeable, and the real-time performance of matching cannot meet the requirements. Wait
There are many problems in this method: first, "decompression + scanning" divides the detection process into two stages, which greatly reduces the real-time performance of detection; second, if all the compressed files can be decompressed, there is a risk of "decompression bomb", namely The decompression rate is too large, resulting in a large amount of memory and CPU usage during the decompression process
[0011] 1. "Decompression + scanning" divides the detection process into two stages, which greatly reduces the real-time detection;
[0012] 2. If all the compressed files are decompressed, there is a risk of "decompression bomb", that is, the decompression rate is too large, resulting in a large amount of memory and CPU usage during the decompression process;
[0013] 3. Increase the decompression part, resulting in too high overall time and reduced filtering performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Filtering method and system for Gzip compressed data
  • Filtering method and system for Gzip compressed data
  • Filtering method and system for Gzip compressed data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail in conjunction with the accompanying drawings.

[0049] The Gzip compressed data is composed of the original data through LZ77 encoding and Huffman encoding, and the present invention mainly aims at the LZ77 encoding part in the Gzip compressed data. The LZ77 compression algorithm is mainly for character data. By fixing a window size, if the new string already exists in the window, record the position and length of the corresponding string in the window, and use the pointer (length, distance) to represent, where distance Indicates the position of the repeated string, and length indicates the length of the string, so as to achieve the purpose of compressing the text. In Gzip, the window size is fixed at 32KB, so the distance length is 1 to 32768 (2 15 ), and the value of length is between 3 and 258. For ex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a filtering method for Gzip compressed data. According to characteristics of the Gzip compressed data, and in combination with a KR multi-mode matching algorithm, the filteringspeed of the Gzip compressed data is increased, and the timeliness and security of processing are improved. The invention furthermore provides a filtering system for the Gzip compressed data. The filtering system is used for executing the method.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to a filtering method and system for Gzip compressed data. Background technique [0002] Pattern matching technology is one of the key technologies of intrusion detection systems and network application firewalls. However, with the development of the information age, pattern matching technology faces new problems: the amount of data increases sharply, the network flow is complex and changeable, and the real-time performance of matching cannot meet the requirements. Wait. Therefore, in the face of complex and changeable network data, the performance of pattern matching technology needs to be further improved. [0003] In order to continuously improve network bandwidth, in addition to improving hardware transmission capabilities, compressed data transmission is gradually being valued. HTTP compression refers to the transmission method of sending web text data to the br...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04L29/08
CPCH04L67/02H04L67/06G06F16/137G06F16/1744
Inventor 刘燕兵王歧卢毓海张春燕袁方方谭建龙郭莉
Owner INST OF INFORMATION ENG CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products