Text compression method based on gzip hardware

Abstract

The invention discloses a text compression method based on Gzip hardware, mainly solving the problem current text compression is slow in speed and not high in compression ratio. According to the method provided by the invention, a text to be compressed is read into a text compression processor without delay from two buffers in an alternative reading manner, computing units process simultaneously to compute dictionary storage address and mark effective information, dictionary information is updated by a character string to be processed after the historical character string is found in a dictionary, then matching of the character strings and trimming matching treatment are performed, Huffman coding is performed on the matched compressed text, and finally a code stream of the compressed text is acquired and output. The method provided by the invention is fast in processing speed, high in compression ratio, expandable in occupied resources, and prone to implement different scales of FPGA.

Description

technical field [0001] The invention belongs to the technical field of communication, and further relates to a text compression method based on Gzip (GUNzip) hardware in the technical field of lossless data compression. The invention uses a parallel processing window to process text information and completes text compression processing with a full pipeline structure, which can be used to optimize the text compression encoding hardware implementation method, and is especially suitable for real-time text compression processing. Background technique [0002] With the advent of the era of big data, a large amount of multimedia data needs to be transmitted on the network, which needs to occupy a large amount of network resources, so the research on data compression technology is very important. Gzip, as the most popular lossless compression method at present, is widely used in the fields of network data download and data backup. [0003] The most well-known implementation of the...

AI Technical Summary

Problems solved by technology

The disadvantage of this method is that this method requires a lot of calculations and searches in the process of analyzing data and compressing and encoding, such sequential execution and a large amount of calculations lead to slow processing speed

The disadvantage of this method is that this method uses heterogeneous computing to realize the compression of this paper, and the hardware implementation part does not implement the pipeline structure, resulting in a certain clock delay in this method and a decrease in processing throughput.

The disadvantage of this method is that the hardware implementation process of dictionary compression and Huffman coding adopts the sequential execution method, and the structure is not optimized, and the processing process consumes a lot of clock cycles

The disadvantage of this patent application is that it only uses the mapping function composed of sampled phrases to compress the text as a whole, and the text compression method is single, resulting in a relatively low compression ratio.

Moreover, the sequential execution method of text compression sampling, in the sequential execution method of each text sampling, the compression process consumes a large number of clock cycles, resulting in slow processing speed

Images