Hardware compression system and method based on pipeline mode

Abstract

The invention provides a hardware compression system and method based on a pipeline mode. The hardware compression system based on the pipeline mode comprises a management control unit, a pipeline matching unit, a standard format conversion unit, a static Huffman coding unit and a data stream generation unit, and the management control unit is used for controlling and coordinating data transmission of other units, obtaining to-be-compressed data and outputting compressed data. The pipeline matching unit is used for calculating the same matching position of the current input character and the previous input character, and the current input character is continuously matched with the same length. The standard format conversion unit is used for converting the input characters into a standard data format. The static Huffman coding unit is used for coding the data in the standard data format into a Huffman coding stream. The data stream generation unit is used for converting the non-fixed-length code stream into a fixed-length code stream and outputting the fixed-length code stream. According to the technical scheme provided by the embodiment of the invention, the data compression rate is improved, and the time for occupying the central processing unit and the memory resources are reduced.

Description

technical field [0001] The invention relates to the technical field of data compression, in particular to a pipeline-based hardware compression system and method. Background technique [0002] With the rapid development of big data and artificial intelligence, the server needs to store a large amount of data to support the platform computing of big data and artificial intelligence. In order to reduce data storage and prevent data from occupying too much storage resources, data is usually compressed before being stored. [0003] At present, data compression is often performed through software to achieve lossless compression, which can effectively reduce data storage, but will occupy a large amount of time and a large amount of memory resources of a central processing unit (CPU, Central Processing Unit). Contents of the invention [0004] Embodiments of the present invention provide a pipeline-based hardware compression system and method, so as to increase the rate of data ...

AI Technical Summary

Problems solved by technology

[0003] At present, data compression is often achieved through software to achieve lossless compression. Although this can effectively reduce data storage, it will take up a lot of time and a lot of memory resources of the central processing unit (CPU, Central Processing Unit)

Images