Method for compressing Chinese text supporting ANSI encode

Abstract

The present invention provides a compression method of Chinese text and a corresponding decompression method, which support ANSI codes. The compression method comprises the following steps: according to the position of the characters of the Chinese text to be compressed in the character code table, the characters of the Chinese text to be compressed are encodes by 1 or more than 1 bytes; the number of the bytes is marked in the generated code word; wherein, the character code table comprises the characters which are arranged in the descending order according to the frequency of occurrence of the characters of the Chinese text to be compressed; the generated code word is written into a compressed file. The compression method maintains the semantic characteristics of Chinese data flow to the greatest extent, and can be used with various compression algorithms and compression software.

Description

technical field [0001] The invention relates to the fields of data encoding and data compression, in particular to a method for compressing Chinese texts that support ANSI encoding. Background technique [0002] Data compression technology is the main technical means to save network bandwidth and storage resources and improve data transmission speed. Data compression refers to reorganizing relatively large original data into a data set that meets the aforementioned space requirements under a certain data storage space requirement, so that the information recovered from the data set can be consistent with the original data, or can be obtained. Use the same quality as the original data. Data can be compressed because of the redundancy in the data and the correlation between the information represented by the data. Data compression reduces the space required for data storage, thereby indirectly reducing the time and resource consumption required for data processing. [0003]...

AI Technical Summary

Problems solved by technology

Among the above three compression methods for Chinese data streams, the first method directly converts Chinese data into single bytes, and compresses ANSI-encoded Chinese data by compressing ASCII-encoded data, because ANSI-encoded Chinese data is expressed in double bytes A Chinese character, alphanumeric, etc. is represented by a single byte, and its semantics are mostly represented by the relationship between double bytes or the relationship between single and double bytes, so this method physically separates the semantic information contained in the encoding , cannot make full use of the character-level semantic information contained in the Chinese data stream, and the compression performance is poor

The second method simply expands the byte-based compression algorithm to a character-based compression algorithm. When performing subsequent compression, such as when applied to Huffman coding, it changes the number of characters of Huffman coding from 8 bits to 256 characters. Extended to 16-bit 65536 characters, the number of nodes in the corresponding Huffman tree has increased by 256 times, which greatly reduces the compression speed

Images