Chinese web page data encoding, decoding method and system

Abstract

The invention provides a method for encoding Chinese webpage data. The method comprises the following steps of: from a first character of the current processed Chinese webpage data, performing participle processing according to a preset word base to judge whether a participle which is matched with a word in the preset word base and starts with the first character exists; when the participle which is matched with the word and starts with the first character exists, replacing the participle by a corresponding Unicode of the word matched with the participle, or if the participle which is matched with the word and starts with the first character does not exist, replacing the first character by a Unicode of the first character; and removing the part which is replaced by the Unicode from the current processed Chinese webpage data to obtain the next current processed Chinese webpage data, and repeating the steps until the Chinese webpage data are completely replaced by a Unicode stream. By the method, the space occupied by an encoded data stream can be saved; and therefore, the storage space and the data transmission flow of the Chinese webpage data can be reduced.

Description

technical field [0001] The present invention relates to the field of mobile communication, more specifically, to a Chinese web page data encoding method and device, a server with the Chinese web page data encoding device, a Chinese web page data decoding method and device, and a Chinese web page data encoding method and device, and a Chinese web page data encoding method and device, and a Chinese web page data encoding method and device. A mobile terminal of a method for decoding Chinese web page data. Background technique [0002] In order to save the user's Internet traffic, when the webpage content is transmitted from the server to the browser client of the mobile terminal, the browser background server will compress the webpage before the webpage is transmitted. The current server usually uses Lz77-based compression algorithms, such as Lz77 compression algorithm, Lzma compression algorithm, etc. These algorithms use gzip, 7zip and other compression formats. Web page ht...

AI Technical Summary

Problems solved by technology

[0006] The LZW algorithm is transparent to the language. Because the algorithm defines repetition patterns at the byte level, it can be effectively applied to the compression of Chinese web pages, but at the same time it cannot effectively use the characteristics of the language itself. For example, Chinese is actually semantically It is composed of relatively fixed 'words', but this algorithm will not consider this feature of Chinese

In terms of compression method, the compression algorithm relies on the repeated pattern in the text. If there is no repeated pattern in a certain text or the string repeats less, the algorithm will fail or the compression efficiency will not be high.

At the same time, since the repeating pattern is gradually recognized in the process of scanning the text, only the short pattern can be recognized initially, and the longer repeating pattern can be recognized gradually, which means that the initial part of the document has a low compression ratio, which means that the shorter Web pages of length that don't compress well

Images