Chinese character automatic verification and error correction system and method for gbk encoding

Abstract

The invention discloses a Chinese character automatic checking and error-correcting system aiming at GBK (Chinese Internal Code Specification) encoding, which comprises an encoding abnormal detection module, an error correction trying module and an error correction judging module. The invention also discloses a Chinese character automatic checking and error-correcting method implemented on the basis of the system. Abnormal GBK encoding can be identified and corrected and correct text characters can be recovered by the system and the method thereof. When the system and the method thereof are applied, firstly, the texts which are abnormally encoded are identified by the encoding abnormal detection module; then various error correction schemes are tried on the texts by the error correction trying module; and finally, an optimal error correction scheme is selected by the error correction judging module and the texts are recovered into texts which are normally encoded, so that the text characters can be correctly displayed.

Description

technical field [0001] The invention relates to an automatic check and error correction system for Chinese characters suitable for GBK encoding. The invention also relates to the application method of the system. Background technique [0002] GBK, the full name of "Chinese Character Internal Code Extension Specification", is a Chinese character encoding standard formulated by the National Information Technology Standardization Technical Committee. It is an internal code extension specification based on the GB2312 standard, so it is fully compatible with the GB2312 standard. [0003] The GBK encoding system contains a total of 21003 Chinese characters, and each Chinese character is represented by 2 bytes. The range of the first byte is 0x81-0xFE, and the range of the second byte is 0x40-0xFE. For example, the GBK code corresponding to the phrase "Wan Gang fully affirms science and technology" is expressed in hexadecimal as "CDF2B8D6B3E4B7D6BFCFB6A8BFC6BCBC", where "CDF2" cor...

AI Technical Summary

Problems solved by technology

[0004] However, GBK coding has the disadvantage of poor error tolerance. When a single byte is omitted in the coding, the coding of all subsequent Chinese characters will be wrong. After the first byte "CD" is lost, the system will still display the subsequent code with every two bytes as a Chinese character. In this way, the above phrase is displayed as "蚋絞浞zhi派田吉", the phrase All the characters in the text are scrambled, this phenomenon is called the "avalanche effect" of Chinese encoding

The above problems often occur when texts are transmitted on the Chinese Internet, which will greatly enlarge the small errors in text transmissions, resulting in the inability to read all texts correctly

Images