Method for processing converting abnormal word containing unicode four byte code East Asia ideograph in searching engine

Abstract

The invention discloses a method for processing the conversion of variant forms of Unicode four-byte code-containing East-Asia expression ideographs in search engines. According to a table of variant forms of Chinese characters, the method adopts the idea of layered matching and realizes the matched search of variant forms of characters between various East-Asia Chinese characters, between the current frequently used characters and ancient writings and between ancient writings of different versions in the search engines. As searching, as long as any one of the variant forms of characters is inputted, the information containing other variant forms of characters will be searched. The invention makes the search engines able to more accurately search the user-needed information without considering the conversion problem between various variant forms of characters.

Description

technical field [0001] The invention relates to a method for processing variant character conversion of East Asian ideographic characters containing Unicode four-byte codes in a search engine. Background technique [0002] Search engines can help users find the useful information they need in massive amounts of information. With the continuous advancement of informatization, human beings have accumulated more and more information data, especially on the Internet, and the accumulated information is increasing exponentially every year. Search engines play a key role in finding the information users need in the vast Internet information. Due to the five thousand years of Chinese cultural accumulation and the uniqueness of the Chinese language, foreign English search engines cannot handle Chinese search engines very well. Therefore, there have also been Chinese search engines that specifically deal with Chinese, such as Baidu. Baidu search engine uses a unique Chinese languag...

AI Technical Summary

Problems solved by technology

That is to say, in the current search engine, if only simplified or traditional characters are used, relevant information in other East Asian countries or ancient documents cannot be retrieved.

Images