Automatic discovery method of sensitive words and its device and application

Abstract

The invention relates to the field of data analysis, and discloses an automatic discovery method, device and application of a sensitive word. The automatic discovery method of the sensitive word comprises the following steps: obtaining a reporting account whose the reported act is established; obtaining a search keyword adopted by the reporting account before the established reporting behaviors happen; and on the basis of the established reported information in the search result of each search keyword, judging whether the search keyword is the sensitive word or not. The sensitive word can be determined by the search behaviors of the reporting account, and a sensitive word bank is effectively expanded in real time.

Description

technical field [0001] The invention relates to the field of data analysis, in particular to an automatic discovery method of sensitive words and its device and application. Background technique [0002] Any UGC (account generated content) website will face information content security issues, including politically sensitive, pornographic, counterfeit, fraudulent, and advertising spam. Therefore, a text-based sensitive word filtering system is indispensable. This system mainly includes the following modules: [0003] 1) The establishment and update of thesaurus: this part mainly depends on the way of manual collection. [0004] 2) Preprocessing and index creation: This step is mainly to solve the quick search in the following steps, and there are very mature solutions, such as using the data structure of Trie tree (word search tree) to achieve. [0005] 3) Content acquisition: depending on the specific business model, there are mainly two implementation methods, one is th...

AI Technical Summary

Problems solved by technology

[0009] 2) Sensitive words mutate very quickly. Even for professional information security personnel, it is very difficult and time-consuming to promptly discover the modified words of malicious accounts that deliberately evade website rules; and the existence of these harmful information for a long time will also poses a high risk to the site

This method of relying on a large number of Internet accounts to assist in the investigation can alleviate the above-mentioned problem 2) to a certain extent, but there are also some problems, such as unstable reporting cycles, uneven quality, etc.

Images