Profanity Detection via Disallowed Variants Dictionary
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Detecting and preventing profane/objectionable content in community-based or user-generated content is challenging, leading to direct and indirect losses for organizations hosting forums, as existing methods are ineffective in handling morphological and phonetic variations of profane words.
Innovation Solution
A system and method that utilize a disallowed variants dictionary, constructed using a misuse table, to detect and prevent profane content by employing a parameterizable online algorithm that checks incoming messages against allowed and disallowed word dictionaries, as well as a disallowed variants dictionary to capture morphological and phonetic variations, thereby preventing the posting of inappropriate content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a simple disallowed words dictionary is used to detect profane content, then the system is easy to implement and has low computational overhead, but it fails to detect morphological and phonetic variations of profane words
Solution Approach 1:
The patent segments the detection task into multiple specialized dictionaries: a disallowed words dictionary for exact matches, a disallowed variants dictionary for morphological variations, and a phonetic dictionary for phonetic similarities. This segmentation allows each dictionary to specialize in detecting specific types of profane content, improving overall detection accuracy while keeping each individual dictionary relatively simple and manageable.
Solution Approach 2:
The patent performs preliminary processing to generate variant forms of disallowed words before the actual detection process. By pre-computing morphological variants and phonetic representations and storing them in dedicated dictionaries, the system prepares detection data in advance, enabling faster and more accurate real-time detection without adding complexity to the core detection algorithm.
2Measurement precision
If multiple dictionaries including variants are used to detect all variations of profane words, then detection precision improves, but runtime overhead and memory requirements increase
Solution Approach 1:
The patent divides the large detection task into smaller sub-tasks handled by separate specialized dictionaries. Each dictionary focuses on a specific aspect (exact matches, morphological variants, phonetic similarities), allowing for optimized lookup operations. This segmentation reduces the search space for each query compared to a single comprehensive dictionary, thereby reducing runtime overhead while maintaining high detection precision.
Solution Approach 2:
The patent creates simplified copy structures of profane words in various forms (morphological variants, phonetic representations) and stores them in dedicated dictionaries. These copied representations enable fast comparison operations during detection, as the system can quickly check against pre-organized variant forms rather than performing complex real-time analysis of each incoming message.
3Adaptability or versatility
If comprehensive variant detection is implemented, then the system can capture all forms of profane content, but the complexity of constructing and maintaining the dictionary increases
Solution Approach 1:
The patent performs preliminary generation of word variants using systematic rules for morphological transformations and phonetic conversions. By automating the creation of variant forms through predefined linguistic rules rather than manual curation, the system achieves comprehensive coverage of profane word variations while simplifying the dictionary construction process. This preliminary automated generation makes the system easier to maintain and update.
Solution Approach 2:
The patent applies systematic parameter changes to base profane words to generate variants, such as applying morphological transformation rules (plurals, comparisons, derivations) and phonetic substitution rules. This parameter-based generation approach allows comprehensive coverage of variations through automated rule application, making dictionary construction more systematic and easier to maintain compared to manual compilation of all possible variants.
Data Source
AI summary
A system and method can detect and/or prevent profane/objectionable content in forums/communities with community based or user generated content. The system generates and provides a disallowed variants dictionary, which can be constructed based on a misuse table, wherein the disallowed variants dictionary contains a plurality of variants of one or more disallowed words in a community based or user generated content. Furthermore, the system checks each word in an incoming message against the disallowed variants dictionary, and determines that one or more words in the incoming message are disallowed when there is a hit.