Multi-token matching for database content moderation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing database security systems are not extensible to different communities within a database system, requiring custom security software for varying moderation configurations, and face performance issues as the list of offensive words grows and content increases.
Innovation Solution
An extensible content moderation framework that uses a declarative configuration scheme to define moderation rules, allowing selectable actions based on user and content criteria, and employs a multi-token matching scheme for efficient keyword detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a security system uses a list of offensive words for comparing with content, then it can filter inappropriate content, but the filtering time increases as the list of offensive words gets larger
Solution Approach 1:
The patent segments the content into individual words or phrases (tokens) and compares them against the offensive words list. This segmentation allows the system to process content word-by-word rather than comparing entire content blocks, reducing the time complexity of filtering operations even as the offensive words list grows larger.
Solution Approach 2:
The patent pre-processes and stores the offensive words list in an optimized data structure (such as a hash set or trie) before filtering operations. This preliminary organization of the offensive words enables faster lookup during content filtering, maintaining efficient performance even as the list expands over time.
2Adaptability or versatility
If custom security software is developed for each community with different moderation configurations, then each community can have tailored content moderation, but the system complexity and development cost increase
Solution Approach 1:
The patent implements a universal security system architecture that can serve multiple database communities with different moderation requirements. The system uses configurable parameters and rules that can be adjusted for each community without requiring separate custom software development, allowing one system to fulfill multiple specialized functions.
Solution Approach 2:
The patent introduces dynamic configuration capabilities that allow moderation rules, offensive words lists, and filtering parameters to be adjusted for different communities at runtime. This dynamic adaptability enables the same security software to accommodate varying moderation configurations across communities without requiring static custom development for each case.
Data Source
AI summary
A multi-token matching scheme efficiently detects multi-token keyword matches in content received by a database system. A keyword list may include multi-token keywords. Head tokens from the multi-token keywords are converted into a head hashmap. Token chains identifying tokens and delimiters in the multi-token keywords are generated and linked to the head hashmap. Tokens in the content are compared with the head hashmap. The matching tokens and following segments in the content are compared with the token chains. Portions of the content matching the token chains are identified as keyword matches. The matching scheme may use reverse delimiter tries to detect content matches for multi-token keywords with leading delimiters.