Server Device for Automatic General Word List Creation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for creating a list of general words to exclude from search results are labor-intensive and incomplete, burdening users with the task of manually creating and maintaining such lists, which can lead to missed relevant information.
Innovation Solution
A server device and method that automatically collects and analyzes texts to identify words appearing frequently over a defined period, determining general words by their high frequency and consistent usage, and creates a list to exclude them from search results.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users manually create general word lists, then the lists can be customized to specific needs, but the work burden on users increases significantly and completeness is difficult to achieve
Solution Approach 1:
The system automatically creates and maintains the general word list by analyzing text data itself, without requiring user intervention. The control unit collects texts, extracts words, determines general words based on frequency criteria, and creates the list autonomously, making the system self-sufficient for this task.
Solution Approach 2:
The system uses frequency-based parameters (first frequency threshold and second frequency variation range) to automatically identify general words. By changing the analysis approach from manual curation to automated statistical analysis with adjustable parameters, the system achieves both completeness and time efficiency.
2Reliability
If users manually configure non-display conditions, then specific words can be excluded, but users often neglect this setting and miss important information
Solution Approach 1:
The system automatically performs the non-display condition configuration by generating the general word list and applying it to filter search results. This eliminates the need for users to manually set exclusion rules, making the process both reliable and easy to operate.
Solution Approach 2:
The system performs preliminary analysis to create the general word list before actual information retrieval operations. By preparing the exclusion list in advance based on collected text data, the system ensures accurate filtering is already in place when users perform searches.
3Quantity of substance
If general words are included in search results, then the results are comprehensive, but the readability and quality of extracted information deteriorates
Solution Approach 1:
The system extracts and separates general words from the search results using the automatically created general word list. By taking out these low-value words that appear frequently across all texts, the system maintains comprehensive coverage while improving the quality and readability of the remaining results.
Solution Approach 2:
The system applies frequency-based filtering parameters to distinguish between general words (high frequency, low variation) and meaningful words (lower frequency, higher variation). This parameter-based approach automatically adjusts the balance between completeness and readability based on the actual text corpus being analyzed.
Data Source
AI summary
A server device of the present invention includes a control unit collecting texts stored in a storage unit in response to an instruction from the outside or when a predetermined time is reached, extracting words from the collected texts, determining, as a general word, a word which appears at a frequency higher than a first predefined value for a first predetermined period, and which appears at a frequency that varies within a second predefined value range for every second predetermined period that is shorter than the first predetermined period, and creating a general word list which enumerates the general words.