Automated Key Phrase Rule Generation via Part-of-Speech Patterns
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for key phrase extraction require manual creation of part-of-speech patterns, which are time-consuming, expensive, and inaccurate, especially when dealing with different languages and text types, necessitating linguistic expertise and labor-intensive processes.
Innovation Solution
An automated system generates key phrase extraction rules using part-of-speech patterns, such as noun+noun or verb+adverb, to identify key phrases across various languages and text types by analyzing a corpus sample and iteratively testing for accuracy, reducing the need for manual input and linguistic training.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual key phrase extraction rules are created using linguistically trained speakers, then extraction accuracy is improved, but time consumption and cost increase significantly
Solution Approach 1:
The system performs self-service by automatically generating key phrase extraction rules through iterative testing and evaluation without requiring manual linguistic expertise. The automated system learns and optimizes rules independently, eliminating the need for human linguists to manually create patterns.
Solution Approach 2:
The patent replaces the mechanical process of manual rule creation by linguistically trained speakers with an automated computational system. The mechanical human effort is substituted by algorithmic processes that automatically generate, test, and refine extraction rules through iterative evaluation.
2Measurement precision
If manual key phrase extraction rules are created with linguistic expertise, then extraction accuracy is improved, but cost increases significantly
Solution Approach 1:
The system eliminates the need for expensive linguistic expertise by performing self-service rule generation. The automated system independently creates and refines extraction rules through computational processes, removing the cost associated with hiring linguistically trained professionals.
Solution Approach 2:
The patent substitutes the expensive mechanical process of manual rule creation by experts with an automated computational system. The costly human expertise is replaced by algorithmic processes that generate rules through automatic testing and evaluation.
3Measurement precision
If part-of-speech patterns are manually composed for different languages and text types, then extraction accuracy is improved, but device complexity and labor requirements increase
Solution Approach 1:
The system achieves universality by creating a single automated framework that handles multiple languages and text types without requiring separate manual rule sets for each. The automated system adapts to different languages and text types through the same general-purpose rule generation process.
Solution Approach 2:
The patent replaces the complex mechanical process of manually composing language-specific and text-type-specific patterns with an automated system. The substitution eliminates the need for separate manual processes for each language and text type, unified into a single automated workflow.
Data Source
AI summary
A method, system, and non-transitory processor-readable storage medium for automatic key phrase rule generation for automatic key phrase extraction including: receiving a corpus sample including a plurality of documents containing text, receiving a plurality of identified key phrases which relate to a topic of the text of at least one corresponding document; assigning a part-of-speech to each word in the corpus sample; generating a part-of-speech pattern from each identified key phrase; and generating key phrase rules.