Word Segmentation Rule Conflict Detection and Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing word segmentation methods often result in inaccurate segmentation due to conflicting rules, which can lead to different final segmentation results for the same input text when processed with different rules, and these conflicts may not be accurately detected.
Innovation Solution
A method that acquires text and configuration information containing multiple word segmentation rules, converts indeterminate rules to determinate rules by modifying replacement conditions, and determines conflicts by identifying intersections between character strings matched by these rules, thereby processing the text accurately.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple word segmentation rules are used to process text information, then the coverage and applicability of word segmentation is improved, but rule conflicts occur leading to inaccurate and inconsistent segmentation results
Solution Approach 1:
The patent applies preliminary action by detecting and resolving rule conflicts before actual word segmentation processing. The system pre-processes the rule set to identify intersections and conflicts between rules, establishing a conflict-free or optimized rule order beforehand, so that when text segmentation actually occurs, accurate and consistent results are guaranteed without runtime conflicts
Solution Approach 2:
The patent introduces an intermediary mechanism - a rule conflict detection and resolution module - that acts between the rule set and the text segmentation process. This intermediary analyzes rule intersections, determines conflict relationships, and resolves them through optimization algorithms, thereby mediating between multiple segmentation rules to ensure reliable results
2Ease of manufacture
If traditional rule conflict detection methods are used, then implementation simplicity is maintained, but conflict detection accuracy is insufficient leading to missed conflicts
Solution Approach 1:
The patent replaces traditional mechanical/manual rule conflict detection with an automated computational system. The system uses algorithmic methods to automatically analyze rule intersections, identify conflicts, and resolve them, substituting manual inspection and simple heuristic methods with a systematic automated detection mechanism that provides both accuracy and efficiency
3Productivity
If rule conflicts are not accurately detected, then processing speed is maintained, but segmentation result reliability deteriorates
Solution Approach 1:
The system performs rule conflict detection and resolution as a preliminary step before actual text processing. By pre-analyzing and optimizing the rule set, conflicts are resolved beforehand, ensuring that subsequent text segmentation operations can proceed at high speed with reliable and consistent results, without needing to slow down for conflict detection during processing
Data Source
AI summary
The present disclosure relates to a method and a terminal for performing word segmentation on text information, and a storage medium. The method includes: acquiring the text information and configuration information, in which the configuration information includes at least two first word segmentation rules; converting the first word segmentation rules into second word segmentation rules according to a predetermined rule; in response to determining that an intersection exists between character strings of the text information matched by two of the second word segmentation rules, determining that two first word segmentation rules corresponding to the two of the second word segmentation rules associated with the intersection conflict; and processing the text information according to the configuration information, and outputting a result of the word segmentation on the text information.