Abbreviation Expansion for Text Analysis Precision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic text documents often contain abbreviations that hinder accurate automatic analysis and identification of concepts, as they can be incorrectly expanded or not recognized at all, leading to reduced precision and recall in text analysis.
Innovation Solution
A method and system that evaluate electronic text documents for multi-word expressions and their abbreviations, storing the abbreviations and their full forms in a data structure, allowing for the annotation of occurrences of abbreviations with their expanded forms, thereby improving the recognition of entities in controlled vocabularies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If abbreviations are used in text documents to economize on words and space, then document conciseness is improved, but text analysis precision deteriorates
Solution Approach 1:
The system performs preliminary action by first identifying and storing the full multi-word expression in the text document, then using it to expand subsequent abbreviations. This preliminary establishment of the full form enables accurate recognition of abbreviated versions later, resolving the precision issue while maintaining conciseness
Solution Approach 2:
The system introduces an intermediary data structure that stores the relationship between full multi-word expressions and their abbreviations. This intermediary enables the system to translate abbreviated forms back to their full meanings, thereby maintaining text analysis precision despite the use of space-saving abbreviations
2Productivity
If abbreviations are expanded automatically without context, then processing speed is improved, but expansion accuracy deteriorates
Solution Approach 1:
The system performs preliminary scanning to identify and store the first occurrence of the full multi-word expression before attempting to expand abbreviations. This preliminary action ensures that when expansion occurs, the correct full form is already available in the data structure, maintaining both speed and accuracy
Solution Approach 2:
The system uses feedback by checking whether a multi-word expression has already been identified and stored in the data structure before expanding an abbreviation. This feedback mechanism prevents incorrect expansions and ensures that only contextually verified abbreviations are expanded, maintaining high accuracy while processing efficiently
Data Source
AI summary
Systems, computer-program products and methods for annotating electronic text documents by resolving abbreviated text of concepts defined in a controlled vocabulary. In one embodiment, a method of annotating an electronic text document includes evaluating, by a computer, the electronic text document for one or more multi-word expressions having a first word and a second word. The method further includes, if a multi-word expression is found in the electronic text document, storing an abbreviation of the multi-word expression and evaluating the electronic text document for occurrences of the abbreviation after a location of the multi-word expression. The method further includes, if an occurrence of the abbreviation is found following the multi-word expression, annotating the occurrence of the abbreviation with the multi-word expression.