Academic Impact Assessment via Citation Context Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current evaluation metrics for academic impact primarily focus on the quantity of papers published, failing to effectively assess the true impact of scholars and publications.
Innovation Solution
A method for determining academic impact involves pre-processing citing papers to extract relevant data, determining the category and ranking of reference paper contributions, calculating local and global influential factors, and considering sentiment polarity to evaluate the impact of each reference paper.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If evaluation metrics focus on the quantity of papers published, then the evaluation process is simple and fast, but the accuracy of assessing true academic impact deteriorates
Solution Approach 1:
The patent segments the evaluation process into multiple components: extracting citation information from papers, analyzing citation contexts, determining citation types (supportive, critical, neutral), and calculating composite impact scores. This segmentation allows the system to move beyond simple citation counts while maintaining a structured, manageable evaluation framework.
Solution Approach 2:
The patent changes the evaluation parameters from simple quantitative metrics (citation count) to multi-dimensional parameters including citation context, citation type, paper quality indicators, and temporal factors. This parameter transformation enables more accurate impact assessment by capturing the nuanced ways citations reflect academic influence.
2Measurement precision
If evaluation metrics focus only on citation quantity, then the evaluation method is easy to implement, but the ability to distinguish true academic value deteriorates
Solution Approach 1:
The patent performs preliminary actions by pre-processing and storing structured citation information, including extracting citation contexts and classifying citation types in advance. This preliminary processing enables the evaluation system to quickly assess true academic value without implementing complex real-time analysis, thereby maintaining ease of operation while improving measurement precision.
3Measurement precision
If the evaluation system analyzes citation quality and context, then the accuracy of impact assessment improves, but the computational resources and time required increase
Solution Approach 1:
The patent performs preliminary analysis of citation contexts and classification of citation types during data collection and storage phases. By pre-processing this information, the system avoids time-consuming analysis during the actual evaluation process, thereby maintaining high accuracy while reducing evaluation time.
Solution Approach 2:
The patent implements a tiered evaluation approach where the system can perform partial analysis (focusing on key citation indicators) for quick assessments, or conduct more comprehensive analysis when higher precision is required. This allows flexible adjustment between accuracy and time consumption based on specific evaluation needs.
Data Source
AI summary
A method for determining an academic impact, including: pre-processing a citing paper to obtain pre-processed data; determining a category of an impact, on the citing paper, of each reference paper and ranking of contribution, to the citing paper, of each reference paper, according to the pre-processed data; determining a local influential factor, on the citing paper, of each reference paper, according to the category of the impact and the ranking of the contribution of each reference paper; and determining a global influential factor of each reference paper according to a global influential factor of the citing paper and the local influential factor.