Journal Impact Assessment Using Citation Network Metrics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current citation-based metrics, such as the ISI Impact Factor, fail to accurately assess journal impact as they focus on global citation frequencies, ignoring structural and contextual aspects, and do not account for local communities' needs or web-based publications, leading to an incomplete representation of journal prestige.
Innovation Solution
A system and method that evaluates the impact of scholarly works by aggregating usage data from Digital Libraries to create a network representation, using social network metrics like degree, closeness, and betweenness centrality to determine the impact of journals within specific communities, rather than relying solely on citation counts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If citation-based metrics like ISI Impact Factor are used to assess journal impact, then global citation frequencies can be measured, but structural and contextual aspects of journal impact are ignored
Solution Approach 1:
The patent transitions from one-dimensional citation counting to multi-dimensional network analysis by representing journals, articles, and authors as nodes in a citation network. This dimensional expansion captures structural relationships (who cites whom, direct vs. indirect citations) and contextual information (author affiliations, journal categories, temporal patterns) that simple citation counts miss, thereby resolving the contradiction between measurement simplicity and information completeness
Solution Approach 2:
The patent changes the assessment parameters from single scalar citation counts to multiple network metrics including betweenness centrality, closeness centrality, degree centrality, and eigenvector centrality. These parameter transformations enable comprehensive capture of both global impact and local contextual factors, allowing accurate journal impact assessment while preserving structural and contextual information that would be lost in traditional metrics
2Adaptability or versatility
If ISI Impact Factor is calculated based on selected scholarly journals, then a standardized metric can be produced, but web-based publications and gray literature are excluded
Solution Approach 1:
The patent creates a universal citation network framework that can accommodate multiple types of scholarly works including traditional journals, web-based publications, gray literature, and preprints within a single analytical system. The network model treats all these sources equally as nodes, allowing the system to universally process diverse publication types while maintaining consistent network metric calculations, thus achieving both adaptability and reliability
Solution Approach 2:
The patent implements a dynamic network model that can adapt to include new types of publications as they emerge. The system continuously updates the citation network as new citations are recorded, allowing it to dynamically incorporate web-based publications and gray literature while maintaining metric consistency through the same network analysis algorithms applied to all publication types
3Measurement precision
If global citation patterns are analyzed, then a consensus view of journal impact is obtained, but local community needs and preferences are overlooked
Solution Approach 1:
The patent applies local quality by enabling different network metrics and analysis parameters to be optimized for specific local communities while maintaining the overall network framework. The system can calculate community-specific betweenness centrality, closeness centrality, and other metrics tailored to local citation patterns and preferences, providing precise local impact assessments without requiring separate data collection for each community
Solution Approach 2:
The patent segments the global citation network into local community sub-networks based on author affiliations, institutional boundaries, or disciplinary domains. This segmentation allows the system to analyze local citation patterns separately while still benefiting from the comprehensive global data, effectively resolving the contradiction between obtaining sufficient data quantity and achieving local measurement precision
Data Source
AI summary
Although recording of usage data is common in scholarly information services, its exploitation for the creation of value-added services remains limited due to concerns regarding, among others, user privacy, data validity, and the lack of accepted standards for the representation, sharing and aggregation of usage data. A technical, standards-based architecture for sharing usage information is presented. In this architecture, OpenURL-compliant linking servers aggregate usage information of a specific user community as it navigates the distributed information environment that it has access to. This usage information is made OAI-PMH harvestable so that usage information exposed by many linking servers can be aggregated to facilitate the creation of value-added services with a reach beyond that of a single community or a single information service.