Denoised NER and Relation Extraction Models for Knowledge Graph Population
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Early approaches for populating Knowledge Graphs (KGs) rely heavily on pattern-based information extraction, neglecting binary relation extraction and resulting in inefficient and complex post-processing, leading to unnatural representations and neglect of relation extraction for simplicity.
Innovation Solution
A computer-implemented method for determining denoised named entity recognition and relation extraction models using semantic analysis, distant supervision, and active learning to generate noisy labeled datasets, which are then denoised through user interaction, allowing for efficient and reliable propagation of text data into a graph database representation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If pattern-based information extraction is used for KG population, then entity extraction can be achieved, but relation extraction is neglected and post-processing becomes complex and time-consuming
Solution Approach 1:
The patent combines entity extraction and relation extraction into a unified neural network model that processes text and generates both entity mentions and relation triples simultaneously. This integration eliminates the need for separate post-processing steps to normalize relation representations, directly resolving the contradiction between extraction completeness and processing complexity.
Solution Approach 2:
The model performs relation extraction in advance during the initial text processing stage, generating relation triples alongside entity mentions in a single pass. This preliminary action prevents the accumulation of complex post-processing requirements that would otherwise be needed to handle relation data separately.
2Productivity
If distant supervision is used to generate labeled datasets, then data labeling efficiency is improved, but data quality becomes noisy and inaccurate
Solution Approach 1:
The patent implements an active learning loop where the neural network model processes noisy distant supervision data, identifies uncertain predictions, and queries users for correction only on those specific cases. This feedback mechanism allows the system to leverage efficient distant supervision while maintaining high accuracy by selectively correcting only the noisy portions through user interaction.
Solution Approach 2:
Instead of requiring complete manual labeling of all data or accepting all distant supervision data as-is, the system applies partial manual correction only where needed (on uncertain predictions). This selective approach achieves high accuracy without the excessive cost of full manual labeling, resolving the contradiction between labeling efficiency and accuracy.
3Measurement precision
If manual correction of all labeled data is performed, then data accuracy is improved, but time consumption and cost increase significantly
Solution Approach 1:
The system performs manual correction only partially, specifically on data points where the model demonstrates low confidence or high uncertainty. This selective correction approach achieves high overall data accuracy while avoiding the time-consuming and costly process of manual verification for all labeled data, thus resolving the contradiction between accuracy and time investment.
Solution Approach 2:
The model serves itself by automatically identifying which data points require human correction based on its own confidence assessments. This self-service capability reduces the need for extensive manual intervention, allowing the system to maintain high accuracy while minimizing time loss.
4Ease of manufacture
If only entity extraction is focused for simplicity, then implementation is easier, but relation extraction capability is lost
Solution Approach 1:
The patent merges entity extraction and relation extraction capabilities into a single neural network model with unified architecture and loss function. This combination maintains implementation simplicity by using one model instead of separate systems, while simultaneously providing versatile extraction capabilities that handle both entities and relations in a single processing pass.
Solution Approach 2:
The neural network model is designed as a universal system that performs multiple functions: it extracts entity mentions, identifies relation types, and generates relation triples all within the same architecture. This multi-functionality resolves the contradiction by providing comprehensive extraction capabilities without requiring separate specialized models for each task.
Data Source
AI summary
A computer-implemented method for determining a denoised named entity recognition (NER)-model and denoised relation extraction (RE)-model. A computer-implemented method for propagating an input dataset into a graph database representation, a computing unit and a computer program product, is also provided.

