AI Data Quality Filtering via Graph Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge lies in obtaining and utilizing robust training data for artificial intelligence models, as open-sourced and crowd-sourced data often contains low-quality or malicious information, which can result in poor performance of AI-based models.
Innovation Solution
A mechanism is introduced to determine the quality of data points and repositories using graph analysis techniques, involving direct and indirect quality metrics, and filtering out low-quality data to improve the training dataset.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If open-sourced and crowd-sourced data is used for training, then the quantity of training data increases, but the quality of training data deteriorates due to low-quality or malicious information
Solution Approach 1:
The patent applies preliminary action by performing quality assessment and filtering of training data before it is used to train the AI model. The system evaluates data quality metrics and removes low-quality or malicious data points in advance, ensuring that only high-quality data reaches the training process. This prevents contamination of the model with poor-quality data while still allowing extensive use of open-sourced and crowd-sourced data sources.
Solution Approach 2:
The patent introduces an intermediary quality assessment mechanism that acts as a mediator between raw training data and the AI model training process. This intermediary layer evaluates data quality using multiple metrics and filters data accordingly, allowing the system to maintain both large data quantity and high data quality by selectively passing only approved data points to the training process.
2Reliability
If data quality assessment and filtering mechanisms are implemented, then the quality of training data improves, but the complexity of the training process increases
Solution Approach 1:
The patent applies segmentation by dividing the quality assessment process into distinct modular components: data collection, quality metric evaluation, filtering decisions, and training execution. Each component handles a specific aspect of quality control independently, making the overall complex process more manageable and maintainable while effectively improving data quality.
Solution Approach 2:
The patent uses parameter changes by implementing multiple adjustable quality metrics and thresholds that can be configured based on specific training requirements. The system evaluates data against various parameters (completeness, consistency, source reliability) and applies filtering based on configurable threshold values, allowing flexible control over quality standards without hardcoding complex filtering logic.
Data Source
AI summary
Methods, apparatus, systems, and articles of manufacture to improve data quality for artificial intelligence are disclosed. An example apparatus includes an interface; instructions; and processor circuitry to execute the instruction to: determine an indirect quality of a repository that include datapoints of a dataset; determine a direct quality of the repository that include the datapoints of the dataset; determine a dataset quality based on the indirect quality of the repository and the direct quality of the repository; and when the quality does not satisfy a threshold, filter out a subset of the datapoints to prepare the dataset to support the training of the neural network.


