Annotated Dataset Refinement Through Machine-Learning Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing machine-learning algorithms for autonomous systems require large amounts of high-quality annotated data, but manual correction of annotation errors is costly and error-prone, leading to reduced performance and delayed launches.
Innovation Solution
An iterative data-annotation refinement scheme where a machine-learning algorithm evaluates and refines annotations, iteratively correcting errors and missing annotations until a threshold is met, using a second machine-learning algorithm to generate predictions and compare with initial annotations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual correction of annotation errors is performed, then annotation quality is improved, but cost and time consumption increase
Solution Approach 1:
The system uses the trained machine learning algorithm to automatically evaluate and identify annotation errors in the dataset, enabling self-correction without manual intervention. The algorithm processes images, compares predictions with annotations, and generates erroneous datasets that highlight errors for automated refinement.
Solution Approach 2:
The system implements a feedback loop where the trained algorithm's predictions are compared with existing annotations, and the identified errors are used to re-train and improve the algorithm iteratively. This continuous feedback mechanism automatically refines annotation quality through multiple training cycles.
2Manufacturing precision
If manual correction of annotation errors is performed, then annotation quality is improved, but cost increases
Solution Approach 1:
The system performs self-evaluation and self-correction of annotation errors using the trained machine learning algorithm, eliminating the need for expensive manual correction processes. The algorithm autonomously identifies erroneous annotations and triggers re-training cycles to improve quality.
Solution Approach 2:
The patent replaces the mechanical process of manual annotation correction with an automated computational system. The machine learning algorithm substitutes human annotators in detecting and correcting errors, significantly reducing labor costs while maintaining or improving annotation quality.
3Productivity
If large amounts of data are collected to improve performance, then machine-learning algorithm performance is improved, but data annotation complexity and cost increase
Solution Approach 1:
The system automatically evaluates the quality of annotations in the large dataset using the trained algorithm, identifying errors without requiring manual review of each annotation. This self-evaluation mechanism makes handling large datasets feasible by automating the quality control process.
Solution Approach 2:
The system extracts only the erroneous annotations from the large dataset for targeted re-training, rather than manually processing or verifying all annotations. This extraction approach focuses computational resources on correcting specific errors, reducing overall annotation complexity.
4Manufacturing precision
If iterative refinement is performed to improve annotation quality, then annotation accuracy is improved, but processing time increases
Solution Approach 1:
The system implements iterative refinement where the trained algorithm's predictions are fed back to identify annotation errors, which then trigger targeted re-training cycles. Each iteration focuses on correcting specific errors rather than reprocessing the entire dataset, improving efficiency.
Solution Approach 2:
Instead of re-annotating or re-processing the entire dataset in each iteration, the system performs partial action by focusing only on the extracted erroneous annotations. This selective refinement reduces processing time while still improving overall annotation accuracy through cumulative corrections.
Data Source
AI summary
The present disclosure relates to a method for determining a state of a vehicle on a road portion having two or more lanes. The method includes obtaining map data associated with the road portion and positioning data indicating a position of the vehicle on the road and a sensor data from a sensor system of the vehicle. The method further includes initializing a filter per lane of the road portion based on the obtained map data, the obtained positioning data, and the obtained sensor data, wherein each filter indicates an estimated state of the vehicle on the road portion. Then, selecting one of the initialized filters using a trained machine-learning algorithm, configured to use the obtained map data, the positioning data, the sensor data, and each estimated state as indicated by each filter as input and to output a current state of the vehicle on the road portion.

