Annotated Dataset Refinement Through Machine-Learning Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing machine-learning algorithms for autonomous systems require large amounts of high-quality annotated data, but manual correction of annotation errors is costly and error-prone, leading to reduced performance and delayed launches.

Innovation Solution

An iterative data-annotation refinement scheme where a machine-learning algorithm evaluates and refines annotations, iteratively correcting errors and missing annotations until a threshold is met, using a second machine-learning algorithm to generate predictions and compare with initial annotations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual correction of annotation errors is performed, then annotation quality is improved, but cost and time consumption increase

Engineering Contradiction:
Improveannotation qualityVSAvoidtime consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system uses the trained machine learning algorithm to automatically evaluate and identify annotation errors in the dataset, enabling self-correction without manual intervention. The algorithm processes images, compares predictions with annotations, and generates erroneous datasets that highlight errors for automated refinement.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements a feedback loop where the trained algorithm's predictions are compared with existing annotations, and the identified errors are used to re-train and improve the algorithm iteratively. This continuous feedback mechanism automatically refines annotation quality through multiple training cycles.

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If manual correction of annotation errors is performed, then annotation quality is improved, but cost increases

Engineering Contradiction:
Improveannotation qualityVSAvoidcost
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The system performs self-evaluation and self-correction of annotation errors using the trained machine learning algorithm, eliminating the need for expensive manual correction processes. The algorithm autonomously identifies erroneous annotations and triggers re-training cycles to improve quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical process of manual annotation correction with an automated computational system. The machine learning algorithm substitutes human annotators in detecting and correcting errors, significantly reducing labor costs while maintaining or improving annotation quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If large amounts of data are collected to improve performance, then machine-learning algorithm performance is improved, but data annotation complexity and cost increase

Engineering Contradiction:
Improvealgorithm performanceVSAvoiddata annotation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system automatically evaluates the quality of annotations in the large dataset using the trained algorithm, identifying errors without requiring manual review of each annotation. This self-evaluation mechanism makes handling large datasets feasible by automating the quality control process.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system extracts only the erroneous annotations from the large dataset for targeted re-training, rather than manually processing or verifying all annotations. This extraction approach focuses computational resources on correcting specific errors, reducing overall annotation complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

4Manufacturing precision

If iterative refinement is performed to improve annotation quality, then annotation accuracy is improved, but processing time increases

Engineering Contradiction:
Improveannotation accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system implements iterative refinement where the trained algorithm's predictions are fed back to identify annotation errors, which then trigger targeted re-training cycles. Each iteration focuses on correcting specific errors rather than reprocessing the entire dataset, improving efficiency.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Instead of re-annotating or re-processing the entire dataset in each iteration, the system performs partial action by focusing only on the extracted erroneous annotations. This selective refinement reduces processing time while still improving overall annotation accuracy through cumulative corrections.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12406477B2Iterative refinement of annotated datasets
Publication Date: 2025.09.02 ZENSEACT AB
  • US12406477B2 patent drawing
  • US12406477B2 patent drawing

AI summary

The present disclosure relates to a method for determining a state of a vehicle on a road portion having two or more lanes. The method includes obtaining map data associated with the road portion and positioning data indicating a position of the vehicle on the road and a sensor data from a sensor system of the vehicle. The method further includes initializing a filter per lane of the road portion based on the obtained map data, the obtained positioning data, and the obtained sensor data, wherein each filter indicates an estimated state of the vehicle on the road portion. Then, selecting one of the initialized filters using a trained machine-learning algorithm, configured to use the obtained map data, the positioning data, the sensor data, and each estimated state as indicated by each filter as input and to output a current state of the vehicle on the road portion.