Temporary Labeling for Learning Data Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing machine learning systems face challenges in collecting suitable learning data for classification tasks, particularly for objects not classified with known labels, and in improving data collection efficiency for supervised learning.
Innovation Solution
A learning data generation apparatus that extracts object images, evaluates their reliability using a learned model, and assigns temporary labels if the reliability falls within specific thresholds, generating learning data based on these temporary labels to enhance data collection and classification accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a learned model is used to evaluate object images for classification, then classification accuracy is improved, but the system cannot adequately handle objects with unknown labels or low reliability scores
Solution Approach 1:
The patent introduces a temporary label as an intermediary category between known classification labels and unclassified objects. When the learned model evaluates an object image and determines it does not match any known label (or matches with low reliability), the system assigns a temporary label instead of discarding the data. This intermediary label allows the system to maintain high classification accuracy for known objects while adapting to handle unknown objects, thereby resolving the contradiction between measurement precision and adaptability.
2Reliability
If learning data is collected only for high reliability objects, then data quality is improved, but the quantity of learning data is insufficient
Solution Approach 1:
The patent segments the learning data collection process into two distinct pathways: one for high reliability objects (assigned known labels) and another for low reliability objects (assigned temporary labels). This segmentation allows the system to maintain strict quality control for confidently classified objects while simultaneously expanding the quantity of learning data by including uncertain objects with temporary labels. The segmented approach resolves the contradiction by allowing both high-quality and quantity-expanding data collection strategies to coexist.
3Measurement precision
If manual labeling of all object images is performed, then labeling accuracy is improved, but the time and cost required increases significantly
Solution Approach 1:
The patent implements a self-service labeling system where the learned model automatically evaluates object images and assigns labels (either known labels or temporary labels) without requiring manual intervention for every image. The system serves itself by using its own learned knowledge to generate labels, thereby maintaining high labeling accuracy while dramatically reducing the time and computational resources required compared to manual labeling of all images.
4Quantity of substance
If temporary labels are assigned to low reliability objects, then the quantity of learning data is increased, but data heterogeneity increases
Solution Approach 1:
The patent extracts and separates temporary label data from the main labeled dataset, treating them as distinct but complementary components. By extracting temporary labeled data as a separate category, the system can maintain the homogeneity of the primary labeled dataset while still incorporating the quantity benefits of temporary labels. This extraction approach allows the system to manage data heterogeneity by clearly delineating between confidently labeled and temporarily labeled data, resolving the contradiction between quantity increase and homogeneity maintenance.
Data Source
AI summary
A learning data generation apparatus includes an object extraction unit configured to extract an object image from an image; a classification evaluation unit configured to evaluate the object possireimage based on a learned model, and to calculate reliability indicating a degree of posibility that the object image is classified as a candidate label; a classification determination unit configured to, if the reliability is smaller than a first threshold and equal to or larger than a second threshold which is smaller than the first threshold, associate a temporary label different from the candidate label with the object image; and a learning data generation unit configured to generate learning data based on the object image that is associated with the temporary label.


