Training Image Data Generation via Object Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for creating training image data for machine learning, particularly for object recognition and segmentation, are labor-intensive due to the need for manual labeling, and synthetic data often lacks realism, leading to less robust trained networks.
Innovation Solution
A procedure that involves providing an annotated image, selecting an object, removing the object and its annotation from the image, and generating a modified annotated image, which is then used to create real training image data that is more heterogeneous and accurate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual labeling is used to create training image data, then the accuracy and realism of training data is improved, but the time and labor effort required increases substantially
Solution Approach 1:
The patent applies preliminary action by pre-segmenting images into multiple patches before training the object recognition model. This preprocessing step creates a structured foundation that enables automated label generation later, reducing the need for manual labeling while maintaining accuracy. The patches are created in advance with their spatial relationships preserved, allowing the system to efficiently generate training data through automated processes.
Solution Approach 2:
The patent uses copying by generating synthetic training images through template matching and patch reconstruction. Instead of manually labeling each image, the system creates copies and variations of annotated patches, combining them to form new training images with automatically generated labels. This copying approach maintains the realism and accuracy of manual labeling while dramatically reducing the time required.
2Productivity
If synthetic data is used to generate training images, then the productivity and automation level is improved, but the realism and robustness of trained networks deteriorates
Solution Approach 1:
The patent applies local quality by ensuring that each patch retains its original local characteristics and visual fidelity from the source images. Instead of generating entirely synthetic images that may lack realism, the system preserves the authentic local properties of image patches while arranging them in synthetic configurations. This approach maintains the visual realism needed for robust network training while achieving automated generation.
Solution Approach 2:
The patent uses composite materials by combining multiple real image patches with template structures to create composite training images. These composite images retain the authentic visual properties of real images while incorporating the structured organization needed for automated generation. The resulting training data achieves both productivity and reliability by merging real image content with synthetic arrangement.
3Quantity of substance
If data augmentation is applied to modify original labeled datasets, then the quantity of training data is improved, but the accuracy of label alignment deteriorates due to transformation errors
Solution Approach 1:
The patent applies segmentation by dividing images into discrete patches that can be independently processed and recombined. This segmentation approach enables the system to generate multiple training samples from single images by rearranging patches, effectively increasing training data volume without requiring complex transformations that would misalign labels. Each patch maintains its original label information, ensuring accurate label alignment.
Solution Approach 2:
The patent uses another dimension by transitioning from image-level transformations to patch-level recombination. Instead of applying transformations that affect the entire image and risk label misalignment, the system operates at the patch level, where each patch's label remains independently valid. This dimensional shift from global to local operations preserves label accuracy while generating diverse training samples.
Data Source
Figure 1
Figure 2
Figure 3~5
AI summary
The invention relates to a computer-implemented method for providing training image data (TBD) for training a function, in particular an object recognition function (F0), the method comprising the following steps: S1 Providing at least one annotated image (AB), the annotated image (AB) having at least one object (01, 02, 031, 032, 041, 042, 043, 05) comprising an annotation (L1, L2) associated with the at least one object, the annotation describing an image region in which the at least one object (01, 02, 031, 032, 041, 042, 043, 05) is contained; S2 selecting an object (01, 02, 031, 032, 041, 042, 043, 05) in the annotated image (AB); S3 replacing the image region described by the annotation (L1, L2) with a region of another image in order to remove the selected object (01, 02, 031, 032, 041, 042, 043, 05) together with the annotation (L1, L2) associated with the selected object (01, 02, 031, 032, 041, 042, 043, 05) from the annotated image (AB) and produce a modified annotated image (MAB); S4 providing the training image data (TBD) containing the modified annotated image (MAB).