Training Image Data Generation via Object Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for creating training image data for machine learning, particularly for object recognition and segmentation, are labor-intensive due to the need for manual labeling, and synthetic data often lacks realism, leading to less robust trained networks.

Innovation Solution

A procedure that involves providing an annotated image, selecting an object, removing the object and its annotation from the image, and generating a modified annotated image, which is then used to create real training image data that is more heterogeneous and accurate.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual labeling is used to create training image data, then the accuracy and realism of training data is improved, but the time and labor effort required increases substantially

Engineering Contradiction:
Improvetraining data accuracyVSAvoidlabeling time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-segmenting images into multiple patches before training the object recognition model. This preprocessing step creates a structured foundation that enables automated label generation later, reducing the need for manual labeling while maintaining accuracy. The patches are created in advance with their spatial relationships preserved, allowing the system to efficiently generate training data through automated processes.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by generating synthetic training images through template matching and patch reconstruction. Instead of manually labeling each image, the system creates copies and variations of annotated patches, combining them to form new training images with automatically generated labels. This copying approach maintains the realism and accuracy of manual labeling while dramatically reducing the time required.

Inventive Principle:
Principle #26Copying

2Productivity

If synthetic data is used to generate training images, then the productivity and automation level is improved, but the realism and robustness of trained networks deteriorates

Engineering Contradiction:
Improvedata generation speedVSAvoidnetwork robustness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies local quality by ensuring that each patch retains its original local characteristics and visual fidelity from the source images. Instead of generating entirely synthetic images that may lack realism, the system preserves the authentic local properties of image patches while arranging them in synthetic configurations. This approach maintains the visual realism needed for robust network training while achieving automated generation.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent uses composite materials by combining multiple real image patches with template structures to create composite training images. These composite images retain the authentic visual properties of real images while incorporating the structured organization needed for automated generation. The resulting training data achieves both productivity and reliability by merging real image content with synthetic arrangement.

Inventive Principle:
Principle #40Composite materials

3Quantity of substance

If data augmentation is applied to modify original labeled datasets, then the quantity of training data is improved, but the accuracy of label alignment deteriorates due to transformation errors

Engineering Contradiction:
Improvetraining data volumeVSAvoidlabel alignment accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent applies segmentation by dividing images into discrete patches that can be independently processed and recombined. This segmentation approach enables the system to generate multiple training samples from single images by rearranging patches, effectively increasing training data volume without requiring complex transformations that would misalign labels. Each patch maintains its original label information, ensuring accurate label alignment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses another dimension by transitioning from image-level transformations to patch-level recombination. Instead of applying transformations that affect the entire image and risk label misalignment, the system operates at the patch level, where each patch's label remains independently valid. This dimensional shift from global to local operations preserves label accuracy while generating diverse training samples.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP4371084B1Method for providing training image data for training a function
Publication Date: 2025.05.14 SIEMENS AG
  • EP4371084B1 patent drawingFigure 1
  • EP4371084B1 patent drawingFigure 2
  • EP4371084B1 patent drawingFigure 3~5

AI summary

The invention relates to a computer-implemented method for providing training image data (TBD) for training a function, in particular an object recognition function (F0), the method comprising the following steps: S1 Providing at least one annotated image (AB), the annotated image (AB) having at least one object (01, 02, 031, 032, 041, 042, 043, 05) comprising an annotation (L1, L2) associated with the at least one object, the annotation describing an image region in which the at least one object (01, 02, 031, 032, 041, 042, 043, 05) is contained; S2 selecting an object (01, 02, 031, 032, 041, 042, 043, 05) in the annotated image (AB); S3 replacing the image region described by the annotation (L1, L2) with a region of another image in order to remove the selected object (01, 02, 031, 032, 041, 042, 043, 05) together with the annotation (L1, L2) associated with the selected object (01, 02, 031, 032, 041, 042, 043, 05) from the annotated image (AB) and produce a modified annotated image (MAB); S4 providing the training image data (TBD) containing the modified annotated image (MAB).