Neural Network Sub-Type Recognition for Rare Object Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional training methods for learning-based image evaluation devices struggle with recognizing rare object types due to insufficient training data, leading to decreased recognition accuracy and increased training time.
Innovation Solution
A configuration method using two neural network modules for joint training, where the first module extracts image features and the second module recognizes object types, followed by the creation of a sub-type recognition module for efficient recognition of object sub-types, especially for rare object types.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional training methods are used with limited training images for rare object types, then the training process is simple and fast, but the recognition accuracy deteriorates considerably
Solution Approach 1:
The training process is segmented into two distinct phases: a first training phase using a first neural network module with available training images, and a second training phase using a second neural network module with synthesized training images. This segmentation allows the system to handle rare object types by separating the training into manageable stages, first learning from real data and then reinforcing with synthesized data, thereby improving recognition accuracy without requiring a large quantity of real training images for rare object types.
2Measurement precision
If training is continued until sufficient training images of rare object types are evaluated, then the recognition accuracy improves, but the training outlay rises considerably
Solution Approach 1:
The system performs preliminary action by first training the first neural network module with available real training images before synthesizing and using virtual training images. This preliminary training establishes a foundation with real data, and subsequent training with synthesized images reinforces and extends this foundation. This approach allows the system to achieve sufficient training for rare object types without requiring extensive time to evaluate and collect additional real training images, as the synthesized images supplement and extend the training data efficiently.
3Measurement precision
If specific image features are determined individually by experts for rare object types, then the classification accuracy improves, but the training complexity and outlay increase
Solution Approach 1:
The system employs self-service by using the first neural network module to automatically extract and generate training images for the second neural network module without requiring manual intervention from experts. The first neural network module processes real training images and generates synthesized training images that are then used for further training. This self-service mechanism eliminates the need for experts to manually determine and annotate specific image features for rare object types, thereby maintaining high classification accuracy while significantly reducing training complexity and manual outlay.
Data Source
AI summary
An image analysis device (BA) is configured to recognize imaged objects. A plurality of training images (TPIC) assigned to an object type (OT) and an object sub-type (OST) are fed into a first neural network module (CNN) to detect image features. Training output data sets (FEA) of the first neural network module are fed into a second neural network module (MLP) to detect object types using the detected image features. For each object type: training images assigned to the object type (OT1, OT2) are fed into the trained first neural network module, the first neural network module training output data set (FEA1, FEA2) generated for the respective training image is assigned to the object sub-type (OST) of the respective training image, and by means of the aforementioned sub-type assignments, a sub-type detection module (BMLP1, BMLP2) is configured to detect object sub-types.

