Neural Network Sub-Type Recognition for Rare Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional training methods for learning-based image evaluation devices struggle with recognizing rare object types due to insufficient training data, leading to decreased recognition accuracy and increased training time.

Innovation Solution

A configuration method using two neural network modules for joint training, where the first module extracts image features and the second module recognizes object types, followed by the creation of a sub-type recognition module for efficient recognition of object sub-types, especially for rare object types.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional training methods are used with limited training images for rare object types, then the training process is simple and fast, but the recognition accuracy deteriorates considerably

Engineering Contradiction:
Improverecognition accuracyVSAvoidnumber of training images
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The training process is segmented into two distinct phases: a first training phase using a first neural network module with available training images, and a second training phase using a second neural network module with synthesized training images. This segmentation allows the system to handle rare object types by separating the training into manageable stages, first learning from real data and then reinforcing with synthesized data, thereby improving recognition accuracy without requiring a large quantity of real training images for rare object types.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If training is continued until sufficient training images of rare object types are evaluated, then the recognition accuracy improves, but the training outlay rises considerably

Engineering Contradiction:
Improverecognition accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by first training the first neural network module with available real training images before synthesizing and using virtual training images. This preliminary training establishes a foundation with real data, and subsequent training with synthesized images reinforces and extends this foundation. This approach allows the system to achieve sufficient training for rare object types without requiring extensive time to evaluate and collect additional real training images, as the synthesized images supplement and extend the training data efficiently.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If specific image features are determined individually by experts for rare object types, then the classification accuracy improves, but the training complexity and outlay increase

Engineering Contradiction:
Improveclassification accuracyVSAvoidtraining complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system employs self-service by using the first neural network module to automatically extract and generate training images for the second neural network module without requiring manual intervention from experts. The first neural network module processes real training images and generates synthesized training images that are then used for further training. This self-service mechanism eliminates the need for experts to manually determine and annotate specific image features for rare object types, thereby maintaining high classification accuracy while significantly reducing training complexity and manual outlay.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12243287B2Method for configuring an image evaluation device and also image evaluation method and image evaluation device
Publication Date: 2025.03.04 SIEMENS HEALTHCARE DIAGNOSTICS INC
  • US12243287B2 patent drawing
  • US12243287B2 patent drawing

AI summary

An image analysis device (BA) is configured to recognize imaged objects. A plurality of training images (TPIC) assigned to an object type (OT) and an object sub-type (OST) are fed into a first neural network module (CNN) to detect image features. Training output data sets (FEA) of the first neural network module are fed into a second neural network module (MLP) to detect object types using the detected image features. For each object type: training images assigned to the object type (OT1, OT2) are fed into the trained first neural network module, the first neural network module training output data set (FEA1, FEA2) generated for the respective training image is assigned to the object sub-type (OST) of the respective training image, and by means of the aforementioned sub-type assignments, a sub-type detection module (BMLP1, BMLP2) is configured to detect object sub-types.