Generative Transformer Model Retraining for Vehicle Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object detection methods for highly automated driving require significant training effort due to resource-intensive annotation processes, especially in machine learning algorithms.

Innovation Solution

A computer-implemented method using a pre-trained generative deep learning model, specifically a generative transformer model, is retrained with a small dataset of unannotated sensor data from a vehicle's environment to adapt it for specific object detection tasks, reducing the need for extensive annotation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional object detection methods are used with standard training datasets, then satisfactory object detection performance is achieved, but the training effort and annotation resources are very resource-intensive

Engineering Contradiction:
Improveobject detection performanceVSAvoidtraining effort
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-training the generative deep learning model on large-scale natural language data before fine-tuning it for specific object detection tasks. This pre-training phase prepares the model with general language understanding and patterns, so that when it is later fine-tuned with smaller, task-specific datasets, it achieves high performance with reduced training effort and annotation requirements.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If extensive annotation is performed manually or automated, then training data quality is improved, but the annotation process becomes very resource-intensive

Engineering Contradiction:
Improvetraining data qualityVSAvoidannotation process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies self-service by enabling the generative model to automatically generate training data and annotations through its language understanding capabilities. Instead of requiring extensive manual or automated annotation processes, the model can generate synthetic training examples with automatic annotations, thereby improving training data quality while eliminating the resource-intensive annotation process.

Inventive Principle:
Principle #25Self-service

3Loss of time

If a pre-trained generative deep learning model is used and retrained with small dataset, then training effort is reduced, but the model must be adapted to specific vehicle environment tasks

Engineering Contradiction:
Improvetraining effortVSAvoidtask adaptation requirement
Core Design Contradiction:
Loss of timeVSAdaptability or versatility

Solution Approach 1:

The patent applies parameter changes by fine-tuning the pre-trained generative model's parameters through retraining on smaller, task-specific datasets containing vehicle environment images and annotations. This process adjusts the model's parameters to be optimized for specific detection tasks such as detecting pedestrians, vehicles, or obstacles in automotive contexts, thereby reducing training effort while achieving task-specific adaptability.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP4576022A1Computer-implemented method and system for object detection using a deep learning generative model and training method
Publication Date: 2025.06.25 DSPACE SE & CO KG
  • EP4576022A1 patent drawingFigure 1~4
  • EP4576022A1 patent drawing
  • EP4576022A1 patent drawing

AI summary

The invention relates to a computer-implemented method for providing a generative deep learning model (A) for object detection, comprising the steps of: providing (S1) a generative deep learning model (A) pre-trained on the basis of natural language data, in particular a pre-trained generative transformer model, and retraining (S2) the generative deep learning model (A) using a training data set (TD) of individual images (10), in particular time series images and/or point clouds (12), based on sensor data (SD) of a vehicle's surroundings. The invention further relates to a computer-implemented method for object detection using a generative deep learning model, a system for providing a generative deep learning model for object detection, and a system for object detection using a generative deep learning model.