Generative Transformer Model Retraining for Vehicle Object Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing object detection methods for highly automated driving require significant training effort due to resource-intensive annotation processes, especially in machine learning algorithms.
Innovation Solution
A computer-implemented method using a pre-trained generative deep learning model, specifically a generative transformer model, is retrained with a small dataset of unannotated sensor data from a vehicle's environment to adapt it for specific object detection tasks, reducing the need for extensive annotation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional object detection methods are used with standard training datasets, then satisfactory object detection performance is achieved, but the training effort and annotation resources are very resource-intensive
Solution Approach 1:
The patent applies preliminary action by pre-training the generative deep learning model on large-scale natural language data before fine-tuning it for specific object detection tasks. This pre-training phase prepares the model with general language understanding and patterns, so that when it is later fine-tuned with smaller, task-specific datasets, it achieves high performance with reduced training effort and annotation requirements.
2Manufacturing precision
If extensive annotation is performed manually or automated, then training data quality is improved, but the annotation process becomes very resource-intensive
Solution Approach 1:
The patent applies self-service by enabling the generative model to automatically generate training data and annotations through its language understanding capabilities. Instead of requiring extensive manual or automated annotation processes, the model can generate synthetic training examples with automatic annotations, thereby improving training data quality while eliminating the resource-intensive annotation process.
3Loss of time
If a pre-trained generative deep learning model is used and retrained with small dataset, then training effort is reduced, but the model must be adapted to specific vehicle environment tasks
Solution Approach 1:
The patent applies parameter changes by fine-tuning the pre-trained generative model's parameters through retraining on smaller, task-specific datasets containing vehicle environment images and annotations. This process adjusts the model's parameters to be optimized for specific detection tasks such as detecting pedestrians, vehicles, or obstacles in automotive contexts, thereby reducing training effort while achieving task-specific adaptability.
Data Source
Figure 1~4

AI summary
The invention relates to a computer-implemented method for providing a generative deep learning model (A) for object detection, comprising the steps of: providing (S1) a generative deep learning model (A) pre-trained on the basis of natural language data, in particular a pre-trained generative transformer model, and retraining (S2) the generative deep learning model (A) using a training data set (TD) of individual images (10), in particular time series images and/or point clouds (12), based on sensor data (SD) of a vehicle's surroundings. The invention further relates to a computer-implemented method for object detection using a generative deep learning model, a system for providing a generative deep learning model for object detection, and a system for object detection using a generative deep learning model.