Self-Supervised DNN Pretraining for Autonomous Vehicle Object Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Training deep neural networks for object detection in autonomous vehicles is resource-intensive due to the need for annotated labeled data, which is time-consuming and costly.
Innovation Solution
A self-supervised learning system that uses a combination of 2D and 3D convolutional neural networks to determine pairwise region of interest feature similarity based on features from cropped image and point cloud data, allowing for the generation of loss functions and weight updates without requiring labeled data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If annotated labeled data is used for training deep neural networks, then object detection accuracy is improved, but resource consumption and training time increase significantly
Solution Approach 1:
The patent applies preliminary action by performing self-supervised pretraining on large amounts of unlabeled data before fine-tuning on smaller labeled datasets. This preliminary pretraining phase extracts useful features and representations from unlabeled data, which accelerates subsequent supervised training and improves final detection accuracy while reducing overall training time.
Solution Approach 2:
The patent implements self-service through self-supervised learning mechanisms where the model learns from unlabeled data using self-generated supervision signals. The system automatically creates training objectives from the data itself without requiring external human annotation, enabling the model to serve its own training needs and reducing dependency on costly labeled datasets.
2Measurement precision
If annotated labeled data is used for training deep neural networks, then object detection accuracy is improved, but resource consumption increases significantly
Solution Approach 1:
The patent performs preliminary self-supervised pretraining on unlabeled data to establish strong feature representations before supervised fine-tuning. This preliminary action reduces the computational resources needed during the supervised training phase, as the model already possesses useful learned features that require less intensive training to achieve high accuracy.
Solution Approach 2:
The self-supervised learning approach enables the model to learn from unlabeled data without requiring resource-intensive human annotation processes. The system generates its own training signals automatically, eliminating the need for expensive labeled datasets and reducing overall resource consumption while maintaining detection accuracy.
3Productivity
If self-supervised learning is used for pretraining, then resource consumption and training time are reduced, but the need for effective loss functions and weight updates must be achieved without labeled data
Solution Approach 1:
The patent segments the training process into distinct phases: self-supervised pretraining on unlabeled data followed by supervised fine-tuning on labeled data. Each phase uses appropriately designed loss functions for its specific objectives, simplifying the overall design complexity while maintaining training efficiency. The segmentation allows each loss function to be optimized for its specific phase rather than requiring a single complex loss function for all scenarios.
Solution Approach 2:
The patent employs parameter changes by modifying loss function parameters and optimization hyperparameters between the self-supervised pretraining phase and the supervised fine-tuning phase. This allows the system to adapt to different training objectives and data types, achieving effective weight updates without labeled data during pretraining while maintaining simplicity in each individual phase.
Data Source
AI summary
A system comprises a computer including a processor and a memory. The memory includes instructions such that the processor is programmed to determine a pairwise region of interest feature similarity based on features extracted from a first cropped image portion and corresponding point cloud data and features extracted from a second cropped image portion and corresponding point cloud data. The processor is also programmed to determine a loss using a loss function based on the pairwise region of interest feature similarity, wherein the loss function corresponds to at least one a first deep neural network or a second deep neural network. The processor is also programmed to update at least one weight of the at least one of the first deep neural network or the second deep neural network based on the loss.


