Self-Supervised DNN Pretraining for Autonomous Vehicle Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Training deep neural networks for object detection in autonomous vehicles is resource-intensive due to the need for annotated labeled data, which is time-consuming and costly.

Innovation Solution

A self-supervised learning system that uses a combination of 2D and 3D convolutional neural networks to determine pairwise region of interest feature similarity based on features from cropped image and point cloud data, allowing for the generation of loss functions and weight updates without requiring labeled data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If annotated labeled data is used for training deep neural networks, then object detection accuracy is improved, but resource consumption and training time increase significantly

Engineering Contradiction:
Improveobject detection accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing self-supervised pretraining on large amounts of unlabeled data before fine-tuning on smaller labeled datasets. This preliminary pretraining phase extracts useful features and representations from unlabeled data, which accelerates subsequent supervised training and improves final detection accuracy while reducing overall training time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements self-service through self-supervised learning mechanisms where the model learns from unlabeled data using self-generated supervision signals. The system automatically creates training objectives from the data itself without requiring external human annotation, enabling the model to serve its own training needs and reducing dependency on costly labeled datasets.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If annotated labeled data is used for training deep neural networks, then object detection accuracy is improved, but resource consumption increases significantly

Engineering Contradiction:
Improveobject detection accuracyVSAvoidresource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary self-supervised pretraining on unlabeled data to establish strong feature representations before supervised fine-tuning. This preliminary action reduces the computational resources needed during the supervised training phase, as the model already possesses useful learned features that require less intensive training to achieve high accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The self-supervised learning approach enables the model to learn from unlabeled data without requiring resource-intensive human annotation processes. The system generates its own training signals automatically, eliminating the need for expensive labeled datasets and reducing overall resource consumption while maintaining detection accuracy.

Inventive Principle:
Principle #25Self-service

3Productivity

If self-supervised learning is used for pretraining, then resource consumption and training time are reduced, but the need for effective loss functions and weight updates must be achieved without labeled data

Engineering Contradiction:
Improvetraining efficiencyVSAvoidloss function design complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the training process into distinct phases: self-supervised pretraining on unlabeled data followed by supervised fine-tuning on labeled data. Each phase uses appropriately designed loss functions for its specific objectives, simplifying the overall design complexity while maintaining training efficiency. The segmentation allows each loss function to be optimized for its specific phase rather than requiring a single complex loss function for all scenarios.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs parameter changes by modifying loss function parameters and optimization hyperparameters between the self-supervised pretraining phase and the supervised fine-tuning phase. This allows the system to adapt to different training objectives and data types, achieving effective weight updates without labeled data during pretraining while maintaining simplicity in each individual phase.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12175732B2Computationally efficient unsupervised DNN pretraining
Publication Date: 2024.12.24 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US12175732B2 patent drawing
  • US12175732B2 patent drawing
  • US12175732B2 patent drawing

AI summary

A system comprises a computer including a processor and a memory. The memory includes instructions such that the processor is programmed to determine a pairwise region of interest feature similarity based on features extracted from a first cropped image portion and corresponding point cloud data and features extracted from a second cropped image portion and corresponding point cloud data. The processor is also programmed to determine a loss using a loss function based on the pairwise region of interest feature similarity, wherein the loss function corresponds to at least one a first deep neural network or a second deep neural network. The processor is also programmed to update at least one weight of the at least one of the first deep neural network or the second deep neural network based on the loss.