Autonomous Vehicle Training Data Labeling Using Removable Sensor Pods

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current autonomous vehicle technologies face challenges in efficiently generating training data for machine learning models, particularly in complex environments, due to the time-consuming and error-prone process of manual data labeling and the difficulty in accurately labeling objects at varying distances and occlusions.

Innovation Solution

The use of additional vehicles equipped with removable hardware pods to collect and synchronize data with autonomous vehicles, enabling automatic generation of labeled training instances through temporal correlation and localization, which can then be used to train machine learning models for controlling autonomous vehicle actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual data labeling is used for autonomous vehicle training, then training data can be generated, but the process is time-consuming and error-prone

Engineering Contradiction:
Improvelabeling accuracyVSAvoiddata generation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system uses additional vehicles equipped with sensors to automatically collect and generate labeled training data without human intervention. The additional vehicles autonomously perform the labeling task by detecting and recording attributes of target vehicles, eliminating the need for manual human labeling while improving both speed and consistency.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Additional vehicles serve as intermediary data collection platforms between the target autonomous vehicle and the training data generation process. These intermediary vehicles equiped with hardware pods collect sensor data and vehicle state information, which is then used to create labeled training instances without requiring direct human annotation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If additional vehicles with hardware pods are deployed to collect data, then data generation speed increases, but system complexity increases

Engineering Contradiction:
Improvedata generation speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The hardware pod is designed as a universal, multi-functional unit that can be mounted on any additional vehicle. It integrates multiple sensor types (cameras, LIDAR, radar) and data collection capabilities into a single standardized platform, allowing the system to scale by simply adding more identical units rather than designing custom complex systems for each vehicle.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The data collection system is segmented into independent additional vehicles, each equipped with its own hardware pod. This modular approach allows the system to scale productivity by adding more independent units without proportionally increasing overall system complexity, as each unit operates autonomously with standardized interfaces.

Inventive Principle:
Principle #1Segmentation

3Reliability

If manual labeling is used for objects at varying distances and occlusions, then training data can be created, but human error increases

Engineering Contradiction:
Improvetraining data reliabilityVSAvoidlabeling process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The manual human labeling process is replaced with automated sensor-based detection systems mounted on additional vehicles. These systems use computer vision, LIDAR, and radar to automatically detect, track, and label objects at various distances and occlusion levels, eliminating human error while maintaining consistent labeling standards across diverse scenarios.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11256263B2Generating targeted training instances for autonomous vehicles
Publication Date: 2022.02.22 AURORA OPERATIONS INC
  • US11256263B2 patent drawing
  • US11256263B2 patent drawing
  • US11256263B2 patent drawing

AI summary

Sensor data collected via an autonomous vehicle can be labeled using sensor data collected via an additional vehicle, such as a non-autonomous vehicle mounted with a vehicle agnostic removable hardware pod. A training instance can include an instance of data collected by an autonomous vehicle sensor suite and one or more corresponding labels.