Synthetic HD Map Data Generation for Autonomous Vehicle Change Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems for updating high-definition (HD) maps are computationally burdensome and require continuous probe data collection, making them outdated and unsuitable for autonomous navigation due to the high cost and time-consuming nature of processing and classifying probe data.

Innovation Solution

A computing system converts standard-definition (SD) map features into pseudo-HD map features, generates modified map features, and trains a machine learning model to detect changes between HD map data and sensor data, allowing for frequent updates without the need for probe data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional probe data collection and processing methods are used to update HD maps, then measurement precision and reliability are improved, but device complexity and loss of time increase significantly

Engineering Contradiction:
ImproveHD map precisionVSAvoidupdate time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent creates synthetic probe data by copying and transforming existing HD map data through simulated environmental changes. Instead of collecting real probe data from probe vehicles, the system generates artificial training datasets by programmatically modifying existing map features (adding/removing road markings, changing lane configurations) to represent various environmental change scenarios. This copying approach eliminates the time-consuming real-world data collection process while maintaining the precision needed for training change detection models.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary actions by pre-generating synthetic training data and pre-training the machine learning model offline before actual HD map updates are needed. The synthetic dataset is created in advance with various simulated environmental changes, and the model is trained beforehand on this prepared data. When real updates are needed, the pre-trained model can quickly process new map data without requiring time-consuming real-time analysis or retraining.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If conventional probe data collection methods are used, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
ImproveHD map precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex physical probe data collection infrastructure with a digital copying system that generates synthetic data from existing HD maps. Instead of deploying probe vehicles with specialized sensors and processing equipment, the system uses software to copy and transform existing map data into synthetic training examples. This dramatically reduces device complexity while maintaining the ability to generate high-precision training data for change detection.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent substitutes mechanical probe data collection systems (probe vehicles, specialized sensors, physical data gathering infrastructure) with a computational system that generates synthetic data through algorithms. The mechanical process of driving probe vehicles around environments to collect data is replaced by digital transformation of existing map data, including programmatically adding/removing road markings, changing lane configurations, and simulating environmental variations through software operations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If frequent HD map updates are implemented, then reliability is improved, but loss of time and computational resources increase

Engineering Contradiction:
ImproveHD map accuracyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary training using synthetic data before actual HD map updates. The machine learning model is pre-trained offline on extensively generated synthetic datasets that cover various environmental change scenarios. This preliminary training phase prepares the model in advance, so when frequent updates are needed, the already-trained model can quickly process new map data and detect changes without requiring time-consuming retraining or analysis from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses synthetic copying of environmental change scenarios to create comprehensive training data without requiring repeated real-world probe data collection. By copying and transforming existing HD map features into various simulated change scenarios (different road markings, lane configurations, environmental conditions), the system generates abundant training examples that enable the model to handle frequent updates efficiently without proportionally increasing real-world data collection time.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20230349716A1Systems and methods for simulating change detection data
Publication Date: 2023.11.02 TOYOTA RESEARCH INSTITUTE INC
  • US20230349716A1 patent drawing
  • US20230349716A1 patent drawing
  • US20230349716A1 patent drawing

AI summary

System, methods, and other embodiments described herein relate to simulating change detection data. In one embodiment, a method includes converting features from a standard-definition (SD) map into high-definition (HD) map features. The method includes generating modified map features based upon the HD map features. The method includes training a machine learning model based upon the HD map features and the modified map features. The machine learning model is configured to detect a change between data from an HD map corresponding to an environment and sensor data generated by a vehicle in the environment.