3D GAN Traffic Simulation for Realistic Autonomous Driving Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual traffic environments used for testing autonomous driving models lack realism, failing to accurately replicate the complexities of real-world traffic conditions, which hinders the development of safer and more efficient autonomous driving systems.

Innovation Solution

A method and system utilizing a time-dependent 3D generative adversarial network (GAN) model to create photorealistic simulated 4D traffic environments by integrating real and simulated data, allowing for the training of autonomous driving models in a more realistic virtual setting that mimics real-world conditions, including irregular object movements and environmental changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If virtual traffic environment is used for testing autonomous driving models, then cost and time efficiency are improved, but realism and accuracy of environmental conditions deteriorate

Engineering Contradiction:
Improvetesting efficiencyVSAvoidenvironmental realism
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent creates photorealistic virtual traffic environments by copying and replicating real-world traffic scenarios, road geometries, weather conditions, and object behaviors. This allows the virtual environment to closely mimic real-world conditions while maintaining the cost and time efficiency of simulation-based testing.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary data collection and environment construction before autonomous driving tests. By pre-building realistic virtual environments with accurate traffic patterns, road layouts, and environmental conditions, the system prepares comprehensive test scenarios in advance, enabling efficient and reliable testing without requiring real-world field tests for every scenario.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If photorealistic simulated environments are created using GAN models, then environmental realism is improved, but system complexity and computational requirements increase

Engineering Contradiction:
Improveenvironmental realismVSAvoidmodel complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces GAN (Generative Adversarial Network) models as an intermediary between real-world data and virtual environment generation. The GAN consists of a generator that creates photorealistic images and a discriminator that evaluates their authenticity. This intermediary system automatically learns to generate realistic traffic environments without requiring manual modeling of every environmental detail, thus improving realism while managing complexity through automated learning.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11774978B2Generative adversarial network enriched driving simulation
Publication Date: 2023.10.03 PONY AI INC
  • US11774978B2 patent drawing
  • US11774978B2 patent drawing
  • US11774978B2 patent drawing

AI summary

A computer-implemented method and a system for training a computer-based autonomous driving model used for an autonomous driving operation by an autonomous vehicle are described. The method includes: creating time-dependent three-dimensional (3D) traffic environment data using at least one of real traffic element data and simulated traffic element data; creating simulated time-dependent 3D traffic environmental data by applying a time-dependent 3D generic adversarial network (GAN) model to the created time-dependent 3D traffic environment data; and training a computer-based autonomous driving model using the simulated time-dependent 3D traffic environmental data.