Autonomous Vehicle Simulation Scenario Generation Using Log Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for testing and validating autonomous vehicles are inefficient and prone to error, as they require manual generation of simulation scenarios, which is time-consuming and may miss critical scenarios, especially those that are rare or dangerous to test in real-world conditions.

Innovation Solution

A scenario generation system that utilizes log data from autonomous vehicles to create discrete regions and classify objects within those regions, generating simulation scenarios using a Gaussian mixture model to replicate various occupancy scenarios, allowing for repeatable and consistent testing across different environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual generation of simulation scenarios is used, then testing can be performed, but the process is time-consuming and inefficient

Engineering Contradiction:
Improvescenario generation efficiencyVSAvoidtime for manual scenario generation
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system creates synthetic simulation scenarios by copying and generalizing patterns from real-world log data. Instead of manually creating each scenario, the system automatically generates synthetic scenarios that replicate real driving conditions, object arrangements, and environmental factors, dramatically improving efficiency while maintaining realism

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary analysis of log data to extract occupation patterns and scenario templates before actual simulation testing. By pre-processing real-world data to identify common scenarios and their variations, the system prepares a library of synthetic scenarios that can be quickly deployed for testing, reducing the time needed for both scenario creation and execution

Inventive Principle:
Principle #10Preliminary action

2Reliability

If manual scenario generation is used, then some scenarios can be created, but critical rare or dangerous scenarios are likely to be missed

Engineering Contradiction:
Improvecompleteness of scenario coverageVSAvoidcomplexity of scenario generation system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system analyzes its own log data to automatically identify and generate synthetic scenarios, including rare and dangerous conditions. By self-serving its own operational data, the system continuously improves scenario coverage without requiring external manual input, ensuring comprehensive testing of edge cases while maintaining manageable complexity through automated pattern recognition

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from real-world log data to continuously refine and expand its scenario library. By monitoring actual driving conditions and identifying gaps in scenario coverage, the system automatically generates new synthetic scenarios that address missed critical cases, improving reliability while the automated feedback loop prevents complexity from becoming unmanageable

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If real-world dangerous situations are used for testing, then realistic scenarios are obtained, but the autonomous vehicle is exposed to actual danger

Engineering Contradiction:
Improverealism of test scenariosVSAvoiddanger exposure to autonomous vehicle
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system creates accurate copies of dangerous real-world scenarios through synthetic data generation. By replicating the spatial arrangements, object behaviors, and environmental conditions of hazardous situations without using actual dangerous events, the system achieves complete scenario realism while eliminating all physical danger to the autonomous vehicle

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system introduces synthetic log data as an intermediary between real-world dangerous scenarios and the autonomous vehicle testing. This intermediary layer preserves all the realistic characteristics and challenges of dangerous situations while filtering out the actual harm, allowing the vehicle to be tested against realistic scenarios without exposure to real danger

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11628850B2System for generating generalized simulation scenarios
Publication Date: 2023.04.18 ZOOX INC
  • US11628850B2 patent drawing
  • US11628850B2 patent drawing
  • US11628850B2 patent drawing

AI summary

Techniques associated with generating simulation scenarios for simulating a vehicle controller are discussed herein. Log data may include sensor data captured by sensors of a vehicle. The log data may represent objects in an environment. Objects may be associated with a region of a discretized representation of the environment relative to the vehicle. Specific states of objects (relative position in a region type, velocity, classification, size, etc.) may represent an instance of an occupation. Log data can be aggregated based on similar region type and/or object state. A statistical model over object states can be determined for each region type and can later be sampled to determine simulation parameters. A simulation scenario can be generated based on the simulation parameters, and a vehicle controller can be evaluated based on the simulation scenario.