Synthetic Driving Scene Generation Aligned With AV Test Goals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating synthetic driving scenarios for autonomous vehicle (AV) testing are cumbersome and struggle to create diverse and realistic scenarios that effectively validate various AV operating goals.

Innovation Solution

The technology enables the generation of synthetic driving scenarios from text descriptions, using machine-learning models such as Generative Adversarial Networks (GANs) and Generative Pre-trained Transformers (GPT), to create realistic and diverse scenarios that align with specific AV operating goals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional methods are used to generate synthetic driving scenarios, then the process becomes cumbersome and time-consuming, but the diversity and realism of scenarios are limited

Engineering Contradiction:
Improvescenario generation efficiencyVSAvoidscenario diversity
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent replaces traditional manual or rule-based mechanical methods for generating synthetic driving scenarios with machine learning models (GANs and GPT). These models automatically generate diverse and realistic driving scenarios from text descriptions, eliminating the need for cumbersome manual configuration while simultaneously increasing scenario diversity and realism through learned patterns from training data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual configuration methods are used, then control over scenario parameters is precise, but the complexity of the generation process increases

Engineering Contradiction:
Improvescenario parameter controlVSAvoidgeneration process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent introduces text descriptions as an intermediary between the user and the complex scenario generation process. Users provide high-level text descriptions of desired scenarios, and the machine learning models automatically translate these into detailed scenario configurations with precise parameter control. This intermediary layer simplifies the user interface while maintaining precise control over scenario parameters through the models' learned understanding of driving contexts.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If diverse scenarios are generated to cover various operating goals, then the validation comprehensiveness improves, but the generation time increases

Engineering Contradiction:
Improvevalidation comprehensivenessVSAvoidscenario generation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent employs pre-trained machine learning models that have already learned from extensive training data before deployment. When generating synthetic driving scenarios for validation, these pre-trained models can quickly produce diverse scenarios covering various operating goals without requiring time-consuming training at runtime. The preliminary training phase enables rapid generation during actual testing, achieving both comprehensive validation coverage and efficient generation times.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12221122B2Synthetic scene generation for autonomous vehicle testing
Publication Date: 2025.02.11 GM CRUISE HOLDINGS LLC
  • US12221122B2 patent drawing
  • US12221122B2 patent drawing
  • US12221122B2 patent drawing

AI summary

Aspects of the disclosed technology provide solutions for generating synthetic driving scenarios using text-based inputs that describe an intended operating goal. A process of the disclosed technology can include steps for generating a first synthetic scene for testing an autonomous vehicle (AV), providing the first synthetic scene to a first machine-learning model to generate a first text description of the synthetic scene, and providing the first text description to a second machine-learning model to determine if the first text description aligns with the predetermined operating goal for the AV. In some aspects, the process can further include generating a second text description for the synthetic scene, if the first text description does not align with the predetermined operating goal for the AV and providing the second text description to a third machine-learning model to generate a second synthetic scene. Systems and machine-readable media are also provided.