Autonomous Driving Scenario Mining for Abnormal Trajectory Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for simulating and testing autonomous vehicle (AV) systems require extensive real-world test miles to identify and train on realistic, unusual driving scenarios, which is inefficient and impractical for achieving human-level safety standards.

Innovation Solution

A method for analyzing driving behavior data to identify abnormal trajectories and generate realistic driving scenario simulations using spatial Markov models and generative adversarial networks, allowing for systematic and scalable discovery of challenging scenarios without relying on actual test miles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If extensive real-world test miles are used to identify unusual driving scenarios, then the realism and representativeness of training scenarios is improved, but the time and resource consumption increases significantly

Engineering Contradiction:
Improverealism of training scenariosVSAvoidtest miles required
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent creates synthetic copies of realistic driving scenarios by training a generative model on real driving data. Instead of collecting extensive real-world test miles, the system learns the distribution of normal driving behaviors from existing data and generates synthetic scenarios that replicate realistic driving conditions, including unusual but plausible situations. This copying approach maintains scenario realism while eliminating the need for extensive physical testing.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary analysis of real driving data to train the generative model before actual scenario generation. By pre-learning the characteristics of normal and unusual driving behaviors from historical data, the system prepares a robust generative model that can subsequently produce realistic scenarios without requiring additional real-world testing. This preliminary training phase captures essential driving pattern distributions for later synthetic generation.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If the number of test miles is reduced to improve efficiency, then the time and resource consumption decreases, but the ability to discover realistic unusual scenarios deteriorates

Engineering Contradiction:
Improvescenario generation efficiencyVSAvoiddiscovery of unusual scenarios
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system synthesizes unusual driving scenarios by learning from the distribution of real driving data. The generative model captures rare but realistic driving patterns during training and can reproduce them synthetically, maintaining the ability to discover unusual scenarios without requiring extensive additional real-world testing. This copying mechanism preserves scenario diversity and realism while improving efficiency.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent modifies the approach from collecting more real-world data to transforming existing data parameters through generative modeling. By changing how data is utilized—from direct collection to synthetic generation based on learned distributions—the system maintains scenario quality while improving productivity. The generative model learns to generate scenarios with appropriate statistical properties without requiring proportional increases in real testing.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If more real-world driving data is collected to improve scenario diversity, then the coverage of operational design domain is improved, but the cost and complexity of data collection increases

Engineering Contradiction:
Improvescenario diversityVSAvoiddata collection infrastructure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal generative model that can produce diverse driving scenarios across the entire operational design domain from a single training dataset. Instead of requiring separate data collection systems for different scenario types, the generative model learns the joint distribution of driving conditions and can synthesize diverse scenarios including unusual situations. This multi-functional approach achieves scenario diversity without proportionally increasing data collection complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system copies the essential characteristics of diverse real-world driving scenarios through the generative model during training, then reproduces them synthetically. By learning the underlying distributions and relationships in the training data, the model can generate diverse scenarios without requiring continuous expansion of real-world data collection infrastructure. The copying process captures scenario diversity efficiently.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240412624A1Driving scenarios for autonomous vehicles
Publication Date: 2024.12.12 FIVE AI LTD
  • US20240412624A1 patent drawing
  • US20240412624A1 patent drawing
  • US20240412624A1 patent drawing

AI summary

One aspect herein provides a method of analysing driving behaviour in a data processing computer system, the method comprising: receiving at the data processing computer system driving behaviour data to be analysed, wherein the driving behaviour data records vehicle movements within a monitored driving area; analysing the driving behaviour data to determine a normal driving behaviour model for the monitored driving area; using object tracking to determine driving trajectories of vehicles driving in the monitored driving area; comparing the driving trajectories with the normal driving behaviour model to identify at least one abnormal driving trajectory; and extracting a portion of the driving behaviour data corresponding to a time interval associated with the abnormal driving trajectory.