AI Sensor Data Modification for Autonomous Driving Test Scenarios

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating test data for autonomous driving systems face challenges in bridging the gap between simulation and real-world data, requiring manual tuning and resulting in less realistic and costly data generation, especially when adapting scenarios across different geographic and weather conditions.

Innovation Solution

A method utilizing AI technology, specifically machine learning and neural networks, to modify test data from a first scenario to a second modified scenario, incorporating optical camera, radar, and LIDAR data, by applying techniques like image-to-image translation, style transfer, and object segmentation to enhance data realism and adaptability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If simulation data is used for testing, then cost is reduced, but realism and accuracy of test data deteriorates

Engineering Contradiction:
ImprovecostVSAvoidrealism and accuracy of test data
Core Design Contradiction:
Loss of energyVSMeasurement precision

Solution Approach 1:

The patent introduces an AI-based data modification system as an intermediary between simulation data and real-world testing requirements. The system takes simulation data as input and applies learned transformations (from real data pairs) to generate modified simulation data that bridges the gap between synthetic and real-world characteristics, thereby maintaining cost efficiency while improving realism.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms simulation data by changing its parameters and characteristics through AI-based modification. By learning the parameter distributions and relationships from real data pairs and applying them to simulation data, the system alters the simulation data's parameters (such as sensor noise characteristics, object appearance, environmental conditions) to make them more representative of real-world scenarios.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If real data campaigns are conducted, then realism and accuracy of test data is improved, but cost increases

Engineering Contradiction:
Improverealism and accuracy of test dataVSAvoidcost
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent creates a virtual copy of real-world data characteristics by training an AI model on pairs of real simulation data and real-world data. The learned model captures the essential features and patterns of real data, which are then applied to generate modified simulation data that copies the realistic characteristics without requiring additional expensive real-world data collection campaigns.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent develops a universal AI-based modification system that can transform simulation data across multiple scenarios, vehicle types, and environmental conditions using a single trained model. This multi-functional approach allows the system to generate realistic test data for various ODDs (Operational Design Domains) without requiring separate real data campaigns for each specific scenario.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If manual tuning is applied to adapt scenarios, then adaptability to specific ODD details is improved, but device complexity and time consumption increases

Engineering Contradiction:
Improveadaptability to specific ODD detailsVSAvoidcomplexity of data generation process
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a self-service system where the AI model automatically adapts simulation data to specific ODD details without requiring manual intervention. The system self-adjusts by applying the learned transformations from real data pairs, automatically handling scenario adaptation, parameter adjustment, and data generation based on the input specifications, thereby reducing complexity and time consumption.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary action by pre-training the AI model on comprehensive real data pairs that cover various ODD scenarios before actual data generation. This preliminary training phase enables the model to internalize the relationships between different ODD characteristics and their corresponding data patterns, so that subsequent adaptations to specific ODD details can be performed automatically without manual tuning.

Inventive Principle:
Principle #10Preliminary action

4Productivity

If simulation data is used, then productivity is improved, but quality of test data deteriorates

Engineering Contradiction:
Improvedata generation efficiencyVSAvoidquality of test data
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent replaces the mechanical process of manual data adjustment and verification with an AI-based automated system. The AI model automatically performs data transformation, quality assessment, and parameter optimization, substituting the manual mechanical operations with intelligent algorithms that maintain high productivity while improving data quality through learned patterns from real-world data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP4614333A1Method for modifying test data for autonomous driving
Publication Date: 2025.09.10 SIEMENS IND SOFTWARE NV
  • EP4614333A1 patent drawingFigure 1
  • EP4614333A1 patent drawingFigure 2
  • EP4614333A1 patent drawing

AI summary

The invention relates to a Method for modifying test data for autonomous driving wherein the test data (DTA) is vehicle sensor (SNR) data (DTA) for testing a driver assistance system (ADS), wherein the change of test data (DTA) is made from a first scenario (FSC) to a second modified scenario (SMS), wherein the test data (DTA) includes optical camera (OPC) data (DTA) and/or radar (RDR) data (DTA) and/or LIDAR (LDR) data (DTA). It is proposed, that the modification of test data (DTA) is made using AI technology (AIT), wherein an input (INT) into the modification process comprises the sensor (SNR) data (DTA) of the first scenario (FSC) and specifications (ODD) for modifying the sensor (SNR) data (DTA), wherein an output comprises vehicle sensor (SNR) data (DTA) according to the second modified scenario (SMS).