In-Vehicle AI Verification Using Context-Based Robustness Testing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AI-based information processing systems, particularly deep neural networks, are opaque, susceptible to adversarial perturbations, and lack robustness, making systematic testing and formal verification difficult, which poses challenges in semi-automated or fully automated vehicle control.
Innovation Solution
A method and device for verifying AI-based information processing systems using a test procedure that evaluates sensor data with unsupervised tests, storing results in a multidimensional data structure for continuous assessment and updating, allowing robustness evaluation and selection of the most suitable system based on context and properties.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If deep neural networks are used for AI-based information processing, then processing capability and pattern recognition performance are improved, but interpretability and transparency deteriorate
Solution Approach 1:
The patent introduces an intermediary explanation layer between the deep neural network and the user. This layer generates human-interpretable explanations for the network's decisions, allowing the complex processing capability of deep neural networks to be maintained while restoring interpretability through a mediating component that translates internal representations into understandable forms.
2Productivity
If purely data-driven parameter fitting is used for training, then development efficiency is improved, but robustness against adversarial perturbations deteriorates
Solution Approach 1:
The patent applies preliminary action by incorporating robustness considerations into the training process before deployment. Adversarial training is performed during the development phase, where the system is pre-exposed to perturbed inputs and learns to generalize better, thereby maintaining development efficiency while improving robustness against future adversarial attacks.
3Loss of time
If training is performed in simulation with synthetic data, then cost and time for data collection are reduced, but performance on real sensor data deteriorates
Solution Approach 1:
The patent employs parameter changes by systematically varying the parameters of synthetic data generation to better match real-world conditions. By adjusting parameters such as noise characteristics, lighting conditions, and object properties in the simulation, the synthetic training data becomes more representative of real sensor data, thereby maintaining the efficiency benefits of simulation while improving transfer performance.
4Reliability
If the space of possible disturbances is considered infinite, then comprehensive robustness coverage is improved, but testing and verification complexity deteriorates
Solution Approach 1:
The patent applies segmentation by dividing the infinite space of possible disturbances into discrete, manageable categories and types. By segmenting disturbances into classes such as sensor noise, weather conditions, adversarial attacks, and occlusions, the system can systematically test and verify robustness against each category without being overwhelmed by the infinite complexity of all possible disturbances.
Data Source
Figure 1
Figure 2
AI summary
The invention relates to a method for verifying an AI-based information processing system (10) used in the semi-automated or fully automated control of a vehicle (50), wherein at least one sensor (51) of the vehicle (50) provides sensor data (11), the acquired sensor data (11) are evaluated by means of an AI-based information processing system (10) arranged in a first control unit (52) of the vehicle (50), and based on the evaluated sensor data (11) at least one output (30) for controlling the vehicle (50) is generated and provided to a control unit (53) of the vehicle (50), wherein the AI-based information processing system (10) is verified by means of at least one test procedure (12-x) by means of a test device (2) arranged in a second control unit (54) of the vehicle (50).and wherein a test result (13-x) of the at least one test procedure (12-x) is stored with a reference to the tested AI-based information processing system (10) and to the at least one test procedure (12-x) used in a multidimensional data structure (20) in a database (6) arranged in the vehicle (50). The invention further relates to a corresponding device (1).