Driving Control Scenario Testing for State Transition Coverage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Testing intelligent driving systems requires comprehensive coverage of various real-world scenarios to identify vulnerabilities, which is complex and manpower-intensive, necessitating improved automated testing methods.
Innovation Solution
A scenario testing method and apparatus for driving control systems that utilize a simulation system with instrumentation to generate scenario examples, simulate real scenarios, and iteratively refine test cases based on feedback to achieve high test coverage and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If fuzz testing is used to automate scenario testing, then testing efficiency is improved, but test coverage of specific state transitions may be insufficient
Solution Approach 1:
The patent implements feedback mechanisms where the system monitors actual state transitions during testing and compares them against expected transitions from the state control diagram. Test results feed back into the testing process to identify uncovered transitions, which then become targets for generating new test scenarios. This closed-loop feedback ensures both automation efficiency and comprehensive coverage of all state transitions.
Solution Approach 2:
The testing system dynamically adapts its behavior based on test progress. It transitions from random fuzz testing to targeted scenario generation when specific state transitions are identified as uncovered. The system dynamically adjusts test scenario selection and generation strategies to optimize both efficiency and coverage throughout the testing process.
2Reliability
If manual analysis is used to achieve comprehensive scenario coverage, then test coverage is improved, but testing complexity and manpower requirements increase
Solution Approach 1:
The patent introduces an intermediary automated testing system that acts as a bridge between manual test design and system execution. This intermediary layer includes automated scenario generation, state transition monitoring, and test result analysis components that reduce the need for manual analysis while maintaining comprehensive coverage. The system automatically generates test scenarios based on state control diagrams and iteratively refines them to cover all transitions.
Solution Approach 2:
The testing process is segmented into distinct automated phases: state control diagram analysis, initial scenario generation, test execution, result analysis, and iterative refinement. Each phase is handled by specialized automated components, breaking down the complex testing task into manageable segments that can be executed and monitored systematically without requiring continuous manual intervention.
3Reliability
If more driving scenarios are tested, then vulnerability discovery is improved, but testing time and resources increase
Solution Approach 1:
The patent performs preliminary analysis of the state control diagram to identify all possible state transitions and their conditions before actual testing begins. Test scenarios are pre-generated to target specific state transitions, and the system prioritizes testing of critical or frequently occurring transitions. This preliminary preparation enables efficient vulnerability discovery without requiring exhaustive testing of all possible scenarios.
Solution Approach 2:
The testing system dynamically changes parameters such as scenario selection priorities, test depth, and scenario generation rates based on testing progress and identified vulnerabilities. When critical vulnerabilities are found in frequently traversed state transitions, the system intensifies testing in those areas while reducing effort in less critical paths, optimizing the balance between vulnerability discovery and testing time investment.
Data Source
AI summary
A testing method and apparatus of a driving control system, a medium, and a device. According to the method, a state transition diagram is input, and then the test coverage of each state transition in the state transition diagram is gradually implemented on the basis of the state transition diagram and by loop iterative variation of a scenario sample. When the loop iterative variation is performed, a simulation output of the scenario sample is used as a reference, so that the iteration process can quickly converge to the corresponding state transition to achieve the goal of coverage testing. The testing method and apparatus can intuitively test the processing capability and level of the driving control system for a driving environment, and exhibits high test efficiency.

