Driving Control Scenario Testing for State Transition Coverage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Testing intelligent driving systems requires comprehensive coverage of various real-world scenarios to identify vulnerabilities, which is complex and manpower-intensive, necessitating improved automated testing methods.

Innovation Solution

A scenario testing method and apparatus for driving control systems that utilize a simulation system with instrumentation to generate scenario examples, simulate real scenarios, and iteratively refine test cases based on feedback to achieve high test coverage and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If fuzz testing is used to automate scenario testing, then testing efficiency is improved, but test coverage of specific state transitions may be insufficient

Engineering Contradiction:
Improvetesting efficiencyVSAvoidtest coverage
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements feedback mechanisms where the system monitors actual state transitions during testing and compares them against expected transitions from the state control diagram. Test results feed back into the testing process to identify uncovered transitions, which then become targets for generating new test scenarios. This closed-loop feedback ensures both automation efficiency and comprehensive coverage of all state transitions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The testing system dynamically adapts its behavior based on test progress. It transitions from random fuzz testing to targeted scenario generation when specific state transitions are identified as uncovered. The system dynamically adjusts test scenario selection and generation strategies to optimize both efficiency and coverage throughout the testing process.

Inventive Principle:
Principle #15Dynamics

2Reliability

If manual analysis is used to achieve comprehensive scenario coverage, then test coverage is improved, but testing complexity and manpower requirements increase

Engineering Contradiction:
Improvetest coverageVSAvoidtesting complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary automated testing system that acts as a bridge between manual test design and system execution. This intermediary layer includes automated scenario generation, state transition monitoring, and test result analysis components that reduce the need for manual analysis while maintaining comprehensive coverage. The system automatically generates test scenarios based on state control diagrams and iteratively refines them to cover all transitions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The testing process is segmented into distinct automated phases: state control diagram analysis, initial scenario generation, test execution, result analysis, and iterative refinement. Each phase is handled by specialized automated components, breaking down the complex testing task into manageable segments that can be executed and monitored systematically without requiring continuous manual intervention.

Inventive Principle:
Principle #1Segmentation

3Reliability

If more driving scenarios are tested, then vulnerability discovery is improved, but testing time and resources increase

Engineering Contradiction:
Improvevulnerability discoveryVSAvoidtesting time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary analysis of the state control diagram to identify all possible state transitions and their conditions before actual testing begins. Test scenarios are pre-generated to target specific state transitions, and the system prioritizes testing of critical or frequently occurring transitions. This preliminary preparation enables efficient vulnerability discovery without requiring exhaustive testing of all possible scenarios.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The testing system dynamically changes parameters such as scenario selection priorities, test depth, and scenario generation rates based on testing progress and identified vulnerabilities. When critical vulnerabilities are found in frequently traversed state transitions, the system intensifies testing in those areas while reducing effort in less critical paths, optimizing the balance between vulnerability discovery and testing time investment.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260111336A1Scenario test method and apparatus for driving control system, medium, and device
Publication Date: 2026.04.23 NANJING UNIV
  • US20260111336A1 patent drawing
  • US20260111336A1 patent drawing

AI summary

A testing method and apparatus of a driving control system, a medium, and a device. According to the method, a state transition diagram is input, and then the test coverage of each state transition in the state transition diagram is gradually implemented on the basis of the state transition diagram and by loop iterative variation of a scenario sample. When the loop iterative variation is performed, a simulation output of the scenario sample is used as a reference, so that the iteration process can quickly converge to the corresponding state transition to achieve the goal of coverage testing. The testing method and apparatus can intuitively test the processing capability and level of the driving control system for a driving environment, and exhibits high test efficiency.