Coverage Guided Bug Finding in Control Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional automated testing techniques are inefficient for verifying the proper operation of real-time control systems, particularly in automotive applications, often missing bugs and increasing design costs.
Innovation Solution
A computer-implemented method using a test processor to simulate control systems, select goal states, and determine faulty behaviors by dividing the state space into regions, selecting variables based on Euclidean distance, and loading control models to identify and verify faulty behaviors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional automated testing techniques are used for verification of real-time control systems, then the testing process is simpler to implement, but the testing efficiency is low and bugs are missed
Solution Approach 1:
The patent creates a virtual copy of the real-time control system through a control model that replicates the system's behavior and state space. This virtual model allows automated testing to efficiently explore various system states and identify bugs without requiring complex physical test setups, thereby improving testing efficiency while managing complexity through simulation rather than physical replication.
Solution Approach 2:
The patent replaces traditional mechanical/physical testing methods with a computational simulation approach. By substituting physical test equipment and manual testing procedures with an automated test processor that executes simulations on a control model, the system achieves higher testing efficiency and coverage while reducing the complexity associated with physical test infrastructure.
2Reliability
If traditional automated testing is used, then physical hardware testing is required, but testing costs increase and coverage is insufficient
Solution Approach 1:
The patent uses a virtual copy (control model) of the control system to perform testing, eliminating the need for extensive physical hardware testing. This virtual replication allows comprehensive bug detection through automated exploration of the state space while significantly reducing testing costs by avoiding the expenses associated with physical test equipment, hardware loops, and manual testing procedures.
3Reliability
If the state space is thoroughly explored to ensure even coverage, then bug detection improves, but the testing time increases
Solution Approach 1:
The patent performs preliminary actions by automatically selecting goal states and system states that guide the exploration of the state space. The test processor pre-determines which states to explore based on coverage criteria, allowing thorough test coverage to be achieved systematically rather than through exhaustive brute-force exploration, thereby reducing the time required while maintaining high reliability.
Solution Approach 2:
The patent implements feedback mechanisms where the test processor monitors the exploration progress and adjusts the selection of goal states and system states based on coverage metrics. This feedback-driven approach ensures that the state space is explored efficiently with even coverage, directing testing efforts toward unexplored or under-explored regions while avoiding redundant testing, thus balancing thorough coverage with reduced testing time.
Data Source
AI summary
A computer-implemented method for automatically identifying a faulty behavior of a control system. The method includes receiving, at a test processor, a description of the faulty behavior. The method also includes selecting, using the test processor, a goal state based on a heuristic decision. The method also includes selecting, using the test processor, a selected system state. The method also includes selecting, using the test processor, a selected variable to the control system based on the goal state. The method also includes loading, from a memory, a control model of the control system. The method also includes performing, using the test processor, a simulation of the control model using the selected variable and the selected system state as parameters of the simulation. The method also includes determining, using the test processor, whether the faulty behavior was observed based on the simulation.