Vehicle Control Software Verification Using Sensor Output Comparison
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing software verification methods require significant time and resources to evaluate new software versions, struggle with performance determination between old and new software, and face challenges in identifying inappropriate outputs, especially when similar results are obtained.
Innovation Solution
A software verification system that utilizes sensor data from vehicles to detect degradation in new control software by comparing outputs from current and new software versions, using additional information from radar and camera sensors to determine performance changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If new software is executed in the background separately from old software using Shadow Mode technique, then software verification can be performed in real vehicle, but enormous time is required to evaluate all execution results
Solution Approach 1:
The patent extracts only the necessary comparison information (output results of old and new software) from the entire execution process, rather than evaluating all execution results. This selective extraction of critical data points enables rapid performance determination while maintaining verification accuracy.
Solution Approach 2:
The system performs preliminary comparison of software outputs during normal operation, identifying performance changes before formal verification is needed. This preliminary action allows the system to pre-identify degradation cases, reducing the time required for comprehensive evaluation.
2Reliability
If old software and new software are executed side by side or in parallel, then software verification can be exclusively performed, but it is difficult to perform performance determination and enormous work man-hours are required
Solution Approach 1:
The system implements automated performance determination that performs itself without human intervention. The automated determination unit compares software outputs and automatically identifies performance degradation, eliminating the need for manual analysis and significantly reducing work effort while maintaining comprehensive verification.
Solution Approach 2:
The system provides automated feedback on software performance by continuously comparing old and new software outputs. This feedback mechanism automatically identifies degradation cases and triggers appropriate verification actions, reducing manual effort while ensuring complete verification coverage.
3Stability of the object's composition
If same output is performed in both old software and new software, then consistency is maintained, but it is difficult to perform evaluation because difference between execution results cannot be obtained
Solution Approach 1:
The system applies different evaluation criteria to different output characteristics. For completely identical outputs, it confirms stability; for nearly identical outputs, it performs detailed difference analysis; for different outputs, it triggers comprehensive verification. This localized quality approach maintains consistency while enabling precise detection of subtle performance changes.
Data Source
AI summary
A software verification system and the like that can facilitate improvement of software using sensor data of a vehicle as an input are provided. The software verification system detects (performance determining unit 118) a degradation of a new version of control software using, first information that is an output of a current version of control software used for control of a vehicle using, as an input, sensor data from a sensor mounted on the vehicle, second information that is an output of the new version of control software not used for the control of the vehicle using, as an input, the sensor data, and third information relating to the control of the vehicle other than the first and second information; and verifies the new version of control software by using the sensor data when the degradation is detected.