Autonomy and Teleoperations Validation for Deployment Readiness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing autonomous vehicle systems face challenges in accurately assessing readiness for deployment, as simulations may not fully capture real-world scenarios, leading to potential safety issues when autonomous vehicles are inaccurately evaluated.
Innovation Solution
A framework that combines simulation data with teleoperations data to determine whether an autonomous system, when used in conjunction with a teleoperations system, meets minimum deployment standards by processing metrics such as distance-driven and negative event rates, allowing for a more comprehensive evaluation of safety.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If simulations are used to test autonomous systems, then testing coverage and distance are improved, but accuracy in representing real-world scenarios deteriorates
Solution Approach 1:
The patent combines simulation data with teleoperations data to create a comprehensive validation framework. Simulation data provides extensive testing coverage while teleoperations data provides real-world accuracy, and their integration resolves the contradiction between coverage and precision.
Solution Approach 2:
Teleoperations data serves as an intermediary that bridges the gap between simulation and real-world deployment. It validates whether simulation results accurately reflect real-world performance, mediating between the controlled simulation environment and uncontrolled real-world conditions.
2Loss of time
If autonomous systems are deployed based on simulation data alone, then deployment speed is improved, but safety assessment accuracy deteriorates
Solution Approach 1:
The framework performs preliminary validation using teleoperations data before final deployment decisions are made. This preliminary action ensures that simulation-based assessments are verified against real-world performance, maintaining safety accuracy without significantly delaying deployment.
Solution Approach 2:
Teleoperations data provides feedback on the accuracy of simulation-based safety assessments. This feedback loop allows the system to verify whether simulation results correctly predict real-world performance, ensuring reliable safety assessment while maintaining efficient deployment timing.
3Device complexity
If only autonomy system data is used for validation, then validation simplicity is improved, but comprehensive safety assessment deteriorates
Solution Approach 1:
The validation framework segments the assessment into two distinct components: autonomy system performance (from simulation data) and teleoperations system performance (from teleoperations data). This segmentation allows each component to be evaluated independently while maintaining overall validation simplicity through modular processing.
Solution Approach 2:
The framework creates a universal validation approach that can assess both autonomy systems and teleoperations systems using the same methodology. This multi-functional validation process comprehensively evaluates safety for both systems without requiring entirely separate validation processes, maintaining simplicity while ensuring completeness.
Data Source
AI summary
According to one aspect, methods to validate an autonomy system in conjunction with a teleoperations system are provided. A computing device obtains simulation data of an autonomous driving system of a vehicle. The simulation data includes first environment data representing an environment in which the vehicle is driven using the autonomous driving system. The computing device obtains teleoperations driving data of a teleoperations driving system by which the vehicle is remotely controlled with an aid of a human. The teleoperations driving data includes second environment data representing the environment in which the vehicle is driven using the teleoperations driving system. The computing device determines whether the autonomous driving system in conjunction with the teleoperations driving system meets a minimum deployment standard based on the simulation data and the teleoperations driving data.