Remote Assistance Interface Control Under AV Data Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous vehicles (AVs) face challenges in maintaining situational awareness and making accurate decisions due to latency or absence of data in remote assistance systems, leading to potential safety and performance issues.
Innovation Solution
The system dynamically adjusts remote assistance actions based on latency or missing data by disabling or restricting actions that require up-to-date information, ensuring safety and performance by preventing outdated or incorrect interventions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If remote assistance actions are enabled without data latency checks, then system responsiveness and operator control are improved, but safety and decision-making accuracy deteriorate due to outdated information
Solution Approach 1:
The system dynamically adjusts the availability of remote assistance actions based on real-time data latency conditions. When latency exceeds thresholds, the system automatically disables or restricts certain actions, creating a dynamic control mechanism that adapts to changing network conditions while maintaining safety
Solution Approach 2:
The system implements feedback loops that continuously monitor data latency and adjust remote assistance capabilities accordingly. Latency metrics are fed back to the control system, which then modifies action availability to prevent decisions based on outdated information
2Ease of operation
If all remote assistance actions are always available, then ease of operation is improved, but harmful interventions may occur due to outdated or missing data
Solution Approach 1:
The system preemptively disables or restricts remote assistance actions that could lead to harmful interventions when data latency thresholds are exceeded. By preventing potentially harmful actions before they can be executed, the system protects against outdated interventions while still allowing safe actions to proceed
3Device complexity
If data latency is not accounted for in remote assistance, then system complexity is reduced, but safety and performance deteriorate
Solution Approach 1:
The system performs preliminary latency checks and assessments before enabling or disabling remote assistance actions. By proactively evaluating data freshness and determining action availability in advance, the system ensures safety without requiring complex real-time adjustments during critical moments
Data Source
AI summary
Systems and techniques are provided for dynamically controlling remote assistance system for an autonomous vehicle (AV) based on delayed or missing data. An example process includes determining a delay in receiving data from an AV at a first period of time and identifying a task for the remote assistance system at the first period of time. The task can include one or more actions corresponding to one or more input elements on a remote assistance interface. The example process further includes determining a dependence of the task on the data at the first period of time based on one or more parameters, and based on the dependence of the task on the data, adjusting at least one of the one or more input elements of the remote assistance interface and the one or more actions associated with the one or more input elements.