Vehicle Command Normalization for Low-Latency Remote Teleoperation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote vehicle control systems face challenges in maintaining low latency and managing inconsistencies due to bandwidth constraints and varying vehicle and environmental conditions during teleoperation, which can impact safety and operational efficiency.
Innovation Solution
A vehicle system that normalizes operations locally using primary and auxiliary sensor data to transform control commands and stabilize vehicle parameters, allowing for reduced data transmission and enhanced safety by compensating for conditions unknown to the remote support server.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If real-time video and telemetry data are transmitted to a remote server for processing, then remote operation capability is improved, but network bandwidth consumption increases and latency increases
Solution Approach 1:
The patent segments the data transmission by categorizing sensor data into primary (essential for remote operation) and auxiliary (local context information). Only primary sensor data is transmitted to the remote server, while auxiliary data is processed locally to transform control commands. This segmentation reduces network bandwidth consumption while maintaining remote operation capability.
Solution Approach 2:
The patent introduces a local processing dimension at the vehicle level, transforming the traditional centralized remote processing model into a distributed architecture. The vehicle's onboard system performs local normalization and command transformation, adding a computational layer that reduces the need for transmitting all raw sensor data, thereby reducing bandwidth consumption and latency.
2Speed
If control commands are transmitted in real-time from remote server to vehicle, then remote control responsiveness is improved, but network latency increases due to bandwidth constraints
Solution Approach 1:
The system performs preliminary local processing of control commands using auxiliary sensor data before execution. The onboard normalization engine pre-adjusts commands based on locally available contextual information (vehicle state, environmental conditions), reducing the need for iterative remote adjustments and minimizing the impact of network latency on control responsiveness.
Solution Approach 2:
The patent introduces an intermediary normalization engine at the vehicle level that acts as a buffer between the remote server and vehicle actuators. This intermediary transforms and adapts control commands locally, compensating for delays in command transmission and ensuring responsive vehicle control even under network latency conditions.
3Measurement precision
If comprehensive sensor data is collected and transmitted, then accuracy of remote operation is improved, but data transmission volume increases causing bandwidth issues
Solution Approach 1:
The patent applies local quality by processing auxiliary sensor data locally at the vehicle level rather than transmitting it. The normalization engine uses locally available auxiliary data (vehicle state, environmental conditions) to enhance the accuracy of control command execution, while only transmitting essential primary sensor data to the remote server, thus maintaining operational accuracy without increasing data transmission volume.
4Reliability
If vehicle parameters are stabilized locally using auxiliary sensor data, then operational safety is improved, but local processing complexity increases
Solution Approach 1:
The vehicle's onboard normalization engine performs self-service by autonomously processing auxiliary sensor data and transforming control commands based on locally detected conditions. The system independently adjusts commands to account for vehicle state and environmental factors without requiring constant remote intervention, thereby improving operational safety while keeping the processing architecture relatively simple and decentralized.
Data Source
AI summary
In a vehicle system that can receive remote support from a remote support server (e.g., interfacing with a human or computer teleoperator), a local normalization engine locally normalizes operation of the vehicle based on locally available sensor data that may not be accessible to the remote support server. The local normalization engine applies transformations to control commands received from the remote support server to transform the command to compensate for conditions that are locally sensed and may be unknown to the remote support server. Alternatively, or in addition, the local normalization engine controls auxiliary functions of the vehicle (e.g., by activating one or more auxiliary actuators) that may not be under direct control of the remote support server.