Remote Vehicle Teleoperation Over Cellular With Low-Latency Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing cellular wireless infrastructures face challenges in transmitting real-time streaming video data with low latency and quality due to packet routing delays and retransmit requests, making them unsuitable for remote vehicle control applications.
Innovation Solution
A remote vehicle control system that includes a vehicle-mounted sensor system with a video camera and distance mapping sensors, using forward error correction and prioritization of data packets transmitted over cellular networks via UDP, with a virtual control system for live video stream reconstruction and control instruction transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If TCP protocol is used to guarantee reliable packet delivery, then data transmission reliability is improved, but transmission latency increases making real-time video streaming impossible
Solution Approach 1:
The video data stream is segmented into individual frames, which are further divided into multiple packets. Each packet is independently transmitted and can be reassembled at the receiver, allowing selective retransmission of only lost packets rather than entire frames, thus reducing latency while maintaining reliability
Solution Approach 2:
Forward error correction codes are pre-calculated and embedded into the video data packets before transmission. This preliminary action enables the receiver to reconstruct lost or corrupted packets without requiring retransmission, reducing latency while ensuring data integrity
2Speed
If UDP protocol is used to increase transmission speed, then data transmission speed is improved, but data loss and corruption occur making real-time control unreliable
Solution Approach 1:
Forward error correction codes are pre-calculated and embedded into the video data packets before transmission. This preliminary action enables the receiver to reconstruct lost or corrupted packets without requiring retransmission, reducing latency while ensuring data integrity
Solution Approach 2:
The system implements selective acknowledgment feedback where the receiver sends ACK packets only for successfully received video frames. This feedback mechanism allows the transmitter to identify and retransmit only the specific packets that were lost or corrupted, maintaining high reliability while minimizing retransmission overhead
3Device complexity
If all video packets are transmitted with equal priority, then transmission simplicity is maintained, but critical video frames may be lost affecting control quality
Solution Approach 1:
Different priority levels are assigned to different video packets based on their importance. Key frames and packets containing critical control information are marked with higher priority and transmitted first, while less critical packets use lower priority channels. This local differentiation of quality ensures critical data is delivered reliably without significantly increasing overall system complexity
Data Source
AI summary
A remote vehicle control system includes a vehicle mounted sensor system including a video camera system for producing video data and a distance mapping sensor system for producing distance map data. A data handling system is used to compress and transmit both the video and distance map data over a cellular network using feed forward correction. A virtual control system acts to receive the video and distance map data, while providing a user with a live video stream supported by distance map data. Based on user actions, control instructions can be sent to the vehicle mounted sensor system and the remote vehicle over the cellular network.