Vehicle Sideband Data Streaming for Synchronized Tele-Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous vehicles and similar systems face challenges in assessing complex road situations and requiring human oversight, as existing technologies struggle to synchronize relevant vehicle information with visual data in real-time, limiting effective tele-operation.
Innovation Solution
Transmitting sideband data synchronized with visual data, encapsulating vehicle information collected from sensors, formatted in JSON, YAML, or MessagePack, and encoded as RTP packets, to enable accurate correlation and display in a web browser for tele-operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If autonomous vehicles transmit visual data and vehicle information separately, then data transmission is simpler, but synchronization accuracy deteriorates
Solution Approach 1:
The patent combines visual data and vehicle information into a single synchronized data stream by embedding vehicle information (sideband data) within the visual data transmission protocol. This merging approach maintains synchronization accuracy while managing transmission complexity through unified protocol handling.
Solution Approach 2:
The patent introduces timing information as an intermediary element that mediates between visual data and vehicle information. This timing metadata acts as a synchronization marker that enables precise correlation between the two data types without requiring complex coordinated transmission mechanisms.
2Loss of information
If vehicle information is transmitted with high detail, then situational awareness improves, but data transmission bandwidth increases
Solution Approach 1:
The patent extracts only the most critical vehicle information elements (such as sensor data, operational status, and key metadata) and transmits them as sideband data. This selective extraction maintains high situational awareness quality while minimizing the bandwidth required for information transmission.
Solution Approach 2:
The patent applies different levels of detail to different types of data based on their importance. Critical safety-related information is transmitted with high detail, while less critical information uses compressed or summarized formats, optimizing bandwidth usage while preserving essential situational awareness.
3Measurement precision
If timing information is applied to correlate data, then synchronization accuracy improves, but processing time increases
Solution Approach 1:
The patent applies timing information at the point of data generation and transmission, rather than performing complex post-processing correlation. This preliminary tagging of data with timing metadata enables accurate synchronization to be achieved during the transmission phase, reducing subsequent processing time.
Data Source
AI summary
A system may generate visual data from a vehicle in a transportation network. The system may also generate sideband data from the vehicle. The sideband data may encapsulate a serialization of vehicle information collected using one or more sensors of the vehicle. In some implementations, the sideband data may be formatted according to JavaScript Object Notation (JSON) to enable reconstruction of the vehicle information by a server. The sideband data may be associated with timing information used to correlate the vehicle information to the visual data. The system may transmit a stream including the visual data and the sideband data to the server to enable tele-operation of the vehicle.