AV Sensor Fusion Streaming via Cloud Relay for Multiple Viewers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing autonomous vehicles face challenges in efficiently streaming sensor data to multiple endpoints without overburdening the vehicle's CPU or bandwidth, particularly in peer-to-peer streaming scenarios, limiting support for multiple viewers.
Innovation Solution
A cloud-based real-time streaming platform receives sensor data from autonomous vehicles and distributes it to multiple endpoints via multiple streams, with dynamic bit rate adjustments based on bandwidth availability and connection constraints, using encryption and authorization systems hosted in the cloud to manage data access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If peer-to-peer streaming is used to stream sensor data to multiple endpoints, then data transmission to multiple viewers is enabled, but the vehicle's CPU and bandwidth become overburdened
Solution Approach 1:
A cloud-based streaming server is introduced as an intermediary between the autonomous vehicle and multiple endpoint clients. The server receives sensor data from the vehicle via a first communication connection and distributes it to multiple clients via second communication connections, eliminating the need for the vehicle to directly manage multiple peer-to-peer connections. This mediator approach allows the vehicle to maintain minimal CPU and bandwidth usage while supporting multiple viewers.
2Productivity
If dynamic bit rate adjustments are implemented based on bandwidth availability, then efficient data streaming under varying network conditions is achieved, but system complexity increases
Solution Approach 1:
The streaming system dynamically adjusts the bit rate parameter of the data stream based on available network bandwidth. The streaming server monitors network conditions and modifies the data transmission rate accordingly, allowing efficient streaming under varying bandwidth conditions. This parameter-based adaptation enables the system to maintain optimal performance without requiring complex reconfiguration of the entire streaming architecture.
Data Source
AI summary
Systems and methods for encrypting and streaming AV sensor data and AV derived data. In particular, systems and methods are provided for receiving AV sensor data at a streaming platform and providing the received data to multiple endpoints. In some examples, the multiple endpoints are multiple viewers viewing the AV sensor data. In various examples, an AV transmits the AV sensor data to the streaming platform, and the AV sensor data can be transmitted from the streaming platform to multiple endpoints without any effect on AV central processing unit or bandwidth constraints. The AV sensor data can include multiple data streams that are layered and compressed for efficient streaming, and the streaming platform can receive real-time streamed data from the AV even as bandwidth and connection constraints vary. In various examples, the bit rate of the video ingestion from the AV can be changed based on bandwidth availability.