Vehicular Micro Cloud Camera Stitching for Remote Driving
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional remote driving systems for vehicles face challenges in providing comprehensive environmental views, as onboard cameras can be obstructed, damaged, or limited, leading to 'blind spots' that pose safety risks due to inadequate coverage.
Innovation Solution
A vehicular micro cloud system is formed by communicating with multiple vehicles equipped with cameras, tracking their positions, and selecting a set of vehicles to transmit live video streams to an external controller, stitching these streams into panoramic views that provide at least 270-degree or 360-degree coverage around the vehicle.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple vehicles are used to form a vehicular micro cloud for providing panoramic views, then the coverage area and situational awareness are improved, but the system complexity and communication overhead increase
Solution Approach 1:
The system divides the panoramic view coverage task into multiple segments, with each vehicle in the micro cloud responsible for capturing and transmitting video from its specific location. The remote operator's field of view is segmented into multiple zones, each monitored by a different vehicle camera, thereby expanding overall coverage while distributing system complexity across multiple independent units.
Solution Approach 2:
Multiple video streams from different vehicles in the micro cloud are merged and stitched together to form a comprehensive panoramic view. The system combines the capabilities of multiple vehicles' cameras, processors, and communication systems to create a unified enhanced view that exceeds what any single vehicle could provide alone.
2Loss of information
If vehicles in the micro cloud transmit live video streams continuously, then the real-time information availability is improved, but the energy consumption and data transmission load increase
Solution Approach 1:
Instead of continuous transmission, the system implements periodic video stream transmission where vehicles in the micro cloud send video frames at optimized intervals. The transmission frequency is adjusted based on the dynamic situation, transmitting more frequently when changes are detected and less frequently during stable conditions, thereby maintaining information availability while reducing energy consumption.
Solution Approach 2:
The system maintains continuous monitoring capability through the micro cloud network, ensuring that at least one vehicle is always capturing and ready to transmit relevant video information. While individual vehicles may enter low-power states between transmissions, the collective system maintains continuous useful action through coordinated monitoring and on-demand transmission triggered by detected events or time-synchronized intervals.
Data Source
AI summary
Systems and methods for controlling a view, provided by a vehicular micro cloud associated with a remotely supported vehicle, can include communicating with a plurality of vehicles in a vicinity of the remotely supported vehicle to collectively form a vehicular micro cloud. Each of the plurality of vehicles being equipped with at least one camera can track respective positions of the plurality of vehicles relative to the remotely supported vehicle. A set of vehicles can be selected from among the plurality of vehicles. A live video stream can be received from each of the set of vehicles. The live video stream can be transmitted to an external controller.