Context-Aware Surround View via RSU Data Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Surround view systems in vehicles are limited to immediate surroundings, lacking the ability to provide a comprehensive view of distant objects, vehicles, or events, which restricts the driver's ability to make efficient driving decisions.
Innovation Solution
A system that utilizes a controller in vehicles to receive status information from remote sources, identify suitable remote sources based on request requirements, and direct them to stream surround view system data, allowing the vehicle to generate a large-scale surround view by synthesizing data from multiple sources, including edge servers and roadside units.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If onboard cameras are used to generate surround view, then the system can provide a complete view of immediate surroundings, but the view is limited to the immediate surroundings of the vehicle and cannot capture distant objects or events
Solution Approach 1:
The patent combines data from multiple sources: onboard cameras and remote infrastructure cameras (RSUs, edge servers) are merged to create a comprehensive large-scale surround view. This merging extends the coverage area beyond what single onboard cameras can capture while maintaining complete information about both immediate and distant surroundings.
Solution Approach 2:
The system transitions from a local three-dimensional view (immediate surroundings captured by onboard cameras) to a large-scale two-dimensional map view (distant objects and events captured by remote infrastructure). This dimensional change allows the system to overcome the distance limitation of onboard cameras by incorporating aerial or remote perspective data.
2Loss of information
If multiple remote sources are coordinated to stream data, then comprehensive large-scale surround view can be achieved, but the system complexity increases
Solution Approach 1:
The vehicle's controller acts as an intermediary that receives status information from multiple remote sources, identifies suitable sources based on requirements, and coordinates data streaming. This intermediary approach manages the complexity of coordinating multiple remote sources by centralizing the selection and coordination logic within the vehicle system.
Solution Approach 2:
The system performs preliminary identification of suitable remote sources based on status information and requirements before initiating data streaming. This preliminary action reduces coordination complexity by pre-filtering and selecting appropriate sources, so that during operation, the system only needs to manage data from already-selected sources rather than continuously evaluating all possible sources.
Data Source
AI summary
In accordance with one embodiment of the present disclosure, a system for generating surrounding views includes a controller. The controller may be programmed to perform operations including receiving a status information from a remote source, receiving a surround view system (SVS) request having a set of requirements from a vehicle, identifying one or more remote sources based on the status information of the one or more remote sources and the set of requirements of the SVS request, and directing the one or more remote sources to stream SVS data to the vehicle.