Remote 3D Surround View Rendering Across Vehicle ECUs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle systems with multiple cameras for surround view have inefficient computational workload distribution and lack scalability.
Innovation Solution
A distributed system with multiple ECUs, including an ADAS ECU for 3D model generation and rendering, and a media ECU for gesture processing, allows workload distribution across networked ECUs, enabling scalable surround view video generation and control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple cameras are used to generate surround view, then the visual coverage is improved, but the computational workload distribution becomes inefficient
Solution Approach 1:
The system divides the computational workload into distinct segments: the ADAS ECU performs camera feed reception and 3D model generation, while the media ECU handles gesture detection and video rendering. This segmentation allows each unit to specialize in specific tasks, improving overall efficiency while maintaining comprehensive visual coverage from multiple cameras.
Solution Approach 2:
The patent introduces a network communication interface as an intermediary between the ADAS ECU and media ECU. This intermediary enables efficient data exchange and coordinate transmission without requiring direct complex interconnections, thus improving computational workload distribution while maintaining system scalability.
2Manufacturing precision
If more cameras and processing units are added, then the surround view quality is improved, but the system scalability is reduced
Solution Approach 1:
The ADAS ECU is designed with multi-functionality, serving both as an advanced driver assistance system processor and as a surround view video generator. This universal design allows the same hardware to support multiple camera configurations and processing requirements, improving surround view quality while maintaining system scalability without additional dedicated wiring.
Solution Approach 2:
The system transitions from 2D camera feeds to a 3D model representation, enabling more flexible rendering and view generation. This dimensional change allows the system to accommodate varying numbers of cameras and processing units while maintaining high surround view quality, as the 3D model can be rendered from any viewpoint without requiring proportional increases in hardware complexity.
3Ease of operation
If gesture processing is integrated into the media ECU, then the user control flexibility is improved, but the computational load on the media ECU increases
Solution Approach 1:
The patent extracts gesture detection functionality from the overall processing burden and assigns it specifically to the media ECU, which is already dedicated to user interface and rendering tasks. This extraction allows the media ECU to handle gesture processing efficiently without significantly increasing overall computational load, as the ADAS ECU continues to focus on video generation while the media ECU manages interaction control.
Data Source
AI summary
A system comprises: a sensor configured to detect a gesture relating to a vehicle; a network; an electronic control unit (ECU) coupled to the network, a display device, and the sensor, the ECU providing media functionality for the vehicle, the ECU configured to present a surround view video on the display device, determine a gesture state and screen coordinates for the gesture, and send the gesture state and the screen coordinates over the network; cameras providing feeds; and an ECU coupled to the network and to the cameras, the ECU providing an advanced driver assistance system (ADAS) for the vehicle, the ECU configured to receive the gesture state and the screen coordinates over the network, generate the surround view video based on the feeds of the cameras and the gesture state and the screen coordinates, and send the surround view video over the network.