Vehicle Camera-Radar Coordination for Low-Bandwidth Image Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current in-vehicle electronic control devices face high transmission bandwidth requirements for raw image data from high-resolution cameras, leading to increased costs due to the need for expensive cables and communication components, and existing methods fail to effectively reduce transmission bandwidth.
Innovation Solution
The system employs a radar sensor to detect three-dimensional objects and specify necessary data, allowing the camera to capture and transmit high-resolution partial images only when required, reducing data transmission and using the radar's detection information to coordinate the image capture and transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If uncompressed raw image data is transmitted from high-resolution camera to control unit, then recognition accuracy and real-time performance are improved, but transmission bandwidth requirement increases to several hundred MB/sec
Solution Approach 1:
The patent extracts and transmits only the necessary partial image data (region of interest) instead of the entire high-resolution image. The control unit identifies specific regions requiring detailed recognition and requests only those portions from the camera, thereby reducing transmission bandwidth while maintaining recognition accuracy for critical areas.
Solution Approach 2:
The patent segments the high-resolution image into multiple regions, transmitting only the relevant segments (partial images) that contain objects of interest for recognition. This segmentation approach divides the large image data into smaller, manageable portions that can be transmitted efficiently based on actual recognition needs.
2Speed
If expensive cable and communication transceiver LSI are used to support high bandwidth transmission, then real-time performance is improved, but system cost increases
Solution Approach 1:
The patent extracts and transmits only the necessary partial image data (region of interest) instead of the entire high-resolution image. The control unit identifies specific regions requiring detailed recognition and requests only those portions from the camera, thereby reducing transmission bandwidth while maintaining recognition accuracy for critical areas.
Solution Approach 2:
The patent applies partial action by transmitting only the minimum necessary image data (specific regions) rather than complete images. This partial transmission approach achieves real-time performance for critical recognition tasks without requiring the full bandwidth capacity that would necessitate expensive communication hardware.
3Measurement precision
If 8K camera with higher resolution is used, then recognition accuracy is improved, but transmission bandwidth requirement increases further
Solution Approach 1:
The patent extracts and transmits only the necessary partial image data (region of interest) instead of the entire high-resolution image. The control unit identifies specific regions requiring detailed recognition and requests only those portions from the camera, thereby reducing transmission bandwidth while maintaining recognition accuracy for critical areas.
Solution Approach 2:
The patent segments the high-resolution image into multiple regions, transmitting only the relevant segments (partial images) that contain objects of interest for recognition. This segmentation approach divides the large image data into smaller, manageable portions that can be transmitted efficiently based on actual recognition needs.
Data Source
AI summary
Image data captured from a traveling vehicle is considered, and it is not possible to reduce the transmission band of the image data. It is assumed that a radar 4 mounted in a traveling vehicle 10 detects a certain distant three-dimensional object at a time T in a direction of a distance d1 [m] and an angle θ1. Since the vehicle 10 travels at a vehicle speed Y [km/h], it is predicted that a camera 3 is capable of capturing the distant three-dimensional object at a time (T+ΔT) and an angle ϕ1 or at a distance d2 [m]. Therefore, if a control unit 2 outputs a request to the camera 3 in advance, so as to cut out an image of the angle ϕ1 or the distance d2 [m] at the time (T+ΔT), when the time (T+ΔT) comes, the camera 3 transfers a whole image and a high-resolution image being a cutout image of only a partial image, to the control unit 2.