SerDes Link Image Segmentation for High-Bandwidth Camera Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current autonomous driving systems face challenges in transmitting high-resolution camera data due to bandwidth limitations in serializer/deserializer (SerDes) links, leading to information loss and increased delay, as existing methods like compression and reducing frame rates result in suboptimal performance.
Innovation Solution
A method that calculates the required transmission bandwidth, determines the maximum bandwidth capacity of each SerDes link, cuts image data into sub-images, assigns them to corresponding transmission areas, and splices them back into complete image data, fully utilizing each SerDes link to maintain data integrity and improve transmission efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If image data is compressed on the camera module side to fit SerDes link bandwidth, then transmission bandwidth is reduced to match link capacity, but information loss occurs leading to degraded image quality and potential loss of important details
Solution Approach 1:
The patent divides the high-resolution image data into multiple sub-images, with each sub-image assigned to a separate SerDes link for transmission. This segmentation allows the complete image data to be transmitted without compression across multiple parallel links, avoiding information loss while utilizing available bandwidth capacity.
2Quantity of substance
If only a subset of the entire image data is transmitted to meet SerDes link bandwidth limits, then transmission bandwidth is reduced to match link capacity, but pixels and information are wasted that are not seen by computing units
Solution Approach 1:
The patent segments the complete image data into multiple sub-images that are distributed across multiple SerDes links. This ensures that all pixel data is transmitted without selective cropping, eliminating wasted information while the segmentation allows efficient utilization of multiple transmission links.
3Quantity of substance
If the frame rate of the camera sensor is reduced to decrease data volume, then transmission bandwidth requirement is reduced to fit SerDes link capacity, but motion artifacts increase due to delay and rolling shutter effects
Solution Approach 1:
The patent segments image data across multiple SerDes links to maintain high frame rates without exceeding individual link bandwidth capacity. By distributing the data transmission load across parallel links, the system can process frames at higher rates, reducing temporal delay and motion artifacts while still fitting within SerDes link constraints.
4Loss of information
If multiple SerDes links are used to transmit complete high-resolution image data without compression, then information loss is avoided, but the complexity of data management and link coordination increases
Solution Approach 1:
The patent segments image data into sub-images for distribution across multiple SerDes links, maintaining data integrity without compression. The system manages the increased complexity through systematic assignment of sub-images to specific links and coordinated reception, balancing the trade-off between information preservation and management complexity.
Data Source
AI summary
A method for transmitting high bandwidth camera data through a SerDes links is provided. The method includes steps of: calculating transmission bandwidth required for transmitting image data, and the image data is obtained by a high bandwidth camera; determining a maximum bandwidth capacity of each SerDes link of a plurality of SerDes links; cutting the image data into a plurality of sub images according to the transmission bandwidth and the maximum bandwidth capacity of each SerDes link; assigning each sub image to a sub image transmission area in a corresponding SerDes link, and each SerDes link containing the sub image transmission area and the sub image reception area; acquiring a plurality of sub images transmitted in the plurality of the SerDes links from the corresponding sub image reception area; and splicing the plurality of sub images into the image data.