GMSL to CSI Video Data Conversion for GPU Interfacing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current solutions for interfacing high optical resolution cameras with GPUs are inefficient and costly, requiring multiple field-programmable gate arrays (FPGAs) and less efficient compression methods like H.264, which are not compatible with high-resolution video formats needed for autonomous vehicle applications.
Innovation Solution
A method and system using gigabit multimedia serial link (GMSL) conversion modules to convert n-bit length serial video data from high-resolution cameras to m-bit length serial GMSL video data, which is then converted to m-bit length serial camera series interface (CSI) data compatible with GPUs, utilizing de-serializers, multiplexers/FIFOs, and serializers to achieve efficient data processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional solutions use multiple FPGAs to convert video streams, then camera-GPU interfacing is achieved, but system complexity and cost increase significantly
Solution Approach 1:
The patent combines multiple separate FPGA conversion functions into a single integrated GMSL-to-CSI conversion module. This module directly converts GMSL video streams to CSI format without requiring separate FPGAs for each camera, thereby reducing system complexity while maintaining the ability to interface multiple cameras with the GPU.
Solution Approach 2:
The patent introduces a standardized CSI interface as an intermediary between cameras and the GPU. This intermediary layer provides a universal communication protocol that simplifies the interfacing process, eliminating the need for custom FPGA conversion logic for each camera model and reducing overall system complexity.
2Adaptability or versatility
If H.264 compression is used for video encoding, then compatibility is maintained, but compression efficiency is insufficient for high-resolution video
Solution Approach 1:
The patent changes the compression standard parameter from H.264 to H.265/HEVC, which provides superior compression efficiency for high-resolution video while maintaining broad compatibility through widespread decoder support. This parameter change enables more efficient handling of high-bitrate video streams from high-resolution cameras.
3Productivity
If high pixel count cameras are used for direct GPU interfacing, then data rate compatibility is achieved, but optical resolution at long range is insufficient
Solution Approach 1:
The patent introduces the CSI interface as an intermediary that decouples the camera's native video format from the GPU's data bus requirements. This intermediary layer handles format conversion and data rate adaptation, enabling high-resolution cameras to interface with GPUs without requiring the cameras to match specific data rate specifications.
Data Source
AI summary
Systems, methods, and apparatus for converting serial video data for a graphics processing unit (GPU) interface are disclosed. In one or more embodiments, a disclosed method comprises receiving, by each of a plurality of gigabit multimedia serial link (GMSL) conversion modules, n-bit length serial video data from a plurality of high-resolution cameras respectively. The method further comprises converting, by each of the GMSL conversion modules, the n-bit length serial video data to m-bit length serial GMSL video data, where n is equal to twice m. Also, the method comprises receiving, by a GMSL to camera series interface (CSI) conversion unit, the m-bit length serial GMSL video data from each of the GMSL conversion modules. Further, the method comprises converting, with the GMSL to CSI conversion unit, the m-bit length serial GMSL video data to m-bit length serial CSI video data, which is compatible with the GPU interface.