Camera-Radar Data Bundling via CSI-2 Gap Multiplexing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems require separate processing units and cables for camera and radar data transmission, leading to high effort and complexity in ADAS applications, due to differing data rates and wire pair requirements.

Innovation Solution

A device utilizing a multiplexer and buffer to bundle camera and radar data channels via a point-to-point connection, leveraging the CSI-2 protocol, where the multiplexer inserts radar data into gaps in the camera data stream, optimizing data transmission without significant delay.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate processing units and cables are used for camera and radar data transmission, then data transmission reliability is improved, but device complexity and system size increase

Engineering Contradiction:
Improvedata transmission reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines camera and radar data transmission into a single shared data channel using multiplexing. The multiplexer alternates between transmitting camera data and radar data over the same physical connection, eliminating the need for separate cables and processing units while maintaining reliable data transmission for both sensor types.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The shared data channel is designed to serve multiple functions by accommodating both camera data streams and radar data streams through time-division multiplexing. This universal channel replaces what would traditionally require dedicated dedicated channels for each sensor type, reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If separate processing units are implemented for each sensor type, then data processing accuracy is improved, but manufacturing effort and cost increase

Engineering Contradiction:
Improvedata processing accuracyVSAvoidmanufacturing effort
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent merges the processing functions into a single processing unit that handles both camera and radar data. The multiplexer and buffer mechanism allows one processing unit to accurately handle different data types by time-division multiplexing, reducing manufacturing effort while maintaining processing accuracy through proper data sequencing and timing.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If dedicated receiver is available for each sensor type, then data transmission reliability is improved, but device complexity increases

Engineering Contradiction:
Improvedata transmission reliabilityVSAvoidreceiver complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a universal receiver that can process both camera and radar data through the shared multiplexed channel. The receiver includes a demultiplexer that separates the combined data stream back into distinct camera and radar data streams, maintaining reliable reception for both sensor types while using a single receiver unit instead of separate dedicated receivers.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3818448B1Bundling of camera and radar raw data channels
Publication Date: 2026.03.04 AUMOVIO AUTONOMOUS MOBILITY GERMANY GMBH
  • EP3818448B1 patent drawingFigure 1
  • EP3818448B1 patent drawingFigure 2
  • EP3818448B1 patent drawingFigure 3

AI summary

The invention relates to an apparatus and a method for bundling two data channels via a point-to-point connection, for example on the basis of a CSI-2 protocol, in particular for bundling camera and radar raw data channels. In this case, sequences of data from a first data channel are transmitted via a first line (310) and sequences of data from a second data channel are transmitted via a second line (210) to a multiplexer (450). The first data channel transmits camera raw data and the second data channel transmits raw data from a radar, lidar, ultrasonic and/or laser system. In this case, a data gap (312) having a predefined size is arranged between two sequences of first data (311) in each case. The data from the second data channel are transmitted to a buffer (457) and, if the buffer (457) has been filled with second data (211) of a predefined size, are inserted into the data (311) from the first data channel. A third data channel is formed at the output of the multiplexer (450) using these first data (311) and second data (211) and is transmitted to a third line (110). The third data channel therefore has a bundling of sequences of first data (311) and sequences of second data (211).