A video acquisition and output system

By combining four fiber optic cameras, an optoelectronic receiver module, and a video aggregation chip, the problems of low integration, high latency, and poor anti-interference in vehicle-mounted camera video transmission systems are solved, achieving efficient and low-cost video signal processing and transmission.

CN224987494UActive Publication Date: 2026-11-17FULONG TECH CHENGDU CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202522351876.7
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2025-11-06
Publication Date
2026-11-17
Estimated Expiration
2035-11-06

AI Technical Summary

Technical Problem

Existing vehicle-mounted camera video transmission systems suffer from signal delay, poor anti-interference, and low system integration in high-resolution and complex electromagnetic environments. In particular, they are complex in structure, expensive, and require large board area when processing multi-channel fiber optic signals.

Method used

It employs four fiber optic cameras, an optoelectronic receiver module, and a video aggregation chip. A single video aggregation chip (such as LT934LM) aggregates four low-voltage differential signals into a single MIPI signal for transmission to the SoC, simplifying the SoC's interface requirements. Frame synchronization and data processing are achieved through the I²C bus.

Benefits of technology

A highly integrated, low-latency, and highly interference-resistant video transmission system has been developed, reducing PCB area and cost while meeting the real-time requirements of advanced driver assistance systems in vehicles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN224987494U_ABST
    Figure CN224987494U_ABST
Patent Text Reader

Abstract

This invention discloses a four-channel surround-view camera video acquisition and MIPI output system based on fiber optic transmission, aiming to provide a highly integrated, extremely low-latency, and strong anti-interference solution. The system converts the optical signals output from four fiber optic cameras into four parallel LVDS electrical signals via an optoelectronic receiving module. A single video aggregation chip maps and encapsulates the YUV422 video streams carried by the four LVDS inputs into four MIPI channels, and transmits them to the main control SoC via a single MIPI CSI-2 4-lane physical interface. Compared to existing multi-stage conversion or multi-chip solutions, this system offers advantages such as high integration, low cost, low latency, and simplified interface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This utility model relates to the field of vehicle electronic technology, and more specifically, to a video signal acquisition and transmission system for a vehicle driver assistance system, particularly a four-channel surround-view camera video acquisition and MIPI output system based on fiber optic transmission. Background Technology

[0002] In modern Advanced Driver Assistance Systems (ADAS), 360-degree surround view systems play a crucial role. These systems typically involve mounting cameras at the front, rear, left, and right of the vehicle to capture real-time images of the surrounding environment. Currently, the mainstream methods for transmitting video from these in-vehicle cameras include coaxial differential (such as LVDS) or in-vehicle Ethernet.

[0003] However, as camera resolution increases, the required data transmission bandwidth also increases dramatically. Simultaneously, the interior of vehicles (especially new energy vehicles) presents a complex and strong electromagnetic environment, making traditional cable transmission methods (such as coaxial cables) susceptible to electromagnetic interference (EMI), leading to video signal degradation or loss. Furthermore, cable harnesses are complex to install, heavy, and have limited transmission distances for high-speed electrical signals.

[0004] Fiber optic transmission technology possesses inherent advantages such as large transmission bandwidth, strong resistance to electromagnetic interference, long transmission distance, and light weight, making it an ideal solution to the aforementioned problems. However, applying fiber optic technology to in-vehicle surround view systems still faces challenges. When the optical signal from the camera is transmitted to the vehicle's system-on-a-chip (SoC), it must undergo photoelectric conversion and further be converted into a MIPI CSI-2 signal that the SoC can directly process.

[0005] Existing solutions for processing multiple fiber optic signals are often structurally complex. They require four independent optoelectronic conversion modules, each connected to one of four deserializer chips, and then input to the SoC via four MIPI interfaces. This necessitates that the SoC have a sufficient number of MIPI input ports. Alternatively, multi-stage conversion and FPGA-based signal aggregation can be used, resulting in low system integration, high cost, large PCB area, and additional signal delay introduced at each conversion stage.

[0006] Therefore, there is an urgent need in this field for a highly integrated acquisition system that can centrally process the signals from four fiber optic cameras and output them directly to the SoC via a single MIPI interface, in order to simplify the structure, enhance anti-interference capabilities, and reduce signal delay. Utility Model Content

[0007] The main objective of this invention is to overcome the shortcomings of existing technologies and provide a highly integrated, low-latency, and highly interference-resistant four-channel surround-view camera video acquisition and MIPI output system based on fiber optic transmission, comprising:

[0008] At least four fiber optic cameras are used to capture video and output optical signals;

[0009] At least four photoelectric receiving modules, each corresponding to one of the fiber optic cameras, are used to convert the received optical signals into four parallel low-voltage differential signals.

[0010] A video aggregation chip has at least four low-voltage differential signal input interfaces and one MIPI output interface, wherein the four low-voltage differential signal input interfaces are respectively connected to the output terminals of the four-channel photoelectric receiving modules;

[0011] A main control SoC, whose MIPI input interface is connected to the output interface of the video aggregation chip;

[0012] The video aggregation chip is configured to encapsulate the received video streams carried by four low-voltage differential signals into four independent MIPI channels, and transmit them to the SoC via a single MIPI physical link. In a preferred embodiment, the MIPI CSI-2 signal adopts a single-channel 4-lane physical structure, which greatly simplifies the interface requirements on the SoC side while ensuring sufficient bandwidth.

[0013] In one possible implementation, the video aggregation chip integrates at least four LVDS receivers and one MIPI transmitter.

[0014] In one possible implementation, in the aforementioned video acquisition and output system, the SoC is connected to the video aggregation chip via an I²C bus for configuring and controlling the video aggregation chip.

[0015] In one possible implementation, in the aforementioned video acquisition and output system, the SoC configures the VC channel mapping register of the video aggregation chip through the I²C bus, binding each low-voltage differential signal input to a specific channel.

[0016] In one possible implementation, in the aforementioned video acquisition and output system, the SoC configures the video aggregation chip through the I²C bus to achieve frame synchronization of four cameras. The frame synchronization control method includes, but is not limited to: the SoC issuing a synchronization trigger pulse to simultaneously control four fiber optic receivers or cameras through the synchronization signal pin of the video aggregation chip.

[0017] In one possible implementation, the aforementioned video acquisition and output system, wherein the SoC is configured to parse data from four channels of MIPI signals transmitted via the single MIPI physical link, and directly perform surround view stitching algorithm processing on the acquired YUV422 video data without performing video decoding operations.

[0018] In one possible implementation, the aforementioned video acquisition and output system, wherein the video aggregation chip also has a built-in clock data recovery function, used to extract clock information from the input low-voltage differential signal, thereby performing timing alignment and synchronization processing on the four input data channels.

[0019] In one possible implementation, the aforementioned video acquisition and output system transmits the optical signal via single-mode or multi-mode optical fiber to ensure the interference resistance of video data transmission from the vehicle periphery to the central processing unit.

[0020] The beneficial effects of this utility model are as follows:

[0021] High integration and low cost: The use of a single video aggregation chip (such as LT934LM) replaces the traditional "multiplexer" or "FPGA" solution, which simplifies hardware design and reduces PCB area and BOM cost.

[0022] Low latency: The entire transmission link (camera -> fiber optic -> aggregation chip -> SoC) requires no video encoding or decoding. The SoC directly obtains the raw YUV422 data for processing, meeting the stringent real-time requirements of advanced driver assistance systems in vehicles.

[0023] Strong anti-interference capability: The long-distance video transmission of the vehicle (from the sides of the vehicle body to the central host) uses fiber optics, which completely avoids electromagnetic interference (EMI) problems and ensures the stability of the video signal.

[0024] Simplified interface: The SoC only needs to occupy one (e.g., 4-lane) MIPI CSI-2 input port to receive all four surround-view video signals, reducing the requirements for SoC pin resources.

[0025] Improved energy efficiency: Compared to solutions that require multiple deserializers or large FPGAs, a single dedicated LT934LM chip consumes less power, and the SoC does not require high-intensity video decoding, which also reduces the overall system power consumption and heat generation. Attached Figure Description

[0026] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0027] Figure 1 This is a system overall design block diagram in an embodiment of this utility model. Detailed Implementation

[0028] To provide a clearer understanding of the technical features, objectives, and effects of this invention, specific embodiments of the present invention are now described with reference to the accompanying drawings. In the drawings, the same reference numerals denote the same parts. For the sake of simplicity, the parts related to the present invention are shown schematically in each drawing and do not represent their actual structure as a product. Furthermore, for the sake of clarity and ease of understanding, in some drawings, components with the same structure or function are only schematically depicted, or only one is labeled.

[0029] Regarding control systems, functional modules and application programs (APPs) are well known to those skilled in the art. They can take any suitable form, whether hardware or software, and can consist of multiple discrete functional modules or multiple functional units integrated onto a single hardware device. In its simplest form, the control system can be a controller, such as a combinational logic controller or a microprogrammed controller, as long as it can implement the operations described in this application. Of course, the control system can also be integrated as different modules onto a single physical device; these approaches do not depart from the basic principles and scope of protection of this utility model.

[0030] In this utility model, "connection" can include direct connection, indirect connection, communication connection, and electrical connection, unless otherwise specified.

[0031] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly specifies otherwise. It will also be understood that, when used in the specification, the terms “comprising” and / or “including” mean the presence of the stated features, values, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, values, steps, operations, elements, components, and / or groups thereof. As used herein, the term “and / or” includes any and all combinations of one or more of the listed related items.

[0032] It should be understood that the term "vehicle" or "of a vehicle" or other similar terms as used herein generally includes motor vehicles, such as passenger cars including sport utility vehicles (SUVs), buses, trucks, various commercial vehicles, boats including various vessels, aircraft, etc., and includes hybrid vehicles, electric vehicles, plug-in hybrid electric vehicles, hydrogen-powered vehicles, and other vehicles powered by alternative fuels (e.g., fuels derived from non-petroleum energy sources). As mentioned herein, a hybrid vehicle is a vehicle with two or more power sources, such as both gasoline and electric power.

[0033] Furthermore, the controller disclosed herein can be embodied as a non-transient computer-readable medium on a computer-readable medium containing executable program instructions that are executed by a processor, controller, or the like. Examples of computer-readable media include, but are not limited to, ROM, RAM, optical disc (CD)-ROM, magnetic tape, floppy disk, flash memory drive, smart card, and optical data storage device. Computer-readable recording media can also be distributed across a network-coupled computer system, such that the computer-readable media are stored and executed in a distributed manner, for example, via a telematics server or a controller area network (CAN).

[0034] Example 1

[0035] Please see Figure 1 This paper illustrates the system architecture of a preferred embodiment of the present invention. The system is primarily deployed in a vehicle's 360° surround view system and includes: four fiber optic cameras, four fiber optic receivers, a video aggregation chip, and a main control SoC.

[0036] Cameras: Four fiber optic cameras are installed at the front, rear, left, and right of the vehicle, respectively. They are responsible for capturing video footage around the vehicle and directly modulating the video signal (e.g., YUV422 format) into an optical signal for output.

[0037] Fiber Optic Receivers: The fiber optic receivers are optical-to-electrical (OSA) modules. They receive optical signals from the four cameras and demodulate / convert them into high-speed electrical signals. In this embodiment, to match the input interface of the subsequent aggregation chip, the fiber optic receivers convert the optical signals into four parallel LVDS (Low Voltage Differential Signaling) channels.

[0038] Video Aggregator Chip: This is the core of the system. This chip integrates at least four LVDS receivers and one MIPICSI-2 (4-lane) transmitter. The chip's four LVDS input ports receive four LVDS signals from the fiber optic receivers, respectively. The chip's key function is to perform four-in-one aggregation. Depending on the SoC configuration, it encapsulates these four independent video streams (in this embodiment, YUV422 format) into four different MIPI channels (VCs). For example:

[0039] The video from camera 1 is encapsulated in VCO.

[0040] The video from camera 2 is encapsulated in VC1

[0041] The video from camera 3 is encapsulated in VC2

[0042] The video from camera 4 is encapsulated in VC3

[0043] The chip then interleaves these MIPI data packets with different VC identifiers and sends them to the SoC via a single MIPI CSI-2 4-lane physical interface.

[0044] Main SoC: The SoC (such as an automotive-grade processor based on ARM architecture) receives the aggregated signal through its MIPI CSI-2 4-lane input interface. The SoC's MIPI controller first parses the data stream and, based on the channel (VC) identifier in the packet header, re-separates the data stream into four independent YUV422 video streams. Since the SoC acquires raw YUV422 data, it does not need to perform any video decoding. The SoC's image signal processor (ISP) or GPU can immediately perform surround-view algorithm processing, distortion correction, and image stitching on these four YUV422 data streams, and output the final panoramic image to the in-vehicle display.

[0045] Control Link: As shown in the figure, the SoC is also connected to the video aggregation chip via an I²C bus. During system startup, the SoC (acting as the I²C master) writes register configurations to the chip to ensure its correct operation, such as configuring the LVDS input mapping, setting the MIPI output rate, specifying the video resolution for each channel, and implementing frame synchronization triggering for the four cameras.

[0046] Example 2

[0047] The system in this embodiment is mainly used in a 360-degree surround view system for vehicle-mounted driver assistance, and aims to efficiently and stably transmit four high-resolution fiber optic video streams to the vehicle's central processing unit (SoC).

[0048] 1. Signal source and photoelectric conversion:

[0049] The fiber optic camera system uses four cameras with a resolution of 1920x1080P@30fps and an output format of YUV422. To achieve long-distance and interference-resistant transmission, the cameras convert electrical signals into optical signals through an internal optical transmitter, which are then routed to the vehicle's main unit via fiber optic cables.

[0050] Four OSA modules are used to receive fiber optic signals and convert them back to electrical signals. Based on the input requirements of the LT934LM video aggregation chip, this OSA module must have or integrate a deserializer (SerDes) function to demodulate the received optical signal and output a unidirectional, parallel, low-voltage differential LVDS signal.

[0051] 2. Core video aggregation chip (LT934LM):

[0052] In this embodiment, the video aggregation chip is model LT934LM, which provides four sets of LVDS input interfaces, each of which can receive one complete LVDS video stream.

[0053] The LT934LM integrates a clock data recovery (CDR) module. When four LVDS inputs are received, the CDR function can extract the clock from each differential signal to achieve accurate data sampling and timing alignment of the four input data.

[0054] The chip's internal processing module is responsible for encapsulating the four YUV422 raw data packets (from LVDS input) into data packets that conform to the MIPI CSI-2 specification.

[0055] 3. Channel (VC) aggregation mechanism:

[0056] The video aggregation chip does not perform image stitching, but instead utilizes the virtual channel function defined in the MIPI CSI-2 protocol:

[0057] The chip maps the four LVDS input video streams to four logic channels respectively:

[0058] The chip's MIPI transmitter performs time-division multiplexing on video data packets with different VC identifiers (the Data Type and VC ID fields in the packet header) and outputs them through a single 4-lane MIPI physical link.

[0059] This mechanism allows the SoC to receive four logically independent video streams that fully retain the original YUV422 format with only one standard MIPI CSI-2 interface.

[0060] Example 3

[0061] The SoC and the video aggregation chip communicate via the I²C bus. During system startup or operation, the SoC, acting as the host, configures the internal registers of the video aggregation chip via the I²C bus. The main configurations include:

[0062] Input resolution configuration: Set the input LVDS resolution, frame rate and other parameters to ensure the internal processing logic is correct.

[0063] VC mapping register configuration: The SoC writes to specific registers to confirm or modify which LVDS input corresponds to which VC channel.

[0064] MIPI output parameter configuration: Configure the operating mode of MIPI CSI-2 D-PHY (such as DDR rate, number of lanes) to ensure it matches the receiving capability of the SoC.

[0065] For a 360° surround view system, to ensure that all four cameras are exposed and capture images simultaneously (global shutter synchronization), this invention achieves precise frame synchronization through SoC control of the video aggregation chip:

[0066] The SoC configures specific registers of the video aggregation chip via the I²C bus, enabling the internal GPIO pins (or dedicated synchronous output pins) of the chip to be configured as synchronous pulse generators.

[0067] The synchronization signal output from this pin (a periodic V-SYNC / Trigger signal) is transmitted in reverse to the four OSA or fiber optic cameras via an additional control line. This signal is used to precisely trigger the four cameras to start the exposure and acquisition of a new frame at the same time, achieving hardware-level global frame synchronization.

[0068] Example 4

[0069] One of the advantages of this invention is its low latency, which is achieved through the SoC's processing flow:

[0070] 1. MIPI Reception and Unpacking: The MIPI CSI-2 controller inside the SoC receives a single 4-lane signal. Based on the channel (VC) ID field in the data packet header, the controller separates the interleaved data stream into four independent VC data streams (VC0, VC1, VC2, VC3).

[0071] 2. Direct YUV422 Acquisition: Since the video aggregation chip outputs raw YUV422 data streams, the SoC directly obtains four channels of YUV422 format video frame data from the MIPI controller / D-PHY without any hardware or software video decoding process.

[0072] 3. ISP / GPU processing: The raw YUV422 data frames go directly into the image signal processor (ISP) or graphics processing unit (GPU) inside the SoC.

[0073] The ISP performs basic image enhancement functions such as noise reduction and white balance.

[0074] The GPU / CPU executes surround view stitching algorithms (such as distortion correction, viewpoint transformation, and fusion stitching) to quickly generate 360-degree panoramic images.

[0075] It eliminates the tens of milliseconds of latency introduced by video encoders / decoders commonly found in traditional solutions, improving the system's real-time performance and user experience.

[0076] Finally, it should be noted that the above are only specific embodiments of this application, but the protection scope of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application.

Claims

1. A video acquisition and output system, characterized in that, include: At least four fiber optic cameras are used to capture video and output optical signals; At least four photoelectric receiving modules, each corresponding to one of the fiber optic cameras, are used to convert the received optical signals into four parallel low-voltage differential signals. A video aggregation chip has at least four low-voltage differential signal input interfaces and one MIPI output interface, wherein the four low-voltage differential signal input interfaces are respectively connected to the output terminals of the four-channel photoelectric receiving modules; A main control SoC, whose MIPI input interface is connected to the output interface of the video aggregation chip; The video aggregation chip is configured to encapsulate the received video streams carried by four low-voltage differential signals into four independent MIPI channels, and transmit them to the SoC via a single MIPI physical link.

2. The system according to claim 1, characterized in that: The video aggregation chip integrates at least four LVDS receivers and one MIPI transmitter.

3. The system according to claim 1, characterized in that: The SoC is connected to the video aggregation chip via an I²C bus and is used to configure and control the video aggregation chip.

4. The system according to claim 3, characterized in that: The SoC configures the VC channel mapping register of the video aggregation chip through the I²C bus, binding each low-voltage differential signal input to a specific channel.

5. The system according to claim 3, characterized in that: The SoC configures the video aggregation chip through the I²C bus to achieve frame synchronization of four cameras. The frame synchronization control method includes, but is not limited to: the SoC sending a synchronization trigger pulse to simultaneously control four fiber optic receivers or cameras through the synchronization signal pin of the video aggregation chip.

6. The system according to claim 2, characterized in that: The SoC is configured to parse data from four channels of the MIPI signal transmitted through the single MIPI physical link and directly perform surround view stitching algorithm processing on the acquired YUV422 video data without performing video decoding operations.

7. The system according to claim 1, characterized in that: The video aggregation chip also has a built-in clock data recovery function, which is used to extract clock information from the input low-voltage differential signal, thereby performing timing alignment and synchronization processing on the four input data channels.

8. The system according to claim 1, characterized in that: The optical signal is transmitted via single-mode or multi-mode optical fiber to ensure the interference resistance of video data transmitted from the vehicle periphery to the central processing unit.