GMSL signal conversion test tool
By designing the GMSL signal conversion testing tool, the combination of GMSL deserialization chip and FPGA chip is used to solve the problem of camera debugging during the development process, real-time playback and synchronization of multiple cameras is realized, cost reduction and efficiency improvement.
Patent Information
- Application Number
- CN202323336676.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-07
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2033-12-07
AI Technical Summary
The problem of prior art finding and debugging of cameras using GMSL1/GMSL2 communication interfaces during development has resulted in the need of additional design of verification boards, which increases cost and complexity.
Design a GMSL signal conversion testing tool, including GMSL deserialization chip, FPGA chip, USB interface and Ethernet interface, connect GMSL deserialization chip and FPGA chip through MIPI interface, set up MIPI-CIS parsing module, data buffer and UVC module , supports H264 encoding and 1722 protocol packaging, realizes video data conversion and synchronization, can support both USB and Ethernet interfaces, and configures serial port and I2C module for camera parameters reading and debugging.
Real-time playback and debugging of multiple GMSL cameras is realized, and simultaneous verification of 4-channel cameras is supported, which improves efficiency and solves the time synchronization problem of multiple camera images through synchronization functions, reducing costs.
Smart Images

Figure CN222073246U_ABST
Abstract
Description
Technical Field
[0001] The utility model relates to the field of testing tools, in particular to a GMSL signal conversion testing tool. Background Art
[0002] In recent years, with the development and progress of automobile technology, with the continuous improvement of automobile intelligence, especially the popularization of advanced driver assistance systems (ADAS), more and more on-board cameras and sensors need to communicate data with the automotive electronic control unit (ECU), and the requirements for the bandwidth, real-time and stability of in-vehicle data transmission are also getting higher and higher. As a result, the GMSL high-speed signal transmission method was born. Therefore, more and more autonomous driving solutions use cameras with GMSL1 / GMSL2 communication interfaces, which will lead to a large number of purchased or self-produced cameras requiring batch verification functions. The existing domain control needs to complete the debugging of the entire link from the front-end sensor / serializer configuration to the back-end display framework to develop the GMSL camera function. How to find problems with the camera during the development process? The camera output of the high-speed signal is the GMSL signal, which is not compatible with the existing communication interface. Therefore, it is impossible to read and debug the configuration parameters of the camera and solve the problem in time. It is necessary to design a verification board for the GMSL camera separately to test the camera, which will increase the cost. Utility Model Content
[0003] Based on one of the defects of the prior art, the utility model provides a GMSL signal conversion test tool, which at least includes:
[0004] GMSL deserialization chip, FPGA chip, USB interface, and Ethernet interface for GMSL signals, wherein the GMSL deserialization chip is connected to the FPGA chip via a MIPI interface;
[0005] Among them, the FPGA chip is equipped with a MIPI-CIS parsing module, a data buffer, and a UVC module. The data buffer is connected to the MIPI-CIS parsing module and the UVC module respectively. The data buffer is used to store video data, and the UVC module encapsulates the video data and sends it to the USB interface for output.
[0006] A GMSL signal conversion test tool, further optionally, the FPGA chip is set to configure an H264 encoding module and a 1722 protocol encapsulation module, wherein the H264 encoding module is connected to the MIPI-CIS parsing module and the 1722 protocol encapsulation module, and the 1722 protocol encapsulation module is connected to the Ethernet interface.
[0007] A GMSL signal conversion test tool, further optionally, the GMSL deserialization chip transmits the video signal to the FPGA chip via the MIPI interface;
[0008] The FPGA chip transmits control signals to the GMSL deserialization chip through the I2C interface and transmits synchronization signals to the GMSL deserialization chip through the Sync interface.
[0009] A GMSL signal conversion test tool, further optionally, the GMSL deserialization chip is used to receive the GMSL signal sent by a remote camera and to power the remote camera and transmit control signals through a GMSL wiring harness.
[0010] A GMSL signal conversion test tool, further optionally, the FPGA chip configuration instantiates a USB serial port, a serial port parameter parsing module, and an I2C module, wherein the serial port parameter parsing module is respectively connected to the USB serial port and the I2C module;
[0011] The USB serial port is used to configure the camera model, frame rate, and whether to synchronize externally;
[0012] After the host computer receives the control command through the USB serial port, it sends the control command to the GMSL deserialization chip through the I2C module.
[0013] A GMSL signal conversion test tool, further optionally, the FPGA chip is configured with an I2C module, a UDP network parsing module, and a camera parameter parsing module, wherein the UDP network parsing module is respectively connected to the camera parameter parsing module and the Ethernet interface;
[0014] The camera parameter parsing module is connected to the I2C module.
[0015] A GMSL signal conversion test tool, further optionally, a UDP network parsing module is used to configure the camera model, frame rate, and whether it is synchronized.
[0016] A GMSL signal conversion test tool, further optionally, the USB interface is configured as at least any one of USB3.0, USB3.1, and USB3.2.
[0017] A GMSL signal conversion test tool, further optionally, the video data format is a YUV format.
[0018] A GMSL signal conversion test tool, further optionally, the GMSL deserialization chip is at least configured as a MAX96721 deserialization chip.
[0019] Beneficial effects:
[0020] The technical solution provided by the utility model can simultaneously support GMSL to USB and Ethernet, which not only satisfies the real-time playback of the GMSL camera raw data stream by the USB interface, but also supports all PCs in the local area network to play H264 compressed images; the present invention supports the simultaneous display of 4 GMSL cameras, and the number of cameras verified at a single time is greater, which is more efficient.
[0021] At the same time, by configuring the serial port and parsing module, the camera's configuration parameters can be read and debugged, and the host computer can achieve time synchronization for multiple cameras in the debugging state. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The following drawings are only used to illustrate and explain the present invention, and do not limit the scope of the present invention.
[0023] Figure 1 This is a schematic diagram of the structure of a GMSL signal conversion test tool according to an embodiment of the present utility model.
[0024] Figure 2 This is a hardware structure diagram of a USB interface configured inside an FPGA chip according to an embodiment of the utility model.
[0025] Figure 3 This is a schematic diagram of the hardware structure of an Ethernet interface configured inside an FPGA chip according to an embodiment of the utility model.
[0026] Figure 4 The figure is a schematic diagram of parsing a data packet in a MIPI parsing module inside an FPGA chip in one embodiment of the utility model.
[0027] Figure 5 This is a schematic diagram of a PC in a local area network in which a camera sends a video through a GMSL signal conversion test tool in one embodiment of the present invention. DETAILED DESCRIPTION
[0028] In order to have a clearer understanding of the technical features, purposes and effects of this invention, the specific implementation methods of the present invention are now described with reference to the accompanying drawings. The same reference numerals in each figure represent the same parts. In order to make the drawings concise, the parts related to the present invention are schematically shown in each figure, and do not represent the actual structure of the product. In addition, in order to make the drawings concise and easy to understand, in some figures, only one of the parts with the same structure or function is schematically drawn or marked.
[0029] In the present invention, "connection" may include direct connection, indirect connection, communication connection, and electrical connection, unless otherwise specified.
[0030] The terms used herein are for the purpose of describing specific embodiments only and are not intended to limit the present disclosure. As used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that when used in the specification, the terms "include" and / or "comprise" refer to the presence of stated features, values, steps, operations, elements and / or components, but do not exclude the presence or additional addition of one or more other features, values, steps, operations, elements, components and / or groups thereof. As used herein, the term "and / or" includes any and all combinations of one or more of the listed related items.
[0031] The utility model provides a GMSL signal conversion test tool, which is applied to the debugging of a camera of a GMSL (Gigabit Multimedia Serial Links) serial port, and does not need to design an additional verification board of the GMSL camera separately.
[0032] Specifically, Figures 1 to 5 As shown, the test tool includes at least:
[0033] like Figure 1 As shown, a GMSL deserialization chip, an FPGA chip, a USB interface, and an Ethernet interface chip are used for GMSL signals, wherein the GMSL deserialization chip is connected to the FPGA chip via a MIPI interface;
[0034] Among them, the FPGA chip is equipped with a MIPI-CIS parsing module, a data buffer, and a UVC module. The data buffer is connected to the MIPI-CIS parsing module and the UVC module respectively. The data buffer is used to store video data, and the UVC module encapsulates the video data and sends it to the USB interface for output.
[0035] The MIPI-CIS parsing module is used to create multiple virtual channels when executing the parsing protocol to separate the video data of each channel, and configure a FIFO data buffer for receiving video data for each virtual channel;
[0036] The FPGA chip is provided with instantiated configuration UVC protocol encapsulation modules having the same number as the FIFO data buffer, and each UVC protocol encapsulation module is connected to the FIFO data buffer.
[0037] Specifically, the conversion test tool connects to the front-end GMSL camera through the GMSL deserialization chip, and can support up to 4 cameras at the same time. It supports GMSL2 and is backward compatible with GMSL1. The camera is also powered by the GMSL harness through GMSL-USB.
[0038] After unpacking, the GMSL deserialization chip passes the 4-channel camera data to the FPGA through MIPI CSI according to the CSI-2 protocol. The FPGA implements the parsing of the MIPI CSI2 protocol data and separates the 4-channel camera data through the virtual channel. Then the other end of the FPGA chip instantiates a USB device that supports the UVC specification protocol. When the interface is inserted into the host computer, the host computer opens the corresponding GMSL camera through UVC standard protocol programming, displays the image, and performs debugging.
[0039] The video data format is YUV format;
[0040] Specifically, in order to be compatible with the Ethernet interface, the switch can send video data to the local area network, or even the computer on the Internet for video playback. This implementation implements the mode parsing of the Ethernet interface in the FPGA chip, as follows:
[0041] The FPGA chip is set to configure the H264 encoding module and the 1722 protocol encapsulation module, wherein the H264 encoding module is connected to the MIPI-CIS parsing module and the 1722 protocol encapsulation module, and the 1722 protocol encapsulation module is connected to the Ethernet interface.
[0042] Specifically, when multiple cameras are used, the video images obtained by the multiple cameras need to be stitched together. At this time, the images of the multiple cameras need to be synchronized with high precision. However, the existing GMSL is a transmission SoC chip. During the development process, there is a lack of SoC chips or the SoC chips have not yet integrated relevant debugging software, and the signal synchronization of the multiple cameras connected to the GMSL cannot be achieved. This embodiment provides a solution:
[0043] The remote camera transmits the video signal to the FPGA chip through the MIPI interface, the FPGA chip transmits the control signal to the GMSL deserialization chip through the I2C interface, and transmits the synchronization signal to the GMSL deserialization chip through the Sync interface.
[0044] The GMSL deserialization chip is used to receive the GMSL signal sent by the remote camera and to power and transmit control signals to the remote camera through the GMSL wiring harness.
[0045] The host computer analyzes the current image and sends the synchronization command of multiple cameras to the test tool. In the test tool, after the FPGA parses the command, the SYNC interface transmits the synchronization command to the GMSL deserialization chip. The GMSL deserialization chip then sends it to different cameras for time synchronization.
[0046] The GMSL deserialization chip can use MAX96712 or other chips with similar functions.
[0047] like Figure 2 The FPGA chip receives and processes the 4-channel camera image data output by MAX96712 through the MIPI CSI parsing module, separates the YUV camera data of each channel by parsing the virtual channel in the protocol, and transmits a complete frame of YUV data to the FIFO buffer. At the other end, 4 UVC data interfaces are instantiated to read the YUV data from the FIFO buffer and encapsulate the data according to the UVC protocol. Finally, the data is transmitted to the host PC through the USB3.1 PHY.
[0048] USB3.1 supports a maximum of 10Gb / s. This solution supports 4 cameras with a maximum of 30fps and 1920*1080 pixels. The data flow of 4 cameras collected simultaneously is about 4Gb / s, so USB3.1 is used to realize data transmission and forwarding.
[0049] Specifically, in order to debug and control the camera and configure parameters, this embodiment provides a feasible solution:
[0050] like Figure 2 As shown, the FPGA chip configuration instantiates the USB serial port, the serial port parameter parsing module, and the I2C module, wherein the serial port parameter parsing module is respectively connected to the USB serial port and the I2C module;
[0051] After the host computer receives the control command through the USB serial port, it sends the control command to the GMSL deserialization chip through the I2C module. The USB serial port is used to configure the camera model, frame rate, external synchronization and other parameters.
[0052] In a specific embodiment, the FPGA chip configuration instantiates a USB serial port to receive control commands from the PC, which is mainly used to configure parameters such as camera model, frame rate, and whether to synchronize externally. After the serial port parameter parsing module completes the parsing, the parameters are sent to MAX96712 through the I2C module.
[0053] Specifically, the present invention provides another embodiment for configuring camera parameters, which is as follows:
[0054] like Figure 3 As shown, the FPGA chip is configured with a UDP network parsing module and a camera parameter parsing module, wherein the UDP network parsing module is connected to the camera parameter parsing module and the Ethernet interface respectively;
[0055] The camera parameter parsing module is connected to the I2C module.
[0056] The UDP network parsing module is used to configure the camera model, frame rate, and synchronization;
[0057] After the camera parameter parsing module obtains the data packet from UDP, it obtains the camera model, frame rate, synchronization and other parameters for camera parameter adjustment, and then sends them to the I2C module.
[0058] This embodiment supports 4 cameras with a maximum of 30fps and 1920*1080 pixels. The data flow rate of the 4 cameras simultaneously collected is about 4Gb / s, so USB3.0 or above is used to realize data transmission and forwarding.
[0059] The USB interface is configured with at least one of USB3.0, USB3.1, and USB3.2.
[0060] See also Figure 3 ,The most important function implemented inside the FPGA chip is protocol conversion, which converts MIPI serialized data into the standard UVC format that can be transmitted over the USB bus. Figure 3 There are data from four cameras in the serialized data at the same time. The module first parses the data length and virtual channel according to the CSI2 protocol, then extracts the data and transmits the corresponding camera data to the YUV FIFO data buffer. After the FIFO data buffer is full of one frame of data, the data is sent to the UVC protocol encapsulation module to encapsulate the YUV raw data into standard UVC data.
[0061] like Figure 4 As shown, in the FPGA implementation of MIPI protocol parsing, according to the received data packet, the header is removed from the data packet packet1, such as: LPS, SOT, and then the effective load is found, such as: Data0 to Data N, and then Data0 to Data N are transmitted to the data buffer. The data format of the image is YUV.
[0062] Specifically, Figure 5 As shown, this embodiment provides GMSL conversion of two different interfaces, one interface is a USB interface, and the other is an Ethernet interface. Through the Ethernet interface, the conversion tool provided in this embodiment can, on the one hand, pass the data collected by the camera through the H264 encoding module in the FPGA chip, encode the video data by H264, and then use the sub-protocol 1722 protocol of the AVTP protocol to encapsulate it into a standard Ethernet frame and transmit it to the Ethernet interface, and then send it to the switch through the Ethernet interface, and the switch sends the data packet of the Ethernet frame to the computer for decoding and then playing the video file.
[0063] The above is only a preferred embodiment of the present invention, and the present invention is not limited to the above embodiment. It is clear to those skilled in the art that the form in the embodiment is not limited thereto, and the adjustable manner is not limited thereto. It is understood that other improvements and changes directly derived or associated with those skilled in the art without departing from the basic concept of the present invention should be considered to be included in the protection scope of the present invention.
Claims
1. A GMSL signal conversion test tool, characterized in that: At least: GMSL deserialization chip, FPGA chip, USB interface, and Ethernet interface for GMSL signals, wherein the GMSL deserialization chip is connected to the FPGA chip via a MIPI interface; Among them, the FPGA chip is equipped with a MIPI-CIS parsing module, a data buffer, and a UVC module. The data buffer is connected to the MIPI-CIS parsing module and the UVC module respectively. The data buffer is used to store video data, and the UVC module encapsulates the video data and sends it to the USB interface for output.
2. A GMSL signal conversion test tool as claimed in claim 1, characterized in that: The FPGA chip is configured with an H264 encoding module and a 1722 protocol encapsulation module, wherein the H264 encoding module is respectively connected to the MIPI-CIS parsing module and the 1722 protocol encapsulation module, and the 1722 protocol encapsulation module is connected to the Ethernet interface.
3. A GMSL signal conversion test tool as claimed in claim 1, characterized in that: The GMSL deserialization chip transmits the video signal to the FPGA chip via the MIPI interface; The FPGA chip transmits control signals to the GMSL deserialization chip through the I2C interface and transmits synchronization signals to the GMSL deserialization chip through the Sync interface.
4. A GMSL signal conversion test tool as claimed in claim 1, characterized in that: The GMSL deserialization chip is used to receive the GMSL signal sent by the remote camera and to supply power and transmit control signals to the remote camera through the GMSL wiring harness.
5. A GMSL signal conversion test tool as claimed in claim 1, characterized in that: The FPGA chip configuration instantiates a USB serial port, a serial port parameter parsing module, and an I2C module, wherein the serial port parameter parsing module is connected to the USB serial port and the I2C module respectively; The USB serial port is used to configure the camera model, frame rate, and whether to synchronize externally; After the host computer receives the control command through the USB serial port, it sends the control command to the GMSL deserialization chip through the I2C module.
6. A GMSL signal conversion test tool as claimed in claim 2, characterized in that: The FPGA chip is configured with an I2C module, a UDP network parsing module, and a camera parameter parsing module, wherein the UDP network parsing module is connected to the camera parameter parsing module and the Ethernet interface respectively; The camera parameter parsing module is connected to the I2C module.
7. A GMSL signal conversion test tool as claimed in claim 6, characterized in that: The UDP network parsing module is used to configure the camera model, frame rate, and whether to synchronize.
8. A GMSL signal conversion test tool as claimed in claim 1, characterized in that: The USB interface is configured as at least any one of USB3.0, USB3.1, and USB3.
2.
9. A GMSL signal conversion test tool as claimed in claim 1, characterized in that: The video data format is YUV format.
10. A GMSL signal conversion test tool as claimed in claim 1, characterized in that: The GMSL deserialization chip is at least configured as a MAX96721 deserialization chip.
