Video data distribution system, method and camera data processing system
Through the video data shunt system, the camera video data is diverted and stored using the deserializer and serializer module, solving the problem of high sensor costs in the autonomous driving system, achieving efficient data shunt and storage, and reducing system costs.
Patent Information
- Application Number
- CN202210100033.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-27
- Publication Date
- 2024-12-13
- Estimated Expiration
- 2042-01-27
AI Technical Summary
In autonomous driving technology, the data acquisition and storage cost of multi-sensor systems is relatively high, especially for camera data backup, which requires adding sensors to increase system costs.
A video data shunt system is provided, including a deserializer, a main channel serializer and a slave channel serializer. The MCU module initializes the configuration and switches the controller at startup, realizes the shunt storage of camera video data and reduces sensor costs.
It realizes the diversified storage of camera video data, saves sensor costs in the system, and ensures the reliability and flexibility of data transmission.
Smart Images

Figure CN114422737B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent driving technology, and in particular to a video data diversion system, method and camera data processing system. Background Art
[0002] In recent years, autonomous driving has attracted more and more attention in the industry. Among them, sensor data collection and storage is an important part of the development of autonomous driving technology. Multiple sensors will inevitably encounter problems with system solutions and hardware layout, which is a great challenge for the signal control and subsequent maintenance of the entire vehicle. At present, most sensor data is transmitted one-to-one, especially for cameras. If data backup is required in addition to perception and decision-making functions, it will involve the addition of sensors, thereby increasing system costs. Summary of the invention
[0003] The purpose of the present application is to provide a video data diversion system, method and camera data processing system, which can divert and store the video data output by the camera, thereby saving the sensor cost in the system.
[0004] In a first aspect, an embodiment of the present application provides a video data diversion system, which includes: a deserializer, a main serializer and a slave serializer; wherein the deserializer is respectively connected to the main serializer and the slave serializer; the deserializer is used to receive video data sent by a camera, and transmit the video data to the main serializer and the slave serializer respectively; the main serializer and the slave serializer respectively convert the received video data into high-speed serial signals and transmit them to the corresponding external controller.
[0005] Furthermore, the above-mentioned video data diversion system also includes: an MCU module; the MCU module is connected to the deserializer, the main serializer and the slave serializer respectively; the MCU module is used to determine and connect the target serializer according to the state of the trigger signal input by the main serializer when the video data diversion system is started, so that the target controller external to the target serializer initializes the configuration and triggers the camera; the target serializer includes: a main serializer or a slave serializer.
[0006] Furthermore, the above-mentioned MCU module is also used to detect the status of the trigger signal input by the GPO interface of the target serializer in real time during the operation of the video data diversion system. When it is judged that the working status of the target controller is abnormal according to the status and the target controller is the master controller, it switches to the slave serializer corresponding to the external slave controller to initialize the configuration and trigger control of the camera.
[0007] Furthermore, the above-mentioned MCU module is respectively connected to the deserializer GPI interface, IIC interface, the master serializer GPO interface, IIC interface, the slave serializer GPO interface, and IIC interface; the deserializer is connected to the camera through the GMSL communication interface, and is respectively connected to the master serializer and the slave serializer through two 4-lane MIPI CSI-2 interfaces; the master serializer and the slave serializer are both connected to the corresponding external controller through the GMSL communication interface.
[0008] In a second aspect, an embodiment of the present application also provides a video data diversion method, which is applied to a video data diversion system; the video data diversion system includes: a deserializer, a main serializer and a slave serializer; wherein the deserializer is respectively connected to the main serializer and the slave serializer; the method includes: the deserializer receives the video data sent by the camera, and transmits the video data to the main serializer and the slave serializer respectively; the main serializer and the slave serializer respectively convert the received video data into a high-speed serial signal and transmit it to the corresponding external controller.
[0009] Furthermore, the above-mentioned video data diversion system also includes: an MCU module; the MCU module is respectively connected to the deserializer, the main serializer and the slave serializer; before the step of the deserializer receiving the video data sent by the camera and transmitting the video data to the main serializer and the slave serializer respectively, it also includes: when the video data diversion system is started, the MCU module determines and connects the target serializer according to the state of the trigger signal input by the main serializer, so that the target controller external to the target serializer initializes the configuration and triggers the camera; the target serializer includes: a main serializer or a slave serializer.
[0010] Furthermore, the MCU module is respectively connected to the GPI interface and IIC interface of the deserializer, the GPO interface and IIC interface of the master serializer, and the GPO interface and IIC interface of the slave serializer; the MCU module determines and connects the target serializer according to the state of the trigger signal input by the master serializer, so that the target controller external to the target serializer performs initialization configuration and trigger control on the camera, including: the MCU module obtains the state of the trigger signal input by the GPO interface of the master serializer, and determines whether the working state of the master serializer corresponding to the external main controller is normal according to the state; if the working state of the main controller is normal, the master serializer is determined as the target serializer; if the working state of the main controller is abnormal, the slave serializer is determined as the target serializer; the IIC interface and the GPO interface of the target serializer are connected, so that the target controller external to the target serializer initializes the register of the camera through the IIC interface of the target serializer, and triggers the ISP of the camera through the GPO interface of the target serializer.
[0011] Furthermore, the above-mentioned deserializer is configured with a GMSL communication interface and two 4-lane MIPI CSI-2 interfaces; the deserializer receives the video data sent by the camera, and transmits the video data to the main serializer and the slave serializer respectively, including: the deserializer receives the video data sent by the camera through the GMSL communication interface, and transmits the video data to the main serializer and the slave serializer respectively through the two 4-lane MIPI CSI-2 interfaces.
[0012] Furthermore, the above method also includes: during the operation of the video data diversion system, the MCU module detects the state of the trigger signal input by the target serializer in real time, and when it is judged that the working state of the target controller is abnormal according to the state, and the target controller is the master controller, it switches to the slave serializer corresponding to the external slave controller to initialize the configuration and trigger control of the camera.
[0013] In a third aspect, an embodiment of the present application also provides a camera data processing system, which includes: a camera, a main channel controller, a slave channel controller and a video data diversion system as described in the first aspect; the camera is connected to a deserializer in the video data diversion system; the main channel controller is connected to a main channel serializer in the video data diversion system; the slave channel controller is connected to a slave channel serializer in the video data diversion system; the video data diversion system is used to divert and store the video data of the camera, and is also used to provide POC power for the camera.
[0014] In the video data diversion system, method and camera data processing system provided by the embodiment of the present application, the video data diversion system includes: a deserializer, a master serializer and a slave serializer; wherein the deserializer is connected to the master serializer and the slave serializer respectively; the deserializer is used to receive the video data sent by the camera, and transmit the video data to the master serializer and the slave serializer respectively; the master serializer and the slave serializer respectively convert the received video data into a high-speed serial signal and transmit it to the corresponding external controller. The embodiment of the present application can divert and store the video data output by the camera through the deserializer and the two-way master-slave serializer, thereby saving the sensor cost in the system. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0016] Figure 1A schematic diagram of the structure of a video data distribution system provided in an embodiment of the present application;
[0017] Figure 2 A schematic diagram of the structure of another video data distribution system provided in an embodiment of the present application;
[0018] Figure 3 A flowchart of a video data splitting method provided in an embodiment of the present application;
[0019] Figure 4 A flowchart of another video data distribution system method provided in an embodiment of the present application;
[0020] Figure 5 A schematic diagram of the structure of a camera data processing system provided in an embodiment of the present application. DETAILED DESCRIPTION
[0021] The technical solution of the present application will be described clearly and completely below in conjunction with the embodiments. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0022] In the field of intelligent driving technology, most sensor data is transmitted one-to-one, especially for cameras. If data backup is required in addition to the perception and decision-making functions, it will involve the addition of sensors, thereby increasing system costs. Based on this, the embodiments of the present application provide a video data diversion system, method and camera data processing system, which can divert and store video data output by the camera, saving sensor costs in the system.
[0023] To facilitate understanding of this embodiment, a video data distribution system disclosed in an embodiment of the present application is first introduced in detail.
[0024] Figure 1 A video data diversion system is provided in an embodiment of the present application, and the video data diversion system includes: a deserializer 11, a main serializer 12 and a slave serializer 13; wherein the deserializer 11 is connected to the main serializer 12 and the slave serializer 13 respectively; the deserializer 11 is used to receive video data sent by a camera, and transmit the video data to the main serializer 12 and the slave serializer 13 respectively; the main serializer 12 and the slave serializer 13 respectively convert the received video data into high-speed serial signals and transmit them to the corresponding external controller.
[0025] The above-mentioned deserializer can be implemented using a chip of model MAX9296, which is used to receive video data transmitted by the camera in real time and is compatible with GMSL and GMSL2 at the same time; MAX9296 has a dual-channel input and output interface, that is, two GMSL1 / 2 high-speed serial interfaces, and provides two 4-lane MIPI CSI-2 interfaces to the outside; therefore, MAX9296 can transmit the received serial signal to two serializer modules through two 4-lane MIPI CSI-2 respectively.
[0026] The master serializer and the slave serializer can both use the MAX9295 chip to convert video data into high-speed serial signals and transmit them to an external controller. The MAX9295 chip input includes a 14-bit parallel interface and a 4-lane MIPI CSI-2 interface for receiving camera data transmitted by the deserializer; the output is compatible with both GMSL and GMSL2.
[0027] In the video data diversion system provided in the embodiment of the present application, the video data diversion system includes: a deserializer, a main serializer and a slave serializer; wherein the deserializer is connected to the main serializer and the slave serializer respectively; the deserializer is used to receive the video data sent by the camera, and transmit the video data to the main serializer and the slave serializer respectively; the main serializer and the slave serializer respectively convert the received video data into a high-speed serial signal and transmit it to the corresponding external controller. This embodiment can divide the video data of one camera into two outputs through the deserializer, the main serializer and the slave serializer, realize the function of real-time data diversion and storage, and thus save the sensor cost in the system.
[0028] An embodiment of the present application also provides a video data diversion system, which is implemented on the basis of the previous embodiment. In this embodiment, the functions of the MCU module are described in detail.
[0029] The above-mentioned video data diversion system also includes: an MCU module; the MCU module is connected to the deserializer, the main serializer and the slave serializer respectively; the MCU module is used to determine and connect the target serializer according to the state of the trigger signal input by the main serializer when the video data diversion system is started, so that the target controller external to the target serializer initializes the configuration and triggers the camera; the target serializer includes: a main serializer or a slave serializer.
[0030] In addition, the above-mentioned MCU module is also used to detect the status of the trigger signal input by the GPO interface of the target serializer in real time during the operation of the video data diversion system. When it is judged that the working status of the target controller is abnormal according to the status and the target controller is the master controller, it switches to the slave serializer corresponding to the external slave controller to initialize the configuration and trigger control of the camera.
[0031] The above MCU module can be implemented with a chip model RH850, which controls the on / off of the master and slave IICs and the on / off of the GPOs. The IICs of the two serializers and one deserializer are connected to the MCU module; at the same time, the GPO ports of the two serializers and the GPI port of the deserializer are connected to the MCU module.
[0032] The MCU module determines whether the working state of the main controller is abnormal through the state of the trigger signal input by the GPO of the main serializer, so as to switch the main and slave signals. When the trigger signal sent by the GPO interface of the main serializer is input normally, it is judged that the main controller is working normally, and the main controller is used to configure the camera; when the trigger signal sent by the GPO interface of the main serializer is abnormal, it is judged that the main controller is faulty, and the slave controller is used to configure the camera.
[0033] In a preferred embodiment, the deserializer is implemented by a chip of model MAX9296, and the master serializer and the slave serializer are both implemented by a chip of model MAX9295. Figure 2 As shown, the MCU module 14 is respectively connected to the GPI interface and the IIC interface of the deserializer 11, the GPO interface and the IIC interface of the main serializer 12, and the GPO interface and the IIC interface of the slave serializer 13; the deserializer 11 is connected to the camera through the GMSL communication interface, and is respectively connected to the main serializer 12 and the slave serializer 13 through two 4-lane MIPI CSI-2 interfaces; the main serializer 12 and the slave serializer 13 are both connected to the corresponding external controller through the GMSL communication interface.
[0034] The video data shunting system provided in the embodiment of the present application can flexibly switch and select the controller corresponding to which serializer to initialize the configuration and trigger control of the camera through the judgment of the state of the trigger signal input by the MCU module to the main serializer. When the main controller is in normal working state, the main controller is selected to complete the configuration of the camera. When the main controller is in abnormal working state, the slave controller is selected to complete the configuration of the camera, which can ensure the normal operation of the video data shunting system.
[0035] Based on the above system embodiment, the embodiment of the present application also provides a video data distribution method, which is applied to the above video data distribution system; the video data distribution system includes: a deserializer, a master serializer and a slave serializer; wherein the deserializer is connected to the master serializer and the slave serializer respectively; see Figure 3 As shown, the method comprises the following steps:
[0036] Step S302, the deserializer receives the video data sent by the camera, and transmits the video data to the master serializer and the slave serializer respectively;
[0037] In step S304 , the master serializer and the slave serializer respectively convert the received video data into high-speed serial signals and transmit them to the corresponding external controller.
[0038] In the video data diversion method provided in the embodiment of the present application, the video data of one camera can be divided into two outputs through a deserializer, a master serializer and a slave serializer, realizing the functions of real-time data diversion and storage, thereby saving the sensor cost in the system.
[0039] In another embodiment, the video data distribution system further includes: an MCU module; the MCU module is respectively connected to the deserializer, the master serializer and the slave serializer; the embodiment of the present application also provides another video data distribution method, see Figure 4 As shown, the method specifically comprises the following steps:
[0040] Step 402, when the video data diversion system is started, the MCU module determines and connects the target serializer according to the state of the trigger signal input by the main serializer, so that the target controller external to the target serializer initializes the configuration and triggers the camera; the target serializer includes: a main serializer or a slave serializer.
[0041] The MCU module is respectively connected to the GPI interface and IIC interface of the deserializer, the GPO interface and IIC interface of the master serializer, and the GPO interface and IIC interface of the slave serializer; the MCU module determines and connects the target serializer according to the state of the trigger signal input by the master serializer, so that the target controller external to the target serializer performs initialization configuration and trigger control on the camera, specifically comprising: the MCU module obtains the state of the trigger signal input by the GPO interface of the master serializer, and judges whether the working state of the master controller external to the master serializer is normal according to the state; if the working state of the master controller is normal, the master serializer is determined as the target serializer; if the working state of the master controller is abnormal, the slave serializer is determined as the target serializer; the IIC interface and the GPO interface of the target serializer are connected (that is, the GPO interface of the target serializer is connected to the GPI interface of the deserializer, and the IIC interface of the target serializer is connected to the IIC interface of the deserializer), so that the target controller external to the target serializer initializes the register of the camera through the IIC interface of the target serializer, and triggers the ISP of the camera through the GPO interface of the target serializer. For example, if the trigger frame rate is 10 Hz, the camera will send video data to the deserializer at a frame rate of 10 Hz.
[0042] Step S404, the deserializer receives the video data sent by the camera, and transmits the video data to the master serializer and the slave serializer respectively. Specifically, the deserializer is configured with a GMSL communication interface and two 4-lane MIPI CSI-2 interfaces; the deserializer receives the video data sent by the camera through the GMSL communication interface, and transmits the video data to the master serializer and the slave serializer respectively through the two 4-lane MIPI CSI-2 interfaces.
[0043] In step S406 , the master serializer and the slave serializer respectively convert the received video data into high-speed serial signals and transmit them to the corresponding external controller.
[0044] Step S408, during the operation of the video data diversion system, the MCU module detects the status of the trigger signal input by the target serializer in real time. When it is determined that the working status of the target controller is abnormal and the target controller is the master controller, the slave serializer is switched to the external slave controller corresponding to initialize the configuration and trigger control of the camera.
[0045] In practical applications, the following six working conditions are encountered:
[0046] 1) When the system starts and runs, and both the master controller and the slave controller can work normally:
[0047] At startup, the MCU module in the video data diversion system detects that the trigger signal sent by the GPO interface of the main serializer is normal, so the working status of the MCU module is judged to be the main controller is normal; the working status of the MCU module is to connect the GPO interface and the IIC interface of the main serializer, so that the main controller configures the register of the camera through the IIC interface of the main serializer, and controls the GPO interface of the main serializer to trigger the camera.
[0048] 2) When the system starts, both the master controller and the slave controller can work normally. However, during operation, the slave controller suddenly fails:
[0049] At startup, the MCU module in the video data diversion system detects that the trigger signal sent by the GPO interface of the main serializer is normal, so the working status of the MCU module is judged to be the main controller is normal; the working status of the MCU module is to connect the GPO interface and the IIC interface of the main serializer, so that the main controller configures the register of the camera through the IIC interface of the main serializer, and controls the GPO interface of the main serializer to trigger the camera.
[0050] If the slave controller fails during operation, it will not affect the working status of the MCU.
[0051] 3) When the system starts, both the master controller and the slave controller can work normally. However, during operation, the master controller suddenly fails:
[0052] At startup, the MCU module in the video data diversion system detects that the trigger signal sent by the GPO interface of the main serializer is normal, so the working status of the MCU module is judged to be the main controller is normal; the working status of the MCU module is to connect the GPO interface and the IIC interface of the main serializer, so that the main controller configures the register of the camera through the IIC interface of the main serializer, and controls the GPO interface of the main serializer to trigger the camera.
[0053] During operation, the main controller fails, and the MCU module in the video data diversion system detects that the trigger signal sent by the GPO interface of the main serializer is abnormal, so the working status of the MCU module is judged as a main controller failure; at this time, the MCU module connects the GPO interface and IIC interface of the slave serializer, so that the slave controller configures the register of the camera through the IIC interface of the slave serializer, and controls the GPO interface of the slave serializer to trigger the camera.
[0054] 4) When the system starts, the master controller works normally, but the slave controller fails:
[0055] At startup, the MCU module in the video data diversion system detects that the trigger signal sent by the GPO interface of the main serializer is normal, so the working status of the MCU module is judged to be the main controller is normal; the working status of the MCU module is to connect the GPO interface and the IIC interface of the main serializer, so that the main controller configures the register of the camera through the IIC interface of the main serializer, and controls the GPO interface of the main serializer to trigger the camera.
[0056] 5) When the system starts, the slave controller works normally, but the master controller fails:
[0057] At startup, the MCU module in the video data diversion system detects that the trigger signal sent by the GPO interface of the main serializer is abnormal, so the working state of the MCU module is judged as a main controller failure; the working state of the MCU module is to connect the GPO interface and the IIC interface of the slave serializer, so that the slave controller configures the register of the camera through the IIC interface of the slave serializer, and controls the GPO interface of the slave serializer to trigger the camera.
[0058] 6) When the system starts, if both the master controller and the slave controller fail:
[0059] At startup, the MCU module in the video data diversion system detects that the trigger signal sent by the GPO interface of the main serializer is abnormal, so the working state of the MCU is judged as a main controller failure; the working state of the MCU is to use the slave controller to work; but at this time the slave controller fails, so the camera's registers cannot be configured, and the camera cannot be triggered, so there is no video data output in the end.
[0060] The video data shunting method provided in the embodiment of the present application can flexibly switch and select the controller corresponding to which serializer to initialize the configuration and trigger control of the camera by judging the state of the trigger signal input by the main serializer through the MCU module. When the main controller is in normal working state, the main controller is selected to complete the configuration of the camera. When the main controller is in abnormal working state, the slave controller is selected to complete the configuration of the camera, which can ensure the normal operation of the video data shunting system.
[0061] Based on the above system embodiment, the present application embodiment also provides a camera data processing system, see Figure 5 As shown, the camera data processing system includes: a camera 51, a main path controller 52, a slave path controller 53 and a video data diversion system 54 as described in the first aspect; the camera 51 is connected to a deserializer 541 in the video data diversion system 54; the main path controller 52 is connected to a main path serializer 542 in the video data diversion system 54; the slave path controller 53 is connected to a slave path serializer 543 in the video data diversion system 54; the video data diversion system 54 is used to divert and store the video data of the camera 51, and is also used to provide POC power to the camera 51.
[0062] Of course, the video data distribution system 54 may also include an MCU module, and its working process is the same as described above, which will not be repeated here. The camera data processing system provided in the embodiment of the present application has the same implementation principle and technical effects as the aforementioned system and method embodiments. For the sake of brief description, for any part not mentioned in the embodiment of the camera data processing system, reference may be made to the corresponding contents in the aforementioned method or system embodiments.
[0063] Unless otherwise specifically stated, the relative steps, numerical expressions and values of the components and steps set forth in these embodiments do not limit the scope of the present application.
[0064] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0065] In the description of the present application, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present application. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.
[0066] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims
1. A video data distribution system, characterized in that: The video data shunting system comprises: a deserializer, a main serializer and a slave serializer; wherein the deserializer is connected to the main serializer and the slave serializer respectively; the video data shunting system further comprises: an MCU module; the MCU module is connected to the deserializer, the main serializer and the slave serializer respectively; the MCU module is connected to the GPI interface and the IIC interface of the deserializer, the GPO interface and the IIC interface of the main serializer, the GPO interface and the IIC interface of the slave serializer respectively; The MCU module is used to obtain the state of the trigger signal input by the GPO interface of the master serializer when the video data shunting system is started, and judge whether the working state of the master controller externally connected to the master serializer is normal according to the state; if the working state of the master controller is normal, determine the master serializer as the target serializer; if the working state of the master controller is abnormal, determine the slave serializer as the target serializer; connect the IIC interface and the GPO interface of the target serializer, so that the target controller externally connected to the target serializer initializes the register configuration of the camera through the IIC interface of the target serializer, and triggers the ISP of the camera through the GPO interface of the target serializer; the target serializer includes: the master serializer or the slave serializer; The deserializer is used to receive the video data sent by the camera, and transmit the video data to the master serializer and the slave serializer respectively; The master serializer and the slave serializer respectively convert the received video data into high-speed serial signals and transmit them to the corresponding external controller; The video data diversion system can handle the following six working conditions: when the system starts and during operation, both the main controller and the slave controller can work normally; when the system starts, both the main controller and the slave controller can work normally, but during operation, the slave controller suddenly fails; when the system starts, both the main controller and the slave controller can work normally, but during operation, the main controller suddenly fails; when the system starts, the main controller works normally, but the slave controller fails; when the system starts, the slave controller works normally, but the main controller fails; when the system starts, both the main controller and the slave controller fail.
2. The video data distribution system according to claim 1, characterized in that: The MCU module is also used to detect the status of the trigger signal input by the GPO interface of the target serializer in real time during the operation of the video data diversion system, and when it is judged that the working status of the target controller is abnormal according to the status and the target controller is the master controller, switch to the slave serializer corresponding to the external slave controller to initialize the configuration and trigger control of the camera.
3. The video data distribution system according to claim 1, characterized in that: The deserializer is connected to the camera through a GMSL communication interface, and is respectively connected to the master serializer and the slave serializer through two 4-lane MIPI CSI-2 interfaces; the master serializer and the slave serializer are both connected to the corresponding external controller through the GMSL communication interface.
4. A video data splitting method, characterized in that: The method is applied to a video data shunting system; the video data shunting system comprises: a deserializer, a main serializer and a slave serializer; wherein the deserializer is connected to the main serializer and the slave serializer respectively; the video data shunting system further comprises: an MCU module; the MCU module is connected to the deserializer, the main serializer and the slave serializer respectively; the MCU module is connected to the GPI interface and the IIC interface of the deserializer, the GPO interface and the IIC interface of the main serializer, the GPO interface and the IIC interface of the slave serializer respectively; the method comprises: When the video data shunting system is started, the MCU module obtains the state of the trigger signal input by the GPO interface of the master serializer, and determines whether the working state of the master controller externally connected to the master serializer is normal according to the state; if the working state of the master controller is normal, the master serializer is determined as the target serializer; if the working state of the master controller is abnormal, the slave serializer is determined as the target serializer; the IIC interface and the GPO interface of the target serializer are connected, so that the target controller externally connected to the target serializer initializes and configures the register of the camera through the IIC interface of the target serializer, and triggers the ISP of the camera through the GPO interface of the target serializer; the target serializer includes: the master serializer or the slave serializer; The deserializer receives the video data sent by the camera, and transmits the video data to the master serializer and the slave serializer respectively; The master serializer and the slave serializer respectively convert the received video data into high-speed serial signals and transmit them to the corresponding external controller.
5. The video data splitting method according to claim 4, characterized in that: The deserializer is configured with a GMSL communication interface and two 4-lane MIPI CSI-2 interfaces; the deserializer receives video data sent by a camera, and transmits the video data to the master serializer and the slave serializer respectively, comprising: The deserializer receives the video data sent by the camera through the GMSL communication interface, and transmits the video data to the master serializer and the slave serializer through two 4-lane MIPI CSI-2 interfaces respectively.
6. The video data splitting method according to claim 4, characterized in that: The method further comprises: During the operation of the video data diversion system, the MCU module detects the state of the trigger signal input by the target serializer in real time. When it is determined that the working state of the target controller is abnormal according to the state and the target controller is the master controller, the slave serializer is switched to the external slave controller corresponding to initialize the configuration and trigger control of the camera.
7. A camera data processing system, characterized in that: The camera data processing system comprises: a camera, a master controller, a slave controller and a video data distribution system according to any one of claims 1 to 3; The camera is connected to a deserializer in the video data distribution system; The main channel controller is connected to the main channel serializer in the video data distribution system; The slave controller is connected to the slave serializer in the video data distribution system; The video data shunting system is used to shun and store the video data of the camera, and is also used to provide POC power supply for the camera.
Citation Information
Patent Citations
Visual image data processing system and method and automatic driving automobile
CN111078475A
Video processing device and vehicle
CN211557370U
