A video stream diagnosis system, a video stream diagnosis method and a vehicle

Abstract

The present disclosure provides a video stream diagnosis system, a video stream diagnosis method and a vehicle. The video stream diagnosis system comprises a master control device, a first signal processing device, a second signal processing device and a switch module. The master control device is configured to output a first video stream of a first protocol through a display serial interface, and control the switching state of the switch module, so that the switching channel between the output end of the first signal processing device and the input end of the second signal processing device is turned on. The first signal processing device is configured to perform first signal processing on the first video stream of the first protocol to obtain a first video stream of a second protocol. The second signal processing device is configured to perform second signal processing on the first video stream of the second protocol to obtain a first video stream of a third protocol, and transmit the first video stream of the third protocol to a camera serial interface of the master control device. The master control device is further configured to diagnose the transmission quality of the first video stream according to the first video stream of the first protocol and the first video stream of the third protocol.

Description

Technical Field

[0001] This disclosure relates to the field of video stream diagnostics technology, and more specifically, to a video stream diagnostics system, a video stream diagnostics method, and a vehicle. Background Technology

[0002] In recent years, with the rapid development of in-vehicle intelligence, intelligent cockpit systems have become more intelligent, and the number of in-vehicle displays, cameras, and other devices has increased dramatically, with their applications becoming more widespread. Furthermore, due to the increased number of displays and cameras, the diagnostics of the video streams transmitted by these devices has become increasingly important.

[0003] However, existing technologies lack diagnostic capabilities for video streams. Summary of the Invention

[0004] One objective of this disclosure is to provide a new technical solution for a video stream diagnostic system.

[0005] According to a first aspect of the present disclosure, a video stream diagnostic system is provided. The video stream diagnostic system includes a main control device, a first signal processing device, a second signal processing device, and a switch module. The main control device has a camera serial interface and a display serial interface. The display serial interface is connected to the input terminal of the first signal processing device, and the camera serial interface is connected to the output terminal of the second signal processing device. The main control device is configured to output a first video stream of a first protocol through the display serial interface and control the switching state of the switch module, so that the switch channel between the output terminal of the first signal processing device and the input terminal of the second signal processing device is connected. The first signal processing device is configured to perform first signal processing on the first video stream of the first protocol to obtain a first video stream of a second protocol. The second signal processing device is configured to perform second signal processing on the first video stream of the second protocol to obtain a first video stream of a third protocol, and transmit it to the camera serial interface of the main control device. The main control device is also configured to diagnose the transmission quality of the first video stream based on the first video stream of the first protocol and the first video stream of the third protocol.

[0006] Optionally, the main control device is configured to detect whether a diagnostic event of the video stream has occurred. If a diagnostic event is detected, the main control device controls the switching state of the switch module to make the switching channel between the output terminal of the first signal processing device and the input terminal of the second signal processing device open. If the diagnostic event is not detected, the main control device controls the state of the switch module to make the switching channel between the output terminal of the first signal processing device and the input terminal of the second signal processing device close.

[0007] Optionally, the video stream diagnostic system further includes a video stream output terminal for connection to a display and a video stream input terminal for connection to a camera. The switch module includes a first video stream switch, a second video stream switch, and a third video stream switch. The first video stream switch is connected between the output terminal of the first signal processing device and the input terminal of the second signal processing device. The second video stream switch is connected between the output terminal of the first signal processing device and the video stream output terminal. The third video stream switch is connected between the input terminal of the second signal processing device and the video stream input terminal.

[0008] Optionally, the video stream diagnostic system further includes a video stream output terminal for connection to a display and a video stream input terminal for connection to a camera. The switch module includes a first dual-channel switch and a second dual-channel switch. The input terminal of the first dual-channel switch is connected to the output terminal of the first signal processing device, the first output terminal of the first dual-channel switch is connected to the video stream output terminal, and the second output terminal of the first dual-channel switch is connected to the first input terminal of the second dual-channel switch. The second input terminal of the second dual-channel switch is connected to the video stream input terminal, and the output terminal of the second dual-channel switch is connected to the input terminal of the second signal processing device.

[0009] Optionally, the main control device is configured to, when controlling the switching channel between the output terminal of the first signal processing device and the video stream output terminal, and the switching channel between the input terminal of the second signal processing device and the video stream input terminal, be disconnected; and when controlling the switching channel between the output terminal of the first signal processing device and the input terminal of the second signal processing device to be disconnected, control the switching channel between the output terminal of the first signal processing device and the video stream output terminal, and the switching channel between the input terminal of the second signal processing device and the video stream input terminal to be connected.

[0010] Optionally, the main control device is further configured to output a second video stream of the first protocol through the display serial interface when the switching channel between the output terminal of the first signal processing device and the video stream output terminal is turned on.

[0011] The first signal processing device is configured to perform first signal processing on the video stream of the first protocol to obtain a second video stream of the second protocol, and output it to the display for display through the video stream output terminal.

[0012] Optionally, the main control device is further configured to determine the transmission loss of the first video stream based on the first video stream of the first protocol and the first video stream of the third protocol; and to compensate for the transmission loss of the second video stream of the first protocol.

[0013] Optionally, the second signal processing device is configured to perform second signal processing on the third video stream of the second protocol captured by the camera and input through the video stream input terminal when the switching channel between the input terminal of the second signal processing device and the video stream input terminal is turned on, to obtain the third video stream of the third protocol, and transmit it to the main control device through the camera serial interface.

[0014] According to a second aspect of this disclosure, a video stream diagnostic method is provided, comprising:

[0015] The main control device outputs a first video stream of a first protocol to the first signal processing device, so that the first signal processing device performs first signal processing on the first video stream of the first protocol to obtain a first video stream of a second protocol.

[0016] The main control device controls the switching state of the switch module, so that the switch channel between the output terminal of the first signal processing device and the input terminal of the second signal processing device is connected, and the first video stream of the second protocol is transmitted to the second signal processing module for second signal processing to obtain the first video stream of the third protocol.

[0017] The main control device receives the first video stream of the third protocol output by the second signal processing device, and diagnoses the transmission quality of the first video stream based on the first video stream of the first protocol and the first video stream of the third protocol.

[0018] According to a third aspect of this disclosure, a vehicle is provided, including a video streaming diagnostic system according to any one of the first aspects.

[0019] In the embodiments of this disclosure, the main control device outputs a first video stream of a first protocol through the display serial interface and controls the state of the switch module to connect the switch channel between the output of the first signal processing device and the input of the second signal processing device. The first signal processing device performs first signal processing on the first video stream of the first protocol to obtain a first video stream of the second protocol. The second signal processing device performs second signal processing on the first video stream of the second protocol to obtain a first video stream of the third protocol, which is then transmitted to the camera serial interface of the main control device. The main control device then diagnoses the transmission quality of the first video stream based on the first video stream of the first protocol and the first video stream of the third protocol. In this way, the transmission quality of the first video stream can be diagnosed, which is not only simple, fast, and accurate.

[0020] Other features and advantages of the invention will become clear from the following detailed description of exemplary embodiments of the invention with reference to the accompanying drawings. Attached Figure Description

[0021] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of the invention and, together with their description, serve to explain the principles of the invention.

[0022] Figure 1 This is a circuit schematic diagram of a video stream diagnostic system according to an embodiment of the present disclosure;

[0023] Figure 2 This is a circuit schematic diagram of a video stream diagnostic system according to another embodiment of the present disclosure;

[0024] Figure 3 This is a circuit schematic diagram of a video stream diagnostic system according to another embodiment of the present disclosure;

[0025] Figure 4 This is a flowchart of a video stream diagnostic method according to an embodiment of the present disclosure;

[0026] Figure 5 This is a schematic diagram of the structure of a vehicle according to an embodiment of the present disclosure;

[0027] Figure 6 This is a structural schematic diagram of a vehicle according to another embodiment of the present disclosure. Detailed Implementation

[0028] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the invention.

[0029] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the invention or its application or use.

[0030] Techniques, methods, and apparatus known to those skilled in the art in the relevant field may not be discussed in detail, but where appropriate, such techniques, methods, and apparatus should be considered part of the specification.

[0031] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0032] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0033] Figure 1 A circuit schematic of a video stream diagnostic system 1000 according to some embodiments is shown.

[0034] like Figure 1 As shown, in one embodiment of this application, the video stream diagnostic system includes a main control device 1100, a first signal processing device 1200, a second signal processing device 1400, and a switch module 1300.

[0035] Specifically, the switch module 1300 includes at least a switch channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400. The main control device 1100 has a camera serial interface 1120 and a display serial interface 1110. The display serial interface 1110 is connected to the input terminal of the first signal processing device 1200, and the camera serial interface 1120 is connected to the output terminal of the second signal processing device 1400.

[0036] In embodiments of this application, the main control device 1100 in the video stream diagnostic system can be a host device employing a System-on-Chip (SOC). The camera serial interface 1120 can be a CSI (CMOS Serial Interface). A CSI interface is a high-speed serial interface used for connecting to a camera. The display serial interface 1110 can be a DSI (Display Serial Interface). A DSI interface is a high-speed serial interface used for connecting to a display. In one embodiment of this application, the display serial interface 1110 of the main control device 1100 can be connected to the display 2100 via a first signal processing device 1200, and the camera serial interface 1120 of the main control device 1100 can be connected to the camera 2200 via a second signal processing device 1400.

[0037] In some embodiments of this application, the main control device 1100 is configured to output a first video stream of the first protocol through the display serial interface 1110 and control the switching state of the switch module 1300, so that the switching channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400 is connected.

[0038] In this embodiment, the main control device 1100 can output a first video stream of a first protocol through its display serial interface 1110. The first video stream of the first protocol can be a video stream using the MIPI-DSI protocol specification. The MIPI-DSI protocol can be the interface protocol in the MIPI (Mobile Industry Processor Interface) protocol used for communication with the display. This is understood by those skilled in the art and will not be elaborated further. Furthermore, the main control device 1100 can also control the switching state of the switch module 1300 to realize the transmission or interruption of the video stream between the first signal processing device 1200 and the second signal processing device 1400.

[0039] In one embodiment of this application, the first signal processing device 1200 is configured to perform first signal processing on the first video stream of the first protocol to obtain the first video stream of the second protocol.

[0040] In this embodiment, the first signal processing device 1200 can be a DSI Serializer, which is a signal processing device that converts the video stream from the MIPI-DSI protocol to the GMSL (Gigabit Multimedia Serial Link) protocol. This is something that those skilled in the art will understand, and will not be elaborated further. The first signal processing device 1200 can perform first signal processing on the first video stream of the first protocol output by the main control device 1100 to obtain a first video stream of the second protocol. In other words, the first video stream of the second protocol obtained here can be a video stream using the GMSL protocol specification.

[0041] In other embodiments of this application, the second signal processing device 1400 is configured to perform second signal processing on the first video stream of the second protocol to obtain the first video stream of the third protocol, and transmit it to the camera serial interface 1120 of the main control device 1100.

[0042] In this embodiment, when the switching channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400 is open, the first video stream of the second protocol processed by the first signal processing device 1200 can be transmitted to the second signal processing device 1400. The second signal processing device 1400 can be a CSI-2 Deserializer, that is, a signal processing device that converts the video stream from the GMSL protocol to the MIPI-CSI protocol. This is understood by those skilled in the art and will not be elaborated further. Based on this, the second signal processing device 1400 can perform second signal processing on the first video stream of the second protocol processed by the first signal processing device 1200 to obtain a first video stream of the third protocol. In other words, the first video stream of the third protocol obtained here can be a video stream using the MIPI-CSI protocol specification. The MIPI-CSI protocol can be the interface protocol in the MIPI protocol used for communication with the camera. This is understood by those skilled in the art and will not be elaborated further. After the second signal processing device 1400 processes and obtains the first video stream of the third protocol, it can be transmitted to the camera serial interface 1120 on the main control device 1100.

[0043] In one embodiment of this application, the first protocol and the third protocol may be the same. For example, the first protocol and the third protocol may both be the MIPI-DSI protocol, or the first protocol and the third protocol may both be the MIPI-CSI protocol.

[0044] In some other embodiments of this application, the main control device 1100 is also configured to diagnose the transmission quality of the first video stream according to the first video stream of the first protocol and the first video stream of the third protocol.

[0045] In this embodiment, the main control device 1100 can compare the first video stream of the output first protocol and the first video stream of the received third protocol frame by frame to diagnose the transmission quality of the first video stream. It should be noted that the transmission quality of the video stream mentioned above can include indicators of transmission loss caused during the transmission process. This is understood by those skilled in the art and will not be elaborated upon here.

[0046] In one embodiment of this application, the main control device 1100 is configured to detect whether a diagnostic event of the video stream has occurred. If a diagnostic event is detected, the main control device 1100 controls the switching state of the switch module 1300 to make the switching channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400 open. If no diagnostic event is detected, the main control device 1100 controls the switching state of the switch module 1300 to make the switching channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400 close.

[0047] In this embodiment, the main control device 1100 can detect whether a diagnostic event has occurred for the video stream. It should be noted that the diagnostic event for the video stream can be the receipt of a diagnostic command or the reaching of a preset diagnostic time. In other words, a diagnostic event can be determined to have occurred if a diagnostic command is received or a preset diagnostic time is reached. The specific settings for the diagnostic time or diagnostic command can be manually configured according to actual conditions and are not limited here.

[0048] Furthermore, a button for triggering diagnostic commands can be installed in the vehicle. When the user clicks the button, the vehicle sends diagnostic commands to the main control unit 1100.

[0049] Furthermore, the vehicle may receive a voice command from the user to diagnose the video stream, and in response to the voice command, send a diagnostic command to the main control device 1100.

[0050] When the main control device 1100 detects the occurrence of this diagnostic event, it can control the switching state of the switch module 1300 to connect the switching channel between the output of the first signal processing device 1200 and the input of the second signal processing device 1400. Based on this, the first video stream of the second protocol processed by the first signal processing device 1200 can be transmitted to the second signal processing device 1400.

[0051] If the main control device 1100 does not detect the diagnostic event, it sends a switch control command to the switch module 1300 to control the state of the switch module 1300, thereby disconnecting the switch channel between the output of the first signal processing device 1200 and the input of the second signal processing device 1400. Based on this, the first video stream of the second protocol processed by the first signal processing device 1200 will not be transmitted to the second signal processing device 1400.

[0052] In the embodiments of this disclosure, the main control device outputs a first video stream of a first protocol through the display serial interface and controls the state of the switch module to connect the switch channel between the output of the first signal processing device and the input of the second signal processing device. The first signal processing device performs first signal processing on the first video stream of the first protocol to obtain a first video stream of the second protocol. The second signal processing device performs second signal processing on the first video stream of the second protocol to obtain a first video stream of the third protocol, which is then transmitted to the camera serial interface of the main control device. The main control device then diagnoses the transmission quality of the first video stream based on the first video stream of the first protocol and the first video stream of the third protocol. In this way, the transmission quality of the first video stream can be diagnosed, which is not only simple, fast, and accurate.

[0053] In other embodiments of this application, such as Figure 2 and Figure 3 As shown, the video stream diagnostic system 1000 also includes a video stream output terminal 1500 for connection to the display 2100 and a video stream input terminal 1600 for connection to the camera 2200.

[0054] Based on this, the switch module 1300 may further include a switch channel between the output terminal of the first signal processing device 1200 and the video stream output terminal 1500, and a switch channel between the input terminal of the second signal processing device and the video stream input terminal 1600.

[0055] Furthermore, the main control device 1100 is configured to output a second video stream of the first protocol through the display serial interface when the switching channel between the output terminal of the first signal processing device 1200 and the video stream output terminal 1500 is turned on. Based on this, the first signal processing device 1200 is configured to perform first signal processing on the second video stream of the first protocol to obtain a second video stream of the second protocol, and then output the second video stream of the second protocol to the display 2100 for display through the video stream output terminal 1500.

[0056] The second video stream of the first protocol can be the video stream output by the main control device 1100 through its display serial interface 1110 in the event of a diagnostic event where no video stream is detected.

[0057] The first information processing device 1200 can perform first signal processing on the second video stream of the first protocol output by the main control device 1100, that is, convert the second video stream of the first protocol into a second video stream of the second protocol. After obtaining the second video stream of the second protocol, it can be transmitted to the display 2100 through the video stream output terminal 1500 and displayed on the display 2100. It should be noted that during this process, since the switching channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400 is in a disconnected state, the second video stream of the second protocol cannot be transmitted to the second information processing device 1400.

[0058] In one embodiment of this application, the main control device 1100 is further configured to determine the transmission loss of the first video stream based on the first video stream of the first protocol and the first video stream of the third protocol; and to compensate for the transmission loss of the second video stream of the first protocol.

[0059] In this embodiment, the main control device 1100 can, in the event of a diagnostic event in the video stream detection, compare the original output first video stream of the first protocol with the final returned first video stream of the third protocol frame by frame to calculate the transmission loss of the first video stream along the path. After determining the transmission loss of the first video stream, the main control device 1100 can compensate for the second video stream of the first protocol based on the transmission loss. The first video stream of the first protocol can be the video stream output by the main control device 1100 through its display serial interface 1110 when a diagnostic event in the video stream detection occurs, while the second video stream of the first protocol can be the video stream output by the main control device 1100 through its display serial interface 1110 when no diagnostic event occurs.

[0060] In simple terms, the main control device 1100 can first diagnose the first video stream to calculate the transmission loss caused by the first video stream during transmission. Based on this, the second video stream output by the main control device 1100 under non-diagnostic events can be compensated according to the calculated transmission loss of the first video stream.

[0061] For example, if the transmission loss during video stream transmission in the event of a diagnostic event results in the loss of pixels in the video frames, and causes a decrease in the quality of the video image displayed on the monitor, then pixel compensation can be applied to the second video stream output in subsequent non-diagnostic events.

[0062] For example, if the transmission loss of the video stream during a diagnostic event is the color loss of the target pixel, the color of the target pixel in the second video stream output under subsequent non-diagnostic events can be compensated to reduce the distortion of the second video stream displayed on the monitor.

[0063] Through this embodiment, the diagnostic results of the first video stream can be used to optimize and compensate the subsequent output of the second video stream, thus avoiding the problem of signal distortion in the video stream displayed on the monitor.

[0064] Furthermore, the second signal processing device 1400 is configured to perform second signal processing on the third video stream of the second protocol acquired by the camera 2200 and input through the video stream input terminal 1600 when the switch channel between the input terminal of the second signal processing device and the video stream input terminal 1600 is turned on, to obtain the third video stream of the third protocol, and transmit it to the main control device 1100 through the camera serial interface.

[0065] In this embodiment, the second signal processing device 1400 can perform second signal processing on the third video stream of the second protocol acquired by the camera 2200 and input through the video stream input terminal 1600, that is, convert the third video stream of the second protocol into a third video stream of the third protocol. Here, the third video stream of the second protocol can be a video stream conforming to the GMSL protocol specification. After obtaining the third video stream of the third protocol, it can be transmitted to the main control device 1100 through the camera serial interface 1120. Based on this, the main control device 1100 can output the corresponding third video stream of the first protocol according to the third video stream of the third protocol, and then convert the third video stream of the first protocol into a third video stream of the second protocol through the first information processing device 1200, and finally transmit it to the video stream output terminal 1500 connected to the display, and display the corresponding video image on the display.

[0066] In one embodiment of this application, when the main control device 1100 controls the switching channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400 to be turned on, it controls the switching channel between the output terminal of the first signal processing device 1200 and the video stream output terminal 1500, and the switching channel between the input terminal of the second signal processing device 1400 and the video stream input terminal 1600 to be turned off; thereby, the first video stream of the second protocol obtained by the first signal processing device 1200 performing first signal processing on the first video stream of the first protocol can be transmitted to the second signal processing device 1400.

[0067] When the main control device 1100 disconnects the switching channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400, it controls the switching channel between the output terminal of the first signal processing device 1200 and the video stream output terminal 1500, and the switching channel between the input terminal of the second signal processing device 1400 and the video stream input terminal 1600, so that the second video stream of the second protocol obtained by the first signal processing device 1200 from the second video stream of the first protocol can be transmitted to the display 2100 through the video stream output terminal 1500; it can also transmit the third video stream of the third protocol input by the camera 2200 through the video stream input terminal 1600 to the second signal processing device 1400 for second signal processing.

[0068] In one embodiment of this application, such as Figure 2 As shown, the switch module 1300 may include a first video stream switch 1310, a second video stream switch 1320, and a third video stream switch 1330.

[0069] Specifically, such as Figure 2 As shown, the first video stream switch 1310 is connected between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400, the second video stream switch 1320 is connected between the output terminal of the first signal processing device 1200 and the video stream output terminal 1500, and the third video stream switch 1330 is connected between the input terminal of the second signal processing device 1400 and the video stream input terminal 1600.

[0070] In this embodiment, the main control device 1100 can send switch control commands to the second video stream switch 1320 and the third video stream switch 1330 via path A9, and send switch control commands to the first video stream switch 1310 via path A10, so as to control the conduction or interruption of the first video stream switch 1310, the second video stream switch 1320 and the third video stream switch 1330. Figure 2 A1 to A8 shown can be the path for video stream transmission, and A9 or A10 can be the path for switch control command transmission.

[0071] When the first video stream switch 1310 is turned on, the first signal processing device 1200 performs first signal processing on the first video stream of the first protocol output by the main control device 1100 through the display serial interface 1110. The resulting first video stream of the second protocol can be transmitted to the second signal processing device 1400 through the turned-on first video stream switch 1310. The second signal processing device 1400 performs second signal processing on the first video stream of the second protocol and transmits the resulting first video stream of the third protocol to the camera serial interface 1120 of the main control device 1100. The path traversed by the first video stream can be A1, A4, A5, or A8.

[0072] When the second video stream switch 1320 is turned on, the first signal processing device 1200 performs first signal processing on the second video stream of the first protocol output by the main control device 1100 through the display serial interface 1110. The resulting second video stream of the second protocol can be transmitted to the video stream output terminal 1500 for connection to the display 2100 through the turned-on second video stream switch 1320. When the video stream output terminal 1500 is connected to the display 2100, the first video stream can be displayed on the display 2100. The path traversed by the second video stream can be from A1 to A3.

[0073] With the third video stream switch 1330 turned on, the camera 2200 can transmit the acquired third video stream of the second protocol to the second signal processing device 1400 through the video input terminal 1600 connected to it and the turned-on third video stream switch 1330. The second signal processing device 1400 then performs second signal processing on the third video stream of the second protocol and transmits the resulting third video stream of the third protocol to the camera serial interface 1120 of the main control device 1100. The path traversed by the third video stream can be from A6 to A8.

[0074] In one embodiment of this application, the main control device 1100 is configured to control the second video stream switch 1320 and the third video stream switch 1330 to be disconnected when the first video stream switch 1300 is turned on; and to control the second video stream switch 1320 and the third video stream switch 1330 to be turned on when the first video stream switch 1300 is turned off.

[0075] When the main control device 1100 controls the first video stream switch 1300 to be turned on, it can control the second video stream switch 1320 and the third video stream switch 1330 to be turned off, so that the first video stream of the second protocol obtained by the first signal processing device 1200 performing first signal processing on the first video stream of the first protocol can be transmitted to the second signal processing device 1400.

[0076] Based on this, the second signal processing device 1400 can convert the first video stream of the second protocol into the first video stream of the third protocol and transmit it back to the main control device 1100. In other words, when diagnosing the video stream, the first video stream passes through paths A1, A4, A5, and A8 in sequence. Meanwhile, because the second video stream switch 1320 is in the off state, the first signal processing device 1200 cannot transmit the converted first video stream of the second protocol to the video stream output terminal 1500 connected to the display 2100, and therefore cannot display it on the display. It should also be noted that during this process, because the third video stream switch 1330 is in the off state, the camera 2200 connected to the video stream input terminal 1600 cannot transmit the acquired video stream to the second signal processing device 1400 through the third video stream switch 1330.

[0077] When the main control device 1100 controls the first video stream switch 1300 to be turned off, it can control the second video stream switch 1320 and the third video stream switch 1330 to be turned on, so that the first signal processing device 1200 can perform first signal processing on the second video stream of the first protocol output by the main control device 1100 to obtain the second video stream of the second protocol, and transmit it to the video stream output terminal 1500 connected to the display. The paths of the second video stream here are A1, A2 and A3 in sequence.

[0078] Simultaneously, the camera can transmit the acquired third video stream of the second protocol to the second signal processing device 1400 via its connected video input terminal 1600. The second signal processing device 1400 converts the third video stream of the second protocol into a third video stream of the third protocol, and then transmits it to the main control device 1100. For example... Figure 2 As shown, the paths that the third video stream passes through here can be A6, A7, and A8 in sequence.

[0079] In another embodiment of this application, such as Figure 3 As shown, the switch module 1300 may include a first dual-channel switch 1340 and a second dual-channel switch 1350. The input terminal of the first dual-channel switch 1340 is connected to the output terminal of the first signal processing device 1200, the first output terminal of the first dual-channel switch 1340 is connected to the video stream output terminal 1500, and the second output terminal of the first dual-channel switch 1340 is connected to the first input terminal of the second dual-channel switch 1350. The second input terminal of the second dual-channel switch 1350 is connected to the video stream input terminal 1600, and the output terminal of the second dual-channel switch 1350 is connected to the input terminal of the second signal processing device 1400.

[0080] In this embodiment, the main control device 1100 can send switch control commands to the first dual-channel switch 1340 and the second dual-channel switch 1350 via path B8 to control the conduction or interruption of each channel in the first dual-channel switch 1340 and the second dual-channel switch 1350. Figure 3 B1 to B7 shown can be the path for video stream transmission, and B8 can be the path for switch control command transmission.

[0081] When the switching channels between the input and second output terminals of the first dual-channel switch 1340 and the first input and output terminals of the second dual-channel switch 1350 are connected, the first signal processing device 1200 performs first signal processing on the first video stream of the first protocol output by the main control device 1100 through the display serial interface 1110. The resulting first video stream of the second protocol can be transmitted to the second signal processing device 1400. The second signal processing device 1400 performs second signal processing on the first video stream of the second protocol and transmits the resulting first video stream of the third protocol to the camera serial interface 1120 of the main control device 1100. The path traversed by the first video stream can be B1, B2, B4, B6, or B7.

[0082] When the switching channel between the input terminal and the first output terminal of the first dual-channel switch 1340 is open, the first signal processing device 1200 performs first signal processing on the second video stream of the first protocol output by the main control device 1100 through the display serial interface 1110. The resulting second video stream of the second protocol can be transmitted to the video stream output terminal 1500 for connection to the display 2100. When the video stream output terminal 1500 is connected to the display 2100, the second video stream can be displayed on the display 2100. The path traversed by the second video stream can be from B1 to B3.

[0083] When the switching channel between the second input terminal and the output terminal of the second dual-channel switch 1350 is open, the camera 2200 can transmit the acquired third video stream of the second protocol to the second signal processing device 1400 through the video input terminal 1600 connected to it. The second signal processing device 1400 then performs second signal processing on the third video stream of the second protocol and transmits the resulting third video stream of the third protocol to the camera serial interface 1120 of the main control device 1100. The path traversed by the third video stream can be from B5 to B8.

[0084] In one embodiment of this application, the main control device 1100 is configured to control the second video stream switch 1320 and the third video stream switch 1330 to be disconnected when the first video stream switch 1300 is turned on; and to control the second video stream switch 1320 and the third video stream switch 1330 to be turned on when the first video stream switch 1300 is turned off.

[0085] When the main control device 1100 controls the switching channel between the input terminal and the second output terminal of the first dual-channel switch 1340 and the switching channel between the first input terminal and the output terminal of the second dual-channel switch 1350 to be turned on, the main control device 1100 can control the switching channel between the input terminal and the first output terminal of the first dual-channel switch 1340 and the switching channel between the second input terminal and the output terminal of the second dual-channel switch 1350 to be turned off, thereby allowing the first video stream of the second protocol obtained by the first signal processing device 1200 from the first video stream of the first protocol to be transmitted to the second signal processing device 1400.

[0086] Based on this, the second signal processing device 1400 can convert the first video stream of the second protocol into the first video stream of the third protocol and transmit it back to the main control device 1100. Simultaneously, because the switching channel between the input and first output of the first dual-channel switch 1340 is open, the first signal processing device 1200 cannot transmit the converted first video stream of the second protocol to the video stream output terminal 1500 connected to the display 2100, and therefore cannot display it on the display. It should also be noted that during this process, because the switching channel between the second input and output of the second dual-channel switch 1350 is open, the camera 2200 connected to the video stream input terminal 1600 cannot transmit the acquired third video stream to the second signal processing device 1400.

[0087] When the main control device 1100 controls the switching channel between the input terminal and the second output terminal of the first dual-channel switch 1340, and the switching channel between the first input terminal and the output terminal of the second dual-channel switch 1350 to be disconnected, the main control device 1100 can control the switching channel between the input terminal and the first output terminal of the first dual-channel switch 1340, and the switching channel between the second input terminal and the output terminal of the second dual-channel switch 1350 to be connected. This allows the first signal processing device 1200 to perform first signal processing on the second video stream of the first protocol output by the main control device 1100 to obtain the second video stream of the second protocol, which is then transmitted to the video stream output terminal 1500 connected to the display. Figure 3 As shown, the paths that the second video stream passes through here are B1, B2 and B3 in sequence.

[0088] Simultaneously, the camera can transmit the acquired third video stream of the second protocol to the second signal processing device 1400 via its connected video input terminal 1600. The second signal processing device 1400 converts the third video stream of the second protocol into a third video stream of the third protocol, and then transmits it to the main control device 1100. For example... Figure 3 As shown, the path that the third video stream passes through here can be B5, B6 and B7 in sequence.

[0089] <Method>

[0090] This embodiment discloses a video stream diagnostic method, and the main control device 1100 in the video stream diagnostic system 1000 of the aforementioned embodiment is the main control device 1100 implementing the video stream diagnostic method.

[0091] Figure 4 This is a flowchart of a video stream diagnostic method according to an embodiment of the present disclosure.

[0092] In one embodiment of this application, the video stream diagnostic system may include a main control device 1100, a first signal processing device 1200, a second signal processing device 1400, and a first video stream switch 1300 connected between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400; the main control device 1100 has a camera serial interface 1120 and a display serial interface 1110, the display serial interface 1110 is connected to the input terminal of the first signal processing device 1200, and the camera serial interface 1120 is connected to the output terminal of the second signal processing device 1400.

[0093] like Figure 4As shown, the video stream diagnostic method may include the following steps S2100 to S2300:

[0094] In step S2100, the main control device outputs the first video stream of the first protocol to the first signal processing device 1200, so that the first signal processing device 1200 performs first signal processing on the first video stream of the first protocol to obtain the first video stream of the second protocol.

[0095] In the embodiments of this application, such as Figure 1 As shown, the main control device 1100 can output a first video stream of the first protocol through the display serial interface 1110. The first video stream of the first protocol can be a video stream using the MIPI-DSI protocol specification. In this embodiment, as... Figure 2 As shown, the first signal processing device 1200 can be a DSI Serializer, which is a signal processing device that converts the video stream from the MIPI-DSI protocol to the GMSL (Gigabit Multimedia Serial Link) protocol. Based on this, the first signal processing device 1200 can perform first signal processing on the first video stream of the first protocol output by the main control device 1100 to obtain a first video stream of the second protocol. In other words, the first video stream of the second protocol obtained here can be a video stream using the GMSL protocol specification.

[0096] In step S2200, the main control device controls the switching state of the switch module 1300, so that the switching channel between the output terminal of the first signal processing device and the input terminal of the second signal processing device is connected, and the first video stream of the second protocol is transmitted to the second signal processing module for second signal processing to obtain the first video stream of the third protocol.

[0097] In the embodiments of this application, when the main control device 1100 detects a diagnostic event, the main control device 1100 can control the switching state of the switch module 1300, thereby connecting the switching channel between the output terminal of the first signal processing device 1200 and the input terminal of the second signal processing device 1400. In this case, the first video stream of the second protocol processed by the first signal processing device 1200 can be transmitted to the second signal processing device 1400. The second signal processing device 1400 can perform second signal processing on the first video stream of the second protocol to obtain a first video stream of the third protocol, and then transmit the first video stream of the third protocol to the main control device.

[0098] Specifically, the second signal processing device 1400 can be a CSI-2 Deserializer, which is a signal processing device that converts the video stream from the GMSL protocol to the MIPI-CSI protocol. Based on this, the second signal processing device 1400 can perform second signal processing on the first video stream of the second protocol obtained by the first signal processing device 1200 to obtain the first video stream of the third protocol. In other words, the first video stream of the third protocol obtained here can be a video stream using the MIPI-CSI protocol specification. This is understandable to those skilled in the art and will not be elaborated further. After the second signal processing device 1400 obtains the first video stream of the third protocol, it can also transmit it to the camera serial interface 1120 on the main control device 1100.

[0099] In step S2300, the main control device receives the first video stream of the third protocol output by the second signal processing device, and diagnoses the transmission quality of the first video stream based on the output first video stream of the first protocol and the input first video stream of the third protocol.

[0100] In this embodiment, the main control device 1100 can compare the output video stream of the first protocol and the received video stream of the third protocol to diagnose the transmission quality of the video stream. Specifically, the main control device 1100 can first output the video stream of the first protocol from its display serial interface 1110. After the first information processing device converts the video stream of the first protocol into a video stream of the second protocol, it can transmit it to the second information processing device. The second information processing device can convert the video stream of the second protocol into a video stream of the third protocol and transmit it back to the main control device 1100 through the camera serial interface 1120.

[0101] Based on this, the main control device 1100 can compare the original output video stream of the first protocol with the final input video stream of the third protocol frame by frame to calculate the transmission loss of the first video stream. After determining the transmission loss of the first video stream, the main control device 1100 can compensate for the transmission loss of the second video stream output under subsequent non-diagnostic events.

[0102] According to embodiments of this disclosure, the main control device outputs a first video stream of a first protocol to a first signal processing device 1200, causing the first signal processing device 1200 to perform first signal processing on the first video stream of the first protocol to obtain a video stream of a second protocol; it controls the switching state of the switch module 1300 so that the first video stream of the second protocol is transmitted to the second signal processing module for second signal processing to obtain a first video stream of a third protocol; and then, based on the output first video stream of the first protocol and the input first video stream of the third protocol, the transmission quality of the first video stream is diagnosed. In this way, the transmission quality of the first video stream can be diagnosed, which is not only simple, fast, and accurate, but also allows for optimization and compensation of the subsequently output second video stream based on the diagnostic results of the video stream, avoiding signal distortion problems in the video stream displayed on the monitor.

[0103] <Vehicles>

[0104] This embodiment also provides a vehicle 3000. The vehicle 3000 may include the video stream diagnostic system 1000 as described in the foregoing embodiment.

[0105] Furthermore, such as Figure 5 and Figure 6 As shown, the vehicle 3000 may also include a display 3100 and a camera 3200. The display 3100 may be connected to the video stream output terminal 1500 of the video stream diagnostic system 1000, and the camera 3200 may be connected to the video stream input terminal 1600 of the video stream diagnostic system 1000.

[0106] This invention can be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the invention.

[0107] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, battery storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electrical waves, electrical waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0108] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0109] The computer program instructions used to perform the operations of this invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of the invention.

[0110] Various aspects of the present invention are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0111] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0112] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0113] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.

[0114] The various embodiments of the present invention have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims

1. A video stream diagnostic system, characterized by, The video stream diagnosis system comprises a master control device, a first signal processing device, a second signal processing device and a switch module; the master control device is provided with a camera serial interface and a display serial interface; the display serial interface is connected with an input end of the first signal processing device; the camera serial interface is connected with an output end of the second signal processing device; the master control device is configured to output a first video stream of a first protocol through the display serial interface, and control a switch state of the switch module, so that a switch channel between an output end of the first signal processing device and an input end of the second signal processing device is turned on; the first signal processing device is configured to perform first signal processing on the first video stream of the first protocol, to obtain a first video stream of a second protocol; the second signal processing device is configured to perform second signal processing on the first video stream of the second protocol, to obtain a first video stream of a third protocol, and transmit the first video stream of the third protocol to the camera serial interface of the master control device; the master control device is further configured to diagnose a transmission quality of the first video stream according to the first video stream of the first protocol and the first video stream of the third protocol.

2. The video stream diagnostic system of claim 1, wherein, the master control device is configured to detect whether a diagnosis event of the video stream occurs; in a case where it is detected that the diagnosis event occurs, the master control device is configured to control the switch state of the switch module, so that the switch channel between the output end of the first signal processing device and the input end of the second signal processing device is turned on; in a case where it is detected that the diagnosis event does not occur, the master control device is configured to control the switch state of the switch module, so that the switch channel between the output end of the first signal processing device and the input end of the second signal processing device is turned off.

3. The video stream diagnostic system of claim 1, wherein, The video stream diagnosis system further comprises a video stream output end for connecting with a display and a video stream input end for connecting with a camera; the switch module comprises a first video stream switch, a second video stream switch and a third video stream switch; the first video stream switch is connected between the output end of the first signal processing device and the input end of the second signal processing device; the second video stream switch is connected between the output end of the first signal processing device and the video stream output end; and the third video stream switch is connected between the input end of the second signal processing device and the video stream input end.

4. The video stream diagnostic system of claim 1, wherein, The video stream diagnosis system further comprises a video stream output end for connecting with a display and a video stream input end for connecting with a camera; the switch module comprises a first double-channel switch and a second double-channel switch; an input end of the first double-channel switch is connected with the output end of the first signal processing device; a first output end of the first double-channel switch is connected with the video stream output end; a second output end of the first double-channel switch is connected with a first input end of the second double-channel switch; a second input end of the second double-channel switch is connected with the video stream input end; and an output end of the second double-channel switch is connected with the input end of the second signal processing device.

5. The video stream diagnostic system of claim 3 or 4, wherein, The master control device is configured to control the switch channel between the output end of the first signal processing device and the input end of the second signal processing device to be conductive, and control the switch channel between the output end of the first signal processing device and the video stream output end and the switch channel between the input end of the second signal processing device and the video stream input end to be non-conductive; control the switch channel between the output end of the first signal processing device and the input end of the second signal processing device to be non-conductive, and control the switch channel between the output end of the first signal processing device and the video stream output end and the switch channel between the input end of the second signal processing device and the video stream input end to be conductive.

6. The video stream diagnostic system of claim 5, wherein, The master control device is further configured to output a second video stream of the first protocol through the display serial interface when the switch channel between the output end of the first signal processing device and the video stream output end is conductive. The first signal processing device is configured to perform first signal processing on the second video stream of the first protocol to obtain a second video stream of the second protocol, and output the second video stream of the second protocol to the display through the video stream output end for display.

7. The video stream diagnostic system of claim 6, wherein, The master control device is further configured to determine a transmission loss of the first video stream according to the first video stream of the first protocol and the first video stream of the third protocol, and compensate the second video stream of the first protocol according to the transmission loss.

8. The video stream diagnostic system of claim 5, wherein, The second signal processing device is configured to perform second signal processing on a third video stream of the second protocol collected by the camera and input through the video stream input end to obtain a third video stream of the third protocol when the switch channel between the input end of the second signal processing device and the video stream input end is conductive, and transmit the third video stream of the third protocol to the master control device through the camera serial interface.

9. A video stream diagnostic method characterized by, The method is applied to a master control device having a camera serial interface and a display serial interface, and the method comprises: The master control device outputs a first video stream of a first protocol to a first signal processing device through the display serial interface, so that the first signal processing device performs first signal processing on the first video stream of the first protocol to obtain a first video stream of a second protocol; The master control device controls the switch state of the switch module, so that the switch channel between the output end of the first signal processing device and the input end of a second signal processing device is conductive, and the first video stream of the second protocol is transmitted to the second signal processing device for second signal processing to obtain a first video stream of a third protocol; The master control device receives the first video stream of the third protocol output by the second signal processing device through the camera serial interface, and diagnoses the transmission quality of the first video stream according to the output first video stream of the first protocol and the input first video stream of the third protocol.

10. A vehicle characterized by comprising: The video stream diagnosis system according to any one of claims 1 to 8.

Images