Injection system

Abstract

The utility model provides an injection system. The injection system comprises data processing equipment, at least one video injection device and a first transmission medium, and is characterized in that the injection system further comprises at least one deserializing injection device and a second transmission medium different from the first transmission medium; the video injection device can obtain video data to be injected from the data processing equipment, and is separably connected with the deserializing injection device through a first transmission medium, so that a first data stream of the video data to be injected is sent to the deserializing injection device when the deserializing injection device is connected; the deserializing injection device is separably connected with the injection object through a second transmission medium so as to inject a second data stream obtained by deserializing the first data stream into the injection object when the injection object is connected.

Description

Technical Field

[0001] This application relates to the technical field of electronic device simulation testing, and specifically relates to an injection system. Background Art

[0002] During the development process of an electronic device, it is often necessary to inject data into the electronic device (i.e., the injection object in the corresponding injection system) to verify or train its functions.

[0003] In the related art, the injection object can include at least one of a domain controller, a sensor, etc. For example, it can be a domain controller during the development process. Generally speaking, after receiving the video signal transmitted by the video injection device through GMSL, the injection object will deserialize and convert it into a MIPI signal for subsequent processing. Among them, the transmission distance of GMSL is relatively long.

[0004] However, for some injection objects, they can only receive MIPI signals, and the video injection devices in the prior art can only be connected to cables for transmitting serial signals, and the two do not match.

[0005] In order to solve the problem of mismatch between the two, the conventional idea is to change the structure of the video injection device and design it to output MIPI signals. However, the transmission distance of MIPI signals is extremely short. If the video injection device outputs MIPI signals, the video injection device and the injection object need to be at a very close distance, making the spatial layout in the injection system inconvenient and prone to the occurrence of cable interference phenomena. Utility Model Content

[0006] An embodiment of this application provides an injection system, aiming to solve the problem of signal mismatch in transceiver between the injection object and the video injection device.

[0007] An embodiment of this application provides an injection system, including a data processing device, at least one video injection device, a first transmission medium. The injection system further includes at least one deserialization injection device and a second transmission medium different from the first transmission medium;

[0008] The video injection device can obtain the video data to be injected from the data processing device and is detachably connected to the deserialization injection device through the first transmission medium to send the first data stream of the video data to be injected to the deserialization injection device when connected to the deserialization injection device;

[0009] The deserialization injection device is detachably connected to the injection object through the second transmission medium to inject the second data stream after deserializing the first data stream into the injection object when connected to the injection object.

[0010] Advantageous Effects of the Embodiment of this Application:

[0011] In the embodiments of the present application, at least one deserialization injection device and a second transmission medium different from the first transmission medium are introduced into the injection system. Specifically, the video injection device can be detachably connected to the deserialization injection device through the first transmission medium, so as to send the first data stream of the video data to be injected to the deserialization injection device when connecting to the deserialization injection device, and the deserialization injection device can be detachably connected to the injection object through the second transmission medium, so as to inject the second data stream after deserializing the first data stream into the injection object when connecting to the injection object. It can be seen that through the deserialization injection of the deserialization injection device, even if the output signal of the video injection device does not match the input signal of the injection object, the injection can still be completed. At the same time, according to common knowledge, the effective transmission distance of the signal that has not been deserialized is often greater than that of the deserialized signal. In the present application, since the signal received by the deserialization injection device is the one that has not been deserialized and is transmitted through the first transmission medium, it often has a longer effective transmission distance. Furthermore, compared with the conventional method of the video injection device transmitting the deserialized signal through the second transmission medium to meet the requirements of the injection object, the present application can facilitate increasing the transmission distance between the video injection device and the injection object. On the premise of ensuring that the video data to be injected can be normally transmitted between the video injection device and the injection object, it can also effectively ensure that the relative positions and distances between the video injection device and the injection object are more flexible. For example, it is not necessary to be limited within the effective transmission distance of the second transmission medium, thereby reducing the limitation of the spatial layout in the injection system and improving the convenience of its spatial layout. At the same time, it also prevents the occurrence of various wiring interference phenomena. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those skilled in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0013] Figure 1 It is a schematic structural diagram of an embodiment of an injection system provided by an embodiment of the present application;

[0014] Figure 2 It is a schematic structural diagram of another embodiment of an injection system provided by an embodiment of the present application;

[0015] Figure 3 It is a schematic structural diagram of another embodiment of an injection system provided by an embodiment of the present application

[0016] Figure 4 It is a schematic structural diagram of an architecture of a deserialization injection device provided by an embodiment of the present application

[0017] Figure 5 It is a schematic structural diagram of another embodiment of the injection system provided by the embodiments of the present application;

[0018] Figure 6 It is a schematic structural diagram of an embodiment of the open-loop injection system provided by the embodiments of the present application;

[0019] Figure 7 It is a schematic structural diagram of an embodiment of the closed-loop injection system provided by the embodiments of the present application;

[0020] Figure 8 It is a schematic structural diagram of another embodiment of the closed-loop injection system provided by the embodiments of the present application;

[0021] Figure 9 It is a schematic structural diagram of another embodiment of the closed-loop injection system provided by the embodiments of the present application.

[0022] Reference numerals:

[0023] Injection system 10, data processing device 100, bus interaction device 200, video injection device 300, injection object 400, deserialization injection device 500, first transmission medium 600, second transmission medium 700, third transmission medium 800;

[0024] Realtime machine 101, video simulation server 102;

[0025] Video transmission module 301, serialization addition module 302, conversion module 303;

[0026] Data source 401;

[0027] Deserialization module 501, interface module 502, control module 503, communication interface module 504, trigger signal feedback module 505, Ethernet module 506, power supply module 507. Detailed implementation manners

[0028] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative efforts belong to the scope of protection of the present application. In addition, it should be understood that the specific implementation manners described herein are only used to illustrate and explain the present application, and are not used to limit the present application. In the present application, unless otherwise stated, the orientation words such as "upper" and "lower" generally refer to the upper and lower in the actual use or working state of the device, specifically the drawing direction in the accompanying drawings; and "inner" and "outer" refer to the outline of the device.

[0029] In the related art, the injection object (for example, if the injection is used for testing and verifying the injection object, the injection object can also be understood as the device under test) can include at least one of a domain controller, a sensor, etc. Generally speaking, taking the device under test as an example of the injection object, then: after receiving the signal transmitted through GMSL, the device under test will deserialize and convert it into a MIPI signal (or other video signals that can be serialized into GMSL signals, such as DVP signals, LVDS signals, etc.) for subsequent processing. Among them, the effective transmission distance of GMSL is relatively long. However, for some devices under test, they can only receive MIPI signals (or other un-serialized video signals), and the effective transmission distance of MIPI signals (or other un-serialized video signals) is extremely short. If the video injection device outputs MIPI signals (or other un-serialized video signals), then the video injection device and the device under test need to be in a very close distance, making the spatial layout in the injection system inconvenient and prone to various phenomena such as cable interference. Therefore, the embodiments of the present application provide an injection system, by introducing at least one deserializer injection device and a second transmission medium different from the first transmission medium in the injection system. Specifically, the video injection device can be detachably connected to the deserializer injection device through the first transmission medium, so as to send the first data stream of the video data to be injected to the deserializer injection device when connecting the deserializer injection device, and the deserializer injection device can be detachably connected to the injection object through the second transmission medium, so as to inject the second data stream after deserializing the first data stream into the injection object when connecting the injection object. It can be seen that through the deserialization and injection of the deserializer injection device, even if the signals output by the video injection device and the signals input by the injection object do not match, the injection can still be completed. At the same time, according to common knowledge, the effective transmission distance of the un-deserialized signal is often greater than that of the deserialized signal. In the present application, since the signal received by the deserializer injection device is un-deserialized and transmitted through the first transmission medium, it usually has a relatively long effective transmission distance. Therefore, compared with the conventional method of the video injection device transmitting the deserialized signal through the second transmission medium to meet the requirements of the injection object, the present application can facilitate increasing the transmission distance between the video injection device and the injection object, so as to ensure that the video data to be injected can be normally transmitted between the video injection device and the injection object, and at the same time, it can effectively ensure that the relative position and distance between the video injection device and the injection object are more flexible. For example, it does not need to be limited within the effective transmission distance of the second transmission medium, thereby reducing the limitation of the spatial layout in the injection system, improving the convenience of its spatial layout, and at the same time preventing various phenomena of cable interference. For the specific solution, please refer to the following specific description.

[0030] As Figures 1-9 shown, among which Figure 1It is a schematic structural diagram of an injection system provided by an embodiment of the present application. The injection system 10 includes a data processing device 100, at least one video injection device 300, and a first transmission medium 600. In addition, the injection system further includes at least one deserialization injection device 500 and a second transmission medium 700 different from the first transmission medium 600. The video injection device 300 can obtain video data to be injected from the data processing device 100 and is separably connected to the deserialization injection device 500 through the first transmission medium 600, so as to send a first data stream of the video data to be injected to the deserialization injection device 500 when connecting to the deserialization injection device 500. The deserialization injection device 500 is separably connected to the injection object 400 through the second transmission medium 700, so as to inject a second data stream after deserializing the first data stream into the injection object 400 when connecting to the injection object 400.

[0031] The first transmission medium 600 and the second transmission medium 700 are two different transmission media. The transmission distance of the first transmission medium 600 can be much greater than that of the second transmission medium 700, while the second transmission medium 700 has a higher matching degree with the injection object 400. It can also be understood that all injection objects 400 used in the present application can communicate normally through the second transmission medium 700, while some or all of the injection objects 400 cannot communicate normally with the first transmission medium 600.

[0032] Specifically, the differences between the first transmission medium 600 and the second transmission medium 700 can be reflected at least in that: the first transmission medium 600 is a transmission medium for transmitting signals that have been serialized (or not deserialized), and the data stream transmitted through the first transmission medium 600 is the first data stream; the second transmission medium 700 is a transmission medium for transmitting video signals that have not been serialized (or have been deserialized), and the data stream transmitted through the second transmission medium 700 is the second data stream. However, it is not limited to this. The differences between the first transmission medium 600 and the second transmission medium 700 can also be understood as: the first transmission medium 600 is selected to be adapted to the data stream output interface of the video injection device 300, and the second transmission medium 700 is selected to be adapted to the data stream receiving interface of the injection object 400. Furthermore, because the data stream output interface of the video injection device 300 does not match the data stream receiving interface of the injection object 400, this mismatch constitutes the source of the difference between the first transmission medium 600 and the second transmission medium 700.

[0033] In a specific example, the first transmission medium 600 may be a cable for transmitting serial signals. The corresponding first data stream may be a GMSL signal, which is a serial signal, but it may also be other serial signals, such as RS485 signals, RS232 signals, etc. The second transmission medium 700 may be an MIPI FPC, and the second data stream may be an MIPI signal. In other examples, the second data stream may also be a DVP signal, an LVDS signal, etc.

[0034] In the embodiments of the present application, by introducing at least one deserialization injection device 500 and a second transmission medium 700 different from the first transmission medium 600 into the injection system 10. Specifically, the video injection device 300 can be separably connected to the deserialization injection device 500 through the first transmission medium 600, so as to send the first data stream of the video data to be injected to the deserialization injection device 500 when connecting to the deserialization injection device 500. And the deserialization injection device 500 can be separably connected to the injection object 400 through the second transmission medium 700, so as to inject the second data stream after deserializing the first data stream into the injection object 400 when connecting to the injection object 400. It can be seen that through the deserialization injection of the deserialization injection device 500, even if there is a mismatch between the output signal of the video injection device 300 and the input signal of the injection object 400, the injection can still be completed. At the same time, according to common knowledge, the effective transmission distance of the signal that has not been deserialized is often greater than that of the deserialized signal. In the present application, since the signal received by the deserialization injection device 500 is the non-deserialized signal transmitted through the first transmission medium 600, it usually has a relatively long effective transmission distance. Furthermore, compared with the conventional method of the video injection device 300 transmitting the deserialized signal through the second transmission medium 700 to meet the requirements of the injection object 400, the present application can facilitate increasing the transmission distance between the video injection device 300 and the injection object 400. On the premise of ensuring that the video data to be injected can be normally transmitted between the video injection device 300 and the injection object 400, it can also effectively ensure that the relative positions and distances between the video injection device 300 and the injection object 400 are more flexible. For example, it is not necessary to be limited within the effective transmission distance of the second transmission medium 700, thereby reducing the restriction of the spatial layout in the injection system 10 and improving the convenience of its spatial layout. At the same time, it also prevents the occurrence of various cable interference phenomena.

[0035] The data processing device 100 therein can be any device with data processing capabilities or a set of devices. Specifically, the data processing device 100 may include one or more computers.

[0036] The video injection device 300 can be any device that can realize the circuit or collection of circuits of video data injection (injection can also be understood as back injection, back injection, etc.). Specifically, the video injection device 300 can include a video board, and the number of channels for injecting data in each video board can be one or more. The video board can be a single board or a combination of multiple boards. In addition, the video injection device 300 can also perform any preset processing and / or injection processing on the acquired video data to be injected. The preset processing is at least one of the conversion of data format, adjustment of frame rate, resolution, etc., fault simulation, modification of images in the video, etc. The injection processing can be, for example, based on the timestamp of the image data in the video data to be injected, and can also be, for example, based on the trigger signal acquired by the video injection device 300, the corresponding image data in the video data to be injected can be injected. For example, the image data of the acquired video data to be injected can also be directly injected one by one. In addition, for the video injection device 300, the result of the injection processing is: the corresponding image data is output to the deserialization injection device 500, so that the image data to be injected into the injection object 400 is finally injected through the deserialization injection device 500. Although the video data before and after the preset processing may be different, they can all be understood as the video data to be injected.

[0037] In one embodiment, if Figure 2 As shown, the video injection device 300 includes a video transmission module 301 and a string adding module 302; wherein the video transmission module 301 can obtain video data from the data processing device 100; the video transmission module 301 is connected to the string adding module 302 to send the third data stream of the video data to be injected to the string adding module 302; the string adding module 302 is detachably connected to the deserialization injection device 500 through the first transmission medium 600, and the string adding module 302 can perform string adding processing on the third data stream to obtain the first data stream, and transmit the first data stream to the deserialization injection device 500 when connected to the deserialization injection device 500. The video transmission module 301 can perform any preset processing and / or injection processing on the video data to be injected during the transmission of the video data to be injected, wherein the contents of the preset processing and injection processing can be understood by referring to the relevant description of this specification.

[0038] In one embodiment, the video injection device 300 has a PCIe connection part, so that the video injection device 300 can be plugged into the data processing device 100 through the PCIe connection part. Furthermore, the video injection device 300 can obtain the video data to be injected through the PCIe connection part. Of course, in some embodiments, the video injection device 300 can also exchange other information with the data processing device 100 through the PCIe connection part.

[0039] Optionally, as Figure 3 shown, the video injection device 300 may include a conversion module 303, wherein the video transmission module 301 is disposed between the conversion module 303 and the string adding module 302; the conversion module 303 obtains a fourth data stream in a first format of the video data to be injected from the data processing device 100 through a third transmission medium 800, converts the fourth data stream in the first format into the third data stream in a second format, and sends the third data stream to the string adding module 302. Specifically, the video transmission module 301 may include a video transmission main board, the string adding module 302 may include a string adding small board, and the conversion module 303 may include an HDMI to MIPI small board.

[0040] The video transmission main board may directly or indirectly obtain video data from the data processing device 100 through a PCIe connection part, or may obtain the video data to be injected through the HDMI to MIPI small board. Either of the two ways to obtain the video data to be injected can be selected for use. Of course, it is not excluded that both ways are used simultaneously to obtain different paths of video data to be injected. After obtaining the video data to be injected, the video transmission main board may perform preset processing and / or injection processing on the video data to be injected. For the content related to the preset processing and injection processing, reference may be made to the relevant descriptions in this specification for understanding.

[0041] Furthermore, the video transmission main board and the HDMI to MIPI small board may be detachably connected. Furthermore, if the method of obtaining the video data to be injected through the PCIe connection part is adopted, the HDMI to small board may not be installed and connected to the video transmission main board. In other examples, if only one way is considered, then: in one example, the video transmission module 301 may not be provided with a PCIe connection part, and the video transmission module 301 and the conversion module 303 are disposed on the same circuit board. In another example, the video transmission module 301 may be provided with a PCIe connection part but does not have a conversion module 303.

[0042] It can be seen that whether the acquisition of the video data to be injected is implemented based on the PCIe method or the conversion module 303 (such as the HDMI-to-MIPI small board) is used to acquire the video data to be injected, after using the deserialization injection device 500, it can be applied to inject the injection object 400 that accesses the MIPI signal; conversely, if the deserialization injection device 500 is not used, the structure of the video injection device 300 can only be designed to output the MIPI signal. The transmission distance of the MIPI signal is extremely short. At the same time, if the PCIe connection part is used to acquire the video data to be injected, then: the video transmission main board can usually be directly plugged into the PCIe slot of the data processing device 100, that is, it needs to be connected inside the data processing device. At this time, there is simply not enough space between the injection object 400 (such as the ECU) and the data processing device 100 to complete the connection required for the injection. Furthermore, if the deserialization injection device 500 is not used, the acquisition method of the video data to be injected is limited to only using the conversion module 303, which greatly limits the applicable scenarios of the injection system 10.

[0043] In addition, the video transmission main board and the serial addition small board can be detachably connected. Furthermore, it is convenient for the video transmission main board to be applied in other scenarios. In one example, in some injection application scenarios, the video transmission main board can also directly inject the video signal into the injection object 400 by outputting the MIPI signal. In another example, in some scenarios that require data acquisition, the video transmission main board can receive the video data and then report the video data to the host computer through the PCIe connection part. At this time, the video transmission main board does not need to output the video data in the form of outputting the video signal and adding a serial, that is, it does not need to use the serial addition small board or the serial addition module 302. At this time, the serial addition small board can be removed and the video transmission main board can be used. It can be seen that the video transmission main board is no longer used in the injection system 10 at this time. Therefore, the common use of the video transmission main board and the serial addition small board and their detachable connection design are to meet the application requirements of the video transmission main board to be compatible in other scenarios.

[0044] The third transmission medium 800 therein is selected to be adapted to the data stream output interface of the data processing device 100 (such as a computer). Generally speaking, the third transmission medium 800 can be another transmission medium different from the first transmission medium 600 and the second transmission medium 700, that is: the third transmission medium 800 is different from the first transmission medium 600 and also different from the second transmission medium 700, but the possibility of being the same is not excluded; furthermore, the fourth data stream in the first format is a video signal suitable for being transmitted through the third transmission medium 800, such as an HDMI signal, a DVP signal, etc., and the third data stream in the second format is a video signal suitable for being transmitted and processed within the video transmission module 301, usually a video signal that has not been added with a serial (or can be understood as having been deserialized), such as an MIPI signal.

[0045] In one example, the first transmission medium 600 can be a cable for transmitting serial signals, the second transmission medium 700 can be an MIPI FPC, and the third transmission medium 800 can be an HDMI cable. The fourth data stream in the corresponding first format is the HDMI signal.

[0046] The video injection device 300 is separably connected to the deserialization injection device 500 through the first transmission medium 600, which includes three cases. The first case is that the video injection device 300 is separably connected to the first transmission medium 600, and the first transmission medium 600 is inseparably connected to the deserialization injection device 500, such as by welding. The second case is that the first transmission medium 600 is separably connected to the deserialization injection device 500, and the first transmission medium 600 is inseparably connected to the video injection device 300, such as by welding. The third case is that the first transmission medium 600 is separably connected to the deserialization injection device 500, and the first transmission medium 600 is also separably connected to the video injection device 300.

[0047] The deserialization injection device 500 is separably connected to the injection object 400 through the second transmission medium 700, which also includes three cases. The first case is that the deserialization injection device 500 is separably connected to the second transmission medium 700, and the second transmission medium 700 is inseparably connected to the injection object 400, such as by welding. The second case is that the second transmission medium 700 is separably connected to the injection object 400, and the second transmission medium 700 is inseparably connected to the deserialization injection device 500, such as by welding. The third case is that the second transmission medium 700 is separably connected to the deserialization injection device 500, and the second transmission medium 700 is also separably connected to the deserialization injection device 500.

[0048] In addition, the "separably connected" in these two places can refer to plugging, for example, and the inseparable connection can refer to welding, for example.

[0049] In a specific embodiment, the deserialization injection device 500 can include a GMSL-to-MIPI board. The GMSL-to-MIPI board can include two circuit boards. A deserialization module 501 is provided on one of the circuit boards A, and an interface module 502 is provided on the other circuit board B. Among them, the deserialization module 501 can be a deserializer, and the interface module 502 can be an MIPI interface. The two circuit boards are detachably assembled together. The remaining circuit parts can be provided on the circuit board A, and it does not rule out the scheme of being partially or entirely provided on the circuit board B. By separately providing the circuit boards A and B, it is convenient to flexibly combine circuit boards with different configurations to meet diverse requirements.

[0050] Of course, the GMSL-to-MIPI board can also be implemented by one circuit board.

[0051] In one embodiment, as Figure 2Or the deserialization injection device 500 shown in 3 may include a deserialization module 501 and an interface module 502, and the deserialization module 501 is connected to the interface module 502; wherein the deserialization module 501 can obtain the first data stream from the video injection device 300 through the first transmission medium 600, and deserialize the first data stream to obtain the processed second data stream, and send the second data stream to the interface module 502; the interface module 502 injects the second data stream into the injection object 400 through the second transmission medium 700.

[0052] Specifically, the deserialization module 501 may include a deserializer, and the interface module 502 may include a MIPI interface, wherein the MIPI interface may be a MIPI FPC interface, and then the GMSL to MIPI board card may be connected to the injection object 400 through the MIPI FPC cable, and the deserializer may have a GMSL fakra interface, or be connected to a fakra interface, and the deserializer may have a MIPI FPC interface, or be connected to a MIPI FPC interface. It should be noted that the interfaces used by the above-mentioned devices can be set according to actual needs.

[0053] In one embodiment, if Figure 4 As shown, the deserialization injection device 500 also includes a control module 503 and a communication interface module 504; wherein the communication interface module 504 is respectively connected to the deserialization module 501, the control module 503 and the interface module 502, and then, the communication interface module 504 can obtain configuration instructions from the control module 503, and configure the deserialization module 501 based on the configuration instructions. For example, the communication interface module 504 can implement the configuration by feeding back the configuration instructions to the deserialization module 501, and the corresponding control module 503 is configured to send the configuration instructions for configuring the deserialization module 501 to the communication interface module 504.

[0054] Specifically, the control module 503 may be a microcontroller unit (MCU), and the communication interface module 504 may be an I2C module.

[0055] Among them, the I2C module (I2C can also be expressed as IIC, I2C) has the following main functions:

[0056] The I2C module (ie, the communication interface module 504) can also realize direct communication of I2C communication signals between the video injection device 300 and the injection object 400, that is, after connecting to the GMSL to MIPI board, the I2C communication signals between the video injection board and the injection object 400 are transmitted through the I2C module.

[0057] The MCU can configure the deserialiser via the I2C module; for example, it can configure the GMSL protocol parameters of the deserialiser, such as the data mode, clock mode, etc., that is, the configuration instructions can be used to configure the GMSL protocol parameters.

[0058] Optionally, there may be one or more injection processes in the video injection device 300, including an injection process based on a trigger signal. This injection process can be understood as follows: the video injection device 300 performs an injection process of injecting image data in the video data to be injected based on the trigger signal obtained by the video injection device 300. For example, when the video injection device 300 receives a trigger signal, it injects one or more frames of image data externally. In the case of using the deserialisation injection device 500, for example: the video injection device 300 receives a trigger signal from the deserialisation injection device 500 and outputs one or more frames of image data to the deserialisation injection device 500, so as to inject the one or more frames of image data into the injection object 400 through the deserialisation injection device 500. To this end, the deserialisation injection device 500 can send a trigger signal to the video injection device 300 via the deserialiser and the first transmission medium 600.

[0059] As Figure 4 shown, the deserialisation injection device 500 further includes a trigger signal feedback module 505; wherein, the trigger signal feedback module 505 is connected to the deserialisation module 501 to feedback a trigger signal to the deserialisation module 501, so that the trigger signal is transmitted to the video injection device 300 via the deserialisation module 501.

[0060] In some embodiments, the trigger signal feedback module 505 may also be connected to the interface module 502 and the control module 503. The trigger signal feedback module can be configured to selectively obtain the trigger signal or an indication signal for triggering the trigger signal from the control module 503 or the injection object 400, and can transmit the trigger signal to the video injection device 300 via the deserialisation module 501.

[0061] The control module 503 may be configured to switch the state of the trigger signal feedback module 505; when the state of the trigger signal feedback module 505 is switched to the first state, the trigger signal feedback module 505 uses the control module 503 as the target object, that is, the trigger signal feedback module 505 receives a trigger signal or an indication signal from the control module 503, and in response thereto, feeds back the trigger signal to the deserialization module 501 so as to transmit the trigger signal to the video injection device 300 through the deserialization module 501; when the state of the trigger signal feedback module 505 is switched to the second state, the trigger signal feedback module 505 uses the injection object 400 as the target object, that is, the trigger signal feedback module 505 receives a trigger signal or an indication signal from the injection object 400, and in response thereto, feeds back the trigger signal to the deserialization module 501 so as to transmit the trigger signal to the video injection device 300 through the deserialization module 501.

[0062] Specifically, the trigger signal feedback module 505 may be a GPIO MUX module.

[0063] The MCU can switch the state of the GPIO MUX module. For example, it can be switched between the first state and the second state, thereby switching the source of the GPIO MUX module.

[0064] The corresponding functions of the GPIO MUX module: when the state of the GPIO MUX module is switched to the first state, it can receive a Trigger signal from the MCU, pass through the deserializer in the GMSL to MIPI board and be fed back to the video injection board;

[0065] When the state of the GPIO MUX module is switched to the second state, it can receive a Trigger signal from the injection object 400 through the MIPI interface, and then, pass through the deserializer in the GMSL to MIPI board and feed back the Trigger signal to the video injection board.

[0066] In other examples not shown, the trigger signal feedback module 505 may also only have the first state (in this case, the trigger signal feedback module 505 may not be connected to the interface module 502) or only have the second state (in this case, the trigger signal feedback module 505 may not be connected to the control module 503). Thus, there is no need to balance the two sources of trigger signals and no need to implement switching. The trigger signal feedback module 505 may also have a third state. Thus, the trigger signal feedback module 505 in the third state may obtain a trigger signal or an indication signal from other sources outside the control module 503 and the injection object 400. If the trigger signal feedback module 505 has more than one state capable of emitting a trigger signal, it may help to be compatible with various possibilities of the source of the trigger signal and ensure that the injection system 10 can be used in multiple test scenarios. In addition, the control module 503 may also be used to control whether the trigger signal feedback module 505 emits a trigger signal. For example, if injection based on the trigger signal is not required, the control module 503 may control the trigger signal feedback module 505 not to emit a trigger signal, or it can be understood as controlling it not to work.

[0067] It can be seen that in any case, the trigger signal feedback module 505 is connected to the deserialization module 501 to feedback a trigger signal to the deserialization module 501, so that the trigger signal is transmitted to the video injection device 300 through the deserialization module 501. The trigger signal is used to trigger the video injection device 300 to output one or more frame image data of the video data to be injected.

[0068] Optionally, as Figure 4 shown, the deserialization and injection device 500 further includes a control module 503 and an Ethernet module 506;

[0069] Among them, the Ethernet module 506 is connected to the control module 503. The Ethernet module 506 is configured to communicate with a preset external device, so as to achieve the required external communication. For example, it can obtain instruction data for configuring the control module 503 from the external device and send the instruction data to the control module 503. The control module 503 is configured to receive the instruction data sent by the Ethernet module 506 and complete the configuration based on the instruction data. For another example, it can obtain a trigger signal or an indication signal from the outside and feedback it to the control module 503. The control module 503 then feedbacks it to the trigger signal feedback module 505. For yet another example, it can obtain control information from the outside indicating whether at least one of the deserialization module 501, the interface module 502, and the trigger signal feedback module 505 is working and in what state and mode it is working, and feedback it to the control module 503 or the corresponding module, and the control information can be achieved through the control module 503 or directly controlling the corresponding module.

[0070] Among them, the external device may be a host computer.

[0071] Optionally, as Figure 4 shown, the deserialization injection device 500 further includes a power supply module 507, which is configured to supply power to the deserialization injection device 500, for example, connected to at least one of the control module 503, the deserialization module 501, the interface module 502, the Ethernet module 506, the communication interface module 504, and the trigger signal feedback module 505 of the deserialization injection device 500 to directly or indirectly supply power to it.

[0072] Specifically, the power supply module 507 can supply power to each module in the GMSL to MIPI board. The electrical energy of this power supply can come from the power interface. For example, a 12V power supply is obtained from the outside through the power interface and then directly or after conversion is supplied to the corresponding module. The electrical energy of this power supply can also come from the POE Ethernet power supply of the Eth module.

[0073] In addition, in the deserialization injection device 500, Figure 4 the number of the shown deserializers, interface module 502, communication interface module 504, and trigger signal feedback module 505 can be one or multiple to meet the requirements of multi-channel video injection. Multiple video injection devices 300 can be connected to the same deserialization injection device 500 and injected into the injection object 400 through the same deserialization injection device 500. At this time, through the unified wiring for one deserialization injection device 500, problems such as difficult cable routing and easy cable routing interference can be effectively eliminated. Of course, in some examples, some or all of the video injection devices 300 can also be connected to different deserialization injection devices 500. It can be seen that the number of deserialization injection devices 500 in the injection system 10 can be one or multiple. And if multiple video injection devices 300 are used, then the use of the deserialization injection device 500 can also avoid placing the video injection board cards concentratedly close to the injection object 400, avoiding problems such as difficult cable routing and easy cable routing interference caused thereby.

[0074] The injection object 400 can include at least one of the following: an electronic control unit (ECU), an electronic load, a sensor, etc.

[0075] In one embodiment, as Figure 5 shown, the injection system 10 further includes at least one bus interaction device 200; the bus interaction device 200 is disposed between the data processing device 100 and the injection object 400.

[0076] For at least some of the bus interaction devices 200, it can be configured to obtain first bus data from the data processing device 100 and inject the first bus data into the injection object 400.

[0077] Among them, the bus interaction device 200 can be any device that can implement bus data interaction, which can be a circuit or a set of circuits. Specifically, the bus interaction device 200 can be a bus board card. The channels for injecting data in each bus board card can be one or more types, and the number of each type of channel can be one or more. For example, the bus board card can have channels for CAN bus, LIN bus, and Flexray bus, or it can only have channels for CAN bus.

[0078] In addition, if protocols such as DSI3, PSI5, SENT, and MOST are also understood as bus protocols, then at least one of the channels for DSI3 bus, PSI5 bus, SENT bus, etc. can also be provided in the bus board card. For example, the bus board card can also include a DSI3 board card.

[0079] In a broad sense, Ethernet can also be understood as a kind of bus. Therefore, the bus board card can also include an Ethernet board card.

[0080] It should be noted that the above first bus data is the bus data that the data processing device 100 needs to give to the injection object 400, and the second bus data in the following text is the data that the injection object 400 needs to feedback to the data processing device 100. Usually, it is obtained by the injection object 400 based on part or all of the video data to be injected and the first bus data. At the same time, the transmission channels and / or interfaces of the first bus data and the second bus data in the bus interaction device 200 can be different, or the same or partially multiplexed.

[0081] In the embodiments of the present application, at least one bus interaction device 200 and at least one video injection device 300 are provided in the injection system 10. Specifically, the video injection device 300 is arranged between the data processing device 100 and the injection object 400, so as to obtain the video data to be injected from the data processing device 100 through the video injection device 300 and inject the video data to be injected into the injection object 400; and the bus interaction device 200 is arranged between the data processing device 100 and the injection object 400, so as to obtain the first bus data from the data processing device 100 through the bus interaction device 200 and inject the data stream of the first bus data into the injection object 400, so that the injection system 10 has the functions of injecting both bus data and video data.

[0082] It should be noted that the following is a further description of different architectures formed among the data processing device 100, the video injection device 300, the bus interaction device 200, and the injection object 400 on the basis of Figure 5 and so on.

[0083] In one embodiment of the present application, an open-loop injection system 10 is provided. At this time, the bus interaction device 200 is only configured to obtain the first bus data from the data processing device 100 and inject the data stream of the first bus data into the injection object 400.

[0084] For example, the specific structure of the open-loop injection system 10 is as Figure 6 shown. The data processing device 100 in the open-loop injection system 10 can only select an industrial control computer. It should be noted that for the open-loop injection system 10, the data processing device 100 stores a series of data, such as the video captured by the camera when the vehicle is driving normally and the data that has occurred on the bus. These data are synchronously injected into the injection object 400 in chronological order, and the injection object 400 will process them. When verifying the function of the injection object 400, some of the processing results need to be used as verification bases. For example, whether the injection device outputs a braking signal when the vehicle is very close to the vehicle in front.

[0085] The target data required by the above injection object 400, such as the video data to be injected and the first bus data, can come from the data stored in the disk of the data acquisition device (such as the ADstation device of Kunyi), that is: the actually collected data is re-injected into the injection object 400. Furthermore, the present application can provide a data source 401 to store these data.

[0086] The data source 401 has the following three situations:

[0087] 1. An external device serves as the data source 401 to store the corresponding data. The data processing device 100 (such as an industrial control computer) is connected to the external device through Ethernet (fiber optic Ethernet or electrical Ethernet); data can be retrieved in real time for re-injection, or data can be retrieved in advance and stored before re-injection;

[0088] 2. A storage device built into the data processing device 100 (such as an industrial control computer), such as a computer hard disk;

[0089] 3. A storage device external to the data processing device 100 (such as an industrial control computer), such as a mobile hard disk.

[0090] In some embodiments of the present application, a closed-loop injection system 10 is further provided. At this time, in addition to being able to obtain the first bus data from the data processing device 100 and inject the data stream of the first bus data into the injection object 400, the bus interaction device 200 can also be used to transmit the second bus data generated by the injection object 400 to the data processing device 100.

[0091] Optionally, in this closed-loop system, the video data to be injected includes simulated video data; the number of the data processing devices 100 is multiple, and the multiple data processing devices 100 include at least one real-time machine 101 and at least one video simulation server 102. The real-time machine 101 and the video simulation server 102 are configured to communicate with each other. The real-time machine 101 is directly or indirectly connected to the bus interaction device 200 to receive second bus data from the injection object 400 through the bus interaction device 200. The video simulation server 102 is connected to the video injection device 300 to feedback the simulated video data to the video injection device 300.

[0092] According to the foregoing description, the second bus data here is what the injection object 400 needs to feedback to the data processing device 100, and is usually obtained by the injection object 400 based on part or all of the video data to be injected and the first bus data.

[0093] Among them, the communication connection method between the real-time machine 101 and the video simulation server 102 includes but is not limited to network cable and optical fiber.

[0094] In a specific embodiment, the specific structure of the closed-loop injection system 10 is as Figure 7 shown. In the closed-loop injection system 10, the video simulation server 102 needs to simulate and render simulated video data, and then inject the simulated video data back into the injection object 400 through the video injection device 300 and the deserialization injection device 500. Furthermore, the video injection device 300 is arranged between the video simulation server 102 and the injection object 400. In addition, in order to simulate and render the video data to be injected, the video simulation server 102 can usually be separately configured with an independent GPU. A closed-loop test can be formed among the real-time machine 101, the video simulation server 102, the bus interaction device 200, the video injection device 300 and the injection object 400.

[0095] For the convenience of understanding, in a specific embodiment, the injection object 400 is set as an ECU, the bus interaction device 200 is set as a bus board, and the video injection device 300 is set as a video board. On this basis, the process of the closed-loop test is exemplarily described as follows:

[0096] The bus data fed back by the ECU is transmitted to the real-time machine 101 through the bus board. The required models can be configured in the real-time machine 101, and the models therein can perform preset processing on the content in the data packet of the bus data; the real-time machine 101 can also be implemented by using the RTPC in the traditional HIL system, and thus there is no need to specifically design the functions and software algorithms of the real-time machine 101;

[0097] Some or all of the data processed by some or all of the models can be fed back to the video simulation server 102. The video simulation server 102 can perform simulation rendering based on this to obtain simulation video data, and then inject the simulation video data back into the ECU through a video board;

[0098] For example, the data packet of the bus data can include control signals fed back by the ECU, such as control signals related to braking, acceleration, steering, etc. Some models can calculate the changes that occur to the vehicle based on the control signals (such as the speed change and pose change caused by braking), and then feed them back to the video simulation server 102. A virtual scene is constructed in the video simulation server 102. For example, there can be virtual roadside trees, buildings, roads, vehicles, etc. There is a virtual camera in it, which can be understood as being fixed at a certain position of a vehicle in the virtual scene, such as a camera on the left side of the vehicle. What the video simulation server 102 has to do is to simulate the view and render the content that the virtual camera can observe in the virtual scene based on the changes that occur to the vehicle calculated by the real-time machine 101 to obtain simulation video data, and then inject it back into the ECU through a video board. The ECU then performs the next control process based on the newly received data.

[0099] Some or all of the data processed by some models may directly be simulation data, such as simulation bus data, and then be injected back into the ECU through a bus board; The simulation bus data can be data obtained from the detection results of model simulation sensors, the execution results of actuators, the status information of devices, etc.

[0100] For example, the data packet of the bus data can contain control signals fed back by the ECU, such as a window opening instruction. The model can simulate the detection results of the window position sensor, such as the opening degree, etc., and can also simulate the status information reported by the window motor itself. Then the ECU performs further control based on the received information to form a closed-loop control.

[0101] The above-mentioned models can run on the real-time machine 101 or may also run on the video simulation server 102.

[0102] Since the uses of the ECU are diverse, the cockpit domain, chassis domain, intelligent driving domain, body domain, etc. will all use the ECU. The uses of the ECU are different, and the input and output data for it are also different, and all can be configured according to requirements. The embodiments of the present application mainly provide an architecture that can be used to implement a similar closed-loop injection process. Specifically, what kind of data to inject and how to perform simulation calculations can all vary according to requirements.

[0103] It should be noted that the functions related to data processing of the above real-time machine 101 and video simulation server 102 can all be implemented by using algorithms, software, and devices of the prior art.

[0104] It should be noted that the specific implementation manner of the video simulation server 102 may vary depending on the manufacturer, application scenario, and requirements. The above steps are only common video simulation processes, and the specific implementation details may vary due to the customization requirements of the system.

[0105] In some embodiments of the present application, the multiple data processing devices 100 include at least one real-time machine 101 and at least one video simulation server 102. The real-time machine 101 and the video simulation server 102 are configured to communicate with each other, and the video injection device 300 is connected to the video simulation server 102; the at least one bus interaction device 200 includes: a first bus interaction device disposed between the real-time machine 101 and the injection object 400; and / or, a second bus interaction device disposed between the video simulation server 102 and the injection object 400.

[0106] As Figure 8 shown, the video injection device 300 is disposed between the video simulation server 102 and the injection object 400, and the number thereof can be one or more. The first bus interaction device can specifically be the bus interaction device 200 disposed between the real-time machine 101 and the injection object 400, and the number thereof can be one or more. The second bus interaction device can specifically be the bus interaction device 200 disposed between the video simulation server 102 and the injection object 400, and the number thereof can be one or more, and can be specifically set according to actual requirements.

[0107] In the embodiments of the present application, when the number of interfaces of the real-time machine 101 and the simulation server is insufficient, optionally, as Figure 9 shown, the at least one bus interaction device 200 includes a plurality of specified bus interaction devices 200 connected in cascade; the first specified bus interaction device 200 after cascading among the plurality of specified bus interaction devices 200 is connected to the data processing device 100, and the plurality of specified bus interaction devices 200 are also all connected to the injection object 400.

[0108] In some embodiments of the present application, the injection system 10 may further include at least one Ethernet interaction device (not shown in the figure). The Ethernet interaction device is disposed between the data processing device 100 and the injection object 400 to obtain first Ethernet data from the data processing device 100 and inject the data stream of the first Ethernet data into the injection object 400. At least a part of the Ethernet interaction device can also be used to feed back the second Ethernet data fed back by the injection object 400 to the corresponding data processing device 100. The Ethernet interaction device and the injection object 400 may interact data through in-vehicle Ethernet. Furthermore, in this solution, the injection function of in-vehicle Ethernet data is creatively introduced into the injection device. In comparison, existing injection devices generally do not have the injection function of in-vehicle Ethernet data. Of course, in other solutions, the Ethernet interaction device may also interact data through ordinary Ethernet.

[0109] The embodiments of the present application have been described in detail above. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application. At the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. An injection system, comprising a data processing device, at least one video injection device, and a first transmission medium, characterized in that: The injection system further includes at least one deserializing injection device and a second transmission medium distinct from the first transmission medium; The video injection device is capable of acquiring the video data to be injected from the data processing device, and the video injection device is detachably connected to the deserialization injection device via a first transmission medium, so as to send a first data stream of the video data to be injected to the deserialization injection device when connected to the deserialization injection device; The deserialization injection device is detachably connected to an injection object via a second transmission medium, so as to inject a second data stream after deserialization of the first data stream into the injection object when connected to the injection object.

2. The injection system according to claim 1, characterized in that The first transmission medium is a cable for transmitting serial signals, the second transmission medium is a MIPI FPC, and the injection object is a domain controller that receives a data stream of video data through a MIPI interface.

3. The injection system according to claim 1, characterized in that The video injection device includes a video transmission module and a string adding module; Wherein, the video transmission module can obtain the video data to be injected from the data processing device; The video transmission module is connected to the string adding module to send the third data stream to be injected into the video data to the string adding module; The string adding module is detachably connected to the deserializing injection device via the first transmission medium. The string adding module can perform string adding processing on the third data stream to obtain the first data stream, and transmit the first data stream to the deserializing injection device when connected to the deserializing injection device.

4. The injection system according to claim 1, characterized in that The video injection device has a PCIe connection part, and the video injection device is plugged into the data processing device through the PCIe connection part to obtain the video data to be injected through the PCIe connection part.

5. The injection system according to claim 3, characterized in that The video injection device further comprises a conversion module, and the video transmission module is arranged between the conversion module and the string adding module; The conversion module obtains the fourth data stream in the first format of the video data to be injected from the data processing device through a third transmission medium, converts the fourth data stream in the first format into the third data stream in the second format, and sends the third data stream to the string adding module. The third transmission medium is different from the first transmission medium and the second transmission medium.

6. The injection system according to any one of claims 1 to 5, characterized in that: The deserialization injection device comprises a deserialization module and an interface module, and the deserialization module is connected to the interface module; The deserialization module obtains the first data stream from the video injection device through the first transmission medium, deserializes the first data stream to obtain the deserialized second data stream, and sends the second data stream to the interface module; The interface module injects the second data stream into the injection object through the second transmission medium.

7. The injection system according to claim 6, characterized in that The deserialization injection device also includes a control module and a communication interface module; The communication interface module is respectively connected to the deserialization module, the control module and the interface module to obtain configuration instructions from the control module and configure the deserialization module based on the configuration instructions.

8. The injection system according to claim 6, characterized in that The deserialization injection device further includes a trigger signal feedback module, which is connected to the deserialization module to feed back a trigger signal to the deserialization module, so that the trigger signal is transmitted to the video injection device via the deserialization module.

9. The injection system according to claim 8, characterized in that The deserialization injection device also includes a control module; The trigger signal feedback module is configured to selectively obtain the trigger signal or an indication signal for initiating the trigger signal from the control module or the injection object.

10. The injection system according to claim 6, characterized in that The deserialization injection device also includes a control module and an Ethernet module; The Ethernet module is connected to the control module, and the Ethernet module is configured to communicate with a preset external device.

11. The injection system according to any one of claims 1 to 5, characterized in that: Also includes at least one bus interaction device; The bus interaction device is arranged between the data processing device and the injection object, and at least part of the bus interaction device is configured to obtain first bus data from the data processing device and inject the first bus data into the injection object.

12. The injection system according to any one of claims 1 to 5, characterized in that It also includes at least one bus interaction device; the video data to be injected includes simulated video data; the number of the data processing devices is multiple, and the multiple data processing devices include at least one real-time machine and at least one video simulation server, the real-time machine and the video simulation server are configured to communicate with each other, at least part of the bus interaction device is arranged between the real-time machine and the injection object, and is configured to receive second bus data from the injection object and send the second bus data to the real-time machine, and the video simulation server is connected to the video injection device to feed back the simulated video data to the video injection device.

Images