Image data transmission method and device, electronic equipment and storage medium

Abstract

The application discloses an image data transmission method and device, electronic equipment and storage medium, and relates to the technical field of intelligent control and data transmission. The method comprises the following steps: in response to obtaining transmission data sent by a data receiving module of a decision chip, obtaining an image start signal and an image data signal of a first protocol type sent by the data receiving module, and converting the image start signal into an image synchronization signal of a second protocol type; and sequentially sending the image synchronization signal and the image data signal to a data sending module of the decision chip, so as to send the image synchronization signal and the image data signal to an interaction chip through the data sending module. The technical scheme of the embodiment of the application sends the image data to the interaction chip by using the existing functional module on the decision chip without configuring a special serializer, thereby reducing the hardware cost, wiring difficulty and software control overhead required for image data transmission.

Description

Technical Field

[0001] This invention relates to the field of intelligent control and data transmission technology, and in particular to an image data transmission method, apparatus, electronic device and storage medium. Background Technology

[0002] With the continuous development of intelligent control technology, the types of functional chips configured in intelligent devices such as automobiles and robots are also increasing. Among them, decision chips used to generate control decisions and interaction chips used for human-computer interaction have become important components of intelligent control technology.

[0003] In the prior art, in order to improve the utilization rate of image data and reduce the hardware cost of the device, the decision chip and the interaction chip often share the same set of cameras. After the image data output by the camera is processed by the serializer and enters the decision control board, the decision control board sends the restored image data to the decision chip through the deserializer. At the same time, a dedicated serializer is configured on the decision control board. The restored image data is forwarded to the interaction chip through the dedicated serializer, thereby completing the image transmission between the camera and the decision chip and the interaction chip.

[0004] However, the dedicated serializer configured on the decision control board not only increases the hardware cost of the decision control board and the wiring difficulty of the decision control board, but also requires the configuration of a transmission link between the deserializer and the dedicated serializer, which increases the software control overhead of the decision control board. Summary of the Invention

[0005] This invention provides an image data transmission method, apparatus, electronic device, and storage medium to address the problems of high hardware costs and excessive overhead in image data transmission for decision control boards.

[0006] According to another aspect of the present invention, an image data transmission method is provided, applied to a bridging module of a decision chip, comprising:

[0007] In response to receiving transmission data from the data receiving module of the decision chip, the data type of the transmission data is obtained;

[0008] If the data type is determined to be image data, the image start signal and image data signal of the first protocol type sent by the data receiving module are obtained, and the image start signal is converted into an image synchronization signal of the second protocol type.

[0009] The image synchronization signal and the image data signal are sequentially sent to the data transmission module of the decision chip, so that the image synchronization signal and the image data signal can be sent to the interaction chip through the data transmission module.

[0010] After determining that the data type is image data, the method further includes: sending a high-level signal to the data sending module to enable the data sending module and to switch the transmission target. Thus, by outputting a high-level signal to guide the data sending module into the enabled state, both effective transmission of image data and real-time switching of the transmission target are achieved, further ensuring the orderly transmission of image data.

[0011] The process of obtaining the data type of the transmitted data includes: determining the data type of the transmitted data based on whether embedded line data exists; if embedded line data is found, the data type of the transmitted data is determined to be image data; if embedded line data is not found, the data type of the transmitted data is determined to be non-image data. This not only avoids misidentifying other types of image data as image data emitted by the camera, but also allows for data type acquisition by detecting embedded line data, even for data without a specific encapsulation format, greatly expanding the detection range of image data.

[0012] The step of sequentially sending the image synchronization signal and the image data signal to the data transmission module of the decision chip includes: configuring the interval between the transmission of the image synchronization signal and the image data signal as an original interval time; wherein, the original interval time refers to the interval between the camera sending the image start signal and the image data signal. By configuring the delay time of the image synchronization signal, the accuracy of the image timing parameters between the image synchronization signal and the image data signal is ensured, improving the accuracy of the transmission timing of the image data sent via the data transmission module.

[0013] The step of sequentially sending the image synchronization signal and the image data signal to the data transmission module of the decision chip includes: configuring a delay transmission time for the image synchronization signal based on the data size of the image data signal, so that the image synchronization signal is sent to the data transmission module after the delay transmission time has elapsed. This ensures that the image data forwarded by the decision chip maintains the same transmission timing as the image data emitted by the camera, further guaranteeing the accuracy of the image data transmission timing.

[0014] The step of sequentially sending the image synchronization signal and the image data signal to the data transmission module of the decision chip includes: in response to acquiring target image data at a preset threshold, sequentially sending the image synchronization signal and the target image data to the data transmission module of the decision chip. This reduces the delay time between the image synchronization signal and the image data signal while ensuring that the original interval time between them is maintained, thereby improving the transmission efficiency of image data.

[0015] According to another aspect of the present invention, an image data transmission apparatus is provided, applied to a bridging module of a decision chip, comprising:

[0016] The data type acquisition module is used to acquire the data type of the transmitted data in response to the data received by the data receiving module of the decision chip;

[0017] A synchronization signal acquisition module is used to acquire, if it is determined that the data type is image data, an image start signal and an image data signal of a first protocol type sent by the data receiving module, and convert the image start signal into an image synchronization signal of a second protocol type;

[0018] The image data transmission module is used to sequentially send the image synchronization signal and the image data signal to the data transmission module of the decision chip, so that the image synchronization signal and the image data signal can be sent to the interaction chip through the data transmission module.

[0019] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the image data transmission method according to any embodiment of the present invention.

[0020] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the image data transmission method described in any embodiment of the present invention.

[0021] According to another aspect of the present invention, a computer program product is provided, comprising a computer program that, when executed by a processor, implements the image data transmission method described in any embodiment of the present invention.

[0022] The technical solution of this invention, in response to receiving transmission data from the data receiving module of the decision chip, obtains the data type of the transmission data; if the data type is determined to be image data, obtains the image start signal and image data signal of the first protocol type sent by the data receiving module, and converts the image start signal into an image synchronization signal of the second protocol type; sequentially sends the image synchronization signal and image data signal to the data sending module of the decision chip, so that the image synchronization signal and image data signal are sent to the interaction chip through the data sending module. Thus, without the need to configure a dedicated serializer, image data is sent to the interaction chip using the existing functional modules on the decision chip, reducing the hardware cost and wiring difficulty required for image data transmission, while avoiding the need to configure a transmission link between the deserializer and the dedicated serializer, reducing the software control overhead required for image data transmission.

[0023] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 This is a schematic diagram of the structure of an image data transmission system based on existing technology;

[0026] Figure 2 This is a schematic diagram of the structure of a decision chip according to an embodiment of the present invention;

[0027] Figure 3 This is a flowchart of an image data transmission method provided according to Embodiment 1 of the present invention;

[0028] Figure 4 This is a schematic diagram of another decision chip provided according to Embodiment 1 of the present invention;

[0029] Figure 5 This is a flowchart of another image data transmission method provided according to Embodiment 2 of the present invention;

[0030] Figure 6 This is a schematic diagram of the timing control process provided in Embodiment 2 of the present invention;

[0031] Figure 7This is a schematic diagram of the process of transmitting image data by the bridging module according to Embodiment 3 of the present invention;

[0032] Figure 8 This is a schematic diagram of the structure of an image data transmission device according to Embodiment 4 of the present invention;

[0033] Figure 9 This is a schematic diagram of the structure of an electronic device that implements the image data transmission method of this invention. Detailed Implementation

[0034] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0035] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0036] Figure 1 This is a schematic diagram of an existing image data transmission system configured in a smart device. A camera (e.g., a webcam) serves as an environmental sensing device installed in the smart device, responsible for collecting image data near the smart device. The image data output by the camera is processed by an initial serializer, such as a GMSL (Gigabit Multimedia Serial Link) serialization chip, and then enters the decision control board via a wiring harness. The decision control board, also known as the decision controller hardware board, serves as the carrier of the decision chip and integrates the decision chip and its supporting circuits (e.g., power supply, interface, and memory).

[0037] After processing by a deserializer, such as a GMSL deserializer chip, the decision control board forwards the processed image data to the interaction chip via a dedicated serializer. The interaction chip then displays the image data to the user and provides human-computer interaction functionality. Simultaneously, it transmits the processed image data to the decision chip. The decision chip processes the input image data to output control decisions using artificial intelligence (AI) algorithms such as perception fusion, path planning, and decision control.

[0038] When image data enters the decision chip through the deserializer, it specifically enters the image signal processor (ISP) through the data receiving module (including the physical layer receiving unit and the protocol layer receiving unit). The image signal processor processes the image data to make it more suitable for the execution of the aforementioned AI algorithms, and then the control decision is obtained by calculating the aforementioned AI algorithms.

[0039] Furthermore, the decision chip itself has a data transmission module (including a physical layer transmission unit and a protocol layer transmission unit). This protocol layer transmission unit has a different protocol type than the aforementioned protocol layer receiving unit, allowing for the transmission of other types of data. Simultaneously, the decision control board has an inherent serializer, and the aforementioned functional units are themselves used for the transmission of other types of data. For example, the decision chip's data processing unit (DSP) performs data processing tasks and sends the processing results to the inherent serializer on the decision control board via the physical layer transmission unit and the protocol layer transmission unit, so that the serializer can then transmit the processing results to other functional modules.

[0040] Specifically, the aforementioned image data transmission system may include an integrated intelligent driving and intelligent cockpit system (i.e., a cockpit-driver collaboration system) configured in intelligent vehicles; cameras include in-vehicle cameras responsible for collecting image data near the vehicle; decision control boards include intelligent driving domain control boards, i.e., intelligent driving domain controller hardware boards; decision chips include intelligent driving chips, which are used to output driving decisions; and interaction chips include cockpit chips.

[0041] like Figure 2 As shown, in this embodiment of the invention, a bridging module is added to the decision chip, and the bridging module is connected to the protocol layer receiving unit of the data receiving module and the protocol layer sending unit of the data sending module, thereby establishing an image data transmission link consisting of the physical layer receiving unit, the protocol layer receiving unit, the bridging module, the physical layer sending unit, the protocol layer sending unit and the built-in serializer; correspondingly, there is no need to configure an additional dedicated serializer in the decision control board.

[0042] Example 1

[0043] Figure 3 This is a flowchart of an image data transmission method provided in Embodiment 1 of the present invention. This embodiment is applicable to image data transmission between a camera and an interactive chip by connecting a bridging module that connects a data receiving module and a data sending module respectively. This method can be executed by an image data transmission device, which can be implemented in hardware and / or software. The image data transmission device can be configured in the bridging module of a decision chip, which can be configured in electronic devices inside intelligent devices such as automobiles and robots. Figure 3 As shown, the method includes:

[0044] S101. In response to receiving the transmission data sent by the data receiving module of the decision chip, the data type of the transmission data is obtained.

[0045] The data receiving module refers to the functional module in the decision chip used to receive image data emitted by the camera. Figure 4 For example, the physical layer receiving unit of the data receiving module may include a C Physical Receive (C-PHYRX) unit or a D Physical Receive (D-PHYRX) unit; the protocol layer receiving unit of the data receiving module may include a Camera Serial Interface Receive (CSIRX) unit.

[0046] Since the images transmitted by the camera are usually in a specified format, such as RAW (Raw Data), YUV (Luminance-Chrominance), and RGB (Red Green Blue), the bridging module can obtain the format of the transmitted data by parsing the transmitted data when it receives the data from the protocol layer receiving unit. If the format is one of the above image formats, it indicates that the current transmitted data is image data; if the format is not one of the above image formats, it indicates that the current transmitted data is non-image data.

[0047] Optionally, in this embodiment of the invention, obtaining the data type of the transmitted data includes: determining the data type of the transmitted data based on whether there is embedded row data in the transmitted data; if it is determined that there is embedded row data in the transmitted data, determining that the data type of the transmitted data is image data; if it is determined that there is no embedded row data in the transmitted data, determining that the data type of the transmitted data is non-image data.

[0048] Specifically, embedded row data refers to non-visual auxiliary data inserted between image rows, such as data types like transmission metadata and data stream structured identifiers. When outputting frame data, cameras often embed the aforementioned non-visual auxiliary data between image rows. The bridging module can determine the data type of the transmitted data through data parsing results. If it is determined that embedded row data exists in the transmitted data, the data type of the transmitted data is determined to be image data; if it is determined that embedded row data does not exist in the transmitted data, the data type of the transmitted data is determined to be non-image data.

[0049] Compared to determining the data type of transmitted data based on the data format, determining the data type of transmitted data based on the presence of embedded line data not only avoids misidentifying other types of image data as image data emitted by the camera, but also allows for data type determination by detecting embedded line data even for data without a packaging format, greatly expanding the detection range of image data.

[0050] S102. If the data type is determined to be image data, obtain the image start signal and image data signal of the first protocol type sent by the data receiving module, and convert the image start signal into an image synchronization signal of the second protocol type.

[0051] The image start signal indicates the start of image data, and the image data signal indicates the original data that records the actual image content. Taking the Camera Serial Interface (CSI) protocol as an example, the image start signal includes the frame start (FS) signal and the line start (LS) signal. The frame start signal indicates the start of a complete frame of image, and the line start signal indicates the start of a line of pixel data.

[0052] Image synchronization signals represent signals that synchronize the reception of image data. Taking the Display Serial Interface (DSI) protocol as an example, the image synchronization signals include vertical synchronization (VSync) signals and horizontal synchronization (HSync) signals. The vertical synchronization signal is a synchronization signal in the vertical direction, used to coordinate the frame output rhythm of image data; the horizontal synchronization signal is a synchronization signal in the horizontal direction, used to coordinate the transmission rhythm of each row of pixels in the image data.

[0053] The purpose of the bridging module is to transmit image data captured by the camera to the interactive chip for display. This requires precise timing synchronization between the interactive chip and the image source (i.e., the camera) to avoid anomalies such as image tearing, jitter, and misalignment. It also needs to be compatible with the interactive chip's transmission protocol. Therefore, the bridging module needs to convert the image start signal of the first protocol type into an image synchronization signal of the second protocol type. Accordingly, by converting the frame start signal into a vertical synchronization signal and the line start signal into a horizontal synchronization signal, the image synchronization signal ensures precise timing synchronization of image data between the interactive chip and the camera, while also being compatible with the interactive chip's transmission protocol.

[0054] S103. The image synchronization signal and the image data signal are sequentially sent to the data transmission module of the decision chip, so that the image synchronization signal and the image data signal are sent to the interaction chip through the data transmission module.

[0055] like Figure 4 As shown, the physical layer transmission unit of the data transmission module may include a C Physical Receive (C-PHY TX) unit or a D Physical Receive (D-PHY TX) unit; the protocol layer transmission unit of the data transmission module may include a Display Serial Interface Transmit (DSI TX) unit.

[0056] The bridging module converts the frame start signal and line start signal of the CSI protocol into the vertical synchronization signal and horizontal synchronization signal of the DSI protocol, and sends the vertical synchronization signal and horizontal synchronization signal to the DSI TX unit. Then, it sends the image data signal to the DSI TX unit, so that the image data can be transmitted to the built-in serializer on the decision control board through the DSI TX unit and the physical layer transmission unit. Finally, the built-in serializer sends the image data sent by the camera to the interaction chip.

[0057] In particular, on the decision control board, the deserializer and the built-in serializer are often configured in different areas due to the different data they transmit. This leads to wiring difficulties between the deserializer and the built-in serializer, making it impossible to directly construct a transmission line between them. Therefore, this application completes image data transmission between the camera and the interaction chip by reusing the data transmission module of the decision chip and the built-in serializer of the decision control board without configuring a dedicated serializer. This reduces the hardware cost of the decision control board and improves the convenience of image data transmission.

[0058] Optionally, in this embodiment of the invention, after determining that the data type is an image, the method further includes: sending a high-level signal to the data sending module to enable the data sending module and to switch the transmission object.

[0059] Specifically, since the data transmission module in the decision chip is used for transmitting other types of data, such as the data processing unit sending the data processing results to other functional modules through the data transmission module, after determining that the transmitted data is image data, a high-level signal is sent to the data transmission module to enable the data transmission module and switch the transmission object to the current image data. Thus, by outputting a high-level signal to guide the data transmission module into the enabled state, both effective transmission of image data and real-time switching of the transmission object are achieved, further ensuring the orderly transmission of image data.

[0060] The technical solution of this invention, in response to receiving transmission data from the data receiving module of the decision chip, obtains the data type of the transmission data; if the data type is determined to be image data, obtains the image start signal and image data signal of the first protocol type sent by the data receiving module, and converts the image start signal into an image synchronization signal of the second protocol type; sequentially sends the image synchronization signal and image data signal to the data sending module of the decision chip, so that the image synchronization signal and image data signal are sent to the interaction chip through the data sending module. Thus, without the need to configure a dedicated serializer, image data is sent to the interaction chip using the existing functional modules on the decision chip, reducing the hardware cost and wiring difficulty required for image data transmission, while avoiding the need to configure a transmission link between the deserializer and the dedicated serializer, reducing the software control overhead required for image data transmission.

[0061] Example 2

[0062] Figure 5 This is a flowchart of an image data transmission method provided in Embodiment 2 of the present invention. The relationship between this embodiment and the above embodiments is that the interval transmission time between the image synchronization signal and the image data signal remains unchanged. Figure 5 As shown, the method specifically includes:

[0063] S201. In response to receiving the transmission data sent by the data receiving module of the decision chip, the data type of the transmission data is obtained.

[0064] S202. If the data type is determined to be image data, obtain the image start signal and image data signal of the first protocol type sent by the data receiving module, and convert the image start signal into an image synchronization signal of the second protocol type.

[0065] S203. Configure the interval between the transmission of the image synchronization signal and the image data signal as the original interval time; wherein, the original interval time refers to the interval between the camera transmitting the image start signal and the image data signal.

[0066] like Figure 6 As shown, when the camera outputs image data, it first sends the frame start signal (FL) and line start signal (SL), followed by the image data signal. The image timing parameter between the line start signal and the image data signal is hpb1 (i.e., the duration is hpb1). However, when the CST TX unit sends the signal, its image timing parameter is increased to hpb2. This is because after the CST TX unit receives the frame start signal and line start signal, it can send them immediately due to the small amount of data. However, the image data signal needs to be sent after the image data reception is complete. This causes a longer delay when the CST TX unit sends the image data signal.

[0067] For the bridging module, when sending image data signals, it delays the transmission of the converted vertical and horizontal synchronization signals. This ensures that, according to the transmission characteristics of the transmission protocol, the image timing parameters between the horizontal synchronization signal and the image data signal are still restored to hpb1. This allows the DSI TX unit to maintain the original image timing parameters hpb1 when acquiring image data. By configuring the delay time of the image synchronization signal, the accuracy of the image timing parameters between the image synchronization signal and the image data signal is ensured, thus improving the accuracy of the transmission timing of image data sent through the data transmission module.

[0068] Optionally, in this embodiment of the invention, the step of sequentially sending the image synchronization signal and the image data signal to the data transmission module of the decision chip includes: configuring a delayed transmission time for the image synchronization signal according to the data size of the image data signal, so that the image synchronization signal is sent to the data transmission module after the delayed transmission time has elapsed.

[0069] Specifically, the larger the image data signal, the longer the CST TX unit takes during transmission and reception. Correspondingly, if the bridging module does not perform delay processing on the image synchronization signal, the transmission delay between the image synchronization signal and the image data signal will also be greater. Therefore, the delay time of the image synchronization signal is configured according to the size of the image data signal. The size of the image data signal and the delay time of the image synchronization signal are positively correlated; that is, the larger the image data signal, the longer the delay time of the image synchronization signal. This ensures that the image data forwarded by the decision chip maintains the same transmission timing as the image data emitted by the camera, further ensuring the accuracy of the image data transmission timing.

[0070] Optionally, in this embodiment of the invention, the step of sequentially sending the image synchronization signal and the image data signal to the data transmission module of the decision chip includes: in response to obtaining target image data with a preset threshold, sequentially sending the image synchronization signal and the target image data to the data transmission module of the decision chip.

[0071] Specifically, for the bridging module, after receiving the image start signal from the data receiving module and completing the conversion of the image synchronization signal, it does not need to wait until the image data signal is fully acquired before sending the image synchronization signal. Instead, after acquiring the target image data with a preset threshold, it can send the image synchronization signal and the target image data sequentially. For example, in the CSI protocol, image data is split into multiple rows of pixels for transmission. The preset threshold can be configured as one pixel row. That is, after acquiring one pixel row, the image synchronization signal and the target image data can be sent sequentially. This reduces the delay time of the image synchronization signal and the image data signal while ensuring that the original interval time is maintained between them, thus improving the transmission efficiency of image data.

[0072] S204. The image synchronization signal and the image data signal are sequentially sent to the data transmission module of the decision chip, so that the image synchronization signal and the image data signal are sent to the interaction chip through the data transmission module.

[0073] The technical solution of this invention, in response to receiving transmission data from the data receiving module of the decision chip, obtains the data type of the transmission data; if the data type is determined to be image data, obtains the image start signal and image data signal of the first protocol type sent by the data receiving module, and converts the image start signal into an image synchronization signal of the second protocol type; configures the interval transmission time between the image synchronization signal and the image data signal as the original interval time; thereby, by configuring the delay time of the image synchronization signal, the accuracy of the image timing parameters between the image synchronization signal and the image data signal is ensured, and the accuracy of the transmission timing of the image data sent by the data sending module is improved.

[0074] Example 3

[0075] Figure 7 This is a schematic diagram of the process of transmitting image data by the bridging module provided in Embodiment 3 of the present invention, as shown below. Figure 7As shown, the bridging module includes an identifier conversion unit and a protocol conversion unit. The bridging module connects to the CSI-TX unit and the DSI-TX unit respectively through different IPI (Image Processing and Interchange) interfaces.

[0076] The identifier conversion unit parses the Format (identifier) ​​signal and determines whether the transmitted data is embedded line data added to the camera based on the parsing result. If it is determined that the current transmitted data is embedded line data added to the camera, the output Embedded (interrupt) signal is set to a high level. If it is determined that the current transmitted data is not embedded line data added to the camera, the Embedded signal is set to a low level. The high-level Embedded (interrupt) signal can be used for the enable control of the DSI TX unit.

[0077] When it is determined that the transmitted data is embedded line data added to the camera, the protocol conversion unit converts the CSI protocol's Frame_start signal (i.e., frame start signal) into a VSync signal (i.e., vertical synchronization signal) and the Line_start signal (i.e., line start signal) into an HSync signal (i.e., horizontal synchronization signal), and then sends the vertical synchronization signal and the horizontal synchronization signal to the DSI TX unit; then the bridging module sends the Data signal (i.e., image data signal) and Dataen (image enable signal) sent by the CSI TX unit to the DSI TX unit.

[0078] The DSI TX unit sends image data to the interaction chip through the physical layer transmission unit and the built-in serializer on the decision control board. Based on this, the decision chip acquires the image data sent by the camera, completes the data processing of the image data, generates a control strategy, and forwards the image data sent by the camera to the interaction chip by reusing the data transmission module inside the decision chip and the built-in serializer on the decision control board, thus realizing data transmission between the camera and the interaction chip.

[0079] The technical solution of this invention transmits image data to the interaction chip using existing functional modules on the decision chip without requiring a dedicated serializer. This reduces the hardware cost and wiring difficulty required for image data transmission, while avoiding the need to configure a transmission link between the deserializer and the dedicated serializer, thus reducing the software control overhead required for image data transmission.

[0080] Example 4

[0081] Figure 8 This is a structural block diagram of an image data transmission device provided in Embodiment 4 of the present invention. The device specifically includes:

[0082] The data type acquisition module 401 is used to acquire the data type of the transmitted data in response to the data received by the data receiving module of the decision chip;

[0083] The synchronization signal acquisition module 402 is used to acquire, if determined that the data type is image data, an image start signal and an image data signal of the first protocol type sent by the data receiving module, and convert the image start signal into an image synchronization signal of the second protocol type;

[0084] The image data transmission module 403 is used to sequentially send the image synchronization signal and the image data signal to the data transmission module of the decision chip, so that the image synchronization signal and the image data signal can be sent to the interaction chip through the data transmission module.

[0085] The technical solution of this invention, in response to receiving transmission data from the data receiving module of the decision chip, obtains the data type of the transmission data; if the data type is determined to be image data, obtains the image start signal and image data signal of the first protocol type sent by the data receiving module, and converts the image start signal into an image synchronization signal of the second protocol type; sequentially sends the image synchronization signal and image data signal to the data sending module of the decision chip, so that the image synchronization signal and image data signal are sent to the interaction chip through the data sending module. Thus, without the need to configure a dedicated serializer, image data is sent to the interaction chip using the existing functional modules on the decision chip, reducing the hardware cost and wiring difficulty required for image data transmission, while avoiding the need to configure a transmission link between the deserializer and the dedicated serializer, reducing the software control overhead required for image data transmission.

[0086] Optionally, the image data transmission device is further configured to send a high-level signal to the data transmission module to enable the data transmission module and to switch the transmission target of the data transmission module.

[0087] Optionally, the data type acquisition module 401 is specifically used to determine the data type of the transmitted data based on whether there is embedded row data in the transmitted data; if it is determined that there is embedded row data in the transmitted data, the data type of the transmitted data is determined to be image data; if it is determined that there is no embedded row data in the transmitted data, the data type of the transmitted data is determined to be non-image data.

[0088] Optionally, the image data transmission module 403 is specifically configured to set the interval transmission time between the image synchronization signal and the image data signal as an original interval time; wherein, the original interval time refers to the interval time between the camera sending the image start signal and the image data signal.

[0089] Optionally, the image data transmission module 403 is specifically configured to configure the delayed transmission time of the image synchronization signal according to the data size of the image data signal, so as to send the image synchronization signal to the data transmission module after the delayed transmission time has elapsed.

[0090] Optionally, the image data transmission module 403 is specifically used to, in response to acquiring target image data with a preset threshold, sequentially send the image synchronization signal and the target image data to the data transmission module of the decision chip.

[0091] The above-described apparatus can execute the image data transmission method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the method. Technical details not described in detail in this embodiment can be found in the image data transmission method provided in any embodiment of the present invention.

[0092] Example 5

[0093] Figure 9 A schematic diagram of an electronic device 10, which can be used to implement embodiments of the present invention, is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, electronic devices, blade electronic devices, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0094] like Figure 9 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0095] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0096] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as image data transmission methods.

[0097] In some embodiments, the image data transmission method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as a storage unit. In some embodiments, part or all of the computer program may be loaded and / or installed on a heterogeneous hardware accelerator via ROM and / or a communication unit. When the computer program is loaded into RAM and executed by a processor, one or more steps of the image data transmission method described above may be performed. Alternatively, in other embodiments, the processor may be configured to perform the image data transmission method by any other suitable means (e.g., by means of firmware).

[0098] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0099] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0100] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0101] To provide user interaction, the systems and techniques described herein can be implemented on a heterogeneous hardware accelerator, which includes: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the heterogeneous hardware accelerator. Other types of devices can also be used to provide user interaction; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or haptic feedback); and input from the user can be received in any form (including sound input, voice input, or haptic input).

[0102] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0103] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0104] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0105] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. An image data transmission method, characterized in that, A bridging module used in decision-making chips includes: In response to receiving transmission data from the data receiving module of the decision chip, the data type of the transmission data is obtained; If the data type is determined to be image data, the image start signal and image data signal of the first protocol type sent by the data receiving module are acquired, and the image start signal is converted into an image synchronization signal of the second protocol type; wherein, the decision chip includes an image signal processor; the image signal processor is used to acquire image data through the data receiving module and process the image data so as to use the processing result for control decision; The image synchronization signal and the image data signal are sequentially sent to the data transmission module of the decision chip, so that the image synchronization signal and the image data signal are sent to the interaction chip through the data transmission module and the inherent serializer of the decision control board; wherein, the decision chip includes a data processing unit; the data processing unit is used to perform data processing tasks and send the data processing results to other functional modules through the data transmission module and the inherent serializer; the decision control board is the carrier of the decision chip and integrates the decision chip and supporting circuits.

2. The image data transmission method according to claim 1, characterized in that, After determining that the data type is image data, the process also includes: A high-level signal is sent to the data transmission module to enable the data transmission module and to switch the transmission target.

3. The image data transmission method according to claim 1 or 2, characterized in that, The data type of the transmitted data obtained includes: The data type of the transmitted data is determined based on whether there is embedded row data in the transmitted data; If it is determined that there is embedded row data in the transmitted data, the data type of the transmitted data is determined to be image data; If it is determined that there is no embedded row data in the transmitted data, the data type of the transmitted data is determined to be non-image data.

4. The image data transmission method according to claim 1, characterized in that, The data transmission module that sequentially sends the image synchronization signal and the image data signal to the decision chip includes: The interval between the transmission of the image synchronization signal and the image data signal is configured as the original interval time; wherein, the original interval time refers to the interval between the camera transmitting the image start signal and the image data signal.

5. The image data transmission method according to claim 1 or 4, characterized in that, The data transmission module that sequentially sends the image synchronization signal and the image data signal to the decision chip includes: Based on the data size of the image data signal, the delay time for sending the image synchronization signal is configured so that the image synchronization signal is sent to the data sending module after the delay time has elapsed.

6. The image data transmission method according to claim 1, characterized in that, The data transmission module that sequentially sends the image synchronization signal and the image data signal to the decision chip includes: In response to acquiring target image data with a preset threshold, the image synchronization signal and the target image data are sequentially sent to the data transmission module of the decision chip.

7. An image data transmission device, characterized in that, A bridging module used in decision-making chips includes: The data type acquisition module is used to acquire the data type of the transmitted data in response to the data received by the data receiving module of the decision chip; A synchronization signal acquisition module is used to acquire an image start signal and an image data signal of a first protocol type sent by the data receiving module if the data type is determined to be image data, and to convert the image start signal into an image synchronization signal of a second protocol type; wherein, the decision chip includes an image signal processor; the image signal processor is used to acquire image data through the data receiving module and process the image data so as to use the processing result for control decision; An image data transmission module is used to sequentially send the image synchronization signal and the image data signal to the data transmission module of the decision chip, so that the image synchronization signal and the image data signal are sent to the interaction chip through the inherent serializer of the data transmission module and the decision control board; wherein, the decision chip includes a data processing unit; the data processing unit is used to perform data processing tasks and send the data processing results to other functional modules through the data transmission module and the inherent serializer; the decision control board is the carrier of the decision chip and integrates the decision chip and supporting circuitry.

8. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the image data transmission method according to any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the image data transmission method according to any one of claims 1-6.

10. A computer program product comprising a computer program that, when executed by a processor, implements the image data transmission method of any one of claims 1-6.

Images