Data transmission method, device, system, equipment and storage medium

Abstract

The present application discloses a data transmission method, device, system, equipment and storage medium, the method comprising: obtaining data of a display image layer and data of a transparency layer, and determining multiple groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer; constructing a target layer based on the display image layer and the transparency layer of each group of data to be superimposed; determining first placement data and second placement data of the corresponding target layer based on the data of the display image layer and the transparency layer of each group of data to be superimposed; placing the first placement data at the first position of the corresponding target layer, and placing the second placement data at the second position of the corresponding target layer, to obtain the data of the corresponding target layer; transmitting the data of multiple target layers. The technical solution of the present application realizes the synchronization of the data of the display image layer and the data of the transparency layer, and solves the problem of asynchronous data transmission.

Description

Technical Field

[0001] The present application belongs to the field of chip technology, and in particular relates to a data transmission method, device, system, equipment and storage medium. Background Art

[0002] At present, when there is a need to transmit layer transparency information or transparency layer data between chips, a separate channel is mainly set up through the high-speed serial computer expansion bus standard (peripheral component interconnect express, PCIe) or the universal serial bus (Universal Serial Bus, USB) to transmit the transparency layer data; or in addition to the corresponding display image layer data, a separate mobile industry processor interface (Mobile Industry Processor Interface, MIPI) or Display Port interface signal is set up for transmission.

[0003] Therefore, the above methods all require that additional hardware interfaces be deployed on the chips at both ends of data transmission, resulting in large power consumption losses. Summary of the invention

[0004] The present application aims to solve one of the technical problems in the related art at least to a certain extent. To this end, one purpose of the present application is to propose a data transmission method, device, system, equipment and storage medium.

[0005] In order to solve the above technical problems, the embodiments of the present application provide the following technical solutions:

[0006] A data transmission method, comprising:

[0007] Acquire data of a display image layer and data of a transparency layer, and determine multiple groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer;

[0008] Constructing a target layer based on the display image layer and the transparency layer of each group of the data to be superimposed;

[0009] Determine first placement data and second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed;

[0010] Placing the first placement data at a first position of the corresponding target layer, and placing the second placement data at a second position of the corresponding target layer, to obtain data of the corresponding target layer;

[0011] The data of the plurality of target layers are transmitted.

[0012] Optionally, the acquiring the data of the display image layer and the data of the transparency layer, and determining the data to be superimposed based on the data of the display image layer and the data of the transparency layer, includes:

[0013] Acquire a first matching parameter of the display image layer; and simultaneously acquire a second matching parameter of the data of the transparency layer;

[0014] Comparing the first matching parameter and the second matching parameter;

[0015] If the first matching parameter and the second matching parameter are consistent, the data of the display image layer corresponding to the first matching parameter and the data of the transparency layer matching the second matching parameter are obtained, and the data of the display image layer and the data of the transparency layer are determined as the data to be superimposed.

[0016] Optionally, constructing a target layer based on the display image layer and the transparency layer of each group of the data to be superimposed includes:

[0017] Obtaining a first parameter of the display image layer of each group of the data to be superimposed;

[0018] Obtain a second parameter of the transparency layer of each group of the data to be superimposed;

[0019] Obtaining construction parameters based on the first parameter and the second parameter of the data to be superimposed;

[0020] Based on the construction parameters, the target layer is constructed.

[0021] Optionally, the determining the first placement data and the second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed includes:

[0022] Determine the data of the display image layer as the first placement data; determine the data of the transparency layer as the second placement data;

[0023] Placing the data of the display image layer at the first position; placing the data of the transparency layer at the second position;

[0024] Wherein, the second position is determined according to the first position.

[0025] Optionally, the determining the first placement data and the second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed includes:

[0026] Determine the data of the transparency layer as the first placement data; determine the data of the display image layer as the second placement data;

[0027] Placing the data of the transparency layer at the first position; placing the data of the display image layer at the second position;

[0028] Wherein, the second position is determined according to the first position.

[0029] Optionally, transmitting the data of the plurality of target layers includes:

[0030] Determine whether the data of each target layer needs to be compressed;

[0031] If the data of the target layer needs to be compressed, the data of the target layer is determined as the data to be compressed, and the data to be compressed is compressed to obtain compressed data, and then the compressed data is transmitted; or

[0032] If the data of the target layer does not need to be compressed, the data of the target layer is directly transmitted.

[0033] Optionally, the determining whether the data of each target layer needs to be compressed includes:

[0034] Obtaining transmission parameters of data of each target layer;

[0035] Comparing the transmission parameter of each target layer's data with a transmission parameter threshold;

[0036] If the transmission parameter is greater than the transmission parameter threshold, the data of the target layer corresponding to the transmission parameter is determined as the data to be compressed;

[0037] Or if the transmission parameter is less than or equal to the transmission parameter threshold, the actual transmission power consumption of the data of the target layer is calculated, and the compressed transmission power consumption of the compressed data of the target layer is calculated; the actual transmission power consumption is compared with the compressed transmission power consumption; if the actual transmission power consumption is greater than the compressed transmission power consumption, the data of the target layer corresponding to the actual transmission power consumption is determined as the data to be compressed.

[0038] An embodiment of the present application further provides a data transmission device, including:

[0039] An acquisition module, used for acquiring data of a display image layer and data of a transparency layer, and determining a plurality of groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer;

[0040] A construction module, constructing a target layer by intentionally using the display image layer and the transparency layer based on each group of the data to be superimposed;

[0041] A determination module, configured to determine first placement data and second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed;

[0042] A placement module, used for placing the first placement data at a first position of the corresponding target layer, and placing the second placement data at a second position of the corresponding target layer, to obtain data of the corresponding target layer;

[0043] The transmission module is used to transmit the data of the multiple target layers.

[0044] An embodiment of the present application further provides a data transmission system, including:

[0045] A first chip, the first chip includes a GPU, a DPU and a first interface that are communicatively connected; the GPU is used to obtain data of a display image layer and data of a transparency layer, and determine multiple groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer; construct a target layer based on the display image layer and the transparency layer of each group of data to be superimposed; determine first placement data and second placement data of the corresponding target layer based on the data of the display image layer and the transparency layer of each group of data to be superimposed; place the first placement data at a first position of the corresponding target layer, and place the second placement data at a second position of the corresponding target layer to obtain data of each target layer; and send the data of multiple target layers to the first interface based on the DPU;

[0046] The second chip is used to receive data of the plurality of target layers sent by the first chip through the first interface.

[0047] An embodiment of the present application further provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the method as described above when executing the computer program.

[0048] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the method described above.

[0049] The embodiments of the present application have the following technical effects:

[0050] The above-mentioned technical scheme of the present application can establish a data transmission channel based on the network, the first interface of the first chip and the second interface of the second chip, and through this data transmission channel, the data of the corresponding display image layer and the data of the transparency layer can be transmitted simultaneously, without having to provide an interface for establishing a second data transmission channel, thereby saving hardware resources; in addition, the corresponding display image layer data and the transparency layer data are transmitted simultaneously based on the same data transmission channel, thereby realizing the synchronization of the display image layer data and the transparency layer data, and solving the problem of asynchronous data transmission.

[0051] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 It is a structural diagram of a data transmission system provided in an embodiment of the present application;

[0053] Figure 2 It is a flowchart of a data transmission method provided by an embodiment of the present application;

[0054] Figure 3 This is a schematic diagram of the first structure of a target layer provided in an embodiment of the present application;

[0055] Figure 4 This is a second structural schematic diagram of a target layer provided in an embodiment of the present application;

[0056] Figure 5 This is a third structural schematic diagram of a target layer provided in an embodiment of the present application;

[0057] Figure 6 This is a fourth structural schematic diagram of a target layer provided in an embodiment of the present application;

[0058] Figure 7 It is a structural diagram of a data transmission device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0060] In order to facilitate the understanding of the embodiments by those skilled in the art, some terms are explained:

[0061] 1) GPU: Graphics Processing Unit, graphics processor.

[0062] 2)DPU: Display Processing Uni, image data processing unit.

[0063] 3)SoC: System on Chip, system-level chip.

[0064] 4)DRAM: Dynamic Random Access Memory.

[0065] 5)bit depth: bit depth.

[0066] 6)DSC, Display Stream Compression, image compression transmission.

[0067] At present, if the data of the transparency layer is not specially processed, when the data of the transparency layer is transmitted, the data stream related to the data of the transparency layer exists separately, and is stored separately from the data of the display image layer, and is subsequently read separately. Therefore, when the data of the transparency layer is transmitted, it is also necessary to set up a separate channel to transmit only the data of the transparency layer, which will lead to independent data streams, high implementation complexity, and difficulty in synchronizing the data of the display image layer and the data of the transparency layer.

[0068] In order to solve the above problems, the embodiments of the present application provide the following technical solutions:

[0069] like Figure 1 As shown, an embodiment of the present application further provides a data transmission system, including:

[0070] A first chip, the first chip includes a GPU, a DPU and a first interface that are communicatively connected; the GPU is used to obtain data of a display image layer and data of a transparency layer, and determine multiple groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer; construct a target layer based on the display image layer and the transparency layer of each group of data to be superimposed; determine first placement data and second placement data of the corresponding target layer based on the data of the display image layer and the transparency layer of each group of data to be superimposed; place the first placement data at a first position of the corresponding target layer, and place the second placement data at a second position of the corresponding target layer to obtain data of the corresponding target layer; and send the data of multiple target layers to the first interface based on the DPU;

[0071] Among them, the first interface of the present application can be implemented based on interfaces such as USB or PCIe.

[0072] The second chip is used to receive data of the plurality of target layers sent by the first chip through the first interface.

[0073] In an embodiment of the present application, correspondingly, the second chip is provided with a second interface for receiving the data of the target layer sent by the first chip through the first interface.

[0074] The second interface of the present application can also be implemented based on interfaces such as USB or PCIe.

[0075] The second chip may be implemented based on SoC.

[0076] In an embodiment of the present application, the transmission parameters of the data of the target layer are determined based on the DPU; wherein the transmission parameters can be calculated based on parameters such as resolution and data frame rate;

[0077] After obtaining the transmission parameters of the data of the target layer, the transmission parameters are compared with the transmission parameter threshold. If the transmission parameters are greater than the transmission parameter threshold, it indicates that the bandwidth of the current data channel cannot support the transmission of the data of the target layer. Therefore, the DPU compresses the data of the target layer, obtains compressed data, and sends the compressed data to the first interface; the transmission parameter threshold is set according to the adaptive bandwidth of the first interface; and is used to realize the transmission of the data from the DPU based on the first interface;

[0078] If the transmission parameter is less than or equal to the transmission parameter threshold, it indicates that the bandwidth of the current data channel can support the transmission of the data of the target layer, and then the actual transmission power consumption of the data of the target layer is calculated, and the compressed transmission power consumption of the compressed data of the target layer is calculated; if the actual transmission power consumption is greater than the compressed transmission power consumption, the DPU compresses the data of the target layer; if the actual transmission power consumption is less than the compressed transmission power consumption, the DPU will not compress the data of the target layer, but directly send the data of the target layer to the first interface.

[0079] In addition, DPU is an image data processing unit, which usually performs local / global color calibration, local / global dynamic range enhancement, image enhancement processing related to the characteristics of the display (such as display brightness uniformity compensation, etc.) and image data compression on the data of the display image layer in the form of a pipeline, which can effectively improve the final display effect on the display end and is necessary for the data of the actual image layer; in the embodiment of the present application, after the data of the transparency layer is also added to the target layer, it is transmitted simultaneously with the data of the display image layer, and the above-mentioned DPU image data processing unit can be reused to perform certain processing on the data of the transparency layer, such as compression.

[0080] In the embodiments of the present application, a data transmission channel can be established based on the network, the first interface of the first chip and the second interface of the second chip, and through this data transmission channel, the data of the corresponding display image layer and the data of the transparency layer can be transmitted simultaneously without providing an interface for establishing a second data transmission channel, thereby saving hardware resources; in addition, the data of the corresponding display image layer and the data of the transparency layer are transmitted simultaneously based on the same data transmission channel, thereby realizing synchronization of the data of the display image layer and the data of the transparency layer, and solving the problem of asynchronous data transmission.

[0081] like Figure 2 As shown, the embodiment of the present application provides a data transmission method, which is applied to Figure 1 The data transmission system shown comprises:

[0082] Step S21: acquiring data of a display image layer and data of a transparency layer, and determining a plurality of groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer;

[0083] In an embodiment of the present application, the data of the display image layer and the data of the transparency layer are read out from the system cache or DRAM at the same time.

[0084] Specifically, the acquiring of the data of the display image layer and the data of the transparency layer, and determining the data to be superimposed based on the data of the display image layer and the data of the transparency layer, includes:

[0085] Acquire a first matching parameter of the display image layer; and simultaneously acquire a second matching parameter of the data of the transparency layer;

[0086] Comparing the first matching parameter and the second matching parameter;

[0087] If the first matching parameter and the second matching parameter are consistent, the data of the display image layer corresponding to the first matching parameter and the data of the transparency layer matching the second matching parameter are obtained, and the data of the display image layer and the data of the transparency layer are determined as the data to be superimposed.

[0088] In an embodiment of the present application, when reading data from DRAM, a group of data is read simultaneously each time, including data of the display image layer and data of the transparency layer, and each group of data is processed based on a subsequent algorithm, and the above steps are repeated to read multiple groups of display image layer data and transparency layer data, thereby obtaining multiple groups of data to be superimposed.

[0089] When determining the same set of data, the data of the display image layer and the data of the transparency layer that need to be read simultaneously can be determined according to the matching parameters. For example, if the matching parameter is a timestamp, the first matching parameter is the timestamp of the data of the display image layer; the second matching parameter is the timestamp of the data of the transparency layer;

[0090] The data of the display image layer and the data of the transparency layer with the same timestamp are read; or according to actual needs, other matching parameters are set to read the data of the same group of display image layers and the data of the transparency layer.

[0091] Step S22: constructing a target layer based on the display image layer and the transparency layer of each group of the data to be superimposed;

[0092] Specifically, constructing a target layer based on the display image layer and the transparency layer of each group of the data to be superimposed includes:

[0093] Obtaining a first parameter of the display image layer of each group of the data to be superimposed;

[0094] Obtain a second parameter of the transparency layer of each group of the data to be superimposed;

[0095] Obtaining construction parameters based on the first parameter and the second parameter of the data to be superimposed;

[0096] Based on the construction parameters, the target layer is constructed.

[0097] In the embodiment of the present application, after a set of display image layer data and transparency layer data are read out simultaneously, a first parameter of the display image layer is obtained; wherein the first parameter is the size of the display image layer (for example, the length, width and other parameters used to characterize the size of the display image layer); and a second parameter of the transparency layer is obtained; wherein the second parameter is the size of the transparency layer;

[0098] According to the size of the display image layer and the size of the transparency layer, based on the existing algorithm (the embodiments of the present application do not make specific limitations on this), the construction parameters of the target layer, that is, the size of the target layer, are calculated, and the target layer is constructed according to the size of the target layer.

[0099] Among them, the size of the target layer of the present application is larger than the size of the display image layer, and the size of the target layer is equal to the sum of the size of the display image layer and the size of the transparency layer.

[0100] In an embodiment of the present application, parameters of a target layer are obtained based on the size of a display image layer and the size of a transparency layer, so that the size of the display image layer is expanded based on the size of the transparency layer, so as to realize simultaneous transmission of corresponding display image layer data and the size of the transparency layer based on the target layer.

[0101] Step S23: determining first placement data and second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed;

[0102] Step S24: placing the first placement data at the first position of the corresponding target layer, and placing the second placement data at the second position of the corresponding target layer, to obtain data of the corresponding target layer;

[0103] In an optional embodiment of the present application, determining the first placement data and the second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed includes:

[0104] The data of the display image layer is determined as the first placement data; and the data of the transparency layer is determined as the second placement data.

[0105] Placing the data of the display image layer at the first position; placing the data of the transparency layer at the second position;

[0106] Wherein, the second position is determined according to the first position.

[0107] In an embodiment of the present application, according to actual needs, the data of the display image layer determined as the first placement data can be placed at the first position of the target layer, and the remaining position of the target layer can be determined as the second position, and then the data of the transparency layer determined as the second placement data can be placed at the second position of the target layer.

[0108] After the area corresponding to the first position is determined, the second position may be located at any one of the top, bottom and both sides of the first position.

[0109] like Figure 3 As shown, according to actual needs, the data of the display image layer determined as the first placement data can be placed at the first position of the target layer, and the remaining position of the target layer can be determined as the second position, and then the data of the transparency layer determined as the second placement data can be placed at the second position of the target layer; and the second position is located on the left side of the first position;

[0110] like Figure 4 As shown, according to actual needs, the data of the display image layer determined as the first placement data can be placed at the first position of the target layer, and the remaining position of the target layer can be determined as the second position, and then the data of the transparency layer determined as the second placement data can be placed at the second position of the target layer; and the second position is located on the right side of the first position;

[0111] In an optional embodiment of the present application, determining the first placement data and the second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed includes:

[0112] Determine the data of the transparency layer as the first placement data; determine the data of the display image layer as the second placement data;

[0113] Placing the data of the transparency layer at the first position; placing the data of the display image layer at the second position;

[0114] Wherein, the second position is determined according to the first position.

[0115] In an embodiment of the present application, according to actual needs, the data of the transparency layer determined as the first placement data can be placed at the first position of the target layer, and the remaining position of the target layer can be determined as the second position, and then the data of the display image layer determined as the second placement data can be placed at the second position of the target layer.

[0116] After the area corresponding to the first position is determined, the second position may be located at any one of the top, bottom and both sides of the first position.

[0117] like Figure 5 As shown, in an embodiment of the present application, according to actual needs, the data of the transparency layer determined as the first placement data can be placed at the first position of the target layer, and the remaining position of the target layer can be determined as the second position, and then the data of the display image layer determined as the second placement data can be placed at the second position of the target layer; and the second position is located at the bottom of the first position.

[0118] like Figure 6 As shown, in an embodiment of the present application, according to actual needs, the data of the transparency layer determined as the first placement data can be placed at the first position of the target layer, and the remaining position of the target layer can be determined as the second position, and then the data of the display image layer determined as the second placement data can be placed at the second position of the target layer; and the second position is located on top of the first position.

[0119] Step S25: Transmitting data of the plurality of target layers.

[0120] Specifically, the transmitting of the data of the plurality of target layers includes:

[0121] Determine whether the data of each target layer needs to be compressed;

[0122] If the data of the target layer needs to be compressed, the data of the target layer is determined as the data to be compressed, and the data to be compressed is compressed to obtain compressed data, and then the compressed data is transmitted; or

[0123] If the data of the target layer does not need to be compressed, the data of the target layer is directly transmitted.

[0124] Furthermore, the determining whether the data of each target layer needs to be compressed includes:

[0125] Obtaining transmission parameters of data of each target layer;

[0126] Comparing the transmission parameter of each target layer's data with a transmission parameter threshold;

[0127] If the transmission parameter is greater than the transmission parameter threshold, the data of the target layer corresponding to the transmission parameter is determined as the data to be compressed;

[0128] Or if the transmission parameter is less than or equal to the transmission parameter threshold, the actual transmission power consumption of the data of the target layer is calculated, and the compressed transmission power consumption of the compressed data of the target layer is calculated; the actual transmission power consumption is compared with the compressed transmission power consumption; if the actual transmission power consumption is greater than the compressed transmission power consumption, the data of the target layer corresponding to the actual transmission power consumption is determined as the data to be compressed.

[0129] An optional embodiment of the present application obtains the resolution and frame rate of the data of the target layer, and based on the resolution and frame rate of the data of the target layer, calculates the actual bandwidth required to transmit the data of the target layer, that is, the transmission parameter, and compares the calculated actual bandwidth with the bandwidth threshold. If the actual bandwidth is greater than the bandwidth threshold, it means that the current bandwidth cannot support the transmission of the data of the target layer. Therefore, the data of the target layer needs to be compressed. When compressing, the data of the display image layer and the data of the transparency layer need to be compressed. The compression ratio is preset according to actual needs. After the compression of the data of the target layer is completed, the compressed data is obtained and transmitted.

[0130] For example, if the resolution is 4000*2000 and the 8-bit depth display image layer data, and the frame rate is 120fps, then the actual bandwidth required to transmit the display image layer data without compression is 23Gbps. If the data of the transparency layer with the same resolution and bit depth is added, the actual bandwidth required to transmit the target layer data will be even greater, for example: 46Gbps.

[0131] If the bandwidth threshold is 30 Gbps, then 30 Gbps < 46 Gbps, indicating that the bandwidth of the current data channel cannot support the transmission of the data of the target layer. Therefore, the data of the target layer needs to be compressed.

[0132] Generally, the lossless compression ratio can be less than 1 / 2. After compressing the data size of the target layer to 1 / 2 of the original size, the actual bandwidth required to transmit the compressed data is 23Gbps. 23Gbps<30Gbps. Therefore, the current data channel can transmit the compressed data after compression.

[0133] Furthermore, in an optional embodiment of the present application, the data of the target layer can be compressed based on a compression algorithm of image compression technology; for example: the data of the target layer can be compressed based on a DSC compression algorithm of a MIPI interface or a displayport interface.

[0134] In the embodiment of the present application, after obtaining the actual bandwidth required for data transmission of each target layer, the actual bandwidth corresponding to the data of each target layer is compared with the bandwidth threshold. If the actual bandwidth is greater than the bandwidth threshold, the data of the target layer is compressed to obtain compressed data, and the compressed data is transmitted, thereby realizing the simultaneous transmission and compression processing of the data of the matching display image layer and the data of the transparency layer. The operation is simple and easy to implement. At the same time, the bandwidth required for data transmission is saved, and the transmission rate and transmission efficiency are improved.

[0135] In an optional embodiment of the present application, if the transmission parameter is less than or equal to the transmission parameter threshold, the actual transmission power consumption of the data of the target layer is calculated, and the compressed transmission power consumption of the compressed data of the target layer is calculated;

[0136] For example, if the resolution is 4000*2000 and the 8-bit depth display image layer data, and the frame rate is 120fps, then the actual bandwidth required to transmit the display image layer data without compression is 23Gbps. If the data of the transparency layer with the same resolution and bit depth is added, the actual bandwidth required to transmit the target layer data will be even greater, for example: 46Gbps.

[0137] If the bandwidth threshold is 50 Gbps, 50 Gbps>46 Gbps, indicating that the bandwidth of the current data channel can support the transmission of the data of the target layer.

[0138] Then, the actual transmission power consumption of the data of the target layer is calculated, and the compressed transmission power consumption of the data of the compressed target layer is calculated;

[0139] Assuming that the actual transmission power consumption is M and the compressed transmission power consumption is N, if M>N, the data of the target layer needs to be compressed; or if M<N, the data of the target layer does not need to be compressed, and the data of the target layer can be directly transmitted based on the current data channel.

[0140] In an embodiment of the present application, when the actual bandwidth is less than or equal to the bandwidth threshold, the actual transmission power consumption of the data of the target layer is calculated, and the compressed transmission power consumption of the compressed data of the target layer is calculated; if the actual transmission power consumption is greater than the compressed transmission power consumption, the data of the target layer is compressed to obtain compressed data, and the compressed data is transmitted, thereby further saving the bandwidth required for data transmission and improving the transmission rate and transmission efficiency.

[0141] The embodiment of the present application further provides a data transmission device 70, comprising:

[0142] An acquisition module 71, used to acquire data of a display image layer and data of a transparency layer, and determine a plurality of groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer;

[0143] A construction module 72, constructing a target layer by using the display image layer and the transparency layer intentionally based on each group of the data to be superimposed;

[0144] A determination module 73, configured to determine first placement data and second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed;

[0145] A placement module 74, configured to place the first placement data at a first position of the corresponding target layer, and place the second placement data at a second position of the corresponding target layer, to obtain data of the corresponding target layer;

[0146] The transmission module 75 is used to transmit the data of the multiple target layers.

[0147] Optionally, the acquiring the data of the display image layer and the data of the transparency layer, and determining the data to be superimposed based on the data of the display image layer and the data of the transparency layer, includes:

[0148] Acquire a first matching parameter of the display image layer; and simultaneously acquire a second matching parameter of the data of the transparency layer;

[0149] Comparing the first matching parameter and the second matching parameter;

[0150] If the first matching parameter and the second matching parameter are consistent, the data of the display image layer corresponding to the first matching parameter and the data of the transparency layer matching the second matching parameter are obtained, and the data of the display image layer and the data of the transparency layer are determined as the data to be superimposed.

[0151] Optionally, constructing a target layer based on the display image layer and the transparency layer of each group of the data to be superimposed includes:

[0152] Obtaining a first parameter of the display image layer of each group of the data to be superimposed;

[0153] Obtain a second parameter of the transparency layer of each group of the data to be superimposed;

[0154] Obtaining construction parameters based on the first parameter and the second parameter of the data to be superimposed;

[0155] Based on the construction parameters, the target layer is constructed.

[0156] Optionally, the determining the first placement data and the second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed includes:

[0157] Determine the data of the display image layer as the first placement data; determine the data of the transparency layer as the second placement data;

[0158] Placing the data of the display image layer at the first position; placing the data of the transparency layer at the second position;

[0159] Wherein, the second position is determined according to the first position.

[0160] Optionally, the determining the first placement data and the second placement data of the corresponding target layer based on the data of the display image layer and the data of the transparency layer of each group of the data to be superimposed includes:

[0161] Determine the data of the transparency layer as the first placement data; determine the data of the display image layer as the second placement data;

[0162] Placing the data of the transparency layer at the first position; placing the data of the display image layer at the second position;

[0163] Wherein, the second position is determined according to the first position.

[0164] Optionally, transmitting the data of the plurality of target layers includes:

[0165] Determine whether the data of each target layer needs to be compressed;

[0166] If the data of the target layer needs to be compressed, the data of the target layer is determined as the data to be compressed, and the data to be compressed is compressed to obtain compressed data, and then the compressed data is transmitted; or

[0167] If the data of the target layer does not need to be compressed, the data of the target layer is directly transmitted.

[0168] Optionally, the determining whether the data of each target layer needs to be compressed includes:

[0169] Obtaining transmission parameters of data of each target layer;

[0170] Comparing the transmission parameter of each target layer's data with a transmission parameter threshold;

[0171] If the transmission parameter is greater than the transmission parameter threshold, the data of the target layer corresponding to the transmission parameter is determined as the data to be compressed;

[0172] Or if the transmission parameter is less than or equal to the transmission parameter threshold, the actual transmission power consumption of the data of the target layer is calculated, and the compressed transmission power consumption of the compressed data of the target layer is calculated; the actual transmission power consumption is compared with the compressed transmission power consumption; if the actual transmission power consumption is greater than the compressed transmission power consumption, the data of the target layer corresponding to the actual transmission power consumption is determined as the data to be compressed.

[0173] An embodiment of the present application further provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the method as described above when executing the computer program.

[0174] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the method described above.

[0175] In addition, other structures and functions of the device of the embodiment of the present application are known to those skilled in the art and will not be described in detail here to reduce redundancy.

[0176] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0177] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0178] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0179] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0180] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0181] In this application, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0182] In the present application, unless otherwise clearly specified and limited, a first feature being “above” or “below” a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being “above”, “above”, and “above” a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being “below”, “below”, and “below” a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0183] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A data transmission method, characterized in that: include: Acquire data of a display image layer and data of a transparency layer, and determine multiple groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer; Constructing a target layer based on the display image layer and the transparency layer of each group of the data to be superimposed; For each group of the data of the display image layer and the data of the transparency layer of the data to be superimposed, respectively determining the data of the display image layer and the data of the transparency layer as the first placement data or the second placement data of the corresponding target layer; Placing the first placement data at a first position of the corresponding target layer, and placing the second placement data at a second position of the corresponding target layer, to obtain data of the corresponding target layer, wherein the second position is located at any one side of the top, bottom, left, and right of the first position; Transmitting data of a plurality of target layers; The transmitting of the data of the plurality of target layers comprises: Obtain the resolution and frame rate of the data of the target layer, and calculate the actual bandwidth required to transmit the data of the target layer based on the DPU according to the resolution and the frame rate to obtain transmission parameters; Comparing the transmission parameter with a transmission parameter threshold to determine whether the data of the target layer needs to be compressed; If the transmission parameter is greater than the transmission parameter threshold, it is determined that the data of the target layer needs to be compressed, the data of the target layer is compressed based on the DPU, compressed data is obtained, and the compressed data is transmitted.

2. The method according to claim 1, characterized in that The acquiring the data of the display image layer and the data of the transparency layer, and determining the data to be superimposed based on the data of the display image layer and the data of the transparency layer, comprises: Acquire a first matching parameter of the display image layer; and simultaneously acquire a second matching parameter of the data of the transparency layer; Comparing the first matching parameter and the second matching parameter; If the first matching parameter and the second matching parameter are consistent, the data of the display image layer corresponding to the first matching parameter and the data of the transparency layer matching the second matching parameter are obtained, and the data of the display image layer and the data of the transparency layer are determined as the data to be superimposed.

3. The method according to claim 1, characterized in that The step of constructing a target layer based on the display image layer and the transparency layer of each group of the data to be superimposed comprises: Obtaining a first parameter of the display image layer of each group of the data to be superimposed; Obtain a second parameter of the transparency layer of each group of the data to be superimposed; Obtaining construction parameters based on the first parameter and the second parameter of the data to be superimposed; Based on the construction parameters, the target layer is constructed.

4. The method according to claim 1, characterized in that: The step of determining the data of the display image layer and the data of the transparency layer as first placement data or second placement data of the corresponding target layer respectively includes: Determine the data of the display image layer as the first placement data; determine the data of the transparency layer as the second placement data; Wherein, the second position is determined according to the first position.

5. The method according to claim 1, characterized in that The step of determining the data of the display image layer and the data of the transparency layer as first placement data or second placement data of the corresponding target layer respectively includes: Determine the data of the transparency layer as the first placement data; determine the data of the display image layer as the second placement data; Wherein, the second position is determined according to the first position.

6. The method according to claim 1, characterized in that After comparing the transmission parameter with the transmission parameter threshold to determine whether the data of the target layer needs to be compressed, the method further includes: If the data of the target layer does not need to be compressed, the data of the target layer is directly transmitted.

7. The method according to claim 1, characterized in that After comparing the transmission parameter with the transmission parameter threshold to determine whether the data of the target layer needs to be compressed, the method further includes: If the transmission parameter is less than or equal to the transmission parameter threshold, the actual transmission power consumption of the data of the target layer is calculated, and the compressed transmission power consumption of the compressed data of the target layer is calculated; the actual transmission power consumption is compared with the compressed transmission power consumption; if the actual transmission power consumption is greater than the compressed transmission power consumption, the data of the target layer corresponding to the actual transmission power consumption is determined as the data to be compressed, and the data to be compressed is transmitted.

8. A data transmission device, characterized in that: include: An acquisition module, used for acquiring data of a display image layer and data of a transparency layer, and determining a plurality of groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer; A construction module, constructing a target layer by intentionally using the display image layer and the transparency layer based on each group of the data to be superimposed; a determination module, configured to determine, for each group of the data of the display image layer and the data of the transparency layer of the data to be superimposed, the data of the display image layer and the data of the transparency layer as first placement data or second placement data of the corresponding target layer; a placement module, used for placing the first placement data at a first position of the corresponding target layer, and placing the second placement data at a second position of the corresponding target layer, to obtain data of the corresponding target layer, wherein the second position is located at any one side of the top, bottom, left, and right of the first position; A transmission module, used for transmitting data of a plurality of target layers; The transmitting of the data of the plurality of target layers comprises: Obtain the resolution and frame rate of the data of the target layer, and calculate the actual bandwidth required to transmit the data of the target layer based on the DPU according to the resolution and the frame rate to obtain transmission parameters; Comparing the transmission parameter with a transmission parameter threshold to determine whether the data of the target layer needs to be compressed; If the transmission parameter is greater than the transmission parameter threshold, it is determined that the data of the target layer needs to be compressed, the data of the target layer is compressed based on the DPU, compressed data is obtained, and the compressed data is transmitted.

9. A data transmission system, characterized in that: include: A first chip, the first chip comprising a GPU, a DPU and a first interface that are communicatively connected; The GPU is used to obtain data of a display image layer and data of a transparency layer, and determine multiple groups of data to be superimposed based on the data of the display image layer and the data of the transparency layer; Based on the display image layer and the transparency layer of each group of the data to be superimposed, a target layer is constructed; for each group of the data of the display image layer and the data of the transparency layer of the data to be superimposed, the data of the display image layer and the data of the transparency layer are respectively determined as the first placement data or the second placement data of the corresponding target layer; Place the first placement data at a first position of the target layer, and place the second placement data at a second position of the target layer, obtain data of each target layer, the second position being located at any one of the top, bottom, left, and right sides of the first position; and send the data of the plurality of target layers to the first interface based on the DPU; a second chip, the second chip being used to receive data of the plurality of target layers sent by the first chip through the first interface; The sending the data of the plurality of target layers to the first interface based on the DPU includes: Obtaining the resolution and frame rate of the data of the target layer, and calculating the actual bandwidth required to transmit the data of the target layer based on the DPU according to the resolution and the frame rate, to obtain transmission parameters; Comparing the transmission parameter with a transmission parameter threshold to determine whether the data of the target layer needs to be compressed; If the transmission parameter is greater than the transmission parameter threshold, it is determined that the data of the target layer needs to be compressed, the data of the target layer is compressed based on the DPU, compressed data is obtained, and the compressed data is transmitted.

10. An electronic device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the method according to any one of claims 1 to 7 when executing the computer program.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 7.

Images