Data transmission method and device, computer device, medium and product
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- GRAVITYXR ELECTRONICS & TECH CO LTD
- Filing Date
- 2024-12-17
- Publication Date
- 2026-06-26
Smart Images
Figure CN122293902A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of transmission technology, and more specifically, to a data transmission method, apparatus, computer equipment, medium, and product. Background Technology
[0002] Transmitting high-resolution and high-frame-rate images dominates data transmission in XR (Extended Reality) devices, especially in the mixed reality domain. The alpha layer (transparency layer or alpha channel) of the displayed image layer defines object edges and transparency transitions, which are crucial for the interaction of virtual objects with the real environment and for depth perception. Therefore, accurately transmitting alpha channel information is essential for achieving realistic rendering and compositing effects.
[0003] Currently, in the transmission of display image layers between chips, the transmission of Alpha layer information is mainly carried out through a separate path set up for PCIe (Peripheral Component Interconnect Express) or USB (Universal Serial Bus), or by setting up a separate MIPI (Mobile Industry Processor Interface) signal in addition to the RGB layer information of the corresponding display image.
[0004] However, due to network instability or the setting of independent channels, the transmission efficiency of Alpha layer information in the display image layer transmission is low. Summary of the Invention
[0005] The main objective of this application is to provide a data transmission method, apparatus, computer equipment, medium, and product that can improve the transmission efficiency of Alpha layer information in the transmission of displayed image layers.
[0006] To achieve the above objectives, firstly, this application provides a data transmission method, comprising:
[0007] Get the display image layer, which includes a transparency layer and a color layer;
[0008] The transparency layer of the displayed image layer is divided into several parts, and the size of the divided transparency layer is an integer multiple of the number of color layers.
[0009] The divided transparency layers are mapped and composited to obtain M first RGB images, where M is an integer greater than 1;
[0010] The first RGB images (M images) are stitched together with the second RGB images (composed of color layers) to obtain the target RGB image, and the target RGB image is then transmitted.
[0011] In one embodiment, before dividing the transparency layer of the displayed image layer to obtain the divided transparency layer, the method further includes:
[0012] Get the size of the transparency layer of the displayed image layer;
[0013] Determine if the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers.
[0014] In one embodiment, the transparency layer of the displayed image layer is divided to obtain a divided transparency layer, including:
[0015] If the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers;
[0016] Obtain the preset division method, which includes horizontal division method and vertical division method;
[0017] The transparency layer of the display image layer can be divided into N equal parts according to the horizontal or vertical division method, resulting in N transparency sub-layers, where N is a multiple of 3. The horizontal or vertical division method dynamically adjusts the division ratio according to the uniformity of the transparency distribution.
[0018] The resulting transparency layer consists of N transparency sublayers.
[0019] In one embodiment, after determining whether the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers, the method further includes:
[0020] If the size of the transparency layer of the displayed image layer is not an integer multiple of the number of color layers;
[0021] Zero-fill the transparency layer of the displayed image layer until the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers, and then obtain a new transparency layer of the displayed image layer.
[0022] In one embodiment, the transparency layer of the displayed image layer is divided to obtain a divided transparency layer, including:
[0023] When the transparency layer of the displayed image layer is the new transparency layer of the displayed image layer, obtain the preset division method, which includes a horizontal division method and a vertical division method.
[0024] The transparency layer of the new display image layer is divided into N equal parts according to the horizontal or vertical division method, resulting in N transparency sub-layers, where N is a multiple of 3;
[0025] The resulting transparency layer consists of N transparency sublayers.
[0026] In one embodiment, the divided transparency layers are mapped and composited to obtain M first RGB images, including:
[0027] For three transparency sublayers derived from any transparency layer among N transparency sublayers;
[0028] By performing layer mapping on the three sub-layers of transparency obtained from any transparency layer, we get the R layer, G layer, and B layer.
[0029] The pixels of the R, G, and B layers are superimposed according to color weights, and tone smoothing correction is performed during the superposition process to generate the first RGB image;
[0030] Summarize all the generated first RGB images to obtain M first RGB images.
[0031] In one embodiment, the target RGB image is obtained by concatenating M first RGB images with a second RGB image composed of color layers, including:
[0032] The target RGB image is obtained by stitching M first RGB images with a second RGB image composed of color layers in a horizontal or vertical stitching manner.
[0033] And / or,
[0034] The target RGB image is obtained by pixel-by-pixel overlay and edge correction of the second RGB image composed of M first RGB images and color layers.
[0035] In one embodiment, the method further includes:
[0036] During the stitching process, the edges of the stitching boundary area are smoothed based on the transparency and color gradient of the adjacent images.
[0037] In one embodiment, the method further includes:
[0038] The target RGB image is transmitted to the receiving end so that the receiving end can restore the target RGB image to the display image layer.
[0039] In one embodiment, different color layer data of the target RGB image are transmitted in parallel.
[0040] Secondly, embodiments of this application provide a data transmission apparatus, including:
[0041] The acquisition module is used to acquire the display image layer, which includes a transparency layer and a color layer;
[0042] The layer division module is used to divide the transparency layer of the displayed image layer to obtain the divided transparency layer. The size of the divided transparency layer is an integer multiple of the number of color layers.
[0043] The layer compositing module is used to map and composite the divided transparency layers to obtain M first RGB images, where M is an integer greater than 1;
[0044] The data transmission module is used to stitch together M first RGB images with a second RGB image composed of color layers to obtain a target RGB image, and then transmit the target RGB image.
[0045] Thirdly, embodiments of this application provide a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of any of the methods described above.
[0046] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of any of the methods described above.
[0047] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the steps of any of the methods described above.
[0048] This application provides a data transmission method, apparatus, computer equipment, medium, and product. By performing operations such as segmentation, mapping, and compositing on the transparency layer included in the display image layer during transmission, this application optimizes the transmission method of transparency layer information, thereby improving the efficiency, stability, and reliability of transparency layer information transmission. Furthermore, this application stitches together M first RGB images determined by the processed transparency layer with a second RGB image composed of color layers included in the display image layer to obtain a target RGB image, and then transmits the target RGB image. This ensures that the transparency layer information and color layer information are transmitted synchronously, avoiding image quality degradation caused by asynchrony between the transparency layer information and color layer information, as well as the loss of transparency layer information during transmission. This guarantees the integrity of the target RGB image transmission, thereby ensuring the accuracy and precision of the display image layer reconstruction based on the target RGB image at the receiving end. Attached Figure Description
[0049] The accompanying drawings, which form part of this application, are used to provide a further understanding of the application and to make other features, objects, and advantages of the application more apparent. The illustrative embodiments and descriptions of this application are used to explain the application and do not constitute an undue limitation of the application. In the drawings:
[0050] Figure 1 This is an application scenario diagram of a data transmission method provided in an embodiment of this application;
[0051] Figure 2 This is a flowchart illustrating a data transmission method provided in an embodiment of this application;
[0052] Figure 3 This is a flowchart illustrating another data transmission method provided in an embodiment of this application;
[0053] Figure 4 This is a flowchart illustrating another data transmission method provided in an embodiment of this application;
[0054] Figure 5 This is a schematic diagram of an RGBA image set provided in an embodiment of this application;
[0055] Figure 6 This is a schematic diagram of the signal-to-noise ratio comparison chart provided in the embodiments of this application;
[0056] Figure 7 This is a schematic diagram of the structure of a data transmission device provided in an embodiment of this application;
[0057] Figure 8 This is a schematic diagram of the computer device provided in the embodiments of this application. Detailed Implementation
[0058] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.
[0059] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein.
[0060] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.
[0061] It should be understood that in the various embodiments of this application, the sequence number of each process does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0062] It should be understood that in this application, "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product or device.
[0063] It should be understood that in this application, "multiple" refers to two or more. "And / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, "and / or B" can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "Contains A, B, and C", "Contains A, B, and C" means that all three A, B, and C are contained; "Contains A, B, or C" means that one of A, B, and C is contained; "Contains A, B, and / or C" means that any one, two, or three of A, B, and C are contained.
[0064] It should be understood that in this application, "B corresponding to A", "B corresponding to A", "A corresponds to B", or "B corresponds to A" means that B is associated with A, and B can be determined based on A. Determining B based on A does not mean determining B solely based on A; B can also be determined based on A and / or other information. Matching A and B is defined as a similarity between A and B that is greater than or equal to a preset threshold.
[0065] Depending on the context, "if" as used here can be interpreted as "when," "when," "in response to determination," or "in response to detection."
[0066] The data involved in this application may be data authorized by the tester or fully authorized by all parties. The collection, dissemination, and use of the data shall comply with the relevant laws, regulations and standards of the relevant countries and regions. The implementation methods / executives of this application may be combined with each other.
[0067] The technical solutions of this application will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.
[0068] Please see Figure 1 , Figure 1 This diagram illustrates an application scenario of a data transmission method provided in an embodiment of this application. Figure 1 As shown, it includes:
[0069] Figure 1 This includes a SoC (System-on-a-Chip) and a co-processor. This data transfer is an image data transfer between the SoC and the co-processor, such as displaying image layer data transfer.
[0070] The specific transmission process is as follows:
[0071] Step 1: The GPU (Graphics Processing Unit) in the chip SoC renders the image and outputs each frame of the displayed image layer to the DPU (Data Processing Unit).
[0072] Step 2: The DPU in the chip SoC acquires the display image layer, which includes a transparency layer and a color layer. Then, the transparency layer of the display image layer is divided to obtain the divided transparency layer. The divided transparency layer is then mapped and composited to obtain M first RGB images, where M is an integer greater than 1. Finally, the M first RGB images are stitched together with the second RGB image composed of the color layer to obtain the target RGB image.
[0073] Step 3: The DPU in the chip SoC converts the target RGB image into a format supported by DSC (Digital Signal Compression) to obtain a DSC compressed image, which is the compressed target RGB image.
[0074] Step 4: The chip SoC transmits the compressed target RGB image to the co-processor via MIPIDSI (Display Serial Interface).
[0075] Step 5: After receiving the compressed target RGB image, the co-processor performs DSC decompression on the compressed target RGB image to restore it to the target RGB image.
[0076] Step 6: The co-processor restores the target RGB image to the display image layer by performing the inverse transformation of step 2.
[0077] Step 7: The co-processor will compress the image layers by tiles and store them in DDR memory.
[0078] Step 8: The DPU reads the encoded data from the DDR (Double Data Rate) memory, decompresses the tiles, and restores the displayed image layers.
[0079] Please see Figure 2 , Figure 2 This is a flowchart illustrating a data transmission method provided in an embodiment of this application. Applied to... Figure 1 The DPU in the process includes the following steps:
[0080] Step S201: Obtain the display image layer.
[0081] The image layer includes a transparency layer and a color layer.
[0082] The display image layer is, for example, an RGBA layer. The display image layer contains multiple pixels, and each pixel corresponds to a transparency layer and a color layer. The color layer is the RGB layer, which includes an R (Red) layer, a G (Green) layer, and a B (Blue) layer.
[0083] Step S202: Divide the transparency layer of the displayed image layer to obtain the divided transparency layer.
[0084] The size of the resulting transparency layer must be an integer multiple of the number of color layers.
[0085] Before dividing the transparency layer of the display image layer to obtain the divided transparency layer, the process also includes: obtaining the size of the transparency layer of the display image layer, and then determining whether the size of the transparency layer of the display image layer is an integer multiple of the number of color layers.
[0086] After obtaining the transparency layer of the displayed image layer, you need to first obtain the size of the transparency layer of the displayed image layer, such as the width and height of the transparency layer of the displayed image layer.
[0087] If the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers, then the transparency layer of the displayed image layer can be directly divided to obtain the divided transparency layers.
[0088] The process of dividing the transparency layer of the displayed image layer to obtain the divided transparency layer includes: obtaining a preset division method, wherein the preset division method includes a horizontal division method and a vertical division method; dividing the transparency layer of the displayed image layer into N equal parts according to the horizontal division method or the vertical division method to obtain N transparency sub-layers, wherein N is a multiple of 3; and forming the divided transparency layer by the N transparency sub-layers.
[0089] The horizontal or vertical division method dynamically adjusts the division ratio based on the uniformity of the transparency distribution.
[0090] Since the color layer includes R, G, and B layers, its number is 3. If either the width or height of the transparency layer of the displayed image layer is divisible by 3, the transparency layer of the displayed image layer can be divided to obtain the divided transparency layers.
[0091] like Figure 3 As shown, the height of the transparency layer of the displayed image layer is 13cm and the width is 12cm. Therefore, the width of the transparency layer is 3 times 4. Thus, the transparency layer can be divided vertically into four equal parts of 3. Each set of three transparency sub-layers constitutes one RGB image, resulting in four RGB images.
[0092] If the size of the transparency layer of the displayed image layer is not an integer multiple of the number of color layers, then the transparency layer of the displayed image layer needs to be zero-filled until the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers, and a new transparency layer of the displayed image layer is obtained.
[0093] The process of dividing the transparency layer of the displayed image layer to obtain the divided transparency layer includes: when the transparency layer of the displayed image layer is the transparency layer of the new displayed image layer, obtaining a preset division method, wherein the preset division method includes a horizontal division method and a vertical division method; dividing the transparency layer of the new displayed image layer into N equal parts according to the horizontal division method or the vertical division method, obtaining N transparency sub-layers, wherein N is a multiple of 3; and forming the divided transparency layer by the N transparency sub-layers.
[0094] If the width and height of the transparency layer of the displayed image layer are not integer multiples of the number of color layers, the transparency layer of the displayed image layer cannot be divided equally. In this case, zero-filling is required for the width and / or height of the transparency layer of the displayed image layer. Zero-filling means expanding the size of the layer on the transparency layer and assigning zero-value pixels to the expanded portion.
[0095] like Figure 4 As shown, the height of the transparency layer of the displayed image layer is 13cm and the width is 14cm. It can be seen that neither the width nor the height of the transparency layer is a multiple of 3. Therefore, at least one of the width and height can be zero-filled depending on the specific situation. For example, the width of the transparency layer of the displayed image layer can be zero-filled and filled to 15cm to obtain the filled transparency layer. At this time, the width of the filled transparency layer is a multiple of 3. The filled transparency layer can then be divided into 5 equal parts of 3 vertically. Each 3 transparency sub-layers constitute an RGB image, and the 5 RGB images form the divided transparency layer.
[0096] It should be noted that if the width and height of the transparency layer of the displayed image layer are both integer multiples of the number of color layers, then the horizontal or vertical division method can be arbitrarily selected to divide the transparency layer of the displayed image layer into N equal parts, depending on the specific situation.
[0097] Furthermore, this application also includes a method for dynamically adjusting the division of transparency layers based on image resolution, pixel alignment, and display requirements. Specifically, for transparency layers with non-standard resolutions, zero-fill or edge interpolation is used to ensure the uniformity of the sub-layers after division. Additionally, a dynamic division strategy is introduced, assigning different division weights according to the importance of transparency information to improve the transmission of details in high-transparency areas.
[0098] In addition, the transparency layer and color channel (RGB layer) in this application are spliced together to adapt to specific display devices (such as HDR display or high refresh rate XR device).
[0099] When transmitting a display image layer, this application can automatically zero-padded the width and / or height of the transparency layer based on its width and / or height, allowing the segmentation of the transparency layer to adapt to images of various sizes. Furthermore, by dynamically adjusting the segmentation step size and stitching method, this application can optimize the transmission strategy under different network conditions, thereby improving the stability and reliability of display image layer transmission.
[0100] Step S203: Map and composite the divided transparency layers to obtain M first RGB images.
[0101] Where M is an integer greater than 1.
[0102] The process involves mapping and compositing the divided transparency layers to obtain M first RGB images. First, three transparency sub-layers derived from any transparency layer are taken from the N transparency sub-layers. Then, these three transparency sub-layers are mapped to obtain R layer, G layer, and B layer. Next, the pixels of R layer, G layer, and B layer are superimposed according to color weights, and tone smoothing correction is performed during the superposition process to generate the first RGB images. Finally, all the generated first RGB images are combined to obtain M first RGB images.
[0103] Since the displayed image layer includes multiple pixels, and each pixel corresponds to a transparency layer and a color layer, and this application further divides each transparency layer, there are also multiple transparency layers after the division.
[0104] Suppose there are N transparency layers after the division (i.e., N transparency sub-layers), and N = 3M. Then, perform layer mapping for every three transparency sub-layers, that is, map them to R layer, G layer and B layer respectively. Then, combine the mapped R layer, G layer and B layer into a first RGB image.
[0105] By mapping and compositing all N transparency sublayers, we can obtain M first RGB images.
[0106] Based on the above layer mapping methods, the layer mapping method of this application also includes multi-dimensional mapping of the transparency sublayer (e.g., color space mapping + geometric correction) to reduce information loss caused by non-linear transformation, and / or, using dynamic tone mapping (DTM) technology to optimize brightness and color performance when synthesizing RGB images and improve visual effects.
[0107] Step S204: Concatenate the M first RGB images with the second RGB image composed of color layers to obtain the target RGB image, and transmit the target RGB image.
[0108] To obtain a target RGB image by stitching M first RGB images with a second RGB image composed of color layers, the M first RGB images and the second RGB image composed of color layers need to be stitched together in either a horizontal or vertical manner.
[0109] And / or,
[0110] The target RGB image is obtained by pixel-by-pixel overlay and edge correction of the second RGB image composed of M first RGB images and color layers.
[0111] Horizontal stitching refers to combining multiple first RGB images with second RGB images horizontally to form a wider image. Vertical stitching refers to combining multiple first RGB images with second RGB images vertically to form a taller image. Furthermore, during the stitching process, edge smoothing is applied to the stitching boundary area based on the transparency and color gradient of adjacent images.
[0112] like Figure 3 As shown, the transparency layer and color layer of any pixel in the image layer are displayed. The width of the transparency layer is 9, which is an integer multiple of 3. The transparency layer can be divided into 3 equal parts to obtain 3 transparency sub-layers.
[0113] Then, the three obtained transparency sublayers are mapped to R layer, G layer, and B layer respectively. Finally, the mapped R layer, G layer, and B layer are merged into a first RGB image.
[0114] Once the first RGB image of a pixel is obtained, the other pixels can be processed in the same way as the pixels described above, and the first RGB images of the other pixels can also be obtained.
[0115] If the first RGB image of all the obtained pixels is M, then the M first RGB images can be stitched together with the second RGB image composed of color layers. The stitching method can be vertical or horizontal, which can be selected according to the specific situation.
[0116] Images stitched together horizontally or vertically constitute the target RGB image.
[0117] Based on the above-mentioned splicing methods, the splicing methods of this application also include: a content-aware splicing method, which selects horizontal or vertical splicing by analyzing the data characteristics of the color layer and the transparency layer, and / or performs edge smoothing processing on the transparency layer and the color layer after splicing to reduce visual artifacts that may be generated during the splicing process (such as edge breaks or abrupt color transitions).
[0118] This application stitches together a first RGB image and a second RGB image, enabling the synchronous transmission of transparency information and color information. This avoids the image quality degradation caused by the asynchrony between the transparency channel and the RGB channel. Transparency information is not lost during transmission, ensuring the integrity of the final image and thus guaranteeing high-precision image restoration at the receiving end.
[0119] In one embodiment, the method further includes: transmitting the target RGB image to a receiving end so that the receiving end restores the target RGB image to a display image layer.
[0120] After receiving the target RGB image, the receiving end in this application will restore the received target RGB image to the display image layer in the reverse manner of steps S201-S204. The specific steps will not be described in detail.
[0121] In one embodiment, different color layer data of the target RGB image are transmitted in parallel.
[0122] Since the target RGB image includes an R layer, a G layer, and a B layer, the data of the three layers can be transmitted in their respective channels. That is, the R layer data is transmitted in the R channel, the G layer data is transmitted in the G channel, and the B layer data is transmitted in the B channel. Moreover, the data of the three layers can be transmitted simultaneously in parallel. This not only saves data transmission time but also ensures the integrity of data transmission.
[0123] Furthermore, compared to existing technologies that map ARGB format data to RGB format data before transmitting it to the receiving end, and then the receiving end reverse-maps the RGB format data back to ARGB format data, this application divides the transparency layer of the display image layer to obtain the divided transparency layer. Then, it maps and composites the divided transparency layer to obtain M RGB images. These M RGB images are then stitched together with the RGB image composed of color layers to obtain the target RGB image. This target RGB image is then transmitted to the receiving end, allowing the receiving end to restore the target RGB image to the display image layer.
[0124] Existing technologies convert display image layers into RGB images in the data dimension. Taking an RGBA image layer as an example, the specifics are as follows:
[0125] 1. Convert to a one-dimensional vector:
[0126] Flatten the original (height, width, 4) shape of the display image layer into a one-dimensional vector with a length of height*width*4, containing the RGBA data of all pixels.
[0127] 2. Rearrangement and reshape:
[0128] The flattened vector is reshaped into a new three-channel RGB structure (height, 4 / 3*width, 3), that is, every four channels of data are recombined into three channels, and the original RGB data is replaced in the new width 4 / 3*width.
[0129] Figure 5This application contains a collection of RGBA images, including RGBA images with effects such as transparency, blurring, light refraction, and shadow.
[0130] like Figure 6 , Figure 5 The RGBA images in the RGBA image set shown are processed by mapping, compositing, and stitching the divided transparency layers to form RGB images using the scheme of this application. The signal-to-noise ratio of the RGBA images is SINR1 after the RGB images are compressed and transmitted by DSC and then reverse-constructed.
[0131] The comparison is based on the existing technology that converts an RGBA image into an RGB image in the data dimension, then compresses the RGB image through DSC and transmits it, and then reverse-engineers the RGBA image, resulting in a signal-to-noise ratio of SINR2.
[0132] like Figure 6 As shown, the RGBA image obtained by this application can significantly improve the signal-to-noise ratio and make the image clearer compared with the prior art, regardless of effects such as transparency, blurring, light refraction and shadow.
[0133] This application provides a data transmission method. By performing operations such as segmentation, mapping, and compositing on the transparency layer included in the display image layer during transmission, this method optimizes the transmission of transparency layer information, thereby improving the efficiency, stability, and reliability of transparency layer information transmission. Furthermore, this application stitches together M first RGB images determined by the processed transparency layer with a second RGB image composed of color layers included in the display image layer to obtain a target RGB image, which is then transmitted synchronously. This ensures that the transparency layer information and color layer information are transmitted synchronously, avoiding image quality degradation caused by asynchrony between the two information, as well as the loss of transparency layer information during transmission. This guarantees the integrity of the target RGB image transmission, thereby ensuring the accuracy and precision of the display image layer reconstruction based on the target RGB image at the receiving end.
[0134] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0135] The following are device embodiments of this application. For details not described in detail, please refer to the corresponding method embodiments described above.
[0136] Figure 7A schematic diagram of a data transmission device according to an embodiment of this application is shown. For ease of explanation, only the parts related to the embodiment of this application are shown. The data transmission device includes an acquisition module 701, a layer division module 702, a layer compositing module 703, and a data transmission module 707, as detailed below:
[0137] The acquisition module 701 is used to acquire the display image layer, wherein the display image layer includes a transparency layer and a color layer;
[0138] The layer division module 702 is used to divide the transparency layer of the displayed image layer to obtain the divided transparency layer. The size of the divided transparency layer satisfies an integer multiple of the number of color layers.
[0139] The layer compositing module 703 is used to map and composite the divided transparency layers to obtain M first RGB images, where M is an integer greater than 1;
[0140] The data transmission module 707 is used to stitch together M first RGB images with a second RGB image composed of color layers to obtain a target RGB image, and then transmit the target RGB image.
[0141] In one embodiment, before the layer division module 702, a determination module is further included, which is used to obtain the size of the transparency layer of the displayed image layer;
[0142] Determine if the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers.
[0143] In one embodiment, the layer division module 702 is further configured to, if the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers;
[0144] Obtain the preset division method, which includes horizontal division method and vertical division method;
[0145] The transparency layer of the display image layer can be divided into N equal parts according to the horizontal or vertical division method, resulting in N transparency sub-layers, where N is a multiple of 3. The horizontal or vertical division method dynamically adjusts the division ratio according to the uniformity of the transparency distribution.
[0146] The resulting transparency layer consists of N transparency sublayers.
[0147] In one embodiment, after the determination module, a filling module is further included, which is used to determine if the size of the transparency layer of the displayed image layer is not an integer multiple of the number of color layers.
[0148] Zero-fill the transparency layer of the displayed image layer until the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers, and then obtain a new transparency layer of the displayed image layer.
[0149] In one embodiment, the layer division module 702 is further configured to obtain a preset division method when the transparency layer of the displayed image layer is a new transparency layer of the displayed image layer, wherein the preset division method includes a horizontal division method and a vertical division method.
[0150] The transparency layer of the new display image layer is divided into N equal parts according to the horizontal or vertical division method, resulting in N transparency sub-layers, where N is a multiple of 3;
[0151] The resulting transparency layer consists of N transparency sublayers.
[0152] In one embodiment, the layer composition module 703 is further configured to target three transparency sublayers derived from any transparency layer among N transparency sublayers;
[0153] By performing layer mapping on the three sub-layers of transparency obtained from any transparency layer, we get the R layer, G layer, and B layer.
[0154] The pixels of the R, G, and B layers are superimposed according to color weights, and tone smoothing correction is performed during the superposition process to generate the first RGB image;
[0155] Summarize all the generated first RGB images to obtain M first RGB images.
[0156] In one embodiment, the data transmission module 707 is further configured to stitch M first RGB images with a second RGB image composed of color layers in a horizontal or vertical stitching manner to obtain a target RGB image;
[0157] And / or,
[0158] The target RGB image is obtained by pixel-by-pixel overlay and edge correction of the second RGB image composed of M first RGB images and color layers.
[0159] In one embodiment, the apparatus further includes a smoothing module, which is used to perform edge smoothing processing on the stitching boundary area according to the transparency and color gradient of adjacent images during the stitching process.
[0160] In one embodiment, the apparatus further includes a restoration module, which transmits the target RGB image to the receiving end so that the receiving end restores the target RGB image to a display image layer.
[0161] In one embodiment, different color layer data of the target RGB image are transmitted in parallel.
[0162] This application provides a data transmission device. By performing operations such as segmentation, mapping, and compositing on the transparency layer included in the display image layer during transmission, this application optimizes the transmission method of transparency layer information, thereby improving the efficiency, stability, and reliability of transparency layer information transmission. This application also stitches together M first RGB images determined by the processed transparency layer with a second RGB image composed of color layers included in the display image layer to obtain a target RGB image, and transmits the target RGB image. This ensures that the transparency layer information and color layer information are transmitted synchronously, avoiding image quality degradation caused by asynchrony between the transparency layer information and color layer information, as well as the loss of transparency layer information during transmission. This guarantees the integrity of the target RGB image transmission, thereby ensuring the accuracy and precision of the display image layer reconstruction based on the target RGB image at the receiving end.
[0163] This application Figure 8 A schematic diagram of a computer device is provided. (Example) Figure 8 As shown, the computer device 8 in this embodiment includes a processor 801, a memory 802, and a computer program 803 stored in the memory 802 and executable on the processor 801. When the processor 801 executes the computer program 803, it implements the steps in the various data transmission method embodiments described above, for example... Figure 2 Steps 201 to 204 are shown. Alternatively, when processor 801 executes computer program 803, it implements the functions of each module / unit in the above-described embodiments of the data transmission device, for example... Figure 7 The functions of modules / units 701 to 704 shown.
[0164] This application also provides a readable storage medium storing a computer program, which, when executed by a processor, is used to implement the data transmission methods provided in the various embodiments described above.
[0165] The readable storage medium can be a computer storage medium or a communication medium. A communication medium includes any medium that facilitates the transfer of computer programs from one location to another. A computer storage medium can be any available medium accessible to a general-purpose or special-purpose computer. For example, a readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application-Specific Integrated Circuit (ASIC). Alternatively, the ASIC can be located in a user device. Of course, the processor and the readable storage medium can also exist as discrete components in a communication device. The readable storage medium can be a read-only memory (ROM), random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0166] This application also provides a computer program product including executable instructions stored in a readable storage medium. At least one processor of the device can read the executable instructions from the readable storage medium, and the execution of the executable instructions by the at least one processor causes the device to implement the data transmission methods provided in the various embodiments described above.
[0167] In the embodiments of the above-described device, it should be understood that the processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this application can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.
[0168] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.
Claims
1. A data transmission method, characterized in that, include: Obtain a display image layer, wherein the display image layer includes a transparency layer and a color layer; The transparency layer of the displayed image layer is divided to obtain a divided transparency layer, and the size of the divided transparency layer satisfies an integer multiple of the number of color layers; The divided transparency layers are mapped and composited to obtain M first RGB images, where M is an integer greater than 1; The M first RGB images are stitched together with the second RGB image composed of the color layers to obtain the target RGB image, and the target RGB image is transmitted.
2. The data transmission method according to claim 1, characterized in that, Before dividing the transparency layer of the displayed image layer to obtain the divided transparency layer, the method further includes: Obtain the size of the transparency layer of the displayed image layer; Determine whether the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers.
3. The data transmission method according to claim 2, characterized in that, The step of dividing the transparency layer of the displayed image layer to obtain the divided transparency layer includes: If the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers; Obtain a preset division method, wherein the preset division method includes a horizontal division method and a vertical division method; The transparency layer of the displayed image layer is divided into N equal parts according to the horizontal or vertical division method to obtain N transparency sub-layers, where N is a multiple of 3. The horizontal or vertical division method dynamically adjusts the division ratio according to the uniformity of the transparency distribution. The divided transparency layer is composed of the N transparency sub-layers.
4. The data transmission method according to claim 2, characterized in that, After determining whether the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers, the method further includes: If the size of the transparency layer of the displayed image layer is not an integer multiple of the number of color layers; Zero-fill the transparency layer of the displayed image layer until the size of the transparency layer of the displayed image layer is an integer multiple of the number of color layers, and obtain a new transparency layer of the displayed image layer.
5. A data transmission method according to claim 4, characterized in that, The step of dividing the transparency layer of the displayed image layer to obtain the divided transparency layer includes: When the transparency layer of the displayed image layer is the transparency layer of the new displayed image layer, a preset division method is obtained, wherein the preset division method includes a horizontal division method and a vertical division method; The transparency layer of the new display image layer is divided into N equal parts according to the horizontal or vertical division method, resulting in N transparency sub-layers, where N is a multiple of 3; The divided transparency layer is composed of the N transparency sub-layers.
6. A data transmission method according to claim 3 or 5, characterized in that, The process of mapping and compositing the divided transparency layers to obtain M first RGB images includes: For the three transparency sublayers obtained by dividing any transparency layer among the N transparency sublayers; The three transparency sub-layers obtained by dividing the layer from any transparency layer are mapped to obtain the R layer, G layer and B layer; The pixels of the R layer, G layer and B layer are superimposed according to color weights, and tone smoothing correction is performed during the superposition process to generate the first RGB image; All generated first RGB images are combined to obtain the M first RGB images.
7. The data transmission method according to claim 1, characterized in that, The step of concatenating the M first RGB images with the second RGB image composed of the color layers to obtain the target RGB image includes: The M first RGB images are stitched together with the second RGB image composed of the color layers in a horizontal or vertical stitching manner to obtain the target RGB image; And / or, The target RGB image is obtained by pixel-by-pixel superposition and edge correction of the second RGB image formed by the M first RGB images and the color layer.
8. A data transmission method according to claim 7, characterized in that, The method further includes: During the stitching process, the edges of the stitching boundary area are smoothed based on the transparency and color gradient of the adjacent images.
9. A data transmission method according to claim 1, characterized in that, The method further includes: The target RGB image is transmitted to the receiving end so that the receiving end can restore the target RGB image to the display image layer.
10. A data transmission method according to claim 9, characterized in that, The data of different color layers of the target RGB image are transmitted in parallel.
11. A data transmission device, characterized in that, include: The acquisition module is used to acquire the display image layer, wherein the display image layer includes a transparency layer and a color layer; The layer division module is used to divide the transparency layer of the display image layer to obtain the divided transparency layer, and the size of the divided transparency layer satisfies an integer multiple of the number of color layers. The layer compositing module is used to map and composite the divided transparency layers to obtain M first RGB images, where M is an integer greater than 1; The data transmission module is used to stitch the M first RGB images with the second RGB image composed of the color layers to obtain a target RGB image, and to transmit the target RGB image.
12. A computer device, characterized in that, Includes a memory, and one or more processors communicatively connected to the memory; The memory stores instructions that can be executed by the one or more processors to cause the one or more processors to implement the data transmission method as described in any one of claims 1 to 10.
13. A computer-readable storage medium, characterized in that, Includes a program or instructions that, when run on a computer, implement the data transmission method of any one of claims 1 to 10.
14. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the data transmission method according to any one of claims 1 to 10.