A display method, device, apparatus and storage medium

Abstract

The application discloses a display method, device, equipment and storage medium, which facilitates to improve display effect. In the application, a first terminal device performs first format camouflage on a first image in a four-channel format to obtain a second image in a first target format, and sends the second image in the first target format to a second terminal device; the first image in the four-channel format comprises a transparency channel; the second terminal device receives the second image in the first target format, performs data extraction on the second image in a data extraction mode corresponding to the four-channel format, and obtains the first image in the four-channel format. The first image is subjected to format camouflage, so that the second terminal device can receive the second image comprising the transparency channel, and then the second terminal device extracts in the data extraction mode corresponding to the four-channel format to obtain the first image in the four-channel format comprising the transparency channel, thereby realizing transmission of the transparency channel without changing an existing hardware architecture, and guaranteeing display effect.

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to a display method, apparatus, device, and storage medium. Background Technology

[0002] To make Mixed Reality (MR) headsets thinner and lighter, improving wearing comfort, a separate display and computing architecture is adopted. In this architecture, the box-side unit handles computing and power, allowing for greater weight, while the glasses-side unit handles the display, allowing for lighter weight. This architecture requires data transmission between the box-side and glasses-side units. Related technologies typically use Red Green Blue (RGB), YUV (uncompressed), or Motion Joint Photographic Experts Group (MJPG) or HEVC (compressed) formats for video content transmission between the two cores. None of these formats have an alpha channel, meaning the data transmitted from the box-side unit can only be synthesized based on depth, usually placing it at the top layer, where it overwrites other content.

[0003] This method can only overlay by depth and does not support alpha channel transmission, resulting in poor display quality. Summary of the Invention

[0004] The purpose of this invention is to provide a display method, apparatus, device, and storage medium to solve the technical problems in the prior art.

[0005] In a first aspect, embodiments of this application provide a display method, the method comprising:

[0006] The first terminal device performs a first format disguise on the first image in the four-channel format to obtain a second image in the first target format, and sends the second image in the first target format to the second terminal device; the first image in the four-channel format includes a transparency channel; the second terminal device receives the second image in the first target format, extracts data from the second image using the data extraction method corresponding to the four-channel format, and obtains the first image in the four-channel format.

[0007] In this embodiment, the first image is a four-channel format including transparency. By masquerading the first image, the second terminal device can receive the second image including transparency. Then, the second terminal device extracts data according to the data extraction method corresponding to the four-channel format, and obtains the first image in the four-channel format including transparency. Transmission of transparency is achieved without changing the existing hardware architecture, thereby ensuring the display effect.

[0008] In some possible embodiments, the first target format is a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in the four-channel format. The first terminal device performs a first format disguise on the first image in the four-channel format to obtain a second image in the first target format, including: for each pixel in the first image, using the values ​​of the four channels of that pixel in a preset order as the pixel value of one pixel in the second image, thereby obtaining the pixel values ​​of the four pixels in the second image.

[0009] In this embodiment of the application, by processing each pixel in the first image, the four-channel format of the first image is converted into a first target format, and then the transmission of the transparency channel can be realized through the first target format.

[0010] In some possible embodiments, data is extracted from the second image using a data extraction method corresponding to the four-channel format to obtain a first image in the four-channel format, including: taking the pixel value of every 4 pixels in the second image as the value of the 4 channels of a pixel in the first image.

[0011] In this embodiment, the second terminal device extracts data according to the data extraction method corresponding to the four-channel format, and can obtain a first image in the four-channel format including the transparency channel. The transmission of the transparency channel is realized without changing the existing hardware architecture, thereby ensuring the display effect.

[0012] Secondly, embodiments of this application provide a display method, the method comprising: a first terminal device performing a first format disguise on a four-channel format first image to obtain a second image of a first target format, and sending the second image of the first target format to a bridging device; the four-channel format first image includes a transparency channel; the bridging device performing a second format disguise on the second image of the first target format to obtain a third image of the second target format, and sending the third image of the second target format to a second terminal device; the second terminal device performing data extraction on the third image using a data extraction method corresponding to the four-channel format to obtain the four-channel format first image.

[0013] In this embodiment, the first image is a four-channel format including transparency. By masquerading the first image, the bridging device can receive a second image including transparency, and the second terminal device can receive a third image including transparency. The second terminal device extracts data according to the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format including transparency. Transmission of transparency is achieved without changing the existing hardware architecture, thereby ensuring the display effect.

[0014] In some possible embodiments, the first target format is a 3-channel format, where the number of bits per channel is the same as the number of bits per channel in a 4-channel format. The first terminal device performs a first format disguise on the first image in the 4-channel format to obtain a second image in the first target format, including: grouping every 3 pixels into a group according to the order of pixels in the first image; for each group: using the values ​​of the first to third channels of the first 4-channel format pixel as the values ​​of the 3 channels of the first 3-channel format pixel in the second image; using the value of the fourth channel of the first 4-channel format pixel and the values ​​of the first and second channels of the second 4-channel format pixel as the values ​​of the 3 channels of the second 3-channel format pixel in the second image; using the values ​​of the third and fourth channels of the second 4-channel format pixel and the value of the first channel of the third 4-channel format pixel as the values ​​of the 3 channels of the third 3-channel format pixel in the second image; and using the values ​​of the second to fourth channels of the third 4-channel format pixel as the values ​​of the 3 channels of the fourth 3-channel format pixel in the second image.

[0015] In this embodiment of the application, the bridging device can receive a second image containing a transparency channel by spoofing the format of the first image.

[0016] In some possible embodiments, the first terminal device performs a first format disguise on the four-channel format first image to obtain a second image of the first target format, including: the first terminal device performs a fourth format disguise on the four-channel format first image to obtain a fourth image, the fourth image being a four-channel format image including invalid channels; and removes the invalid channels from the fourth image to obtain a second image of the first target format.

[0017] In this embodiment of the application, the bridging device can receive a second image containing a transparency channel by spoofing the format of the first image.

[0018] In some possible embodiments, the first terminal device performs fourth-format spoofing on the first image in a four-channel format to obtain a fourth image, including: based on the order of pixels in the first image, grouping every three pixels into a group; for each group: using the values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel as the values ​​of the four channels of the first four-channel format pixel in the fourth image; using the values ​​of the fourth channel of the first four-channel format pixel, the first channel, the second channel, and the second invalid channel of the second four-channel format pixel as the values ​​of the four channels of the second four-channel format pixel in the fourth image; using the values ​​of the third and fourth channels of the second four-channel format pixel, the first channel, and the third invalid channel of the third four-channel format pixel as the values ​​of the four channels of the third four-channel format pixel in the fourth image; and using the values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

[0019] In this application, different format spoofing methods are set for the first image in four-channel format with different formats, making this application more universal.

[0020] In some possible embodiments, removing invalid channels from the fourth image to obtain a second image in the first target format includes: for each pixel in the fourth image, removing invalid channels from the pixel to obtain the three-channel values ​​corresponding to the pixel; and obtaining the second image in the first target format based on the three-channel values ​​corresponding to each pixel.

[0021] In this embodiment of the application, there is no need to transmit invalid channels, thus saving resources consumed in the data transmission process by removing invalid channels.

[0022] In some possible embodiments, the first terminal device includes an overlay layer OVL, and the step of removing invalid channels in the fourth image to obtain a second image of the first target format is performed by the OVL.

[0023] In some possible embodiments, the second target format is a single-channel format, where the number of bits per pixel is the same as the number of bits per channel in the three-channel format, and the first target format is a three-channel format. The bridging device disguises the second image of the first target format with the second format to obtain a third image of the second target format, including: for each pixel in the second image, using the values ​​of the three channels of the pixel in a preset order as the pixel value of one pixel in the third image, to obtain the pixel value of the three pixels in the third image.

[0024] In some possible embodiments, the second terminal device extracts data from the third image using a data extraction method corresponding to the four-channel format to obtain a first image in the four-channel format, including: taking the pixel value of every 4 pixels in the third image as the value of the 4 channels of one pixel in the first image.

[0025] Thirdly, this application also provides a display method applied to a first terminal device. The method includes: performing a first format disguise on a four-channel format first image to obtain a second image in a first target format; sending the second image in the first target format to a second terminal device so that the second terminal device extracts data from the second image using a data extraction method corresponding to the four-channel format to obtain a first image in a four-channel format; the first image in the four-channel format includes a transparency channel.

[0026] In some possible embodiments, the first target format is a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in the four-channel format. The first image in the four-channel format is disguised by the first format to obtain a second image in the first target format, which includes: for each pixel in the first image, the values ​​of the four channels of the pixel are respectively used as the pixel values ​​of one pixel in the second image in a preset order to obtain the pixel values ​​of the four pixels in the second image.

[0027] In some possible embodiments, after obtaining the second image in the first target format, the method further includes: sending the second image in the first target format to a bridging device so that the bridging device performs a second format disguise on the second image in the first target format to obtain a third image in the second target format, and sending the third image in the second target format to a second terminal device.

[0028] In some possible embodiments, the first target format is a 3-channel format, where the number of bits per channel is the same as the number of bits per channel in a 4-channel format. The first image in the 4-channel format is then masqueraded using a first format to obtain a second image in the first target format. This process includes: grouping every three pixels into a single group according to the order of pixels in the first image; for each group: using the values ​​of the first to third channels of the first 4-channel format pixel as the values ​​of the three channels of the first 3-channel format pixel in the second image; using the value of the fourth channel of the first 4-channel format pixel and the values ​​of the first and second channels of the second 4-channel format pixel as the values ​​of the three channels of the second 3-channel format pixel in the second image; using the values ​​of the third and fourth channels of the second 4-channel format pixel and the value of the first channel of the third 4-channel format pixel as the values ​​of the three channels of the third 3-channel format pixel in the second image; and using the values ​​of the second to fourth channels of the third 4-channel format pixel as the values ​​of the three channels of the fourth 3-channel format pixel in the second image.

[0029] In some possible embodiments, performing a first format disguise on a four-channel format first image to obtain a second image of a first target format includes: performing a fourth format disguise on the four-channel format first image to obtain a fourth image, the fourth image being a four-channel format image including invalid channels; removing invalid channels from the fourth image to obtain a second image of the first target format.

[0030] In some possible embodiments, a fourth format spoofing is applied to a first image in a four-channel format to obtain a fourth image, including: taking the order of pixels in the first image and grouping every three pixels into a set; for each set: using the values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel as the values ​​of the four channels of the first four-channel format pixel in the fourth image; using the values ​​of the fourth channel of the first four-channel format pixel, the first channel, the second channel, and the second invalid channel of the second four-channel format pixel as the values ​​of the four channels of the second four-channel format pixel in the fourth image; using the values ​​of the third and fourth channels of the second four-channel format pixel, the first channel, and the third invalid channel of the third four-channel format pixel as the values ​​of the four channels of the third four-channel format pixel in the fourth image; and using the values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

[0031] In some possible embodiments, removing invalid channels from the fourth image to obtain a second image in the first target format includes: for each pixel in the fourth image, removing invalid channels from the pixel to obtain the three-channel values ​​corresponding to the pixel; and obtaining the second image in the first target format based on the three-channel values ​​corresponding to each pixel.

[0032] Fourthly, embodiments of this application also provide a display method applied to a second terminal device, the method comprising: receiving a second image in a first target format; wherein the second image is obtained by the first terminal device by disguising a first image in a four-channel format using a first format; the first image in the four-channel format includes a transparency channel; and extracting data from the second image using a data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format.

[0033] In some possible embodiments, data extraction is performed on the second image using a data extraction method corresponding to a four-channel format, including: taking the pixel value of every four pixels in the second image as the value of the four channels of one pixel in the first image.

[0034] In some possible embodiments, the method further includes: receiving a third image in a second target format sent by the bridging device; wherein the third image in the second target format is obtained by the bridging device by disguising the received second image in a first target format as a second format; and extracting data from the third image using a data extraction method corresponding to the four-channel format to obtain a first image in a four-channel format.

[0035] Fifthly, embodiments of this application also provide a display control device, the device comprising:

[0036] The first image processing module is used by the first terminal device to perform first format spoofing on the first image in the four-channel format to obtain a second image in the first target format, and to send the second image in the first target format to the second terminal device; the first image in the four-channel format includes a transparency channel.

[0037] The first data extraction module is used for the second terminal device to receive the second image in the first target format, extract data from the second image in the four-channel format, and obtain the first image in the four-channel format.

[0038] In some possible embodiments, the first target format is a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in a four-channel format. The first image processing module is specifically used to: for each pixel in the first image, use the values ​​of the four channels of that pixel in a preset order as the pixel value of one pixel in the second image, thereby obtaining the pixel values ​​of the four pixels in the second image.

[0039] In some possible embodiments, the first data extraction module is specifically used to: take the pixel value of every 4 pixels in the second image as the value of the 4 channels of a pixel in the first image.

[0040] Sixthly, embodiments of this application provide a display device, the device comprising:

[0041] The second image processing module is used by the first terminal device to perform first format spoofing on the first image in the four-channel format to obtain a second image in the first target format, and to send the second image in the first target format to the bridging device; the first image in the four-channel format includes a transparency channel.

[0042] The third image processing module is used to spoof the second image in the first target format to obtain a third image in the second target format, and then send the third image in the second target format to the second terminal device.

[0043] The second data extraction module is used by the second terminal device to extract data from the third image using a data extraction method corresponding to the four-channel format, thereby obtaining the first image in the four-channel format.

[0044] In some possible embodiments, the first target format is a 3-channel format, where the number of bits per channel is the same as the number of bits per channel in a 4-channel format. The second image processing module is specifically used to: group every 3 pixels as a group according to the order of pixels in the first image; for each group: use the values ​​of the first to third channels of the first 4-channel format pixel as the values ​​of the 3 channels of the first 3-channel format pixel in the second image; use the value of the fourth channel of the first 4-channel format pixel and the values ​​of the first and second channels of the second 4-channel format pixel as the values ​​of the 3 channels of the second 3-channel format pixel in the second image; use the values ​​of the third and fourth channels of the second 4-channel format pixel and the value of the first channel of the third 4-channel format pixel as the values ​​of the 3 channels of the third 3-channel format pixel in the second image; and use the values ​​of the second to fourth channels of the third 4-channel format pixel as the values ​​of the 3 channels of the fourth 3-channel format pixel in the second image.

[0045] In some possible embodiments, the second image processing module is specifically used for: the first terminal device performing fourth format spoofing on the first image in four-channel format to obtain a fourth image, the fourth image being a four-channel format image including invalid channels; removing invalid channels from the fourth image to obtain a second image in the first target format.

[0046] In some possible embodiments, the second image processing module is specifically configured to: based on the order of pixels in the first image, group every three pixels into a set; for each set: using the values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel as the values ​​of the four channels of the first four-channel format pixel in the fourth image; using the value of the fourth channel of the first four-channel format pixel, the value of the first channel, the value of the second channel of the second four-channel format pixel, and the value of the second invalid channel as the values ​​of the four channels of the second four-channel format pixel in the fourth image; using the values ​​of the third and fourth channels of the second four-channel format pixel, the value of the first channel of the third four-channel format pixel, and the value of the third invalid channel as the values ​​of the four channels of the third four-channel format pixel in the fourth image; and using the values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

[0047] In some possible embodiments, the second image processing module is specifically used to: for each pixel in the fourth image, remove invalid channels in the pixel to obtain the three-channel values ​​corresponding to the pixel; and obtain a second image in the first target format based on the three-channel values ​​corresponding to each pixel.

[0048] In some possible embodiments, the first terminal device includes an overlay layer OVL, and the step of removing invalid channels in the fourth image to obtain a second image of the first target format is performed by the OVL.

[0049] In some possible embodiments, the second target format is a single-channel format, where the number of bits per pixel is the same as the number of bits per channel in the three-channel format, the first target format is a three-channel format, and the third image processing module is specifically used to: for each pixel in the second image, take the values ​​of the three channels of the pixel as the pixel value of a pixel in the third image in a preset order, so as to obtain the pixel value of the three pixels in the third image.

[0050] In some possible embodiments, the second data extraction module is specifically used to: take the pixel value of every 4 pixels in the third image as the value of the 4 channels of a pixel in the first image.

[0051] Seventhly, embodiments of this application also provide a display control device applied to a first terminal device, the device comprising:

[0052] The fourth image processing module is used to perform a first format disguise on the first image in the four-channel format to obtain a second image in the first target format;

[0053] The image sending module is used to send a second image in a first target format to a second terminal device, so that the second terminal device can extract data from the second image using a data extraction method corresponding to the four-channel format to obtain a first image in a four-channel format; the first image in the four-channel format includes a transparency channel.

[0054] In some possible embodiments, the first target format is a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in a four-channel format. The fourth image processing module is specifically used to: for each pixel in the first image, take the values ​​of the four channels of that pixel as the pixel value of one pixel in the second image in a preset order, thereby obtaining the pixel values ​​of the four pixels in the second image.

[0055] In some possible embodiments, the image sending module is further configured to: send a second image in a first target format to a bridging device, so that the bridging device performs a second format disguise on the second image in the first target format to obtain a third image in a second target format, and send the third image in the second target format to a second terminal device.

[0056] In some possible embodiments, the first target format is a 3-channel format, where the number of bits per channel is the same as the number of bits per channel in a 4-channel format. The fourth image processing module is specifically configured to: group every 3 pixels as a group according to the order of pixels in the first image; for each group: use the values ​​of the first to third channels of the first 4-channel format pixel as the values ​​of the 3 channels of the first 3-channel format pixel in the second image; use the value of the fourth channel of the first 4-channel format pixel and the values ​​of the first and second channels of the second 4-channel format pixel as the values ​​of the 3 channels of the second 3-channel format pixel in the second image; use the values ​​of the third and fourth channels of the second 4-channel format pixel and the value of the first channel of the third 4-channel format pixel as the values ​​of the 3 channels of the third 3-channel format pixel in the second image; and use the values ​​of the second to fourth channels of the third 4-channel format pixel as the values ​​of the 3 channels of the fourth 3-channel format pixel in the second image.

[0057] In some possible embodiments, the fourth image processing module is specifically used to: perform fourth format spoofing on the first image in four-channel format to obtain a fourth image, the fourth image being a four-channel format image including invalid channels; and remove the invalid channels from the fourth image to obtain a second image in the first target format.

[0058] In some possible embodiments, the fourth image processing module is specifically configured to: group every three pixels in the first image according to their order; for each group: use the values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel as the values ​​of the four channels of the first four-channel format pixel in the fourth image; use the value of the fourth channel of the first four-channel format pixel, the value of the first channel, the value of the second channel, and the value of the second invalid channel of the second four-channel format pixel as the values ​​of the four channels of the second four-channel format pixel in the fourth image; use the values ​​of the third and fourth channels of the second four-channel format pixel, the value of the first channel, and the value of the third invalid channel of the third four-channel format pixel as the values ​​of the four channels of the third four-channel format pixel in the fourth image; and use the values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

[0059] In some possible embodiments, the fourth image processing module is specifically used to: for each pixel in the fourth image, remove invalid channels in the pixel to obtain the three-channel values ​​corresponding to the pixel; and obtain a second image in the first target format based on the three-channel values ​​corresponding to each pixel.

[0060] Eighthly, embodiments of this application also provide a display control device applied to a second terminal device, the device comprising:

[0061] The receiving module is used to receive a second image in a first target format; wherein the second image is obtained by the first terminal device by disguising the first image in a four-channel format in a first format; the first image in the four-channel format includes a transparency channel;

[0062] The third data extraction module is used to extract data from the second image using the data extraction method corresponding to the four-channel format, so as to obtain the first image in the four-channel format.

[0063] In some possible embodiments, the third data extraction module is specifically used to: take the pixel value of every 4 pixels in the second image as the value of the 4 channels of a pixel in the first image.

[0064] In some possible embodiments, the third data extraction module is further configured to: receive a third image in a second target format sent by the bridging device; wherein the third image in the second target format is obtained by the bridging device by disguising the received second image in the first target format with a second format; and extract data from the third image using a data extraction method corresponding to the four-channel format to obtain a first image in the four-channel format.

[0065] Ninthly, another embodiment of this application also provides an electronic device, including at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform any of the methods provided in the first or second aspect of this application.

[0066] In a tenth aspect, another embodiment of this application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for causing a computer to perform any of the methods provided in the first or second aspect embodiments of this application.

[0067] Eleventhly, another embodiment of this application also provides a computer program product, the computer program product comprising: computer program code, which, when run on a computer, causes the computer to perform any of the methods provided in the first or second aspect of the embodiments described above.

[0068] Other features and advantages of this application will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings. Attached Figure Description

[0069] Figure 1 A schematic diagram illustrating how top-level content covers other content in an embodiment of this application;

[0070] Figure 2 This is a schematic diagram of the overall process of a display method provided in an embodiment of this application;

[0071] Figure 3 This is a schematic diagram illustrating a display method provided in an embodiment of this application, in which each channel in a first image is used as a pixel in a second image;

[0072] Figure 4 This is a schematic diagram illustrating a display method provided in an embodiment of the present application, in which the pixel values ​​of every four pixels in the second image are used as four channels of one pixel in the first image;

[0073] Figure 5 This is another schematic flowchart illustrating a display method provided in an embodiment of this application;

[0074] Figure 6 This is a flowchart illustrating a display method provided in this application for obtaining a second image of a first target format by performing a first format disguise on a first image of a four-channel format.

[0075] Figure 7 A schematic diagram illustrating a first-format masquerading of a first image in a four-channel format by a first terminal device according to an embodiment of this application;

[0076] Figure 8 A schematic diagram illustrating the process of a first terminal device performing fourth format spoofing on a first image in a four-channel format according to an embodiment of this application;

[0077] Figure 9 A schematic diagram illustrating a fourth format disguise of a first terminal device in a four-channel format for a display method provided in an embodiment of this application;

[0078] Figure 10 A schematic diagram illustrating a display method provided in this application for removing invalid channels from each four-channel format pixel to obtain a three-channel format pixel corresponding to each four-channel format pixel;

[0079] Figure 11 A schematic diagram illustrating a display method for disguising a second image of a first target format as a second format, provided in an embodiment of this application;

[0080] Figure 12 A flowchart illustrating a display method provided in this application, wherein the execution subject is a first terminal device;

[0081] Figure 13 A flowchart illustrating a display method provided in this application, wherein the execution subject is a second terminal device;

[0082] Figure 14 This is a schematic diagram of a display system corresponding to a display method provided in an embodiment of this application;

[0083] Figure 15 A schematic diagram illustrating audio-visual synchronization of a display method provided in an embodiment of this application;

[0084] Figure 16 A schematic diagram of an apparatus for a display method provided in an embodiment of this application;

[0085] Figure 17 This is a schematic diagram of another apparatus for a display method provided in an embodiment of this application;

[0086] Figure 18 A schematic diagram of a device for implementing a display method provided in this application embodiment, wherein the execution subject is a first terminal device;

[0087] Figure 19 A schematic diagram of a device for implementing a display method provided in this application, wherein the execution subject is a second terminal device;

[0088] Figure 20 This is a schematic diagram of an electronic device for a display method provided in an embodiment of this application. Detailed Implementation

[0089] The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0090] To better understand the technical solution of this application, the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0091] It should be understood that the described embodiments are merely some, not all, of the embodiments in this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0092] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. The singular forms “a,” “the,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0093] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0094] To make Mixed Reality (MR) headsets thinner and lighter, improving wearing comfort, a separate display and computing architecture is adopted. In this architecture, the headset itself handles computing and power, allowing for greater weight, while the glasses themselves handle the display, allowing for lighter weight. This architecture requires data transmission between the headset and glasses. In related technologies, the video content transmitted between the headset and glasses is typically in RGB, YUV, or MJPG / HEVC formats, none of which have an alpha channel. Figure 1 As shown, the box sends video content to the head-up display (HUD), while cameras and other devices send other content (other video content) to the HUD. Because the format of the transmitted video content lacks an alpha channel, the HUD can only composite the data transmitted from the box by depth, typically placing the video content on top of the other content, thus overwriting the rest. This method only supports depth-based overlay and does not support alpha channel transmission, resulting in poor display quality.

[0095] To address the aforementioned problems, embodiments of this application provide a display method, apparatus, device, and storage medium to solve these problems. The inventive concept of this application can be summarized as follows: a first terminal device performs a first format disguise on a four-channel format first image to obtain a second image in a first target format, and sends the second image in the first target format to a second terminal device; the four-channel format first image includes a transparency channel; the second terminal device receives the second image in the first target format, extracts data from the second image using a data extraction method corresponding to the four-channel format, and obtains the four-channel format first image.

[0096] In this embodiment, the first image is a four-channel format including transparency. By masquerading the first image, the second terminal device can receive the second image including transparency. Then, the second terminal device extracts data according to the data extraction method corresponding to the four-channel format, and obtains the first image in the four-channel format including transparency. Transmission of transparency is achieved without changing the existing hardware architecture, thereby ensuring the display effect.

[0097] For ease of understanding, the following detailed description of a display method provided by an embodiment of this application, in conjunction with the accompanying drawings, is provided:

[0098] like Figure 2The diagram shown is an overall flowchart of a display method provided in an embodiment of this application. The display method provided in this application is applied to a display system, which includes at least: a first terminal device and a second terminal device, wherein:

[0099] In step 201: the first terminal device performs a first format disguise on the first image in the four-channel format to obtain a second image in the first target format; the first image in the four-channel format includes a transparency channel.

[0100] In this embodiment of the application, each pixel in the first image of the four-channel format contains four channels, and the four-channel format can be RGBA10101010 format.

[0101] In some possible embodiments, the first target format can be a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in the four-channel format. For example, the first target format can be Raw10, and the four-channel format is RGBA10101010. In this case, the first terminal device performs a first format disguise on the first image in the four-channel format to obtain a second image in the first target format. Specifically, for each pixel in the first image, the values ​​of the four channels of that pixel are used as the pixel values ​​of one pixel in the second image in a preset order to obtain the pixel values ​​of the four pixels in the second image.

[0102] In this embodiment of the application, each channel in the first image is used as a pixel in the second image, for example: Figure 3 As shown, the transmission content corresponding to the first image is: RGBARGBARGBA, where each RGBA represents a pixel, and each pixel includes the following channels: R channel, G channel, B channel, and A channel. For the first image, there are pixels 1, 2, and 3, and each pixel includes the values ​​of 4 channels. Therefore, the first image includes the values ​​of 12 channels. According to the order of each pixel in the first image, the values ​​of each channel of the pixel are sequentially used as a pixel in the second image. The resulting second image includes 12 pixels, namely R, G, B, A, R, G, B, A, R, G, B, A.

[0103] In step 202: the first terminal device sends the second image in the first target format to the second terminal device.

[0104] In this application embodiment, the first terminal device can directly send the second image in the first target format to the second terminal device, or it can send the second image in the first target format to the second terminal device through a bridging chip. This application does not limit this.

[0105] In step 203: the second terminal device receives the second image in the first target format.

[0106] In this embodiment, the second terminal device can directly receive the second image in the first target format sent by the first terminal device, or it can receive the second image in the first target format sent by the bridging chip.

[0107] In step 204: the second terminal device extracts data from the second image using the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format.

[0108] In this embodiment, the second terminal device extracts data from the second image using a data extraction method corresponding to the four-channel format, and the resulting data content is in the four-channel format. Therefore, the first image in the four-channel format can be obtained through this method.

[0109] In some possible embodiments, the second image is extracted using a data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format. Specifically, this can be implemented by taking the pixel value of every four pixels in the second image as the value of the four channels of one pixel in the first image.

[0110] For example: Figure 4 As shown, the second image includes 12 pixels, namely: R, G, B, A, R, G, B, A, R, G, B, A. Starting from the first pixel, four pixels are grouped together in sequence, resulting in three groups: RGBA, RGBA, and RGBA. Each group is used as one of the four channels of a pixel in the first image. The resulting first image includes three pixels, and each pixel includes the values ​​of four channels. The content of the resulting first image is: RGBARGBARGBA.

[0111] In addition to the above-described display method, another display method provided in this application embodiment is described below. This display method is applied to a display system, which includes: a first terminal device, a bridging device, and a second terminal device, such as... Figure 5 The diagram shown is a schematic representation of the overall flow of this display method, wherein:

[0112] In step 501: the first terminal device performs a first format disguise on the first image in the four-channel format to obtain a second image in the first target format, wherein the first image in the four-channel format includes a transparency channel.

[0113] In this embodiment, each pixel in the four-channel format first image contains four channels. This four-channel format can be RGBA10101010, RGBA8888, or RGBX8888. The method for masquerading the format of the first image differs depending on the format. The method for masquerading the RGBA10101010 format first image is the same as described above. Figure 2The process shown is the same, so it will not be repeated here. The following sections will explain the first image in RGBA8888 format and the method of spoofing the RGBX8888 format.

[0114] In some possible embodiments, the first target format is a 3-channel format (e.g., RGB888), where the number of bits per channel is the same as the number of bits per channel in a 4-channel format. The first image is in RGBA8888 format. The first terminal device performs a first format disguise on the 4-channel format first image to obtain a second image in the first target format. Specifically, this can be implemented by: grouping every 3 pixels into a group according to the order of pixels in the first image; and performing the following steps for each group: Figure 6 The steps shown are as follows:

[0115] In step 601: the values ​​of the first to third channels of the first four-channel format pixel are used as the values ​​of the three channels of the first three-channel format pixel in the second image.

[0116] In this embodiment of the application, since the number of bits per channel in the 3-channel format is the same as the number of bits per channel in the 4-channel format, the values ​​of the three channels can be extracted from the pixels in the 4-channel format and used as the values ​​of each channel in the 3-channel format.

[0117] For example: Figure 7 As shown, the content of the first image in 4-channel format is RGBARGBARGBA, which includes 3 pixels. Each pixel includes four channels: R, G, B, and A. After converting the first image in 4-channel format to a second image in 3-channel format, the second image in 3-channel format includes 4 pixels, each pixel including 3 channels. The values ​​of the four channels of the first pixel in the first image are R, G, B, and A. The values ​​of the first to third channels of the first 4-channel format pixel are R, G, and B, respectively. Using the values ​​of these three channels as the first pixel in the first 3-channel format, the values ​​of the three channels of the first 3-channel format pixel are obtained as RGB.

[0118] In step 602: the value of the fourth channel of the first four-channel format pixel and the values ​​of the first and second channels of the second four-channel format pixel are used as the values ​​of the three channels of the second three-channel format pixel in the second image.

[0119] For example: Figure 7As shown, the values ​​of the four channels of the first pixel in the first image are R, G, B, and A, respectively. The values ​​of the four channels of the second pixel are R, G, B, and A, respectively. The value of the fourth channel of the first four-channel format pixel is A, the value of the first channel of the second pixel is R, and the value of the second channel of the second pixel is G. Therefore, the values ​​of the three channels of the second three-channel format pixel are: ARG.

[0120] In step 603: the values ​​of the third and fourth channels of the second four-channel format pixel and the value of the first channel of the third four-channel format pixel are used as the values ​​of the three channels of the third three-channel format pixel in the second image.

[0121] For example: Figure 7 As shown, the values ​​of the four channels of the second pixel in the first image are R, G, B, and A, respectively. The values ​​of the four channels of the third pixel are R, G, B, and A, respectively. The value of the third channel of the second four-channel format pixel is B, the value of the fourth channel of the second pixel is A, and the value of the first channel of the third pixel is R. Therefore, the values ​​of the three channels of the third three-channel format pixel are: BAR.

[0122] In step 604: the values ​​of the second to fourth channels of the third four-channel format pixel are used as the values ​​of the three channels of the fourth three-channel format pixel in the second image.

[0123] For example: Figure 7 As shown, the values ​​of the four channels of the third pixel in the first image are R, G, B, and A, respectively. The value of the second channel of the third four-channel format pixel is G, the value of the third channel of the third pixel is B, and the value of the fourth channel of the third pixel is A. Therefore, the values ​​of the three channels of the fourth three-channel format pixel are GBA.

[0124] In summary, with Figure 7 For example, the content of the first image in 4-channel format is: RGBARGBARGBA, and the content of the second image in 3-channel format obtained by masquerading the first image in the first format is: RGB ARG BAR GBA.

[0125] In some other possible embodiments, the first target format is a 3-channel format (e.g., RGB888), where the number of bits per channel is the same as the number of bits per channel in a 4-channel format. The first image is in RGBA8888 format. The first terminal device performs a first format disguise on the 4-channel format first image to obtain a second image in the first target format. Alternatively, the first terminal device performs a fourth format disguise on the 4-channel format first image to obtain a fourth image, which is a 4-channel format image including invalid channels. The invalid channels in the fourth image are removed to obtain the second image in the first target format.

[0126] In this embodiment of the application, the content corresponding to the fourth image can be obtained by using a computer shader to disguise the first image in a fourth format.

[0127] In some possible embodiments, the first terminal device performs fourth-format spoofing on the first image in a four-channel format to obtain a fourth image. This can be implemented by grouping every three pixels as a group based on the order of pixels in the first image, and performing [action] on each group. Figure 8 The process shown is as follows:

[0128] In step 801: The values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel are used as the values ​​of the four channels of the first four-channel format pixel in the fourth image.

[0129] For example: Figure 9 As shown, the content of the first image in 4-channel format is: RGBARGBARGBA, including 3 pixels, each pixel including four channels: R, G, B, A; the values ​​of the four channels of the first pixel in the first image are R, G, B, A, and the values ​​of the first to third channels of the first four-channel format pixel are R, G, B, respectively. The values ​​of these three channels and the value X of the first invalid channel are used as the values ​​of the four channels of the first four-channel format pixel in the fourth image, resulting in the values ​​of the four channels of the first four-channel format pixel: RGBX.

[0130] In step 802: the value of the fourth channel of the first four-channel format pixel, the value of the first channel, the value of the second channel of the second four-channel format pixel, and the value of the second invalid channel are used as the values ​​of the four channels of the second four-channel format pixel in the fourth image.

[0131] For example: Figure 9As shown, the values ​​of the four channels of the first pixel in the first image are R, G, B, and A, respectively. The value of the fourth channel of the first four-channel format pixel is A. The values ​​of the four channels of the second pixel in the first image are R, G, B, and A, respectively. The values ​​of the first and second channels of the second pixel are R and G, respectively. The value of the second invalid channel is X. Therefore, the values ​​of the four channels of the second four-channel format pixel are ARGX.

[0132] In step 803: the values ​​of the third and fourth channels of the second four-channel format pixel, the value of the first channel of the third four-channel format pixel, and the value of the third invalid channel are used as the values ​​of the four channels of the third four-channel format pixel in the fourth image.

[0133] For example: Figure 9 As shown, the values ​​of the four channels of the second pixel in the first image are R, G, B, and A, respectively; the values ​​of the third and fourth channels are B and A, respectively; the values ​​of the four channels of the third pixel in the first image are R, G, B, and A, respectively; the value of the first channel of the third pixel is R; the value of the third invalid channel is X; and the values ​​of the four channels of the third four-channel format pixel are BARX.

[0134] In step 804: The values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel are used as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

[0135] For example: Figure 9 As shown, the values ​​of the four channels of the third pixel in the first image are R, G, B, and A, respectively. The values ​​of the second to fourth channels are G, B, and A, respectively. The value of the fourth invalid channel is X. Therefore, the values ​​of the four channels of the fourth four-channel format pixel are GBAX.

[0136] In some possible embodiments, after obtaining a fourth image of pixels in four-channel format, it is necessary to remove invalid channels from the fourth image. Specifically, this can be implemented as follows: for each pixel in the fourth image, remove the invalid channels to obtain the corresponding three-channel values; and obtain a second image of the first target format based on the three-channel values ​​corresponding to each pixel. The first terminal device includes an overlay (OVL), which can be used to remove invalid channels from the fourth image to obtain the second image of the first target format.

[0137] In this embodiment of the application: invalid channels in each four-channel format pixel are removed to obtain a three-channel format pixel corresponding to each four-channel format pixel; for each three-channel format pixel: the value of the first channel of the three-channel format pixel is used as the value of the first channel of the first target format; the value of the second channel of the three-channel format pixel is used as the value of the second channel of the first target format; and the value of the third channel of the three-channel format pixel is used as the value of the third channel of the first target format.

[0138] For example: Figure 10 As shown, the fourth image includes the values ​​of four pixels in four-channel format: RGBX, ARGX, BARX, and GBAX. Invalid channels in each pixel are removed, resulting in three-channel format pixel values: RGB, ARG, BAR, and GBA. For each three-channel format pixel: for RGB pixel: the value R of the first channel is used as the value of the first channel of the first target format, the value G of the second channel is used as the value of the second channel of the first target format, and the value B of the third channel is used as the value of the third channel of the first target format, resulting in the first pixel value of the first target format being RGB; for ARG pixel: the value A of the first channel is used as the value of the first channel of the first target format, and the value R of the second channel is used as the value of the second channel of the first target format. For pixel BAR: the value of the first channel B of the pixel is used as the value of the first channel of the first target format, the value of the second channel A of the pixel is used as the value of the second channel of the first target format, and the value of the third channel R of the pixel is used as the value of the third channel of the first target format, resulting in the first pixel of the first target format being named BAR; for pixel GBA: the value of the first channel G of the pixel is used as the value of the first channel of the first target format, the value of the second channel B of the pixel is used as the value of the second channel of the first target format, and the value of the third channel A of the pixel is used as the value of the third channel of the first target format, resulting in the first pixel of the first target format being named GBA.

[0139] In step 502: the first terminal device sends the second image in the first target format to the bridging device.

[0140] In this embodiment of the application, the first terminal device includes a DisplayPort Transmitter (DPTX), and the bridging device includes a DisplayPort Receiver (DPRX). Therefore, the first terminal device transmits a second image of the first target format through the DPTX, and the bridging device receives the second image of the first target format through the DPRX.

[0141] In step 503: the bridging device disguises the second image in the first target format with a second format to obtain a third image in the second target format.

[0142] In this embodiment of the application, the first target format is a 3-channel format (e.g., RGB888), and the second target format is a single-channel format (e.g., RAW8). The number of bits per pixel in the second target format is the same as the number of bits per channel in the 3-channel format. Therefore, a third image of the second target format can be obtained by masquerading the first target format with the second format.

[0143] In some possible embodiments, the bridging device disguises the second image of the first target format with a second format to obtain a third image of the second target format. Specifically, it can be implemented as follows: for each pixel in the second image, the values ​​of the three channels of the pixel are respectively used as the pixel value of a pixel in the third image in a preset order to obtain the pixel values ​​of the three pixels in the third image.

[0144] For example: Figure 11 As shown, the content of the second image in 3-channel format is: RGB ARG BAR GBA, including 4 pixels, each pixel including 3 channels; for the first pixel RGB in the second image, the channel values ​​are: R, G, B. Taking the value R of the first channel of the first pixel in the second image as the first pixel in the third image, we get the value R of the first pixel in the third image. Similarly, we can get the value G of the second pixel in the third image and the value B of the third pixel. For the second pixel ARG in the second image, the channels are A, R, G. Taking the value R of the first channel of the second pixel in the second image as the first pixel in the third image, we get the value R of the first pixel in the third image. The value A is used as the fourth pixel in the third image, so the value of the fourth pixel in the third image is A. Similarly, the value of the fifth pixel in the third image is R, and the value of the sixth pixel is G; similarly, the value of the seventh pixel is B, the value of the eighth pixel is A, the value of the ninth pixel is R, the value of the tenth pixel is G, the value of the eleventh pixel is B, and the value of the twelfth pixel is A. Through this method, the twelve pixels in the third image are: R, G, B, A, R, G, B, A, R, G, B, A.

[0145] In step 504: the bridging device sends the third image in the second target format to the second terminal device.

[0146] In this embodiment of the application, the bridging device includes a Camera Serial Interface Transmit (CSITX), and the second terminal device includes a Camera Serial Interface Receiver (CSIRX). The bridging device sends a third image in a second target format to the second terminal device via CSITX, and the second terminal device receives the third image in the second target format via CSITX.

[0147] In step 505: the second terminal device extracts data from the third image using the data extraction method corresponding to the four-channel format, and obtains the first image in the four-channel format.

[0148] In this embodiment, the second terminal device extracts data from the second image using a data extraction method corresponding to a four-channel format, and the resulting data content is in a four-channel format. Therefore, the first image in a four-channel format can be obtained through this method.

[0149] In some possible embodiments, the second terminal device extracts data from the third image using a data extraction method corresponding to the four-channel format to obtain a first image in the four-channel format. Specifically, this can be implemented by taking the pixel value of every four pixels in the third image as the value of the four channels of one pixel in the first image.

[0150] For example: Figure 4 As shown, the second image includes the values ​​of 12 pixels: R, G, B, A, R, G, B, A, R, G, B, A. Starting from the first pixel, four pixels are grouped together in sequence, resulting in three groups: RGBA, RGBA, and RGBA. Each group is used as one of the four channels of a pixel in the first image, resulting in a first image containing three pixels, each pixel containing four channels. The content of the resulting first image is: RGBARGBARGBA.

[0151] The following describes a display method when the execution subject is the first terminal device. The overall flowchart is as follows: Figure 12 As shown, where:

[0152] In step 1201: The first image in the four-channel format is disguised in the first format to obtain the second image in the first target format.

[0153] The specific implementation method of this step is the same as that of steps 201 and 501 above, and will not be repeated here.

[0154] In step 1202: the second image in the first target format is sent to the second terminal device, so that the second terminal device extracts data from the second image in the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format; the first image in the four-channel format includes a transparency channel.

[0155] The specific implementation method of this step is the same as that of steps 202 and 502, and will not be described again here.

[0156] The following describes a display method when the execution subject is a second terminal device. The overall flowchart is as follows: Figure 13 As shown, where:

[0157] In step 1301: a second image in a first target format is received; wherein the second image is obtained by the first terminal device by disguising the first image in a four-channel format using a first format; the first image in the four-channel format includes a transparency channel.

[0158] The specific implementation method of this step is the same as that of steps 203 and 504 above, and will not be repeated here.

[0159] In step 1302: Data is extracted from the second image using the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format.

[0160] The specific implementation method of this step is the same as that of steps 204 and 505 above, and will not be repeated here.

[0161] Based on the same inventive concept, embodiments of this application also provide a display system, such as... Figure 14 As shown, the display system includes: a first terminal device, a second terminal device, and a bridge chip; it can be understood that during execution... Figure 2 The display method shown may not include a bridging chip in the display system.

[0162] The first terminal device includes a graphics processing unit (GPU), double data rate synchronous dynamic random access memory (DDR), OVL, and DPTX. The GPU is used to perform format spoofing on the first image, the DDR is used to store the first image, the OVL is used to remove invalid channels in the first image, and the DPTX is used to send the second image. The second image can be obtained by spoofing the first image, or it can be obtained by spoofing the fourth image after removing invalid channels from the first image.

[0163] The bridging chip includes DPRX and CSITX. DPRX is used to receive a second image sent by a first terminal device, and CSITX is used to send the received second image to a second terminal device, or to send a third image to a second terminal device. During execution... Figure 5 In the display method shown, the bridging chip is also used to spoof the format of the second image to obtain the third image;

[0164] The second terminal device includes: CSIRX and GPU. The GPU is used to extract and process the received image to obtain the first image. The CSIRX is used to receive the second or third image sent by the bridging chip, and also to receive the second image sent by the first terminal device.

[0165] In some possible embodiments, the display method provided in this application also supports synchronized audio and video transmission, as illustrated in the specific transmission diagram. Figure 15 As shown, it includes: a first terminal device, a second terminal device, and a bridging chip, wherein:

[0166] The first terminal device includes at least: a digital signal processor (DSP), a DDR, an audio module (Audio), and a DPTX. The DSP is used to receive audio information, the Audio module in the DDR is used to store audio information, and the DPTX is used to send audio information to the bridging device.

[0167] Bridging devices include at least: DPRX, I 2 STX and DPRX are used to receive audio information sent by the first terminal device, and 12STX is used to send audio information to the second terminal device.

[0168] The second terminal device includes at least: I 2 S RX, DDR, Audio, 12STX. 12SRX is used to receive audio information sent by the bridging device, Audio in DDR is used to store audio information, and 12STX is used to output audio information.

[0169] In some possible embodiments, the above-described display method provided in the embodiments of this community also supports USB reverse transmission.

[0170] Based on the same inventive concept, embodiments of this application also provide a display device, such as... Figure 16 As shown, the device includes:

[0171] The first image processing module 16001 is used by the first terminal device to perform first format spoofing on the first image in the four-channel format to obtain a second image in the first target format, and to send the second image in the first target format to the second terminal device; the first image in the four-channel format includes a transparency channel.

[0172] The first data extraction module 16002 is used to receive the second image in the first target format from the second terminal device, extract data from the second image in the four-channel format using the data extraction method corresponding to the four-channel format, and obtain the first image in the four-channel format.

[0173] In some possible embodiments, the first target format is a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in a four-channel format. The first image processing module 16001 is specifically used to: for each pixel in the first image, use the values ​​of the four channels of that pixel in a preset order as the pixel value of one pixel in the second image, thereby obtaining the pixel values ​​of the four pixels in the second image.

[0174] In some possible embodiments, the first data extraction module 16002 is specifically used to: take the pixel value of every 4 pixels in the second image as the value of the 4 channels of a pixel in the first image.

[0175] This application also provides another display device, such as... Figure 17 As shown, the device includes:

[0176] The second image processing module 17001 is used by the first terminal device to perform first format spoofing on the first image in the four-channel format to obtain a second image in the first target format, and to send the second image in the first target format to the bridging device; the first image in the four-channel format includes a transparency channel.

[0177] The third image processing module 17002 is used by the bridging device to disguise the second image of the first target format to a second format, obtain a third image of the second target format, and send the third image of the second target format to the second terminal device.

[0178] The second data extraction module 17003 is used by the second terminal device to extract data from the third image using the data extraction method corresponding to the four-channel format, so as to obtain the first image in the four-channel format.

[0179] In some possible embodiments, the first target format is a 3-channel format, where the number of bits per channel is the same as the number of bits per channel in a 4-channel format. The second image processing module 17001 is specifically configured to: group every 3 pixels as a group according to the order of pixels in the first image; for each group: use the values ​​of the first to third channels of the first 4-channel format pixel as the values ​​of the 3 channels of the first 3-channel format pixel in the second image; use the value of the fourth channel of the first 4-channel format pixel and the values ​​of the first and second channels of the second 4-channel format pixel as the values ​​of the 3 channels of the second 3-channel format pixel in the second image; use the values ​​of the third and fourth channels of the second 4-channel format pixel and the value of the first channel of the third 4-channel format pixel as the values ​​of the 3 channels of the third 3-channel format pixel in the second image; and use the values ​​of the second to fourth channels of the third 4-channel format pixel as the values ​​of the 3 channels of the fourth 3-channel format pixel in the second image.

[0180] In some possible embodiments, the second image processing module 17001 is specifically used for: the first terminal device performing fourth format spoofing on the first image in four-channel format to obtain a fourth image, the fourth image being a four-channel format image including invalid channels; removing invalid channels from the fourth image to obtain a second image in the first target format.

[0181] In some possible embodiments, the second image processing module 17001 is specifically configured to: based on the order of pixels in the first image, group every three pixels into a set; for each set: using the values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel as the values ​​of the four channels of the first four-channel format pixel in the fourth image; using the values ​​of the fourth channel of the first four-channel format pixel, the first channel, the second channel, and the second invalid channel of the second four-channel format pixel as the values ​​of the four channels of the second four-channel format pixel in the fourth image; using the values ​​of the third and fourth channels of the second four-channel format pixel, the first channel, and the third invalid channel of the third four-channel format pixel as the values ​​of the four channels of the third four-channel format pixel in the fourth image; and using the values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

[0182] In some possible embodiments, the second image processing module 17001 is specifically used to: for each pixel in the fourth image, remove invalid channels in the pixel to obtain the three-channel values ​​corresponding to the pixel; and obtain a second image of the first target format based on the three-channel values ​​corresponding to each pixel.

[0183] In some possible embodiments, the first terminal device includes an overlay layer OVL, and the step of removing invalid channels in the fourth image to obtain a second image of the first target format is performed by the OVL.

[0184] In some possible embodiments, the second target format is a single-channel format, where the number of bits per pixel is the same as the number of bits per channel in the three-channel format, and the first target format is a three-channel format. The third image processing module 17002 is specifically used to: for each pixel in the second image, take the values ​​of the three channels of the pixel as the pixel value of a pixel in the third image in a preset order, so as to obtain the pixel value of the three pixels in the third image.

[0185] In some possible embodiments, the second data extraction module 17003 is specifically used to: take the pixel value of every 4 pixels in the third image as the value of the 4 channels of a pixel in the first image.

[0186] In some possible embodiments, when the executing entity is a first terminal device, the display device is as follows: Figure 18 As shown, the device includes:

[0187] The fourth image processing module 18001 is used to perform a first format disguise on the first image in the four-channel format to obtain a second image in the first target format;

[0188] The image sending module 18002 is used to send the second image in the first target format to the second terminal device, so that the second terminal device can extract data from the second image in the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format; the first image in the four-channel format includes a transparency channel.

[0189] In some possible embodiments, the first target format is a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in the four-channel format. The fourth image processing module 18001 is specifically used to: for each pixel in the first image, use the values ​​of the four channels of the pixel in a preset order as the pixel value of one pixel in the second image, thereby obtaining the pixel values ​​of the four pixels in the second image.

[0190] In some possible embodiments, the image sending module 18002 is further configured to: send a second image in a first target format to a bridging device, so that the bridging device performs a second format disguise on the second image in the first target format to obtain a third image in a second target format, and send the third image in the second target format to a second terminal device.

[0191] In some possible embodiments, the first target format is a 3-channel format, where the number of bits per channel is the same as the number of bits per channel in a 4-channel format. The fourth image processing module 18001 is specifically configured to: group every 3 pixels as a group according to the order of pixels in the first image; for each group: use the values ​​of the first to third channels of the first 4-channel format pixel as the values ​​of the 3 channels of the first 3-channel format pixel in the second image; use the value of the fourth channel of the first 4-channel format pixel and the values ​​of the first and second channels of the second 4-channel format pixel as the values ​​of the 3 channels of the second 3-channel format pixel in the second image; use the values ​​of the third and fourth channels of the second 4-channel format pixel and the value of the first channel of the third 4-channel format pixel as the values ​​of the 3 channels of the third 3-channel format pixel in the second image; and use the values ​​of the second to fourth channels of the third 4-channel format pixel as the values ​​of the 3 channels of the fourth 3-channel format pixel in the second image.

[0192] In some possible embodiments, the fourth image processing module 18001 is specifically used to: perform fourth format spoofing on the first image in four-channel format to obtain a fourth image, the fourth image being a four-channel format image including invalid channels; and remove the invalid channels in the fourth image to obtain a second image in the first target format.

[0193] In some possible embodiments, the fourth image processing module 18001 is specifically configured to: group every three pixels in the first image according to their order; for each group: use the values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel as the values ​​of the four channels of the first four-channel format pixel in the fourth image; use the values ​​of the fourth channel of the first four-channel format pixel, the first channel, the second channel, and the second invalid channel of the second four-channel format pixel as the values ​​of the four channels of the second four-channel format pixel in the fourth image; use the values ​​of the third and fourth channels of the second four-channel format pixel, the first channel, and the third invalid channel of the third four-channel format pixel as the values ​​of the four channels of the third four-channel format pixel in the fourth image; and use the values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

[0194] In some possible embodiments, the fourth image processing module 18001 is specifically used to: for each pixel in the fourth image, remove invalid channels in the pixel to obtain the three-channel values ​​corresponding to the pixel; and obtain a second image of the first target format based on the three-channel values ​​corresponding to each pixel.

[0195] In some possible embodiments, when the executing entity is a second terminal device, the display device is as follows: Figure 19 As shown, the device includes:

[0196] The receiving module 19001 is used to receive a second image in a first target format; wherein the second image is obtained by the first terminal device by disguising a first image in a four-channel format using a first format; the first image in the four-channel format includes a transparency channel;

[0197] The third data extraction module 19002 is used to extract data from the second image using a data extraction method corresponding to the four-channel format, so as to obtain the first image in the four-channel format.

[0198] In some possible embodiments, the third data extraction module 19002 is specifically used to: take the pixel value of every 4 pixels in the second image as the value of the 4 channels of a pixel in the first image.

[0199] In some possible embodiments, the third data extraction module 19002 is further configured to: receive a third image in a second target format sent by the bridging device; wherein the third image in the second target format is obtained by the bridging device by disguising the received second image in the first target format with a second format; and extract data from the third image using a data extraction method corresponding to the four-channel format to obtain a first image in the four-channel format.

[0200] Corresponding to the above embodiments, this application also provides an electronic device. Figure 20 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. The electronic device 2000 may include a processor 2001, a memory 2002, and a communication unit 2003. These components communicate through one or more buses. Those skilled in the art will understand that the structure of the electronic device shown in the figure does not constitute a limitation on the embodiment of the present invention. It may be a bus topology or a star topology, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0201] The communication unit 2003 is used to establish a communication channel, enabling the electronic device to communicate with other devices. It receives user data from other devices or sends user data to other devices.

[0202] The processor 2001 serves as the control center of the electronic device, connecting various parts of the device via interfaces and lines. It executes software programs and / or modules stored in the memory 2002 and retrieves data stored in the memory to perform various functions and / or process data. The processor may be composed of integrated circuits (ICs), such as a single packaged IC or multiple packaged ICs with the same or different functions connected together. For example, the processor 2001 may consist only of a central processing unit (CPU). In this embodiment, the CPU may have a single processing core or include multiple processing cores.

[0203] The memory 2002 is used to store the execution instructions of the processor 2001. The memory 2002 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0204] When the execution instructions in memory 2002 are executed by processor 2001, the electronic device 2000 is able to perform operations. Figure 1 Some or all of the steps in the illustrated embodiments.

[0205] In a specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, which, when executed, may include some or all of the steps of the various embodiments of the display method provided by the present invention. The storage medium may be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0206] In some possible implementations, various aspects of the terminal device control method provided in this application can also be implemented in the form of a program product, which includes program code. When the program product is run on a computer device, the program code is used to cause the computer device to perform the steps in a display method according to various exemplary embodiments of this application described above.

[0207] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0208] The program product for controlling a terminal device according to embodiments of this application may employ a portable compact disc read-only memory (CD-ROM) and include program code, and may run on an electronic device. However, the program product of this application is not limited thereto. In this document, the readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0209] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments of the present invention.

[0210] The same or similar parts between the various embodiments in this specification can be referred to mutually. In particular, the device embodiments and terminal embodiments are basically similar to the method embodiments, so the description is relatively simple, and the relevant parts can be referred to the description in the method embodiments.

Claims

1. A display method, characterized in that, The method includes: The first terminal device performs a first format disguise on the first image in the four-channel format to obtain a second image in the first target format, and sends the second image in the first target format to the second terminal device; the first image in the four-channel format includes a transparency channel. The second terminal device receives the second image in the first target format, and extracts data from the second image using the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format.

2. The method according to claim 1, characterized in that, The first target format is a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in the four-channel format. The first terminal device performs a first format disguise on the first image in the four-channel format to obtain a second image in the first target format, including: For each pixel in the first image, the values ​​of the four channels of that pixel are used as the pixel value of one pixel in the second image in a preset order, so as to obtain the pixel values ​​of the four pixels in the second image.

3. The method according to claim 1, characterized in that, The step of extracting data from the second image using the data extraction method corresponding to the four-channel format to obtain the first image in four-channel format includes: The pixel values ​​of every four pixels in the second image are used as the values ​​of the four channels of one pixel in the first image.

4. A display method, characterized in that, The method includes: The first terminal device performs a first format disguise on a first image in a four-channel format to obtain a second image in a first target format, and sends the second image in the first target format to the bridging device; the first image in the four-channel format includes a transparency channel. The bridging device disguises the second image in the first target format with a second format to obtain a third image in the second target format, and sends the third image in the second target format to the second terminal device. The second terminal device extracts data from the third image using the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format.

5. The method according to claim 4, characterized in that, The first target format is a 3-channel format, with each channel having the same number of bits as each channel in the 4-channel format. The first terminal device performs a first format disguise on the first image in the 4-channel format to obtain a second image in the first target format, including: Based on the order of pixels in the first image, group every 3 pixels into a single group; For each combination: The values ​​of the first to third channels of the first four-channel format pixel are used as the values ​​of the three channels of the first three-channel format pixel in the second image; The value of the fourth channel of the first four-channel format pixel and the values ​​of the first and second channels of the second four-channel format pixel are used as the values ​​of the three channels of the second three-channel format pixel in the second image. The values ​​of the third and fourth channels of the second four-channel format pixel and the value of the first channel of the third four-channel format pixel are used as the values ​​of the three channels of the third three-channel format pixel in the second image. The values ​​of the second to fourth channels of the third four-channel format pixel are used as the values ​​of the three channels of the fourth three-channel format pixel in the second image.

6. The method according to claim 4, characterized in that, The first terminal device performs a first format disguise on the first image in a four-channel format to obtain a second image in a first target format, including: The first terminal device performs fourth-format spoofing on the first image in the four-channel format to obtain a fourth image, which is a four-channel format image including invalid channels; Remove invalid channels from the fourth image to obtain a second image in the first target format.

7. The method according to claim 6, characterized in that, The first terminal device performs fourth-format spoofing on the first image in the four-channel format to obtain a fourth image, including: Based on the order of pixels in the first image, every 3 pixels are grouped together: For each combination: The values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel are used as the values ​​of the four channels of the first four-channel format pixel in the fourth image. The value of the fourth channel in the first four-channel format pixel, the value of the first channel, the value of the second channel, and the value of the second invalid channel in the second four-channel format pixel are used as the values ​​of the four channels of the second four-channel format pixel in the fourth image. The values ​​of the third and fourth channels of the second four-channel format pixel, the value of the first channel of the third four-channel format pixel, and the value of the third invalid channel are used as the values ​​of the four channels of the third four-channel format pixel in the fourth image. The values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel are used as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

8. The method according to any one of claims 6 or 7, characterized in that, The step of removing invalid channels from the fourth image to obtain a second image in the first target format includes: For each pixel in the fourth image, invalid channels in the pixel are removed to obtain the three-channel values ​​corresponding to the pixel; The second image in the first target format is obtained based on the three-way value corresponding to each pixel.

9. The method according to claim 6, characterized in that, The first terminal device includes an overlay layer OVL, and the step of removing invalid channels from the fourth image to obtain a second image of the first target format is performed by the OVL.

10. The method according to any one of claims 4 to 9, characterized in that, The second target format is a single-channel format, where the number of bits per pixel is the same as the number of bits per channel in the three-channel format. The first target format is a three-channel format. The bridging device performs a second-format disguise on the second image of the first target format to obtain a third image of the second target format, including: For each pixel in the second image, the values ​​of the three channels of that pixel are used as the pixel value of one pixel in the third image in a preset order, so as to obtain the pixel values ​​of the three pixels in the third image.

11. The method according to any one of claims 4 to 10, characterized in that, The second terminal device extracts data from the third image using the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format, including: The pixel values ​​of every four pixels in the third image are used as the values ​​of the four channels of one pixel in the first image.

12. A display method, characterized in that, Applied to a first terminal device, the method includes: The first image in four-channel format is disguised in a first format to obtain a second image in the first target format. The second image in the first target format is sent to the second terminal device, so that the second terminal device extracts data from the second image using the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format; the first image in the four-channel format includes a transparency channel.

13. The method according to claim 12, characterized in that, The first target format is a single-channel format, where the number of bits per pixel value is the same as the number of bits per channel in the four-channel format. The step of performing a first format disguise on the first image in the four-channel format to obtain a second image in the first target format includes: For each pixel in the first image, the values ​​of the four channels of that pixel are used as the pixel value of one pixel in the second image in a preset order, so as to obtain the pixel values ​​of the four pixels in the second image.

14. The method according to claim 12, characterized in that, After obtaining the second image in the first target format, the method further includes: The second image in the first target format is sent to the bridging device, so that the bridging device performs a second format disguise on the second image in the first target format to obtain a third image in the second target format, and sends the third image in the second target format to the second terminal device.

15. The method according to claim 14, characterized in that, The first target format is a 3-channel format, with each channel having the same number of bits as each channel in the 4-channel format. The step of performing a first format disguise on the first image in the 4-channel format to obtain a second image in the first target format includes: Based on the order of pixels in the first image, group every 3 pixels into a single group; For each combination: The values ​​of the first to third channels of the first four-channel format pixel are used as the values ​​of the three channels of the first three-channel format pixel in the second image; The value of the fourth channel of the first four-channel format pixel and the values ​​of the first and second channels of the second four-channel format pixel are used as the values ​​of the three channels of the second three-channel format pixel in the second image. The values ​​of the third and fourth channels of the second four-channel format pixel and the value of the first channel of the third four-channel format pixel are used as the values ​​of the three channels of the third three-channel format pixel in the second image. The values ​​of the second to fourth channels of the third four-channel format pixel are used as the values ​​of the three channels of the fourth three-channel format pixel in the second image.

16. The method according to claim 12, characterized in that, The step of performing a first format disguise on a first image in a four-channel format to obtain a second image in a first target format includes: The first image in the four-channel format is disguised with a fourth format to obtain a fourth image, which is a four-channel format image including invalid channels; Remove invalid channels from the fourth image to obtain a second image in the first target format.

17. The method according to claim 16, characterized in that, The process of masquerading the first image in the four-channel format to obtain the fourth image includes: Based on the order of pixels in the first image, group every 3 pixels as a unit: For each combination: The values ​​of the first to third channels of the first four-channel format pixel and the value of the first invalid channel are used as the values ​​of the four channels of the first four-channel format pixel in the fourth image. The value of the fourth channel in the first four-channel format pixel, the value of the first channel, the value of the second channel, and the value of the second invalid channel in the second four-channel format pixel are used as the values ​​of the four channels of the second four-channel format pixel in the fourth image. The values ​​of the third and fourth channels of the second four-channel format pixel, the value of the first channel of the third four-channel format pixel, and the value of the third invalid channel are used as the values ​​of the four channels of the third four-channel format pixel in the fourth image. The values ​​of the second to fourth channels of the third four-channel format pixel and the value of the fourth invalid channel are used as the values ​​of the four channels of the fourth four-channel format pixel in the fourth image.

18. The method according to any one of claims 16 or 17, characterized in that, The step of removing invalid channels from the fourth image to obtain a second image in the first target format includes: For each pixel in the fourth image, invalid channels in the pixel are removed to obtain the three-channel values ​​corresponding to the pixel; The second image in the first target format is obtained based on the three-way value corresponding to each pixel.

19. A display method, characterized in that, Applied to a second terminal device, the method includes: Receive a second image in a first target format; wherein the second image is obtained by the first terminal device by disguising a first image in a four-channel format using a first format; the first image in the four-channel format includes a transparency channel; Data is extracted from the second image using the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format.

20. The method according to claim 19, characterized in that, The data extraction of the second image using the data extraction method corresponding to the four-channel format includes: The pixel values ​​of every four pixels in the second image are used as the values ​​of the four channels of one pixel in the first image.

21. The method according to claim 19, characterized in that, The method further includes: The bridging device receives a third image in a second target format; wherein the third image in the second target format is obtained by the bridging device by disguising the received second image in a first target format with a second format. Data is extracted from the third image using the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format.

22. A display device, characterized in that, The device includes: A first image processing module is used by a first terminal device to perform a first format disguise on a first image in a four-channel format to obtain a second image in a first target format, and to send the second image in the first target format to a second terminal device; the first image in the four-channel format includes a transparency channel. The first data extraction module is used to receive the second image in the first target format from the second terminal device, and extract data from the second image in the data extraction method corresponding to the four-channel format to obtain the first image in the four-channel format.

23. A display device, characterized in that, The method includes: The second image processing module is used by the first terminal device to perform first format spoofing on the first image in the four-channel format to obtain a second image in the first target format, and to send the second image in the first target format to the bridging device; the first image in the four-channel format includes a transparency channel. The third image processing module is used by the bridging device to disguise the second image of the first target format into a second format, obtain a third image of the second target format, and send the third image of the second target format to the second terminal device. The second data extraction module is used by the second terminal device to extract data from the third image using the data extraction method corresponding to the four-channel format, so as to obtain the first image in the four-channel format.

24. A display device, characterized in that, Applied to a first terminal device, the device includes: The fourth image processing module is used to perform a first format disguise on the first image in the four-channel format to obtain a second image in the first target format; An image sending module is used to send a second image in the first target format to a second terminal device, so that the second terminal device can extract data from the second image using the data extraction method corresponding to the four-channel format to obtain a first image in the four-channel format; the first image in the four-channel format includes a transparency channel.

25. A display device, characterized in that, Applied to a second terminal device, the device includes: A receiving module is configured to receive a second image in a first target format; wherein the second image is obtained by the first terminal device by disguising a first image in a four-channel format using a first format; the first image in the four-channel format includes a transparency channel; The third data extraction module is used to extract data from the second image using a data extraction method corresponding to the four-channel format, so as to obtain the first image in the four-channel format.

26. An electronic device, characterized in that, It includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to perform the method of any one of claims 1-21.

27. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein, when the program is executed, it controls the device on which the computer-readable storage medium is located to perform the method of any one of claims 1-21.

28. A computer program product, characterized in that, The computer program product includes: computer program code, which, when run on a computer, causes the computer to perform the method described in any one of claims 1-21.

Images