Image transmission apparatus and method, processor, and virtual reality chip

Abstract

Embodiments of the present disclosure provide an image transmission apparatus and method, a processor, and a virtual reality chip. A master processor is connected to a slave processor by means of a mobile industry processor interface. An apparatus applied to the master processor comprises: a data arrangement module, used for respectively performing data arrangement on Alpha data and RGB data of an image in an application, the Alpha data and the RGB data being arranged to different data regions; and a sending control module, used for sending the arranged Alpha data and RGB data by means of the mobile industry processor interface. In the embodiments of the present disclosure, the master processor transmits the image comprising the Alpha data and the RGB data to the slave processor by means of the mobile industry processor interface, which does not affect a transmission protocol of the mobile industry processor interface, and has good universality.

Description

Image transmission devices, methods, processors, and virtual reality chips Technical Field

[0001] This disclosure relates to the field of image transmission technology, and more particularly to an image transmission device, method, processor, and virtual reality chip. Background Technology

[0002] In virtual and real-world display scenarios, images require not only RGB data but also alpha data. The main processor typically connects to the slave processor via the Mobile Industry Processor Interface (MIPI). However, the image format defined by the MIPI transmission protocol does not specify alpha data; therefore, the main processor cannot send image data including alpha data to the slave processor via the MIPI.

[0003] Therefore, how to use mobile industry processor interfaces to achieve image transmission including Alpha and RGB data has become an urgent technical problem to be solved. Summary of the Invention

[0004] In view of the above, embodiments of this disclosure provide an image transmission apparatus, method, processor, and virtual reality chip to at least solve or alleviate the above-mentioned problems.

[0005] According to a first aspect of the present disclosure, an image transmission apparatus is provided, applied to a main processor, the main processor being connected to a slave processor via a mobile industrial processor interface. The apparatus includes: a data arrangement module, configured to arrange alpha data and RGB data of an image in an application into different data regions; and a transmission control module, configured to transmit the arranged alpha data and RGB data via the mobile industrial processor interface; wherein the alpha data and RGB data are received by the slave processor and merged to form an ARGB format image slave processor.

[0006] According to a second aspect of the present disclosure, an image transmission apparatus is provided, applied to a slave processor, the slave processor being connected to a main processor via a mobile industrial processor interface. The apparatus includes: a receiving control module, configured to receive alpha data and RGB data sent by the mobile industrial processor interface, the alpha data and the RGB data being respectively arranged in different data regions of an image in the application; and a data merging module, configured to merge the received alpha data and the RGB data to form an ARGB format image.

[0007] According to a third aspect of the present disclosure, a main processor is provided, including the image transmission apparatus described in the first aspect above.

[0008] According to a fourth aspect of the present disclosure, a processor is provided, including the image transmission apparatus described in the second aspect above.

[0009] According to a fifth aspect of the present disclosure, a mixed reality chip is provided, comprising: a main processor and a slave processor; the main processor and the slave processor are connected via a mobile industrial processor interface; the main processor includes an image transmission device according to a first aspect; and the slave processor includes an image transmission device according to a second aspect.

[0010] According to a sixth aspect of the present disclosure, an image transmission method is provided, applied to a main processor, the main processor being connected to a slave processor via a mobile industrial processor interface, the method comprising: arranging alpha data and RGB data of an image in an application into different data regions; and transmitting the arranged alpha data and RGB data through the mobile industrial processor interface; wherein the alpha data and RGB data are received by the slave processor and merged to form an ARGB format image.

[0011] According to a seventh aspect of the present disclosure, an image transmission method is provided, applied to a slave processor, the slave processor being connected to a main processor via a mobile industry processor interface, the method comprising: receiving alpha data and RGB data sent by the mobile industry processor interface, the alpha data and the RGB data being respectively arranged in different data regions of an image in an application; and merging the received alpha data and the RGB data to form an ARGB format image.

[0012] According to the image transmission scheme provided in this disclosure, the main processor arranges the alpha and RGB data of the image in the application into different data regions, and sends the arranged alpha and RGB data through a mobile industry processor interface. The slave processor receives the alpha and RGB data and merges them to form an ARGB format image. In this disclosure, the main processor transmits the image including alpha and RGB data to the slave processor through the mobile industry processor interface, which has no impact on the transmission protocol of the mobile industry processor interface and has good versatility. Attached Figure Description

[0013] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings.

[0014] Figure 1 is a schematic diagram of a mixed reality chip according to an embodiment of the present disclosure;

[0015] Figure 2 is a schematic diagram of a mixed reality chip according to another embodiment of this disclosure;

[0016] Figure 3 is a schematic diagram of a main processor according to an embodiment of the present disclosure;

[0017] Figure 4 is a schematic diagram of the main processor according to another embodiment of this disclosure;

[0018] Figure 5 is a schematic diagram of a processor according to an embodiment of the present disclosure;

[0019] Figure 6 is a schematic diagram of a slave processor according to another embodiment of the present disclosure;

[0020] Figure 7 is a schematic diagram of an image transmission device applied to a main processor according to an embodiment of the present disclosure;

[0021] Figure 8 is a schematic diagram of a data area according to an embodiment of this disclosure;

[0022] Figure 9 is a schematic diagram of a data arrangement module of an image transmission device applied to a main processor according to an embodiment of the present disclosure;

[0023] Figure 10 is a schematic diagram of an image transmission device applied to a main processor according to another embodiment of the present disclosure;

[0024] Figure 11 is a schematic diagram of the data area according to another embodiment of this disclosure;

[0025] Figure 12 is a schematic diagram of a data arrangement module of an image transmission device applied to a main processor according to another embodiment of the present disclosure;

[0026] Figure 13 is a schematic diagram of an image transmission device applied to a main processor according to another embodiment of the present disclosure;

[0027] Figure 14 is a schematic diagram of an image transmission device applied to a processor according to an embodiment of the present disclosure;

[0028] Figure 15 is a schematic diagram of a data merging module applied to an image transmission device from a processor according to another embodiment of the present disclosure;

[0029] Figure 16 is a schematic diagram of an image transmission device applied to a processor according to another embodiment of the present disclosure;

[0030] Figure 17 is a schematic diagram of an image transmission device applied to a processor according to another embodiment of the present disclosure;

[0031] Figure 18 is a schematic diagram of the image transmission process of a mixed reality chip according to another embodiment of the present disclosure;

[0032] Figure 19 is a schematic diagram of the image transmission process of a mixed reality chip according to another embodiment of the present disclosure;

[0033] Figure 20 is a flowchart of an image transmission method according to an embodiment of the present disclosure;

[0034] Figure 21 is a flowchart of an image transmission method according to another embodiment of the present disclosure. Detailed Implementation

[0035] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0036] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0037] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0038] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0039] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0040] First, some of the nouns or terms that appear in the description of the embodiments of this disclosure are to be interpreted as follows.

[0041] Mobile Industry Processor Interface (MIPI): This is an open standard and specification developed by the MIPI Alliance for mobile application main processors. Its serial interface (Display Serial Interface, DSI) can efficiently transmit displayed image data from the main processor to the slave processor of the display panel, thereby achieving high-quality image display.

[0042] Display Stream Compression (DSC) is a video compression technique designed to reduce the bandwidth required for video data transmission and storage while maintaining visually lossless image quality.

[0043] Mixed Reality (MR) is a further development of virtual reality technology. This technology enhances the realism of the user experience by presenting virtual scene information within a real-world environment, creating an interactive feedback loop between the real world, the virtual world, and the user. Mixed Reality display data includes alpha data, which refers to the transparency of colors.

[0044] The image transmission scheme provided by the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings.

[0045] Mixed Reality Chip

[0046] Figures 1 and 2 respectively show schematic diagrams of two mixed reality chips 1 applicable to image transmission methods according to embodiments of the present disclosure. As shown in Figures 1 and 2, the mixed reality chip 1 includes a main processor 11 and a slave processor 12, which can be built based on various types of main processors.

[0047] As shown in Figures 1 and 2, the main processor 11 and the slave processor 12 of the mixed reality chip 1 are connected through a mobile industry processor interface 13, which includes a transmit port (TX) and a receive port (RX).

[0048] The main processor 11 is used to transmit image data to the slave processor 12 via the mobile industry processor interface 13, and the slave processor 12 is used to receive the image data.

[0049] The main processor 11 transmits image data, including alpha data and RGB data, to the slave processor 12 via the mobile industry processor interface 13.

[0050] For example, the processor can be a display driver. The processor 12 receives alpha and RGB data and displays the received alpha and RGB data on the display screen.

[0051] Image transmission device 100 is applied to main processor 11, and image transmission device 200 is applied to slave processor 12.

[0052] In this embodiment, the image transmission device 100 applied to the main processor 11 arranges the Alpha data and RGB data of the image in the application into different data areas.

[0053] Referring to Figure 1, in this embodiment, the image transmission device 100 applied to the main processor 11 selects and sets a first transmitting port 1311 and a second transmitting port 1312 in the mobile industrial processor interface 13. The first transmitting port 1311 and the second transmitting port 1312 are used to transmit Alpha data and RGB data after data arrangement, respectively. In this embodiment, the image transmission device 200 applied to the slave processor 12 selects and sets a first receiving port 1321 and a second receiving port 1322 in the mobile industrial processor interface 13. The first receiving port 1321 is used to receive the Alpha data transmitted by the first transmitting port 1311, and the second receiving port 1322 is used to receive the RGB data transmitted by the second transmitting port 1312. In this embodiment, the image transmission device 200 applied to the slave processor 12 merges the received Alpha data and RGB data to form an ARGB format image.

[0054] Referring to Figure 2, in this embodiment, the image transmission device 100 applied to the main processor 11 selects a third transmitting port 1313 in the mobile industrial processor interface 13. The third transmitting port 1313 is used to transmit the arranged Alpha data and RGB data. In this embodiment, the image transmission device 200 applied to the slave processor 12 selects a third receiving port 1323 in the mobile industrial processor interface 13. The third receiving port 1323 is used to receive the Alpha data and RGB data transmitted by the third transmitting port 1313. In this embodiment, the image transmission device 200 applied to the slave processor 12 merges the received Alpha data and RGB data to form an ARGB format image.

[0055] This disclosure focuses on describing the process of image transmission by the mixed reality chip 1. The internal structures of the image transmission device 100 and the image transmission device 200 will be described in detail below.

[0056] It should be noted that the structure of the mixed reality chip 1 may vary depending on the motherboard, operating system, and instruction set architecture. This disclosure does not limit the specific structure of the mixed reality chip 1, nor the number of main processors 11 and slave processors 12 included in the mixed reality chip 1.

[0057] main processor

[0058] Figures 3 and 4 show schematic block diagrams of two main processors 11. As shown in Figures 3 and 4, the main processor 11 includes an image transmission device 100. The image transmission device 100 is a dedicated circuit designed primarily for image transmission by the main processor 11 in this embodiment of the disclosure. The main processor 11 may be a main processor (CPU) for data processing and / or instruction execution, an image processing unit (GPU), a processing element (PE), an application-specific integrated circuit (ASIC), or a field-programmable gate array (FPGA), etc., and this disclosure does not limit the scope of the application-specific integrated circuit.

[0059] Referring to Figure 3, the image transmission device 100 is applied to the main processor 11 in this embodiment of the present disclosure. The image transmission device 100 arranges the alpha data and RGB data of the image in the application into different data areas. The image transmission device 100 selects and sets a first transmission port 1311 and a second transmission port 1312 in the mobile industrial processor interface 13. The first transmission port 1311 and the second transmission port 1312 are used to transmit the arranged alpha data and RGB data, respectively.

[0060] Referring to Figure 4, the image transmission device 100 is applied to the main processor 11 in this embodiment of the present disclosure. The image transmission device 100 arranges the alpha data and RGB data of the image in the application into different data areas. The image transmission device 100 selects and sets a third transmission port 1313 in the mobile industrial processor interface 13. The third transmission port 1313 is used to transmit the arranged alpha data and RGB data.

[0061] This disclosure focuses on describing the process of image transmission performed by the main processor 11. The internal structure of the image transmission device 100 will be described in detail later.

[0062] From the processor

[0063] Figures 5 and 6 show schematic block diagrams of two slave processors 12. As shown in Figures 5 and 6, the slave processor 12 includes an image transmission device 200. The image transmission device 200 is a dedicated circuit designed primarily for image transmission from the slave processor 12 in this embodiment of the disclosure. The slave processor 12 may be a driver for data processing and / or instruction execution, which is not limited in this disclosure.

[0064] Referring to Figure 5, in this embodiment of the image transmission device 200 applied to the processor 12, a first receiving port 1321 and a second receiving port 1322 are selected and configured in the mobile industrial processor interface 13. The first receiving port 1321 and the second receiving port 1322 are respectively used to receive Alpha data sent by the first transmitting port 1311 and RGB data sent by the second transmitting port 1312. In this embodiment of the image transmission device 200 applied to the processor 12 merges the received Alpha data and RGB data to form an ARGB format image.

[0065] Referring to Figure 6, in this embodiment of the image transmission device 200 applied to the processor 12, a third receiving port 1323 is selected in the mobile industrial processor interface 13. The third receiving port 1323 is used to receive Alpha data and RGB data transmitted by the third transmitting port 1313. In this embodiment of the image transmission device 200 applied to the processor 12 merges the received Alpha data and RGB data to form an ARGB format image.

[0066] This disclosure focuses on describing the process of image transmission from processor 12, and the internal structure of image transmission device 200 will be described in detail later.

[0067] Image transmission device

[0068] Figure 7 is a schematic diagram of the internal structure of an image transmission device 100 according to an embodiment of the present disclosure. The image transmission device 100 is applied to the main processor 11.

[0069] As shown in Figure 7, the image transmission device 100 includes a data arrangement module 101 and a transmission control module 102.

[0070] The data arrangement module 101 can arrange the Alpha data and RGB data of the image in the application separately, and arrange the Alpha data and RGB data into different data areas.

[0071] In some embodiments, referring to Figure 8, the different data regions are a first image and a second image. Both the first image and the second image have a width of W and a height of H, and are arranged horizontally side by side. Here, W and H are both positive numbers.

[0072] It is worth noting that the first image can be located on the left and the second image can be located on the right; or the first image can be located on the right and the second image can be located on the left.

[0073] The transmission control module 102 selects and sets a first transmission port 1311 and a second transmission port 1312 in the mobile industrial processor interface 13. The first transmission port 1311 and the second transmission port 1312 are used to transmit the alpha data of the first image and the RGB data of the second image, respectively.

[0074] The processor 12 receives Alpha data sent from the first transmission port 1311 and RGB data sent from the second transmission port 1312, and combines them to form an ARGB format image.

[0075] In this embodiment, the main processor 11 transmits an image including Alpha and RGB data to the slave processor 12 through the mobile industry processor interface 13. This does not affect the transmission protocol of the mobile industry processor interface 13 and has good versatility.

[0076] In some embodiments, referring to FIG9, the data arrangement module 101 includes:

[0077] Filling unit 1011 is used to fill each Alpha component in the Alpha data with two placeholders.

[0078] Specifically, the placeholder can be 0 or any other character that implements placeholder filling.

[0079] Since each RGB component in RGB data has three bits (R, G, B), each Alpha component is padded with two placeholders to ensure that the number of bits in each RGB component is the same as the number of placeholders and Alpha components.

[0080] The first arrangement unit 1012 is used to arrange each Alpha component and placeholder in the first image row by row, and to arrange each RGB component in the RGB data in the second image row by row.

[0081] Referring to Figure 8, after the filling unit 1011 fills each Alpha component with two placeholders, the data volume of the first image arranged by the first arrangement unit 1012 is the same as that of the second image. The transmission control module 102 selects the set first transmission port 1311 to transmit the data of the first image, and the transmission control module 102 selects the set second transmission port 1312 to transmit the data of the second image. Since the data volume of the first image and the second image transmitted by the first transmission port 1311 and the second transmission port 1312 are the same, and the specifications of the first transmission port 1311 and the second transmission port 1312 are the same, the data received from the processor 12 transmitted by the first transmission port 1311 and the second transmission port 1312 can be merged into an ARGB format image without complex algorithm processing.

[0082] In some other embodiments, as shown in FIG10, the image transmission device 100 includes a data arrangement module 101 and a transmission control module 102.

[0083] The data arrangement module 101 can arrange the Alpha data and RGB data of the image in the application separately, and arrange the Alpha data and RGB data into different data areas.

[0084] Referring to Figure 11, the different data regions are the first and second partitions of the image, which are two regions that are equally divided in the horizontal direction. The image has a width of 2W and a height of H.

[0085] The transmission control module 102 selects and sets a third transmission port 1313 in the mobile industrial processor interface 13. The third transmission port 1313 transmits the Alpha data and RGB data after data arrangement.

[0086] The processor 12 receives Alpha data sent from the first transmission port 1311 and RGB data sent from the second transmission port 1312, and combines them to form an ARGB format image.

[0087] In this embodiment, the main processor 11 transmits an image including Alpha and RGB data to the slave processor 12 through the mobile industry processor interface 13. This does not affect the transmission protocol of the mobile industry processor interface 13 and has good versatility.

[0088] Referring to Figure 12, the data arrangement module 101 includes:

[0089] Filling unit 1011 is used to fill each Alpha component in the Alpha data with two placeholders.

[0090] Specifically, the placeholder can be 0 or any other character that implements placeholder filling.

[0091] Since each RGB component in RGB data has three bits (R, G, B), each Alpha component is padded with two placeholders to ensure that the number of bits in each RGB component is the same as the number of placeholders and Alpha components.

[0092] The second arrangement unit 1013 is used to arrange each Alpha component and each placeholder in the first partition row by row, and to arrange each RGB component in the RGB data in the second partition row by row.

[0093] Referring to Figure 11, after the filling unit 1011 fills each Alpha component with two placeholders, the data volume of the first partition and the second partition after the second arrangement unit 1013 is the same. The transmission control module 102 selects and sets a third transmission port 1313 to transmit the data of the first partition and the data of the second partition. Since the data volume of the first partition and the second partition is the same, the data received from the processor 12 via the third transmission port 1313 can be merged into an ARGB format image without complex algorithm processing.

[0094] In some other embodiments, referring to Figure 11, the first partition is the partition located on the left side of the image, and the second partition is the partition on the right side of the image. The data of the first partition is received from the processor 12 first, that is, the processor 12 receives the alpha component and placeholder of the first partition before receiving the RGB data of the second partition.

[0095] While waiting to receive RGB data, the processor 12 can first separate and cache the alpha component and placeholder of the received first partition, and then merge it with the received RGB data to form an ARGB format image. Since the alpha component is only one bit after separating the placeholder, the buffer for caching alpha data in this embodiment is relatively small. The specific method by which the processor 12 separates and caches the alpha component and placeholder of the received first partition will be described in detail in the description of the data transmission device 200.

[0096] It is worth noting that, in this embodiment, the first partition can be the partition located on the right side of the image, and the second partition can be the partition on the left side of the image. The processor 12 can also cache the received RGB data, wait for the alpha component and placeholders to be received, and then perform placeholder separation processing, merging the alpha component and the received RGB data to form an ARGB format image. However, since the RGB component is three bits, the cache for caching RGB data in this embodiment will be larger than the cache for caching alpha data.

[0097] In some other embodiments, referring to Figures 8 and 11, the filling unit 1011 sets the Alpha component in the high bits of the image and the placeholder is set in the low bits of the image.

[0098] Referring to Figure 13, the image transmission device 100 also includes:

[0099] The encoding module 103 is used to perform display stream compression encoding processing on the image arranged by the data arrangement module 101.

[0100] Since the display stream compression encoding process results in less data distortion in the high bits of the image, the Alpha component is set in the high bits of the image, which reduces the compression distortion of the Alpha component after the encoding module 103 performs the display stream compression encoding process.

[0101] Figure 14 is a schematic diagram of the internal structure of an image transmission device 200 according to an embodiment of the present disclosure. The image transmission device 200 is applied to a processor 12. As shown in Figure 14, the image transmission device 200 includes a receiving control module 201 and a data merging module 202.

[0102] The receiving control module 201 can receive Alpha data and RGB data sent by the mobile industrial processor interface 13.

[0103] Alpha data and RGB data are respectively distributed into different data regions of the image in the application.

[0104] The data merging module 202 can merge the received Alpha data and RGB data to form an ARGB format image.

[0105] In this embodiment, the main processor 11 transmits an image including Alpha and RGB data to the slave processor 12 through the mobile industry processor interface 13. This does not affect the transmission protocol of the mobile industry processor interface 13 and has good versatility.

[0106] In some embodiments, different data regions are shown in Figure 8. The different data regions are a first image and a second image. The Alpha data in the first image includes each Alpha component and a two-digit placeholder filled with each Alpha component.

[0107] In other embodiments, different data regions are shown in Figure 11. The different data regions are the first region and the second region of the image. The Alpha data in the first region includes each Alpha component and a two-bit placeholder filled with each Alpha component.

[0108] Referring to Figure 15, the data merging module 202 includes:

[0109] The component separation unit 2021 is used to separate and discard placeholders in the Alpha data.

[0110] The merging processing unit 2022 is used to merge the Alpha data (after the placeholders are discarded by the component separation unit) with the RGB data to form an ARGB format image.

[0111] As shown in Figures 8 and 11, the data volume of the first image and the second image is the same, or the data volume of the first region and the second region is the same. The data merging module 202 only needs to set the component separation unit 2021 to separate the placeholders in the Alpha data, and the merging processing unit 2022 can then merge the Alpha data (after discarding the placeholders) with the RGB data to form an ARGB format image. In this embodiment, the data merging module 202 can merge Alpha data and RGB data to form an ARGB format image without complex algorithm processing.

[0112] In other embodiments, the alpha component in Figure 8 is set in the high bit of the image, and the placeholder is set in the low bit of the image.

[0113] Referring to Figure 16, the receiving control module 201 is specifically used to select and set the first receiving port 1321 and the second receiving port 1322 in the mobile industrial processor interface 13. The first receiving port 1321 receives Alpha data sent by the first transmitting port 1311, and the second receiving port 1322 receives RGB data sent by the second transmitting port 1312.

[0114] Referring to Figure 16, the image transmission device 200 also includes:

[0115] The first decoding module 203 is used to perform display stream compression decoding processing on the Alpha data received by the first receiving port 1321.

[0116] The second decoding module 204 is used to perform display stream compression decoding processing on the RGB data received by the second receiving port 1322.

[0117] The component separation unit 2021 is specifically used to separate the placeholders in the decoded Alpha data and discard the placeholders.

[0118] The merging processing unit 2022 is specifically used to merge the Alpha data after the component separation unit 2021 discards the placeholders with the decoded RGB data to form an ARGB format image.

[0119] Since display stream compression processing results in less data distortion in the high bits of the image, the Alpha component is set in the high bits of the image. The Alpha component obtained after the first decoding unit 2023 performs display stream compression decoding processing has low compression distortion.

[0120] In some other embodiments, the alpha component in Figure 11 is set in the high bit of the image, and the placeholder is set in the low bit of the image.

[0121] Referring to Figure 17, the receiving control module 201 is specifically used to select and set a third receiving port 1323 in the mobile industrial processor interface 13. The third receiving port 1323 receives Alpha data and RGB data transmitted by the third transmitting port 1313.

[0122] The image transmission device 200 also includes:

[0123] The third decoding module 205 is used to perform display stream compression decoding processing on the Alpha data and RGB data received by the third receiving port 1323.

[0124] The component separation unit 2021 is specifically used to separate the placeholders in the decoded Alpha data and discard the placeholders.

[0125] The merging processing unit 2022 is specifically used to merge the Alpha data after the component separation unit 2021 discards the placeholders with the decoded RGB data to form an ARGB format image.

[0126] Since display stream compression processing results in less data distortion in the high bits of the image, the Alpha component is set in the high bits of the image. The Alpha component obtained after the third decoding unit 2025 performs display stream compression decoding processing has low compression distortion.

[0127] In some other embodiments, as shown in FIG11, the first partition is the partition on the left side of the image, and the second partition is the partition on the right side of the image.

[0128] Referring to Figure 17, the image transmission device 200 also includes:

[0129] The cache control module 206 is used to cache the Alpha data after the component separation unit 2021 discards the placeholders to the cache (not shown in the figure).

[0130] The merging processing unit 2022 is specifically used to merge each group of RGB components in the decoded RGB data with the Alpha components corresponding to the RGB components in the buffer to form an ARGB format image.

[0131] Since the first partition is the left side of the image and the second partition is the right side, the cache control module 206 caches the Alpha component after the component separation unit 2021 discards the placeholders into the cache. The merging processing unit 2022 waits to receive RGB data, and based on a set of RGB components in the received RGB data, reads the corresponding Alpha component from the cache, and then merges the set of RGB components with the corresponding Alpha component to form an ARGB component. After merging each set of RGB components and its corresponding Alpha component in the RGB data, the merging processing unit 2022 generates an ARGB image.

[0132] When waiting to receive RGB data, the cache control module 206 can first separate and cache the Alpha component and placeholder of the received first partition. Since the Alpha component is only one bit after separating the placeholder, the cache for caching Alpha data in this embodiment is relatively small.

[0133] As shown in Figure 11, each line of an image frame is 6 bits, consisting of an Alpha component, two placeholders, and three RGB components. Therefore, the Alpha component occupies 1 / 6 of the line space, and the buffer is a 1 / 6 line buffer.

[0134] It is worth noting that, in this embodiment, the first partition can also be the partition located on the right side of the image, and the second partition can be the partition on the left side of the image. The cache control module 206 can also cache the received RGB data, wait for the Alpha component and placeholders to be received, and then perform placeholder separation processing, merging the Alpha component and the received RGB data to form an ARGB format image. Since the RGB component is three bits, the cache for caching the RGB data is larger than the cache for caching the Alpha component after separating the placeholders.

[0135] The process of image transmission between image transmission device 100 and image transmission device 200 will be described below with reference to the mixed reality chips shown in Figures 18 and 19.

[0136] The image transmission process in the mixed reality chip shown in Figure 18 is as follows:

[0137] A1. The data arrangement module 101 in the image transmission device 100 arranges the Alpha data and RGB data of the image in the application separately.

[0138] As shown in Figure 8, the Alpha data and the RGB data are arranged in different data regions, namely the first image and the second image. The Alpha data in the first image includes each Alpha component and a two-bit placeholder that fills each Alpha component. The Alpha components are set in the high position of the image, and the placeholders are set in the low position of the image.

[0139] A2. The encoding module 103 in the image transmission device 100 performs display stream compression encoding processing on the image.

[0140] A3. In the image transmission device 100, the transmission control module 102 selects to set the first transmission port 1311 to send Alpha data and selects to set the second transmission port 1312 to send RGB data in the mobile industrial processor interface 13.

[0141] A4. The receiving control module 201 in the image transmission device 200 selects to set the first receiving port 1321 to receive the encoded Alpha data sent by the first sending port 1311 in the mobile industrial processor interface 13, and selects to set the second receiving port 1322 to receive the encoded RGB data sent by the second sending port 1311.

[0142] A5. The first decoding module 203 of the data merging module 202 in the image transmission device 200 performs display stream compression decoding processing on the Alpha data received by the first receiving port 1321; the second decoding module 204 of the data merging module 202 in the image transmission device 200 performs display stream compression decoding processing on the RGB data received by the second receiving port 1322.

[0143] A6. The component separation unit 2021 of the data merging module 202 in the image transmission device 200 separates the placeholders in the decoded Alpha data and discards the placeholders.

[0144] A7. The merging processing unit 2022 of the data merging module 202 in the image transmission device 200 merges the Alpha data after the component separation unit 2021 discards the placeholders with the decoded RGB data to form an ARGB format image.

[0145] The image transmission process in the mixed reality chip shown in Figure 19 is as follows:

[0146] B1. The data arrangement module 101 in the image transmission device 100 arranges the Alpha data and RGB data of the image in the application separately.

[0147] As shown in Figure 9, the alpha data and RGB data are arranged in different data regions, namely the first and second partitions of the image. The first partition is the left side of the image, and the second partition is the right side of the image. The alpha data in the first partition includes each alpha component and a two-bit placeholder corresponding to each alpha component. The alpha components are set in the high bits of the image, and the placeholders are set in the low bits.

[0148] B2. The encoding module 103 in the image transmission device 100 performs display stream compression encoding processing on the image.

[0149] B3. The transmission control module 102 in the image transmission device 100 selects and sets a third transmission port 1313 in the mobile industrial processor interface 13 to transmit Alpha data and RGB data.

[0150] B4. The receiving control module 201 in the image transmission device 200 selects and sets a third receiving port 1323 in the mobile industrial processor interface 13 to receive encoded Alpha data and encoded RGB data.

[0151] B5. The third decoding unit 2025 of the data merging module 202 in the image transmission device 200 performs display stream compression decoding processing on the Alpha data and RGB data received by the third receiving port 1321.

[0152] B6. The component separation unit 2021 of the data merging module 202 in the image transmission device 200 separates the placeholders in the decoded Alpha data and discards the placeholders.

[0153] B7. The buffer control unit 2026 in the image transmission device 200 buffers the Alpha data after the component separation unit 2021 discards the placeholders into the buffer.

[0154] B8. The merging processing unit 2022 in the image transmission device 200 merges each group of RGB components in the decoded RGB data with the Alpha components corresponding to the RGB components in the buffer to form an ARGB format image.

[0155] Image transmission methods

[0156] Figure 20 shows a flowchart of an image transmission method according to an embodiment of the present disclosure. This image transmission method can be executed by the image transmission device 100 described above. As shown in Figure 20, the image transmission method includes the following steps:

[0157] Step 2001: Arrange the Alpha data and RGB data of the image in the application separately, and arrange the Alpha data and RGB data into different data areas;

[0158] Step 2002: Send the Alpha and RGB data after data arrangement through the mobile industrial processor interface.

[0159] Alpha and RGB data are received from the processor and combined to form an ARGB format image.

[0160] In this embodiment, the main processor transmits an image including Alpha and RGB data to the slave processor through the mobile industry processor interface. This does not affect the transmission protocol of the mobile industry processor interface and has good versatility.

[0161] Figure 21 shows a flowchart of an image transmission method according to another embodiment of the present disclosure, which can be executed by the image transmission device 200 in the above embodiments. As shown in Figure 21, the image transmission method includes the following steps:

[0162] Step 2101: Receive Alpha data and RGB data sent by the mobile industry processor interface. The Alpha data and RGB data are respectively arranged in different data areas of the image in the application.

[0163] Step 2102: Merge the received Alpha data and RGB data to form an ARGB format image.

[0164] In this embodiment, the main processor transmits an image including Alpha and RGB data to the slave processor through the mobile industry processor interface. This does not affect the transmission protocol of the mobile industry processor interface and has good versatility.

[0165] It should be noted that the details of the image transmission method have been described in detail in conjunction with the structural diagram in the image transmission device section of the above embodiments. For specific processes, please refer to the description in the aforementioned image transmission device embodiments, and will not be repeated here.

[0166] It should be understood that the various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, for the method embodiments, since they are basically similar to the methods described in the apparatus and system embodiments, the description is relatively simple, and relevant parts can be referred to the descriptions of other embodiments.

[0167] It should be understood that the foregoing describes specific embodiments of this specification. Other embodiments are within the scope of the claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0168] It should be understood that the use of a singular form to describe an element or to show only one element in the accompanying drawings does not imply that the number of such element is limited to one. Furthermore, modules or elements described or shown as separate herein may be combined into a single module or element, and modules or elements described or shown as single herein may be broken down into multiple modules or elements.

[0169] It should also be understood that the terminology and expressions used herein are for descriptive purposes only, and one or more embodiments described herein should not be limited to these terms and expressions. The use of these terms and expressions does not exclude any illustrative and descriptive equivalent features (or parts thereof), and it should be recognized that various modifications that may exist should also be included within the scope of the claims. Other modifications, variations, and substitutions may also exist. Accordingly, the claims should be considered to cover all such equivalents.

Claims

1. An image transmission apparatus applied to a master processor, the master processor being connected with a slave processor through a mobile industry processor interface, the apparatus comprising: a data arrangement module configured to arrange Alpha data and RGB data of an image in an application respectively, the Alpha data and the RGB data being arranged to different data regions; a sending control module configured to send the Alpha data and the RGB data arranged through the mobile industry processor interface, wherein the Alpha data and the RGB data are used to be received by the slave processor and combined to form an ARGB format image.

2. The apparatus of claim 1, wherein, The different data regions are a first image and a second image, the first image and the second image having the same width and height, and the first image and the second image being arranged horizontally side by side. The data arrangement module comprises: a padding unit configured to pad each Alpha component in the Alpha data with two placeholders; a first arrangement unit configured to arrange each Alpha component and the placeholders in the first image row by row, and to arrange each RGB component in the RGB data in the second image row by row. The sending control module is specifically configured to select and set a first sending port and a second sending port in the mobile industry processor interface, the first sending port sending the Alpha data, and the second sending port sending the RGB data.

3. The apparatus of claim 1, wherein, The different data regions are a first partition and a second partition of the image, the first partition and the second partition being two regions of the image divided in a horizontal direction. The data arrangement module comprises: a padding unit configured to pad each Alpha component in the Alpha data with two placeholders; a second arrangement unit configured to arrange each Alpha component and each placeholder in the first partition row by row, and to arrange each RGB component in the RGB data in the second partition row by row. The sending control module is specifically configured to select and set a third sending port in the mobile industry processor interface to send the Alpha data and the RGB data.

4. The apparatus of claim 3, wherein, The first partition is a partition on the left side of the image, and the second partition is a partition on the right side of the image, so that the slave processor receives each Alpha component and each placeholder before receiving the RGB data.

5. The apparatus of any one of claims 2-4, wherein, The padding unit sets the Alpha components at high bits of the image and sets the placeholders at low bits of the image. The apparatus further comprises: an encoding module configured to perform display stream compression encoding processing on the image arranged by the data arrangement module. 6.An image transmission apparatus applied to a slave processor, the slave processor being connected with a master processor through a mobile industry processor interface, the apparatus comprising: a receiving control module configured to receive Alpha data and RGB data sent by the mobile industry processor interface, the Alpha data and the RGB data being arranged to different data regions of an image in an application respectively. The data merging module is configured to merge the received Alpha data and the RGB data into an ARGB format image.

7. The apparatus of claim 6, wherein, The different data regions are a first image and a second image, the first image and the second image have the same width and height, and the first image and the second image are arranged horizontally side by side. The Alpha components and the placeholders are arranged in the first image, and the RGB components in the RGB data are arranged in the second image. The Alpha data includes Alpha components and two-bit placeholders corresponding to the Alpha components. The data merging module includes: The component separation unit is configured to separate the placeholders in the Alpha data and discard the placeholders. The merging processing unit is configured to merge the Alpha data after the placeholders are discarded by the component separation unit and the RGB data into an ARGB format image.

8. The apparatus of claim 7, wherein, The Alpha components are arranged at high bit positions of the image, and the placeholders are arranged at low bit positions of the image. The receiving control module is specifically configured to select and set a first receiving port and a second receiving port in the MIPI. The first receiving port receives the Alpha data sent by the first sending port, and the second receiving port receives the RGB data sent by the second sending port. The apparatus further includes: The first decoding module is configured to perform display stream compression decoding processing on the Alpha data received by the first receiving port. The second decoding module is configured to perform display stream compression decoding processing on the RGB data received by the second receiving port. The component separation unit is specifically configured to separate the placeholders in the decoded Alpha data and discard the placeholders. The merging processing unit is specifically configured to merge the Alpha data after the placeholders are discarded by the component separation unit and the decoded RGB data into an ARGB format image.

9. The apparatus of claim 6, wherein, The different data regions are a first partition and a second partition of the image, the first partition and the second partition are two regions of the image divided in a horizontal direction. The Alpha components and the placeholders are arranged in the first partition, and the RGB components in the RGB data are arranged in the second partition. The Alpha data includes Alpha components and two-bit placeholders corresponding to the Alpha components. The data merger includes: The component separation unit is configured to separate the placeholders in the Alpha data and discard the placeholder. The merging processing unit is configured to merge the Alpha data after the placeholders are discarded by the components separation unit and the RGB data into an ARGB format image.

10. The apparatus of claim 7, wherein, The Alpha components are arranged at the high bit positions of the image, and the placeholders are arranged at the low bit positions of the image. The receiving control module is specifically configured to select and set a third receiving port in the MIPI. The third receiving port receives the Alpha data and the RGB data sent by the third sending port; The device further comprises: A third decoding module is configured to perform display stream compression decoding processing on the Alpha data and the RGB data received by the third receiving port; The component separation unit is specifically configured to separate the placeholder in the decoded Alpha data and discard the placeholder; The merging processing unit is specifically configured to merge the Alpha data after the placeholder is discarded by the component separation unit and the decoded RGB data to form an ARGB format image.

11. The apparatus of claim 10, wherein, The first partition is a partition on the left side of the image, and the second partition is a partition on the right side of the image; The device further comprises: A buffer control module is configured to buffer the Alpha data after the placeholder is discarded by the component separation unit to a buffer; The merging processing unit is specifically configured to merge each group of RGB components in the decoded RGB data with the Alpha component corresponding to the RGB component in the buffer to form an ARGB format image.

12. The device of claim 11, wherein, The buffer is a 1 / 6 row buffer.

13. A host processor comprising: The image transmission device according to any one of claims 1-5.

14. A processor, comprising: The image transmission device according to any one of claims 6-12.

15. A mixed reality chip comprising: A master processor and a slave processor; The master processor and the slave processor are connected through a mobile industry processor interface; The master processor comprises the image transmission device according to any one of claims 1-5; The slave processor comprises the image transmission device according to any one of claims 6-12.

16. An image transmission method applied to a master processor, the master processor being connected with a slave processor through a mobile industry processor interface, the method comprising: arranging Alpha data and RGB data of an image in an application respectively, the Alpha data and the RGB data being arranged to different data areas; sending the Alpha data and the RGB data arranged through the mobile industry processor interface; wherein the Alpha data and the RGB data are used to be received by the slave processor to be merged to form an ARGB format image.

17. An image transmission method applied to a slave processor, the slave processor being connected with a master processor through a mobile industry processor interface, the method comprising: receiving Alpha data and RGB data sent by the mobile industry processor interface, the Alpha data and the RGB data being arranged to different data areas of an image in an application; merging the received Alpha data and the RGB data to form an ARGB format image.

Images