Layer blending and reconstruction method based on alpha channel
By using an application processor in video processing to mix and reconstruct the alpha channel and RGB image data, the problems of layer data processing and alpha channel transmission in video processing are solved, and more efficient bandwidth utilization and transmission efficiency are achieved.
Patent Information
- Application Number
- CN202110377864.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-02-19
- Filing Date
- 2021-04-08
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2041-04-08
AI Technical Summary
The prior art is difficult to effectively process data of different layers in video processing and supports the transmission of alpha channels during transmission, resulting in increased bandwidth requirements and increased processing complexity.
By using the layer mixing method supported by the general application processor (AP), the alpha channel and RGB image data are mixed, mixed image data is generated, and transmitted through a standard transmission interface. On the receiving side, the original RGB image data and alpha channel are reconstructed by the decoder.
The bandwidth requirement, transmission load, data amount and transmission time are reduced, and the effect of obtaining images again after transmission is achieved.
Smart Images

Figure CN114500881B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to video processing, and in particular to a device and method for mixing image data and an alpha channel and reconstructing the image to obtain an image again after transmission. Background Art
[0002] When performing video processing, better processing results can be achieved if the data of different layers can be processed separately and then overlapped after processing.
[0003] In order to be able to overlap after processing, an alpha channel (transparency) is required during transmission.
[0004] One possible solution is to use the existing RGB three channels and transmit the rearranged ARGB four channel data, and rearrange the ARGB after receiving it. The method is incompatible with the existing encoder, and requires an additional processing mechanism and occupies a large bandwidth.
[0005] In addition, common video transmission interfaces (HDMI, MIPI) only support the transmission of image data, but do not support the transmission of alpha data when transmitting images.
[0006] Another possible solution is to use two images to transmit the RGB image data and the alpha channel separately, and process the two images after receiving them to restore the ARGB image. This method requires twice the amount of bandwidth data.
[0007] Therefore, it is hoped that there will be improvements in video processing to process different image layers separately by mixing an alpha channel (transparency) with the image data to be transmitted. Summary of the invention
[0008] The present invention aims to provide a device and method for mixing and reconstructing composition layers according to an alpha channel.
[0009] The present invention uses a layer blending method supported by a general application processor (AP) to blend the alpha channel with the red, green and blue (RGB) image data. Then, the blended data (RGB+alpha) is transmitted through an existing transmission interface. After receiving the blended data, a reconstruction process is performed to obtain the original RGB image data and the alpha channel again.
[0010] Advantageously, the present invention reduces bandwidth requirements, transmission load, data volume and transmission time.
[0011] The device and method for mixing image data and alpha channel after transmission and reconstructing to obtain an image again include an encoder and a decoder. The encoder and the decoder include electronic circuits integrated into separate integrated circuits (ICs) or integrated into the same integrated circuit (IC).
[0012] The encoder performs layer blending on the RGB image data and the alpha channel data to obtain blended image data (RGB+alpha channel). The blended image data is transmitted using a standard transmission interface. Since the blended image data is obtained using a layer blending method supported by a general application processor (AP), the blended image data can be transmitted through a standard transmission interface in a manner similar to standard RGB image data.
[0013] In a specific embodiment of the present invention, the method of layer blending and reconstruction based on the alpha channel includes: layer blending the alpha channel and red, green and blue (RGB) image data to obtain mixed image data; blending the transit element image data with the 1-alpha channel data to obtain the transit element; and blending the transit element with the mixed image data to obtain mixed image data.
[0014] In a specific embodiment, the RGB image data includes 30-bit RGB image data. In a specific embodiment, the RGB image data includes 24-bit RGB image data. In a specific embodiment, the RGB image data includes more than 30-bit RGB image data. In a specific embodiment, the alpha channel includes 8-bit alpha channel data. In a specific embodiment, the alpha channel includes more than 8-bit alpha channel data. In a specific embodiment of the present invention, the transit element image data includes 24-bit, 30-bit or more than 30-bit transit element image data. In a specific embodiment, the 1-alpha channel data includes 8-bit data or more than 8-bit 1-alpha channel data. In a specific embodiment, the mixed image data includes 24-bit, 30-bit or more than 30-bit mixed image data. In a specific embodiment of the present invention, the transit element image data includes a checkerboard pattern. In a specific embodiment, the transit element image data includes a colored checkerboard pattern.
[0015] In a specific embodiment of the present invention, a method for layer blending and reconstruction based on an alpha channel includes: receiving mixed image data; removing transit-source image data from the mixed image data to obtain mixed image data; and reconstructing red, green, and blue (RGB) image data and an alpha channel from the mixed image data.
[0016] In a specific embodiment of the present invention, the method for layer blending and reconstruction based on the Alpha channel includes: for decoding processing, Cr1 =RGB*alpha,C r2 =RGB*alpha+255*(1-alpha) and alpha=1+(C r1 -C r2 ) / 255; where C r1 Tie in left, right, top and bottom positions from C r2 obtained; and wherein different costs are calculated to determine the interpolation direction.
[0017] In a specific embodiment of the present invention, the method for layer blending and reconstruction based on the alpha channel includes: receiving mixed image data; determining whether a mode flag is set, the mode flag indicating that the mode is ARGB mode when set and RGB mode when not set; performing cost calculation in the ARGB mode; performing C r1 / C r2 Evaluate; perform alpha calculation; perform alpha smoothing; and according to C r1 / C r2 Evaluates, alpha-smoothes, and transfers the meta-image data to perform ARGB reconstruction.
[0018] The present invention provides an electronic device for layer blending and reconstruction based on an alpha channel, comprising an encoder for layer blending an alpha channel and red, green and blue (RGB) image data to obtain mixed image data; blending transit element image data with 1-alpha channel data to obtain a transit element; and blending the transit element with the mixed image data to obtain mixed image data.
[0019] The present invention provides an electronic device for layer blending and reconstruction based on an alpha channel, comprising a decoder for receiving mixed image data; removing transit element image data from the mixed image data to obtain mixed image data; and reconstructing red, green, and blue (RGB) image data and an alpha channel from the mixed image data.
[0020] In one embodiment of the present invention, the electronic device for layer blending and reconstruction based on alpha channel is used for decoder processing, C r1 =RGB*alpha,C r2 =RGB*alpha+255*(1-alpha) and alpha=1+(C r1 -C r2 ) / 255; where C r1 Tie in left, right, top and bottom positions from C r2 obtained; and wherein different costs are calculated to determine the interpolation direction.
[0021] In a specific embodiment, the present invention provides an electronic device for layer blending and reconstruction based on an alpha channel, comprising: an encoder for layer blending an alpha channel and red, green, and blue (RGB) image data to obtain mixed image data; mixing a transit element image data with 1-alpha channel data to obtain a transit element; mixing the transit element with the mixed image data to obtain mixed image data; and transmitting the mixed image data to a decoder; and the decoder is used to receive the mixed image data from the encoder; remove the transit element from the mixed image data to obtain mixed image data; and reconstruct red, green, and blue (RGB) image data and an alpha channel from the mixed image data.
[0022] In a specific embodiment of the present invention, the encoder and the decoder are both arranged in a single integrated circuit. In a specific embodiment of the present invention, the encoder and the decoder are separate integrated circuits.
[0023] In a specific embodiment of the invention, the encoder and the decoder are co-located with each other, for example in the same electronic device or electronic circuit.
[0024] In a specific embodiment of the present invention, the encoder and the decoder are remote from each other and are located in separate electronic devices or electronic circuits.
[0025] In a specific embodiment of the present invention, the mixed image data is transmitted from the encoder or encoder system via a network or the Internet.
[0026] In a specific embodiment of the present invention, the mixed image data is received by a decoder or a decoder system via a network or the Internet.
[0027] In a specific embodiment of the present invention, the decoding and reconstruction process flow includes a decoder receiving input data. The input data includes, for example, RGB image data or mixed image data, wherein the mixed image data includes RGB image data and alpha channel data. At the same time or before this, the decoder also receives a mode flag. The decoder determines whether the mode flag indicates that the input data is RGB image data or the input data is mixed image data.
[0028] If the decoder determines that the mode flag indicates that the input data is RGB image data (RGB mode), the input data (RGB image data) is output as RGB data to a data processing system, and the processing system uses the RGB image data for a standard method of processing image data. The system includes, for example, a microcontroller, a CPU, a GPU, a graphics card, or an external electronic component.
[0029] If the decoder determines that the mode flag indicates that the input data is mixed image data (ARGB mode), the input data will be further processed as mixed image data. The mixed data (ARGB) is costed and processed in the execution of C r1 / C r2 The cost calculation result data is used together with the transshipment metadata during the valuation process.
[0030] C r1 / C r2 The evaluation result is used to perform alpha channel calculation processing. The result of the alpha channel calculation processing is used to perform alpha channel smoothing processing.
[0031] Transshipment metadata, C r1 / C r2 The evaluation result and the alpha channel smoothing result are used to perform ARGB reconstruction processing. After the ARGB reconstruction processing is completed, the original RGB image data and the original alpha channel data are obtained.
[0032] To at least achieve the above objectives, the present invention provides an apparatus and method for mixing RGB image data with an alpha channel, transmitting the mixed image data, and reconstructing the mixed image data after transmission to obtain an RGB image and an alpha channel. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Figure 1 A video processing flow chart illustrating a method for mixing image data and an alpha channel and reconstructing after transmission to obtain an image again according to a specific embodiment of the present invention;
[0034] Figure 2 A layer hybrid coding process diagram is illustrated according to a specific embodiment of the present invention;
[0035] Figure 3 A diagram illustrating a reconstruction decoding process according to a specific embodiment of the present invention;
[0036] Figure 4 A diagram illustrating a chessboard transfer element image data processing diagram according to a specific embodiment of the present invention;
[0037] Figure 5 A diagram illustrating a color chessboard transfer element image data processing diagram according to a specific embodiment of the present invention;
[0038] Figure 6 As an example, C according to a specific embodiment of the present invention r1 and C r2 Schema of pixel pattern;
[0039] Figure 7A flowchart illustrating a decoder processing flow according to a specific embodiment of the present invention;
[0040] Figure 8 The left, right, upper and lower C of a specific embodiment of the present invention are exemplified. r1 and C r2 Schema of pixel pattern;
[0041] Fig. 9 A diagram of RGB image data illustrating an apparatus and method for mixing image data and an alpha channel and reconstructing after transmission to obtain an image again according to one embodiment of the present invention;
[0042] Fig.10 A diagram of alpha channel data illustrating an apparatus and method for mixing image data and an alpha channel and reconstructing after transmission to obtain an image again according to one embodiment of the present invention;
[0043] Fig.11 A diagram of mixed image data (RGB+alpha channel mixing) illustrating an apparatus and method for mixing image data and an alpha channel and reconstructing after transmission to obtain an image again according to one embodiment of the present invention;
[0044] Fig.12 A diagram of a reconstructed RGB simulation result illustrating an apparatus and method for mixing image data and an alpha channel and reconstructing after transmission to obtain an image again according to one embodiment of the present invention; and
[0045] Fig.13 The diagram is a diagram of a reconstructed alpha channel simulation result illustrating an apparatus and method for mixing image data and an alpha channel and reconstructing the image after transmission to obtain an image again according to a specific embodiment of the present invention.
[0046] Reference numerals
[0047] 100 Methods
[0048] 110 Encoder
[0049] 120 Transmission
[0050] 130 Decoder
[0051] 200 Layer Hybrid Coding Processing Method
[0052] 210 RGB image data
[0053] 220 8-bit alpha channel data
[0054] 230 Transit element image data
[0055] 240 1-alpha channel data
[0056] 250 Mixed Data
[0057] 300 Reconstruction decoding processing method
[0058] 700 Decoding Process
[0059] Steps 710-740 DETAILED DESCRIPTION
[0060] In order to promote understanding of the objects, features and effects of the present invention, specific embodiments and drawings are provided for detailed description of the present invention.
[0061] The following are details of a specific embodiment of the present invention.
[0062] Please refer to Figure 1 , which is a video processing flow chart illustrating a method for mixing image data and an alpha channel and reconstructing after transmission to obtain an image again according to a specific embodiment of the present invention.
[0063] In the method 100, first, both RGB image data and alpha channel data are provided to an encoder 110. The encoder encodes the RGB image data and the alpha channel data to obtain mixed RGB data. The mixed RGB data is transmitted 120 to a decoder 130. The decoder 130 decodes the mixed RGB data to obtain the original RGB image data and the original alpha channel again.
[0064] Please refer to Figure 2 , which is an illustration of a layer hybrid coding processing scheme according to a specific embodiment of the present invention.
[0065] exist Figure 2 In the layer mixing coding processing method 200 shown in the figure, first, the apparatus and method are used to mix the image data and the alpha channel and reconstruct them again after transmission to obtain the image and the alpha channel, the encoder ( Figure 1 , 110) performs encoder processing. The 30 / 24-bit RGB image data 210 is mixed with the 8-bit alpha channel data 220 to obtain mixed image data. In addition, the transit element image data 230, such as a checkerboard pattern, is mixed with the 1-alpha channel data 240 to obtain the transit element. Then, the mixed image data is combined with the transit element to obtain 30 / 24-bit mixed data 250. In a specific embodiment, the transit element image data 230 includes a black and white checkerboard pattern. In a specific embodiment, the transit element image data 230 includes a color checkerboard pattern.
[0066] At this point the 30 / 24 bit jumbled data 250 has been encoded and is ready for transmission.
[0067] In an embodiment of the present invention, RGB image data 210 includes a number of bits other than the 30 bits or 24 bits used in this embodiment.
[0068] In an embodiment of the present invention, alpha channel data 220 includes a number of bits other than the 8 bits used in this embodiment.
[0069] In an embodiment of the present invention, the transfer element image data 230 includes a number of bits other than the 30 bits or 24 bits used in this embodiment.
[0070] In an embodiment of the present invention, the 1-alpha channel data 240 includes a number of bits other than the 8 bits used in this embodiment.
[0071] In an embodiment of the present invention, the hash data 250 includes a number of bits different from the 30 bits or 24 bits used in this embodiment.
[0072] Please refer to Figure 3 , which is a diagram illustrating a reconstruction decoding processing method according to a specific embodiment of the present invention.
[0073] like Figure 3 The reconstruction decoding process method 300 shown, the decoder ( Figure 1 , 130) reconstructs the received 30 / 24-bit mixed data 250 to obtain the original 30 / 24-bit RGB image data 210 and the original 8-bit alpha channel data 220 again.
[0074] During the reconstruction process, the transit element ( Figure 2 , transfer the original image data 230×1-alpha channel data 240) to obtain the mixed image data ( Figure 2 , RGB image data 210×alpha channel data 220). Then, the alpha channel data and the RGB image data are decoded from the mixed image data to obtain the original RGB image data 210 and the original alpha channel data 220.
[0075] Please refer to Figure 4 , which illustrates a diagram of chessboard transfer element image data processing according to a specific embodiment of the present invention, and please refer to Figure 5 , which illustrates a diagram of color chessboard transfer element image data processing according to a specific embodiment of the present invention.
[0076] exist Figure 4 In the specific embodiment shown, the transporter ( Figure 2 , the transfer element image data 230×1-alpha channel data 240) includes black and white chessboard image data.
[0077] exist Figure 5 In the specific embodiment shown, the transporter ( Figure 2 , the transfer element image data 230×1-alpha channel data 240) includes color chessboard image data.
[0078] Please refer to Figure 6 , which is an example of C according to a specific embodiment of the present invention r1 and C r2 Pixel pattern diagram.
[0079] In the decoder processing, C r1 =RGB*alpha and C r2 =RGB*alpha+255*(1-alpha) is located in different pixel / sub-pixel coordinates in the mixed image data. First, reconstruct the C at the same pixel / sub-pixel coordinate in the mixed image data. r1 and C r2 The value can then be obtained by alpha = 1 + (C r1 -C r2 ) / 255 to calculate alpha.
[0080] The decoder processing includes:
[0081] C r1 Tie from left, right, top and bottom positions C r2 what is obtained;
[0082] Calculate different costs to determine the interpolation direction;
[0083] Execute C r1 and C r2 Reconstruction;
[0084] Performing an alpha reconstruction; and
[0085] Perform RGB reconstruction.
[0086] Please refer to Figure 7 , which is a flowchart illustrating the decoder processing flow according to a specific embodiment of the present invention.
[0087] Figure 7 The exemplary decoding process flow 700 includes receiving input data by the decoder at step 705. The input data includes, for example, RGB image data or mixed image data, the mixed image data including RGB image data and alpha channel data.
[0088] The decoder also receives the mode flag at step 706. At step 710, the decoder determines whether the mode flag indicates that the input data is RGB image data, or the input data is mixed image data.
[0089] If the decoder determines that the mode flag indicates that the input data is RGB image data (RGB mode), the input data (RGB image data) is output as RGB data to the image processing system in step 711, and the image processing system uses the RGB image data for a standard method of processing image data.
[0090] If the decoder determines that the mode flag indicates that the input data is mixed image data (ARGB mode), then the input data continues to be processed as mixed image data at step 712 .
[0091] In step 715, the mixed data (ARGB) is subjected to cost calculation processing, and in step 720, C r1 / C r2 The cost calculation result data is used together with the transshipment metadata during the valuation process.
[0092] In step 725, C r1 / C r2 The evaluation result is used to perform an alpha channel calculation process. The result of the alpha channel calculation process is then used to perform an alpha channel smoothing process at step 730 .
[0093] In step 740, the transport metadata, C r1 / C r2 The evaluation result and the alpha channel smoothing result are used to perform an ARGB reconstruction process. For the ARGB reconstruction process result, the original RGB image data and the original alpha channel data can be obtained.
[0094] Please refer to Figure 8 , which is an example of the left, right, upper and lower C according to a specific embodiment of the present invention. r1 and C r2 Pixel pattern diagram.
[0095] In order to determine the interpolation direction, different costs need to be calculated. The cost calculation includes:
[0096] enter:
[0097] L Cr2 , T Cr2 , R Cr2 , B Cr2 , L Cr1 , R Cr1
[0098] Optional value:
[0099] LR_value=(L Cr2 +R Cr2 +1)>>1
[0100] TB_value=(T Cr2 +B Cr2 +1)>>1
[0101] cost:
[0102] LR_cost = abs(L Cr2 -R Cr2 )
[0103] TB_cost=abs(T Cr2 -B Cr2 )
[0104] LC_cost = abs(L Cr1 -C Cr1 )
[0105] RC_cost = abs(R Cr1 -C Cr1 )
[0106] In the above, L Cr2 Left Cr2 , T Cr2 For the top Cr2 , R Cr2 Right Cr2 , B Cr2 For the next Cr2 , L Cr1 Left Cr1 And R Cr1 Right Cr1 .
[0107] In the above, LR_value is the left and right value, and TB_value is the upper and lower value.
[0108] In the above, abs is the absolute value, LR_cost is the left-right cost, TB_cost is the top-bottom cost, LC_cost is the left-center cost, and RC_cost is the right-center cost.
[0109] To execute C r1 &C r2 If the reconstruction is completed, the evaluation process is performed. r2 Evaluation r1 Use the same process) including:
[0110]
[0111] To perform alpha reconstruction, an alpha calculation process is performed. The alpha calculation (for a 0 / 255 chessboard) includes:
[0112] C r1 =RGB*alpha
[0113] C r2 =RGB*alpha+255*(1-alpha)
[0114] alpha=1+(C r1 -C r2 ) / 255
[0115] To perform RGB reconstruction, an ARGB reconstruction process is performed. The ARGB reconstruction process (e.g., for red) includes:
[0116]
[0117]
[0118] In the above, for 8-bit data, max_value=255, and for 10-bit data, max_value=1023.
[0119] Please refer to Figures 9 to 13 , which is a diagram of RGB image data, alpha channel data, mixed image data (RGB+alpha channel mixing), reconstructed RGB simulation results, and reconstructed alpha channel simulation results, which illustrates an apparatus and method for mixing image data and an alpha channel and reconstructing after transmission to obtain an image again according to a specific embodiment of the present invention.
[0120] In the invention summary, the present invention provides an electronic device for layer blending and reconstruction based on an alpha channel, which includes: an encoder for layer blending an alpha channel and red, green, and blue (RGB) image data to obtain mixed image data; blending a transit element image data with 1-alpha channel data to obtain a transit element; blending the transit element with the mixed image data to obtain mixed image data; and transmitting the mixed image data to a decoder; and the decoder is used to receive the mixed image data from the encoder; remove the transit element from the mixed image data to obtain mixed image data; and reconstruct red, green, and blue (RGB) image data and an alpha channel from the mixed image data.
[0121] In some embodiments, an electronic device for layer blending and reconstruction based on an alpha channel includes a decoder for processing, C r1 =RGB*alpha,C r2=RGB*alpha+255*(1-alpha) and alpha=1+(C r1 -C r2 ) / 255; where C r1 Tie in left, right, top and bottom positions from C r2 obtained and wherein different costs are calculated to determine the interpolation direction.
[0122] In some specific embodiments, the method of layer blending and reconstruction based on the alpha channel includes: layer blending the alpha channel and red, green and blue (RGB) image data to obtain mixed image data, blending the transit element image data with the 1-alpha channel data to obtain the transit element, and blending the transit element with the mixed image data to obtain mixed image data.
[0123] In some specific embodiments, the method of layer blending and reconstruction based on the alpha channel of the present invention includes: receiving mixed image data; removing the transit element image data from the mixed image data to obtain mixed image data; and reconstructing red, green, and blue (RGB) image data and an alpha channel from the mixed image data.
[0124] In some specific embodiments, the method for layer blending and reconstruction based on the alpha channel of the present invention includes: receiving mixed image data, determining whether a mode flag is set, the mode flag indicating that the mode is ARGB mode when set and RGB mode when not set, performing cost calculation in the ARGB mode, performing C r1 / C r2 Evaluate, perform alpha calculations, perform alpha smoothing, and r1 / C r2 Evaluates, alpha-smoothes, and transfers the meta-image data to perform ARGB reconstruction.
[0125] Although the present invention has been described by way of specific embodiments, many modifications and variations may be made by those skilled in the art without departing from the scope and spirit of the invention.
Claims
1. A method for layer blending and reconstruction based on an alpha channel, characterized in that: The method comprises: receiving mixed image data; removing the transit element image data from the mixed image data to obtain mixed image data; and Reconstructing the red, green, blue, RGB image data and the alpha channel from the mixed image data, wherein for the decoding process, Based on the mixed image data, performing cost calculation, wherein the cost is an absolute value of a difference between adjacent pixels; According to the cost, C r1 or C r2 Perform interpolation calculations for evaluation of According to C r1 or C r2 The evaluation and formula C r1 =RGB*alpha,C r2 =RGB*alpha+255*(1-alpha) and alpha=1+(C r1 -C r2 ) / 255, perform alpha calculation, where RGB is image data, and pass C in the mixed image data r1 Point, C r1 is the pixel value obtained from the received mixed image data, C r2 By corresponding to C r1 The pixel values of the surrounding pixels of the pixel point are calculated by the cost calculation and the interpolation calculation; for the mixed image data transmitted C r2 Point, C r2 is the pixel value obtained from the received mixed image data, C r1 By corresponding to C r2 The pixel values of the pixel points around the pixel point are calculated by the cost calculation and the interpolation calculation.
2. The method for layer blending and reconstruction based on alpha channel according to claim 1, characterized in that: The RGB image data includes 30-bit RGB image data.
3. The method for layer blending and reconstruction based on alpha channel according to claim 1, characterized in that: The alpha channel comprises an 8-bit alpha channel.
4. The method for layer blending and reconstruction based on alpha channel according to claim 1, characterized in that: The transport element image data includes a checkerboard pattern.
5. The method of layer blending and reconstruction based on alpha channel according to claim 1, characterized in that: The transport element image data includes a colored checkerboard pattern.
6. A method for layer blending and reconstruction based on an alpha channel, characterized in that: The method comprises: receiving mixed image data; Determine whether to set a mode flag, the mode flag indicating that it is ARGB mode when it is set, and that it is RGB mode when it is not set; When in ARGB mode, cost calculation is performed, where the cost is the absolute value of the difference between adjacent pixels; Execute C r1 / C r2 Evaluation, based on the cost, will C r1 / C r2 The evaluation of performs interpolation calculations; Perform alpha calculation; Perform alpha smoothing; and According to the C r1 / C r2 Evaluation, alpha smoothing and transfer of the meta-image data perform ARGB reconstruction, for the mixed image data transfer C r1 Point, C r1 is the pixel value obtained from the received mixed image data, C r2 By corresponding to C r1 The pixel values of the surrounding pixels of the pixel point are calculated by the cost calculation and the interpolation calculation; for the mixed image data transmitted C r2 Point, C r2 is the pixel value obtained from the received mixed image data, C r1 By corresponding to C r2 The pixel values of the pixel points around the pixel point are calculated by the cost calculation and the interpolation calculation.
7. An electronic device for layer blending and reconstruction based on an alpha channel, characterized in that: The electronic device comprises: A decoder is used to receive mixed image data; remove the transit element image data from the mixed image data to obtain mixed image data; and reconstruct the red, green, blue (RGB) image data and the alpha channel from the mixed image data, wherein for the decoder processing, Based on the mixed image data, performing cost calculation, wherein the cost is an absolute value of a difference between adjacent pixels; According to the cost, C r1 or C r2 Perform interpolation calculations for evaluation of According to C r1 or C r2 The evaluation and formula C r1 =RGB*alpha,C r2 =RGB*alpha+255*(1-alpha) and alpha=1+(C r1 -C r2 ) / 255, perform alpha calculation, where RGB is image data, and pass C in the mixed image data r1 Point, C r1 is the pixel value obtained from the received mixed image data, C r2 By corresponding to C r1 The pixel values of the surrounding pixels of the pixel point are calculated by the cost calculation and the interpolation calculation; for the mixed image data transmitted C r2 Point, C r2 is the pixel value obtained from the received mixed image data, C r1 By corresponding to C r2 The pixel values of the pixel points around the pixel point are calculated by the cost calculation and the interpolation calculation.
8. The electronic device for layer blending and reconstruction based on alpha channel according to claim 7, characterized in that: The RGB image data includes 30-bit RGB image data.
9. The electronic device for layer blending and reconstruction based on alpha channel according to claim 7, characterized in that: The alpha channel comprises an 8-bit alpha channel.
10. The electronic device for layer blending and reconstruction based on alpha channel according to claim 7, characterized in that: The transport element image data includes a checkerboard pattern.
11. The electronic device for layer blending and reconstruction based on alpha channel according to claim 7, characterized in that: The transport element image data includes a colored checkerboard pattern.
12. An electronic device for layer blending and reconstruction based on an alpha channel, characterized in that: The electronic device comprises: The encoder performs layer blending on the alpha channel and the RGB image data to obtain mixed image data; blends the transit element image data with the 1-alpha channel data to obtain a transit element; blends the transit element with the mixed image data to obtain mixed image data; and transmits the mixed image data to a decoder; and The decoder is used to receive the mixed image data from the encoder; remove the conveyor from the mixed image data to obtain mixed image data; and reconstruct the red, green, blue, RGB image data and the alpha channel from the mixed image data, characterized in that for the decoder processing, Based on the mixed image data, performing cost calculation, wherein the cost is an absolute value of a difference between adjacent pixels; According to the cost, C r1 or C r2 The evaluation of performs interpolation calculations; According to C r1 or C r2 The evaluation and formula C r1 =RGB*alpha,C r2 =RGB*alpha+255*(1-alpha) and alpha=1+(C r1 -C r2 ) / 255, perform alpha calculation, where RGB is image data, and pass C in the mixed image data r1 Point, C r1 is the pixel value obtained from the received mixed image data, C r2 By corresponding to C r1 The pixel values of the surrounding pixels of the pixel point are calculated by the cost calculation and the interpolation calculation; for the mixed image data transmitted C r2 Point, C r2 is the pixel value obtained from the received mixed image data, C r1 By corresponding to C r2 The pixel values of the pixel points around the pixel point are calculated by the cost calculation and the interpolation calculation.
13. The electronic device for layer blending and reconstruction based on alpha channel according to claim 12, characterized in that: The RGB image data includes 30-bit RGB image data.
14. The electronic device for layer blending and reconstruction based on alpha channel according to claim 12, characterized in that: The alpha channel comprises an 8-bit alpha channel.
15. The electronic device for layer blending and reconstruction based on alpha channel according to claim 12, characterized in that: The transport element image data includes a checkerboard pattern.
16. The electronic device for layer blending and reconstruction based on alpha channel according to claim 12, characterized in that: The transport element image data includes a colored checkerboard pattern.
Citation Information
Patent Citations
Electronic apparatus for playing substitutional advertisement and controlling method thereof
US20180255264A1
Method and system of multi-dynamic range multi-layer video blending with alpha channel sideband for video playback
US20190149792A1