Color component prediction method, encoder, decoder, and computer storage medium

By encoding and decoding chrominance components to predict the luminance component using linear or nonlinear models, the method addresses the accuracy issues in H.266 video coding, enhancing prediction accuracy and efficiency.

JP7602480B2Active Publication Date: 2024-12-18GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021556939
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-03-25
Filing Date
2019-12-09
Publication Date
2024-12-18
Estimated Expiration
2039-12-09

AI Technical Summary

Technical Problem

In the H.266 video coding standard, the accuracy of predicting the chroma component from the luminance component is low due to the rich texture of the luminance component and the flat nature of the chrominance component, leading to inefficiencies in encoding and decoding.

Method used

The method involves encoding and decoding the chrominance components to obtain a predicted value of the luminance component, using a linear or nonlinear model based on adjacent reference values and weighted addition of predictions from multiple chroma components to improve accuracy.

Benefits of technology

This approach enhances the prediction accuracy of the luminance component, bringing the predicted value closer to the actual pixel value, thereby improving encoding and decoding efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007602480000019
    Figure 0007602480000019
  • Figure 0007602480000020
    Figure 0007602480000020
  • Figure 0007602480000021
    Figure 0007602480000021
Patent Text Reader

Abstract

An embodiment of the present application discloses a color component prediction method, an encoder, and a computer storage medium, which includes, in encoding a color component, encoding a chrominance component and obtaining a predicted value of a luma component based on the encoded chrominance component.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] TECHNICAL FIELD The embodiments of the present application relate to intra-frame prediction techniques in the field of video coding, and in particular to a color component prediction method, a decoder, a decoder and a computer storage medium. [Background technology]

[0002] In the next-generation video coding standard H.266 or Versatile Video Coding (VVC), cross-component prediction can be realized using a cross-component linear model prediction method (CCLM), which allows chrominance components to be predicted by luma components based on dependencies between the components.

[0003] Currently, the luma component for prediction needs to be downsampled to the same resolution as the chroma component to be predicted, and then prediction is performed between luma and chroma at the same resolution, thereby realizing prediction of one of the chroma components from the luma component.

[0004] However, since the luma component has rich texture and the chroma component is relatively flat, when the luma component is used to predict the chroma component, there is a large deviation between the predicted chroma component and the actual chroma value, and the accuracy of the predicted value is low, which affects the efficiency of encoding and decoding. Summary of the Invention [Means for solving the problem]

[0005] The embodiments of the present application provide a color component prediction method, an encoder, a decoder, and a computer storage medium, which realize predictive coding from chrominance components to luminance components, improve the prediction accuracy of the luminance component, and make the predicted value of the luminance component closer to the actual pixel value of the luminance component.

[0006] The technical solutions in the embodiments of the present application may be realized as follows.

[0007] In a first aspect, a color component prediction method according to an embodiment of the present application includes: The color component encoding step includes encoding chrominance components; and obtaining a prediction of the luma component based on the coded chroma components.

[0008] In a second aspect, a color component prediction method according to an embodiment of the present application includes: Decoding color components includes decoding chrominance components; and obtaining a prediction of the luma component based on the decoded chroma components.

[0009] In a third aspect, an encoder according to an embodiment of the present application comprises: a coding module configured to code chromaticity components in the coding of color components; A first retrieval module configured to derive a predicted value of a luma component based on the encoded chroma component.

[0010] In a fourth aspect, a decoder according to an embodiment of the present application comprises: a decoding module configured to decode chrominance components in decoding the color components; and a second retrieval module configured to derive a predicted value of the luma component based on the decoded chroma component.

[0011] In a fifth aspect, an encoder according to an embodiment of the present application comprises: The present invention includes a processor and a storage medium storing instructions executable by the processor, the storage medium performing operations dependent on the processor via a communication bus, and when the instructions are executed by the processor, performing the color component prediction method described in one or more embodiments above.

[0012] In a sixth aspect, a decoder according to an embodiment of the present application comprises: The present invention includes a processor and a storage medium storing instructions executable by the processor, the storage medium performing operations dependent on the processor via a communication bus, and when the instructions are executed by the processor, performing the color component prediction method described in one or more embodiments above.

[0013] In a seventh aspect, a computer-readable storage medium according to an embodiment of the present application has executable instructions stored thereon, the executable instructions, when executed by one or more processors, causing the processors to perform the color component prediction method described in one or more embodiments above. Effect of the Invention

[0014] The embodiments of the present application provide a color component prediction method, an encoder, a decoder and a computer storage medium, which includes the steps of: in encoding a color component, encoding a chrominance component, and obtaining a predicted value of the luma component according to the encoded chrominance component, that is, in the embodiments of the present application, first encoding and decoding a chrominance component, and then predicting the luma component with the encoded and decoded chrominance component, thus predicting the luma component with the encoded and decoded chrominance component, i.e., first encoding and decoding a flat chrominance component, and then predicting a luma component with rich texture according to the encoded and decoded chrominance component, thereby improving the prediction accuracy of the luma component, and making the predicted value of the luma component closer to the actual pixel value of the luma component. [Brief description of the drawings]

[0015] [Figure 1] 1 is a flowchart of a selectable color component prediction method according to an embodiment of the present application. [Diagram 2] FIG. 1 is a structural diagram of a video encoding system. [Diagram 3] FIG. 1 is a structural diagram of a video decoding system. [Figure 4] 4 is a flowchart of another selectable color component prediction method according to an embodiment of the present application. [Diagram 5]FIG. 2 is a structural diagram of one selectable encoder according to an embodiment of the present application. [Figure 6] FIG. 2 is a structural diagram of one selectable decoder according to an embodiment of the present application; [Figure 7] FIG. 2 is a structural diagram of another selectable encoder according to an embodiment of the present application; [Figure 8] FIG. 2 is a structural diagram of another selectable decoder according to an embodiment of the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] The technical solutions in the embodiments of the present application will be described below in a clear and comprehensive manner in combination with the drawings in the embodiments of the present application. It can be understood that the specific embodiments described herein are only for interpreting the related applications, but are not intended to limit the applications. In addition, for ease of description, only parts related to the related applications are shown in the drawings.

[0017] Example 1 In a video image, a block is generally represented by a first color component, a second color component, and a third color component, where the first color component, the second color component, and the third color component may include one luma component and two chroma components. Specifically, the luma component is usually represented by the symbol Y, and the chroma components are usually represented by the symbols Cb, Cr, where Cb represents the blue chroma component and Cr represents the red chroma component.

[0018] In addition, in the embodiments of the present application, the first color component, the second color component, and the third color component may be a luminance component Y, a blue chromaticity component Cb, and a red chromaticity component Cr, respectively. For example, the first color component may be a luminance component Y, the second color component may be a red chromaticity component Cr, and the third color component may be a blue chromaticity component Cb, and the embodiments of the present application are not specifically limited thereto.

[0019] Furthermore, in the embodiments of the present application, the commonly used sampling format represented by luminance and chrominance components respectively is also called YCbCr format, and the YCbCr format may include 4:4:4 format, 4:2:2 format and 4:2:0 format.

[0020] When the YCbCr4:2:0 format is used for a video image, the luminance component of the video image is a current block with a size of 2N×2N, and the corresponding chrominance component is a current block with a size of N×N, where N is the side length of the current block. In the embodiment of the present application, the 4:2:0 format is taken as an example, but the technical solution of the embodiment of the present application is also applicable to other sampling formats.

[0021] In order to further improve coding performance and coding efficiency, H.266 proposes Cross-component Linear Model Prediction (CCLM) by extending and improving Cross-component Prediction (CCP). In H.266, CCLM realizes prediction from the first color component to the second color component, prediction from the first color component to the third color component, and prediction between the second and third color components.

[0022] However, in the case of CCLM, the luma component of the current block is predicted first, and then the chroma component is predicted using the luma component. Since the luma component has rich texture and the chroma component is relatively flat, when the luma component is used to predict the chroma component, there is a large deviation between the predicted chroma component and the actual chroma value, and the accuracy of the predicted value is low, which affects the efficiency of encoding and decoding.

[0023] In an embodiment of the present application, a color component prediction method is provided. Figure 1 is a flow chart of a selectable color component prediction method according to an embodiment of the present application. As shown in Figure 1, the method includes: In the coding of color components, a step S101 of coding chromaticity components; It may include a step S102 of obtaining a prediction value of the luma component based on the coded chroma component.

[0024] Here, the color component prediction method according to the embodiment of the present application may be applied to an encoder or a decoder, and Fig. 2 is a structural diagram of a video encoding system. As shown in Fig. 2, the video encoding system 200 includes a transform and quantization unit 201, an intraframe estimation unit 202, an intraframe prediction unit 203, a motion compensation unit 204, a motion estimation unit 205, an inverse transform and inverse quantization unit 206, a filter control analysis unit 207, a filtering unit 208, an encoding unit 209, and a decoded image cache unit 210, etc., where the filtering unit 208 can realize deblocking filtering and sample adaptive offset (SAO: Sample Adaptive Offset) filtering, and the encoding unit 209 can realize header information coding and context-based adaptive binary arithmetic coding (CABAC: Context-based Adaptive Binary Arithmetic Coding). For the input original video signal, one video coding block can be obtained by dividing a coding tree unit (CTU); then, for the residual pixel information obtained after intra-frame or inter-frame prediction, the transform and quantization unit 201 performs transformation, including transforming the residual information from the pixel domain to the transform domain, and quantizes the obtained transform coefficients to further reduce the bit rate; the intra-frame estimation unit 202 and the intra-frame prediction unit 203 are used to perform intra-frame prediction on the video coding block, specifically, the intra-frame estimation unit 202 and the intra-frame prediction unit 203 are used to determine an intra-frame prediction mode for encoding the video coding block; the motion compensation unit 204 and the motion estimation unit 205 are used to perform inter-frame prediction encoding of the received video coding block relative to one or more blocks in one or more reference frames to provide temporal prediction information; the motion estimation performed by the motion estimation unit 205 is a process of generating a motion vector, and the motion of the video coding block can be estimated by the motion vector; then, the motion compensation unit 204 performs:After performing motion compensation according to the motion vector determined by the motion estimation unit 205, and the intra-frame prediction mode is determined, the intra-frame prediction unit 203 is further used to provide the selected intra-frame prediction data to the coding unit 209, and the motion estimation unit 205 sends the calculated and determined motion vector data to the coding unit 209, and the inverse transform and inverse quantization unit 206 is used to reconstruct the video coding block and reconstruct a residual block in the pixel domain, and the reconstructed residual block is filtered out by the filter control analysis unit 207 and the filtering unit 208 to remove block effect artifacts. The coding unit 209 is used to code various coding parameters and quantized transform coefficients, and in a CABAC-based coding algorithm, the context content may be used to code information indicating a determined intra-frame prediction mode based on neighboring coding blocks, and output a bitstream of the video signal, and the decoded image cache unit 210 is used to store the reconstructed video coding block for the prediction reference. With the execution of video image coding, new reconstructed video coding blocks are continuously generated, and all these reconstructed video coding blocks are stored in the decoded image cache unit 210.

[0025] Figure 3 is a structural diagram of a video decoding system. As shown in Figure 3, the video decoding system 300 includes a decoding unit 301, an inverse transform and inverse quantization unit 302, an intraframe prediction unit 303, a motion compensation unit 304, a filtering unit 305 and a decoded image cache unit 306, etc., where the decoding unit 301 can realize header information decoding and CABAC decoding, and the filtering unit 305 can realize deblocking filtering and SAO filtering. After the input video signal has been subjected to the encoding process of FIG. 2, a bitstream of the video signal is output. The bitstream is input to a video decoding system 300, and is firstly obtained by a decoding unit 301 to obtain decoded transform coefficients, which are then processed by an inverse transform and inverse quantization unit 302 to generate a residual block in the pixel domain. An intraframe prediction unit 303 may be used to generate prediction data for a current video decoded block based on the determined intraframe prediction mode and data from a previously decoded block of the current frame or picture. A motion compensation unit 304 determines prediction information for the video decoded block by analyzing the motion vector and other related syntax elements, and generates the prediction data for the current video decoded block based on the determined intraframe prediction mode and data from a previously decoded block of the current frame or picture. The inverse transform and inverse quantization unit 302 uses the information to generate a predictive block of the video decoding block being decoded, and sums the residual block from the inverse transform and inverse quantization unit 302 with the corresponding predictive block generated by the intraframe prediction unit 303 or the motion compensation unit 304 to form a decoded video block, and the decoded video signal passes through a filtering unit 305 to remove block effect artifacts, thereby improving the video quality, and then stores the decoded video block in a decoded image cache unit 306, which stores a reference image for subsequent intraframe prediction or motion compensation, and is simultaneously used to output the video signal to obtain the restored original video signal.

[0026] In addition, S101 and S102 in the embodiments of the present application are mainly applied to the part of the intraframe prediction unit 203 shown in FIG. 2 and the part of the intraframe prediction unit 303 shown in FIG. 3, that is, the embodiments of the present application can function simultaneously for the encoder and the decoder, and the embodiments of the present application are not specifically limited thereto.

[0027] Also, in S101 and S102, in encoding color components, one chrominance component may be encoded and then the luminance component may be predicted with that chrominance component, one chrominance component may be encoded and then the luminance component may be predicted with that chrominance component, two chrominance components may be encoded first and then the luminance component may be predicted with one chrominance component, or two chrominance components may be predicted with the luminance component, although the embodiments of the present application are not specifically limited thereto.

[0028] To obtain the predicted value of the luminance component, in one alternative embodiment, S102 includes: The method may include a step of performing a prediction based on a first chroma component in the encoded chroma components and a second chroma component in the encoded chroma components to obtain a prediction of a luma component; Here, when the first chromaticity component is a blue chromaticity component, the second chromaticity component is a red chromaticity component, and when the first chromaticity component is a red chromaticity component, the second chromaticity component is a blue chromaticity component.

[0029] Here, the predicted value of the luminance component is predicted using the first chrominance component in the encoded chrominance component and the second chrominance component in the encoded second chrominance component. For example, if the first chrominance component is Cb, the second chrominance component is Cr, and the luminance component is Y, then Y can be predicted using Cb and Cr, or if the first chrominance component is Cr, the second chrominance component is Cb, and the luminance component is Y, then Y can be predicted using Cb and Cr.

[0030] Further, in one alternative embodiment, to predict the predicted value of the luma component, the step of performing a prediction based on a first chroma component in the coded chroma components and a second chroma component in the coded chroma components to obtain the predicted value of the luma component includes: Obtaining a reconstruction value of a first chrominance component, a reconstruction value of a second chrominance component, an adjacent reference value of the first chrominance component, an adjacent reference value of the second chrominance component, and an adjacent reference value of a luma component for a current block; performing prediction based on the reconstructed value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component; performing prediction based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component; determining a predicted value of the luminance component based on the first predicted value and the second predicted value; Here, the current block is a block to be currently coded, and here, for the current block, a reconstructed value of a first chrominance component of the current block and a reconstructed value of a second chrominance component of the current block need to be obtained, where the first chrominance component of the adjacent block of the current block is the adjacent reference value of the first chrominance component, the second chrominance component of the adjacent block of the current block is the adjacent reference value of the second chrominance component, and the luma component of the adjacent block of the current block is the adjacent reference value of the luma component, and the adjacent blocks of the current block are the block in the previous row and the block in the left column of the current block.

[0031] Therefore, after the above values ​​are obtained, a first predicted value is predicted based on the reconstructed value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component, and a second predicted value is predicted based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component, and then a predicted value of the luminance component of the current block can be obtained based on the first predicted value and the second predicted value, in this way, one predicted value is predicted for each chrominance component, and finally the two predicted predicted values ​​are combined to obtain a predicted value of the luminance component of the current block.

[0032] In one alternative embodiment, the step of obtaining the first predicted value includes performing prediction based on the reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain the first predicted value of the luminance component, comprising: determining parameters of a prediction model based on the adjacent reference value of the first chromaticity component and the adjacent reference value of the luminance component; and obtaining a first predicted value utilizing a prediction model based on the reconstructed value of the first chromaticity component.

[0033] After obtaining the reconstruction value of the first chromaticity component and the adjacent reference value of the first chromaticity component, the prediction model of the color component used above may be a linear model or a nonlinear model, and prediction is performed on the luminance component to obtain a first predicted value, where the embodiments of the present application are not specifically limited.

[0034] Specifically, in the case of a linear model, an inter-component linear model prediction mode is used in encoders of next-generation video coding standards, such as the H.266 / VVC Joint Exploration Model (JEM) or the VVC Test model (VTM). Based on equation (1), the predicted value of the luminance component is constructed using the reconstructed value of the same coding block.

number

[0035] TIFF0007602480000002.tif63170

number

[0036] TIFF0007602480000004.tif30170

[0037] TIFF0007602480000005.tif39170

[0038] In practical application, the adjacent reference value of the first chromaticity component and the adjacent reference value of the luminance component are substituted into equation (2) to obtain α and β, and then the reconstructed value of the first chromaticity component is substituted into equation (1) to obtain the first predicted value, and in this way, the first predicted value can be obtained by using the linear model.

[0039] For the prediction model, in addition to the above linear model, a nonlinear model can be used, and based on the above linear model, the prediction model of the color components also proposes a nonlinear model calculation method.

[0040] Specifically, when calculating the parameters of the linear model, not only the adjacent reference value of the chrominance component and the adjacent reference value of the luma component are taken into consideration, but also the correlation and similarity between the reconstructed value of the chrominance component of the current block and the adjacent reference value of the chrominance component are taken into consideration to obtain α and β in the existing linear model, so that the obtained linear model is more compatible with the reconstructed value of the current chrominance component, and further obtains the predicted value of the luma component of the current block.

[0041] For example, in the nonlinear model, the adjacent reference value of the chrominance component of the current block and the adjacent reference value of the luminance component are divided into two sets, and each set can be used as a training set for deriving linear model parameters independently, that is, each set can derive a set of parameters, which can overcome the defect of the deviation between the linear model and the expected model when the adjacent reference value of the chrominance component and the parameters corresponding to the current block have a large deviation, or when the adjacent reference value of another chrominance component and the parameters corresponding to the current block have a large deviation, and further, when the luminance component of the current block is predicted by this linear model, the prediction accuracy of the predicted value of the luminance component can be greatly improved.

[0042] For the nonlinear model, by setting a threshold, the adjacent reference value and the intermediate value can be divided into two sets, and a nonlinear model can be established based on the two sets of adjacent reference values ​​and reconstruction values.

[0043] Here, the threshold value is based on the classification of the adjacent reference value of the chrominance component of the current block and the adjacent reference value of the luminance component, and is also based on the classification of the reconstructed value of the chrominance component of the current block. Here, the threshold value is used to indicate a set value based on which a plurality of calculation models are established, and the magnitude of the threshold value is related to the reconstructed value of the chrominance component of all sampling points of the current block. Specifically, it can be obtained by calculating the average value of the reconstructed value of the chrominance component of all sampling points of the current block, or can be obtained by calculating the median value of the reconstructed value of the chrominance component of all sampling points of the current block, and the embodiment of the present application is not specifically limited thereto.

[0044] In the embodiment of the present application, firstly, the average value can be calculated based on the reconstruction values ​​of the chromaticity components of all the sample points of the block of the current image and Equation (3).

number

[0045] TIFF0007602480000007.tif40170

[0046] TIFF0007602480000008.tif115170

[0047] TIFF0007602480000009.tif45170

[0048] TIFF0007602480000010.tif29170

[0049] TIFF0007602480000011.tif64170

[0050] TIFF0007602480000012.tif20170

number

[0051] TIFF0007602480000014.tif18170

number

[0052] TIFF0007602480000016.tif33170

number

[0053] TIFF0007602480000018.tif81170

[0054] In practical application, firstly, a threshold value is calculated based on the reconstructed value of the first chromaticity component, and then the adjacent reference value of the first chromaticity component and the adjacent reference value of the luminance component are classified based on the threshold value. Taking two calculation models as an example, α1 and β1 are obtained based on equation (4), and α2 and β2 are obtained based on equation (5). Then, the reconstructed value of the first chromaticity component is substituted into the above equation (6) to obtain the first predicted value.

[0055] In one alternative embodiment, the step of obtaining the second predicted value includes performing prediction based on the reconstruction value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain the second predicted value of the luminance component, comprising: determining parameters of a prediction model based on the adjacent reference value of the second chromaticity component and the adjacent reference value of the luminance component; and obtaining a second predicted value utilizing the prediction model based on the reconstructed value of the second chromaticity component.

[0056] Similarly, similar to the method of calculating the first predicted value, as for the linear model, in practical application, the adjacent reference value of the second chromaticity component and the adjacent reference value of the luminance component are substituted into equation (2) to obtain α and β, and then the reconstructed value of the second chromaticity component is substituted into equation (1) to obtain the second predicted value; in this way, the second predicted value can be obtained by using the linear model.

[0057] As for the nonlinear model, in practical application, first calculate the threshold value based on the reconstructed value of the second chromaticity component, and then classify the adjacent reference value of the second chromaticity component and the adjacent reference value of the luminance component based on the threshold value. Taking two calculation models as an example, obtain α1 and β1 based on equation (4), and obtain α2 and β2 based on equation (5). Then, substitute the reconstructed value of the second chromaticity component into the above equation (6) to obtain the second predicted value.

[0058] In this manner, the first predicted value and the second predicted value can be obtained.

[0059] To determine a predicted value of the luminance component, in one alternative embodiment, the step of determining a predicted value of the luminance component based on the first predicted value and the second predicted value includes: obtaining a weight value of the first predicted value and a weight value of the second predicted value; and performing a weighted addition of the first predicted value and the second predicted value based on a weighting value of the first predicted value and a weighting value of the second predicted value to obtain a predicted value of the luminance component.

[0060] After the first predicted value and the second predicted value are determined, a fusion process is performed on the first predicted value and the second predicted value, and the value after the fusion process can be determined as the predicted value of the luminance component.

[0061] Specifically, first, a weighted value of the first predicted value and a weighted value of the second predicted value are obtained, and then a weighted addition is performed to obtain a predicted value of the luminance component by weighting the first predicted value and the second predicted value.

[0062] Here, there are multiple ways to obtain the weight value of the first predicted value and the weight value of the second predicted value. In one optional embodiment, the step of obtaining the weight value of the first predicted value and the weight value of the second predicted value includes: The method may include the steps of selecting a set of weight values ​​from a preset set of weight values, determining one value in the set of weight values ​​as a weight value for the first predicted value, and determining another value in the set of weight values ​​as a weight value for the second predicted value.

[0063] That is, the encoder is preset with a number of weight value sets, such as (0.5, 0.5), (0.2, 0.8), (0.3, 0.7), and (0.1, 0.9), and can select one of the preset weight value sets. If (0.5, 0.5) is selected, the weight value of the first predicted value is 0.5, and the weight value of the second predicted value is 0.5. In this manner, the weight value of the first predicted value and the weight value of the second predicted value can be determined.

[0064] Then, at the decoder side, the selected result can be identified with a corresponding syntax element from the bitstream to facilitate the decoder side in predicting the predicted value of the luma component.

[0065] In one alternative embodiment, the step of obtaining the weight value of the first predicted value and the weight value of the second predicted value comprises: obtaining a weight value of the first predicted value and a weight value of the second predicted value; determining a first weight value as a weight value for the first predicted value and determining a second weight value as a weight value for the second predicted value.

[0066] Here, the weight value of the first predicted value and the weight value of the second predicted value can be predetermined by the user. In this way, when the encoder receives the first weight value and the second weight value, it can determine the first weight value as the weight value of the first predicted value and the second weight value as the weight value of the second predicted value. At the same time, the selected result is identified by a corresponding syntax element from the bitstream, which makes it convenient for the decoder to receive the weight values ​​and predict the predicted value of the luminance component.

[0067] In practical applications, the resolution of the chrominance component of the current block is lower than the resolution of the luma chrominance, and the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component may be selected to be upsampled, or the first predicted value and the second predicted value may be selected to be upsampled, and after obtaining the predicted value of the luma component, the predicted value of the luma component may also be upsampled, where the embodiments of the present application are not specifically limited thereto.

[0068] In the upsampling of the reconstructed value of the first luma component and the reconstructed value of the second chroma component, in one optional embodiment, after obtaining the reconstructed value of the first chroma component, the reconstructed value of the second chroma component, the adjacent reference value of the first chroma component, the adjacent reference value of the second chroma component, and the adjacent reference value of the luma component for the current block, the method includes: If the resolution of the chrominance components is smaller than the resolution of the luma component, the method further includes: upsampling the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component respectively to obtain a processed reconstructed value of the first chrominance component and a processed reconstructed value of the second chrominance component; Accordingly, the step of performing prediction based on the reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component includes: performing prediction based on the processed reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component; Accordingly, the step of performing prediction based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component includes: The method includes performing prediction based on the processed reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component.

[0069] Specifically, since the resolution of the chrominance components of the current block is smaller than that of the luma component, in order to improve the prediction accuracy, here, after obtaining the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component, the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component need to be upsampled respectively, so that the resolution of the reconstructed value after processing of the first chrominance component and the resolution of the reconstructed value after processing of the second chrominance component are respectively the same as the resolution of the luma component, thereby improving the prediction accuracy.

[0070] Therefore, after obtaining a reconstructed value after processing of the first chroma component and a reconstructed value after processing of the second chroma component, prediction is performed based on the reconstructed value after processing of the first chroma component, the adjacent reference value of the first chroma component, and the adjacent reference value of the luminance component to obtain a first predicted value of the chroma component, prediction is performed based on the reconstructed value after processing of the second chroma component, the adjacent reference value of the second chroma component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component, and a predicted value of the luminance component of the current block can be determined based on the obtained first predicted value and second predicted value.

[0071] Wherein, in the upsampling of the first predicted value and the second predicted value, in one alternative embodiment, before determining a predicted value of the luminance component based on the first predicted value and the second predicted value, the method further comprises: and further comprising: upsampling the first predicted value and the second predicted value, respectively, when the resolution of the chrominance component is smaller than the resolution of the luma component, to obtain a processed first predicted value and a processed second predicted value; Accordingly, the step of determining a predicted value of a luminance component based on the first predicted value and the second predicted value comprises: The method includes determining a predicted value of the luminance component based on the processed first predicted value and the processed second predicted value.

[0072] Here, when the resolution of the chromaticity component is smaller than the resolution of the luma component, in order to adapt to the resolution of the luma component, a first predicted value and a second predicted value are obtained, and then the first predicted value and the second predicted value are upsampled respectively to obtain a processed first predicted value and a processed second predicted value, and finally a predicted value of the luma component is determined based on the processed first predicted value and the processed second predicted value.

[0073] In the upsampling of the predicted value of the luminance component, in one alternative embodiment, after determining the predicted value of the luminance component based on the first predicted value and the second predicted value, the method includes: If the resolution of the chrominance component is smaller than the resolution of the luma component, the method further includes upsampling the predicted value of the luma component to obtain a processed predicted value of the luma component.

[0074] That is, after obtaining the predicted value of the luminance component, the predicted value of the luminance component is selected to be upsampled so that the resolution of the predicted value of the luminance component after processing is the same as the resolution of the luminance component.

[0075] In an embodiment of the present application, a color component prediction method is provided. Figure 4 is a flow chart of one selectable color component prediction method according to an embodiment of the present application. As shown in Figure 4, the method includes: In the decoding of color components, a step S401 of decoding chromaticity components; and obtaining a predicted value of the luma component based on the decoded chroma component in step S402.

[0076] In addition, S401 and S402 in the embodiments of the present application are mainly applied to the part of the intraframe prediction unit 203 shown in FIG. 2 and the part of the intraframe prediction unit 303 shown in FIG. 3, that is, the embodiments of the present application can function simultaneously for the encoder and the decoder, and the embodiments of the present application are not specifically limited thereto.

[0077] Also, in S401 and S402, in decoding color components, one chrominance component can be decoded and then the luminance component can be predicted with the chrominance component, one chrominance component can be decoded and then the luminance component can be predicted with the chrominance component, two chrominance components can be decoded first and then the luminance component can be predicted with one chrominance component, or two chrominance components can be predicted with the luminance component, and the embodiments of the present application are not specifically limited thereto.

[0078] To obtain the predicted value of the luminance component, in one alternative embodiment, S102 includes: The method may include a step of predicting based on a first chrominance component in the decoded chrominance components and a second chrominance component in the decoded chrominance components to obtain a predicted value of a luma component; Here, when the first chromaticity component is a blue chromaticity component, the second chromaticity component is a red chromaticity component, and when the first chromaticity component is a red chromaticity component, the second chromaticity component is a blue chromaticity component.

[0079] Here, the predicted value of the luminance component is predicted using the first chrominance component in the decoded chrominance components and the decoded second chrominance component. For example, if the first chrominance component is Cb, the second chrominance component is Cr, and the luminance component is Y, then Y can be predicted using Cb and Cr; or, if the first chrominance component is Cr, the second chrominance component is Cb, and the luminance component is Y, then Y can be predicted using Cb and Cr.

[0080] Further, in one alternative embodiment, to predict the predicted value of the luma component, the step of performing a prediction based on a first chroma component in the decoded chroma components and a second chroma component in the decoded chroma components to obtain the predicted value of the luma component includes: Obtaining a reconstruction value of a first chrominance component, a reconstruction value of a second chrominance component, an adjacent reference value of the first chrominance component, an adjacent reference value of the second chrominance component, and an adjacent reference value of a luma component for a current block; performing prediction based on the reconstructed value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component; performing prediction based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component; determining a predicted value of the luminance component based on the first predicted value and the second predicted value.

[0081] Here, the current block is a block to be decoded currently, and here, for the current block, a reconstructed value of a first chrominance component of the current block and a reconstructed value of a second chrominance component of the current block need to be obtained, and the first chrominance component of the adjacent block of the current block is the adjacent reference value of the first chrominance component, the second chrominance component of the adjacent block of the current block is the adjacent reference value of the second chrominance component, and the luma component of the adjacent block of the current block is the adjacent reference value of the luma component, and the adjacent blocks of the current block are the block in the previous row and the block in the left column of the current block.

[0082] Therefore, after the above values ​​are obtained, a first predicted value is predicted based on the reconstructed value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component, and a second predicted value is predicted based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component, and then a predicted value of the luminance component of the current block can be obtained based on the first predicted value and the second predicted value, in this way, one predicted value is predicted by one chrominance component respectively, and finally the two predicted predicted values ​​are combined to obtain a predicted value of the luminance component of the current block.

[0083] In one alternative embodiment, the step of obtaining the first predicted value includes performing prediction based on the reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain the first predicted value of the luminance component, comprising: determining parameters of a prediction model based on the adjacent reference value of the first chromaticity component and the adjacent reference value of the luminance component; and obtaining a first predicted value utilizing a prediction model based on the reconstructed value of the first chromaticity component.

[0084] After the reconstruction value of the first chromaticity component and the adjacent reference value of the first chromaticity component are obtained, the prediction model of the color component used above may be a linear model or a nonlinear model, and the luminance component is predicted to obtain a first predicted value, where the embodiments of the present application are not specifically limited.

[0085] In practical application, the adjacent reference value of the first chromaticity component and the adjacent reference value of the luminance component are substituted into equation (2) to obtain α and β, and then the reconstructed value of the first chromaticity component is substituted into equation (1) to obtain the first predicted value, and in this way, the first predicted value can be obtained by using the linear model.

[0086] For the prediction model, in addition to the above linear model, a nonlinear model can be used. Based on the above linear model, the prediction model of the color components also proposes a nonlinear model calculation method.

[0087] In practical application, firstly, a threshold value is calculated based on the reconstructed value of the first chromaticity component, and then the adjacent reference value of the first chromaticity component and the adjacent reference value of the luminance component are classified based on the threshold value. Taking two calculation models as an example, α1 and β1 are obtained based on equation (4), and α2 and β2 are obtained based on equation (5). Then, the reconstructed value of the first chromaticity component is substituted into the above equation (6) to obtain the first predicted value.

[0088] In one alternative embodiment, the step of obtaining the second predicted value includes performing prediction based on the reconstruction value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain the second predicted value of the luminance component, comprising: determining parameters of a prediction model based on the adjacent reference value of the second chromaticity component and the adjacent reference value of the luminance component; and obtaining a second predicted value utilizing the prediction model based on the reconstructed value of the second chromaticity component.

[0089] Similarly, similar to the method of calculating the first predicted value, for the linear model, in practical application, the adjacent reference value of the second chromaticity component and the adjacent reference value of the luminance component are substituted into equation (2) to obtain α and β, and then the reconstructed value of the second chromaticity component is substituted into equation (1) to obtain the second predicted value, and in this way, the second predicted value can be obtained using the linear model.

[0090] For the nonlinear model, in practical application, first calculate a threshold value based on the reconstructed value of the second chromaticity component, and then classify the adjacent reference value of the second chromaticity component and the adjacent reference value of the luminance component based on the threshold value. Taking two calculation models as an example, obtain α1 and β1 based on equation (4), and obtain α2 and β2 based on equation (5). Then, substitute the reconstructed value of the second chromaticity component into the above equation (6) to obtain the second predicted value.

[0091] In this manner, the first predicted value and the second predicted value can be obtained.

[0092] To determine a predicted value of the luminance component, in one alternative embodiment, the step of determining a predicted value of the luminance component based on the first predicted value and the second predicted value includes: obtaining a weight value of the first predicted value and a weight value of the second predicted value; and performing a weighted addition of the first predicted value and the second predicted value based on a weighting value of the first predicted value and a weighting value of the second predicted value to obtain a predicted value of the luminance component.

[0093] After the first predicted value and the second predicted value are determined, a fusion process is performed on the first predicted value and the second predicted value, and the value after the fusion process can be determined as the predicted value of the luminance component.

[0094] Specifically, first, a weighted value of the first predicted value and a weighted value of the second predicted value are obtained, and then the first predicted value and the second predicted value are weighted-added to obtain a predicted value of the luminance component.

[0095] Here, there are multiple ways to obtain the weight value of the first predicted value and the weight value of the second predicted value. In one optional embodiment, the step of obtaining the weight value of the first predicted value and the weight value of the second predicted value includes: The method may include the steps of selecting a set of weight values ​​from a preset set of weight values, determining one value in the set of weight values ​​as a weight value for a first predicted value, and determining another value in the set of weight values ​​as a weight value for a second predicted value.

[0096] That is, a number of weight value sets, such as (0.5, 0.5), (0.2, 0.8), (0.3, 0.7) and (0.1, 0.9), are preset in the decoder, and the decoder can select one of the preset weight value sets. When (0.5, 0.5) is selected, the weight value of the first predicted value is 0.5 and the weight value of the second predicted value is 0.5. In this manner, the weight value of the first predicted value and the weight value of the second predicted value can be determined.

[0097] Then, at the decoder side, the selected result can be identified with a corresponding syntax element from the bitstream to facilitate the decoder side in predicting the predicted value of the luma component.

[0098] In one alternative embodiment, the step of obtaining the weight value of the first predicted value and the weight value of the second predicted value comprises: obtaining a weight value of the first predicted value and a weight value of the second predicted value; determining a first weight value as a weight value for the first predicted value and determining a second weight value as a weight value for the second predicted value.

[0099] Here, the weight value of the first predicted value and the weight value of the second predicted value can be predetermined by the user. In this way, when the encoder receives the first weight value and the second weight value, it can determine the first weight value as the weight value of the first predicted value and the second weight value as the weight value of the second predicted value. At the same time, the selected result is identified by a corresponding syntax element from the bitstream, which makes it convenient for the decoder to receive the weight values ​​and predict the predicted value of the luminance component.

[0100] In addition, in practical applications, the resolution of the chrominance component of the current block is lower than the resolution of the luma chrominance, and the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component may be selected to be upsampled, or the first predicted value and the second predicted value may be selected to be upsampled, or the predicted value of the luma component may be obtained and then the predicted value of the luma component may be upsampled, whereby the embodiments of the present application are not specifically limited thereto.

[0101] In the upsampling of the reconstructed value of the first luma component and the reconstructed value of the second chroma component, in one optional embodiment, after obtaining the reconstructed value of the first chroma component, the reconstructed value of the second chroma component, the adjacent reference value of the first chroma component, the adjacent reference value of the second chroma component, and the adjacent reference value of the luma component for the current block, the method includes: If the resolution of the chrominance components is smaller than the resolution of the luma component, the method further includes: upsampling the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component respectively to obtain a processed reconstructed value of the first chrominance component and a processed reconstructed value of the second chrominance component; Accordingly, the step of performing prediction based on the reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component includes: performing prediction based on the processed reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component; Accordingly, the step of performing prediction based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component includes: The method includes performing prediction based on the processed reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component.

[0102] Specifically, since the resolution of the chrominance components of the current block is smaller than the resolution of the luma component, in order to improve the prediction accuracy, after obtaining the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component, the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component need to be upsampled respectively, so that the resolution of the reconstructed value after processing of the first chrominance component and the resolution of the reconstructed value after processing of the second chrominance component are the same as the resolution of the luma component, thereby improving the prediction accuracy.

[0103] Therefore, after the processed reconstructed value of the first chrominance component and the processed reconstructed value of the second chrominance component are obtained, prediction is performed based on the processed reconstructed value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the chrominance component, prediction is performed based on the processed reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component, and a predicted value of the luminance component of the current block can be determined based on the obtained first predicted value and second predicted value.

[0104] Wherein, in the upsampling of the first predicted value and the second predicted value, in one alternative embodiment, before determining a predicted value of the luminance component based on the first predicted value and the second predicted value, the method further comprises: and further comprising: upsampling the first predicted value and the second predicted value, respectively, when the resolution of the chrominance component is smaller than the resolution of the luma component, to obtain a processed first predicted value and a processed second predicted value; Accordingly, the step of determining a predicted value of a luminance component based on the first predicted value and the second predicted value comprises: The method includes determining a predicted value of the luminance component based on the processed first predicted value and the processed second predicted value.

[0105] Here, when the resolution of the chromaticity component is smaller than the resolution of the luma component, in order to adapt to the resolution of the luma component, a first predicted value and a second predicted value are obtained, and then the first predicted value and the second predicted value are upsampled respectively to obtain a processed first predicted value and a processed second predicted value, and finally a predicted value of the luma component is determined based on the processed first predicted value and the processed second predicted value.

[0106] In the upsampling of the predicted value of the luminance component, in one alternative embodiment, after determining the predicted value of the luminance component based on the first predicted value and the second predicted value, the method includes: If the resolution of the chrominance component is smaller than the resolution of the luma component, the method further includes upsampling the predicted value of the luma component to obtain a processed predicted value of the luma component.

[0107] That is, after obtaining the predicted value of the luminance component, the predicted value of the luminance component is selected to be upsampled so that the resolution of the predicted value of the luminance component after processing is the same as the resolution of the luminance component.

[0108] In an embodiment of the present application, a color component prediction method is provided, which includes the steps of: in encoding a color component, encoding a chrominance component, and obtaining a predicted value of a luma component according to the encoded chrominance component; that is, in an embodiment of the present application, first encoding and decoding a chrominance component, and then predicting a luma component with the encoded and decoded chrominance component; in this way, predicting a luma component with the encoded and decoded chrominance component, i.e. encoding and decoding a flat chrominance component first, and then predicting a luma component with rich texture according to the encoded and decoded chrominance component, can improve the prediction accuracy of the luma component, and make the predicted value of the luma component closer to the pixel value of the actual luma component.

[0109] Example 2 Based on the same inventive concept, Fig. 5 is a schematic structural diagram of one selectable encoder according to an embodiment of the present application. As shown in Fig. 5, the encoder according to an embodiment of the present application can include an encoding module 51 and a first acquisition module 52, where: The encoding module 51 is configured to encode chromaticity components in the encoding of the color components; The first retrieval module 52 is configured to derive a prediction of the luma component based on the coded chroma components.

[0110] Furthermore, the first acquisition module 52 specifically The method is configured to perform a prediction based on a first chroma component in the coded chroma components and a second chroma component in the coded chroma components to obtain a predicted value of a luma component; Here, when the first chromaticity component is a blue chromaticity component, the second chromaticity component is a red chromaticity component, and when the first chromaticity component is a red chromaticity component, the second chromaticity component is a blue chromaticity component.

[0111] Furthermore, the step of the first obtaining module 52 performing prediction based on a first chrominance component in the coded chrominance components and a second chrominance component in the coded chrominance components to obtain a predicted value of a luminance component includes: Obtaining a reconstruction value of a first chrominance component, a reconstruction value of a second chrominance component, an adjacent reference value of the first chrominance component, an adjacent reference value of the second chrominance component, and an adjacent reference value of a luma component for a current block; performing prediction based on the reconstructed value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component; performing prediction based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component; determining a predicted value of the luminance component based on the first predicted value and the second predicted value.

[0112] Furthermore, the step of the first obtaining module 52 performing prediction based on the reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component includes: determining parameters of a prediction model based on the adjacent reference value of the first chromaticity component and the adjacent reference value of the luminance component; and obtaining a first predicted value utilizing a prediction model based on the reconstructed value of the first chromaticity component.

[0113] Furthermore, the step of the first obtaining module 52 performing prediction based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component includes: determining parameters of a prediction model based on the adjacent reference value of the second chromaticity component and the adjacent reference value of the luminance component; and obtaining a second predicted value utilizing the prediction model based on the reconstructed value of the second chromaticity component.

[0114] Furthermore, the step of the first acquisition module 52 determining a predicted value of the luminance component based on the first predicted value and the second predicted value includes: obtaining a weight value of the first predicted value and a weight value of the second predicted value; and performing a weighted addition of the first predicted value and the second predicted value based on a weighting value of the first predicted value and a weighting value of the second predicted value to obtain a predicted value of the luminance component.

[0115] Furthermore, the step of the first acquisition module 52 acquiring the weight value of the first predicted value and the weight value of the second predicted value includes: The method includes the steps of selecting one weight value set from a preset weight value set, determining one value in the one weight value set as a weight value for a first predicted value, and determining another value in the one weight value set as a weight value for a second predicted value.

[0116] Furthermore, the first acquisition module 52 specifically The method is configured to obtain, for a current block, a reconstructed value of a first chrominance component, a reconstructed value of a second chrominance component, an adjacent reference value of the first chrominance component, an adjacent reference value of the second chrominance component, and an adjacent reference value of a luma component, and then, when a resolution of the chrominance component is smaller than a resolution of the luma component, respectively upsample the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component to obtain a processed reconstructed value of the first chrominance component and a processed reconstructed value of the second chrominance component; Accordingly, the step of the first obtaining module 52 performing prediction based on the reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component is as follows: performing prediction based on the processed reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component; Accordingly, the step of the first obtaining module 52 performing prediction based on the reconstruction value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component is as follows: The method includes performing prediction based on the processed reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component.

[0117] In one alternative embodiment, the first acquisition module 52 specifically includes: prior to determining the predicted value of the luma component based on the first predicted value and the second predicted value, if a resolution of the chroma component is smaller than a resolution of the luma component, upsampling the first predicted value and the second predicted value respectively to obtain a processed first predicted value and a processed second predicted value; Accordingly, the step of the first acquisition module 52 determining a predicted value of the luminance component based on the first predicted value and the second predicted value includes: The method includes determining a predicted value of the luminance component based on the processed first predicted value and the processed second predicted value.

[0118] In one alternative embodiment, the first acquisition module 52 specifically includes: After determining a predicted value of the luma component based on the first predicted value and the second predicted value, if the resolution of the chroma component is smaller than the resolution of the luma component, the predicted value of the luma component is upsampled to obtain a predicted value of the processed luma component.

[0119] Based on the same inventive concept, Fig. 6 is a structural diagram of one selectable decoder according to an embodiment of the present application. As shown in Fig. 6, the decoder according to an embodiment of the present application can include a decoding module 61 and a second acquisition module 62, where: The decoding module 61 is configured to decode chrominance components in decoding the color components; The second retrieval module 62 is configured to derive a prediction value of the luma component based on the decoded chroma component.

[0120] Furthermore, the second acquisition module 62 specifically includes: A prediction is performed based on a first chroma component in the decoded chroma components and a second chroma component in the decoded chroma components to obtain a prediction value of a luma component; Here, when the first chromaticity component is a blue chromaticity component, the second chromaticity component is a red chromaticity component, and when the first chromaticity component is a red chromaticity component, the second chromaticity component is a blue chromaticity component.

[0121] Further, the step of the second obtaining module 62 predicting based on the first chrominance component in the decoded chrominance components and the second chrominance component in the coded chrominance components to obtain a predicted value of the luminance component may include: Obtaining a reconstruction value of a first chrominance component, a reconstruction value of a second chrominance component, an adjacent reference value of the first chrominance component, an adjacent reference value of the second chrominance component, and an adjacent reference value of a luma component for a current block; performing prediction based on the reconstructed value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component; performing prediction based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component; determining a predicted value of a luminance component based on the first predicted value and the second predicted value.

[0122] Furthermore, the step of the second obtaining module 62 performing prediction based on the reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component includes: determining parameters of a prediction model based on the adjacent reference value of the first chromaticity component and the adjacent reference value of the luminance component; and obtaining a first predicted value utilizing a prediction model based on the reconstructed value of the first chromaticity component.

[0123] Furthermore, the step of the second obtaining module 62 performing prediction based on the reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component includes: determining parameters of a prediction model based on the adjacent reference value of the second chromaticity component and the adjacent reference value of the luminance component; and obtaining a second predicted value utilizing the prediction model based on the reconstructed value of the second chromaticity component.

[0124] Furthermore, the step of the second acquisition module 62 determining a predicted value of the luminance component based on the first predicted value and the second predicted value includes: obtaining a weight value of the first predicted value and a weight value of the second predicted value; and performing a weighted addition of the first predicted value and the second predicted value based on a weighting value of the first predicted value and a weighting value of the second predicted value to obtain a predicted value of the luminance component.

[0125] Furthermore, the step of the second acquisition module 62 acquiring the weight value of the first predicted value and the weight value of the second predicted value includes: The method includes the steps of selecting one weight value set from a preset weight value set, determining one value in the one weight value set as a weight value for a first predicted value, and determining another value in the one weight value set as a weight value for a second predicted value.

[0126] Furthermore, the second acquisition module 62 specifically includes: The method is configured to obtain, for a current block, a reconstructed value of a first chrominance component, a reconstructed value of a second chrominance component, an adjacent reference value of the first chrominance component, an adjacent reference value of the second chrominance component, and an adjacent reference value of a luma component, and then, when a resolution of the chrominance component is smaller than a resolution of the luma component, respectively upsample the reconstructed value of the first chrominance component and the reconstructed value of the second chrominance component to obtain a processed reconstructed value of the first chrominance component and a processed reconstructed value of the second chrominance component; Accordingly, the step of the second obtaining module 62 performing prediction based on the reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component is: performing prediction based on the processed reconstruction value of the first chrominance component, the adjacent reference value of the first chrominance component, and the adjacent reference value of the luminance component to obtain a first predicted value of the luminance component; Accordingly, the step of the second obtaining module 62 performing prediction based on the reconstruction value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component is: The method includes performing prediction based on the processed reconstructed value of the second chrominance component, the adjacent reference value of the second chrominance component, and the adjacent reference value of the luminance component to obtain a second predicted value of the luminance component.

[0127] In one alternative embodiment, the second acquisition module 62 specifically includes: prior to determining the predicted value of the luma component based on the first predicted value and the second predicted value, if a resolution of the chroma component is smaller than a resolution of the luma component, upsampling the first predicted value and the second predicted value respectively to obtain a processed first predicted value and a processed second predicted value; Accordingly, the step of the second acquisition module 62 determining a predicted value of the luminance component based on the first predicted value and the second predicted value includes: The method includes determining a predicted value of the luminance component based on the processed first predicted value and the processed second predicted value.

[0128] In one alternative embodiment, the second acquisition module 62 specifically includes: After determining a predicted value of the luma component based on the first predicted value and the second predicted value, if the resolution of the chroma component is smaller than the resolution of the luma component, the predicted value of the luma component is upsampled to obtain a predicted value of the processed luma component.

[0129] Fig. 7 is a structural diagram of another optional encoder according to an embodiment of the present application. As shown in Fig. 7, the encoder according to the embodiment of the present application may further include a processor 71 and a storage medium 72 storing instructions executable by the processor 71, the storage medium 72 performing operations dependent on the processor 73 via a communication bus 73, and when the instructions are executed by the processor 71, performing the color component prediction method described in one or more embodiments above.

[0130] In practical application, each component in the terminal is coupled via a communication bus 73. It can be understood that the communication bus 73 is configured to realize the connection communication between these components. The communication bus 73 includes a power bus, a control bus and a status signal bus in addition to a data bus. However, for the sake of clarity, various buses are marked as the communication bus 73 in FIG. 7.

[0131] Fig. 8 is a structural diagram of another selectable decoder according to an embodiment of the present application. As shown in Fig. 8, the decoder according to an embodiment of the present application may further include a processor 81 and a storage medium 82 storing instructions executable by the processor 81, the storage medium 82 performing operations dependent on the processor 83 via a communication bus 83, and when the instructions are executed by the processor 81, performing the color component prediction method described in one or more embodiments above.

[0132] It should be noted that in practical application, each component in the terminal is coupled via a communication bus 83. It can be understood that the communication bus 83 is configured to realize the connection communication between these components. The communication bus 83 includes a power bus, a control bus and a status signal bus in addition to a data bus. However, for the sake of clarity, various buses are marked as the communication bus 83 in FIG. 8.

[0133] A computer storage medium according to an embodiment of the present application has executable instructions stored thereon, which, when executed by one or more processors, cause the processors to perform the color component prediction method described in one or more of the embodiments above.

[0134] It can be understood that the memory in the embodiments of the present application may be volatile or non-volatile memory, or may include both volatile and non-volatile memory. Here, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM) that functions as an external cache memory. By way of example and not of limitation, many forms of RAM are available, such as, for example, static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchlink dynamic random access memory (SLDRAM), and direct Rambus random access memory (DRRAM). The memory of the systems and methods described herein is intended to include, without being limited to, these and any other suitable types of memory.

[0135] The processor may be an integrated circuit chip having signal processing functions. In the realization process, each step of the above method may be completed by an instruction in the form of a hardware integrated logic circuit or software in the processor. The above processor may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component. Each method, step and logic block diagram disclosed in the embodiments of the present application can be realized or executed. The general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied to be executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor. The software modules may be located in mature storage media in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0136] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. When implemented in hardware, the processing unit may be implemented as one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units, or a combination thereof for performing the functions described herein.

[0137] When implemented in software, the techniques described herein may be implemented with modules (e.g., processes, functions, etc.) for performing functions described herein. The software code may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.

[0138] It is to be noted that, in this application, the terms "comprehensive," "comprising," or any variation thereof, are intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus that includes a set of elements includes not only those elements but also other elements not expressly set forth, or includes the inherent elements of such process, method, article, or apparatus. Absent further limitations, an element qualified by the phrase "comprising a..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.

[0139] The example numbers in the present application above are for illustrative purposes only and do not represent the superiority or inferiority of the examples.

[0140] From the above description of the embodiments, those skilled in the art can understand that the methods of the above embodiments can be realized by combining software with a necessary general-purpose hardware platform, and of course, can also be realized by hardware, and in many cases, the former is a better embodiment. Based on this understanding, the technical solution of the present application can be essentially embodied in the form of a software product, or the part contributing to the prior art can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as a ROM / RAM, a magnetic disk, an optical disk, etc.) and includes some instructions for making a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) execute the methods described in each embodiment of the present application.

[0141] Although the embodiments of the present application have been described above in combination with the accompanying drawings, the present application is not limited to the above specific embodiments, and the above specific embodiments are merely illustrative and not limiting. Those skilled in the art can implement the present invention in many forms under the teachings of the present invention without departing from the spirit of the present application and the scope of protection of the claims, and all of these belong to the scope of protection of the present application. [Industrial Applicability]

[0142] An embodiment of the present application provides a color component prediction method, an encoder, and a computer storage medium, which include a step of encoding a chrominance component in encoding a color component and obtaining a predicted value of a luma component based on the encoded chrominance component, thereby improving the prediction accuracy of the luma component and making the predicted value of the luma component closer to an actual pixel value of the luma component.

Claims

1. 1. A method for decoding color components, comprising the steps of: obtaining a prediction of a luminance component; performing upsampling on the predicted value of the luminance component to obtain a predicted value of a processed luminance component; Decoding the first chrominance component; determining a second chromaticity component based on the first chromaticity component; The method for decoding color components further comprises: determining parameters of a predictive model; and obtaining a prediction value of the luminance component using the prediction model, the prediction model being a non-linear model. How to decode color components.

2. The first chromaticity component is a blue chromaticity component, and the second chromaticity component is a red chromaticity component. The method of decoding color components according to claim 1 .

3. The first chromaticity component is a red chromaticity component, and the second chromaticity component is a blue chromaticity component. The method of decoding color components according to claim 1 .

4. A decoder comprising: an acquisition module configured to acquire a prediction of a luma component and perform upsampling on the prediction of the luma component to obtain a processed prediction of the luma component; a decoding module configured to decode a first chrominance component and determine a second chrominance component based on the first chrominance component; The acquisition module further comprises: determining parameters of a prediction model and utilizing the prediction model to obtain a predicted value of the luminance component, the prediction model being a non-linear model; Decoder.

5. The first chromaticity component is a blue chromaticity component, and the second chromaticity component is a red chromaticity component. A decoder according to claim 4.

6. the first chromaticity component is a red chromaticity component, and the second chromaticity component is a blue chromaticity component. A decoder according to claim 4.

7. A computer-readable storage medium having executable instructions stored thereon, the executable instructions, when executed by one or more processors, causing the processors to perform the color component decoding method of any one of claims 1-3.

Citation Information

Patent Citations

  • Moving image decoder, moving image decoding method, moving image encoder, moving image encoding method and computer readable recording medium

    JP2018107692A

  • Improved intra prediction in video coding

    JP2020526956A

  • Image decoding method, image encoding method, and recording medium

    JP2020533822A

  • Encoding device, decoding device, encoding method, and decoding method

    WO2018221631A1

  • Improved intra prediction in video coding

    WO2019006105A1