Video coding using cross-component linear model
The CCLM-based video coding method addresses cross-component redundancy by deriving parameters for a final chroma predictor from adjacent luma samples, enhancing compression efficiency and reducing bit rates.
Patent Information
- Application Number
- JP2024151563
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2019-01-09
- Filing Date
- 2024-09-03
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2040-01-08
AI Technical Summary
Existing video coding techniques face challenges in efficiently compressing video data while maintaining video quality, particularly in reducing cross-component redundancy between luma and chroma samples, which affects compression efficiency and bit rate.
A method and device for video coding that utilizes a cross-component linear model (CCLM) to derive parameters α and β for generating a final chroma predictor based on adjacent reconstructed luma samples, reducing complexity by using a simplified derivation process involving selected sample pairs.
The method enhances video coding efficiency by minimizing cross-component redundancy, leading to improved compression performance and reduced bit rates without compromising video quality.
Smart Images

Figure 2024164277000001_ABST
Abstract
Description
[Technical field]
[0001] This application claims the benefit of U.S. Provisional Application No. 62 / 790,459, filed January 9, 2019. The entire disclosure of the aforementioned application is incorporated herein by reference.
[0002] FIELD OF THE DISCLOSURE The present disclosure relates generally to video coding and compression. More specifically, the disclosure relates to a system and method for performing video coding using a cross-component linear model. The method is described in terms of a final chroma predictor for chroma samples of a coding unit in a specific exemplary embodiment. [Background technology]
[0003] This section provides background information related to the present disclosure. The information contained in this section should not necessarily be construed as prior art.
[0004] Various video coding techniques may be used to compress video data. Video coding is performed according to one or more video coding standards. For example, video coding standards include versatile video coding (VVC), joint exploration test model (JEM), high-efficiency video coding (H.265 / HEVC), advanced video coding (H.264 / AVC), moving picture experts group (MPEG) coding, etc. Video coding generally uses prediction methods (e.g., inter-prediction, intra-prediction, etc.) that exploit redundancy present in a video image or sequence. One of the important objectives of video coding techniques is to compress video data into a format that uses a lower bitrate while avoiding or minimizing degradation to the quality of the video. To enable ever-evolving video services, coding techniques with better compression efficiency are needed. Summary of the Invention
[0005] This section provides an overview of the disclosure and is not a comprehensive disclosure of its entire scope or all of its features.
[0006] According to a first aspect of the present disclosure, a method for video coding is performed in a computing device having one or more processors and one or more memories storing a plurality of programs executed by the one or more processors, the method including deriving a first parameter α and a second parameter β for a cross-component linear model (CCLM) mode by using a predetermined number of neighboring reconstructed luma and chroma samples in a coding unit (CU), and generating a final chroma predictor for a chroma sample of the CU by using the first parameter α and the second parameter β.
[0007] According to a second aspect of the present disclosure, there is provided a computing device, the computing device including at least one processor, a non-transitory storage device coupled to the one or more processors, and a plurality of programs stored in the non-transitory storage device that, when executed by the processor, causes the computing device to perform operations including deriving a first parameter α and a second parameter β for a cross-component linear model (CCLM) mode by using a predetermined number of neighboring reconstructed luma samples and chroma samples in a coding unit (CU), and generating a final chroma predictor for the chroma sample of the CU by using the first parameter α and the second parameter β. [Brief description of the drawings]
[0008] In the following, a set of exemplary, non-limiting embodiments of the present disclosure are described. Variations in structure, method, or function may be implemented by those of ordinary skill in the relevant technical field based on the examples shown herein, and all such variations are included within the scope of the present disclosure. Where no inconsistency exists, teachings of different embodiments may, but need not, be combined with each other. [Figure 1] FIG. 1 is a block diagram illustrating an example encoder that may be used in conjunction with multiple video coding standards. [Diagram 2] FIG. 2 is a block diagram illustrating an example decoder that may be used with multiple video coding standards. [Diagram 3] FIG. 3 is a flow chart of a video coding method. [Figure 4] Figure 4 is an example of a luma / chroma pixel sampling grid. [Diagram 5] FIG. 5 shows the locations of the samples used for the derivation of α and β. [Figure 6] FIG. 6 shows the linear derivation of α and β using the min-max method. [Figure 7] FIG. 7 shows the LM_A mode. [Figure 8] FIG. 8 shows the LM_A mode. [Figure 9] Figure 9 is the luma / chroma pixel sampling grid for the YUV4:2:2 format. [Figure 10] Figure 10 is the luma / chroma pixel sampling grid for the YUV4:2:4 format. [Figure 11] FIG. 11 shows multiple neighbors of the MMLM. [Figure 12] FIG. 12 shows the locations of an example of three sample pairs. [Figure 13] FIG. 13 shows another example location of three sample pairs. [Figure 14] FIG. 14 shows an example location of four sample pairs. [Figure 15]FIG. 15 shows another example location of four sample pairs. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] The terms used in this disclosure are intended to describe specific examples, not to limit the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" also refer to the plural, unless the context clearly dictates otherwise. As used herein, the term "and / or" should be understood to refer to any or all possible combinations of one or more of the associated listed items.
[0010] It should be understood that terms such as "first," "second," and "third" may be used herein to denote various pieces of information, and that the information is not to be limited by these terms. These terms are merely used to distinguish one category of information from another. For example, a first piece of information may be referred to as a second piece of information, and similarly, a second piece of information may be referred to as a first piece of information, without departing from the scope of this disclosure. The term "if," as used herein, may be understood to mean "when," "when," or "depending on," depending on the context.
[0011] References throughout this specification to "one embodiment," "an embodiment," "another embodiment," or the like in the singular or plural form mean that one or more of the specific features, structures, or properties described in connection with an embodiment are included in at least one embodiment of the disclosure. Thus, the appearances of the phrases "in one embodiment," "in an embodiment," "another embodiment," or the like in the singular or plural form in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, specific features, structures, or properties in one or more embodiments may be combined in any suitable manner.
[0012] Conceptually, many video coding standards, including those mentioned above in the Background section, are similar, for example, almost all video coding standards use block-based processing and share similar video coding block diagrams to achieve video compression.
[0013] FIG. 1 shows a block diagram of an example encoder 100 that may be used with multiple video coding standards. In the encoder 100, a video frame is divided into multiple video blocks for processing. For each given video block, a prediction is made based on either an inter-prediction approach or an intra-prediction approach. In inter-prediction, one or more predictors are formed based on pixels from a previously reconstructed frame through motion estimation and motion compensation. In intra-prediction, predictors are formed based on reconstructed pixels in a current frame. Through a mode decision, the best predictor is selected to predict the current block.
[0014] A prediction residual, which represents the difference between the current video block and its predictor, is sent to a transform circuit 102, which then sends transform coefficients to a quantization circuit 104 for entropy reduction. The quantized coefficients are then provided to an entropy coding circuit 106 to generate a compressed video bitstream. As shown in FIG. 1, prediction-related information 110, such as video block partition information, motion vectors, reference picture indexes, intra-prediction modes, etc., from an inter-prediction circuit and / or an intra-prediction circuit 112 are also provided through the entropy coding circuit 106 and stored in the compressed video bitstream 114.
[0015] Decoder-related circuitry is also required in the encoder 100 to reconstruct pixels for prediction purposes. First, a prediction residual is reconstructed through inverse quantization 116 and inverse transform circuitry 118. This reconstructed prediction residual is combined with a block predictor 120 to generate unfiltered reconstructed pixels for the current video block.
[0016] In-loop filters are commonly used to improve coding efficiency and image quality. For example, a deblocking filter is available for AVC, HEVC, as well as the current version of VVC. In HEVC, an additional in-loop filter called sample adaptive offset (SAO) is defined to further improve coding efficiency. In the current version of the VVC standard, another in-loop filter called adaptive loop filter (ALF) is actively being researched and has a good chance of being included in the final standard.
[0017] The operation of these in-loop filters is optional: performing these operations helps improve coding efficiency and image quality, and they may be turned off as a decision made by the encoder 100 to save computational effort.
[0018] It should be noted that if these filter options are turned on by the encoder 100, inter prediction is based on filtered reconstructed pixels, while intra prediction is usually based on unfiltered reconstructed pixels.
[0019] FIG. 2 is a block diagram illustrating an exemplary decoder 200 that may be used with multiple video coding standards. The decoder 200 is similar to the reconstruction-related section present in the encoder 100 of FIG. 1. In the decoder 200 (FIG. 2), the input video bitstream 201 is first decoded through entropy decoding 202 to derive the levels of quantized coefficients and prediction-related information. The levels of the quantized coefficients are then processed through inverse quantization 204 and inverse transform 206 to obtain a reconstructed prediction residual. A block predictor mechanism, implemented in an intra / inter mode selector 212, is configured to perform intra prediction 208 or motion compensation 210 based on the decoded prediction information. A set of unfiltered reconstructed pixels is obtained by summing the reconstructed prediction residual from the inverse transform 206 and the prediction output generated by the block predictor mechanism using a summer 214. In the situation where an in-loop filter is turned on, a filtering operation is performed on these reconstructed pixels to derive the final reconstructed video for output.
[0020] In order to reduce the redundancy of cross-components, a prediction mode of cross-component linear model (CCLM) is used in VVC. In the common test conditions during the development of VVC, YUV format 4:2:0 is used, and the sampling grid of luma samples and chroma samples for YUV format 4:2:0 is shown in FIG. 4. The coordinates of luma samples and chroma samples (downsampled luma samples are also shown in FIG. 4). RecL'[x,y] represents the downsampled top and left adjacent reconstructed luma samples, RecC'[x,y] represents the top and left adjacent reconstructed chroma samples, and x and y indicate pixel indexes as shown in the figure. In this disclosure, several methods are proposed to reduce the complexity of deriving the parameters of CCLM.
[0021] The present disclosure generally relates to coding (e.g., encoding and decoding) video data. More specifically, the disclosure relates to a video coding method and a computing device for reducing cross-component redundancy in the video coding method. A CCLM predictor mode is used to predict chroma samples based on reconstructed luma samples of the same CU. The computing device includes at least one processor, a non-transitory storage device coupled to the one or more processors, and a plurality of programs stored in the non-transitory storage device and executed by the processor to cause the computing device to perform operations of the video coding method.
[0022] As shown in FIG. 3, the video coding method includes at least the following steps:
[0023] Step 10: Derive the first parameter α and the second parameter β for the CCLM mode by using a predetermined number of adjacent reconstructed luma and chroma samples in the CU.
[0024] Step 20: Generate a final chroma predictor for the chroma samples of the CU by using the first parameter α and the second parameter β.
[0025] In step 20, we generate the final chroma predictor for the CU's chroma samples by using the following equation:
number
[0026] pred C (x,y) is the final chroma predictor for the chroma samples of the CU, and rec L '(x,y) is the downsampled reconstructed luma sample of the CU, where x denotes the row index and y denotes the column index.
[0027] In FIG. 5, the coordinates of the luma samples and the chroma samples (downsampled luma samples) are shown.
[0028] The parameters α and β are derived by the following equation (referred to as the min-max method in the next section):
number
[0029] Each chroma sample and its corresponding luma sample are called a sample pair. B is the chroma sample value of the largest sample pair, and y A is the chroma sample value of the smallest sample pair, and x B is the luma sample value of the largest sample pair, and x A is the luma sample value of the smallest sample pair.
[0030] As depicted in Figure 6, two points (luma and chroma combinations) (A,B) are the minimum and maximum values among a set of adjacent luma samples. Figure 6 illustrates a straight line between the minimum and maximum values of luma when parameters α and β of the linear model are obtained according to equation (2).
[0031] In Figure 5, Rec L '[x,y] represents the downsampled top and left adjacent reconstructed luma samples, and Rec C[x,y] represents the top and left neighboring reconstructed chroma samples, x indicates the row index, and y indicates the column index. Note that the square blocks in Fig. 5 are reconstructed luma samples corresponding to the luma sample positions depicted in Fig. 4, and the circles in Fig. 5 correspond to the chroma sample or downsampled luma sample positions depicted in Fig. 4. For rectangular coding blocks, the min-max method is applied directly. For non-rectangular coding blocks, the neighboring samples on the longer boundary are first subsampled to have the same number of samples as on the shorter boundary. Fig. 5 shows the left and top sample positions and the samples of the current block involved in CCLM mode.
[0032] The min-max calculation is performed as part of the decoding process and not just as a search operation in the encoder. Therefore, no syntax is used to communicate the values of parameters α and β to the decoder. Currently, equation / filter (3) is used as the luma downsampling filter to generate the downsampled luma samples. However, as shown in equations (3) to (19), a different equation / filter can be selected to generate the downsampled luma samples. Note that equations (5) to (10) can be considered as taking the samples directly without the downsampling process.
number
[0033] The top and left templates can both be used to calculate the coefficients of the linear model, and alternatively, the other two LM modes, LM_A and LM L As shown in Figure 7, in LM_A mode, the above template is used to calculate the coefficients of the linear model. To obtain more samples, the above template is extended to (W+H). As shown in Figure 8, in LM_A mode, the above template is used to calculate the coefficients of the linear model. LIn this mode, only the left template is used to compute the coefficients of the linear model. To get more samples, the left template is extended to (H+W). For non-rectangular blocks, the top template is extended to W+W and the left template is extended to H+H. If the top / left template is not available, LM_A / LM L The mode is not checked or signaled. If not enough samples are available, the template is padded by copying the rightmost (in the case of the top template) or bottommost (in the case of the left template) sample to the nearest log2 number. In addition to the 4:2:0 YUV format, the codec also supports the 4:2:2 (Figure 9) and 4:4:4 (Figure 10) formats.
[0034] At the JVET meeting, several methods to improve the LM mode were proposed:
[0035] MMLM mode: MMLM corresponds to the multi-model LM mode, where two linear models are used to derive the predictions of the chroma samples. The reconstructed luma values are split into two categories, and one model is fitted to each category. The derivation of the α and β parameters for each model is done as in CCLM mode, but the reconstructed luma (downsampled) used to derive the parameters is also split according to each model.
[0036] MFLM mode: MFLM corresponds to the multi-filter LM mode, where different filters are used to downsample the reconstructed luma samples used in the prediction model. Four such filters are used, and the particular filter used is indicated / signaled in the bitstream.
[0037] LM angle prediction: In this mode, the MMLM mode and the non-LM mode are combined by averaging the prediction samples obtained by the two modes.
[0038] MNLM (Multiple Neighbor-based Linear Model) uses multiple neighbor sets for deriving MMLM, covering various linear relationships between luma samples and chroma samples of a CU. As illustrated in Figure 11, three MNLMs with different neighbor sets are proposed in MMLM.
[0039] MMLM: A, B, C, D (including top and left neighbors)
[0040] MMLM above: C, D, F, H (including only the neighbors above)
[0041] Left MMLM: A, B, E, G (including only left neighbors)
[0042] As shown in Figure 11, A is the second neighbor on the left. B is the first neighbor on the left. C is the first neighbor above. D is the second neighbor above. E is the third neighbor on the left. F is the third neighbor above. G is the fourth neighbor on the left. H is the fourth neighbor above.
[0043] The different CCLM prediction modes for MNLM are listed in the table below. [Table 1]
[0044] Mode 0, mode 1, mode 2, and mode 3 use the same downsampling filter but different neighbor sets for LM and MMLM derivation.
[0045] To reduce the complexity of deriving the CCLM parameters, in the first embodiment, three sample pairs are used to derive parameters α and β. As shown in FIG. 12, the sample pairs are the topmost left adjacent sample (Rec' L [-1,0],Rec C[-1,0]) and the bottom adjacent sample to the left (Rec' L [-1,H-1],Rec C [-1,H-1]) and the rightmost adjacent sample above (Rec' L [W-1,-1],Rec C [W-1,-1]), where W and H indicate the width and height of the block of chroma.
[0046] In another embodiment, as shown in FIG. 13, the sample pair is divided into two groups, one for the left-most adjacent sample above (Rec' L [0,-1],Rec C [0,-1]) and the bottom adjacent sample to the left (Rec' L [-1,H-1],Rec C [-1,H-1]) and the rightmost adjacent sample above (Rec' L [W-1,-1],Rec C [W-1,-1]).
[0047] It should be noted that the selection of sample pairs is not limited to the above embodiment, the three sample pairs can be any three sample pairs selected from the reconstructed adjacent samples above or to the left, and the adjacent samples are not limited to only one line above or one line to the left.
[0048] In one embodiment, a sample pair having a maximum luma sample value, a median sample value, and a minimum luma sample value, respectively, is identified through a luma sample comparison. The weighted average of the luma sample values of the maximum and median sample pairs is x B (21)), and the weighted average of the chroma sample values of the maximum and middle sample pairs is y B (23)). The weighted average of the luma sample values of the middle and minimum sample pairs is x A (20)), and the weighted average of the chroma sample values of the middle and minimum sample pairs is y A(shown in equation (22)). Then, the parameters α and β are calculated using equation (2).
number
number
number
number
[0049] x max is the luma sample value of the largest sample pair, and x mid is the luma sample value of the middle sample pair, and x min is the luma sample value of the smallest sample pair, and y max is the chroma sample value of the largest sample pair, and y mid is the chroma sample value of the middle sample pair, and y min is the chroma sample value of the smallest sample pair, and w1+w2=(1< <N1)、offset1=1<<(N1-1)であり、w3+w4=(1<<N2)、offset2=1<<(N2-1)である。
[0050] w1 is the first weighting coefficient, w2 is the second weighting coefficient, w3 is the third weighting coefficient, and w4 is the fourth weighting coefficient. N1 is the first average value, N2 is the second average value, offset1 is the first offset coefficient, and offset2 is the second offset coefficient.
[0051] An example where equal weighting is applied is where w1=1, w2=1, w3=1, w4=1, N1=1, N2=1, and offset1=1, offset2=1.
[0052] In yet another example, w1=3, w2=1, w3=1, w4=3, N1=2, N2=2, and offset1=2, offset2=2.
[0053] In yet another example, w1=3, w2=1, w3=1, w4=3, N1=2, N2=2, and offset1=2, offset2=2.
[0054] In yet another embodiment, i, j, and k are used as indices for the three sample pairs, and luma i and luma j And, luma i and luma k Only two comparisons are made: x and y. The three sample pairs can be completely sorted by luma value, or divided into two groups, one containing the two larger values and the other containing the smaller values, or vice versa. If the values are completely sorted, the method described in the previous section can be used. If the sample pairs are divided into two groups, the luma and chroma samples in the same group are respectively weighted averaged (a single sample pair in a group does not actually require weighted averaging). For example, if there are two sample pairs in a group, the two luma values of the group are equally weighted and averaged, while the two chroma values are also equally weighted and averaged. Here, the weighted average value is expressed as x to derive the CCLM parameters using (2). A , x B , y A and y B Used as.
[0055] In yet another embodiment, the sample pair having the maximum luma sample value and the sample pair having the minimum luma sample value are identified through a comparison of the luma samples. B and the chroma sample value of the largest sample pair is denoted as y Band denote the luma sample value of the smallest sample pair by x A and the chroma sample value of the smallest sample pair is denoted as y A Then, the parameters α and β are calculated using the formula (2).
[0056] It should be noted that the method of deriving the CCLM parameters is not limited to the above embodiment, and the selected three sample pairs can be used in any manner to derive the CCLM parameters.
[0057] In the second embodiment, to reduce the complexity of the derivation of the CCLM, four sample pairs are used to derive the parameters α and β. As shown in FIG. 14, the sample pairs are the topmost sample of the left adjacent sample (Rec' L [-1,0],Rec C [-1,0]) and the leftmost adjacent sample above (Rec' L [0,-1],Rec C [0,-1]) and the bottom adjacent sample to the left (Rec' L [-1,H-1],Rec C [-1,H-1]) and the rightmost adjacent sample above (Rec' L [W-1,-1],Rec C [W-1,-1]).
[0058] In another embodiment, as shown in FIG. 15, the sample pair is split into a quarter of the width of the leftmost sample of the upper adjacent sample (Rec' L [W / 4,-1],Rec C [W / 4,-1]) and one-quarter of the width of the topmost sample to the left (Rec' L [-1,H / 4],Rec C [-1,H / 4]) and the lowest adjacent sample to the left (Rec' L [-1,H-1],Rec C[-1,H-1]) and the rightmost adjacent sample above (Rec' L [W-1,-1],Rec C [W-1,-1]).
[0059] It should be noted that the selection of sample pairs is not limited to the above embodiment. The four sample pairs can be any four sample pairs selected from the reconstructed adjacent samples above or to the left, and the adjacent samples are not limited to only one line above or one line to the left. For example, one set of sample pairs includes a quarter of the width of the leftmost sample among the adjacent samples above, a quarter of the width of the topmost sample among the adjacent samples to the left, a three-quarter of the width of the leftmost sample among the adjacent samples above, and a three-quarter of the width of the topmost sample among the adjacent samples to the left.
[0060] Alternatively, another set of sample pairs includes one-eighths of the width of the leftmost one of the adjacent samples above, three-eighths of the width of the leftmost one of the adjacent samples above, five-eighths of the width of the leftmost one of the adjacent samples above, and seven-eighths of the width of the leftmost one of the adjacent samples above.
[0061] Alternatively, another set of sample pairs includes one-eighth of the height of the topmost one of the left adjacent samples, three-eighths of the height of the topmost one of the left adjacent samples, five-eighths of the height of the topmost one of the left adjacent samples, and seven-eighths of the height of the topmost one of the left adjacent samples.
[0062] In one embodiment, a sample pair having the largest two luma sample values and the smallest two luma sample values, respectively, are identified through a comparison of the luma samples. B0 , x B1and are shown, and the chroma sample values of the two larger maximum sample pairs are y B0 , y B1 and are shown. The luma sample values of the two smaller sample pairs are x A0 , x A1 and are shown, and the chroma sample values of the two smaller minimum sample pairs are y A0 , y A1 and are shown. And, as shown in the following equations, equations (24)-(27), x A , x B , y A and y B are derived as the weighted averages of x A0 , x A1 , x B0 , x B1 , y A0 , y A1 and y B0 , y B1 . And the parameter α and the parameter β are calculated using equation (2).
Number
Number
Number
Number
[0063] w1 + w2 = (1 << N1), offset1 = 1 << (N1 - 1). w3 + w4 = (1 << N2), offset2 = 1 << (N2 - 1). w1 is the first weighting coefficient, w2 is the second weighting coefficient, w3 is the third weighting coefficient, and w4 is the fourth weighting coefficient. Also, N1 is the first average value, and N2 is the second average value. Also, offset1 is the first offset coefficient, and offset2 is the second offset coefficient.
[0064] An example where equal weighting is applied is where w1=1, w2=1, w3=1, w4=1, N1=1, N2=1, and offset1=1, offset2=1.
[0065] In yet another example, w1=3, w2=1, w3=1, w4=3, N1=2, N2=2, and offset1=2, offset2=2.
[0066] In another embodiment, a sample pair having a maximum luma sample value and a minimum luma sample value, respectively, is identified through a comparison of the luma samples. The luma sample value of the maximum sample pair is denoted by x B and the chroma sample value of the largest sample pair is denoted as y B Let the luma sample value of the smallest sample pair be x A and the chroma sample value of the smallest sample pair is denoted as y A Then, the parameters α and β are calculated using the formula (2).
[0067] It should be noted that the method of deriving the CCLM parameters is not limited to the above embodiment, and the selected four sample pairs can be used in any manner to derive the CCLM parameters.
[0068] Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any modifications, uses, or adaptations of the invention in accordance with its general principles, including departures from the present disclosure as come within known or customary practice in the art. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
[0069] It will be appreciated that the present invention is not limited to the specific examples described above and illustrated in the accompanying drawings, and that various modifications and changes can be made without departing from the scope of the present invention, which is intended to be limited only by the appended claims.
[0070] In one or more examples, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over a computer-readable medium as one or more instructions or code and executed by a hardware-based processing unit. Computer-readable media includes computer-readable storage media, which correspond to tangible media, such as data storage media, and communication media, which include any medium that facilitates transmission of a computer program from one place to another, for example according to a communication protocol. As such, computer-readable media may generally correspond to (1) a non-transitory, tangible computer-readable storage medium, or (2) a communication medium, such as a signal, carrier wave, or the like. A data storage medium may be any available medium that can be accessed by one or more computers or one or more processors to obtain instructions, code, and / or data structures for implementation of the implementations described herein. A computer program product may include a computer-readable medium.
[0071] Additionally, the methods may be implemented using an apparatus including one or more circuits, including application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components. The apparatus may use the circuits in combination with other hardware or software components to perform the methods described above. Each of the above modules, sub-modules, units, or sub-units may be implemented, at least in part, using one or more circuits.
[0072] Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any modifications, uses, or adaptations of the invention in accordance with its general principles, including departures from the present disclosure as come within known or customary practice in the art. It is intended that the specification and examples be considered as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.
[0073] It will be appreciated that the present invention is not limited to the specific examples described above and illustrated in the accompanying drawings, and that various modifications and changes can be made without departing from the scope of the present invention, which is intended to be limited only by the appended claims.
Claims
1. deriving a first parameter α and a second parameter β for a cross-component linear model (CCLM) mode by using a predetermined number of neighboring reconstructed luma and chroma samples in a coding unit (CU); generating a final chroma predictor for the chroma samples of the CU by using the first parameter α and the second parameter β; 23. A method for video coding comprising:
2. generating the final chroma predictor for the chroma samples of the CU by using the first parameter α and the second parameter β, obtaining the final chroma predictor using [0010] Equipped with Pred C (x, y) is the final chroma predictor for the chroma samples of the CU, and rec L '(x, y) is the downsampled reconstructed luma sample of the CU, where x denotes the row index and y denotes the column index; The method of claim 1.
3. deriving the first parameter α and the second parameter β for the CCLM mode by using a predetermined number of neighboring reconstructed luma and chroma samples in a coding unit (CU), deriving the first parameter α and the second parameter β by using adjacent reconstructed chroma samples and their corresponding luma samples, each of which is referred to as a sample pair; The method of claim 2 comprising:
4. Each of a chroma sample and its corresponding luma sample is referred to as the sample pair, and deriving the first parameter α and the second parameter β by using adjacent reconstructed chroma samples and their corresponding luma samples includes: Obtaining the first parameter α and the second parameter β using the following equation: [0025] Equipped with y B is the chroma sample value of the largest sample pair, and y A is the chroma sample value of the smallest sample pair, and x B is the luma sample value of the largest sample pair, and x A is the luma sample value of the smallest sample pair, The method according to claim 3.
5. deriving the first parameter α and the second parameter β by using adjacent reconstructed chroma samples and their corresponding luma samples, using three sample pairs to derive the parameter α and the parameter β; Equipped with The three sample pairs are a sample pair set of an uppermost one of the left adjacent samples, a lowermost one of the left adjacent samples, and a rightmost one of the upper adjacent samples; a sample pair set of a left-most sample of the above adjacent samples, a bottom-most sample of the left adjacent samples, and a right-most sample of the above adjacent samples; A sample set of one of The method according to claim 4.
6. Using the following formula, x A、 x B , y A、 and y B To obtain [0030] Further equipped with x max is the luma sample value of the largest sample pair, and x mid is the luma sample value of the middle sample pair, and x min is the luma sample value of the smallest sample pair, and y max is the chroma sample value of the largest sample pair, and y mid is the chroma sample value of the intermediate sample pair, and y min are the chroma sample values of the smallest sample pair, w1+w2=(1<<N1), offset1=1<<(N1-1), w3+w4=(1<<N2), offset2=1<<(N2-1), w1 is the first weighting factor, w2 is the second weighting factor, w3 is the third weighting factor, w4 is the fourth weighting factor, N1 is the first average value, N2 is the second average value, offset1 is the first offset factor, and offset2 is the second offset factor. The method according to claim 5.
7. Let x be the luma sample value of the largest sample pair. B and Let y be the chroma sample value of the maximum sample pair. B and Let x be the luma sample value of the smallest sample pair. A and y as the chroma sample value of the smallest sample pair A and The method of claim 5 further comprising:
8. deriving the parameters α and β by using neighboring reconstructed chroma samples and their corresponding luma samples, using four sample pairs to derive the parameter α and the parameter β; Equipped with The four sample pairs are a sample pair set of a topmost one of the left adjacent samples, a leftmost one of the above adjacent samples, a bottommost one of the left adjacent samples, and a rightmost one of the above adjacent samples; a sample pair set of a quarter portion of the width of the leftmost one of the above adjacent samples, a quarter portion of the width of the topmost one of the left adjacent samples, the bottommost one of the left adjacent samples, and the rightmost one of the above adjacent samples; a sample pair set of a quarter portion of the width of the leftmost one of the above adjacent samples, a quarter portion of the width of the topmost one of the left adjacent samples, a three-quarter portion of the width of the leftmost one of the above adjacent samples, and a three-quarter portion of the width of the topmost one of the left adjacent samples; a set of sample pairs including a 1 / 8th portion of the width of the leftmost sample of the upper adjacent samples, a 3 / 8th portion of the width of the leftmost sample of the upper adjacent samples, a 5 / 8th portion of the width of the leftmost sample of the upper adjacent samples, and a 7 / 8th portion of the width of the leftmost sample of the upper adjacent samples; a sample pair set of one-eighth of the height of the topmost sample of the left adjacent samples, three-eighths of the height of the topmost sample of the left adjacent samples, five-eighths of the height of the topmost sample of the left adjacent samples, and seven-eighths of the height of the topmost sample of the left adjacent samples; A sample set of one of The method according to claim 4.
9. Using the following formula, x A、 x B , y A and y BTo obtain [0045] Further equipped with w1+w2=(1<<N1), offset1=1<<(N1-1), w3+w4=(1<<N2), offset2=1<<(N2-1), The luma sample value of the larger of the two sample pairs is x B0 , x B1 and the chroma sample values of the larger of the two maximum sample pairs are denoted as y B0 , y B1 and the luma sample value of the smaller two sample pairs is denoted as x A0 , x A1 and the chroma sample values of the smaller of the two minimum sample pairs are denoted as y A0 , y A1 It is shown that w1 is the first weighting factor, w2 is the second weighting factor, w3 is the third weighting factor, w4 is the fourth weighting factor, N1 is the first average value, N2 is the second average value, offset1 is the first offset factor, and offset2 is the second offset factor. The method according to claim 8.
10. 1. A computing device comprising: At least one processor; a non-transitory storage device coupled to one or more of said processors; A plurality of programs stored in the non-transitory storage device that, when executed by the processor, cause the computing device to perform operations including: Preparation, The operation includes: deriving a first parameter α and a second parameter β for a cross-component linear model (CCLM) mode by using a predetermined number of neighboring reconstructed luma and chroma samples in a coding unit (CU); generating a final chroma predictor for the chroma samples of the CU by using the first parameter α and the second parameter β; Equipped with Computing device.
11. generating a final predictor of chroma for the chroma samples of the CU by using the first parameter α and the second parameter β, obtaining the final chroma predictor using [0050] Equipped with Pred C (x, y) is the final chroma predictor for the chroma samples of the CU, and rec L '(x, y) is the downsampled reconstructed luma sample of the CU, where x denotes the row index and y denotes the column index; The computing device of claim 10.
12. deriving the first parameter α and the second parameter β for the CCLM mode by using a predetermined number of neighboring reconstructed luma and chroma samples in a coding unit (CU), deriving the first parameter α and the second parameter β by using adjacent reconstructed chroma samples and their corresponding luma samples, each of which is referred to as a sample pair; The computing device of claim 11 .
13. Each of a chroma sample and its corresponding luma sample is referred to as the sample pair, and deriving the first parameter α and the second parameter β by using adjacent reconstructed chroma samples and their corresponding luma samples includes: Obtaining the first parameter α and the second parameter β using the following equation: [006] Equipped with y B is the chroma sample value of the largest sample pair, and y A is the chroma sample value of the smallest sample pair, and x B is the luma sample value of the largest sample pair, and x A is the luma sample value of the smallest sample pair, The computing device of claim 12.
14. deriving the first parameter α and the second parameter β by using adjacent reconstructed chroma samples and their corresponding luma samples, using three sample pairs to derive the parameter α and the parameter β; Equipped with The three sample pairs are a sample pair consisting of an uppermost one of the left adjacent samples, a lowermost one of the left adjacent samples, and a rightmost one of the upper adjacent samples; a sample pair including a left-most sample of the above adjacent samples, a bottom-most sample of the left adjacent samples, and a right-most sample of the above adjacent samples; containing one sample pair of The computing device of claim 13.
15. The said act is Using the following formula, x A , x B , y A and y B To obtain [0070] Further equipped with x max is the luma sample value of the largest sample pair, and x mid is the luma sample value of the middle sample pair, and x min is the luma sample value of the smallest sample pair, and y max is the chroma sample value of the largest sample pair, and y mid is the chroma sample value of the intermediate sample pair, and y min are the chroma sample values of the smallest sample pair, w1+w2=(1<<N1), offset1=1<<(N1-1), w3+w4=(1<<N2), offset2=1<<(N2-1), w1 is the first weighting factor, w2 is the second weighting factor, w3 is the third weighting factor, w4 is the fourth weighting factor, N1 is the first average value, N2 is the second average value, offset1 is the first offset factor, and offset2 is the second offset factor. The computing device of claim 14.
16. The said act is Let x be the luma sample value of the largest sample pair. B and Let y be the chroma sample value of the maximum sample pair. B and Let x be the luma sample value of the smallest sample pair. A and y as the chroma sample value of the smallest sample pair A and The computing device of claim 14 further comprising:
17. deriving the parameters α and β by using neighboring reconstructed chroma samples and their corresponding luma samples, using four sample pairs to derive the parameter α and the parameter β; Equipped with The four sample pairs are a sample pair set of a topmost one of the left adjacent samples, a leftmost one of the above adjacent samples, a bottommost one of the left adjacent samples, and a rightmost one of the above adjacent samples; a sample pair set of a quarter portion of the width of the leftmost one of the above adjacent samples, a quarter portion of the width of the topmost one of the left adjacent samples, the bottommost one of the left adjacent samples, and the rightmost one of the above adjacent samples; a sample pair set of a quarter portion of the width of the leftmost one of the above adjacent samples, a quarter portion of the width of the topmost one of the left adjacent samples, a three-quarter portion of the width of the leftmost one of the above adjacent samples, and a three-quarter portion of the width of the topmost one of the left adjacent samples; a set of sample pairs including a 1 / 8th portion of the width of the leftmost sample of the upper adjacent samples, a 3 / 8th portion of the width of the leftmost sample of the upper adjacent samples, a 5 / 8th portion of the width of the leftmost sample of the upper adjacent samples, and a 7 / 8th portion of the width of the leftmost sample of the upper adjacent samples; a sample pair set of one-eighth of the height of the topmost sample of the left adjacent samples, three-eighths of the height of the topmost sample of the left adjacent samples, five-eighths of the height of the topmost sample of the left adjacent samples, and seven-eighths of the height of the topmost sample of the left adjacent samples; A sample set of one of The computing device of claim 13.
18. The said act is Using the following formula, x A , x B , y A and y B To obtain [0080] Further equipped with w1+w2=(1<<N1), offset1=1<<(N1-1), w3+w4=(1<<N2), offset2=1<<(N2-1), The luma sample value of the larger of the two sample pairs is x B0 , x B1 and the chroma sample values of the larger of the two maximum sample pairs are denoted as y B0 , y B1 and the luma sample value of the smaller two sample pairs is denoted as x A0 , x A1 and the chroma sample values of the smaller of the two minimum sample pairs are denoted as y A0 , y A1 It is shown that w1 is the first weighting factor, w2 is the second weighting factor, w3 is the third weighting factor, w4 is the fourth weighting factor, N1 is the first average value, N2 is the second average value, offset1 is the first offset factor, and offset2 is the second offset factor.
20. The computing device of claim 17.
Citation Information
Patent Citations
Method of Video Coding for Chroma Components
US20170366818A1
Linear model chroma intra prediction for video coding
WO2018053293A1
Linear model prediction mode with sample accessing for video coding
WO2018118940A1
New sample sets and new down-sampling schemes for linear component sample prediction
WO2019162413A1
