Methods and apparatus for intra-frame merging mode of mixing mode and chroma component in video encoding and decoding systems.
By employing a hybrid-mode intra-frame prediction method based on information inherited from previous coded blocks in the video encoding and decoding system, a merged candidate set is constructed and a target block is selected to generate the prediction for the current block. This solves the problem of low efficiency in intra-frame prediction in the prior art and improves encoding and decoding efficiency.
Patent Information
- Application Number
- CN202580028714.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-04-19
- Filing Date
- 2025-04-16
- Publication Date
- 2026-11-17
AI Technical Summary
Existing video coding and decoding systems suffer from inefficiency in intra-frame prediction, especially when dealing with multi-functional video coding and decoding standards such as VVC, where it is difficult to effectively utilize information from previous coded blocks for efficient intra-frame prediction.
A hybrid mode intra-frame prediction method based on information inherited from previous coded blocks is adopted. By constructing a merged candidate set and selecting the target block, the prediction of the current block is generated, and the inherited information of the target block is used for intra-frame prediction.
It improves the efficiency and performance of intra-frame prediction, enhances the encoding and decoding efficiency of video codec systems, and makes better use of information from previous coded blocks, especially in multi-functional video codec standards.
Smart Images

Figure CN123125864A_ABST
Abstract
Description
[0001] Cross-references This invention is a non-provisional application of U.S. Provisional Patent Application No. 63 / 634,953 (filed April 17, 2024) and U.S. Provisional Patent Application No. 63 / 636,172 (filed April 19, 2024), and claims priority thereto. The entire contents of the aforementioned U.S. Provisional Patent Applications are incorporated herein by reference. Technical Field
[0002] This invention relates to intra-frame prediction in a video codec system that utilizes inherited information from previous codec blocks. In particular, this invention relates to intra-frame merging modes with mixing modes having one or more color components. Background Technology
[0003] Versatile Video Coding (VVC) is the latest international video coding standard developed by the Joint Video Experts Team (JVET), comprised of the ITU-T Video Coding Experts Group (VCEG) and the ISO / IEC Moving Picture Experts Group (MPEG). This standard has been published as an ISO standard: ISO / IEC 23090-3:2021, Information technology – Encoding representation of immersive media – Part 3: Versatile Video Coding, published in February 2021. VVC is developed based on its predecessor, High Efficiency Video Coding (HEVC), by adding more coding and decoding tools to improve coding and decoding efficiency and handle various types of video sources, including three-dimensional (3D) video signals.
[0004] Figure 1AAn exemplary adaptive inter-frame / intra-frame video coding system incorporating loop processing is illustrated. For intra-frame prediction 110, prediction data is derived from previously encoded video data in the current frame. For inter-frame prediction 112, motion estimation (ME) is performed at the encoder, and motion compensation (MC) is performed based on the result of ME to provide prediction data derived from other frames and motion data. Switch 114 selects either intra-frame prediction 110 or inter-frame prediction 112 and provides the selected prediction data to adder 116 to form a prediction error, also known as a residual. The prediction error is then processed by transform (T) 118, followed by quantization (Q) 120. The transformed and quantized residual is encoded by entropy encoder 122 and included in the video bitstream corresponding to the compressed video data. The bitstream associated with the transform coefficients is then packaged with side information, such as motion and encoding / decoding modes associated with intra-frame and inter-frame prediction, and other information related to loop filters applied to the base image region. Side information related to intra-frame prediction 110, inter-frame prediction 112, and loop filter 130, such as Figure 1A The image is provided to the entropy encoder 122. When using inter-frame prediction mode, the reference picture or image must also be reconstructed at the encoder. Therefore, the transformed and quantized residuals are processed by inverse quantization (IQ) 124 and inverse transformation (IT) 126 to recover the residuals. Then, the residuals are added back to the prediction data 136 in reconstruction (REC) 128 to reconstruct the video data. The reconstructed video data can be stored in the reference picture buffer (Ref. Pic. Buffer) 134 and used for prediction of other frames.
[0005] like Figure 1AAs shown, the incoming video data undergoes a series of processing steps in the encoding system. The video data reconstructed by REC 128 may be subject to various degradations due to these processing steps. Therefore, a loop filter 130 is typically applied to the reconstructed video data before it is stored in the reference image buffer 134 to improve video quality. For example, a deblocking filter (DF), Sample Adaptive Offset (SAO), and Adaptive Loop Filter (ALF) may be used. Loop filter information may need to be included in the bitstream so that the decoder can correctly recover the required information. Therefore, loop filter information is also provided to the entropy encoder 122 for inclusion in the bitstream. Figure 1A In the process, the loop filter 130 is applied to the reconstructed video before the reconstructed samples are stored in the reference image buffer 134. Figure 1A The system described herein is intended to demonstrate an exemplary architecture of a typical video encoder. It may correspond to a High Efficiency Video Codec (HEVC) system, VP8, VP9, H.264, VVC, or any other video codec standard.
[0006] like Figure 1B As shown, the decoder can use functional modules similar to or partially identical to the encoder, except for transform 118 and quantization 120, since the decoder only needs inverse quantization 124 and inverse transform 126. The decoder uses entropy decoder 140 to decode the video bitstream into quantized transform coefficients and the required encoding / decoding information (e.g., loop filter information, intra-frame prediction information, and inter-frame prediction information). Intra-frame prediction 150 at the decoder end does not require mode search. Instead, the decoder only needs to generate intra-frame predictions based on the intra-frame prediction information received from entropy decoder 140. Furthermore, for inter-frame prediction, the decoder only needs to perform motion compensation (MC 152) based on the inter-frame prediction information received from entropy decoder 140, without motion estimation.
[0007] According to VVC, the input image is divided into non-overlapping square regions called Coding Tree Units (CTUs), similar to HEVC. Each CTU can be further divided into one or more smaller Coding Units (CUs). The resulting CU partitions can be square or rectangular. Furthermore, VVC divides the CTUs into Prediction Units (PUs) as units for applying prediction processes, such as inter-frame prediction and intra-frame prediction.
[0008] The VVC standard incorporates various new encoding and decoding tools to further improve encoding and decoding efficiency beyond the HEVC standard. The following is a review of some tools related to this invention.
[0009] Intra-mode codec with 67 intra-prediction modes In VVC, several traditional angle intra-prediction modes are adaptively replaced with non-blocky wide-angle intra-prediction modes.
[0010] Intra-frame mode encoding and decoding The Most Probable Mode (MPM) list is generated by considering two available neighboring intra-frame modes.
[0011] This invention discloses a method and apparatus for deriving mixed-mode intra-frame prediction of one or more color components based on information inherited from previous coding blocks, in order to improve performance. Summary of the Invention
[0012] A method and apparatus for deriving mixed-mode intra-frame prediction based on inherited information from previous codec blocks are disclosed. According to the method, input data associated with a current block is received, including a first color component and one or more second color components, wherein the input data includes pixel data to be encoded at the encoder end or data associated with the current block to be decoded at the decoder end. An inherited block setting is determined, wherein the inherited block setting corresponds to inherited information or candidate modes associated with several previous codec blocks. A merge candidate set specified by the inherited block setting is constructed from the previous codec blocks. One or more target blocks are selected from the merge candidate set. A target prediction is generated for the current block based on the target mode and the inherited information associated with the one or more target blocks, wherein the inherited information from the one or more target blocks includes inherited information related to the first color component and / or the one or more second color components, and the prediction for the current block for the first color component and / or the one or more second color components is generated based on the inherited information associated with the first color component and / or the one or more second color components, respectively. The current block is encoded or decoded using the target prediction.
[0013] In one embodiment, the inheritance information from the one or more target blocks includes only the inheritance information related to the first color component, and only a prediction for the current block with the first color component is generated, which is based on the inheritance information related to the first color component. In another embodiment, the inheritance information from the one or more target blocks includes the inheritance information related to the one or more second color components, and the prediction for the one or more second color components is generated based on the inheritance information related to the one or more second color components.
[0014] In one embodiment, a set of allowed target first color modes and / or a set of allowed target second color modes are determined. In one embodiment, if both the target first color mode and the target second color mode of the target previously encoded block are in the set of allowed target first color modes and the set of allowed target second color modes, then the target previously encoded block is allowed to be added to the merge candidate set. In one embodiment, the target prediction for the first color component and the one or more second color components is generated based on the first color component and the one or more second color components associated with the inheritance information of the one or more target blocks.
[0015] In one embodiment, the target mode associated with the one or more target blocks selected for the current block includes a chroma direct mode, a DIMD chroma mode, a chroma fusion mode, or a cross-component prediction mode. When the target mode corresponds to the chroma direct mode, the inherited information associated with the one or more target blocks includes whether the block is encoded / decoded in the chroma direct mode. When the target mode corresponds to the DIMD chroma mode, the inherited information associated with the one or more target blocks includes one or more histogram values of available intra-prediction modes, N intra-prediction modes suggested by the histogram values, or both. When the target mode corresponds to the chroma fusion mode, the inherited information associated with the one or more target blocks includes the Linear Model (LM) mode to be fused. When the target mode corresponds to the cross-component prediction mode, the inherited information associated with the one or more target blocks includes the encoding / decoding mode, model parameters, a classification threshold for the encoding / decoding mode as a multi-model cross-component mode, a low-pass filter flag, or a combination thereof.
[0016] In one embodiment, when the one or more target blocks for the first color component and the one or more target blocks for the one or more second color components are different, the candidate indices for the first color component and the one or more second color components are signaled or parsed separately. In one embodiment, when the merge candidate set for the first color component and the merge candidate set for the one or more second color components are different, a flag is used to indicate whether the first color component and the one or more second color components are encoded / decoded in the merge scheme. In one embodiment, the candidate indices for the first color component and the one or more second color components are signaled or parsed separately.
[0017] In one embodiment, when the merge candidate set of the first color component differs from the merge candidate set of the one or more second color components, a flag is used to indicate whether the first color component is encoded or decoded in the merge scheme, and signaling or parsing is performed on the candidate index. In another embodiment, a second flag is used to indicate whether the one or more second color components are encoded in a second merge scheme, and signaling or parsing is performed on the one or more second candidate indices. Attached Figure Description
[0018] Figure 1A This paper describes an exemplary adaptive Inter / Intra video encoding system that incorporates loop processing.
[0019] Figure 1B Explanation Figure 1A The corresponding decoder of the encoder.
[0020] Figure 2 Three types of filter shapes are described, each with fifteen inputs and generating one output for the EIP process.
[0021] Figure 3A -C indicates three types ( Figure 3A Top left area Figure 3B The upper area Figure 3C The reconstructed region (left side region) is used to derive the filter coefficients of the EIP.
[0022] Figure 4 This illustrates a sample template area with multiple reference lines.
[0023] Figure 5 This indicates the location of the spatial merging candidates.
[0024] Figure 6A -C illustrates a DIMD chromaticity mode paradigm using a DIMD derivation method that reconstructs Y(t) based on the nearest neighbors in the second nearest row and column. Figure 6A ), Cb ( Figure 6B ) and Cr ( Figure 6C The sample is used to derive the intra-frame chroma prediction mode for the current block.
[0025] Figure 7 A flowchart of an exemplary video encoding / decoding system is provided, which, according to an embodiment of the invention, derives hybrid-mode intra-frame prediction based on inheritance from previous encoded / decoded blocks. Detailed Implementation
[0026] It will be readily understood that the components of the present invention, as described and illustrated in the figures, can be arranged and designed in a variety of different configurations. Therefore, the following more detailed description of embodiments of the systems and methods of the present invention, as shown in the figures, is not intended to limit the scope of the claimed invention, but is merely representative of selected embodiments of the invention. References to “one embodiment,” “an embodiment,” or similar language throughout this specification mean that a particular feature, structure, or characteristic associated with that embodiment may be included in at least one embodiment of the invention. Therefore, the phrases “in one embodiment” or “in a kind of embodiment” appearing in various places in this specification do not necessarily refer to the same embodiment.
[0027] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. However, those skilled in the art will recognize that the invention can be practiced without one or more specific details, or using other methods, components, etc. In other instances, well-known structures or operations have not been shown or described in detail to avoid obscuring aspects of the invention. Embodiments of the invention will be best understood by referring to the accompanying drawings, in which similar parts are labeled with similar numerals throughout the figures. The following description is by way of example only, illustrating merely embodiments of certain selected devices and methods consistent with the claims of the invention.
[0028] 1.1 Decoder-side Intra Mode Derivation (DIMD) When DIMD is applied, two intra-frame modes are derived from the reconstructed neighboring samples (templates), and these two predictors are combined with a planar mode predictor with weights derived from the gradients. Texture gradient analysis is performed at both the encoder and decoder ends. This process begins with an empty gradient histogram (HoG) with 65 entries, corresponding to 65 angular modes. The magnitudes of these entries are determined during texture gradient analysis.
[0029] 1.2 Template-based Intra Mode Derivation (TIMD) Template-based intra-frame mode derivation (TIMD) modes implicitly derive the intra-predicted mode of the CU from neighboring templates in the encoder and decoder, rather than signaling the exact intra-predicted mode bits to the decoder. Predicted samples for the templates are generated using reference samples of the template for each candidate mode. The SATD between the prediction and the reconstructed samples of the template is calculated as the cost. The top two intra-predicted modes with the minimum SATD are selected as TIMD modes. These two TIMD modes are fused with weights to generate the prediction for the current CU.
[0030] 1.3 Extrapolation filter-based IntraPrediction (EIP) mode In EIP mode, samples in the CU are predicted from the top left to the bottom right by applying an extrapolation filter to neighboring reconstructed or predicted samples. EIP mode uses a 15-tap filter for prediction, as shown below: in It is the predicted value of position (x, y) in CU. These are filter coefficients. It refers to either reconstructed samples or predicted samples.
[0031] EIP filters can be derived from neighboring reconstructed samples or inherited from previous EIP coding blocks. ECM supports three EIP filter shapes and three types of reconstructed regions, such as... Figure 2 As shown in Figure 3. Figure 2 In Figure 3, the three filter shapes correspond to square 210, horizontal bar 220, and vertical bar 230, respectively. In Figure 3, the three reconstruction regions correspond to the upper left region (…). Figure 3A ), upper region ( Figure 3B ) and left region ( Figure 3C ).
[0032] For a CU encoded in EIP mode, an EIP merging flag is signaled to indicate whether the EIP filter inherits from a previously encoded block in EIP mode. When the EIP merging flag is true, an EIP merging list is constructed from spatially adjacent, spatially non-adjacent, temporal, and historical candidates. The positional information and inclusion order of these candidates are the same as those used in the CCP merging candidate list. An EIP merging index is further signaled to indicate which EIP merging candidate was selected. The filter shape and filter coefficients of the selected candidate are then inherited to encode the CU.
[0033] When the EIP merging flag is false, the EIP filter is derived from neighboring reconstructed samples, and signaling related syntax elements indicate which of the three types of reconstruction regions and three filter shapes the CU uses. The selected filter is moved horizontally or vertically one pixel step within the selected reconstruction region to construct the autocorrelation matrix and cross-correlation vector. The calculation of coefficients from the autocorrelation matrix and cross-correlation vector is the same as in CCCM.
[0034] After generating prediction samples for the CU using the EIP filter, an intra-prediction mode is derived by applying the DIMD procedure to the prediction samples. Specifically, the horizontal and vertical gradients are calculated for each prediction sample to construct a gradient histogram. Then, the intra-prediction mode corresponding to the maximum histogram count is used to determine the LFNST, NSPT, or MTS transform set.
[0035] 1.4 Template-based multi-reference line intra-frame prediction Template-based multiple reference line intra-prediction (TMRL) mode combines reference lines and prediction patterns, and uses template matching methods to construct a list of candidate combinations. The index of the candidate combination list is signaled.
[0036] Extended reference lines begin with reference line 1. Reference line 0 is used for template matching. The template area (see...) Figure 4 The SAD cost (TMRL cost) is calculated between prediction (generated from 50 combinations) and reconstruction. The 20 combinations with the lowest SAD cost are selected and sorted in ascending order to form a TMRL candidate list.
[0037] 1.5 Inter-frame prediction - Spatial candidate derivation Spatial merging candidates from Figure 5 Choose from the candidates depicted in the image.
[0038] 1.6 DIMD Color Mode The DIMD chromaticity mode uses the DIMD derivation method, based on, for example... Figure 6A The chroma intra-prediction mode for the current chroma block is derived by reconstructing the neighboring Y 610, Cb 620, and Cr 630 samples in the second neighboring row and column shown in -C. Specifically, the horizontal and vertical gradients are calculated for each corresponding reconstructed luminance sample and the reconstructed Cb and Cr samples of the current chroma block to establish the HoG. Then, the intra-prediction mode with the largest histogram magnitude is used to perform chroma intra-prediction for the current chroma block.
[0039] When the intra-prediction mode derived from the DIMD chroma mode is the same as the intra-prediction mode derived from the DM mode, the intra-prediction mode with the second largest histogram magnitude is used as the DIMD chroma mode. A CU-level flag is signaled to indicate whether the proposed DIMD chroma mode is applied.
[0040] Finally, the luminance regions of the reconstructed samples used to calculate the gradient histogram for the chroma DIMD mode are modified compared to JVET-O0449. For a WxH chroma CB pair to be predicted, in order to construct a gradient histogram associated with the corresponding luminance CB, the vertical and horizontal gradient pairs are extracted from the second and third rows of that luminance CB, instead of from the regular DIMD decoding reference sample set surrounding that luminance CB.
[0041] 1.7 Fusion of Chroma Intra-Frame Prediction Modes In ECM, two chroma intra-prediction signals can be fused together. One of the two chroma intra-prediction signals is predicted using DM mode, DIMD chroma mode, and one of the four default modes (non-LM mode). The other chroma intra-prediction signal is predicted using cross-component linear prediction mode (LM mode). Two different methods are supported.
[0042] In the first method, the LM mode can be either MM-CCLM or MM-CCCM, and the final predictor derivation is as follows: in It is a predictor obtained by applying a non-LM model. It is a predictor obtained by applying the LM model. It is the final predictor for the current chroma block.
[0043] Two weights, and Determined by the intra-frame prediction mode of adjacent chroma blocks. Set to 2. Specifically, when both the upper and left adjacent blocks are encoded in LM mode, { }={1, 3}; When the blocks above and to the left are both encoded in non-LM mode, { }={3, 1}; otherwise, { }={2, 2}. Two template costs are calculated by fusing angular chromaticity prediction with either MM-CCLM or MM-CCCM, and the derivation is performed using one of the two CCPs that provides the smaller template cost. .
[0044] In the second method, the LM mode can be either MMLM or CCLM, and the final predictor derivation is as follows: .
[0045] It is a predictor obtained by applying a non-LM model. It involves downsampling and reconstructing the brightness sample set at the corresponding locations. It is the final predictor for the current chroma block. It is a fixed value, set to 512 for 10-bit content. Three weights. , and It is derived from adjacent luminance and chrominance samples using the same LDL derivation method as in CCCM.
[0046] For the syntax design, a signaling index indicates whether fusion is applied and which method is used, as shown in Table 1. It is important to note that for I slices, non-LM modes can be DM mode, DIMD chroma mode, and the four default modes. For non-I slices, only fusion of DIMD chroma mode and LM mode is allowed.
[0047] Table 1. Index indicating whether fusion is applied and which method is used.
[0048] 1.8 JVET-AG0078: AHG12: Intra-frame prediction using merged gradient histograms This contribution proposes adding a new intra-prediction mode called Merged IntraMode Derivation (MIMD), based on the computation of a Merged Histogram of Gradients (MHoG). Similar to DIMD, up to five MIMD modes are derived from the MHoG and then blended together. The derivation of modes and the blending weights follow the same process, deriving DIMD modes and blending weights from the HoG. However, unlike DIMD, MHoG is not directly computed by analyzing template samples, but rather based on information extracted from neighboring blocks. More details can be found in JVET-AG0078.
[0049] In particular, several N neighboring blocks are considered. A neighboring block is considered if it is encoded with at least one directional intra-prediction mode. This refers to the amplitude of the directional mode m in HoG, where m can take values from 0 to... ,in This is the maximum number of intra-frame prediction modes. When considering... In this case, a normalization process can be used.
[0050] Then, MHoG The HoG can be calculated using all available neighboring blocks: Finally, the MHoG is used to calculate the MIMD modes and weights. The five highest-amplitude directional modes in the MHoG and their weights are selected as the directional modes and weights for the MIMD. More details can be found in JVET-AG0078.
[0051] 1.9 JVET-AH0076: EE2-2.2: Occurrence-Based Intra Coding (OBIC) Occurrence-based intra-coding (OBIC) derives the intra-prediction mode of the current block based on the sample-by-sample occurrence of intra-modes in the block's spatial neighborhood. To do this, adjacent and non-adjacent spatial neighboring blocks are examined, and the intra-prediction modes of the blocks are collected into an occurrence histogram. OBIC introduces an occurrence histogram (HoC), which consists of intra-modes and their sample-by-sample occurrences. The occurrence value is calculated based on the number of samples encoded in that neighborhood using a certain intra-prediction mode. For example, if a block is encoded using the IPM mode, the occurrence of the mode in that particular block is calculated as follows: HoC[IPM] += uiWidth * uiHeight, Where uiWidth and uiHeight are the width and height of the spatially adjacent blocks.
[0052] The occurrence of existing patterns from spatially neighboring blocks is accumulated in the histogram.
[0053] Select up to 5 angular patterns and planar patterns with the highest occurrence from HoC, and use the predictions of the selected patterns for the final prediction.
[0054] For blocks that use more than one intra-frame mode for prediction, all intra-frame modes for such blocks are selected and used when creating the OBIC histogram. Examples of such blocks are shown below: DIMD: Up to 5 angle modes TIMD: Up to 2 modes SGPM: 2 modes OBIC: Up to 5 angle modes.
[0055] When creating histograms for OBIC modes, virtual intra-prediction modes (VIPMs) for the following blocks are considered only in inter-frame slices: MIP block IntraTMP block IBC block EIP block.
[0056] The weights for the mixed weight and planar mode are calculated similarly to those for the DIMD mode, but instead of using the gradient values from the template, they use the occurrence values of the OBIC. More details can be found in JVET-AH0076.
[0057] 1.10 JVET-AH0128: EE2-2.5: A combination of EE2-2.2, EE2-2.3, and EE2-2.4 Test EE2-2.5 combines OBIC, MIMD, and the method proposed in JVET-AH0090. This method involves establishing a DIMD parameter list similar to that in JVET-AH0090. In test EE2-2.5a, these parameters are derived through the MIMD derivation process and from spatially adjacent and non-adjacent neighboring blocks. In test EE2-2.5b, the OBIC derivation process is also used to derive the DIMD parameter list. More details can be found in JVET-AH0128.
[0058] This disclosure proposes an intra-block merging scheme to improve intra-block prediction. This intra-block merging mode can also be called a decoder-derived intra-block prediction (DIP) merging mode. The concept of the merging scheme is to inherit (or reference) information from previous codec blocks and use this inherited information to predict the current block. The main differences between the proposed intra-block merging scheme and the associated intra-block MPM are as follows. For intra-blocks, the associated intra-block MPM can only inherit intra-block prediction modes from signaling in previous codec blocks, such as the mode index of the reference angle prediction mode, DC, or plane mode, from the upper neighbor block and / or left neighbor block. The proposed intra-block merging scheme brings a more flexible inheritance process and / or more efficient inheritance information.
[0059] Firstly, in some embodiments specified in the “Inheritance Information Settings” section, through the proposed intra-frame merging scheme, the inherited information can be any mode information, any sample information, any block information, any model information, and / or any information related to prediction generation.
[0060] Secondly, in some embodiments specified in the “Inheritance Block Settings” section, the current block can find the previous codec block containing inheritance information through several proposed merging methods using the proposed intra-frame merging scheme.
[0061] Thirdly, in the “Target Mode Setting and Shortcut Syntax Setting” section, for some embodiments, the proposed merging scheme obtains information related to the prediction generation of the current block encoded and decoded by the hybrid mode (e.g., the proposed intra-frame merging scheme has a target mode from the hybrid mode).
[0062] In one embodiment, a merge list containing one or more merge candidates is created. When generating a prediction for the current block encoded and decoded by the target mode, one or more successor blocks (or target blocks) are selected from the merge candidate list or multiple merge candidates. The succession information from the successor blocks is then used to generate a prediction for the target mode. In some embodiments, the succession information for each merge candidate may belong to a different target mode, corresponding to a mixed mode. For example, the succession information for a merge candidate (or candidate mode) may be associated with DIMD and / or TIMD and / or MRL and / or EIP. A merge list may contain merge candidates with different target modes. The current block can be predicted according to DIMD, TIMD, MRL, or EIP, depending on the merge candidate used.
[0063] In one sub-implementation, the inheritance information from the inherited block contains only inheritance information related to the luminance component. Predictions for the luminance component of the current block are generated only based on the inheritance information related to the luminance component.
[0064] In one sub-implementation, the inheritance information from the inherited block also includes inheritance information related to the chroma components. Predictions of the chroma components of the current block can be generated based on the inheritance information related to the chroma components.
[0065] In one sub-implementation, a set of inherited blocks is selected from the merge list, and a prediction of the luminance component of the current block is generated based on the inheritance information from the selected inherited blocks.
[0066] In one sub-implementation, a set of inheritance blocks is selected from a merge list. The prediction of all color components (including luma and chroma components) of the current block is generated based on inheritance information from the selected inheritance blocks. In this case, each component is generated based on its corresponding inheritance information. Specifically, the luma component is generated using luma-related inheritance information, and the chroma component is generated using chroma-related inheritance information. In one sub-implementation, a set of inheritance blocks is selected from a merge list for each component. The prediction of each component of the current block is generated based on inheritance information from its corresponding selected inheritance blocks.
[0067] In one sub-implementation, a set of inheritance blocks is selected from the merge list for the luminance component and a set of inheritance blocks is selected for the chrominance component. The prediction for each component of the current block is generated based on inheritance information from its corresponding selected inheritance blocks. In this case, the Cb and Cr components will use the same selected inheritance blocks.
[0068] In one sub-implementation, the list is created using the method described in Section 2.2, “Inheritance Block Settings” below.
[0069] In one embodiment, when creating a merge list and / or selecting an inheritance block from the merge list, a set of allowed target luminance modes and / or a set of allowed target chrominance modes are determined.
[0070] In one sub-implementation, the mode associated with cross-component prediction is not among the allowed target chromaticity modes.
[0071] In one sub-implementation, if the target brightness mode of the inherited block is in the set of allowed target brightness modes, then the inherited block is allowed to be added to the merge list.
[0072] In one sub-implementation, if the target chroma mode of the inherited block is in the set of allowed target chroma modes, then the inherited block is allowed to be added to the merge list.
[0073] In one sub-implementation, if both the target luminance mode and target chrominance mode of the inherited block are within the allowed sets of target luminance modes and allowed sets of target chrominance modes, then the inherited block is allowed to be added to the merge list. In one case, a set of inherited blocks is selected from the merge list. The prediction of all color components of the current block is generated based on the inheritance information from the selected inherited blocks.
[0074] In one sub-implementation, if the target luma mode of the inherited block is in the allowed set of target luma modes, then the inherited block is allowed to be added to the merge list. In one case, a set of inherited blocks is selected from the merge list for each component. For the chroma component, candidates whose target chroma mode is not in the allowed set of target chroma modes cannot be selected. In another case, a set of inherited blocks is selected from the merge list for the luma component and a set of inherited blocks is selected for the chroma component. For the chroma component, candidates whose target chroma mode is not in the allowed set of target chroma modes cannot be selected.
[0075] In one embodiment, multiple merge lists are created.
[0076] In one sub-implementation, a merged list is created for each color component. That is, a list is created for the luminance component, a list is created for the Cb component, and a list is created for the Cr component.
[0077] In one sub-implementation, a merge list is created for the luminance component and a merge list is created for the chrominance component.
[0078] In one sub-implementation, when creating a merge list for chromaticity components, a set of allowed target chromaticity modes is determined. In one case, the cross-component prediction correlation mode is not among the allowed target chromaticity modes.
[0079] In one embodiment, there is a maximum number of candidates allowed in the merge candidate list.
[0080] In one sub-implementation, the maximum number is 12.
[0081] 2.1 Inheritance Information Settings The inheritance information used to generate the current block prediction is defined using the target pattern.
[0082] 2.1.1 Setting Inheritance Information for DIMD For DIMD mode, the inheritance information includes the following elements (a) and / or (b) and / or (c) and / or (d).
[0083] One or more histogram (bar) values of the available DIMD intra-prediction modes (e.g., DC, planar, and / or directional prediction modes). N intra-frame prediction patterns suggested by histogram values (with a maximum of N histogram bars) DIMD weighted information and / or fusion or not Reference line information and / or wide-angle conditions.
[0084] 2.1.2 Setting Inheritance Information for TIMD For TIMD mode, the inheritance information includes the following elements (a) and / or (b) and / or (c) and / or (d).
[0085] One or more TIMD cost values are available for TIMD intra-prediction modes (e.g., DC, planar, and / or directional prediction modes). N intra-frame prediction modes recommended by TIMD cost (with minimum N TIMD costs) TIMD weighted information and / or fusion or not Reference line information and / or wide-angle conditions.
[0086] 2.1.3 Setting Inheritance Information for MRL For MRL patterns, the inheritance information includes the following elements (a) and / or (b) and / or (c) and / or (d).
[0087] One or more reference lines associated with intra-frame prediction modes (e.g., DC, planar, and / or directional prediction modes). N intra-frame prediction modes recommended by TIMD cost (with minimum N TIMD costs) Weighted information and / or fusion or not Reference line information and / or wide-angle conditions.
[0088] 2.1.4 Setting EIP Inheritance Information For EIP mode, the inheritance information includes the following elements (a) and / or (b) and / or (c).
[0089] Filter shape All or part of the filter coefficients Templates used to derive filter coefficients.
[0090] 2.1.5 Inheritance Information Settings for Hybrid Mode When the target mode is a hybrid mode merge mode, it can also be called a decoder-derived intra-prediction (DIP) merge mode, and the inherited information includes all or any subset of the following items.
[0091] Item 1: (a) and / or (b) and / or (c) and / or (d) in Section 2.1.1 Item 2: (a) and / or (b) and / or (c) and / or (d) in Section 2.1.2 Item 3: (a) and / or (b) and / or (c) and / or (d) in Section 2.1.3 Item 4: Codec mode (e.g., whether DIMD-related mode, TIMD-related mode, MRL-related mode, SGPM-related mode, ISP-related mode, intraTMP-related mode, MPM-related mode, MIP-related mode, EIP-related mode and / or any mode related to predefined intra-frame modes) and / or corresponding information about the codec mode.
[0092] Item 5: (a) and / or (b) and / or (c) in Section 2.1.4.
[0093] In one embodiment, for Project 1 and / or Project 2 and / or Project 3 and / or Project 5, the inheritance information can be obtained using the embodiments in Section 2.1.1 and / or Section 2.1.2 and / or Section 2.1.3 and / or Section 2.1.4.
[0094] In another embodiment, item 4 is included in the inheritance information and / or the encoding / decoding mode in item 4 determines whether the corresponding information is further included in the hybrid mode inheritance information. For example, the encoding / decoding mode in item 4 is an MRL-related mode, and only the corresponding information in item 3 is included in the hybrid mode inheritance information.
[0095] In one embodiment, the encoding / decoding mode in Item 4 is derived from a previous encoding / decoding block specified in Section 2.2, “Inheritance Block Settings.” The previous encoding / decoding block may store hybrid mode inheritance information. This stored hybrid mode inheritance information of the previous encoding / decoding block can be referenced by subsequent encoding / decoding blocks (e.g., the current block). For example, for each block containing hybrid mode information, the hybrid mode information is stored and / or referenced by subsequent encoding / decoding blocks. Similarly, for each predefined cell containing hybrid mode information, the hybrid mode information is stored and / or referenced by subsequent encoding / decoding blocks. This cell can be any predefined region or kxk grid, where k can be 2, 4, 8, 16, or any predefined positive integer.
[0096] In one sub-implementation, the encoding / decoding mode is EIP. The previously encoded / decoded block generates corresponding EIP inheritance information (e.g., filter shape and / or filter coefficients) and / or stores mixed mode inheritance information (e.g., encoding / decoding mode and / or corresponding information).
[0097] In one sub-implementation, the encoding / decoding mode is SGPM (Spatial Geometric Partitioning Mode). This mode generates multiple prediction hypotheses from different intra-prediction modes and combines these hypotheses to form a final prediction using geometric partition lines as weights for the interactive GPMs. Previously encoded / decoded blocks generate corresponding SGPM inheritance information (e.g., intra-prediction modes and / or partition lines and / or weights) and / or store hybrid mode inheritance information (e.g., encoding / decoding modes and / or corresponding information).
[0098] In one sub-implementation, the encoding / decoding mode is ISP (Intra-Frame Subsegmentation). This mode divides the current block into several subsegments and uses reconstructed samples (possibly from previous subsegments) as reference samples to generate predictions for each subsegment. Previous encoding / decoding blocks generate corresponding ISP inheritance information (e.g., one or more intra-frame prediction modes and / or segmentation methods) and / or store hybrid mode inheritance information (e.g., encoding / decoding modes and / or corresponding information).
[0099] In one sub-implementation, the encoding / decoding mode is intraTMP (Intra-Template Matching Prediction). This mode uses template matching to find displacements (i.e., block vectors) within a predetermined range of the current image to reference a reference block, and generates predictions using reconstructed samples of the reference block. Previously encoded / decoded blocks generate corresponding intraTMP inheritance information (e.g., one or more block vectors) and / or store hybrid mode inheritance information (e.g., encoding / decoding modes and / or corresponding information).
[0100] In another embodiment, the encoding / decoding mode is MIP (Matrix-Based Intra-Frame Prediction). This mode generates predictions using a predetermined matrix and predetermined neighboring or non-neighboring reference samples. Previous encoding / decoding blocks generate corresponding MIP inheritance information (e.g., one or more matrix indicators and / or one or more matrix coefficients indicating the matrix and / or block width and / or block height and / or block area and / or block location) and / or store hybrid mode inheritance information (e.g., encoding / decoding mode and / or corresponding information).
[0101] In another embodiment, to reduce storage, only a subset of the mixed-mode information is stored instead of all the mixed-mode information (possibly for reference). For example, only three pieces of information out of all the information are stored. For instance, the subset is the first three pieces of information. The first three pieces of information always include item 4. Although 3 is used in the example, any predetermined positive number can be used.
[0102] In one embodiment, the inheritance information of the target pattern depends on the inheritance encoding / decoding pattern value of the selected merge candidate.
[0103] In one sub-implementation, if the selected merge candidate codec mode is DIMD, TIMD, EIP, or MRL, then the inherited codec mode value is the same as the codec mode (i.e., DIMD, TIMD, EIP, or MRL, respectively).
[0104] In one sub-implementation, for blocks encoded and decoded in DIP merge mode, the inheritance mode type value is set as follows: When the current block is encoded or decoded in DIP merge mode, the block will select a merge candidate to generate a prediction.
[0105] If the selected merge candidate of the current block is encoded in DIMD, TIMD, MRL, or EIP, then the inheritance mode type value of the current block is set to DIMD, TIMD, MRL, or EIP, respectively.
[0106] If the selected merge candidate of the current block is encoded or decoded in DIP merge mode, the inheritance mode type value of the current block is set to the inheritance mode type value of the selected merge candidate.
[0107] In one sub-implementation, if the inheritance mode type is DIMD, the inheritance information settings follow the description in Section 2.1.1.
[0108] In one sub-implementation, if the inheritance mode type is TIMD, the inheritance information settings follow the description in Section 2.1.2.
[0109] In one sub-implementation, if the inheritance mode type is MRL, the inheritance information settings follow the description in Section 2.1.3.
[0110] In one sub-implementation, if the inheritance mode type is EIP, the inheritance information settings follow the description in Section 2.1.4.
[0111] 2.1.6 Setting Inheritance Information for Direct Chroma Mode For chroma direct mode, inherited information includes element (a).
[0112] Whether this block is encoded or decoded in chroma direct mode.
[0113] 2.1.7 Setting Inheritance Information for DIMD Chroma Mode For the DIMD chroma mode, the inheritance information includes element (a) and / or (b).
[0114] a) One or more histogram (bar) values of an intra-frame prediction mode (e.g., DC, planar, and / or directional prediction modes) may be used. b) N intra-frame prediction patterns suggested by histogram values (with the highest histogram bar).
[0115] 2.1.8 Setting Inheritance Information for Chroma Blending Mode For chroma blending modes (as described in Section 1.12), the inherited information includes element (a).
[0116] The LM pattern to be integrated.
[0117] 2.1.9 Setting Inheritance Information for Cross-Component Prediction Modes For cross-component prediction modes, inherited information includes elements (a) and / or (b) and / or (c).
[0118] a) Codec modes (e.g., CCLM, MMLM, CCCM, GLM, GL-CCCM, MDF-CCCM, NSCCCM, BVGCCCM, InterCCCM and / or variants of these modes). b) Model parameters c) If the encoding / decoding mode is a multi-model cross-component mode, then the classification threshold... d) Low-pass filter markings.
[0119] 2.2 Inheritance Block Settings 2.2.1 Inherited information from previous codec blocks The inherited information is obtained from the previously encoded and decoded blocks.
[0120] In one embodiment, one or more spatially adjacent candidates and / or non-adjacent candidates, historical candidates, temporal candidates, preset candidates, or any subset of the above candidates provide inherited information from previous codec blocks.
[0121] In one embodiment, a merge candidate list containing inheritance information is constructed for the current block. Similar to the inter-frame merge mode candidate list, this merge candidate list includes spatially adjacent candidates and / or non-adjacent candidates, historical candidates, temporal candidates, preset candidates, or any subset of the above candidates.
[0122] In one sub-implementation, after constructing the merge candidate list, one or more candidates are selected from the list for use in the current block. Selection depends on explicitly signaling an index or implicitly selecting one or more (promising) candidates. For example, the first or second candidate with the lowest cost is selected. Alternatively, an explicit index may instruct the reordering of one or more candidates in the list as selected candidates. Cost calculation and / or list reordering may depend on a template matching process that calculates the cost based on the distortion between the prediction on the template (using a certain candidate) and the reconstruction on the template. Candidates in the list are reordered in ascending order of cost.
[0123] 2.2.1.1 Spatially adjacent candidates and non-adjacent candidates Spatial adjacency candidates are drawn from the neighboring blocks of the current block. These neighboring blocks can be the same as the five spatial adjacency blocks in the inter-frame merge mode, or any subset of the neighboring blocks of the current block. For example, to add a spatial adjacency candidate to the merge list, such as... Figure 5 As shown, the inclusion order can be A1 (B1 (A0 (B0 (B2)) or B1 (A1 (B0 (A0 (B2)). Non-adjacent candidates come from the search range around the current block (but are not adjacent). The search range can be the same as the search range of non-adjacent candidates in the inter-frame merge mode. Non-adjacent candidates can come from predefined locations and be added to the merge list in a predefined inclusion order. For example, the predefined locations and inclusion order are the same as the non-adjacent candidates in the inter-frame merge mode.
[0124] 2.2.1.2 Historical Candidates Historical candidates are selected from a history-based buffer array. This buffer array stores inheritance information for each valid previously encoded / decoded block, where a valid previously encoded / decoded block refers to any block containing inheritance information.
[0125] 2.2.1.3 Time Candidates Timing candidates are obtained from inherited information stored in one or more previously encoded / decoded images. Timing candidates can be obtained when the current segment / image is a non-intra-frame segment / image.
[0126] In one embodiment, the time candidate can be derived from certain predefined locations of previously encoded / decoded segments / images. The block.
[0127] In one sub-implementation, the location is within the corresponding region of the current coding block.
[0128] In one sub-implementation, the predefined position is outside the corresponding region of the current coding block.
[0129] In one sub-implementation, the predefined position can be determined based on the position, width, and height of the current block.
[0130] In one sub-implementation, the predefined location can be determined based on the location and some predefined fixed xy distances.
[0131] In one embodiment, the previously encoded / decoded image is among the images in the reference list.
[0132] In one embodiment, the previously encoded / decoded image is the same as the corresponding image in the regular inter-frame merging mode.
[0133] In one embodiment, multiple selected / predefined previously encoded / decoded images can be selected.
[0134] In one embodiment, the previously encoded / decoded image can be signaled in the image / fragment header. The reference list and reference index are signaled in the image / fragment header. For example, signaling L0[0]. Another example is signaling L1[0].
[0135] In one embodiment, previously encoded / decoded images are selected from a set of images with certain predefined rules.
[0136] In one embodiment, the previously encoded / decoded image is selected from images in a reference list. The selection can be determined based on the Point of Conformity (POC) and / or POC distance and / or Quality Point (QP) and / or QP difference. Another example is selecting the image with a smaller POC. Another example is selecting the image with a larger POC. For example, the image with the smallest POC distance from the current image is selected. Another example is selecting the image with a smaller QP. Another example is selecting the image with a larger QP. Another example is selecting the image with a smaller QP difference from the current image.
[0137] In one embodiment, the previously encoded / decoded image is the most recently encoded / decoded I-image.
[0138] In one embodiment, the rules for selecting / not selecting previously encoded / decoded images described in the preceding paragraphs can be combined. For example, the image with the smallest QP among the unscaled images in the reference list can be selected.
[0139] 2.2.1.4 Preset Candidates A default candidate is a candidate that contains default information and / or default information derived from candidates already included in the merged candidate list. In one embodiment, the default mode of a default candidate can be derived using the MIMD scheme and / or the OBIC scheme and / or the EIP derivation mode scheme and / or any existing or mentioned intra-frame scheme (e.g., TIMD, DIMD, EIP, and / or MRL) and / or any existing or mentioned intra-frame scheme variants.
[0140] 2.3 Target Mode Settings and Shortcut Syntax Settings 2.3.1 DIMD Target Mode Settings (DIMD Merge Mode) This section specifies the DIMD merging mode. When using the DIMD merging mode, DIMD inheritance information obtained from one or more predefined candidates is used to determine the prediction information required to generate the current block prediction, based on the inheritance block settings. For example, inheritance information refers to histogram values from previous codec blocks and is used to determine one or more intra-prediction modes (a type of prediction information) and / or the corresponding weights for the current block as regular DIMD. Then, in unification with regular DIMD, the prediction assumptions from each derived intra-prediction mode are combined using a mixing process to form the final prediction for the current block.
[0141] 2.3.2 TIMD Target Mode Settings (TIMD Merge Mode) This section specifies the TIMD merging mode. When using the TIMD merging mode, TIMD inheritance information obtained from one or more predefined candidates (e.g., each candidate provides N intra-prediction modes for available TIMD intra-prediction modes and TIMD weighting information such as {IPM1, IPM2, W1, W2}, and / or merging or not, and wide-angle conditions) is used to determine the prediction information required to generate the current block prediction, depending on the inherited block settings. For example, the merge candidate list is constructed and reordered based on costs during the template matching process. Template size and template cost calculations can be unified with regular TIMD. After reordering the TIMD merge candidates, the top 2 or any predefined number of candidates in the list are reserved for signaling. Then, unified with regular TIMD, the prediction assumptions from each inherited intra-prediction mode are combined using a merging process to form the final prediction for the current block.
[0142] 2.3.3 MRL Target Mode Settings (MRL Merge Mode) This section specifies the MRL merging mode. When using the MRL merging mode, inheritance information obtained from one or more predefined candidates (e.g., each candidate provides one or more reference lines with intra-prediction modes (IPM1 and MRL1) and / or whether to merge, and wide-angle conditions) is used to determine the prediction information required to generate the current block prediction, depending on the inherited block settings. For example, the merge candidate list is constructed and reordered based on the cost during the template matching process. Template size and template cost calculations can be unified with regular TMRL. After reordering the MRL merge candidates, the top two or any predefined number of candidates in the list are reserved for signaling. Then, in accordance with regular intra-prediction, such as inherited IPM1 and MRL1, the predictions from the inherited intra-prediction modes and inherited reference lines are used to form the final prediction for the current block. For the examples of inherited IPM1 with MRL1 and IPM2 with MRL2, the predictions from the inherited intra-prediction modes and the corresponding inherited reference lines are assumed to be combined using a blending process to form the final prediction for the current block. For the examples of inherited IPM1 with MRL1 / W1 and IPM2 with MRL2 / W2, the prediction assumptions from the inherited intra-prediction modes and corresponding inherited reference lines are combined with W1 and W2 using a blending process to form the final prediction for the current block.
[0143] 2.3.4 Target Mode Settings for Hybrid Mode This section specifies the hybrid mode merging mode. When using the hybrid mode merging mode, the prediction for the current block is generated using inherited hybrid mode information. Candidate inherited information may refer to encoding / decoding modes and / or corresponding information. The current block obtains its own prediction information from the inherited information.
[0144] Examples of DIMD-related encoding / decoding modes in inherited hybrid mode information are shown below: In some cases, DIMD merge mode (Section 2.3.1) or regular DIMD is applied to the current block.
[0145] Examples of TIMD-related encoding / decoding modes in inherited hybrid mode information are shown below: In some cases, TIMD merge mode (Section 2.3.2) or regular TIMD is applied to the current block.
[0146] Examples of encoding / decoding modes related to MRL in inherited mixed-mode information are shown below: In some cases, MRL merging mode (Section 2.3.3) or regular intra-frame prediction using MRL or TMRL is applied to the current block.
[0147] Examples of EIP-related encoding / decoding modes in inherited hybrid mode information are shown below: In some cases, EIP merge mode or EIP export mode is applied to the current block.
[0148] In another embodiment, based on the inherited block settings, only one candidate (e.g., the first available candidate) is used to determine the prediction information for the current block.
[0149] In another embodiment, one or more candidates are used to determine the prediction information for the current block. For example, all available candidates are used to determine the prediction information for the current block. For example, assuming a predefined maximum number of N, the first N available candidates, based on the inspection order, are used to determine the prediction information for the current block. If the total number of available candidates is less than N, then all available candidates are used to determine the prediction information for the current block.
[0150] In one embodiment, an additional flag is signaled before the DIMD flag to indicate whether DIP merge mode is used. If DIP merge mode is used, a candidate index is additionally signaled.
[0151] In one embodiment, candidate indices use truncated unary encoding, and each bin of the candidate index is context-encoded using a separate context.
[0152] 2.3.5 Support for setting the target mode during chromaticity prediction In one embodiment, when different candidate sets are selected for the luminance and chrominance components, the candidate indices for both the luminance and chrominance components are signaled.
[0153] In one embodiment, when multiple merge lists are created, meaning that the luma and chroma components use different merge lists, a flag can be used to indicate whether both the luma and chroma components are encoded and decoded in the merge scheme. Additionally, candidate indices for signaling luma and chroma components are provided.
[0154] In one embodiment, when multiple merge lists are created, meaning that the luma and chroma components use different merge lists, there can be a flag to indicate whether the luma component is encoded or decoded in the merge scheme and to signal the candidate index of the luma component. Additionally, there can be another flag to indicate whether the chroma component is encoded or decoded in the merge scheme and to signal the candidate index of the chroma component.
[0155] In this invention, the term "block" may refer to TU / TB, CU / CB, PU / PB, a predefined region, or CTU / CTB.
[0156] Any combination of the methods proposed in this invention can be applied.
[0157] The method proposed in this invention can be enabled and / or disabled based on implicit rules (e.g., block width, height, or area) or explicit rules (e.g., syntax at the block, tile, slice, picture, SPS, or PPS level). For example, the proposed method is applied when the block area is less than / greater than a threshold.
[0158] Any of the methods or combinations thereof proposed above may be implemented in the encoder and / or decoder. For example, any of the proposed methods or combinations thereof may be implemented in the inter-frame / intra-frame / IBC / prediction / transform module of the encoder and / or the inter-frame / intra-frame / IBC / prediction / transform module of the decoder. Alternatively, any of the proposed methods or combinations thereof may be implemented as a circuit coupled to the inter-frame / intra-frame / IBC / prediction / transform module of the encoder and / or the inter-frame / intra-frame / IBC / prediction / transform module of the decoder to provide the information required by the inter-frame / intra-frame / IBC / prediction / transform module.
[0159] refer to Figure 1A Figures and Figure 1B The exemplary encoder and decoder in the figure, using inherited information from previous codec blocks to derive mixed-mode intra-frame prediction of chroma components, propose a method that can be implemented in the decoder's intra-frame encoding / decoding module (e.g., ...). Figure 1B Implemented in Intra Pred. 150, or in the intra-frame codec module of the encoder (e.g., Figure 1A Intra Pred. 110). However, the decoder or encoder can also use additional processing units to implement the required cross-component prediction processing. While intra-prediction units (e.g., Figure 1A Unit 110 and Figure 1B Units 150 in the diagram are shown as independent processing units, but they may correspond to executable software or firmware code of a CPU (Central Processing Unit) or a programmable device (e.g., a DSP (Digital Signal Processor) or an FPGA (Field Programmable Gate Array)).
[0160] Figure 7A flowchart of an exemplary video encoding / decoding system is shown, which, according to an embodiment of the invention, derives mixed-mode intra-frame prediction based on the inheritance of previously encoded / decoded blocks. The steps shown in the flowchart can be implemented as program code executable on one or more processors (e.g., one or more CPUs) at the encoder end. The steps shown in the flowchart can also be implemented based on hardware, such as one or more electronic devices or processors arranged to perform the steps in the flowchart. According to the method, in step 710, input data associated with the current block is received, including a first color component and one or more second color components, wherein the input data includes pixel data to be encoded at the encoder end or data associated with the current block to be decoded at the decoder end. In step 720, an inheritance block setting is determined, wherein the inheritance block setting corresponds to inheritance information or candidate modes associated with several previously encoded / decoded blocks. In step 730, a merge candidate set specified by the inheritance block setting is constructed from the previously encoded / decoded blocks. In step 740, one or more target blocks are selected from the merge candidate set. In step 750, a target prediction is generated for the current block based on the target pattern and inheritance information associated with the one or more target blocks. The inheritance information from the one or more target blocks includes inheritance information related to the first color component and / or the one or more second color components, and the prediction for the current block for the first color component and / or the one or more second color components is generated based on the inheritance information associated with the first color component and / or the one or more second color components, respectively. In step 760, the target prediction is used to encode or decode the current block.
[0161] The flowchart shown is intended to illustrate an example of video encoding and decoding according to the present invention. Those skilled in the art can modify each step, rearrange the steps, split the steps, or combine the steps to practice the invention without departing from its spirit. Specific syntax and semantics are used in this disclosure to illustrate examples of implementing the invention. Those skilled in the art can practice the invention by using equivalent syntactic and semantic substitutions without departing from its spirit.
[0162] The foregoing description is intended to enable those skilled in the art to practice the invention in the context of specific applications and their requirements. Various modifications to the described embodiments will be apparent to those skilled in the art, and the general principles defined herein can be applied to other embodiments. Therefore, the invention is not intended to be limited to the specific embodiments shown and described, but should be given the broadest scope consistent with the principles and novel features disclosed herein. In the foregoing detailed description, various specific details have been shown to provide a thorough understanding of the invention. However, those skilled in the art will understand that the invention can be practiced.
[0163] Based on the foregoing description, embodiments of the present invention can be implemented in various hardware, software code, or combinations thereof. For example, one embodiment of the invention may be one or more circuits integrated into a video compression chip, or program code integrated into video compression software, to perform the processes described herein. Embodiments of the invention may also be program code to be executed on a digital signal processor (DSP) to perform the processes described herein. The invention may also relate to multiple functions executed by a computer processor, digital signal processor, microprocessor, or field-programmable gate array (FPGA). These processors can be configured to execute machine-readable software code or firmware code to perform the specific methods embodied in the invention. The software code or firmware code can be developed in different programming languages and different formats or styles. The software code can also be compiled for different target platforms. However, configuring the code to perform tasks using different code formats, styles, languages, and other methods according to the present invention will not depart from the spirit and scope of the invention.
[0164] This invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The examples described are for illustrative purposes only and not for limiting purposes. Therefore, the scope of the invention is indicated by the appended claims rather than the foregoing description. All modifications within the meaning and equivalence of the claims should be included within their scope.
Claims
1. A method for video encoding and decoding, the method comprising: Receive input data associated with the current block, including a first color component and one or more second color components, wherein the input data includes pixel data to be encoded at the encoder end or data associated with the current block to be decoded at the decoder end; Determine the inheritance block settings, where the inheritance block settings correspond to inheritance information or candidate patterns associated with several previously encoded / decoded blocks; Construct a merge candidate set specified by the inherited block from these previously encoded and decoded blocks; Select one or more target blocks from the merge candidate set; Based on the target pattern and inheritance information associated with the one or more target blocks, a target prediction is generated for the current block, wherein the inheritance information from the one or more target blocks includes inheritance information related to the first color component and / or the one or more second color components, and the prediction for the current block for the first color component and / or the one or more second color components is generated based on the inheritance information associated with the first color component and / or the one or more second color components, respectively; and Use the target to predict whether to encode or decode the current block.
2. The method of claim 1, wherein the inheritance information from the one or more target blocks includes only the inheritance information related to the first color component, and only a prediction is generated for the first color component as the current block, which is generated based on the inheritance information related to the first color component.
3. The method of claim 1, wherein the inheritance information from the one or more target blocks includes inheritance information related to the one or more second color components, and the prediction for the one or more second color components is generated based on the inheritance information related to the one or more second color components.
4. The method of claim 1, further comprising determining a set of permitted target first color modes and / or a set of permitted target second color modes.
5. The method of claim 4, wherein if both the target first color mode and the target second color mode of the target previously encoded block are in the set of allowed target first color modes and the set of allowed target second color modes, then the target previously encoded block is allowed to be added to the merge candidate set.
6. The method of claim 4, wherein the target prediction for the first color component and the one or more second color components is generated based on the first color component and the one or more second color components of the inherited information associated with the one or more target blocks.
7. The method of claim 4, wherein the target mode associated with the one or more target blocks selected for the current block includes chroma direct mode, DIMD chroma mode, chroma fusion mode, or cross-component prediction mode.
8. The method of claim 7, wherein when the target mode corresponds to the chroma direct mode, the inheritance information associated with the one or more target blocks includes whether the block is encoded or decoded in the chroma direct mode.
9. The method of claim 7, wherein when the target mode corresponds to the DIMD chroma mode, the inheritance information associated with the one or more target blocks includes one or more histogram values of available intra-prediction modes, N intra-prediction modes suggested by the histogram values, or both.
10. The method of claim 7, wherein when the target mode corresponds to the chroma blending mode, the inherited information associated with the one or more target blocks includes the linear model (LM) mode to be blended.
11. The method of claim 7, wherein when the target mode corresponds to the cross-component prediction mode, the inherited information associated with the one or more target blocks includes encoding / decoding mode, model parameters, classification threshold for the encoding / decoding mode as a multi-model cross-component mode, low-pass filter flag, or a combination thereof.
12. The method of claim 4, wherein when the one or more target blocks for the first color component and the one or more target blocks for the one or more second color components are different, the candidate indices for the first color component and the one or more second color components are separately signaled or parsed.
13. The method of claim 4, wherein when the merge candidate set of the first color component is different from the merge candidate set of the one or more second color components, a flag is used to indicate whether the first color component and the one or more second color components are encoded / decoded in the merge scheme.
14. The method of claim 13, wherein the candidate indices of the first color component and the one or more second color components are respectively signaled or parsed.
15. The method of claim 4, wherein when the merge candidate set of the first color component is different from the merge candidate set of the one or more second color components, a flag is used to indicate whether the first color component is encoded or decoded in the merge scheme, and the candidate index is signaled or parsed.
16. The method of claim 15, wherein a second flag is used to indicate whether the one or more second color components are encoded in the second merging scheme, and signaling or parsing is performed on the one or more second candidate indices.
17. An apparatus for video encoding and decoding, the apparatus comprising one or more electronic devices or processors configured to: Receive input data related to the current block, including a first color component and one or more second color components, wherein the input data includes pixel data to be encoded at the encoder end or data related to the current block to be decoded at the decoder end; Determine the inheritance block settings, where the inheritance block settings correspond to inheritance information or candidate modes associated with several previous codec blocks; The inherited block is constructed from these previously encoded and decoded blocks, setting the specified set of merge candidates; Select one or more target blocks from the merge candidate set; Based on the target pattern and the inheritance information associated with the one or more target blocks, a target prediction for the current block is generated, wherein the inheritance information from the one or more target blocks includes the inheritance information associated with the first color component and / or the one or more second color components, and the prediction for the current block for the first color component and / or the one or more second color components is generated respectively based on the inheritance information associated with the first color component and / or the one or more second color components. as well as Use the target to predict whether to encode or decode the current block.
