Method and apparatus for most probable mode list construction based on decoder-end intra mode derivation in video coding
By building an extended most likely mode list in the video encoding and decoding system, using the decoder side intra mode derivation technology and offset distance to generate alternative candidates, combined with block size and aspect ratio constraints, the low encoding efficiency in the existing technology is solved. The problem of this achieves more efficient video encoding.
Patent Information
- Application Number
- CN202380034462.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-19
- Filing Date
- 2023-04-19
- Publication Date
- 2024-11-26
AI Technical Summary
When building the most likely mode (MPM) list, existing video encoding and codec systems are difficult to effectively utilize the decoder side intra mode derivation (DIMD) technology, resulting in low encoding efficiency.
On the encoder or decoder side, by constructing the initial MPM list and generating alternative candidates by adding offset distances, forming an extended MPM list for encoding or decoding of the current block, and pruning and combining constraints such as block size and block aspect ratio. Redundant check.
The encoding efficiency of the video encoding and decoding system is improved, and the encoding performance is enhanced by inserting the decoder side intra mode export mode into the MPM list.
Smart Images

Figure CN119032569A_ABST
Abstract
Description
[0001] Cross-references
[0002] The present invention is a non-provisional application of and claims priority to U.S. Provisional Patent Application No. 63 / 332,291 filed on April 19, 2022. The entire contents of this U.S. Provisional Patent Application are incorporated herein by reference. Technical Field
[0003] The present invention relates to a video coding and decoding system. In particular, the present invention relates to a Most Probable Mode (MPM) list construction using a decoder side intra mode derivation (DIMD) in a video coding and decoding system. Background Art
[0004] Versatile Video Coding (VVC) is the latest international video coding standard jointly developed by the Joint Video Experts Group (JVET) of the ITU-T Video Coding Experts Group (VCEG) and the ISO / IEC Moving Picture Experts Group (MPEG). The standard has been published as an ISO standard: ISO / IEC 23090-3:2021, Information technology - Coded representation of immersive media - Part 3: Versatile video coding, released in February 2021. VVC is an improvement on its predecessor HEVC (High Efficiency Video Coding) by adding more codec tools to improve codec efficiency, and can also handle various types of video sources, including 3D video signals.
[0005] Figure 1A An exemplary adaptive inter / intra video coding system including a loop process is described. For intra prediction, prediction data is derived from previously encoded video data in the current picture. For inter prediction 112, motion estimation (ME) is performed on the encoder side and motion compensation (MC) is performed based on the results of ME to provide prediction data derived from other pictures and motion data. Switch 114 selects intra prediction 110 or inter prediction 112 and the selected prediction data is provided to adder 116 to form a prediction error, also known as a residual. The prediction error is then processed by transform (T) 118 and subsequent quantization (Q) 120. The transformed and quantized residual is then encoded by entropy encoder 122 to be included in a video bitstream corresponding to the compressed video data. The bitstream associated with the transform coefficients is then packaged with auxiliary information (such as motion and coding modes associated with intra prediction and inter prediction) and other information (such as parameters associated with loop filters applied to underlying image areas). Auxiliary information associated with intra prediction 110, inter prediction 112, and in-loop filter 130 is provided to entropy encoder 122, such as Figure 1A As shown. When using inter-frame prediction mode, one or more reference pictures must also be reconstructed at the encoder end. Therefore, the transformed and quantized residual is processed by inverse quantization (IQ) 124 and inverse transform (IT) 126 to recover the residual. The residual is then added back to the prediction data 136 at reconstruction (REC) 128 to reconstruct the video data. The reconstructed video data can be stored in a reference picture buffer 134 and used to predict other frames.
[0006] like Figure 1A As shown, the input video data undergoes a series of processes in the coding system. Due to a series of processes, the reconstructed video data from REC128 may be subject to various impairments. Therefore, loop filter 130 is often applied to reconstructed video data before the reconstructed video data is stored in reference picture buffer 134 to improve video quality. For example, deblocking filter (DF), sample adaptive offset (SAO) and adaptive loop filter (ALF) can be used. It may be necessary to merge loop filter information into the bitstream so that the decoder can correctly restore the required information. Therefore, loop filter information is also provided to entropy encoder 122 to be merged into the bitstream. Figure 1A In , a loop filter 130 is applied to the reconstructed video before the reconstructed samples are stored in a reference picture buffer 134 . Figure 1A The system in is intended to illustrate an exemplary structure of a typical video encoder. It may correspond to the High Efficiency Video Coding (HEVC) system, VP8, VP9, H.264, or VVC.
[0007] like Figure 1B As shown, the decoder can use similar or identical functional blocks as the encoder, except for transform 118 and quantization 120, because the decoder only needs inverse quantization 124 and inverse transform 126. Instead of entropy encoder 122, the decoder uses entropy decoder 140 to decode the video bitstream into quantized transform coefficients and required encoding information (such as ILPF information, intra-frame prediction information, and inter-frame prediction information). Intra-frame prediction 150 on the decoder side does not need to perform mode search. Instead, the decoder only needs to generate intra-frame prediction based on the intra-frame prediction information received from entropy decoder 140. In addition, for inter-frame prediction, the decoder only needs to perform motion compensation (MC152) based on the inter-frame prediction information received from entropy decoder 140 without motion estimation.
[0008] According to VVC, similar to HEVC, the input picture is divided into non-overlapping square block areas called CTUs (Coding Tree Units). Each CTU can be divided into one or more coding units (CUs) of smaller size. The generated CU partitions can be square or rectangular. In addition, VVC divides CTUs into prediction units (PUs) as units for applying prediction processes such as inter-frame prediction, intra-frame prediction, etc.
[0009] The VVC standard incorporates various new coding tools to further improve coding efficiency over the HEVC standard. The use of DIMD candidates in the MPM list has shown an improvement in coding efficiency. In the present invention, methods and apparatus are disclosed to further improve the DIMD-based MPM. Summary of the invention
[0010] A method and apparatus for video encoding and decoding are disclosed. According to the method, pixel data associated with a current block is received on the encoder side or encoded data associated with a current block to be decoded is received on the decoder side. An initial MPM (most probable mode) list is determined for the current block, wherein the initial MPM list includes an MPM1 candidate and an MPM2 candidate. Multiple alternative first candidates are generated by adding one or more first offset distances to the MPM1 candidate. Multiple alternative second candidates are generated by adding one or more second offset distances to the MPM2 candidate. At least one of the multiple alternative first candidates and at least one of the multiple alternative second candidates are inserted into the initial MPM list according to the offset distances associated with at least one of the multiple alternative first candidates and at least one of the multiple alternative second candidates to form an extended MPM list. The current block is encoded or decoded by using information including the extended MPM list.
[0011] In one embodiment, the at least one of the plurality of alternative first candidates and the at least one of the plurality of alternative second candidates are inserted into the MPM list with constraints.
[0012] In one embodiment, the constraint includes a block size of the current block. The block size of the current block may correspond to the sum of a block width and a block height of the current block. In one embodiment, when the sum of the block width and the block height of the current block is greater than a threshold, the at least one of the plurality of alternative first candidates and at least one of the plurality of alternative second candidates are inserted into the MPM list.
[0013] In one embodiment, the constraint includes a block aspect ratio of the current block. The block aspect ratio of the current block may correspond to a ratio of a block width to a block height. In one embodiment, when the block aspect ratio of the current block is greater than a threshold, the at least one of the plurality of alternative first candidates and the at least one of the plurality of alternative second candidates are inserted into the MPM list.
[0014] In one embodiment, the at least one of the plurality of alternative first candidates and the at least one of the plurality of alternative second candidates are inserted into the initial MPM according to increasing order of offset distances associated with the at least one of the plurality of alternative first candidates and the at least one of the plurality of alternative second candidates.
[0015] In one embodiment, the method may further include performing pruning or redundancy checking on the extended MPM list after said inserting said at least one of the plurality of substitute first candidates and said at least one of the plurality of substitute second candidates. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1A An exemplary adaptive inter / intra video coding system incorporating loop processing is shown.
[0017] Figure 1B Shows Figure 1A The corresponding decoder of the encoder in .
[0018] Figure 2 The intra-frame prediction mode adopted by the VVC video coding standard is marked.
[0019] Figure 3A -B shows a block that is wider than it is tall ( Figure 3A ) and blocks that are taller than they are wide ( Figure 3B ) is an example of wide-angle intra prediction.
[0020] Figure 4 An example of two vertically adjacent prediction samples using two non-adjacent reference samples in the case of wide-angle intra prediction is shown.
[0021] Figure 5 An example of constructing an MPM list using intra prediction modes from left (L), above (A), lower left (BL), upper right (AR), and upper left (AL) neighboring blocks is shown.
[0022] Figure 6 A flowchart of an exemplary video decoding system for constructing an MPM list using DIMD candidates according to an embodiment of the present invention is shown. DETAILED DESCRIPTION
[0023] It will be readily appreciated that the components of the present invention as generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Therefore, the following more detailed description of the embodiments of the systems and methods of the present invention as shown in the figures is not intended to limit the scope of the claimed invention, but is merely representative of selected embodiments of the present invention. References throughout this specification to "one embodiment," "an embodiment," or similar language mean that a particular feature, structure, or characteristic described in conjunction with that embodiment may be included in at least one embodiment of the present invention. Therefore, the phrases "in one embodiment" or "in an embodiment" appearing throughout this specification do not necessarily all refer to the same embodiment.
[0024] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. However, those skilled in the relevant art will recognize that the present invention may be practiced without one or more specific details, or using other methods, components, etc. In other cases, well-known structures or detailed descriptions of operations are not shown or are not shown to avoid obscuring aspects of the present invention. The illustrated embodiments of the present invention will be best understood with reference to the accompanying drawings, in which like parts are represented by like numbers throughout. The following description is intended to be exemplary only and simply illustrates certain selected embodiments of the apparatus and methods consistent with the present invention as claimed herein.
[0025] Intra-mode coding with 67 intra-prediction modes
[0026] To capture arbitrary edge directions present in natural videos, the number of directional intra modes in VVC is expanded from 33 used in HEVC to 65. New directional modes not present in HEVC are introduced in Figure 6 Depicted as dashed arrows in , planar and DC modes remain unchanged. These more dense directional intra prediction modes apply to all block sizes and luma and chroma intra prediction.
[0027] In VVC, for non-square blocks, several traditional angular intra prediction modes are adaptively replaced with wide-angle intra prediction modes.
[0028] In HEVC, each intra-coded block has a square shape and the length of each of its sides is a power of 2. Therefore, no division operation is required to generate the intra predictor using the DC mode. In VVC, blocks can have a rectangular shape, which in general requires the use of a division operation for each block. To avoid the division operation for DC prediction, only the longer sides are used to calculate the average for non-square blocks.
[0029] Wide-angle intra prediction for non-square blocks
[0030] Conventional angular intra prediction directions are defined as clockwise from 45 degrees to -135 degrees. In VVC, several traditional angular intra prediction modes are adaptively replaced with wide-angle intra prediction modes for non-square blocks. The replaced modes are signaled using the original mode index, which is remapped to the index of the wide-angle mode after parsing. The total number of intra prediction modes remains unchanged, i.e. 67, and the intra mode encoding method remains unchanged.
[0031] To support these prediction directions, a top reference of length 2W+1 and a left reference of length 2H+1 are defined as shown in Figures 7A and 7B, respectively.
[0032] The number of alternative modes in wide-angle direction mode depends on the aspect ratio of the block. The alternative intra prediction modes are shown in Table 1.
[0033] Table 1 – Intra prediction modes replaced by Wide mode
[0034] Aspect Ratio Alternative intra prediction modes W / H==16 Mode 12,13,14,15 W / H==8 Mode 12,13 W / H==4 Mode 2,3,4,5,6,7,8,9,10,11 W / H==2 Mode 2,3,4,5,6,7, W / H==1 none W / H==1 / 2 Mode 61,62,63,64,65,66 W / H==1 / 4 Mode 57,58,59,60,61,62,63,64,65,66 W / H==1 / 8 Mode 55,56 W / H==1 / 16 Mode 53,54,55,56
[0035] like Figure 4 As shown, in the case of wide-angle intra prediction, two vertically adjacent prediction samples (samples 410 and 412) can use two non-adjacent reference samples (samples 420 and 422). Therefore, a low-pass reference sample filter and side smoothing are applied to wide-angle prediction to reduce the gap Δp α The negative impact of the increase. If the wide-angle mode represents a non-fractional offset. There are 8 modes in the wide-angle mode that meet this condition, namely [-14,-12,-10,-6,72,76,78,80]. When predicting a block by these modes, the samples in the reference buffer are directly copied without applying any interpolation. With this modification, the number of samples that need to be smoothed is reduced. In addition, it also combines the design of the traditional prediction mode and the non-fractional mode in the wide-angle mode.
[0036] In VVC, 4:2:2, 4:4:4, and 4:2:0 chroma formats are supported. The chroma derived mode (DM) derivation table for the 4:2:2 chroma format was originally ported from HEVC, expanding the number of entries from 35 to 67 to keep pace with the expansion of intra prediction modes. Since the HEVC specification does not support prediction angles below -135° and above 45°, the luma intra prediction modes are mapped from 2 to 5 to 2. Therefore, the chroma DM derivation table for the 4:2:2 chroma format is updated by replacing some values of the mapping table entries to more accurately convert the prediction angles of the chroma blocks.
[0037] Most Probable Mode (MPM) List Generation
[0038] In order to keep the complexity of the most probable mode (MPM) list generation low, an intra mode coding method with 6 MPMs is used by considering two available adjacent intra modes. The following three aspects are considered to construct the MPM list:
[0039] Default intra mode;
[0040] Adjacent intra mode;
[0041] Intra mode for export.
[0042] Regardless of whether the Multiple Reference Line (MRL) and IntraSub-Partition (ISP) coding tools are applied, the unified 6-MPM list is used for intra blocks. The MPM list is constructed based on the intra mode of the upper left neighboring block. Assuming that the mode of the left block is recorded as Left and the mode of the upper block is recorded as Above, the unified MPM list is constructed as follows:
[0043] When a neighboring block is not available, its intra mode is set to planar by default.
[0044] If both "Left" and "Above" modes are non-angle modes:
[0045] MPM list → {plane, DC, V, H, V-4, V+4}
[0046] If one of the "Left" and "Above" modes is an angle mode and the other is a non-angle mode:
[0047] Set the mode Max to the larger of "Left" and "Above"
[0048] MPM list → {Plane, Max, DC, Max-1, Max+1, Max-2}
[0049] If Left and Above are both angled and they are different:
[0050] Set the mode Max to the larger of "Left" and "Above"
[0051] If the difference between the patterns Left and Above is in the range 2 to 62 (inclusive)
[0052] MPM list → {plane, left, top, DC, Max-1, Max+1}
[0053] otherwise
[0054] MPM list → {plane, left, top, DC, Max-2, Max+2}
[0055] If Left and Above are both in angle mode and they are the same:
[0056] MPM list → {plane, left, left-1, left+1, DC, left-2}
[0057] In addition, the first binary string (bin) of the MPM index codeword is CABAC context coded. A total of three contexts are used, corresponding to whether the current intra block is MRL-enabled, ISP-enabled, or a normal intra block.
[0058] During the 6MPM list generation process, pruning is used to remove repeated patterns so that only unique patterns are included into the MPM list. For entropy coding of the 61 non-MPM patterns, truncated binary code (TBC) is used.
[0059] Decoder-side Intra Mode Derivation (DIMD)
[0060] In the process of developing new coding standards beyond VVC, various new coding tools are being evaluated in a testbed called Enhanced Compression Model (ECM). Among the various codec tools, a new intra prediction mode has been disclosed, called Decoder Side Intra Mode Derivation (DIMD). When DIMD is applied, two intra modes are derived from reconstructed neighboring samples, and these two predictors are combined with a planar mode predictor, with weights derived from the gradients, as described in JVET-O0449 (Mohsen Abdol et al., "Non-CE3: Decoder-side Intra Mode Derivation with Prediction Fusion Using Planar", ITU-T SG 16WP 3 and ISO / IEC JTC 1 / SC 29 / WG 11 Joint Video Experts Group (JVET), 15th Meeting: Gothenburg, SE, July 3-12, 2019, Document: JVET-O0449).
[0061] From the DIMD, a Histogram of Gradient (HoG) with 65 entries corresponding to the 65 angular modes is calculated. The magnitudes of these entries are determined during the texture gradient analysis.
[0062] In the first step, DIMD selects T columns and rows of templates from the left and above the current block, respectively. This region is used as a reference for gradient-based intra prediction mode derivation.
[0063] In the second step, horizontal and vertical Sobel filters are applied to all 3×3 window positions, centered on the pixels in the template centerline to derive the gradient. At each window position, the Sobel filter calculates the pure horizontal and vertical gradients as G x and G y . Then, the texture angle (angle) of the window is calculated as follows:
[0064] angle=arctan(G x / G y), (1)
[0065] It can be converted to one of 65 angular intra prediction modes. Once the intra prediction mode index of the current window is derived as index(idx), the magnitude of its entry in HoG[idx] is updated by adding:
[0066] ampl=|G x |+|G y | (2)
[0067] The division operations in the weight derivation are performed using the same lookup table (LUT) based integerization scheme used by CCLM (Cross-Color Linear Model).
[0068] Orient=G y / G x (3)
[0069] Calculated by the following LUT-based scheme:
[0070] x=Floor(Log2(Gx)),
[0071] normDiff=((Gx<<4)>>x)&15,
[0072] x+=(3+(normDiff!=0)?1:0),and
[0073] Orient=(Gy*(DivSigTable[normDiff]|8)+(1<<(x-1)))>>x.
[0074] In the above equation, DivSigTable
[16] = {0,7,6,5,5,4,4,3,3,2,2,1,1,1,1,0}.
[0075] The derived intra modes are included in the main list of intra most probable modes (MPM). Therefore, the DIMD process is performed before constructing the MPM list. The main derived intra modes of a DIMD block are stored with the block and used for MPM list construction for neighboring blocks.
[0076] Secondary MPM
[0077] The introduction of the secondary MPM list is as described in JVET-D0114 (Vadim Seregin et al., "Block shapedependent intra mode coding", Joint Video Experts Group (JVET) / SC 29 / WG11 of ITU-T SG 16 WP3 and ISO / IEC JTC1, 4th Meeting: Chengdu, China, October 15-21, 2016, Document: JVET-D0114). The existing primary MPM (PMPM) list consists of 6 entries, and the secondary MPM (SMPM) list includes 16 entries. First, a general MPM list with 22 entries is constructed, and then the first 6 entries in the general MPM list are included in the PMPM list, and the remaining entries form the SMPM list. The first entry in the general MPM list is the planar mode. The remaining entries are as follows Figure 5 The shown intra modes are composed of the left (L), above (A), lower left (BL), upper right (AR), and upper left (AL) neighboring blocks, a directional mode that adds an offset from the first two available directional modes of the neighboring blocks, and a default mode.
[0078] If the CU block is vertically oriented, the order of adjacent blocks is A, L, BL, AR, AL; otherwise, it is L, A, BL, AR, AL.
[0079] The PMPM flag is parsed first; if it is equal to 1, the PMPM index is parsed to determine which entry in the PMPM list to select; otherwise, the SPMPM flag is parsed to determine whether to parse the SMPM index or the remaining mode.
[0080] The use of DIMD candidates in the MPM list has shown an improvement in coding efficiency. In the present invention, a method and apparatus for further improving the DIMD-based MPM is disclosed.
[0081] The present invention discloses a new decoder-side intra mode derivation (DIMD)-based derivation mode for MPM list construction. According to an embodiment of the present invention, when a video codec constructs an MPM list for a current block, a derivation mode based on the DIMD mode of the current block can be added to the MPM list during list construction with some constraints, such as block size, block aspect ratio, or template matching cost. The mode derived from the DIMD mode of the current block can be DIMD mode -1, DIMD mode +1, DIMD mode -2, DIMD mode +2, DIMD mode -3, DIMD mode +3, DIMD mode -4, DIMD mode +4, etc. The intra prediction modes according to VVC include 65 directional modes, a planar mode (ie, mode 0), and a DC mode (ie, mode 1). As Figure 2As shown, the directions of adjacent intra-frame modes (except mode 0 and mode 1) are very similar. The direction angle difference between DIMD±1 and DIMD is very small. When the offset (i.e., n) becomes larger, the direction angle difference between DIMD±n and DIMD becomes larger. The DIMD±n mode is referred to as the alternative DIMD mode in the present disclosure.
[0082] When the derived modes derived based on the decoder-side intra-mode are inserted into the MPM list, pruning or redundancy check may also be applied to the MPM list.
[0083] In one embodiment, when building the MPM list, the DIMD export mode is directly added to the MPM list without any restrictions.
[0084] In another embodiment, when constructing the MPM list, the DIMD export mode is added to the MPM list with a (block width + block height) constraint. For example, when (block width + block height) is less than a threshold, the DIMD export mode will not be inserted into the MPM list; otherwise (i.e., (block width + block height) is greater than or equal to the threshold), the DIMD export mode is added, where the threshold is N samples and N is greater than or equal to 0.
[0085] In another embodiment, when constructing the MPM list, the DIMD export mode is added to the MPM list with a block aspect ratio constraint. When the ratio of block width to block height is less than a threshold, the DIMD export mode will not be inserted into the MPM list; otherwise (i.e., the block aspect ratio is greater than or equal to the threshold), the DIMD export mode is added, where the threshold is N, which can be an integer or a fraction.
[0086] In another embodiment, when constructing the MPM list, only odd DIMD export modes are added to the MPM list. In other words, if the DIMD mode is odd, DIMD mode -2, DIMD mode +2, DIMD mode -4, DIMD mode +4, etc. are added to the MPM list. Similarly, if the DIMD mode is even, DIMD mode -1, DIMD mode +1, DIMD mode -3, DIMD mode +3, etc. are added to the MPM list.
[0087] In another embodiment, when constructing the MPM list, only the modes derived by the even DIMD are added to the MPM list. In other words, if the DIMD mode is odd, DIMD mode -1, DIMD mode +1, DIMD mode -3, DIMD mode +3, etc. are added to the MPM list. Similarly, if the DIMD mode is even, DIMD mode -2, DIMD mode +2, DIMD mode -4, DIMD mode +4, etc. are added to the MPM list.
[0088] In another embodiment, when constructing the MPM list, the template matching cost is calculated by comparing the current reconstructed L-shaped template and the reference sample. If the cost is less than the threshold, the DIMD derived mode is added to the MPM list when constructing the MPM; otherwise (i.e., the template matching cost is greater than or equal to the threshold), the DIMD derived mode is not added to the MPM list.
[0089] In another embodiment, when constructing the MPM list, the export mode and the DIMD export mode are added to the MPM list in the order from the closer mode export distance to the farther mode export distance. For example, the order in which the export mode and the DIMD export mode are added to the MPM list is as follows:
[0090] Second MPM mode -1, second MPM mode +1, third MPM mode -1, third MPM mode +1,
[0091] Fourth MPM mode -1, Fourth MPM mode +1, DIMD export mode -1, DIMD export mode +1,
[0092] Second MPM mode -2, second MPM mode +2, third MPM mode -2, third MPM mode +2,
[0093] Fourth MPM mode -2, fourth MPM mode +2, DIMD export mode -2, DIMD export mode +2, etc.
[0094] In another embodiment, when constructing the MPM list, the export mode and the DIMD export mode are added to the MPM list from the closer mode export distance to the farther mode export distance. For example, the order in which the export mode and the DIMD export mode are added to the MPM list is as follows:
[0095] Second MPM mode-1, third MPM mode-2, DIMD export mode-2, etc.
[0096] As shown in the above table, DIMD derived mode -1 and DIMD derived mode +1 (i.e., DIMD derived mode with offset distance equal to 1) are added after the alternative MPM mode with offset distance equal to 1. The alternative MPM mode refers to a mode derived by adding an offset to the MPM candidate (the i-th MPM mode ±n, where n corresponds to the offset). In other words, the alternative DIMD mode (i.e., DIMD mode ±n) is inserted into the MPM list in an interleaved manner, i.e., one or more i-th MPM mode ±1, DIMD mode ±1, one or more i-th MPM mode ±2, DIMD mode ±2, one or more i-th MPM mode ±3, DIMD mode ±3, etc. Although the above list includes the second MPM mode, the third MPM mode, and the fourth MPM mode, the present invention is not limited to this specific number of MPM candidates. We can generate alternative MPM candidates for more MPM candidates (e.g., also including the fifth MPM mode) or fewer MPM candidates (e.g., only including the second MPM mode and the third MPM mode).
[0097] Any of the aforementioned proposed methods for constructing alternative derived modes in the most probable mode (MPM) list can be implemented in an encoder and / or decoder. For example, any of the proposed methods can be implemented in a prediction derivation module (e.g., Figure 1A Intra-frame prediction 110 in the decoder) and / or a predictor derivation module of the decoder (e.g., Figure 1B Alternatively, any proposed method may be implemented as a circuit coupled to a predictor derivation module of an encoder and / or a predictor derivation module of a decoder so as to provide information required by the predictor derivation module.
[0098] Figure 6A flowchart of an exemplary video encoding system for constructing an MPM list using DIMD candidates according to an embodiment of the present invention is shown. The steps shown in the flowchart can be implemented as executable program codes on one or more processors (e.g., one or more CPUs) on the encoder side. The steps shown in the flowchart can also be implemented based on hardware, such as one or more electronic devices or processors arranged to perform the steps in the flowchart. According to the method, pixel data associated with a current block on the encoder side or encoded data associated with a current block to be decoded on the decoder side is received in step 610. In step 620, an initial MPM (most probable mode) list of the current block is determined, wherein the initial MPM list includes an MPM1 candidate and an MPM2 candidate. In step 630, multiple alternative first candidates are generated by adding one or more first offset distances to the MPM1 candidate. In step 640, multiple alternative second candidates are generated by adding one or more second offset distances to the MPM2 candidate. In step 650, at least one of the plurality of alternative first candidates and at least one of the plurality of alternative second candidates are inserted into the initial MPM list to form an extended MPM list according to the offset distance associated with at least one of the plurality of alternative first candidates and at least one of the plurality of alternative second candidates. In step 660, the current block is encoded or decoded using information including the extended MPM list.
[0099] The flowchart shown is intended to illustrate an example of video encoding according to the present invention. Without departing from the spirit of the present invention, those skilled in the art may modify each step, rearrange the steps, split the steps, or combine the steps to implement the present invention. In the present disclosure, specific syntax and semantics have been used to illustrate examples to implement embodiments of the present invention. Without departing from the spirit of the present invention, those skilled in the art may implement the present invention by replacing syntax and semantics with equivalent syntax and semantics.
[0100] The above description is provided to enable those of ordinary skill in the art to practice the present invention provided in the context of a specific application and its requirements. Various modifications to the described embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the specific embodiments shown and described, but to conform to the widest scope consistent with the principles and novel features disclosed herein. In the above detailed description, various specific details are illustrated to provide a thorough understanding of the present invention. However, those skilled in the art will appreciate that the present invention may be implemented.
[0101] The embodiments of the present invention as described above can be implemented in various hardware, software codes or a combination of the two. For example, one embodiment of the present invention can be one or more circuits integrated into a video compression chip or a program code integrated into the video compression software to perform the processing described herein. The embodiments of the present invention can also be a program code to be executed on a digital signal processor (DSP) to perform the processing described herein. The present invention can also be related to many functions performed by a computer processor, a digital signal processor, a microprocessor or a field programmable gate array (FPGA). These processors can be configured to perform specific tasks according to the present invention by executing machine-readable software codes or firmware codes that define the specific methods embodied by the present invention. The software code or firmware code can be developed in different programming languages and different formats or styles. The software code can also be compiled for different target platforms. However, the different code formats, styles and languages of the software code and other ways of configuring the code to perform tasks according to the present invention will not depart from the spirit and scope of the present invention.
[0102] The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples should be considered in all respects as illustrative and not restrictive. Therefore, the scope of the present invention is indicated by the appended claims rather than by the foregoing description. All changes that fall within the meaning and range of equivalents of the claims should be included within their scope.
Claims
1. A video encoding and decoding method, the method comprising: Receiving pixel data associated with a current block at an encoder side or receiving encoded data to be decoded associated with the current block at a decoder side; Determining an initial most probable mode (MPM) list for the current block, wherein the initial MPM list includes an MPM1 candidate and an MPM2 candidate; generating a plurality of substitute first candidates by adding one or more first offset distances to the MPM1 candidate; generating a plurality of substitute second candidates by adding one or more second offset distances to the MPM2 candidate; inserting the at least one of the plurality of alternative first candidates and the at least one of the plurality of alternative second candidates into the initial MPM list to form an extended MPM list according to offset distances associated with the at least one of the plurality of alternative first candidates and the at least one of the plurality of alternative second candidates; as well as The current block is encoded or decoded by using information including the extended MPM list.
2. The method according to claim 1, characterized in that The at least one of the plurality of substitute first candidates and the at least one of the plurality of substitute second candidates are inserted into the MPM list with constraints.
3. The method according to claim 2, characterized in that The constraints include the block size of the current block.
4. The method according to claim 3, characterized in that The block size of the current block corresponds to the sum of a block width and a block height of the current block.
5. The method according to claim 4, characterized in that When a sum of a block width and a block height of the current block is greater than a threshold, the at least one of the plurality of replacement first candidates and the at least one of the plurality of replacement second candidates are inserted into the MPM list.
6. The method according to claim 2, characterized in that The constraints include a block aspect ratio of the current block.
7. The method according to claim 6, characterized in that The block aspect ratio of the current block corresponds to a ratio of block width to block height.
8. The method according to claim 7, characterized in that When a block aspect ratio of the current block is greater than a threshold, the at least one of the plurality of substitute first candidates and the at least one of the plurality of substitute second candidates are inserted into the MPM list.
9. The method according to claim 1, characterized in that: The at least one of the plurality of alternative first candidates and the at least one of the plurality of alternative second candidates are inserted into the initial MPM according to increasing order of offset distances associated with the at least one of the plurality of alternative first candidates and the at least one of the plurality of alternative second candidates.
10. The method according to claim 1, characterized in that Also included is performing pruning or redundancy checking on the extended MPM list after inserting the at least one of the plurality of replacement first candidates and the at least one of the plurality of replacement second candidates.
11. An apparatus for video encoding and decoding, the apparatus comprising one or more electronic devices or processors, arranged to: Receiving pixel data related to the current block at the encoding end or receiving encoded data to be decoded related to the current block at the decoding end; Determine an initial MPM list of the current block, wherein the initial MPM list includes an MPM1 candidate and an MPM2 candidate; generating a plurality of substitute first candidates by adding at least two first offset distances to the MPM1 candidate; generating a plurality of substitute second candidates by adding at least two second offset distances to the MPM2 candidate; inserting at least one of the plurality of alternative first candidates and at least one of the plurality of alternative second candidates into an initial MPM list to form an extended MPM list according to offset distances associated with at least one of the plurality of alternative first candidates and at least one of the plurality of alternative second candidates; as well as The current block is encoded or decoded by using information including the extended MPM list.
Citation Information
Cited By
HEVC (High Efficiency Video Coding) method based on simplified intra-frame and inter-frame decisions and CU (Coding Unit) division decision
CN120751123A
