Improved method and apparatus for decoder deriving intra prediction in video coding system
By determining a subset of the initial angle intra prediction mode set in video encoding and performing the DIMD process based on the statistics of the angle field, the problem of high complexity in intra mode derivation calculation on the decoder side is solved, and the video encoding performance is improved.
Patent Information
- Application Number
- CN202380034319.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-15
- Filing Date
- 2023-04-12
- Publication Date
- 2024-11-26
AI Technical Summary
In the existing video encoding technology, the decoder side intra mode derivation (DIMD) has high computational complexity, which affects performance.
By receiving pixel data or encoded data associated with the current block on the encoder side and the decoder side, a subset of the initial angle intra prediction mode set is determined, and a DIMD process is performed based on the statistics of the angle field or histogram to generate the final intraframe Predict the cohort and use gradient filtering results to compare with thresholds to determine candidate modes.
The calculation complexity of intra-mode derivation is reduced, the video encoding performance is improved, the calculation overhead is reduced, and the processing efficiency on the decoder side is improved.
Smart Images

Figure CN119032564A_ABST
Abstract
Description
[0001] Cross-references
[0002] The present invention is a non-provisional application of and claims priority to U.S. Provisional Patent Application No. 63 / 331,347 filed on April 15, 2022. The entire contents of the U.S. Provisional Patent Application are incorporated herein by reference. Technical Field
[0003] The invention relates to intra prediction in video coding systems. In particular, the invention relates to computational complexity reduction and / or performance improvement of decoder-side intra mode derivation (DIMD) codec tools. Background Art
[0004] Versatile Video Coding (VVC) is the latest international video coding standard jointly developed by the Joint Video Experts Group (JVET) of the ITU-T Video Coding Experts Group (VCEG) and the ISO / IEC Moving Picture Experts Group (MPEG). The standard has been published as an ISO standard: ISO / IEC 23090-3:2021, Information technology - Coded representation of immersive media - Part 3: Versatile video coding, released in February 2021. VVC is an improvement on its predecessor HEVC (High Efficiency Video Coding) by adding more codec tools to improve codec efficiency, and can also handle various types of video sources, including 3D video signals.
[0005] Figure 1A An exemplary adaptive inter / intra video coding system including a loop process is illustrated. For intra prediction, prediction data is derived from previously encoded video data in the current picture. For inter prediction 112, motion estimation (ME) is performed on the encoder side and motion compensation (MC) is performed based on the results of ME to provide prediction data derived from other pictures and motion data. Switch 114 selects intra prediction 110 or inter prediction 112 and the selected prediction data is provided to adder 116 to form a prediction error, also known as a residual. The prediction error is then processed by transform (T) 118 and subsequent quantization (Q) 120. The transformed and quantized residual is then encoded by entropy encoder 122 to be included in a video bitstream corresponding to the compressed video data. The bitstream associated with the transform coefficients is then packaged with auxiliary information (such as motion and coding modes associated with intra prediction and inter prediction) and other information (such as parameters associated with loop filters applied to underlying image areas). Auxiliary information associated with intra prediction 110, inter prediction 112, and in-loop filter 130 is provided to entropy encoder 122, such as Figure 1AAs shown. When using inter-frame prediction mode, one or more reference pictures must also be reconstructed at the encoder end. Therefore, the transformed and quantized residual is processed by inverse quantization (IQ) 124 and inverse transform (IT) 126 to recover the residual. The residual is then added back to the prediction data 136 at reconstruction (REC) 128 to reconstruct the video data. The reconstructed video data can be stored in a reference picture buffer 134 and used to predict other frames.
[0006] like Figure 1A As shown, the input video data undergoes a series of processes in the coding system. Due to a series of processes, the reconstructed video data from REC128 may be subject to various impairments. Therefore, loop filter 130 is often applied to reconstructed video data before the reconstructed video data is stored in reference picture buffer 134 to improve video quality. For example, deblocking filter (DF), sample adaptive offset (SAO) and adaptive loop filter (ALF) can be used. It may be necessary to merge loop filter information into the bitstream so that the decoder can correctly restore the required information. Therefore, loop filter information is also provided to entropy encoder 122 to be merged into the bitstream. Figure 1A In , a loop filter 130 is applied to the reconstructed video before the reconstructed samples are stored in a reference picture buffer 134 . Figure 1A The system in is intended to illustrate an exemplary structure of a typical video encoder. It may correspond to the High Efficiency Video Coding (HEVC) system, VP8, VP9, H.264, or VVC.
[0007] like Figure 1B As shown, the decoder can use similar or identical functional blocks as the encoder, except for transform 118 and quantization 120, because the decoder only needs inverse quantization 124 and inverse transform 126. Instead of entropy encoder 122, the decoder uses entropy decoder 140 to decode the video bitstream into quantized transform coefficients and required encoding information (such as ILPF information, intra-frame prediction information, and inter-frame prediction information). Intra-frame prediction 150 on the decoder side does not need to perform mode search. Instead, the decoder only needs to generate intra-frame prediction based on the intra-frame prediction information received from entropy decoder 140. In addition, for inter-frame prediction, the decoder only needs to perform motion compensation (MC152) based on the inter-frame prediction information received from entropy decoder 140 without motion estimation.
[0008] In the present invention, techniques for improving the performance or reducing the computational complexity of a decoder-side intra mode derivation (DIMD) coding tool are disclosed. Summary of the invention
[0009] A method and apparatus for video encoding are disclosed. According to the method, pixel data associated with a current block is received at an encoder side or encoded data associated with a current block to be decoded is received at a decoder side. A selected angle intra prediction candidate mode set corresponding to a subset of an initial angle intra prediction mode set is determined for the current block, wherein the selected angle intra prediction candidate mode set depends on the block size of the current block or the prediction mode of a neighboring block of the current block. One or more target DIMD candidates are determined from the selected angle intra prediction candidate mode set of the current block based on a DIMD process using statistics or histograms of an angle field derived from a template of the current block. A final intra predictor is generated based on information including the one or more target DIMD candidates. The current block is encoded or decoded using the final intra predictor.
[0010] In one embodiment, for a smaller block size of the current block, the number of angular intra prediction candidate modes in the selected angular intra prediction candidate mode set is determined to be smaller.The block size of the current block may correspond to the sum of the block width and the block height of the current block.
[0011] In one embodiment, the selected set of angular intra prediction candidate modes corresponds to a set of predefined angular intra prediction modes for the current block.
[0012] In one embodiment, the selected set of angular intra prediction candidate modes corresponds to a restricted candidate set. The restricted candidate set may correspond to a member of a set including an even intra prediction mode, an odd intra prediction mode, a first half set of an initial set of angular intra prediction modes, or a second half set of an initial set of angular intra prediction modes. In one embodiment, syntax is signaled or parsed to indicate the member of the set corresponding to the restricted candidate set for the current block. In another embodiment, syntax associated with the restricted candidate set is signaled or parsed from a PPS (picture parameter set), an SPS (sequence parameter set), a picture header, a slice header, or a CTU level syntax.
[0013] In one embodiment, the grammar associated with the restricted candidate set is implicitly derived based on other grammars. In another embodiment, the restricted candidate set is always used.
[0014] In one embodiment, if the top neighboring CU is inter-coded in skip mode, the selected angular intra prediction candidate mode set excludes angular intra prediction candidate modes whose mode numbers are greater than those of the diagonal intra angular mode. In another embodiment, if the left neighboring CU is inter-coded in skip mode, the selected angular intra prediction candidate mode set excludes angular intra prediction candidate modes whose mode numbers are less than those of the diagonal intra angular mode.
[0015] According to another embodiment, the initial intra prediction mode is derived using DIMD. One or more syntaxes associated with the delta angle are signaled in the bitstream or parsed from the bitstream. The current block is encoded or decoded using the final intra prediction mode, wherein the delta angle corresponds to the difference between the final intra prediction mode and the initial intra prediction mode.
[0016] In one embodiment, the one or more syntaxes include a first syntax associated with a magnitude of the increment angle and a second syntax associated with a sign of the increment angle.
[0017] According to another embodiment, one or more gradient filters are applied to the template of the current block to generate a gradient filtering result. The DIMD candidate mode is determined by comparing the gradient magnitude of the gradient filtering result with a threshold. A final intra-frame predictor is generated based on information including the DIMD candidate mode. The current block is encoded or decoded using the final intra-frame predictor.
[0018] In one embodiment, the threshold value depends on the block size of the current block. In one embodiment, if all gradient magnitudes are less than the threshold value, the DIMD candidate mode is set to the plane mode. In another embodiment, the target candidate intra-frame angle mode with the maximum gradient magnitude in the DIMD is set as the current intra-frame prediction mode. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1A An exemplary adaptive inter / intra video coding system incorporating loop processing is described.
[0020] Figure 1B Picture shows Figure 1A The corresponding decoder of the encoder in .
[0021] Figure 2 Examples of multi-type tree structures corresponding to vertical binary split (SPLIT_BT_VER), horizontal binary split (SPLIT_BT_HOR), vertical ternary split (SPLIT_TT_VER), and horizontal ternary split (SPLIT_TT_HOR) are shown.
[0022] Figure 3 An example of a signaling mechanism for partition split information in a quadtree with a nested multi-type tree coding tree structure is shown.
[0023] Figure 4 An example of a CTU being partitioned into multiple CUs with a quadtree and nested multi-type tree coding block structure is shown, where bold block edges represent quadtree partitions and the remaining edges represent multi-type tree partitions.
[0024] Figure 5An example is shown where TT splitting is prohibited when the width or height of the luma coding block is greater than 64.
[0025] Figure 6 Some examples where TT splitting is prohibited when the width or height of the luma coding block is greater than 64 are marked.
[0026] Figure 7 The intra-frame prediction mode adopted by the VVC video coding standard is marked.
[0027] Fig. 8A -B illustrates a block that is wider than it is tall ( Fig. 8A ) and blocks that are taller than they are wide ( Figure 8B ) is an example of wide-angle intra prediction.
[0028] Fig.9A An example of a template selected for a current block is shown, where the template includes T rows above the current block and T columns to the left of the current block.
[0029] Fig. 9B An example of T=3 is shown, and the HoG (Histogram of Gradients) is calculated for pixels in the middle row and pixels in the middle column.
[0030] Fig. 9C An example of the amplitude (ampl) of the angular intra prediction mode is shown.
[0031] Fig.10 An example of a blending process is illustrated, where two intra modes (M1 and M2) and a planar mode are selected based on the index with the two highest bins of the histogram bins.
[0032] Fig.11A An example of P2 prediction value derivation is illustrated, in which a P2 prediction value for an area of the current block indicated by a slash-filled area is derived according to the intra prediction mode of a neighboring 4x4 block.
[0033] Fig. 11B Another example in combination with an embodiment of the present invention is illustrated, in which neighboring window positions of a current block are divided into a plurality of sets (eg, G1, G2, G3, and G4).
[0034] Fig. 11C Another example in conjunction with an embodiment of the present invention is illustrated, where the final intra prediction is divided into multiple regions and the intra prediction of each region depends on the neighboring window positions.
[0035] Fig.12 An example is illustrated in which prediction samples (corresponding to candidate angular intra mode predictions) in the top and left boundary areas within the current block are indicated by slanted lines.
[0036] Fig.13An example is illustrated where if the current intra prediction comes from the left neighboring reconstructed sample, the current prediction at (x, y) is obtained through the top left sample (eg, R-1, -1) and the current left neighboring sample (eg, R-1, y).
[0037] Fig.14 A flow chart of an exemplary video encoding system for deriving DIMD candidates using a subset of angular intra prediction modes according to an embodiment of the present invention is illustrated.
[0038] Fig.15 A flow chart of an exemplary video encoding system for deriving DIMD candidates according to an embodiment of the present invention is illustrated, wherein a delta angle between a final intra prediction mode and a DIMD derivation mode is signaled or resolved.
[0039] Fig.16 A flow chart of an exemplary video encoding system according to an embodiment of the present invention is illustrated, which video encoding system derives DIMD (decoder-side intra mode derivation) candidates using a process including comparing the gradient magnitude of a gradient filtering result with a threshold. DETAILED DESCRIPTION
[0040] It will be readily appreciated that the components of the present invention as generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Therefore, the following more detailed description of the embodiments of the systems and methods of the present invention as shown in the figures is not intended to limit the scope of the claimed invention, but is merely representative of selected embodiments of the present invention. References throughout this specification to "one embodiment," "an embodiment," or similar language mean that a particular feature, structure, or characteristic described in conjunction with that embodiment may be included in at least one embodiment of the present invention. Therefore, the phrases "in one embodiment" or "in an embodiment" appearing throughout this specification do not necessarily all refer to the same embodiment.
[0041] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. However, those skilled in the relevant art will recognize that the present invention may be practiced without one or more specific details, or using other methods, components, etc. In other cases, well-known structures or detailed descriptions of operations are not shown or are not shown to avoid obscuring aspects of the present invention. The illustrated embodiments of the present invention will be best understood with reference to the accompanying drawings, in which like parts are represented by like numbers throughout. The following description is intended to be exemplary only and simply illustrates certain selected embodiments of the apparatus and methods consistent with the present invention as claimed herein.
[0042] According to VVC, similar to HEVC, the input picture is divided into non-overlapping square block areas called CTUs (Coding Tree Units). Each CTU can be divided into one or more coding units (CUs) of smaller size. The generated CU partitions can be square or rectangular. In addition, VVC divides CTUs into prediction units (PUs) as units for applying prediction processes such as inter-frame prediction, intra-frame prediction, etc.
[0043] The VVC standard incorporates various new coding tools to further improve the coding efficiency over the HEVC standard. Among the various new coding tools, some coding tools related to the present invention are summarized as follows.
[0044] Use tree structure to divide CTU
[0045] In HEVC, CTUs are divided into CUs using a quadtree (QT) structure represented as a coding tree to accommodate various local characteristics. The decision to encode a picture area using inter-picture (temporal) or intra-picture (spatial) prediction is made at the leaf-CU level. Each leaf-CU can be further partitioned into one, two, or four PUs based on the PU partition type. Within a PU, the same prediction process is applied, and relevant information is transmitted to the decoder on a PU basis. After obtaining the residual block by applying the prediction process based on the PU partition type, the leaf-CU can be divided into transform units (TUs) according to another quadtree structure similar to the coding tree of the CU. One of the key features of the HEVC structure is that it has multiple partition concepts, including CU, PU, and TU.
[0046] In VVC, a quadtree with nested multi-type trees using binary and ternary partitioning structures replaces the concept of multiple partitioning unit types, that is, it removes the separation of CU, PU and TU concepts except for CUs that are too large for the maximum transform length, and supports more flexible CU partition shapes. In the coding tree structure, CU can be square or rectangular. The coding tree unit (CTU) is first partitioned according to a quaternary tree (also called quadtree) structure. Then the quadtree leaf nodes can be further divided into multi-type tree structures. For example Figure 2As shown, there are four types of splits in the multi-type tree structure, vertical binary split (SPLIT_BT_VER 210), horizontal binary split (SPLIT_BT_HOR 220), vertical ternary split (SPLIT_TT_VER 230), and horizontal ternary split (SPLIT_TT_HOR 240). The multi-type tree leaf node is called a coding unit (CU), and this segmentation will be used for prediction and transform processing without further division unless the CU is too large for the maximum transform length. This means that in most cases, CUs, PUs, and TUs have the same block size in a quadtree with a nested multi-type tree coding block structure. An exception occurs when the maximum supported transform length is less than the width or height of the CU color component.
[0047] Figure 3 The signaling mechanism for partition split information in a quadtree with a nested multi-type tree coding tree structure is shown. The coding tree unit (CTU) is regarded as the root of the quadtree and is first divided by the quadtree structure. Each quadtree leaf node (when large enough to allow it) is then further divided by the multi-type tree structure. In the multi-type tree structure, the first flag (mtt_split_cu_flag) is sent to indicate whether the node is further divided; when a node is further divided, the second flag (mtt_split_cu_vertical_flag) is sent to indicate the split direction, and then the third flag (mtt_split_cu_binary_flag) is sent to indicate whether the split is a binary split or a ternary split. Based on the values of mtt_split_cu_vertical_flag and mtt_split_cu_binary_flag, the multi-type tree split mode (MttSplitMode) of a CU is derived, as shown in Table 1.
[0048] Table 1 – Deriving MttSplitMode based on multi-type tree syntax elements
[0049] MttSplitMode mtt_split_cu_vertical_flag mtt_split_cu_binary_flag SPLIT_TT_HOR 0 0 SPLIT_BT_HOR 0 1 SPLIT_TT_VER 1 0 SPLIT_BT_VER 1 1
[0050] Figure 4 The CTU is shown to be partitioned into multiple CUs with a quadtree and nested multi-type tree coding block structure, where the bold block edges represent quadtree partitions and the remaining edges represent multi-type tree partitions. The quadtree with nested multi-type tree partitions provides a content-adaptive coding tree structure consisting of CUs. The size of the CU can be as large as the CTU or as small as 4×4 in units of luma samples. For the 4:2:0 chroma format, the maximum chroma CB size is 64×64 and the minimum chroma CB size consists of 16 chroma samples.
[0051] In VVC, the maximum supported luma transform size is 64 × 64, and the maximum supported chroma transform size is 32 × 32. When the width or height of the CB is larger than the maximum transform width or height, the CB is automatically split horizontally and / or vertically to meet the transform size limit in that direction.
[0052] The following parameters are defined and specified by the SPS syntax elements for quadtree with nested multi-type tree coding tree scheme.
[0053] –CTU size: the root node size of the quadtree
[0054] –MinQTSize: Minimum allowed quadtree leaf node size
[0055] –MaxBtSize: Maximum allowed binary tree root node size
[0056] –MaxTtSize: Maximum allowed ternary tree root node size
[0057] –MaxMttDepth: The maximum allowed depth of a multi-type tree split from a quad leaf node
[0058] –MinBtSize: The minimum allowed binary tree leaf node size
[0059] –MinTtSize: The minimum allowed ternary tree leaf node size
[0060] In one example of a quadtree with a nested multi-type tree coding tree structure, the CTU size is set to 128×128 luma samples and two corresponding 64×64 blocks of 4:2:0 chroma samples, MinQTSize is set to 16×16, MaxBtSize is set to 128×128, MaxTtSize is set to 64×64, MinBtSize and MinTtSize (width and height) are set to 4×4, and MaxMttDepth is set to 4. Tree partitioning is first applied to the CTU to generate quadtree leaf nodes. The size of the quadtree leaf node can range from 16×16 (i.e., MinQTSize) to 128×128 (i.e., CTU size). If the leaf QT node is 128×128, the binary tree will not be further split because the size exceeds MaxBtSize and MaxTtSize (i.e., 64×64). Otherwise, the quadtree leaf node may be further split by the multi-type tree. Therefore, the quadtree leaf node is also the root node of the multitree, and its multitree depth (mttDepth) is 0. When the multitree depth reaches MaxMttDepth (i.e. 4), it is considered that no further segmentation is required. When the width of the multi-type tree node is equal to MinBtSize and less than or equal to 2*MinTtSize, no further horizontal segmentation is considered. Similarly, when the height of the multi-type tree node is equal to MinBtSize and less than or equal to 2*MinTtSize, no further vertical segmentation is considered.
[0061] In order to allow 64×64 luma blocks and 32×32 chroma blocks pipeline design in the VVC hardware decoder, TT splitting is prohibited when the width or height of the luma coding block is greater than 64, such as Figure 5 As shown, block 500 corresponds to a 128x128 luma CU. The CU can be split using vertical binary tree partitioning (510) or horizontal binary tree partitioning (520). The block is split into 4 CUs, each CU is 64x64 in size, and the CU can be further partitioned using partitions including TT. For example, the 64x64 CU in the upper left corner is partitioned using vertical ternary partitioning (530) or horizontal ternary partitioning (540). TT splitting is also prohibited when the width or height of the chroma coding block is greater than 32.
[0062] In VVC, the coding tree scheme supports the ability to have separate block tree structures for luma and chroma. For P and B slices, the luma and chroma CTBs in one CTU must share the same coding tree structure. However, for I slices, luma and chroma can have separate block tree structures. When separate block tree modes are applied, the luma CTB is partitioned into CUs by one coding tree structure, and the chroma CTB is partitioned into chroma CUs by another coding tree structure. This means that a CU in an I slice may consist of coding blocks for the luma component or coding blocks for two chroma components, while a CU in a P or B slice always consists of coding blocks for all three color components unless the video is monochrome.
[0063] Virtual Pipeline Data Units (VPDU)
[0064] A Virtual Pipeline Data Unit (VPDU) is defined as a non-overlapping unit in a picture. In a hardware decoder, consecutive VPDUs are processed simultaneously by multiple pipeline stages. In most pipeline stages, the VPDU size is roughly proportional to the buffer size, so it is important to keep the VPDU size small. In most hardware decoders, the VPDU size can be set to the maximum transform block (TB) size. However, in VVC, ternary tree (TT) and binary tree (BT) partitioning may cause the VPDU size to increase.
[0065] To keep the VPDU size to 64x64 luma samples, the following canonical partitioning restrictions (with syntax signaling modifications) are applied in VTM, as Figure 6 As shown:
[0066] – For CUs with width or height or both width and height equal to 128, TT split is not allowed (e.g. Figure 6 ” in the figure).
[0067] – For 128xNCU with N ≤ 64 (i.e. width equals 128 and height less than 128), horizontal BT is not allowed.
[0068] For Nx128 CUs with N≤64 (i.e., height equal to 128 and width less than 128), vertical BT is not allowed. Figure 6 In the example, the luma block size is 128x128. The dashed line indicates a block size of 64x64. According to the above constraints, examples where partitioning is not allowed are indicated by "X", such as Figure 6 As shown in various examples (610-680).
[0069] Intra-mode coding with 67 intra-prediction modes
[0070] To capture arbitrary edge directions present in natural videos, the number of directional intra modes in VVC is expanded from 33 used in HEVC to 65. New directional modes not present in HEVC are introduced in Figure 7 Depicted as dashed arrows in , planar and DC modes remain unchanged. These more dense directional intra prediction modes apply to all block sizes and luma and chroma intra prediction.
[0071] In VVC, for non-square blocks, several traditional angular intra prediction modes are adaptively replaced with wide-angle intra prediction modes.
[0072] In HEVC, each intra-coded block has a square shape and the length of each of its sides is a power of 2. Therefore, no division operation is required to generate intra predictors using DC mode. In VVC, blocks can have a rectangular shape, which in general requires the use of division operations for each block. To avoid division operations for DC prediction, only the longer sides are used to calculate the average for non-square blocks.
[0073] In order to keep the complexity of the most probable mode (MPM) list generation low, an intra mode coding method with 6 MPMs is used by considering two available adjacent intra modes. The following three aspects are considered to construct the MPM list:
[0074] – Default intra mode
[0075] – Adjacent Intra Mode
[0076] – Intra mode for export.
[0077] A unified 6-MPM list is used for intra blocks, regardless of whether the MRL and ISP coding tools are applied. The MPM list is constructed based on the intra modes of the left and upper neighboring blocks. Assuming that the mode on the left is denoted as Left and the mode of the upper block is denoted as Above, the unified MPM list is constructed as follows:
[0078] – When a neighboring block is not available, its intra mode is set to planar by default.
[0079] – If both Left and Above modes are non-angle modes:
[0080] –MPM list → {plane,DC,V,H,V-4,V+4}
[0081] – If one of the Left and Above modes is an angle mode and the other is a non-angle mode:
[0082] – Set mode Max to the larger mode between Left and Above
[0083] – MPM list → {plane, Max, DC, Max-1, Max+1, Max-2}
[0084] – If Left and Above are both angled and they are different:
[0085] – Set mode Max to the larger mode between Left and Above
[0086] – If the difference between the modes Left and Above is in the range 2 to 62, inclusive
[0087] MPM list → {Plane,Left,Above,DC,Max-1,Max+1}
[0088] -otherwise
[0089] MPM list → {Plane,Left,Above,DC,Max-2,Max+2}
[0090] – If Left and Above are both angled and they are the same:
[0091] –MPM list → {plane,Left,Left-1,Left+1,DC,Left-2}
[0092] In addition, the first bin of the MPM index codeword is CABAC context coded. A total of three contexts are used, corresponding to whether the current intra block is MRL enabled, ISP enabled, or a normal intra block.
[0093] In the 6MPM list generation process, pruning is used to remove repeated patterns so that only unique patterns can be included in the MPM list. For entropy coding of the 61 non-MPM patterns, truncated binary code (TBC) is used.
[0094] Wide-angle intra prediction for non-square blocks
[0095] Conventional angular intra prediction directions are defined as clockwise from 45 degrees to -135 degrees. In VVC, several traditional angular intra prediction modes are adaptively replaced with wide-angle intra prediction modes for non-square blocks. The replaced modes are signaled using the original mode index, which is remapped to the index of the wide-angle mode after parsing. The total number of intra prediction modes remains unchanged, i.e. 67, and the intra mode encoding method remains unchanged.
[0096] To support these predictions, Fig. 8A and Figure 8B As shown, a top reference with a length of 2W+1 and a left reference with a length of 2H+1 are defined.
[0097] The number of alternative modes in wide-angle direction mode depends on the aspect ratio of the block. The alternative intra prediction modes are shown in Table 2.
[0098] Table 2 – Intra prediction modes replaced by Wide mode
[0099]
[0100]
[0101] In VVC, 4:2:2, 4:4:4, and 4:2:0 chroma formats are supported. The chroma derived mode (DM) derivation table for the 4:2:2 chroma format was originally ported from HEVC, expanding the number of entries from 35 to 67 to keep pace with the expansion of intra prediction modes. Since the HEVC specification does not support prediction angles below -135° and above 45°, the luma intra prediction modes are mapped from 2 to 5 to 2. Therefore, the chroma DM derivation table for the 4:2:2 chroma format is updated by replacing some values of the mapping table entries to more accurately convert the prediction angles of the chroma blocks.
[0102] Decoder-side Intra Mode Derivation (DIMD)
[0103] When DIMD is applied, two intra modes are derived from the reconstructed neighboring samples and these two predictions are combined with the planar mode prediction with weights derived from the gradients. DIMD mode is used as an alternative prediction mode and is always checked in high complexity RDO mode.
[0104] To implicitly derive the intra prediction mode of a block, texture gradient analysis is performed on both the encoder and decoder side. This process starts with an empty gradient histogram (HoG) with 65 entries, corresponding to 65 angular modes. The magnitudes of these entries are determined during texture gradient analysis.
[0105] In the first step, DIMD selects a template of T=3 columns and rows from the left and top of the current block, respectively. This area is used as a reference for gradient-based intra prediction mode derivation.
[0106] In the second step, horizontal and vertical Sobel filters are applied to all 3×3 window locations, centered on the pixels in the template midline. At each window location, the Sobel filter computes the pure horizontal and vertical intensities G, respectively. x and G y . The texture angle of the window is then calculated as:
[0107] angle=arctan(Gx / G y ), (1)
[0108] can be converted to one of 65 angular intra prediction modes. Once the intra prediction mode index of the current window is derived as idx, the magnitude of its entry in HoG[idx] is updated by adding:
[0109] ampl=|G x |+|G y | (2)
[0110] Fig.9A -C shows an example of the HoG computed after applying the above operations for all pixel positions in the template. Fig.9A An example of a template 920 selected for a current block 910 is illustrated. The template 920 includes T rows above the current block and T columns to the left of the current block. For intra prediction of the current block, an area 930 above and to the left of the current block corresponds to a reconstructed area, while an area 940 below and to the right of the block corresponds to an unavailable area. Fig. 9B An example of T=3 is illustrated and the HoG is calculated for the pixel 960 in the middle row and the pixel 962 in the middle column. For example, for pixel 952, a 3x3 window 950 is used. Fig. 9C An example of the amplitude (Ampl) calculated based on equation (2) for the angular intra prediction mode as determined from equation (1) is illustrated.
[0111] Once the HoG is calculated, the indices with the two highest histogram bins are selected as the two implicitly derived intra prediction modes for the block and further combined with the planar mode as the prediction for the DIMD mode. Prediction fusion is applied as a weighted average of the three predictors mentioned above. For this purpose, the weight of the plane is fixed to 21 / 64 (~1 / 3). The remaining 43 / 64 (~2 / 3) weights are then shared between the two HoG IPMs, proportional to the amplitude of their HoG bins. Fig.10 An example of the mixing process is shown. Fig.10 As shown, two intra modes (M1 1012 and M2 1014) are selected based on the index of the two highest bars of the histogram bar 1010.
[0112] 1040, Pred2 1042 and Pred3 1044) are used to form a hybrid prediction. The three predictors correspond to applying M1, M2 and planar intra modes (1020, 1022 and 1024 respectively) to the reference pixel 1030 to form the corresponding predictor. The three predictors are weighted by the corresponding weighting factors (ω1, ω2 and ω3) 1050. The weighted predictors are summed using adder 1052 to generate a hybrid predictor 1060.
[0113] In addition, two implicitly derived intra modes are included in the MPM list so that the DIMD process is performed before constructing the MPM list. The primary derived intra mode of a DIMD block is stored with the block and used for MPM list construction for neighboring blocks.
[0114] As mentioned above, DIMD is a useful coding tool to improve coding efficiency. In the present invention, a method for improving DIMD prediction accuracy or coding performance is disclosed.
[0115] In one embodiment, the final intra prediction of the current block is generated by combining two or more intra predictions. The two or more intra predictions can come from intra angle prediction, intra DC prediction, intra plane prediction or other intra prediction tools. In one embodiment, one of the "two or more intra predictions" (denoted as P1) can be an intra angle mode, which is implicitly derived from the gradient of adjacent reconstructed samples (e.g., by DIMD) and has the highest gradient histogram bar. The other of the "two or more intra predictions" (denoted as P2) can be implicitly derived by template matching (e.g., by TIMD), the most frequently selected intra prediction mode of adjacent 4x4 blocks, the intra mode selected after excluding high texture areas, the angle mode explicitly signaled, or explicitly signaled and derived from one of the MPMs. In another embodiment, P1 of the "two or more intra predictions" can be an intra angle mode, which is implicitly derived from the gradient of adjacent reconstructed samples (e.g., by DIMD) and the intra mode angle is greater than or equal to the diagonal inner angle (e.g., mode 34 is in 67 mode inner angles, mode 66 is in 131 mode inner angles). P2 of "more than intra prediction" can be derived implicitly by DIMD, and the intra mode angle is smaller than the diagonal intra angle. In yet another embodiment, P1 of "two or more intra prediction" can be an intra angle mode, which is implicitly derived by DIMD. P2 of "two or more intra prediction" can be derived implicitly from neighboring blocks.
[0116] Fig.11A An example of P2 prediction derivation is illustrated, where the P2 prediction for region 1120 (as indicated by the diagonally filled area) of the current block 1110 is derived based on the intra-prediction modes of neighboring 4x4 blocks (shown as squares with arrows corresponding to the respective intra-prediction modes of the neighboring 4x4 blocks).
[0117] In another embodiment, P1 of "two or more intra predictions" may be an intra angle mode implicitly derived from DIMD, and P2 of "two or more intra predictions" may be a planar prediction with reference to any smooth intra prediction method, where smooth intra prediction is a method using multiple reference samples at the corners of the current block, such as the planar prediction defined in HEVC / VVC, or other modified or altered forms of planar prediction.
[0118] The final intra prediction of the current block can be obtained by
[0119] Weight 1×P1+weight 2×P2,
[0120] (P1+P2+1)>>1, or
[0121] Maximum value (P1, P2) = (P1 + P2 + absolute value (P1 – P2)) >> 1
[0122] Fig. 11B Another example in conjunction with an embodiment of the present invention is illustrated, in which the adjacent window positions of the current block 1130 are divided into a plurality of groups (e.g., G1, G2, G3, and G4). Each group will select an angle intra mode, and the final intra prediction is a fusion (i.e., mixing) of these selected angle intra predictions and weights.
[0123] Fig. 11C Another example in combination with an embodiment of the present invention is illustrated, in which the final intra prediction is divided into multiple regions and the intra prediction of each region depends on the adjacent window position. For example, the intra prediction of the R1 region of the current block 1140 is fused by the intra prediction derived from G2 and G3, the intra prediction of the R2 region is fused by the intra prediction derived from G1 and G3, the intra prediction of the R3 region is fused by the derived intra prediction from G2 and G4, and / or the intra prediction of the R4 region is fused with the derived intra prediction from G1 and G4.
[0124] In another embodiment, when the gradient amplitude after applying the Sobel filter is less than a threshold value, all derived DIMD modes are set to plane mode, or the current prediction is set to plane prediction. In one embodiment, the threshold value is allowed to vary with block size. In yet another embodiment, when the gradient amplitude after applying the Sobel filter is greater than the threshold value or the gradient amplitude of the first DIMD mode after applying the Sobel filter is greater than the threshold value (which varies with block size), the current intra-frame prediction is set to the prediction from the first DIMD mode (that is, not mixed with plane prediction). In one embodiment, the threshold value is allowed to vary with block size.
[0125] In another embodiment, in the DIMD process, the boundary smoothness between the candidate angular intra mode predictions and the adjacent reconstructed samples is further considered when deriving the final angular intra mode prediction. For example, the SAD between the top / left prediction sample and the corresponding adjacent samples of each intra mode candidate is considered when searching for the final angular intra mode prediction, such as Fig.12 As shown. Fig.12 , the predicted samples (corresponding to the candidate angular intra mode prediction) in the top and left boundary regions 1220 within the current block 1210 are indicated by slashes. The neighboring reconstructed samples in the top region 1230 and the left region 1232 are shown as dot-filled regions.
[0126] In another embodiment, in order to improve the encoding performance of DIMD, the delta angle is signaled to the decoder side. The final angle intra mode is the angle intra mode derived from DIMD plus the delta angle. In one embodiment, the encoder side can use the original samples to estimate the best angle intra mode. In order to reduce the mode signaling overhead, DIMD is applied to implicitly derive the angle intra mode, and then the delta angle between the best angle intra mode and the intra mode derived from DIMD is signaled to the decoder side. The delta angle may include the syntax of the delta angle size and the syntax of the delta angle sign. The final angle intra mode at the decoder side is the angle intra mode derived from DIMD plus the delta angle. Please note that the coded binary string required for sending the amplitude and sign of the delta angle is smaller than the coded binary string required for sending the final angle intra mode signal (e.g., the intra_luma_mpm_remainder syntax in H.266 / VVC or the rem_intra_luma_pred_mode syntax in H.265 / HEVC).
[0127] In order to simplify the DIMD process, the HoG calculation is from partially selected adjacent window positions to reduce the required calculations. For one embodiment, it can select the upper middle, upper right, middle left, and lower left adjacent window positions to apply the Sobel filter to construct the HoG. Alternatively, it can select even or odd adjacent window positions to apply the Sobel filter to construct the HoG. For another embodiment, the angle mode is by applying the Sobel filter to the window position selected above (for example, the adjacent window position above covers 0,..., 2×current block width, or 0,..., current block width + current block height), and another angle mode is by applying the Sobel filter to the window position selected on the left (for example, the adjacent position on the left covers 0,..., 2×current block height, or 0,..., current block width + current block height), then no HoG calculation is required.
[0128] In another embodiment, in order to improve the encoding and decoding performance of DIMD, DIMD prediction is applied to the chroma CU to implicitly derive the frame angle intra mode. In one embodiment, if the candidate intra chroma modes are DC, vertical, horizontal, planar, and DM, DIMD prediction is applied to derive the final intra angle mode. In another embodiment, a flag is used to indicate whether DIMD is used to derive the final angle intra mode. If the flag is true, DIMD implicitly derives the final angle intra mode and excludes DC, vertical, horizontal, planar, and DM modes from the candidate intra mode list.
[0129] In another embodiment, after the angular intra mode is derived by DIMD, a fine search can be performed around the derived angular intra mode. In one embodiment, DIMD derives the angular intra mode from modes 0 to 66. Assuming that angular intra mode k is derived, the encoder side can insert more angular intra modes between (k-1) and (k+1) for searching, and use a signal to indicate the incremental value of the final intra prediction angle mode.
[0130] In another embodiment, when deriving the angular intra mode through DIMD, the gradients of adjacent inter-coded positions may be excluded or reduced when calculating the gradient histogram, or the cost between the prediction and reconstruction of the inter-coded template may be increased.
[0131] In order to reduce the comparisons required in DIMD, the candidate angular intra modes in DIMD may depend on the block size or prediction mode of the adjacent blocks. In one embodiment, the number of candidate angular intra modes for small CUs in DIMD (e.g., CU width + height or CU area is less than a threshold) is less than the number of candidate angular intra modes in DIMD for large CUs. For example, the number of angular intra mode candidates for small CUs in DIMD is 34, and the number of angular intra mode candidates for large CUs in DIMD is 67. In another embodiment, the candidate angular intra modes in DIMD may be further constrained or reduced to a predefined range. For example, if the current angular intra mode can support up to 67 modes (i.e., 0, 1, 2, 3, ..., 66), it may limit the candidate angular intra modes in DIMD to a subset of these 67 modes (i.e., candidate mode number <67). The restricted candidates can be {0,1,2,4,6,8,…,66}, {0,1,3,5,7,9,…,65}, {0,1,2,3,4,5,…,34}, {34,35,36,37,38,…,66}. Such constraints (e.g., which subsets are selected) can be signaled in PPS (picture parameter set), SPS (sequence parameter set), picture header, slice header, CTU level syntax, or implicitly derived from other syntax, or always applied. For another example, if the constraints are signaled, the CU encoded with DIMD only uses fewer candidate angular intra modes to derive the final angular intra mode. In another embodiment, the candidate angular intra modes in DIMD can be further constrained by the prediction modes of neighboring blocks. For example, if the top neighboring CU is inter-coded in skip mode, angle intra modes greater than the diagonal angle intra mode (e.g., mode 66 in 131 angle intra modes, mode 34 in 67 angle intra modes, mode 18 in 34 angle intra modes) are excluded from the candidate angle intra modes of DIMD. If the left neighboring CU is inter-coded in skip mode, angle intra modes less than the diagonal angle intra mode (e.g., mode 66 in 131 angle intra modes, mode 34 in 67 angle intra modes, mode 18 in 34 angle intra modes) are excluded from the candidate angle intra modes of DIMD.
[0132] The number of neighboring rows for computing HoG in DIMD can be signaled in PPS, SPS, picture header, slice header, CTU level syntax, or derived implicitly from other syntaxes. For example, when the current block size is smaller or larger than a threshold, it can use more neighboring rows to compute HoG in DIMD.
[0133] After generating the angular intra mode prediction by DIMD, the intra prediction is further refined by the gradient of the neighboring reconstructed samples. In one embodiment, the intra prediction is refined by the gradient of the neighboring reconstructed samples. For example, Fig.13 As shown, for the current block 1310, if the current intra prediction comes from the left adjacent reconstructed sample 1330, the current prediction at (x, y) is obtained by the upper left corner sample (e.g., R -1,-1 ) and the current left neighboring sample (e.g., R -1,y ) is further refined. Then, the refined prediction at (x, y) is (w1×(R x,-1 +(R -1,-1 -R -1,y ))+w2×pred(x,y)) / (w1+w2). For another example, if the current intra prediction comes from the upper neighboring reconstructed sample 1320, the current prediction at (x,y) is obtained by the upper left corner sample (eg, R -1,-1 ) and the adjacent sample above the current one (e.g., R x,-1 ) is further refined. Then, the refined prediction at (x, y) is w1×(R -1,y +(R -1,-1 -R x,-1 ))+w2×pred(x,y)) / (w1+w2).
[0134] When the current block is a narrow block (such as width << height) or a wide block (such as width >> height), the horizontal and vertical Sobel filters are replaced with the following two matrices for mapping to support the wide-angle intra mode.
[0135] or
[0136]
[0137] If the image's angular intra mode is greater than 135 (e.g., mode 66) or less than -45 (e.g., mode 2), the image's angular intra mode is converted to the intra mode of the other side. For example, if the image's angular intra mode is greater than mode 66, the converted intra prediction mode is equal to (image's angular intra mode - 65). For another example, if the image's angular intra mode is less than mode 2, the converted intra prediction mode is equal to (image's angular intra mode + 67).
[0138] Any of the above-mentioned improved DIMD methods can be implemented in an encoder and / or a decoder. For example, any of the above-mentioned improved DIMD methods can be implemented in an intra prediction module (e.g. Figure 1A Intra-frame prediction 110 in the example) and / or an intra-frame prediction module (e.g. Figure 1BThe method is implemented in the intra prediction 150 of the decoder in the encoder. However, the encoder or decoder can also use additional processing units to implement the required processing. Alternatively, any of the proposed methods can be implemented as a circuit coupled to the inter / intra / prediction module of the encoder and / or the inter / intra / prediction module of the decoder to provide the information required by the inter / intra / prediction module.
[0139] Fig.14 A flow chart of an exemplary video encoding system for deriving DIMD (decoder-side intra mode derivation) candidates using a subset of angular intra prediction modes according to an embodiment of the present invention is illustrated. According to the method, in step 1410, pixel data associated with a current block is received at the encoder side or encoded data associated with a current block to be decoded at the decoder side. In step 1420, a selected set of angular intra prediction candidate modes is determined, corresponding to a subset of a set of initial angular intra prediction modes for the current block, wherein the selected set of angular intra prediction candidate modes depends on the block size of the current block or the prediction mode of a neighboring block of the current block. In step 1430, one or more target DIMD candidates are determined from the selected set of angular intra prediction candidate modes for the current block based on a DIMD process using statistics or histograms of an angular field derived from a template of the current block. In step 1440, a final intra predictor is generated based on information including the one or more target DIMD candidates. In step 1450, the current block is encoded or decoded using the final intra predictor.
[0140] Fig.15 A flow chart of an exemplary video codec system for deriving DIMD candidates according to an embodiment of the present invention is illustrated, wherein an incremental angle between a final intra-frame prediction mode and a DIMD derived mode is signaled or parsed. According to the method, pixel data associated with a current block or encoded data associated with a current block to be decoded is received on the encoder side in step 1510. In step 1520, an initial intra-frame prediction mode derived using DIMD is determined. In step 1530, one or more syntaxes associated with the incremental angle are signaled or parsed from a bitstream. In step 1540, the current block is encoded or decoded using the final intra-frame prediction mode, wherein the incremental angle corresponds to the difference between the final intra-frame prediction mode and the initial intra-frame prediction mode.
[0141] Fig.16A flow chart of an exemplary video codec system according to an embodiment of the present invention is illustrated, which uses a process including comparing the gradient magnitude of a gradient filtering result with a threshold value to derive a DIMD candidate. According to the method, in step 1610, pixel data associated with a current block is received on the encoder side or encoded data associated with a current block to be decoded on the decoder side. In step 1620, one or more gradient filters are applied to a template of the current block to generate a gradient filtering result. In step 1630, a DIMD candidate mode is determined by comparing the gradient magnitude of the gradient filtering result with a threshold value. In step 1640, a final intra-frame predictor is generated based on information containing the DIMD candidate mode. In step 1650, the current block is encoded or decoded using the final intra-frame predictor.
[0142] The flowchart shown is intended to illustrate an example of video encoding according to the present invention. Without departing from the spirit of the present invention, those skilled in the art may modify each step, rearrange the steps, split the steps, or combine the steps to implement the present invention. In the present disclosure, specific syntax and semantics have been used to illustrate examples to implement embodiments of the present invention. Without departing from the spirit of the present invention, those skilled in the art may implement the present invention by replacing syntax and semantics with equivalent syntax and semantics.
[0143] The above description is provided to enable those of ordinary skill in the art to practice the present invention provided in the context of a specific application and its requirements. Various modifications to the described embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the specific embodiments shown and described, but to conform to the widest scope consistent with the principles and novel features disclosed herein. In the above detailed description, various specific details are illustrated to provide a thorough understanding of the present invention. However, those skilled in the art will appreciate that the present invention may be implemented.
[0144] The embodiments of the present invention as described above can be implemented in various hardware, software codes or a combination of the two. For example, one embodiment of the present invention can be one or more circuits integrated into a video compression chip or a program code integrated into the video compression software to perform the processing described herein. The embodiments of the present invention can also be a program code to be executed on a digital signal processor (DSP) to perform the processing described herein. The present invention can also be related to many functions performed by a computer processor, a digital signal processor, a microprocessor or a field programmable gate array (FPGA). These processors can be configured to perform specific tasks according to the present invention by executing machine-readable software codes or firmware codes that define the specific methods embodied by the present invention. The software code or firmware code can be developed in different programming languages and different formats or styles. The software code can also be compiled for different target platforms. However, the different code formats, styles and languages of the software code and other ways of configuring the code to perform tasks according to the present invention will not depart from the spirit and scope of the present invention.
[0145] The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples should be considered in all respects as illustrative and not restrictive. Therefore, the scope of the present invention is indicated by the appended claims rather than by the foregoing description. All changes that fall within the meaning and scope of equivalents of the claims should be included within their scope.
Claims
1. A video encoding and decoding method, the method comprising: Receiving pixel data associated with the current block at an encoding end or receiving encoded data associated with the current block to be decoded at a decoding end; determining a selected angular intra prediction candidate mode set corresponding to a subset of an initial angular intra prediction mode set for the current block, wherein the selected angular intra prediction candidate mode set depends on a block size of the current block or a prediction mode of a neighboring block of the current block; determining one or more target DIMD candidates from the selected set of angular intra prediction candidate modes for the current block based on a decoder-side intra mode derivation (DIMD) process using statistics or histograms of angular fields derived from a template of the current block; generating a final intra predictor based on information including the one or more target DIMD candidates; as well as The current block is encoded or decoded using the final intra predictor.
2. The method according to claim 1, wherein: For a smaller block size of the current block, the number of angular intra prediction candidate modes in the selected angular intra prediction candidate mode set is determined to be smaller.
3. The method according to claim 1, wherein: The block size of the current block corresponds to the sum of a block width and a block height of the current block. 4 . The method of claim 1 , wherein the selected set of angular intra prediction candidate modes corresponds to a set of predefined angular intra prediction modes for the current block.
5. The method according to claim 1, wherein: The selected set of angular intra prediction candidate modes corresponds to a restricted candidate set.
6. The method according to claim 5, wherein: The restricted candidate set corresponds to a member of an even intra prediction mode, an odd intra prediction mode, a first half set of an initial set of angular intra prediction modes, or a second half set of an initial set of angular intra prediction modes.
7. The method of claim 6, signaling or parsing syntax to indicate the members of the set corresponding to the restricted candidate set for the current block.
8. The method according to claim 5, wherein: The syntax related to the restricted candidate set is signaled or parsed from the picture parameter set (PPS), sequence parameter set (SPS), picture header, slice header, or CTU level syntax.
9. The method according to claim 5, wherein: The grammar associated with the restricted candidate set is derived implicitly based on other grammars.
10. The method of claim 5, wherein a restricted candidate set is always used.
11. The method of claim 1, wherein if a top neighboring codec unit (CU) is inter-coded in skip mode, the selected set of angular intra prediction candidate modes excludes angular intra prediction candidate modes having mode numbers greater than diagonal intra angular mode.
12. The method of claim 1, wherein if the left neighboring CU is inter-coded in skip mode, the selected angular intra prediction candidate mode set excludes angular intra prediction candidate modes having mode numbers smaller than the diagonal intra angular mode.
13. An apparatus for video encoding and decoding, the apparatus comprising one or more electronic devices or processors, arranged to: Receiving pixel data associated with the current block at the encoding end or receiving encoded data associated with the current block to be decoded at the decoding end; determining a selected angular intra prediction candidate mode set corresponding to a subset of an initial angular intra prediction mode set for the current block, wherein the selected angular intra prediction candidate mode set depends on a block size of the current block or a prediction mode of a neighboring block of the current block; determining one or more target DIMD candidates from a selected set of angular intra prediction candidate modes for the current block based on a DIMD process using statistics or histograms of an angular field derived from a template for the current block; generating a final intra predictor based on information including the one or more target DIMD candidates; as well as The current block is encoded or decoded using the final intra predictor.
14. A video encoding and decoding method, the method comprising: Receiving pixel data associated with the current block at the encoding end or receiving encoded data associated with the current block to be decoded at the decoding end; Determine an initial intra prediction mode derived using DIMD; signaling one or more syntaxes associated with the delta angle in a bitstream or parsing the one or more syntaxes associated with the delta angle from a bitstream; and The current block is encoded or decoded using a final intra prediction mode, wherein the delta angle corresponds to a difference between the final intra prediction mode and the initial intra prediction mode.
15. The method of claim 14, wherein the one or more syntaxes include a first syntax associated with a magnitude of the increment angle and a second syntax associated with a sign of the increment angle.
16. An apparatus for video encoding and decoding, the apparatus comprising one or more electronic devices or processors, arranged to: Receiving pixel data associated with a current block at an encoding end or receiving encoded data associated with said current block to be decoded at a decoding end; Determine an initial intra prediction mode derived using DIMD; signaling one or more syntaxes associated with the increment angle in a bitstream or parsing the one or more syntaxes associated with the increment angle from a bitstream; and The current block is encoded or decoded using a final intra prediction mode, wherein the delta angle corresponds to a difference between the final intra prediction mode and the initial intra prediction mode.
17. A video encoding and decoding method, the method comprising: Receiving pixel data associated with the current block at the encoding end or receiving encoded data associated with the current block to be decoded at the decoding end; Applying one or more gradient filters to the template of the current block to generate a gradient filtering result; determining a DIMD candidate mode using a process including comparing a gradient magnitude of a gradient filtering result to a threshold value; generating a final intra-frame predictor based on information including DIMD candidate modes; as well as The current block is encoded or decoded using the final intra predictor.
18. The method according to claim 17, wherein: The threshold depends on the block size of the current block.
19. The method of claim 17, wherein if all gradient magnitudes are less than a threshold, the DIMD candidate mode is set to a planar mode.
20. The method of claim 17, wherein a target candidate intra angle mode having a maximum gradient magnitude in DIMD is set as a current intra prediction mode.
21. An apparatus for video encoding, the apparatus comprising one or more electronic devices or processors arranged to: Receiving pixel data associated with a current block at an encoding end or receiving coded data associated with a current block to be decoded at a decoding end; Applying one or more gradient filters to the template of the current block to generate a gradient filtering result; determining a DIMD candidate mode using a process including comparing a gradient magnitude of a gradient filtering result to a threshold value; generating a final intra-frame predictor based on information including DIMD candidate modes; as well as The current block is encoded or decoded using the final intra predictor.
Citation Information
Cited By
Processing method, processing device and storage medium
WO2026001799A3
Processing method, processing device and storage medium
WO2026001800A3
Encoding and decoding methods, encoder, decoder, and storage medium
WO2026137128A1
