Direction for wide-angle intra prediction

By adjusting the prediction direction to align it along the subdiagonal line of the block and adapting the aspect ratio of different block shapes, the existing wide-angle intra prediction is solved, and the prediction accuracy and compression efficiency are improved. Suitable for a variety of rectangular block shapes.

CN112823522BActive Publication Date: 2024-12-06INTERDIGITAL VC HOLDINGS INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980065245.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-10-01
Filing Date
2019-09-25
Publication Date
2024-12-06
Estimated Expiration
2039-09-25

AI Technical Summary

Technical Problem

The existing wide-angle intra prediction designs have problems with inefficiency in the shape of rectangular blocks, especially when the number of wide-angle directions is limited, resulting in inaccurate reference array length, affecting prediction accuracy and compression efficiency.

Method used

By adjusting the prediction direction, align it along the subdiagonal line of the block, and adapting the aspect ratio of different block shapes, the number of prediction directions is increased or decreased to support all rectangular block shapes, especially the aspect ratio is 8:1, 16 Blocks of :1 and 32:1, make sure that the reference array length is twice the length of the corresponding side of the block, avoiding redundant samples.

Benefits of technology

Improves prediction accuracy and compression efficiency, eliminates suboptimality in the current design, and ensures accuracy of reference array lengths, suitable for all rectangular block shapes, including blocks up to 32:1 aspect ratio.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112823522B_ABST
    Figure CN112823522B_ABST
Patent Text Reader

Abstract

Methods and apparatus for using wide-angle intra prediction for rectangular blocks enable larger prediction angles. Wide-angle intra prediction enables intra prediction direction angles to exceed the conventional 45 and -135 degrees. In one embodiment, when the video block to be coded or decoded is non-square, additional intra prediction directions are enabled in the direction of the longer block edge, and more reference samples are available along the edge. An index is used to indicate the prediction direction and can be adjusted based on the additional intra prediction in the longer direction, with correspondingly fewer prediction directions along the shorter block edges. This maintains the number of prediction modes that need to be indexed, but allows their angles to correspond to the shape of the block.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] At least one embodiment of the invention is generally directed to a method or apparatus for video encoding or decoding, compression or decompression. Background Art

[0002] To achieve high compression efficiency, image and video coding schemes typically employ prediction (including motion vector prediction), as well as transforms to exploit spatial and temporal redundancy in video content. Typically, intra-frame or inter-frame prediction is used to exploit intra-frame or inter-frame correlations, and then the difference between the original image and the predicted image, which is usually represented as a prediction error or prediction residual, is transformed, quantized, and entropy decoded. To reconstruct the video, the compressed data is decoded by the inverse processes corresponding to entropy decoding, quantization, transform, and prediction.

[0003] In the development of the Versatile Video Coding (VVC) standard, an increased number of intra decoding modes were adopted. Summary of the invention

[0004] Embodiments of the present invention generally relate to a method and apparatus for video encoding or decoding, and more particularly to a method and apparatus for interaction between a maximum transform size and a transform decoding tool in a video encoder or a video decoder.

[0005] According to a first aspect, a method is provided. The method comprises the steps of predicting samples of a rectangular video block using at least one of N reference samples from a row above the rectangular video block or at least one of M reference samples from a column to the left of the rectangular video block, wherein the reference samples are based on a number of wide angles, the number of wide angles increasing in proportion to an aspect ratio of the rectangular block; and encoding the rectangular video block using the prediction in an intra-coding mode.

[0006] According to a second aspect, a method is provided. The method comprises the steps of predicting samples of a rectangular video block using at least one of N reference samples from a row above the rectangular video block or at least one of M reference samples from a column to the left of the rectangular video block, wherein the reference samples are based on a number of wide angles, the number of wide angles increasing in proportion to an aspect ratio of the rectangular block; and decoding the rectangular video block using the prediction in an intra-coding mode.

[0007] According to another aspect, a device is provided. The device includes a processor. The processor can be configured to encode a block of a video or decode a bitstream by performing any of the above methods.

[0008] According to another general aspect of at least one embodiment, there is provided an apparatus comprising an apparatus according to any of the decoding embodiments; and at least one of: (i) an antenna configured to receive a signal comprising a video block, (ii) a band limiter configured to limit the received signal to a frequency band comprising the video block, or (iii) a display configured to display an output representing the video block.

[0009] According to another general aspect of at least one embodiment, a non-transitory computer-readable medium is provided that contains data content generated according to any of the described encoding embodiments or variations.

[0010] According to another general aspect of at least one embodiment, there is provided a signal comprising video data generated according to any of the described encoding embodiments or variations.

[0011] According to another general aspect of at least one embodiment, a bitstream is formatted to include data content generated according to any of the described encoding embodiments or variations.

[0012] According to another general aspect of at least one embodiment, there is provided a computer program product comprising instructions which, when executed by a computer, cause the computer to perform any of the described decoding embodiments or variations.

[0013] These and other aspects, features and advantages of the general aspects will become apparent from the following detailed description of illustrative embodiments which is to be read in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 Wide-angle prediction directions are shown, where (a) modes 35 and 36 replace modes 2 and 3, respectively, and (b) 65 directions are used, with angles labeled from 02 to 66.

[0015] Figure 2 The following examples are shown: (a) a block with W=2H, where the starting angle is slightly below the sub-diagonal and the ending angle is slightly above the sub-diagonal, and (b) a left reference array that requires a small extension.

[0016] Figure 3 Examples are shown of blocks with H=2W, and (a) starting angle slightly above the sub-diagonal and ending angle slightly below the sub-diagonal, and (b) a reference array on top requiring a small extension.

[0017] Figure 4 A standard, common video compression scheme is shown.

[0018] Figure 5A standard, common video decompression scheme is shown.

[0019] Figure 6 An exemplary processor-based subsystem is shown for implementing the generally described aspects.

[0020] Figure 7 An embodiment of a method according to the described aspects is shown.

[0021] Figure 8 A further embodiment of a method according to the described aspects is shown.

[0022] Fig. 9 Example apparatus according to the described aspects is shown. DETAILED DESCRIPTION

[0023] The embodiments described herein belong to the field of video compression and generally relate to video compression and video encoding and decoding. At least one embodiment of the invention more specifically relates to video encoding and decoding related to transform coding of intra prediction residuals, wherein enhanced multiple transforms and / or auxiliary transforms are used in conjunction with wide-angle intra prediction.

[0024] To achieve high compression efficiency, image and video coding schemes typically employ prediction (including motion vector prediction) and transforms to exploit spatial and temporal redundancy in video content. Typically, intra-frame or inter-frame prediction is used to exploit intra-frame or inter-frame correlations, and then the difference between the original image and the predicted image, which is typically represented as a prediction error or prediction residual, is transformed, quantized, and entropy decoded. To reconstruct the video, the compressed data is decoded by the inverse processes corresponding to entropy decoding, quantization, transform, and prediction.

[0025] In the HEVC (High Efficiency Video Coding, ISO / IEC 23008-2, ITU-T H.265) video compression standard, motion compensated temporal prediction is used to exploit the redundancy existing between consecutive pictures in a video.

[0026] To do this, a motion vector is associated with each prediction unit (PU). Each coding tree unit (CTU) is represented by a coding tree in the compressed domain. This is a quadtree partitioning of the CTU, where each leaf is called a coding unit (CU).

[0027] Each CU is then given some intra or inter prediction parameters (prediction information). To do this, it is spatially split into one or more prediction units (PUs), each of which is assigned some prediction information. Intra or inter coding modes are assigned on a CU level.

[0028] In the JVET (Joint Video Exploration Team) proposal for a new video compression standard, called the Joint Exploration Model (JEM), it has been proposed to accept a quadtree-binary tree (QTBT) block partitioning structure due to high compression performance. A block in a binary tree (BT) can be split into two sub-blocks of equal size by splitting it horizontally or vertically in the middle. Therefore, a BT block can have a rectangular shape with unequal width and height, unlike a block in QT, which always has a square shape with equal height and width. In HEVC, the angular intra prediction directions are defined from 45° to -135° over a 180° angle, and they have been maintained in JEM, which has made the definition of the angular direction independent of the target block shape.

[0029] To encode these blocks, intra prediction is used to provide an estimated version of the block using previously reconstructed neighboring samples. The difference between the source block and the prediction is then encoded. In the classical codecs described above, a single row of reference samples is used to the left and top of the current block.

[0030] In HEVC (High Efficiency Video Coding, H.265), the encoding of frames of a video sequence is based on a quadtree (QT) block partitioning structure. Frames are divided into square coding tree units (CTUs), all of which undergo quadtree-based partitioning into multiple coding units (CUs) based on the rate-distortion (RD) criterion. Each CU is intra-predicted, that is, it is spatially predicted from causally adjacent CUs, or inter-predicted, that is, it is temporally predicted from a decoded reference frame. In I slices, all CUs are intra-predicted, while in P and B slices, CUs can be intra- or inter-predicted. For intra prediction, HEVC defines 35 prediction modes, which include one plane mode (indexed as mode 0), one DC mode (indexed as mode 1), and 33 angular modes (indexed as modes 2 to 34). The angular modes are associated with prediction directions ranging from 45 degrees to -135 degrees in the clockwise direction. Since HEVC supports a quadtree (QT) block partitioning structure, all prediction units (PUs) have a square shape. Therefore, from the perspective of the PU (prediction unit) shape, the definition of prediction angles from 45 degrees to -135 degrees is reasonable. For a target prediction unit of size N×N pixels, the top reference array and the left reference array each have a size of 2N+1 samples, which is required to cover the above angle range of all target pixels. Considering that the height and width of the PU have equal lengths, it also makes sense that the lengths of the two reference arrays are equal.

[0031] For the next video coding standard, JVET, as an attempt of the Joint Exploration Model (JEM), proposes to use 65 angle intra prediction modes in addition to the planar mode and DC mode. However, the prediction direction is defined within the same angle range, i.e., from 45 degrees to -135 degrees in the clockwise direction. For a target block of size WXH pixels, the top reference array and the left reference array each have a pixel size of (W+H+1), which is required to be the aforementioned angle range covering all target pixels. This definition of the angle in JEM is for simplicity rather than for any other specific reason. However, doing so introduces some inefficiencies. In recent work, wide-angle intra prediction is proposed, which enables the intra prediction direction angle to be higher than the traditional 45 degrees.

[0032] Figure 1 Here, modes 35 and 36 replace modes 2 and 3(a), respectively. Figure 1 In (b), the arrows point to the opposite direction associated with any mode. Note that on this figure, the angles are labeled from 02 to 34, which corresponds to the angle names before 65 prediction directions were adopted in the VVC software. Now, for 65 directions (b), the angles are labeled from 02 to 66.

[0033] Wide-angle intra prediction (WAIP) has been adopted for the upcoming Versatile Video Compression (VVC) standard, also known as H.266. WAIP refers to the use of additional prediction directions beyond the usual 45 and -135 degree range used in intra prediction. When the target block is rectangular, some regular prediction directions are replaced by an equal number of wide-angle directions in the opposite direction, depending on the block shape. In VVC / H.266, up to 10 wide-angle directions can be used, which results in 20 wide-angle directions beyond the usual 45 to -135 degree range of prediction directions. To support these wide-angle directions, the reference array length is appropriately defined.

[0034] One problem with the adopted WAIP is that the defined wide angles are derived from existing regular angles. The regular angles are optimized for square block shapes, but not for rectangular blocks. As a result, the defined angles of the rectangular blocks are not aligned along the diagonal directions. Depending on the shape of the rectangular block, the diagonals may be offset from these directions by some small amount. This poses a problem in that the required length of the reference array is not exactly twice the length of the corresponding side of the block. On the smaller side of the block, the reference array is longer than twice the length of that side. The length of the small extension is a function of the shape of the block. Furthermore, if the number of wide angle directions is limited to 10, as adopted in VVC / H.266 [1], the length of the extension can be very large for rectangular blocks with aspect ratios of 8, 16, and 32. In this disclosure, we provide several methods so that when the number of wide angles is not limited to 10, no extension on the smaller side is required.

[0035] The general aspects described propose several methods to unify the design of intra prediction directions for square and rectangular blocks. The purpose is to use angles that are suitable for the shape of rectangular blocks, rather than simply using angles derived from the case of square blocks. The range of prediction directions is therefore precisely spread over the secondary diagonal of the target block. This design requires that the length of the reference arrays on the top and left is exactly twice the length of the corresponding side of the target block. Therefore, assuming that the number of wide angles is extended from 20 to 28 (14 on each side), the small extension required on the smaller side is not required. This makes it consistent with intra prediction without utilizing WAIP, where the total number of reference samples on the top and left is equal to twice the sum of the height and width of the target block. If the number of wide angles is limited to 10, as adopted in VVC / H.266, rectangular blocks with aspect ratios of 8:1, 16:1, and 32:1 will still need extensions on the smaller side of the reference to support the defined prediction directions.

[0036] Wide-angle intra prediction (WAIP) has been adopted for the upcoming Versatile Video Compression (VVC) standard, also known as H.266. WAIP refers to the use of additional prediction directions beyond the usual 45 and -135 degree range used in intra prediction. When the target block is rectangular, some of the regular prediction directions are replaced by an equal number of wide-angle directions in the opposite direction, depending on the block shape. Thus, when the target block is flat, i.e. its width is greater than its height, some horizontal directions close to 45 degrees are replaced by an equal number of vertical directions exceeding -135 degrees. Similarly, when the target block is tall, i.e. its height is greater than its width, vertical directions close to -135° are replaced by horizontal directions exceeding 45°. This is useful in Figure 1 , where 35 angle modes are used, as in the initial version of VVC (and also in HEVC). In the current version of VVC, the number of angle modes between 45 and -135 degrees has been increased to 65. Note that in Figure 1 , the arrows point in the opposite direction associated with any mode.

[0037] In VVC / H.266, up to 10 wide angle directions can be used, which results in 20 wide angle directions exceeding the usual 45 to -135 degree range of the prediction direction. Therefore, the total number of angle modes used is 85 (= 65 + 20), of which only 65 are used for any given target block. If the target block is a square, the regular 65 modes between 45 and -135 degrees are used for prediction.

[0038] There are two problems with the current WAIP specification. The first problem is caused by the fact that the defined wide angles are derived from existing angles that are optimized for square block shapes. As a result, the predicted angles for any rectangular block are not optimized with respect to the length of the reference array in the same sense that the original angles were for square blocks. This is not the case in Figure 2 and Figure 3 Shown in.

[0039] exist Figure 2 In the example of , W = 2H. In (a), for the flat block, the starting angle (normal) is slightly below the sub-diagonal, and the ending angle (wide angle) is slightly above the sub-diagonal. In (b), the reference array on the left requires a small extension (shown as Ext).

[0040] exist Figure 3 In the example of , H = 2W. In (a), for tall blocks, the starting angle (wide angle) is slightly above the sub-diagonal, and the ending angle (regular) is slightly below the sub-diagonal. In (b), the top reference array requires a small extension (shown as Ext).

[0041] The starting and ending angles of the rectangular blocks are offset from the secondary diagonal by a small amount. For a flat rectangular block, the starting angle has intraPredAngle (also called angle parameter A) equal to (32*H / W)+1, and the ending angle corresponds to the opposite angle with intraPredAngle equal to round(1024 / ((32*H / W)+1)). Similarly, in the case of a tall rectangular block, the ending angle has intraPredAngle equal to (32*W / H)+1*, and the starting angle corresponds to the opposite angle with intraPredAngle equal to round(1024 / ((32*W / H)+1)). Due to this small offset from the secondary diagonal, the length of the reference array on the shorter side of the target block (without the upper left corner reference sample) is slightly more than twice the length of that side. At the same time, the reference array on the longer side (whose length (without the upper left corner reference sample) is twice that of the side of the block) contains several redundant samples close to the end of the array, because those samples are never used for any prediction mode. This makes the design of the defined prediction angles not optimal.

[0042] The second problem with the current WAIP specification is caused by limiting the number of wide angles to 10 on each side (i.e., more than 10 angles beyond the standard angle). This number is optimal for a target rectangular block with an aspect ratio (ratio of long side to short side) equal to 4:1. For such a block, the start and end angles are close to the sub-diagonal, as described above. However, the current VVC standard also supports rectangular blocks with aspect ratios of 8:1, 16:1, and 32:1. In these cases, the start and end angles deviate significantly from the sub-diagonal, which in turn requires a much larger extension of the shorter reference array (more than twice the side length), and also causes redundancy of the longer reference array that is not used for any prediction mode by a larger number of samples at the end. Therefore, it is proposed to expand the number of wide angles to 14 on each side, which will support all rectangular blocks, up to rectangular blocks with an aspect ratio of 32:1. This will be described in detail in a later text.

[0043] The basic idea behind wide-angle prediction is to adapt the prediction directions according to the block shape while keeping the total number of prediction modes the same. This is done by adding some prediction directions on the larger side of the block and reducing them on the shorter side. The overall goal is to improve the prediction accuracy, resulting in higher compression efficiency. Since the newly introduced directions are beyond the usual range of 180 degrees from 45 degrees to -135 degrees, they are called wide-angle directions.

[0044] In this disclosure, we will assume 65 intra-frame prediction modes for the target block, which have been adopted by the current VVC standard. When the target block is square, wide angle does not work because the definition pattern of the block remains unchanged. When the target block is flat, that is, its width W is greater than its height H, some modes close to 45 degrees are removed, and an equal number of wide-angle modes exceeding -135 degrees are added. The added directions are indexed as prediction modes 67, 68, ..., etc. Similarly, when the target block is taller, some modes close to -135 degrees are removed, and an equal number of wide-angle modes exceeding 45 degrees are added. The added directions are indexed as prediction modes -1, -2, ..., etc. Because prediction modes 0 and 1 are reserved for planar prediction and DC prediction. Table 1 shows the number of normal modes replaced by wide-angle modes for different block shapes. We call this parameter modeShift.

[0045] W / H Prediction Model modeShift 1 0:66 0 2 0,1,8:72 6 4 0,1,12:76 10 8 0,1,12:76 10 16 0,1,12:76 10 32 0,1,12:76 10 1 / 2 -6:60 6 1 / 4 -10:56 10 1 / 8 -10:56 10 1 / 16 -10:56 10 1 / 32 -10:56 10

[0046] Table 1: Prediction modes and modeShift for different block shapes. Prediction modes #0 and #1 refer to the usual planar prediction and DC prediction. The remaining modes are angular. modeShift refers to the number of normal modes replaced by wide-angle modes. W / H=1 refers to square blocks.

[0047] For any target block, the mapping from the replaced normal mode to the wide-angle mode is performed as follows:

[0048] modeShift=(Min(2,Abs(Log2(W / H)))<<2)+2;

[0049] if W>H and 1 <predMode<2+modeShift

[0050] predMode = predMode + 65;

[0051] else if H>W and(66–modeShift) <predMode<=66

[0052] predMode = predMode - 67;

[0053] It is obvious that if we look at the predicted directions in clockwise direction (see Table 1), for flat rectangular blocks, the directions start with the regular mode and end with the wide mode. On the other hand, for tall rectangular blocks, the directions start with the wide mode but end with the regular mode.

[0054] The wide angle angle parameter (intraPredAngle) is derived from the replaced regular mode angle parameter as follows:

[0055] If W>H, and A n represents the value of intraPredAngle of the replaced mode #n, then the replaced wide-angle mode has intraPredAngle equal to Among them A n+1 Indicates mode #(n+1). Similarly, if H>W, and A n represents the value of intraPredAngle of the replaced mode #n, then the replaced wide-angle mode has intraPredAngle equal to Among them A n-1 represents the intraPredAngle of mode #(n-1). As an example, Table 2 shows the intraPredAngle value for W / H=4.

[0056] Replaced mode 2 3 4 5 6 7 8 9 10 11 intraPredAngle 32 29 26 23 21 19 17 15 13 11 Replace Mode 67 68 69 70 71 72 73 74 75 76 intraPredAngle 35 39 45 49 54 60 68 79 93 114

[0057] Table 2: Alternative modes and corresponding wide-angle modes for W / H=4 (flat block) and their angular parameter values

[0058] As another example, Table 3 shows intraPredAngle values ​​where W / H=1 / 4.

[0059] Replaced mode 57 58 59 60 61 62 63 64 65 66 intraPredAngle 11 13 15 17 19 21 23 26 29 32 Replace Mode -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 intraPredAngle 114 93 79 68 60 54 49 45 39 35

[0060] Table 3: Replaced modes and corresponding wide-angle modes for W / H=1 / 4 (high block) and their angle parameter values

[0061] In both cases, the inverse angle parameter invAngle of the new mode is given as round(8192 / intraPredAngle).

[0062] To support wide-angle prediction mode, the lengths of the top and left reference arrays are obtained as follows:

[0063]

[0064] Where whRatio = Min(Abs(Log2(W / H)),2).

[0065] The above algorithm can be equivalently expressed as:

[0066]

[0067]

[0068] From the above determination, it is clear that the shorter reference array length is longer than twice the side length. For example, if W>H, the reference array on the left is longer than 2*H. Similarly, if H>W, the reference array on the top is longer than 2*W. The difference is the sum of two terms arising from two different reasons. The first term is caused by limiting the number of wide angles to 10 (where whRatio has a maximum value equal to 2, which corresponds to W / H>=4 or W / H=1 / 4). For W / H<=4 or W / H<=1 / 4, the first term is equal to zero; but for W / H>4 or W / H<1 / 4), the first term is a non-zero positive value. The second term (represented by the ceiling function) is caused by the fact that the starting angle (for W>H) or the ending angle (for H>W) is not aligned along the secondary diagonal of the block. The embodiments described below present several exemplary methods for eliminating these terms.

[0069] If there is no restriction on the number of wide angles to 10, as in the current VVC standard, the first term can be made zero. The number of wide angles can be increased in proportion to the aspect ratio of the rectangular block. The replaced patterns and the corresponding number of wide angles for different block shapes are given in Table 4 below. It should be noted that a maximum of 14 wide angles on either side (28 wide angles in total) is sufficient to cover all block sizes allowed in the current VVC standard.

[0070] W / H Prediction Model modeShift 1 0:66 0 2 0,1,8:72 6 4 0,1,12:76 10 8 0,1,14:78 12 16 0,1,15:79 13 32 0,1,16:80 14 1 / 2 -6:60 6 1 / 4 -10:56 10 1 / 8 -12:54 12 1 / 16 -13:53 13 1 / 32 -14:52 14

[0071] Table 4: Proposed prediction modes and modeShift for different block shapes. Prediction modes #0 and #1 refer to the usual planar prediction and DC prediction. modeShift refers to the number of modes replaced, or equivalently, the number of wide-angle modes added, for a given block shape.

[0072] The following embodiments present several example methods that are intended to align the start and end prediction directions of a block along the secondary diagonal of the block. The application of these methods will make the second term (in the expression given in the previous section) zero. Any of these methods can be considered as an example embodiment.

[0073] Method 1: Truncation

[0074] In this method, the specified prediction direction remains unchanged. For any target rectangular block, only two extreme directions are aligned with its diagonals.

[0075] For flat blocks, i.e., for W>H, the starting normal mode has the angle parameter intraPredAngle equal to (32*H / W)+1, and the ending wide mode has the angle parameter intraPredAngle equal to round(1024 / ((32*H / W)+1). Similarly, for tall blocks, i.e., for H>W, the ending normal mode has intraPredAngle equal to (32*W / H)+1, and the starting wide mode has intraPredAngle equal to round(1024 / ((32*W / H)+1)). The simplest way to align these directions with the diagonals of the block is to truncate them as follows:

[0076]

[0077]

[0078] These two statements will make the second term zero. Optionally, to align the last (first) wide corner with the minor diagonal of the flat (tall) block, we propose the following change:

[0079]

[0080] In all cases, the inverse angle parameter invAngle is derived as

[0081] invAngle=round(8132 / intraPredAngle).

[0082] As an example, Table 5(a) and Table 5(b) show the intraPredAngle values ​​for the start and end directions for W / H = 2 and W / H = 4, respectively. The red numbers are the changes due to truncation.

[0083] predMode 8 72 intraPredMode (old) 17 60 intraPredMode 16 64

[0084] Table 5(a): Angle parameter values ​​modified by truncation for W / H=2

[0085] predMode 12 76 intraPredMode (old) 9 114 intraPredMode 8 128

[0086] Table 5(b): Angle parameter values ​​modified by truncation for W / H=4

[0087] Similarly, Table 6(a) and Table 6(b) show the intraPredAngle values ​​for the start and end directions of W / H=1 / 2 and W / H=1 / 4, respectively.

[0088] predMode -6 60 intraPredMode (old) 60 17 intraPredMode 64 16

[0089] Table 6(a): Angle parameter values ​​modified by truncation for W / H=1 / 2

[0090] predMode -10 56 intraPredMode (old) 114 9 intraPredMode 128 8

[0091] Table 6(b): Angle parameter values ​​modified by truncation for W / H=1 / 4

[0092] Method 2: Binary Alignment

[0093] In this method, the prediction direction is changed so that the angle parameter set, IntraPredAngle, contains all factors of 32, and accordingly, the wide angles corresponding to them also become multiples of 32. In this process, we replace some existing intraPredAngle values. The new angle parameter set is used for all block shapes, including square blocks. As a variant, the new set can be used only for rectangular blocks. The angle values ​​here are derived under the assumption that the number of wide angles is not limited to 10.

[0094]

[0095] Table 7: Factors to adjust the selected direction to make the angle parameter equal to 32

[0096] Note that since an intraPredAngle value of 2 already exists, the modeShift value is also changed slightly. Also, for aspect ratios up to 16:1, which is the case for VVC / H.266 in the All_INTRA configuration, only 14 wide angles need to be added on either side.

[0097] W / H Pre-set mode modeShift 1 0:66 0 2 0,1,8:72 6 4 0,1,12:76 10 8 0,1,14:78 12 16 0,1,15:79 14 32 0,1,16:80 15 1 / 2 -6:60 6 1 / 4 -10:56 10 1 / 8 -12:54 12 1 / 16 -13:53 14 1 / 32 -14:52 15

[0098] Table 8: Modeshift values ​​for binary alignment of angle parameters

[0099] Method 3: New Direction for All Block Shapes

[0100] Due to the unequal spacing of the angle values, the binary insertion of the angles makes the distribution of the angle values ​​slightly irregular, and we propose to modify the other angle values ​​to make the spacing slightly uniform. Note that there is no unique way to distribute the angles, because a slight change in any one value will lead to almost the same result. As a variation, the new set can be used only for rectangular blocks, while the original values, as in the standard, can be used for square target blocks. As an example, we propose the following angle values.

[0101]

[0102] Table 9(a): Example angle parameter values ​​for WAIP. These values ​​may be used for rectangular blocks only, or for both square and rectangular blocks.

[0103]

[0104] Table 9(b): Example angle parameter values ​​for WAIP These values ​​may be used for rectangular blocks only, or for both square and rectangular blocks.

[0105] For the above example, the ModeShift value also needs to be changed slightly as shown in Table 8.

[0106] Finally, it should also be noted that if the number of wide angles is still limited to 10, as in the VVC / H.266 code, the above method will still make the second term zero. For flat blocks with W / H <= 4 or for tall blocks with W / H <= 1 / 4, the first term will be zero. Therefore, for flat blocks with W / H> 4 or for tall blocks with W / H < 1 / 4, the shorter reference array will still need to be extended by more than twice the length of that side.

[0107] One advantage of the proposed inventions is that they eliminate suboptimalities in current WAIP designs by aligning prediction directions that are appropriate to the block shape. With this optimization, the reference array length (excluding the top left reference sample) only needs to be twice the length of the corresponding side of the block.

[0108] Figure 7One embodiment of a method 700 under the general aspects described herein is shown. The method starts at start block 701 and control proceeds to block 710 for predicting samples of a rectangular video block using at least one of N reference samples from a row above the rectangular video block or at least one of M reference samples from a column to the left of the rectangular video block, wherein the reference samples are based on a number of wide angles that increase in proportion to the aspect ratio of the rectangular block. Control proceeds from block 710 to block 720 to encode the rectangular video block using the prediction in intra coding mode.

[0109] Figure 8 Another embodiment of a method 800 under the general aspects described herein is shown. The method starts at start block 801 and control proceeds to block 810 for predicting samples of a rectangular video block using at least one of N reference samples from a row above the rectangular video block or at least one of M reference samples from a column to the left of the rectangular video block, wherein the reference samples are based on a number of wide angles that increase in proportion to the aspect ratio of the rectangular block. Control proceeds from block 810 to block 820 to decode the rectangular video block using the prediction in intra coding mode.

[0110] Fig. 9 One embodiment of a device 900 for encoding, decoding, compressing or decompressing video data using wide angle intra prediction is shown. The device includes a processor 910 and may be interconnected to a memory 920 through at least one port. Both the processor 910 and the memory 920 may also have one or more additional interconnections to external connections.

[0111] Processor 910 is also configured to insert information in a bitstream or receive information in a bitstream and use any of the described aspects for compression, encoding, or decoding.

[0112] Various aspects are described herein, including tools, features, embodiments, models, methods, etc. Many of these aspects are specifically described, at least to show individual characteristics, and are often described in a manner that may sound limited. However, this is for the purpose of describing clearly and does not limit the application or scope of those aspects. In fact, all different aspects can be combined and interchanged to provide additional aspects. In addition, these aspects can also be combined and interchanged with aspects described in earlier documents.

[0113] The embodiments described and contemplated in this document may be implemented in many different forms. Figure 4 , 5 6 provide some embodiments, but other embodiments are contemplated and are Figure 4 , 5The discussion of 6 does not limit the breadth of implementation. At least one aspect generally relates to video encoding and decoding, and at least one other aspect generally relates to transmitting a generated or encoded bitstream. These and other aspects can be implemented as methods, apparatus, a computer-readable storage medium having stored thereon instructions for encoding or decoding video data according to any of the described methods, and / or a computer-readable storage medium having stored thereon a bitstream generated according to any of the described methods.

[0114] In this application, the terms "reconstruction" and "decoding" are used interchangeably, the terms "pixel" and "sample" are used interchangeably, and the terms "image", "picture" and "frame" are used interchangeably. Usually, but not necessarily, the term "reconstruction" is used on the encoder side, while "decoding" is used on the decoder side.

[0115] Various methods are described herein, and each method includes one or more steps or actions for implementing the described method. Unless a specific order of steps or actions is required for proper operation of the method, the order and / or use of specific steps and / or actions may be modified or combined.

[0116] The various methods and other aspects described herein can be used to modify Figure 4 and Figure 5 Modules of the video encoder 100 and decoder 200 shown in , such as intra prediction, entropy coding and / or decoding modules (160, 360, 145, 330). In addition, aspects of the present invention are not limited to VVC or HEVC, and can be applied to, for example, other standards and recommendations, whether pre-existing or developed in the future, and extensions of any such standards and recommendations (including VVC and HEVC). Unless otherwise specified or technically excluded, the aspects described herein may be used alone or in combination.

[0117] Various numerical values ​​are used in this document, for example, {{1,0}, {3,1}, {1,1}}. The specific values ​​are for example purposes, and the described aspects are not limited to these specific values.

[0118] Figure 4 An encoder 100 is shown. Variations of the encoder 100 are contemplated, but for the sake of clarity, the encoder 100 is described below without describing all contemplated variations.

[0119] Before being encoded, the video sequence may undergo a pre-encoding process (101), for example, applying a color transform to the input color picture (e.g., conversion from RGB 4:4:4 to YCbCr 4:2:0), or performing a remapping of the input picture components in order to obtain a signal distribution that is more resilient to compression (e.g., using histogram equalization of one of the color components). Metadata may be associated with the pre-processing and appended to the bitstream.

[0120] In encoder 100, a picture is encoded by encoder elements as described below. The picture to be encoded is divided (102) and processed in units such as CUs. Each unit is encoded using, for example, intra or inter mode. When the unit is encoded in intra mode, it performs intra prediction (160). In inter mode, motion estimation (175) and compensation (170) are performed. The encoder decides (105) which of intra mode or inter mode to use to encode the unit, and indicates the intra / inter decision by, for example, a prediction mode flag. For example, a prediction residual is calculated by subtracting (110) the predicted block from the original image block.

[0121] The prediction residual is then transformed (125) and quantized (130). The quantized transform coefficients, along with motion vectors and other syntax elements, are entropy coded (145) to output a bitstream. The encoder may skip the transform and apply quantization directly to the untransformed residual signal. The encoder may bypass the transform and quantization, i.e., directly decode the residual without applying a transform or quantization process.

[0122] The encoder decodes the coded block to provide a reference for further prediction. The quantized transform coefficients are dequantized (140) and inverse transformed (150) to decode the prediction residual. The decoded prediction residual and the prediction block are combined (155) and the image block is reconstructed. An in-loop filter (165) is applied to the reconstructed picture to perform, for example, deblocking / SAO (sample adaptive offset) filtering to reduce coding artifacts. The filtered image is stored in a reference picture buffer (180).

[0123] Figure 5 2 shows a block diagram of a video decoder 200. In the decoder 200, a bitstream is decoded by decoder elements as described below. The video decoder 200 generally performs the same Figure 4 The encoding pass described in is a decoding pass that is the inverse of the encoding pass described in . The encoder 100 also typically performs video decoding as part of encoding the video data.

[0124] In particular, the input to the decoder includes a video bitstream, which may be generated by the video encoder 100. The bitstream is first entropy decoded (230) to obtain transform coefficients, motion vectors, and other decoding information. The picture segmentation information indicates how the picture is segmented. The decoder can therefore divide (235) the picture according to the decoded picture segmentation information. The transform coefficients are dequantized (240) and inverse transformed (250) to decode the prediction residual. The decoded prediction residual is combined with the prediction block (255) and the image block is reconstructed. The prediction block can be obtained (270) according to intra-frame prediction (260) or motion compensated prediction (i.e., inter-frame prediction) (275). An in-loop filter (265) is applied to the reconstructed image. The filtered image is stored in a reference picture buffer (280).

[0125] The decoded picture may further undergo post-decoding processing (285), such as inverse color conversion (e.g., conversion from YCbCr 4:2:0 to RGB 4:4:4) or performing an inverse remapping of the remapping process performed in the pre-encoding process (101). The post-decoding process may use metadata derived in the pre-encoding process and signaled in the bitstream.

[0126] Figure 6 A block diagram of an example of a system in which various embodiments are implemented is shown. System 1000 can be implemented as a device including various components described below, and is configured to perform one or more aspects described herein. Examples of such devices include, but are not limited to, various electronic devices, such as personal computers, laptop computers, smart phones, tablet computers, digital multimedia set-top boxes, digital television receivers, personal video recording systems, connected home appliances and servers. The elements of system 1000 can be implemented individually or in combination in a single integrated circuit, multiple ICs and / or discrete components. For example, in at least one embodiment, the processing of system 1000 and encoder / decoder elements are distributed across multiple ICs and / or discrete components. In various embodiments, system 1000 is coupled to other similar systems or other electronic devices via, for example, a communication bus or by a dedicated input and / or output port communication. In various embodiments, system 1000 is configured to implement one or more aspects described herein.

[0127] System 1000 includes at least one processor 1010, which is configured to execute instructions loaded therein, for implementing various aspects described herein, for example. Processor 1010 may include embedded memory, input and output interfaces, and various other circuits known in the art. System 1000 includes at least one memory 1020 (e.g., volatile memory device and / or non-volatile memory device). System 1000 includes storage device 1040, which may include non-volatile memory and / or volatile memory, including but not limited to EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash memory, disk drive, and / or optical drive. As a non-limiting example, storage device 1040 may include internal storage device, attached storage device, and / or network accessible storage device.

[0128] The system 1000 includes an encoder / decoder module 1030, which is configured to, for example, process data to provide encoded video or decoded video, and the encoder / decoder module 1030 may include its own processor and memory. The encoder / decoder module 1030 represents a module (one or more) that may be included in a device to perform encoding and / or decoding functions. As is known, a device may include one or both of the encoding and decoding modules. In addition, the encoder / decoder module 1030 may be implemented as a separate element of the system 1000 or may be incorporated into the processor 1010 as a combination of hardware and software as known to those skilled in the art.

[0129] Program code to be loaded onto the processor 1010 or the encoder / decoder module 1030 to perform the various embodiments described in this document may be stored in the storage device 1040 and subsequently loaded onto the memory 1020 for execution by the processor 1010. According to various embodiments, one or more of the processor 1010, the memory 1020, the storage device 1040, and the encoder / decoder module 1030 may store one or more of the various items during the execution of the processes described herein. These stored items may include, but are not limited to, input video, decoded video or portions of decoded video, bitstreams, matrices, variables, and intermediate or final results from the processing of equations, formulas, operations, and operational logic.

[0130] In several embodiments, memory within the processor 1010 and / or encoder / decoder module 1030 is used to store instructions and provide working memory for processing required during encoding or decoding. However, in other embodiments, memory external to the processing device (e.g., the processing device may be the processor 1010 or the encoder / decoder module 1030) is used for one or more of these functions. The external memory may be memory 1020 and / or a storage device 1040, such as a dynamic volatile memory and / or a non-volatile flash memory. In several embodiments, the external non-volatile flash memory is used to store the operating system of the television. In at least one embodiment, a fast external dynamic volatile memory such as RAM is used as working memory for video coding and decoding operations, such as MPEG-2, HEVC, or VVC (Versatile Video Coding).

[0131] As shown in block 1130, input to the elements of system 1000 may be provided through various input devices. Such input devices include, but are not limited to, (i) an RF section that receives an RF signal transmitted over the air, for example, by a broadcaster, (ii) a composite input terminal, (iii) a USB input terminal, and / or (iv) an HDMI input terminal.

[0132] In various embodiments, the input device of block 1130 has associated corresponding input processing elements known in the art. For example, the RF section may be associated with elements for: (i) selecting a desired frequency (also referred to as selecting a signal, or band limiting a signal to a frequency band), (ii) down-converting the selected signal, (iii) again band limiting the frequency band to a narrower frequency band to select a signal frequency band that may be referred to as a channel in some embodiments, (iv) demodulating the down-converted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select a desired data packet stream. The RF section of various embodiments includes one or more elements to perform these functions, such as a frequency selector, a signal selector, a band limiter, a channel selector, a filter, a down-converter, a demodulator, an error corrector, and a demultiplexer. The RF section may include a tuner that performs various of these functions, including, for example, down-converting a received signal to a lower frequency (e.g., an intermediate frequency or a near-baseband frequency) or a baseband. In a set-top box embodiment, the RF part and its relevant input processing element receive the RF signal that sends by wired (for example, cable) medium, and filter to the frequency band of expectation again by filtering, down-conversion and perform frequency selection.Various embodiments rearrange the order of above-mentioned (and other) element, remove some in these elements, and / or add other elements that perform similar or different functions.Adding element can include and insert element between existing element, for example, insert amplifier and analog-to-digital converter.In various embodiments, the RF part comprises antenna.

[0133] In addition, the USB and / or HDMI terminals may include corresponding interface processors for connecting the system 1000 to other electronic devices via USB and / or HDMI connections. It should be understood that various aspects of input processing, such as Reed-Solomon error correction, can be implemented, for example, within a separate input processing IC or processor 1010. Similarly, various aspects of USB or HDMI interface processing can be implemented within a separate interface IC or within processor 1010. The demodulated, error-corrected, and demultiplexed streams are provided to various processing elements, including, for example, processor 1010 and encoder / decoder 1030, which operate in conjunction with memory and storage elements to process the data streams for presentation on output devices.

[0134] The components of system 1000 may be disposed in an integrated housing. Within the integrated housing, the components may be interconnected and data may be transmitted therebetween using suitable connection means 1140, such as internal buses known in the art, including I2C buses, wiring, and printed circuit boards.

[0135] The system 1000 includes a communication interface 1050 that enables communication with other devices via a communication channel 1060. The communication interface 1050 may include, but is not limited to, a transceiver configured to send and receive data through the communication channel 1060. The communication interface 1050 may include, but is not limited to, a modem or a network card, and the communication channel 1060 may be implemented, for example, within a wired and / or wireless medium.

[0136] In various embodiments, a wireless network such as IEEE 802.11 is used to transmit the data stream to the system 1000. The wireless signals of these embodiments are received through a communication channel 1060 and a communication interface 1050, for example, suitable for Wi-Fi communication. The communication channel 1060 of these embodiments is typically connected to an access point or router, which provides access to external networks including the Internet to allow streaming applications and other over-the-top communications. Other embodiments use a set-top box that transmits data through an HDMI connection of an input box 1130 to provide streaming data to the system 1000. Still other embodiments use an RF connection of an input box 1130 to provide streaming data to the system 1000.

[0137] The system 1000 can provide output signals to various output devices, including a display 1100, a speaker 1110, and other peripherals 1120. In various examples of various embodiments, the other peripherals 1120 include one or more of the following: a stand-alone DVR, a disk player, a stereo system, a lighting system, and other devices that provide functions based on the output of the system 1000. In various embodiments, control signals are transmitted between the system 1000 and the display 1100, the speaker 1110, or other peripherals 1120 using signaling, such as AV. Link, CEC, or other communication protocols that enable device-to-device control with or without user intervention. The output devices can be communicatively coupled to the system 1000 via dedicated connections through the corresponding interfaces 1070, 1080, and 1090. Alternatively, the output devices can be connected to the system 1000 via the communication interface 1050 using the communication channel 1060. The display 1100 and the speaker 1110 can be integrated into a single unit in an electronic device (e.g., a television) along with other components of the system 1000. In various embodiments, the display interface 1070 includes a display driver, such as a timing controller (T Con) chip.

[0138] For example, if the RF portion of input 1130 is part of a separate set-top box, the display 1100 and speaker 1110 may alternatively be separate from one or more of the other components. In various embodiments where the display 1100 and speaker 1110 are external components, the output signal may be provided via a dedicated output connection, including, for example, an HDMI port, a USB port, or a COMP output.

[0139] The embodiments may be performed by computer software implemented by the processor 1010, or hardware, or a combination of hardware and software. As a non-limiting example, the embodiments may be implemented by one or more integrated circuits. The memory 1020 may be of any type suitable for the technical environment and may be implemented using any appropriate data storage technology, such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory, and removable memory, as non-limiting examples. The processor 1010 may be of any type suitable for the technical environment and may include one or more of the following as non-limiting examples: a microprocessor, a general-purpose computer, a special-purpose computer, and a processor based on a multi-core architecture.

[0140] Various implementations involve decoding. As used in the present application, "decoding" may include, for example, all or part of a process performed on a received coded sequence to produce a final output suitable for display. In various embodiments, such processes include one or more of the processes typically performed by a decoder, such as entropy decoding, inverse quantization, inverse transform, and differential decoding. In various embodiments, such processes also or alternatively include processes performed by a decoder of the various embodiments described in the present application, such as extracting indices of weights to be used for various intra-frame prediction reference arrays.

[0141] As a further example, in one embodiment, "decoding" refers only to entropy decoding, in another embodiment, "decoding" refers only to differential decoding, and in another embodiment, "decoding" refers to a combination of entropy decoding and differential decoding. Whether the phrase "decoding process" is intended to refer specifically to a subset of operations or generally to a broader decoding process will be clear based on the context of the specific description and is believed to be well understood by those skilled in the art.

[0142] Various implementations involve encoding. In a manner similar to the discussion above about "decoding", "encoding" as used in this application can include, for example, all or part of a process performed on an input video sequence to produce an encoded bitstream. In various embodiments, such processes include one or more processes typically performed by an encoder, such as segmentation, differential encoding, transforms, quantization, and entropy encoding. In various embodiments, such processes also or alternatively include processes performed by encoders of various implementations described in this application, such as weighting of an intra-frame prediction reference array.

[0143] As a further example, in one embodiment, "encoding" refers only to entropy encoding, in another embodiment, "encoding" refers only to differential encoding, and in another embodiment, "encoding" refers to a combination of differential encoding and entropy encoding. Whether the phrase "encoding process" is intended to refer specifically to a subset of operations or generally to a broader encoding process will become clear based on the context of the specific description and is believed to be well understood by those skilled in the art.

[0144] Note that the syntax elements used here are descriptive terms. Therefore, they do not exclude the use of other syntax element names.

[0145] When a figure is presented as a flow chart, it should be understood that it also provides a block diagram of the corresponding apparatus. Similarly, when a figure is presented as a block diagram, it should be understood that it also provides a flow chart of the corresponding method / process.

[0146] Various embodiments relate to rate-distortion calculation or rate-distortion optimization. In particular, during the encoding process, a balance or trade-off between code rate and distortion is usually considered, usually given a constraint on computational complexity. Rate-distortion optimization is usually formulated as minimizing a rate-distortion function, which is a weighted sum of code rate and distortion. There are different methods to solve the rate-distortion optimization problem. For example, these methods can be based on extensive testing of all coding options, including all considered modes or decoding parameter values, and a complete evaluation of their decoding costs and the associated distortion of the reconstructed signal after decoding and decoding. Faster methods can also be used to save coding complexity, in particular, to calculate approximate distortion based on prediction or prediction residual signals rather than reconstructed signals. A mixture of these two methods can also be used, for example, by using approximate distortion only for some possible coding options and full distortion for other coding options. Other methods only evaluate a subset of possible coding options. More generally, many methods use any of a variety of techniques to perform optimization, but optimization is not necessarily a complete evaluation of both coding costs and associated distortions.

[0147] The implementations and aspects described herein may be implemented in, for example, a method or process, a device, a software program, a data stream, or a signal. Even if discussed only in the context of a single form of implementation (e.g., discussed only as a method), the implementation of the features discussed may also be implemented in other forms (e.g., a device or program). For example, a device may be implemented with appropriate hardware, software, and firmware. The method may be implemented in, for example, a processor, which generally refers to a processing device, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. The processor also includes a communication device, such as a computer, a cellular phone, a portable / personal digital assistant ("PDA"), and other devices that facilitate information communication between end users.

[0148] References to "one embodiment," or "an embodiment," or "implementation," or "an implementation," and other variations mean that a particular feature, structure, characteristic, etc. described in connection with the embodiment is included in at least one embodiment. Thus, the appearances of the phrases "in one embodiment," or "in an embodiment," or "in an implementation," or "in an implementation," and any other variations, in various places throughout this document are not necessarily all referring to the same embodiment.

[0149] Additionally, reference may be made herein to "determining" various pieces of information. Determining information may include, for example, one or more of: estimating the information, calculating the information, predicting the information, or retrieving the information from a memory.

[0150] Additionally, reference may be made herein to "accessing" various pieces of information. Accessing information may include, for example, one or more of: receiving information, retrieving information (e.g., from memory), storing information, moving information, copying information, calculating information, determining information, predicting information, or estimating information.

[0151] Additionally, reference may be made herein to "receiving" various information. Like "accessing," receiving is intended to be a broad term. Receiving information may include, for example, one or more of: accessing the information or retrieving the information (e.g., from a memory). Furthermore, during operations such as storing information, processing information, sending information, moving information, copying information, erasing information, calculating information, determining information, predicting information, or estimating information, "receiving" is often involved in one way or another.

[0152] It should be understood that, for example, in the case of "A / B," "A and / or B," and "at least one of A and B," use of any of the following " / ," "and / or," and "at least one of" is intended to encompass selection of only the first listed option (A), or only the second listed option (B), or both options (A and B). As a further example, in the case of "A, B, and / or C" and "at least one of A, B, and C," such wording is intended to include selection of only the first listed option (A), or only the second listed option (B), or only the third listed option (C), or only the first and second listed options (A and B), or only the first and third listed options (A and C), or only the second and third listed options (B and C), or all three options (A and B and C). This can be extended to multiple items listed, as will be apparent to one of ordinary skill in this and related arts.

[0153] In addition, as used herein, the word "signal / signaling" refers to indicating something to the corresponding decoder. For example, in some embodiments, the encoder signals a specific one of the multiple weights to be used for the intra-frame prediction reference array. In this way, in an embodiment, the same parameters are used on the encoder side and the decoder side. Therefore, for example, the encoder can send (explicit signaling) specific parameters to the decoder so that the decoder can use the same specific parameters. On the contrary, if the decoder already has specific parameters and other parameters, signaling can be used without sending (implicit signaling) to simply allow the decoder to know and select specific parameters. Bit savings are achieved in various embodiments by avoiding the transmission of any actual function. It should be understood that signaling can be implemented in various ways. For example, in various embodiments, one or more syntax elements, flags, etc. are used to signal information to the corresponding decoder. Although the foregoing relates to the verb form of the word "signal / signaling", the word "signal / signaling" can also be used as a noun in this article.

[0154] As will be apparent to one of ordinary skill in the art, implementations may generate various signals formatted to carry information that may be stored or transmitted, for example. The information may include, for example, instructions for executing a method, or data generated by one of the described implementations. For example, a signal may be formatted to carry a bitstream of the described embodiments. Such a signal may be formatted as, for example, an electromagnetic wave (e.g., using a radio frequency portion of a spectrum) or a baseband signal. Formatting may include, for example, encoding a data stream and modulating a carrier with the encoded data stream. The information carried by the signal may be, for example, analog or digital information. As is known, the signal may be transmitted over a variety of different wired or wireless links. The signal may be stored on a processor readable medium.

[0155] The foregoing description has described a number of embodiments. These and further embodiments include the following optional features, which, alone or in any combination, span a variety of claim categories and types:

[0156] - Use prediction directions during intra prediction in encoding and decoding above -135 degrees and 45 degrees

[0157] - Extended interaction between wide angle mode and PDPC (Prediction Dependent Combination)

[0158] - Extend the prediction directions horizontally or vertically while removing some directions in the opposite direction to maintain the same number of total directions

[0159] - Expanded the number of directions to beyond -135 degrees and beyond 45 degrees

[0160] - Combine PDPC and wide-angle intra prediction to samples within a block

[0161] - Signaling from the encoder to the decoder which prediction directions are being used

[0162] -Use a subset of prediction directions

[0163] - The block is a CU with a rectangular shape

[0164] - Reference samples are obtained from blocks that are adjacent to each other

[0165] - a bitstream or signal comprising one or more of the described syntax elements, or variations thereof.

[0166] - inserting in the signalling syntax elements enabling the decoder to process the bitstream in a manner opposite to that performed by the encoder.

[0167] - creating and / or transmitting and / or receiving and / or decoding a bitstream or signal comprising one or more of the described syntax elements or variations thereof.

[0168] -TV, set-top box, cell phone, tablet computer, or other electronic device implementing any of the described embodiments.

[0169] - A TV, set-top box, cell phone, tablet computer, or other electronic device that executes any of the described embodiments and displays (eg, using a monitor, screen, or other type of display) the resulting images.

[0170] - A TV, set-top box, cellular phone, tablet computer, or other electronic device that tunes (eg, using a tuner) a channel to receive a signal including an encoded image, and performs any of the described embodiments.

[0171] - A TV, set-top box, cellular phone, tablet computer, or other electronic device that receives (e.g., using an antenna) a signal including an encoded image and performs any of the described embodiments.

[0172] - Various other generalized and specialized features are also supported and contemplated in the present disclosure.

Claims

1. A method comprising: predicting samples of the rectangular video block using at least one sample in a reference array associated with the rectangular video block based on a prediction mode, wherein the rectangular video block has a number of wide angles, the number of wide angles being determined based on an aspect ratio of the rectangular video block, wherein a starting prediction direction and an ending prediction direction associated with the prediction mode are aligned along a minor diagonal of the rectangular video block, and wherein the length of the reference array is twice the length of the corresponding side of the rectangular video block; and The rectangular video block is encoded using the predicted samples in intra coding mode.

2. A device comprising: A processor configured to: predicting samples of the rectangular video block using at least one sample in a reference array associated with the rectangular video block based on a prediction mode, wherein the rectangular video block has a number of wide angles, the number of wide angles being determined based on an aspect ratio of the rectangular video block, wherein a starting prediction direction and an ending prediction direction associated with the prediction mode are aligned along a minor diagonal of the rectangular video block, and wherein the length of the reference array is twice the length of the corresponding side of the rectangular video block; and The rectangular video block is encoded using the predicted samples in intra coding mode.

3. A method comprising: predicting samples of the rectangular video block using at least one sample in a reference array associated with the rectangular video block based on a prediction mode, wherein the rectangular video block has a number of wide angles, the number of wide angles being determined based on an aspect ratio of the rectangular video block, wherein a starting prediction direction and an ending prediction direction associated with the prediction mode are aligned along a minor diagonal of the rectangular video block, and wherein the length of the reference array is twice the length of the corresponding side of the rectangular video block; and The rectangular video block is decoded using the predicted samples in intra coding mode.

4. A device comprising: A processor configured to: predicting samples of the rectangular video block using at least one sample in a reference array associated with the rectangular video block based on a prediction mode, wherein the rectangular video block has a number of wide angles, the number of wide angles being determined based on an aspect ratio of the rectangular video block, wherein a starting prediction direction and an ending prediction direction associated with the prediction mode are aligned along a minor diagonal of the rectangular video block, and wherein the length of the reference array is twice the length of the corresponding side of the rectangular video block; and The rectangular video block is decoded using the predicted samples in intra coding mode.

5. The method according to claim 1 or 3, or the device according to claim 2 or 4, wherein: The prediction direction for the rectangular video block is extended beyond -135 degrees and 45 degrees.

6. The method according to claim 1 or 3, or the device according to claim 2 or 4, wherein: The prediction directions for the rectangular video block are extended in either the horizontal or vertical direction, while removing some directions in the opposite direction to maintain an equal number of total directions.

7. The method according to claim 1 or 3, or the device according to claim 2 or 4, wherein: The prediction directions for the rectangular video block are restricted to a subset of the extended wide-angle prediction directions.

8. The method according to claim 1 or 3, or the device according to claim 2 or 4, wherein: The rectangular video block is a coding unit having a rectangular shape.

9. The method according to claim 1 or 3, or the device according to claim 2 or 4, wherein: The samples in the reference array are selected from adjacent blocks.

10. The method according to claim 1 or 3, or the device according to claim 2 or 4, wherein: The set of angle parameters contains factors of 32.

11. The method or apparatus of claim 7, wherein the angle values ​​are modified to achieve uniform spacing of the angles.

12. A device comprising: The device according to claim 4; as well as At least one of: (i) an antenna configured to receive a signal, the signal comprising the rectangular video block, (ii) a frequency band limiter configured to limit the received signal to a frequency band comprising the rectangular video block, and (iii) a display configured to display an output representing the video block.

13. A non-transitory computer-readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method according to any one of claims 1, 3, and 5 to 11.

14. A computer program product comprising instructions which, when executed by a computer, cause the computer to perform the method according to any one of claims 1, 3 and 5 to 11.