Syntax elements for video encoding or decoding

Abstract

To provide: a video signal formatted to include information compliant with a video encoding standard; a storage medium; a device; and a method.SOLUTION: A High Efficiency Video Coding encoder 100 is configured to: upon a video sequence undergoing pre-coding processing 101 before being encoded, partition 102 each picture into slices including slice segments for encoding the video sequence; encode the picture to be encoded, by using either an intra mode or inter mode by an encoding unit (CU) to perform intra prediction 160; perform motion estimation 175 and motion compensation 170 in the inter mode; determine 105 the mode used to encode the CU and indicate by a prediction mode flag; calculate prediction residuals by subtracting 110 a block predicted from an original image block; transform 125 and quantize 130 the prediction residuals; and inverse-quantize 140 and inverse-transform 150 the prediction residuals for decoding them.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] Technical Field At least one of the present embodiments generally relates to syntax elements for video coding or video decoding. [Background technology]

[0002] background To obtain high compression efficiency, image and video coding schemes usually use prediction and transformation to exploit spatial and temporal redundancy in video content. In general, intra- or inter-prediction is used to exploit intra- or inter-frame correlation, and then the difference between the original block and the predicted block (often called prediction error or prediction residual) is transformed, quantized, and entropy coded. To recover the video, the compressed data is decoded by the inverse process corresponding to entropy coding, quantization, transformation, and prediction. Summary of the Invention

[0003] overview According to a first aspect of at least one embodiment, a video signal is presented, the video signal being formatted to include information in accordance with a video coding standard and including a bitstream having video content and high level syntax information, the high level syntax information including at least one of a parameter representing a type of partitioning, a parameter representing a type of intra prediction mode, a parameter representing a block size adaptation of a sample adaptive offset loop filter, and a parameter representing an illumination compensation mode for a bi-predictive block.

[0004] According to a second aspect of at least one embodiment, a storage medium is presented, the storage medium having coded video signal data, the video signal being formatted to include information according to a video coding standard and including a bitstream having video content and high level syntax information, the high level syntax information including at least one of a parameter representing a type of partitioning, a parameter representing a type of intra prediction mode, a parameter representing a block size adaptation of a sample adaptive offset loop filter, and a parameter representing an illumination compensation mode for bi-predictive blocks.

[0005] According to a third aspect of at least one embodiment, an apparatus is presented, the apparatus including: a video encoder for coding picture data of at least one block in a picture, the coding being performed using at least one parameter from among a parameter representing a type of partitioning, a parameter representing a type of intra-prediction mode, a parameter representing block size adaptation of a sample adaptive offset loop filter, and a parameter representing an illumination compensation mode for a bi-predictive block, the parameters being inserted into a high level syntax element of the coded picture data.

[0006] According to a fourth aspect of at least one embodiment, a method is presented, the method including: coding picture data of at least one block in a picture using at least one parameter from among a parameter representing a type of partitioning, a parameter representing a type of intra prediction mode, a parameter representing a block size adaptation of a sample adaptive offset loop filter, and a parameter representing an illumination compensation mode for a bi-predictive block; and inserting the parameter into a high level syntax element of the coded picture data.

[0007] According to a fifth aspect of at least one embodiment, an apparatus is presented, the apparatus including: a video decoder for decoding picture data of at least one block in a picture, the decoding being performed using at least one parameter from among a parameter representing a type of partitioning, a parameter representing a type of intra prediction mode, a parameter representing block size adaptation of a sample adaptive offset loop filter, and a parameter representing an illumination compensation mode for a bi-predictive block, the parameters being obtained from a high level syntax element of the coded picture data.

[0008] According to a sixth aspect of at least one embodiment, a method is presented, the method including obtaining parameters from a high level syntax element of coded picture data and decoding picture data of at least one block in the picture, the decoding being performed using at least one parameter from among a parameter representing a type of partitioning, a parameter representing a type of intra prediction mode, a parameter representing block size adaptation of a sample adaptive offset loop filter, and a parameter representing an illumination compensation mode for a bi-predictive block.

[0009] According to a seventh aspect of at least one embodiment, a non-transitory computer readable medium is presented, the non-transitory computer readable medium including data content generated according to the third or fourth aspects.

[0010] According to a seventh aspect of at least one embodiment there is provided a computer program comprising program code instructions executable by a processor, the computer program performing at least the steps of a method according to the fourth or sixth aspects.

[0011] According to an eighth aspect of at least one embodiment, there is provided a computer program product comprising program code instructions stored on a non-transitory computer readable medium and executable by a processor, the computer program product performing at least the steps of a method according to the fourth or sixth aspects. [Brief description of the drawings]

[0012] BRIEF DESCRIPTION OF THE DRAWINGS [Figure 1] FIG. 1 shows an example of a video encoder 100, such as a High Efficiency Video Coding (HEVC) encoder. [Diagram 2] 2 shows a block diagram of an example video decoder 200, such as an HEVC decoder. [Diagram 3] 1 illustrates an example of a coding tree unit and a coding tree in the compressed domain. [Figure 4] 1 illustrates an example of division of a CTU into coding units, prediction units, and transform units. [Diagram 5] An example of a CTU representation of a Quad-Tree plus Binary-Tree (QTBT) is shown below. [Figure 6] 1 illustrates an exemplary set of extensions for coding unit partitioning. [Figure 7] 1 illustrates an example of an intra prediction mode with two reference layers. [Figure 8] 1 illustrates an example embodiment of a compensation mode for bidirectional illumination compensation. [Figure 9] 1 illustrates an interpretation of bt-split-flag according to an example embodiment. [Figure 10] 1 illustrates a block diagram of an example of a system in which various aspects and embodiments may be implemented. [Figure 11] 1 shows a flowchart of an example of an encoding method according to an embodiment using a new encoding tool. [Figure 12]1 shows a flowchart of an example of a portion of a decoding method according to an embodiment using the new encoding tool. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Detailed Description In at least one embodiment, improved coding efficiency is provided by the use of the following new coding tools: In an example embodiment, efficient signaling of these coding tools conveys information indicative of the coding tools utilized for coding, e.g., from an encoder device to a receiver device (e.g., a decoder or display), such that the appropriate tool is used for the decoding stage. These tools include new partitioning modes, new intra-prediction modes, increased flexibility for sample adaptive offset, and new illumination compensation modes for bi-prediction blocks. Thus, the proposed new syntax that brings together multiple coding tools provides more efficient video coding.

[0014] Figure 1 illustrates an example of a video encoder 100, such as a High Efficiency Video Coding (HEVC) encoder. Figure 1 may also illustrate an encoder that incorporates improvements to the HEVC standard or that uses technology similar to HEVC, such as the Joint Exploration Model (JEM) encoder being developed by the Joint Video Exploration Team (JVET).

[0015] In this application, the terms "reconstructed" and "decoded" may be used synonymously, the terms "coded" or "encoded" may be used synonymously, and the terms "image", "picture", and "frame" may be used synonymously. Typically, but not necessarily, the term "reconstructed" is used on the encoder side and "decoded" is used on the decoder side.

[0016] Before being coded, a video sequence may undergo coding pre-processing (101), for example by applying a color transformation to the input color picture (e.g., from RGB 4:4:4 to YCbCr 4:2:0) or by remapping the input picture components to obtain a signal distribution that is more resilient to compression (e.g., by histogram equalization of one of the color components). Metadata may be associated with the pre-processing and combined into the bitstream.

[0017] In HEVC, to code a video sequence having one or more pictures, a picture is partitioned (102) into one or more slices, where each slice may contain one or more slice segments. The slice segments are organized into coding units, prediction units, and transform units. The HEVC specification distinguishes between "blocks" and "units," where a "block" addresses a particular area of ​​a sample array (e.g., luma, Y), and a "unit" includes all coded color components (Y, Cb, Cr, or monochrome), syntax elements, and array blocks of prediction data associated with the block (e.g., motion vectors).

[0018] For encoding in HEVC, a picture is partitioned into square-shaped coding tree blocks (CTBs) with configurable size, and a set of consecutive coding tree blocks is grouped into a slice. A coding tree unit (CTU) includes the CTB of a coded color component. The CTB is the root of a quadtree that partitions into coding blocks (CBs), which may be partitioned into one or more prediction blocks (PBs), forming the root of a quadtree that partitions into transform blocks (TBs). Corresponding to the coding blocks, prediction blocks, and transform blocks, a coding unit (CU) includes a prediction unit (PU) and a set of tree-structured transform units (TUs), where a PU includes prediction information for all color components, and a TU includes a residual coding syntax structure for each color component. The sizes of the CB, PB, and TB of the luma component are applied to the corresponding CU, PU, ​​and TU. In this application, the term "block" may be used to refer to, for example, any of CTU, CU, PU, ​​TU, CB, PB, and TB. In addition, "block" may also be used to refer to macroblocks and partitions as specified in H.264 / AVC or other video coding standards, as well as more generally to arrays of data of various sizes.

[0019] In the example encoder 100, a picture is coded by the encoder elements as follows: The picture to be coded is processed in units of CUs. Each CU is coded using intra or inter mode. When a CU is coded in intra mode, it performs intra prediction (160). In inter mode, motion estimation (175) and motion compensation (170) are performed. The encoder decides (105) whether to use intra or inter mode to code the CU, and indicates the intra / inter decision by a prediction mode flag. A prediction residual is calculated by subtracting (110) the predicted block from the original image block.

[0020] Intra mode CUs are predicted from reconstructed neighboring samples in the same slice. A set of 35 intra prediction modes is available in HEVC, including DC prediction mode, planar prediction mode, and 33 angular prediction modes. Intra prediction references are reconstructed from rows and columns neighboring the current block. The references extend across twice the block size in the horizontal and vertical directions, using samples available from previously reconstructed blocks. When an angular prediction mode is used for intra prediction, the reference samples may be copied along the direction indicated by the angular prediction mode.

[0021] The luma intra-prediction modes applicable to the current block can be coded using two different options: If the applicable mode is included in a constructed list of three most probable modes (MPMs), the mode is signaled by an index in the MPM list; otherwise, the mode is signaled by a fixed-length binarization of the mode index. The three most probable modes are derived from the intra-prediction modes of the top and left neighboring blocks.

[0022] For an inter CU, the corresponding coding block is further partitioned into one or more prediction blocks. Inter prediction is performed at the PB level, and the corresponding PU contains information about how the inter prediction is performed. Motion information (e.g., motion vectors and reference picture indexes) can be signaled in two ways: "merge mode" and "advanced motion vector prediction (AMVP)".

[0023] In merge mode, a video encoder or video decoder assembles a candidate list based on already coded blocks, and the video encoder signals an index for one of the candidates in the candidate list. At the decoder side, motion vectors (MVs) and reference picture indexes are reconstructed based on the signaled candidates.

[0024] In AMVP, a video encoder or decoder assembles a candidate list based on motion vectors determined from already coded blocks. The video encoder then signals an index in the candidate list to identify a motion vector predictor (MVP) and a motion vector difference (MVD). At the decoder side, the motion vector (MV) is reconstructed as MVP+MVD. Also, the applicable reference picture indexes are explicitly coded in the AMVP PU syntax.

[0025] The prediction residual is then transformed (125) and quantized (130) (including at least one embodiment for applying a chroma quantization parameter described below). The transformation is typically based on a separable transform. For example, a DCT transform is applied first in the horizontal direction and then in the vertical direction. In modern codecs such as JEM, the transforms used in both directions can be different (e.g., DCT in one direction and DST in the other), which results in a large variety of 2D transforms, but in earlier codecs the variety of 2D transforms for a given block size is usually limited.

[0026] The quantized transform coefficients, as well as the motion vectors and other syntax elements, are entropy coded (145) to output a bitstream. The encoder can also skip the transform and apply quantization directly to the untransformed residual signal on a 4x4 TU basis. The encoder can also avoid both the transform and quantization (i.e., the residual is coded directly without applying a transform or quantization process). In direct PCM coding, no prediction is applied and coding unit samples are coded directly into the bitstream.

[0027] The encoder decodes the coded block to provide a reference for further prediction. The quantized transform coefficients are de-quantized (140) and inverse transformed (150) to decode the prediction residual. An image block is reconstructed by combining (155) the decoded prediction residual and the predicted block. An in-loop filter (165) is applied to the reconstructed picture to reduce coding artifacts, for example by performing deblocking / sample adaptive offset (SAO) filtering. The filtered image is stored in a reference picture buffer (180).

[0028] Figure 2 shows a block diagram of an example video decoder 200, such as an HEVC decoder. In the example decoder 200, the bitstream is decoded by the following decoder elements: The video decoder 200 generally performs a decoding pass that is an inverse of the coding pass as described in Figure 1, which performs video decoding as part of the coding of the video data. Figure 2 may also show a decoder that has improvements made to the HEVC standard, or a decoder that uses techniques similar to HEVC, such as a JEM decoder.

[0029] Specifically, the decoder input includes a video bitstream that may be generated by video encoder 100. The bitstream is first entropy decoded (230) to obtain transform coefficients, motion vectors, picture partitioning information, and other coding information. The picture partitioning information indicates the size of the CTUs and how the CTUs are split into CUs and possibly into PUs, if applicable. Thus, the decoder divides (235) the picture into CTUs and each CTU into CUs according to the decoded picture partitioning information. The transform coefficients are inverse quantized (240) (including at least one embodiment for adapting chroma quantization parameters described below) and inverse transformed (250) to decode the prediction residual.

[0030] The image block is reconstructed by combining (255) the decoded prediction residual and the predicted block. The predicted block may be obtained (270) from intra prediction (260) or motion compensated prediction (i.e., inter prediction) (275). As described above, the AMVP and merge mode techniques can be used to derive motion vectors for motion compensation, which may use an interpolation filter to calculate interpolated values ​​of the sub-integer samples of the reference block. An in-loop filter (265) is applied to the reconstructed image. The filtered image is stored in a reference picture buffer (280).

[0031] The decoded picture may further undergo post-decoding processing (285), such as an inverse color conversion (e.g., from YCbCr 4:2:0 to RGB 4:4:4) or an inverse remapping that reverses the remapping process performed in the pre-coding processing (101). The post-decoding processing may use metadata derived in the pre-coding processing and signaled in the bitstream.

[0032] Figure 3 shows an example of a coding tree unit and a coding tree in the compressed domain. In the HEVC video compression standard, a picture is divided into so-called coding tree units (CTUs), whose sizes are typically 64x64, 128x128, or 256x256 pixels. Each CTU is represented by a coding tree in the compressed domain. This is a quadtree decomposition of the CTU, where each leaf is called a coding unit (CU).

[0033] FIG. 4 shows an example of division of a CTU into coding units, prediction units, and transform units. Each CU is given some intra prediction parameters or inter prediction parameters (prediction information). To this end, it is spatially partitioned into one or more prediction units (PUs), and each PU is assigned some prediction information. An intra coding mode or an inter coding mode is assigned at the CU level.

[0034] Emerging video compression tools, including a coding tree unit representation in the compressed domain, are proposed to represent picture data in a more flexible manner. The advantage of this more flexible representation of the coding tree is that it offers improved compression efficiency compared to the CU / PU / TU arrangement of the HEVC standard.

[0035] FIG. 5 shows an example of a quadtree+binarytree (QTBT) CTU representation. The quadtree+binarytree (QTBT) coding tool provides such increased flexibility. The QTBT is composed of a coding tree in which coding units can be split in both quadtree and binary tree fashions. The split of coding units is determined at the encoder side by a rate distortion (RD) optimization procedure that determines the QTBT representation of the CTU with the minimum RD cost. In the QTBT technique, the CU has a square or rectangular shape. The size of the coding unit is always a power of two, typically ranging from 4 to 128. In addition to this rectangular variety of coding units, such a CTU representation has the following different characteristics compared to HEVC. The QTBT decomposition of a CTU consists of two stages: first, the CTU is split in a quadtree fashion, and then the leaves of each quadtree can be further divided in a binary fashion. This is shown on the right side of the figure, where the solid lines represent the quadtree decomposition phase and the dashed lines represent the binary decomposition spatially embedded in the leaves of the quadtree. In intra slices, the luma and chroma block partitioning structures are separated and determined independently. No further CU partitioning into prediction units or transform units is used. That is, each coding unit systematically consists of a single prediction unit (2N×2N prediction unit partition type) and a single transform unit (no division into transform trees).

[0036] 6 shows an example set of extensions of coding unit partitioning. In one asymmetric bisection and tree splitting mode (ABT), a rectangular coding unit with size (w, h) (width and height) that is split by one of the asymmetric bisection splitting modes (e.g., HOR_UP) is divided into rectangular sizes

number

[0037] Using one or more embodiments of the new topologies described above, significant coding efficiency improvements are achieved.

[0038] FIG. 7 shows an example of an intra prediction mode with two reference layers. In fact, in the improved syntax, a new intra prediction mode is considered. The first new intra prediction mode is named multi-reference intra prediction (MRIP). This tool facilitates using multiple reference layers for intra prediction of a block. Generally, two reference layers are used for intra prediction, and each reference layer consists of a left reference array and an upper reference array. Each reference layer is constructed by reference sample permutation and then prefiltered.

[0039] Using each reference layer, a prediction for the block is constructed, as is commonly done in HEVC or JEM. The final prediction is formed as a weighted average of the predictions made from the two reference layers. The prediction from the nearest reference layer is given more weight than the prediction from the furthest layer. Commonly used weights are 3 and 1.

[0040] In the final part of the prediction process, multiple reference layers may be used to smooth the boundary samples of a particular prediction mode using a mode-dependent process.

[0041] In an example embodiment, the video compression tool also includes a sample adaptive offset (SAO) adaptive block size. This tool is a loop filter specified in HEVC. In HEVC, the SAO process classifies the reconstructed samples of a block into several classes, and samples that belong to some classes are corrected with an offset. The SAO parameters can be coded per block, or can be inherited only from the left or top neighboring blocks.

[0042] A further improvement is proposed by defining a SAO palette mode. The SAO palette keeps the same SAO parameters per block, but a block can inherit these parameters from all other blocks. This brings more flexibility to SAO by widening the range of possible SAO parameters for one block. A SAO palette consists of different sets of SAO parameters. For each block, an index is coded to indicate which SAO parameters to use.

[0043] 8 shows an example embodiment of a compensation mode of bidirectional illumination compensation. Illumination Compensation (IC) allows to correct block prediction samples (SMC) obtained by motion compensation, possibly by taking into account spatial or temporal local illumination variations. S IC =a i .S MC +b i

[0044] In the case of bi-prediction, IC parameters are estimated using samples of two reference CU samples as illustrated in Figure 8. First, IC parameters (a, b) are estimated between two reference blocks, and then IC parameters (ai, bi) i = 0, 1 between the reference blocks and the current block are derived as follows:

number

[0045] If the CU size is less than or equal to 8 in width or height, the IC parameters are estimated using a unidirectional process. If the CU size is greater than 8, the choice of using IC parameters derived from the bidirectional or unidirectional process is made by selecting the IC parameters that minimize the difference in the means of the IC-compensated reference blocks. Bidirectional optical flow (BIO) is enabled using a bidirectional illumination compensation tool.

[0046] The tools introduced above need to be selected and used by video encoder 100, and acquired and used by video decoder 200. To that end, information representative of the use of these tools is carried in the coded bitstream generated by the video encoder, and acquired by video decoder 200 in the form of high-level syntax information. To that end, a corresponding syntax is defined and described below. This syntax, which is a compilation of tools, allows for improved coding efficiency.

[0047] This syntax structure uses the HEVC syntax structure as a basis and includes some additional syntax elements. In the table below, syntax elements signaled in bold italic font and highlighted in grey correspond to additional syntax elements according to an example embodiment. Note that syntax elements may have other forms or names than those shown in the syntax table while handling the same functionality. Syntax elements may exist at different levels (e.g., some syntax elements may be placed in a sequence parameter set (SPS) and some syntax elements may be placed in a picture parameter set (PPS)).

[0048] Table 1 below shows the Sequence Parameter Set (SPS) and introduces new syntax elements inserted into this parameter set according to at least one example embodiment, more precisely: multi_type_tree_enabled_primary, log2_min_cu_size_minus2, log2_max_cu_size_minus4, log2_max_tu_size_minus2, sep_tree_mode_intra, multi_type_tree_enabled_secondary, sps_bdip_enabled_flag, sps_mrip_enabled_flag, use_erp_aqp_flag, use_high_perf_chroma_qp_table, abt_one_third_flag, sps_num_intra_mode_ratio.

[0049] [Table 1]

[0050] [Table 2]

[0051] [Table 3]

[0052] [Table 4]

[0053] The new syntax elements are defined as follows: - use_high_perf_chroma_qp_table: This syntax element specifies a chroma QP table to be used to derive the QP used for decoding the chroma components associated with a slice as a function of the base chroma QP associated with the chroma components of the considered slice. - multi_type_tree_enabled_primary: This syntax element indicates the type of partitioning allowed in a coded slice. In at least one embodiment, this syntax element is signaled at the sequence level (in the SPS) and therefore applies to all coded slices using this SPS. For example, a first value of this syntax element allows quad-tree and binary tree (QTBT) partitioning (NO-SPLIT, QT-SPLIT, HOR, and VER in FIG. 5), a second value allows QTBT+triple-tree (TT) partitioning (NO-SPLIT, QT-SPLIT, HOR, VER, HOR_TRIPLE, and VER_TRIPLE in FIG. 5), a third value allows QTBT+asymmetric binary tree (ABT) partitioning (NO-SPLIT, QT-SPLIT, HOR, VER, HOR-UP, HOR_DOWN, VER_LEFT, and VER_RIGHT in FIG. 5), and a fourth value allows QTBT+TT+ABT partitioning (all split cases in FIG. 5). - sep_tree_mode_intra: This syntax element indicates whether separate coding trees are used for luma and chroma blocks. If sep_tree_mode_intra is equal to 1, then luma and chroma blocks use independent coding trees, and thus the partitioning of luma and chroma blocks is independent. In at least one embodiment, this syntax element is signaled at the sequence level (in the SPS) and thus applies to all coded slices using this SPS. - multi_type_tree_enabled_secondary: This syntax element indicates the type of partitioning allowed for chroma blocks in a coded slice. The possible values ​​of this syntax element are generally the same as those of the syntax element multi_type_tree_enabled_primary. In at least one embodiment, this syntax element is signaled at the sequence level (in the SPS) and therefore applies to all coded slices that use this SPS. - sps_bdip_enabled_flag: this syntax element indicates that bidirectional intra prediction, as described in JVET-J0022, is allowed in coded slices included in the considered coded video sequence. - sps_mrip_enabled_flag: This syntax element indicates that multi-reference intra prediction tools are used in decoding code slices included in the considered coded video bitstream. - use_erp_aqp_flag: This syntax element indicates whether spatial adaptive quantization of VR360 ERP content as described in JVET-J0022 is activated in the coded slice. abt_one_third_flag: This syntax element indicates whether asymmetric partitioning into two partitions having horizontal or vertical dimensions that are 1 / 3 and 2 / 3, or 2 / 3 and 1 / 3, respectively, of the horizontal or vertical dimension of the first CU is activated in the coding slice. - sps_num_intra_mode_ratio: This syntax element specifies how to derive the number of intra predictions to be used for block sizes equal to a multiple of 3 in width or height.

[0054] In addition, the following three syntax elements are used to control the size of the coding unit (CU) and the size of the transform unit (TU): In at least one embodiment, these syntax elements are signaled at the sequence level (in the SPS) and therefore apply to all coded slices that use this SPS: - log2_min_cu_size_minus2 specifies the minimum CU size. - log2_max_cu_size_minus4 specifies the maximum CU size. - log2_max_tu_size_minus2 specifies the maximum TU size.

[0055] In another embodiment, the new syntax elements introduced above are introduced in the Picture Parameter Set (PPS) instead of the Sequence Parameter Set.

[0056] Table 2 below shows the Sequence Parameter Set (SPS) and introduces new syntax elements inserted in this parameter set according to at least one example embodiment, more precisely: - slice_sao_size_id: This syntax element specifies the size of the block to which SAO is applied with respect to the coded slice. - slice_bidir_ic_enable_flag: indicates whether bidirectional illumination compensation is activated for the coding slice.

[0057] [Table 5]

[0058] [Table 6]

[0059] [Table 7]

[0060] [Table 8]

[0061] [Table 9]

[0062] Tables 3, 4, 5, 6 below show the coding tree syntax modified to support additional partitioning modes according to at least one example embodiment. In particular, the syntax enabling asymmetric partitioning is specified in coding_binary_tree(). New syntax elements are inserted in the coding tree syntax, more precisely: - an asymmetricSplitFlag indicating whether an asymmetric bipartite split is allowed for the current CU; and - asymmetric_type, which indicates the type of asymmetric bisection split, can take two values ​​to allow the horizontal split to be top or bottom, or the vertical split to be left or right

[0063] In addition, the parameter btSplitMode is interpreted differently.

[0064] [Table 10]

[0065] [Table 11]

[0066] [Table 12]

[0067] [Table 13]

[0068] [Table 14]

[0069] FIG. 9 illustrates an interpretation of bt-split-flag according to at least one example embodiment. Two syntax elements asymmetricSplitFlag and asymmetric_type are used to specify the value of the parameter btSplitMode. btSplitMode indicates the bipartite split mode applied to the current CU. btSplitMode is derived differently than in the prior art. In JEM, it can take values ​​HOR, VER. In the enhanced syntax, it can further take values ​​HOR_UP, HOR_DOWN, VER_LEFT, VER_RIGHT, which correspond to the partitioning shown in FIG. 6.

[0070] Tables 7, 8, 9, and 10 below show coding unit syntax elements and introduce new syntax elements for bidirectional intra-prediction modes.

[0071] [Table 15]

[0072] [Table 16]

[0073] [Table 17]

[0074] [Table 18]

[0075] [Table 19]

[0076] [Table 20]

[0077] Some of the syntax elements described in this document are defined as arrays. For example, btSplitFlag is defined by an array of dimension 4 indexed by the horizontal and vertical position in the picture and by the coding block horizontal and vertical size. To simplify the notation, these indices are not preserved in the semantic description of the syntax elements (for example, btSplitFlag[x0][y0][cbSizeX][cbSizeY] is simply denoted as btSplitFlag).

[0078] FIG. 10 illustrates a block diagram of an example of a system in which various aspects and embodiments may be implemented. System 1000 may be embodied as a device including the various components described below and configured to perform one or more of the aspects described herein. Examples of such devices include, but are not limited to, various electronic devices such as personal computers, laptop computers, smartphones, tablet computers, digital multimedia set-top boxes, digital television receivers, personal video recording systems, connected home appliances, encoders, transcoders, and servers. The elements of system 1000 may be embodied, alone or in combination, in a single integrated circuit, multiple ICs, and / or separate components. For example, in at least one embodiment, the processing elements and encoder / decoder elements of system 1000 are distributed across multiple ICs and / or separate components. In various embodiments, system 1000 is communicatively coupled to other similar systems or other electronic devices, for example, via a communication bus or via dedicated input and / or output ports. In various embodiments, system 1000 is configured to perform one or more of the aspects described herein.

[0079] The system 1000 includes at least one processor 1010 configured to execute instructions loaded therein to implement various aspects described herein, for example. The processor 1010 may include internal memory, input / output interfaces, and various other circuitry known in the art. The system 1000 includes at least one memory 1020 (e.g., volatile and / or non-volatile memory devices). The system 1000 includes a storage device 1040, which may include non-volatile and / or volatile memory, including, but not limited to, EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk drives, and / or optical disk drives. The storage device 1040 may include, by way of non-limiting example, an internal storage device, an attached storage device, and / or a network-accessible storage device.

[0080] The system 1000 includes an encoder / decoder module 1030 configured to process data to provide, for example, coded or decoded video, and the encoder / decoder module 1030 may include its own processor and memory. The encoder / decoder module 1030 represents a module that may be included within a device to perform coding and / or decoding functions. As is known, a device may include one or both of a coding module and a decoding module. Furthermore, the encoder / decoder module 1030 may be implemented as a separate element of the system 1000 or may be incorporated within the processor 1010 as a combination of hardware and software as known to those skilled in the art.

[0081] Program code loaded into the processor 1010 or the encoder / decoder 1030 to perform various aspects described herein may be stored in the storage device 1040 and later loaded into the memory 1020 for execution by the processor 1010. According to various embodiments, one or more of the processor 1010, memory 1020, storage device 1040, and encoder / decoder module 1030 may store one or more of various items while performing the processes described herein. Such stored items may include, but are not limited to, input video, decoded video or portions of decoded video, bitstreams, matrices, variables, and intermediate or final results from processing equations, expressions, operations, and arithmetic logic.

[0082] In some embodiments, memory internal to the processor 1010 and / or the encoder / decoder module 1030 is used to store instructions and provide working memory for processing required during encoding or decoding. However, in other embodiments, memory external to the processing device (e.g., the processing device may be the processor 1010 or the encoder / decoder module 1030) is used for one or more of these functions. The external memory may be the memory 1020 and / or the storage device 1040 (e.g., dynamic volatile memory and / or non-volatile flash memory). In some embodiments, the external non-volatile flash memory is used to store the TV's operating system. In at least one embodiment, a high-speed external dynamic volatile memory such as RAM is used as working memory for video encoding and decoding operations such as MPEG-2, HEVC, or Versatile Video Coding (VVC).

[0083] Input to the elements of system 1000 may be provided using various input devices as shown in block 1130. Such input devices include, but are not limited to, (i) an RF section that receives RF signals transmitted over the air, for example by a broadcast station, (ii) a composite input, (iii) a USB input, and / or (iv) an HDMI input.

[0084] In various embodiments, the input devices of block 1130 have associated respective input processing elements known in the art. For example, the RF section may be associated with elements necessary to (i) select a desired frequency (also referred to as selecting a signal or band-limiting a signal to a frequency band), (ii) down-convert the selected signal, (iii) band-limit again to a narrower frequency band to select a signal frequency band (for example), which may be referred to as a channel in certain embodiments, (iv) demodulate the down-converted and band-limited signal, (v) perform error correction, and (vi) demultiplex to select a desired stream of data packets. The RF section of various embodiments includes one or more elements for performing these functions, such as a frequency selector, a signal selector, a band limiter, a channel selector, a filter, a down-converter, a demodulator, an error corrector, and a demultiplexer. The RF section may include, for example, a tuner that performs some of these functions, including down-converting a received signal to a lower frequency (e.g., an intermediate frequency or a frequency close to baseband) or to baseband. In one set-top box embodiment, the RF section and its associated input processing elements receive RF signals transmitted over a wired (e.g., cable) medium and perform frequency selection by filtering, down-converting, and filtering again to a desired frequency band. Various embodiments rearrange the order of the above (and other) elements, remove some of these elements, and / or add other elements that perform similar or different functions. Adding elements may include inserting elements between existing elements (e.g., inserting amplifiers and analog-to-digital converters, etc.). In various embodiments, the RF section includes an antenna.

[0085] Additionally, the USB and / or HDMI terminals may include respective interface processors for connecting the system 1000 to other electronic devices via USB and / or HDMI connections. It is to be understood that various aspects of the input processing, e.g., Reed-Solomon error correction, may be implemented, for example, in a separate input processing IC or within the processor 1010, as desired. Similarly, aspects of the USB or HDMI interface processing may be implemented in a separate interface IC or within the processor 1010, as desired. The demodulated, error corrected, and demultiplexed stream is provided to various processing elements, including, for example, the processor 1010 and an encoder / decoder 1030 that operates in combination with memory and storage elements to process the data stream as desired for display on an output device.

[0086] The various elements of system 1000 may be provided within an integrated housing in which the various elements may be interconnected and transmit data between them using any suitable connection arrangement (e.g., internal buses known in the art), including an I2C bus, wiring, and printed circuit boards.

[0087] The system 1000 includes a communication interface 1050 that enables communication with other devices over a communication channel 1060. The communication interface 1050 may include, but is not limited to, a transceiver configured to transmit and receive data over the communication channel 1060. The communication interface 1050 may include, but is not limited to, a modem or a network card, and the communication channel 1060 may be implemented within a wired and / or wireless medium, for example.

[0088] In various embodiments, data is streamed to the system 1000 using a Wi-Fi network, such as IEEE 802.11. The Wi-Fi signal in these embodiments is received by a communication channel 1060 and communication interface 1050 suitable for Wi-Fi communication. The communication channel 1060 in these embodiments is typically connected to an access point or router that provides access to external networks, including the Internet, enabling streaming usage and other over-the-top communication. Other embodiments provide streamed data to the system 1000 using a set-top box that sends data via HDMI communication of the input block 1130. Still other embodiments provide streamed data to the system 1000 using an RF connection of the input block 1130.

[0089] The system 1000 may provide output signals to various output devices including a display 1100, speakers 1110, and other peripheral devices 1120. The other peripheral devices 1120, in various example embodiments, include one or more of a standalone DVR, a disc player, a stereo system, a lighting system, and other devices that provide functionality based on the output of the system 1000. In various embodiments, control signals are communicated between the system 1000 and the display 1100, speakers 1110, or other peripheral devices 1120 using signaling such as AV.Link, CEC, or other communication protocols that allow device-to-device control with or without user intervention. The output devices may be communicatively coupled to the system 1000 via dedicated connections via respective interfaces 1070, 1080, and 1090. Alternatively, the output devices may be connected to the system 1000 using a communication channel 1060 via the communication interface 1050. The display 1100 and speakers 1110 may be integrated in a single unit with other components of the system 1000 in an electronic device such as a television. In various embodiments, the display interface 1070 includes a display driver, such as a timing controller (T Con) chip.

[0090] The display 1100 and the speaker 1110 may alternatively be separate from one or more of the other components, for example when the RF portion of the input 1130 is part of a separate set-top box. In various embodiments where the display 1100 and the speaker 1110 are external components, the output signal may be provided via a dedicated output connection, including, for example, an HDMI port, a USB port, or a COMP output. The implementations described herein may be implemented, for example, in a method or process, an apparatus, a software program, a data stream, or a signal. Even if described only in the context of a single form of implementation (e.g., described only as a method), the implementation of the described features may also be implemented in other forms (e.g., an apparatus or a program). An apparatus may be implemented, for example, in suitable hardware, software, and firmware. A method may be implemented, for example, in an apparatus, such as a processor, which refers generally to a processing device (including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device). Processors also include communications devices such as, for example, computers, mobile phones, portable / personal digital assistants ("PDAs"), and other devices that facilitate communication of information between end-users.

[0091] FIG. 11 shows a flow chart of an example of an encoding method according to an embodiment using a new encoding tool. Such an encoding method can be performed by the system 1000 described in FIG. 10, and more precisely by the processor 1010. In at least one embodiment, in step 1190, the processor 1010 selects the encoding tool to be used. The selection can be made using different techniques. The selection can be made by a user using an encoding configuration parameter (typically a flag) indicating the tool (and corresponding parameters, if necessary) to be used during the encoding and decoding processes. In an example embodiment, the selection is made by setting a value in a file, and the flag is read by the encoding device, which interprets the value of the flag to select which tool to use. In an example embodiment, the selection is made by a manual action of a user who selects the encoding configuration parameter using a graphical user interface operating the encoder device. Once this selection is made, coding is performed in step 1193 using the selected coding tool from among several coding tools, and the selection of the tool is signaled in a higher level syntax element (e.g., in the following SPS, PPS, or slice header).

[0092] Figure 12 shows a flow chart of an example of a part of a decoding method according to an embodiment using the new coding tools. Such a decoding method can be performed by the system 1000 described in Figure 10, and more precisely by the processor 1010. In at least one embodiment, in step 1200, the processor 1010 accesses a signal (e.g. received at an input interface or read from a media support) and extracts and analyzes high level syntax elements to determine the tools selected in the coding device. In step 1210, decoding is performed using these tools to generate a decoded image that can be provided to the device or displayed on the device, for example.

[0093] References to "one embodiment," or "an embodiment," or "one implementation," or "an embodiment," and other variations thereof, mean that a particular feature, structure, characteristic, etc. described in connection with that embodiment is included in at least one embodiment. Thus, the appearances of the phrases "in one embodiment," or "in an embodiment," or "in one embodiment," or "in an embodiment" in various places throughout this specification, and other variations thereof, do not necessarily all refer to the same embodiment.

[0094] Additionally, the application or its claims may refer to "determining" various information. Determining information may include, for example, one or more of estimating information, calculating information, predicting information, or retrieving information from memory.

[0095] Additionally, the application or its claims may refer to "accessing" various information. Accessing information may include, for example, one or more of receiving information, retrieving information (e.g., from a memory), storing information, moving information, copying information, calculating information, predicting information, or estimating information.

[0096] Additionally, the application or claims thereof may refer to "receiving" various information. Like "accessing," receiving is intended to be a broad term. Receiving information may include, for example, one or more of accessing information or retrieving information (e.g., from memory or optical media storage). Additionally, "receiving" generally involves in some way an operation, such as, for example, storing information, processing information, transmitting information, moving information, copying information, erasing information, calculating information, determining information, predicting information, or estimating information.

[0097] For example, in the case of "A / B," "A and / or B," and "at least one of A and B," the use of any of the following " / ," "and / or," and "at least one of" is intended to encompass the selection of only the first listed option (A), or the selection of only the second listed option (B), or the selection of both options (A and B). As a further example, in the case of "A, B, and / or C," and "at least one of A, B, and C," such language is intended to encompass the selection of only the first listed option (A), or the selection of only the second listed option (B), or the selection of only the third listed option (C), or the selection of only the first and second listed options (A and B), or the selection of only the first and third listed options (A and C), or the selection of only the second and third listed options (B and C), or the selection of all three options (A, B, and C). This can be expanded to include as many items as are listed, as would be readily apparent to one of ordinary skill in this and related arts.

[0098] As will be apparent to one of ordinary skill in the art, the embodiments may generate a variety of signals formatted to carry information that may be, for example, stored or transmitted. The information may include, for example, instructions for performing a method or data generated by one of the described embodiments. For example, a signal may be formatted to carry a bit stream of a described embodiment. Such a signal may be formatted, for example, as an electromagnetic wave (e.g., using a radio frequency portion of the spectrum) or as a baseband signal. Formatting may include, for example, encoding a data stream and modulating a carrier wave with the encoded data stream. The information carried by the signal may be, for example, analog or digital information. The signal may be transmitted over a variety of different wired or wireless links, as is known. The signal may be stored on a processor-readable medium.

[0099] In alternative forms of at least the first, second, third, fourth, fifth, sixth, seventh, and eighth aspects of an embodiment, the parameter representing the type of partitioning includes a first value of quadtree and binary tree partitioning, a second value of quadtree and binary tree partitioning + ternary tree partitioning, a third value of quadtree and binary tree partitioning + asymmetric binary tree partitioning, and a fourth value of quadtree and binary tree partitioning + ternary tree partitioning + asymmetric binary tree partitioning.

[0100] In a variant of at least the first, second, third, fourth, fifth, sixth, seventh, and eighth aspects of an embodiment, the parameters further include a size of a block to which the sample adaptive offset is applied with respect to the coded slice.

[0101] In another embodiment of at least the first, second, third, fourth, fifth, sixth, seventh, and eighth aspects of an embodiment, the type of intra prediction mode includes at least one of an intra bi-prediction mode and a multi-reference intra prediction mode.

Claims

1. 1. A video signal formatted to include information according to a video coding standard, the video signal including a bitstream having video content and high level syntax information, the high level syntax information being A parameter indicating a type of intra prediction mode; A parameter that indicates the type of partitioning, a parameter describing the block size adaptation of the sample adaptive offset loop filter; A parameter representing an illumination compensation mode for the bi-predictive block; A video signal including at least one parameter selected from the above.

2. The parameter representing the type of partitioning is a first value for quadtree and binary tree partitioning; a second value of the quadtree and binary tree partitioning plus ternary tree partitioning; a third value of quad-tree and binary tree partitioning plus asymmetric binary tree partitioning; A fourth value of quad-tree and binary tree partitioning + ternary tree partitioning + asymmetric binary tree partitioning; 2. The video signal of claim 1, comprising:

3. 3. The video signal of claim 1, further comprising a size of the block to which the sample adaptive offset is applied with respect to a coded slice.

4. 4. A video signal according to any one of claims 1 to 3, wherein the types of intra prediction modes include at least one of intra bi-prediction modes and multi-reference intra prediction modes.

5. 1. A storage medium having encoded video signal data, the video signal data being encoded and comprising a bitstream having video content and high level syntax information, the high level syntax information comprising: A parameter indicating a type of intra prediction mode; A parameter that indicates the type of partitioning, a parameter describing the block size adaptation of the sample adaptive offset loop filter; A parameter representing an illumination compensation mode for the bi-predictive block; A storage medium comprising at least one parameter from among:

6. 1. A video encoder for encoding picture data for at least one block in a picture, the encoding comprising: A parameter indicating a type of intra prediction mode; A parameter that indicates the type of partitioning, a parameter describing the block size adaptation of the sample adaptive offset loop filter; A parameter representing an illumination compensation mode for the bi-predictive block; The method is carried out using at least one parameter from 11. An apparatus comprising: a video encoder, wherein the parameters are inserted into a high level syntax element of the coded picture data.

7. Coding picture data of at least one block in a picture, comprising: A parameter indicating a type of intra prediction mode; A parameter that indicates the type of partitioning, a parameter describing the block size adaptation of the sample adaptive offset loop filter; A parameter representing an illumination compensation mode for the bi-predictive block; and encoding the signal using at least one parameter from inserting said parameters into a high level syntax element of said coded picture data; 23. A method in a video encoder comprising:

8. 1. A video decoder for decoding picture data of at least one block in a picture, the decoding comprising: A parameter indicating a type of intra prediction mode; A parameter that indicates the type of partitioning, a parameter describing the block size adaptation of the sample adaptive offset loop filter; A parameter representing an illumination compensation mode for the bi-predictive block; The method is carried out using at least one parameter from 13. An apparatus comprising: a video decoder, wherein the parameters are obtained from high level syntax elements of coded picture data.

9. obtaining parameters from high level syntax elements of the coded picture data; Decoding picture data for at least one block in a picture, comprising: A parameter indicating a type of intra prediction mode; A parameter that indicates the type of partitioning, a parameter describing the block size adaptation of the sample adaptive offset loop filter; A parameter representing an illumination compensation mode for the bi-predictive block; and decoding the encoded data using at least one parameter from 23. A method in a video decoder comprising:

10. The parameter representing the type of partitioning is a second value of the quadtree and binary tree partitioning plus ternary tree partitioning; a first value for quadtree and binary tree partitioning; a third value of quad-tree and binary tree partitioning plus asymmetric binary tree partitioning; A fourth value of quad-tree and binary tree partitioning + ternary tree partitioning + asymmetric binary tree partitioning; 10. The method of claim 9, comprising:

11. The method of claim 9 or 10, further comprising the size of the block to which the sample adaptive offset is applied with respect to a coding slice.

12. The method according to any one of claims 9 to 11, wherein the types of intra prediction modes include at least one of intra bi-prediction modes and multi-reference intra prediction modes.

13. A non-transitory computer readable medium containing data content generated by the method or apparatus of any one of claims 6 to 12.

14. A computer program comprising program code instructions executable by a processor for performing the steps of the method according to at least one of claims 7 or 9 to 12.

15. A computer program product stored on a non-transitory computer readable medium and comprising program code instructions executable by a processor for performing the steps of the method according to at least one of claims 7 or 9-12.

Images