Image coding and decoding

The recursive multi-tree partitioning scheme with adaptive context modeling addresses the inefficiencies of fixed block sizes in HEVC by allowing variable block shapes and sizes, resulting in improved compression efficiency for image and video encoding.

JP2024157041AActive Publication Date: 2024-11-06FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024140760
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2019-01-02
Filing Date
2024-08-22
Publication Date
2024-11-06
Estimated Expiration
2039-12-30

Smart Images

  • Figure 2024157041000001_ABST
    Figure 2024157041000001_ABST
Patent Text Reader

Abstract

To provide a coding and decoding method and a device that improve compression efficiency in relation to block division.SOLUTION: A decoding method includes: decoding, from a data stream, a division flag of division information indicating whether a predetermined block of an image is to be divided, thereby stopping recursive multi-tree division with the predetermined block being one of coding blocks, thereby dividing the image into the coding blocks according to division information signalled by the data stream; and when the division flag indicates that the predetermined block of the image is to be divided, decoding, from the data stream, a quadrant flag of the division information indicating whether the predetermined block of the image is divided into four child blocks in division of the image.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] FIELD OF THE DISCLOSURE Embodiments of the present disclosure relate to the field of image encoding and decoding, such as in the field of image or video coding. In particular, embodiments relate to partition tree design and coding thereof in hybrid video compression, such as in the field of block-based image or video coding.

[0002] In hybrid video coding, an image is usually divided into smaller blocks of variable size, allowing adaptation to the characteristics of the input video signal and ultimately resulting in high compression efficiency. The division into blocks of variable size is usually represented by a tree structure, such as a quadtree, a binary tree, etc. The associated signaling depends on the chosen tree structure and affects the compression efficiency.

[0003] In prior art hybrid video coding, such as the High Efficiency Video Coding (HEVC) standard, the input image is first partitioned into fixed-size disjoint square blocks. Each of these fixed-size square blocks constitutes the root of a partitioning tree and can be further subdivided into smaller blocks. The blocks corresponding to the leaves of the partitioning tree are used for prediction and transform coding. For these variable-size blocks, the original signal is often predicted, and the difference between the original signal and the predicted signal is called the residual signal. The residual signal is transmitted using transform coding. In HEVC, the video image is first partitioned into square blocks, called coding tree units (CTUs), each of which constitutes the root of a partitioning tree. HEVC uses a quadtree structure for the subdivision into smaller units. At the leaves of the quadtree, the final blocks are called coding units (CUs). Each CU constitutes the root node for two other partitioning trees, one for the prediction parameters and one for the transform coding stage. An important property of the quadtree structure is that the partitioning syntax element consists of only a single bin. This is also called the split flag, since it signals whether the current block is split into four equally sized disjoint blocks. Figure 1 shows the result of a single split into a split tree and the result in a two-dimensional image. The split syntax element is coded in the normal mode of a context-based adaptive entropy coding engine (HEVC uses Context-Based Adaptive Arithmetic Coding (CABAC)). Specifically, an adaptive context model is used to code this syntax element. The context modeling process of the quadtree split syntax element employs the quadtree depth of the current node and data on the transmitted split trees of the neighboring blocks. Depending on the depth of the neighboring split trees, one of three available context models is selected, and three cases are distinguished: (a) both neighbor depths are equal to or greater than the current depth, (b) both neighbor depths are less than the current depth, and (c) all other settings.

[0004] In the latest ITU-T and ISO / IEC video coding standardization activity, called Versatile Video Coding (VVC), block shapes other than squares are used. The existing quadtree design incorporates two alternative partitioning trees: binary trees and ternary trees. As their names suggest, a node can be partitioned into two or three rectangular shapes. These partitioning shapes are interchangeable and constitute another partitioning tree, the binary-ternary tree (BTT).

[0005] For example, compression of image or video data employs block-based image / video coding and context modeling for content prediction.

[0006] It is therefore an object of the present disclosure to provide a concept for encoding and decoding images with high compression efficiency. This object is achieved by the subject matter of the independent claims contained herein.

[0007] One aspect of the present disclosure relates to an apparatus for decoding an image. The apparatus is configured to divide the image into coding blocks (e.g., leaf blocks) using recursive multi-tree partitioning according to partitioning information signaled in a data stream. The apparatus is further configured to decode the image from coding information signaled in the data stream and related to the coding blocks. The apparatus is configured to divide the image into coding blocks according to partitioning information signaled in a data stream (e.g., the data stream) by decoding from the data stream a partition flag of the partitioning information indicating whether a given block of the image is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. That is, if the partition flag indicates that the given block is not partitioned, the recursive multi-tree partitioning is stopped. If the partition flag indicates that the given block of the image is partitioned, partitioning the image includes decoding from the data stream a quad flag of the partitioning information indicating whether the given block of the image is partitioned or not into four child blocks. If the split flag indicates that the given block of the image is split and the quaternion flag indicates that the given block of the image is not split into four child blocks, splitting the image includes decoding from the data stream one or more further flags of the split information indicating whether the given block of the image is split vertically or horizontally into two or three child blocks. Furthermore, if the split flag indicates that the given block of the image is split, splitting the image includes resuming the recursive multi-tree splitting for the child block with the further flag of the split information. For example, one of the child blocks may be the given block in another recursion of the recursive multi-tree splitting. If the split flag indicates that the given block of the image is split, the device may stop the splitting and may decode and / or evaluate the split flag before decoding another flag, such as the quaternion flag, such that only one flag (i.e., the split flag) is decoded if the given block is not further split.By stopping the recursive splitting after decoding only one flag, the decoding efficiency is improved. Moreover, if a given block is not further split, it is sufficient to have the split flag in the split information, so the size of the data stream can be reduced.

[0008] Another aspect relates to an apparatus for decoding an image. The apparatus is configured to partition the image into coding blocks using recursive multi-tree partitioning in response to partition information signaled in a data stream. The apparatus is further configured to decode the image from coding information signaled in the data stream and related to the coding blocks. The apparatus is configured to partition the image into coding blocks in response to partition information signaled in a data stream (e.g., the data stream) by decoding a partition flag and a quaternary flag of the partition information from the data stream. The partition flag indicates whether a given block of the image is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. The quaternary flag indicates whether the given block of the image is partitioned or not into four child blocks. If the given block of the image is partitioned but not into four child blocks, partitioning the image includes obtaining information about the partition direction flag and information about the trichotomy flag. The apparatus is configured to obtain information regarding the split direction flag by decoding a split direction flag from the data stream, which indicates whether the given block of the image is split vertically or horizontally, if neither the second nor the third predetermined criterion is met. If the second predetermined criterion is met, the apparatus is configured to obtain information regarding the split direction flag by estimating that the split direction flag indicates that the given block of the image is split vertically. If the third predetermined criterion is met, the apparatus is configured to obtain information regarding the split direction flag by estimating that the split direction flag indicates that the given block of the image is split horizontally. If the fourth predetermined criterion is not met, the apparatus is configured to obtain information regarding the split direction flag by decoding a third flag from the data stream. The third flag indicates whether the given block of the image is split into three or two child blocks.If a fourth predetermined criterion is satisfied, the apparatus is configured to obtain information regarding the split direction flag by estimating that the trichotomy flag indicates that the given block of the image is split into two child blocks. Furthermore, if the given block of the image is split, splitting the image includes resuming recursive multi-tree splitting for the child blocks using a further flag of the split information. The apparatus is further configured to decode the split direction flag from the data stream by context-adaptive entropy decoding using a second context. The second context is determined by whether the following scenarios are satisfied and distinguishes between them: In a first scenario, the fourth predetermined criterion is not satisfied when the split direction flag indicates that the split direction is horizontal and when the split direction flag indicates that the split direction is vertical, or is satisfied when the split direction flag indicates that the split direction is horizontal and when the split direction flag indicates that the split direction is vertical. In a second scenario, the fourth predetermined criterion is satisfied when the split direction flag indicates that the split direction is horizontal and is not satisfied when the split direction flag indicates that the split direction is vertical. In the third scenario, the fourth predetermined criterion is not met when the split direction indicated by the split direction flag is horizontal, and is met when the split direction indicated by the split direction flag is vertical.

[0009] Another aspect relates to an apparatus for decoding an image, configured to partition the image into coding blocks using recursive multiple tree partitioning in response to partition information signaled in a data stream. The apparatus is further configured to decode the image from coding information signaled in the data stream and related to the coding blocks. The apparatus is configured to partition the image into coding blocks in response to the partition information signaled in the data stream by decoding a partition flag and a quaternary flag of the partition information from the data stream. The partition flag indicates whether a given block of the image is partitioned or not, the latter indicating a stop of the recursive multiple tree partitioning at a state where the given block is one of the coding blocks. The quaternary flag indicates whether the given block of the image is partitioned or not into four child blocks. If the given block of the image is partitioned but not into four child blocks, the apparatus is configured to obtain information about the partition direction flag and information about the trichotomy flag. Obtaining information regarding the split direction flag includes decoding from the data stream a split direction flag indicating whether the given block of the image is split vertically or horizontally if neither the second nor the third predetermined criterion is met. If the second predetermined criterion is met, obtaining information regarding the split direction flag includes estimating the split direction flag to indicate that the given block of the image is split vertically. If the third predetermined criterion is met, obtaining information regarding the split direction flag includes estimating the split direction flag to indicate that the given block of the image is split horizontally. Obtaining information regarding the third flag includes decoding from the data stream a third flag indicating whether the given block of the image is split into three or two child blocks if the fourth predetermined criterion is not met. If the fourth predetermined criterion is met, obtaining information regarding the third flag includes estimating the third flag to indicate that the given block of the image is split into two child blocks.Furthermore, if a fifth predetermined criterion is satisfied, obtaining information regarding the trichotomy flag includes estimating that the trichotomy flag indicates that the predetermined block of the image is to be split into three child blocks, and suppressing decoding of the trichotomy flag from the data stream. If the predetermined block of the image is split, splitting the image includes resuming recursive multi-tree splitting for the child blocks using a further flag of the split information. Furthermore, the apparatus is configured to decode the split direction flag from the data stream by context-adaptive entropy decoding using a second context. The second context is determined by whether a first criterion number of the fourth predetermined criterion and the fifth predetermined criterion is equal to, greater than, or smaller than a second criterion number of the fourth predetermined criterion and the fifth predetermined criterion, and distinguishes between them. The first criterion number of the fourth predetermined criterion and the fifth predetermined criterion is satisfied if the split direction indicated by the split direction flag is horizontal. The second criterion number of the fourth predetermined criterion and the fifth predetermined criterion is satisfied if the split direction indicated by the split direction flag is vertical.

[0010] Another aspect relates to an apparatus for decoding an image, the apparatus configured to partition the image into coding blocks using recursive multiple tree partitioning in response to partition information signaled in a data stream. The apparatus is further configured to decode the image from coding information signaled in the data stream and related to the coding blocks. The apparatus is configured to partition the image into coding blocks in response to partition information signaled in a data stream (e.g., the data stream described above) by decoding a partition flag and a quaternary flag of the partition information from the data stream. The partition flag indicates whether a given block of the image is partitioned or not, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. The quaternary flag indicates whether the given block of the image is partitioned or not into four child blocks. If the given block of the image is partitioned but not into four child blocks, partitioning the image includes decoding a partition direction flag from the data stream and decoding a ternary flag from the data stream. The partition direction flag indicates whether the given block of the image is partitioned vertically or horizontally. The trichotomy flag indicates whether the given block of the image is to be split into three or two child blocks. If the given block of the image is to be split, splitting the image includes resuming recursive multi-tree partitioning for the child block using a further flag of the partitioning information. The apparatus is further configured to decode the trichotomy flag from the data stream by context-adaptive entropy decoding using a third context. The third context depends on the number of partitions of the recursive multi-tree partitioning used in obtaining the given block (e.g., the number of recursions of the recursive multi-tree partitioning) or on the size of the given block. Alternatively or additionally, the third context depends on and distinguishes between whether the partition direction flag indicates a horizontal partition direction and whether the partition direction flag indicates a vertical partition direction.

[0011] Another aspect relates to an apparatus for decoding an image, the apparatus configured to partition the image into coding blocks using recursive multiple tree partitioning in response to partition information signaled in a data stream. The apparatus is further configured to decode the image from coding information signaled in the data stream and related to the coding blocks. The apparatus is configured to partition the image into coding blocks in response to partition information signaled in a data stream (e.g., the data stream described above) by decoding a partition flag and a quad flag of the partition information from the data stream. The partition flag indicates whether a given block of the image is partitioned or not, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. The quad flag indicates whether the given block of the image is partitioned or not into four child blocks. If the given block of the image is partitioned but not into four child blocks, partitioning the image includes decoding one or more further flags of the partition information indicating whether the given block of the image is partitioned vertically or horizontally into two or three child blocks from the data stream. If the given block of the image is split, splitting the image includes resuming recursive multi-tree splitting for child blocks using a further flag of the split information. The apparatus is further configured to select one of a first mode and a second mode. In the first mode, the apparatus is configured to decode a quad flag after the split flag if the split flag indicates that the given block of the image is split. In the second mode, the apparatus is configured to decode a split flag after the quad flag if the quad flag indicates that the given child block of the image is not split into four child blocks.

[0012] Another aspect relates to an apparatus for encoding an image. The apparatus is configured to divide the image into coding blocks using recursive multiple tree partitioning. The apparatus is configured to encode partition information in a data stream that defines the partitioning of the image. The apparatus is further configured to encode the image into coding information related to the coding blocks and to encode the coding information in the data stream. The apparatus is configured to encode the partition information in the data stream by encoding a partition flag of the partition information in the data stream. The partition flag indicates whether a given block of the image is partitioned, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. For example, the partition flag may indicate to a decoder that decodes the partition flag whether the given block is a coding block (e.g., a leaf block) or whether the given block is further partitioned by another recursion of the recursive multiple tree partitioning, thereby instructing the decoder to perform such another recursion. If the partition flag indicates that the given block of the image is partitioned, encoding the partition information includes encoding a quaternary flag of the partition information in the data stream. The quaternary flag indicates whether the given block of the image is partitioned into four child blocks. If the split flag indicates that the given block of the image is split and the quaternion flag indicates that the given block of the image is not split into four child blocks, encoding the split information further includes encoding one or more other flags of the split information into the data stream. The one or more other flags indicate whether the given block of the image is split vertically or horizontally into two or three child blocks. If the split flag indicates that the given block of the image is split, encoding the split information further includes resuming encoding of the split information for the child block with a further flag of the split information. For example, in another recursion of the recursive multiple tree splitting, one of the child blocks may be the given block.

[0013] Another aspect relates to an apparatus for encoding an image, the apparatus configured to divide the image into coding blocks using recursive multiple tree partitioning and to encode partition information in a data stream that defines the partitioning. The apparatus is further configured to encode the image into coding information related to the coding blocks and to encode the coding information in the data stream. The apparatus is configured to encode the partition information in the data stream by encoding a partition flag and a quad flag of the partition information in the data stream. The partition flag indicates whether a given block of the image is partitioned or not, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. The quad flag indicates whether the given block of the image is partitioned into four child blocks. If the given block of the image is partitioned but not into four child blocks and neither the second nor the third predetermined criterion is met, encoding the partition information includes encoding a partition direction flag in the data stream. The partition direction flag indicates whether the given block of the image is partitioned vertically or horizontally. If the given block of the image is divided but not divided into four child blocks and a second predetermined criterion is met, encoding the partition information includes inhibiting encoding of a partition direction flag, and if the second predetermined criterion is met, the partition direction flag is presumed to indicate that the given block of the image is divided vertically. If the given block of the image is divided but not divided into four child blocks and a third predetermined criterion is met, encoding the partition information includes inhibiting encoding of the partition direction flag, and if the third predetermined criterion is met, the partition direction flag is presumed to indicate that the given block of the image is divided horizontally. If the given block of the image is divided but not divided into four child blocks and a fourth predetermined criterion is not met, encoding the partition information includes encoding a thirds flag into the data stream, the thirds flag indicating whether the given block of the image is divided into three child blocks or two child blocks.If the given block of the image is split but not split into four child blocks and if a fourth predefined criterion is met, encoding the partition information includes inhibiting encoding of the trichotomy flag, where if the fourth predefined criterion is met, the trichotomy flag is presumed to indicate that the given block of the image is split into two child blocks. If the given block of the image is split, encoding the partition information includes resuming encoding of the partition information for the child blocks with a further flag of the partition information. The apparatus is further configured to encode the partition direction flag into the data stream by context-adaptive entropy coding using a second context. The second context is determined by whether the following scenarios are met and distinguishes between them: In a first scenario, the fourth predefined criterion is not met when the partition direction flag indicates that the partition direction is horizontal and when the partition direction flag indicates that the partition direction is vertical, or is met when the partition direction flag indicates that the partition direction is horizontal and when the partition direction flag indicates that the partition direction is vertical. In the second scenario, the fourth predetermined criterion is met when the split direction flag indicates that the split direction is horizontal, and is not met when the split direction flag indicates that the split direction is vertical. In the third scenario, the fourth predetermined criterion is not met when the split direction flag indicates that the split direction is horizontal, and is met when the split direction flag indicates that the split direction is vertical.

[0014] Another aspect relates to an apparatus for encoding an image, the apparatus configured to divide the image into coding blocks using recursive multiple tree partitioning and to code partition information in a data stream that defines the partitioning. The apparatus is further configured to code the image into coding information signaled in the data stream and related to the coding blocks and to code the coding information in the data stream. The apparatus is configured to divide the image into coding blocks according to the partitioning information signaled in the data stream by coding a partition flag and a quad flag of the partition information in the data stream. The partition flag indicates whether a given block of the image is partitioned or not, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. The quad flag indicates whether the given block of the image is partitioned or not into four child blocks. If the given block of the image is partitioned but not into four child blocks and neither the second nor the third predetermined criterion is met, partitioning the image includes coding a partition direction flag in the data stream. The partition direction flag indicates whether the given block of the image is partitioned vertically or horizontally. If the given block of the image is divided but not divided into four child blocks and neither the second nor the third predetermined criterion is met, dividing the image includes suppressing encoding of a split direction flag, and if the second predetermined criterion is met, the split direction flag is presumed to indicate that the given block of the image is divided vertically. If the given block of the image is divided but not divided into four child blocks and if the third predetermined criterion is met, dividing the image includes suppressing encoding of the split direction flag, and if the third predetermined criterion is met, the split direction flag is presumed to indicate that the given block of the image is divided horizontally. If the given block of the image is divided but not divided into four child blocks and if neither the fourth nor the fifth predetermined criterion is met, dividing the image includes encoding a trichotomy flag into the data stream.The trichotomy flag indicates whether the given block of the image is to be split into three or two child blocks. If the given block of the image is split but not into four child blocks and a fourth predefined criterion is met, the image splitting includes inhibiting encoding of the trichotomy flag, and if the fourth predefined criterion is met, the trichotomy flag is presumed to indicate that the given block of the image is to be split into two child blocks. If the given block of the image is split but not into four child blocks and a fifth predefined criterion is met, the image splitting includes inhibiting encoding of the trichotomy flag, and if the fifth predefined criterion is met, the trichotomy flag is presumed to indicate that the given block of the image is to be split into three child blocks. If the given block of the image is split, the image splitting includes resuming encoding of the partition information for the child blocks with a further flag in the partition information. The apparatus is further configured to encode the split direction flag into the data stream by context-adaptive entropy coding using a second context that depends on and distinguishes between whether the first number is equal to, greater than, or smaller than the second number. The first number is a first criterion number of the fourth and fifth predetermined criteria that is satisfied when the split direction indicated by the split direction flag is horizontal. The second number is a second criterion number of the fourth and fifth predetermined criteria that is satisfied when the split direction indicated by the split direction flag is vertical.

[0015] Another aspect relates to an apparatus for encoding an image, the apparatus configured to divide the image into coding blocks using recursive multiple tree partitioning and to encode partition information in a data stream that defines the partitioning. The apparatus is further configured to encode the image into coding information related to the coding blocks and to encode the coding information in the data stream. The apparatus is configured to encode the partition information in the data stream by encoding a partition flag and a quaternary flag of the partition information in the data stream, the partition flag indicating whether a given block of the image is partitioned or not, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. The quaternary flag indicates whether the given block of the image is partitioned or not into four child blocks. If the given block of the image is partitioned but not into four child blocks, encoding the partition information includes encoding a partition direction flag in the data stream and encoding a trichotomy flag in the data stream. The partition direction flag indicates whether the given block of the image is partitioned vertically or horizontally. The trichotomy flag indicates whether the given block of the image is partitioned into three child blocks or two child blocks. If the given block of the image is split, encoding the split information includes resuming encoding of the split information for child blocks using a further flag of the split information. The apparatus is configured to encode the trichotomy flag into the data stream by context-adaptive entropy coding using a third context. The third context depends on the number of divisions of the recursive multi-tree division used to obtain the given block or on the size of the given block. Additionally or alternatively, the third context depends on and distinguishes between whether the split direction flag indicates a horizontal split direction and whether the split direction flag indicates a vertical split direction.

[0016] Another aspect relates to an apparatus for encoding an image, the apparatus configured to divide the image into coding blocks using recursive multiple tree partitioning and to encode partition information in a data stream that defines the partitioning. The apparatus is further configured to encode the image into coding information related to the coding blocks and to encode the coding information in the data stream. The apparatus is configured to encode the partition information in the data stream by encoding a partition flag and a quaternion flag of the partition information in the data stream, the partition flag indicating whether a given block of the image is partitioned or not, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. The quaternion flag indicates whether the given block of the image is partitioned or not into four child blocks. If the given block of the image is partitioned but not into four child blocks, the encoding of the partition information includes encoding one or more further flags of the partition information in the data stream indicating whether the given block of the image is partitioned vertically or horizontally into two or three child blocks. If the given block of the image is partitioned, the encoding of the partition information includes resuming the encoding of the partition information for the child blocks using the further flag of the partition information. The apparatus is configured to select one of a first mode and a second mode, in the first mode, the apparatus is configured to encode a quad flag after the split flag if the split flag indicates that the given block of the image is split, and in the second mode, the apparatus is configured to encode a split flag after the quad flag if the quad flag indicates that the given child block of the image is not split into four child blocks.

[0017] Another aspect relates to a method of decoding an image, comprising: partitioning the image 12' into coding blocks using recursive multi-tree partitioning in response to partition information signaled in a data stream; and further decoding the image 12' from coding information signaled in the data stream and related to the coding blocks. The method further comprises partitioning the image 12' into coding blocks in response to the partition information signaled in the data stream by decoding from the data stream a partition flag of the partition information indicating whether a given block of the image 12' is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. If the partition flag indicates that the given block of the image 12' is partitioned, partitioning the image comprises decoding from the data stream a quad flag of the partition information indicating whether the given block of the image 12' is partitioned or not into four child blocks. If the quad flag indicates that the given block of image 12' is not divided into four child blocks, then dividing the image includes decoding from the data stream one or more further flags of the division information that indicate whether the given block of image 12' is to be divided vertically or horizontally into two or three child blocks. If the division flag indicates that the given block of image 12' is to be divided, then dividing the image includes resuming recursive multi-tree division for the child blocks using the further flags of the division information.

[0018] Another aspect relates to a method of decoding an image, comprising: partitioning the image 12' into coding blocks using recursive multi-tree partitioning in response to partition information signaled in a data stream. The method further comprises: decoding the image 12' from coding information signaled in the data stream and related to the coding blocks. The method comprises partitioning the image 12' into coding blocks in response to partition information signaled in the data stream by decoding a partition flag and a quad flag of the partition information from the data stream, the partition flag indicating whether a given block of the image 12' is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. The quad flag indicating whether the given block of the image 12' is partitioned or not into four child blocks. If the given block of image 12' is split but not into four child blocks, the image splitting includes decoding a split direction flag from the data stream indicating whether the given block of image 12' is split vertically or horizontally if neither the second nor the third predetermined criterion is met. If the given block of image 12' is split but not into four child blocks, the image splitting includes inferring the split direction flag to indicate that the given block of image 12' is split vertically if the second predetermined criterion is met. If the given block of image 12' is split but not into four child blocks, the image splitting includes inferring the split direction flag to indicate that the given block of image 12' is split horizontally if the third predetermined criterion is met. If the given block of image 12' is to be split but not into four child blocks, splitting the image includes decoding a trichotomous flag from the data stream indicating whether the given block of image 12' is to be split into three child blocks or two child blocks if a fourth predetermined criterion is not met.If the given block of image 12' is split but not into four child blocks, splitting the image includes inferring that the trisection flag indicates that the given block of image 12' is split into two child blocks if a fourth predetermined criterion is met. If the given block of image 12' is split, splitting the image includes resuming recursive multi-tree splitting for the child blocks with a further flag in the split information. The method further includes decoding the split direction flag from the data stream by context-adaptive entropy decoding using a second context that is determined based on and distinguishes between the following scenarios: (i) the fourth predetermined criterion is not satisfied when the split direction indicated by the split direction flag is horizontal and when the split direction indicated by the split direction flag is vertical, or when the split direction indicated by the split direction flag is horizontal and when the split direction indicated by the split direction flag is vertical; (ii) the fourth predetermined criterion is satisfied when the split direction indicated by the split direction flag is horizontal and is not satisfied when the split direction indicated by the split direction flag is vertical; and (iii) the fourth predetermined criterion is not satisfied when the split direction indicated by the split direction flag is horizontal and is satisfied when the split direction indicated by the split direction flag is vertical.

[0019] Another aspect relates to a method for decoding an image, comprising: partitioning the image 12' into coding blocks using recursive multi-tree partitioning in response to partition information signaled in a data stream, and further decoding the image 12' from coding information signaled in the data stream and related to the coding blocks. The method includes partitioning the image 12' into coding blocks in response to partition information signaled in the data stream by decoding a partition flag and a quad flag of the partition information from the data stream, the partition flag indicating whether a given block of the image 12' is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. The quad flag indicates whether the given block of the image 12' is partitioned or not into four child blocks. If the given block of image 12' is split but not into four child blocks, the image splitting includes decoding a split direction flag from the data stream indicating whether the given block of image 12' is split vertically or horizontally if neither the second nor the third predetermined criterion is met. If the given block of image 12' is split but not into four child blocks, the image splitting further includes inferring the split direction flag to indicate that the given block of image 12' is split vertically if the second predetermined criterion is met. If the given block of image 12' is split but not into four child blocks, the image splitting further includes inferring the split direction flag to indicate that the given block of image 12' is split horizontally if the third predetermined criterion is met. If the given block of image 12' is split but not into four child blocks, splitting the image further includes decoding a trichotomous flag from the data stream indicating whether the given block of image 12' is split into three child blocks or two child blocks if a fourth predetermined criterion is not met.If the given block of image 12' is split but not into four child blocks, the image splitting further includes inferring that the trichotomy flag indicates that the given block of image 12' is split into two child blocks if a fourth predetermined criterion is met and that the trichotomy flag indicates that the given block of image 12' is split into three child blocks if a fifth predetermined criterion is met, and suppressing decoding of the trichotomy flag from the data stream. If the given block of image 12' is split, the image splitting further includes resuming recursive multi-tree splitting for the child blocks with yet another flag in the splitting information. Furthermore, the method includes decoding the split direction flag from the data stream by context-adaptive entropy decoding using a second context that is determined by and distinguishes between: (i) a first number of the fourth and fifth predetermined criteria that are satisfied when the split direction indicated by the split direction flag is horizontal is equal to a second number of the fourth and fifth predetermined criteria that are satisfied when the split direction indicated by the split direction flag is vertical; (ii) the first number being greater than the second number; and (iii) the first number being smaller than the second number.

[0020] Another aspect relates to a method for decoding an image, comprising: partitioning the image 12' into coding blocks using recursive multi-tree partitioning in response to partition information signaled in a data stream, and further decoding the image 12' from coding information signaled in the data stream and related to the coding blocks. The method includes partitioning the image 12' into coding blocks in response to partition information signaled in the data stream by decoding a partition flag and a quad flag of the partition information from the data stream, the partition flag indicating whether a given block of the image 12' is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. The quad flag indicates whether the given block of the image 12' is partitioned or not into four child blocks. If the given block of the image 12' is split but not into four child blocks, splitting the image includes decoding a split direction flag from the data stream indicating whether the given block of the image 12' is split vertically or horizontally, and decoding a trichotomy flag from the data stream indicating whether the given block of the image 12' is split into three or two child blocks. If the given block of the image 12' is split, splitting the image includes resuming recursive multi-tree splitting for the child blocks using a further flag of the split information. Decoding the trichotomy flag from the data stream using context adaptive entropy decoding includes using a third context that depends on the number of divisions of the recursive multi-tree split used to obtain the given block or that depends on the size of the given block. Additionally or alternatively, the third context depends on whether the split direction flag indicates a horizontal split direction and whether the split direction flag indicates a vertical split direction, and distinguishes between them.

[0021] Another aspect relates to a method of decoding an image, comprising: partitioning the image 12' into coding blocks using recursive multi-tree partitioning in response to partition information signaled in a data stream; and decoding the image 12' from coding information signaled in the data stream and related to the coding blocks. The method includes partitioning the image 12' into coding blocks in response to partition information signaled in the data stream by decoding a partition flag and a quad flag of the partition information from the data stream, the partition flag indicating whether a given block of the image 12' is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. The quad flag indicates whether the given block of the image 12' is partitioned into four child blocks or not. If the given block of the image 12' is partitioned but not into four child blocks, partitioning the image includes decoding one or more further flags of the partition information indicating whether the given block of the image 12' is partitioned vertically or horizontally into two or three child blocks from the data stream. If the given block of the image 12' is split, splitting the image includes resuming recursive multi-tree splitting for child blocks using a further flag in the split information. The method further includes selecting one of a first mode and a second mode, and in the first mode, decoding a quad flag after the split flag if the split flag indicates that the given block of the image 12' is split, and in the second mode, decoding a split flag after the quad flag if the quad flag indicates that the given child block of the image 12' is not split into four child blocks.

[0022] Another aspect relates to a method of encoding an image, the method including dividing the image into coding blocks using recursive multiple tree partitioning and encoding partition information defining the partitioning in a data stream. The method further includes encoding the image into coding information related to the coding blocks and encoding the coding information in the data stream. The method further includes encoding the partitioning information in the data stream by encoding a partition flag of the partitioning information indicative of whether a given block of the image is partitioned or not, whereby the recursive multiple tree partitioning stops with the given block being one of the coding blocks. If the partition flag indicates that the given block of the image is partitioned, partitioning the image includes encoding a quadrant flag of the partitioning information indicative of whether the given block of the image is partitioned or not into four child blocks in the data stream. If the quadrant flag indicates that the given block of the image is not partitioned into four child blocks, the method includes encoding one or more further flags of the partitioning information indicative of whether the given block of the image is partitioned vertically or horizontally into two or three child blocks in the data stream. If the split flag indicates that the given block of the image is split, the method includes resuming encoding of the split information for the child block using a further flag in the split information.

[0023] Another aspect relates to a method of encoding an image, the method including dividing the image into coding blocks using recursive multiple tree partitioning and encoding partition information in a data stream that defines the partitioning. The method further includes encoding the image into coding information related to the coding blocks and encoding the coding information in the data stream. The method further includes encoding the partitioning information in the data stream by encoding a partition flag and a quaternion flag of the partitioning information in the data stream, the partition flag indicating whether a given block of the image is partitioned or not, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. The quaternion flag indicates whether the given block of the image is partitioned into four child blocks. If the given block of the image is partitioned but not into four child blocks, the method includes encoding a partition direction flag in the data stream indicating whether the given block of the image is partitioned vertically or horizontally if neither the second nor the third predetermined criterion is met. If the given block of the image is split but not into four child blocks, the method includes suppressing encoding of the split direction flag if a second predetermined criterion is met, where the split direction flag is presumed to indicate that the given block of the image is split vertically if the second predetermined criterion is met. If the given block of the image is split but not into four child blocks, the method includes suppressing encoding of the split direction flag if a third predetermined criterion is met, where the split direction flag is presumed to indicate that the given block of the image is split horizontally if the third predetermined criterion is met. If the given block of the image is split but not into four child blocks, the method includes encoding into the data stream a trichotomy flag indicating whether the given block of the image is split into three or two child blocks if a fourth predetermined criterion is not met.If the given block of the image is split but not into four child blocks, the method includes suppressing encoding of the trichotomous flag if a fourth predetermined criterion is met, where the trichotomous flag is presumed to indicate that the given block of the image is split into two child blocks if the fourth predetermined criterion is met. If the given block of the image is split, the method includes resuming encoding of the partition information for the child blocks with a further flag of the partition information. The method further includes encoding the split direction flag into the data stream by context-adaptive entropy coding using a second context that is determined by and distinguishes between: (i) a fourth predetermined criterion is not satisfied when the split direction indicated by the split direction flag is horizontal and when the split direction indicated by the split direction flag is vertical, or is satisfied when the split direction indicated by the split direction flag is horizontal and when the split direction indicated by the split direction flag is vertical; (ii) the fourth predetermined criterion is satisfied when the split direction indicated by the split direction flag is horizontal and is not satisfied when the split direction indicated by the split direction flag is vertical; and (iii) the fourth predetermined criterion is not satisfied when the split direction indicated by the split direction flag is horizontal and is satisfied when the split direction indicated by the split direction flag is vertical.

[0024] Another aspect relates to a method of encoding an image, the method comprising: dividing the image into coding blocks using recursive multi-tree partitioning; and encoding partition information in a data stream that defines the partitioning. The method further comprises: encoding the image into coding information signaled in the data stream and related to the coding blocks; and encoding the coding information in the data stream. The method comprises: dividing the image into coding blocks according to the partitioning information signaled in the data stream by encoding a partition flag and a quad flag of the partition information in the data stream, the partition flag indicating whether a given block of the image is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. The quad flag indicates whether the given block of the image is partitioned into four child blocks. If the given block of the image is partitioned but not into four child blocks, the method comprises encoding a partition direction flag in the data stream indicating whether the given block of the image is partitioned vertically or horizontally if neither the second nor the third predetermined criterion is met. If the given block of the image is split but not into four child blocks, the method includes suppressing encoding of the split direction flag if a second predetermined criterion is met, where the split direction flag is presumed to indicate that the given block of the image is split vertically if the second predetermined criterion is met. If the given block of the image is split but not into four child blocks, the method includes suppressing encoding of the split direction flag if a third predetermined criterion is met, where the split direction flag is presumed to indicate that the given block of the image is split horizontally if the third predetermined criterion is met. If the given block of the image is split but not into four child blocks, the method includes encoding into the data stream a trichotomy flag indicating whether the given block of the image is split into three or two child blocks if neither the fourth nor the fifth predetermined criterion is met.If the given block of the image is split but not split into four child blocks, the method includes inhibiting encoding of the trichotomy flag if a fourth predetermined criterion is met, where if the fourth predetermined criterion is met the trichotomy flag is presumed to indicate that the given block of the image is split into two child blocks. If the given block of the image is split but not split into four child blocks, the method includes inhibiting encoding of the trichotomy flag if a fifth predetermined criterion is met, where if the fifth predetermined criterion is met the trichotomy flag is presumed to indicate that the given block of the image is split into three child blocks. If the given block of the image is split, the method includes resuming encoding of the partition information for the child blocks with a further flag of the partition information. The method includes encoding the split direction flag into a data stream by context-adaptive entropy coding using a second context that is determined by and distinguishes between: (i) a first number of the fourth and fifth predetermined criteria that are satisfied when the split direction indicated by the split direction flag is horizontal, and a second number of the fourth and fifth predetermined criteria that are satisfied when the split direction indicated by the split direction flag is vertical, (ii) the first number being greater than the second number, and (iii) the first number being smaller than the second number.

[0025] Another aspect relates to a method of encoding an image, the method including dividing the image into coding blocks using recursive multi-tree partitioning and encoding partition information in a data stream that defines the partitioning. The method further includes encoding the image into coding information related to the coding blocks and encoding the coding information in the data stream. The method further includes encoding the partitioning information in the data stream by encoding a partition flag and a quaternary flag of the partitioning information in the data stream, the partition flag indicating whether a given block of the image is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block is one of the coding blocks. The quaternary flag indicates whether the given block of the image is partitioned or not into four child blocks. If the given block of the image is partitioned but not into four child blocks, the method includes encoding a partition direction flag in the data stream indicating whether the given block of the image is partitioned vertically or horizontally, and encoding a trichotomy flag in the data stream indicating whether the given block of the image is partitioned into three child blocks or two child blocks. If the given block of the image is split, the method includes resuming encoding of the partition information for the child block using a further flag of the partition information. The method further includes encoding the trichotomy flag into the data stream by context-adaptive entropy coding using a third context that depends on the number of divisions of the recursive multi-tree partition used to obtain the given block or that depends on the size of the given block. Additionally or alternatively, the third context depends on whether the split direction flag indicates a horizontal split direction and whether the split direction flag indicates a vertical split direction, and distinguishes between these.

[0026] Another aspect relates to a method of encoding an image, the method including the steps of: dividing the image into coding blocks using recursive multiple tree partitioning and encoding partition information in a data stream that defines the partitioning; and encoding the image into coding information related to the coding blocks and encoding the coding information in the data stream. The method further includes encoding the partition information in the data stream by encoding a partition flag and a quaternion flag of the partition information in the data stream, the partition flag indicating whether a given block of the image is partitioned or not, thereby stopping the recursive multiple tree partitioning when the given block is one of the coding blocks. The quaternion flag indicates whether the given block of the image is partitioned into four child blocks. If the given block of the image is partitioned but not into four child blocks, the method includes encoding one or more further flags of the partition information in the data stream indicating whether the given block of the image is partitioned vertically or horizontally into two or three child blocks. If the given block of the image is partitioned, the method includes resuming the encoding of the partition information for the child blocks using the further flag of the partition information. The method further includes the steps of selecting one of a first mode and a second mode; in the first mode, if the split flag indicates that a given block of the image is to be split, encoding a quad flag after the split flag; and in the second mode, if the quad flag indicates that a given child block of the image is not to be split into four child blocks, encoding a split flag after the quad flag.

[0027] The method relies on the same idea as the above-mentioned device, and therefore provides the same or equivalent functions and advantages. The method may optionally be combined with (or complemented by) any of the features, functions, and details described herein for the corresponding device. The method may optionally be combined with the above-mentioned features, functions, and details individually or in any combination. [Brief description of the drawings]

[0028] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the drawings. [Figure 1] FIG. 1 is a schematic diagram of an apparatus for encoding images, capable of implementing the disclosed concepts; [Diagram 2] FIG. 1 is a schematic diagram of an apparatus for decoding images, capable of implementing the disclosed concepts; [Diagram 3] FIG. 2 illustrates signals used by an encoder or decoder according to one embodiment. [Figure 4] 1 is a schematic diagram of an apparatus for decoding an image according to an embodiment; [Diagram 5] FIG. 4 is a schematic diagram of an apparatus for decoding an image according to another embodiment; [Figure 6] FIG. 4 is a schematic diagram of an apparatus for decoding an image according to another embodiment; [Figure 7] FIG. 2 illustrates an exemplary embodiment of a second context. [Figure 8] FIG. 4 is a schematic diagram of an apparatus for decoding an image according to another embodiment; [Figure 9] FIG. 4 is a schematic diagram of an apparatus for decoding an image according to another embodiment; [Figure 10A] FIG. 2 illustrates a quadtree partitioning according to one embodiment. [Figure 10B] FIG. 2 illustrates a quadtree partitioning according to one embodiment. [Figure 11] FIG. 1 shows a partitioning tree for the current VVC. [Figure 12] FIG. 2 illustrates a partitioning tree according to one embodiment. [Figure 13] 1 is a schematic diagram of an apparatus for encoding an image according to an embodiment; [Figure 14] 1 is a flow chart of an embodiment of a method for decoding an image. [Figure 15] 1 is a flow chart of an embodiment of a method for decoding an image. [Figure 16]1 is a flow chart of an embodiment of a method for decoding an image. [Figure 17] 1 is a flow chart of an embodiment of a method for decoding an image. [Figure 18] 1 is a flow chart of an embodiment of a method for decoding an image. [Figure 19] This is a diagram showing Table 1. [Figure 20] This is a diagram showing Table 2. [Figure 21] This is a diagram showing Table 3. [Figure 22] This is a diagram showing Table 4. [Figure 23] This is a diagram showing Table 5.

[0029] Various embodiments and aspects of the present invention are described below, with further embodiments defined by the appended claims.

[0030] It should be noted that any embodiment as defined by the claims can be supplemented by any of the details (features and functions) described herein. Also, the embodiments described herein can be used separately and optionally supplemented by any of the details (features and functions) contained in the claims. Also, it should be noted that each aspect described herein can be used separately or in combination, whereby details can be added to each of said individual aspects without adding details to the other aspects. Also, it should be noted that the present disclosure explicitly or implicitly describes features that can be used in image / video encoding and decoding. Thus, any of the features described herein can be used in the context of image / video encoding and decoding.

[0031] The present invention will be better understood from the following detailed description and the accompanying drawings of embodiments of the invention, which should not be construed as limiting the invention to the specific embodiments described, but are merely for purposes of illustration and understanding.

[0032] The following description of the figures begins with the presentation of a description of an encoder and decoder of a block-based predictive codec, constituting an example of a coding framework in which embodiments of the invention can be incorporated, by coding images of a video. The encoder and decoder are described with respect to figures 1 to 3, respectively. A description of an embodiment of the inventive concepts is then presented, together with a description of how such concepts can be incorporated in the encoder and decoder of figures 1 and 2, respectively, although the embodiments described in the following figures 4 onwards can also be used for encoder and decoder configurations that do not operate according to the coding framework underlying the encoder and decoder of figures 1 and 2.

[0033] FIG. 1 shows an apparatus for predictively coding an image 12 into a data stream 14 using, as an example, transform-based residual coding. The apparatus or encoder is indicated with the reference symbol 10. FIG. 2 shows a corresponding decoder or apparatus 20, also arranged to predictively decode an image 12' from the data stream 14 using transform-based residual decoding, but the apostrophe is used to indicate that the image 12' reconstructed by the decoder 20 differs from the original image 12 encoded by the apparatus 10 in terms of coding losses introduced by quantization of the predicted residual signal. Although transform-based predictive residual coding is used as an example in FIG. 1 and FIG. 2, the embodiments of the present application are not limited to this type of predictive residual coding. This also applies to other details described with respect to FIG. 1 and FIG. 2, as outlined below.

[0034] The encoder 10 is configured to perform a spatial-to-spectral transformation on the prediction residual signal and to encode the prediction residual signal thus obtained into a data stream 14. Similarly, the decoder 20 is configured to decode the prediction residual signal from the data stream 14 and to perform a spectral-to-spatial transformation on the prediction residual signal thus obtained.

[0035] The encoder 10 may include a prediction residual generator 22 for generating a prediction residual 24 and measuring the deviation of the prediction signal 26 from the original signal, i.e. image 12. The prediction residual generator 22 may for example be a subtractor for subtracting the prediction signal from the original signal, i.e. image 12. The encoder 10 may then include a transformer 28 for performing a spatial-spectral transformation on the prediction residual 24 to obtain a spectral domain prediction residual 24' which is subsequently quantized by a quantizer 32, also included in the encoder 10. The quantized prediction residual 24'' is then coded into the bitstream 14. For this purpose, the encoder 10 may optionally include an entropy coding unit 34 for entropy coding the prediction residual so as to be transformed and quantized into the datastream 14. The prediction signal 26 is generated by a prediction stage 36 of the encoder 10 on the basis of the decodable prediction residual 24'' coded into the datastream 14. For this purpose, as shown in FIG. 1, the prediction stage 36 may include an inverse quantization unit 38 for inverse quantization of the predicted residual signal 24″ to obtain a spectral domain predicted residual signal 24′″ corresponding to the signal 24′ except for quantization losses, followed by an inverse transformation unit 40 for performing an inverse or spectral-spatial transformation on the latter predicted residual signal 24′″ to obtain a predicted residual signal 24″″ corresponding to the original predicted residual signal 24 except for quantization losses. A combiner 42 of the prediction stage 36 then recombines the predicted signal 26 and the predicted residual signal 24″″, for example by addition, to obtain a reconstructed signal 46, i.e. a reconstruction of the original signal 12. The reconstructed signal 46 may correspond to the signal 12′. A prediction module 44 of the prediction stage 36 then generates the predicted signal 26 on the basis of the signal 46, for example by using spatial or intra-picture prediction and / or temporal or inter-picture prediction.

[0036] Similarly, the decoder 20 may include internal components corresponding to the prediction stage 36 and interconnected in a manner corresponding to the prediction stage 36, as shown in Figure 2. In particular, an entropy decoding unit 50 of the decoder 20 may entropy decode a quantized spectral domain prediction residual signal 24'' from the data stream, with an inverse quantization unit 52, an inverse transform unit 54, a combining unit 56 and a prediction module 58 cooperating and interconnected in the manner described above with respect to the modules of the prediction stage 36 to reconstruct a reconstructed signal based on the prediction residual signal 24'', such that the output of the combining unit 5 is a reconstructed signal or image 12', as shown in Figure 2.

[0037] Although not specifically mentioned above, it is easily apparent that the encoder 10 can set some coding parameters, e.g. prediction mode, motion parameters, etc., according to some optimization scheme, e.g. to optimize some rate- and distortion-related criteria, i.e. coding cost. For example, the encoder 10 and the decoder 20 and the corresponding modules 44, 58 may each support different prediction modes, e.g. intra-coding and inter-coding modes. The granularity at which the encoder and the decoder switch between these types of prediction modes may correspond to a subdivision of the images 12 and 12′, respectively, into coding segments or coding blocks. For example, these coding segments may subdivide the image into blocks to be intra-coded and blocks to be inter-coded. The intra-coding blocks are predicted based on their coded / decoded spatial neighbors, as will be explained in more detail below. For each intra-coding segment, several intra-coding modes may exist and be selectable, including a directional or angular intra-coding mode, which is followed to fill each segment by extrapolating neighboring sample values ​​along a specific direction specific to each directional intra-coding mode. The intra-coding modes may also include one or more other modes, such as a DC coding mode, which is followed to assign DC values ​​to all samples in each intra-coding segment in the prediction of each intra-coding block, and / or a planar intra-coding mode, which is followed to approximate or determine the prediction of each block to a spatial distribution of sample values ​​represented by a two-dimensional linear function for the sample positions of each intra-coding block, driven by a planar tilt and offset defined by a two-dimensional linear function based on the neighboring samples. In comparison, for example, an inter-coding block may be predicted temporally.For inter-coding blocks, motion vectors may be signaled in the data stream indicating the spatial displacement of parts of previously coded pictures of the video to which the picture 12 belongs, and a prediction signal for each inter-coding block is obtained by sampling of previously coded / decoded pictures. This means that the residual signal coding contained in the data stream 14, such as coefficient levels of an entropy coding transform representing a quantized spectral domain prediction residual signal 24'', as well as optional other parameters may be coded in the data stream 14, such as coding mode parameters assigning coding modes to the various blocks, prediction parameters for parts of the blocks (such as motion parameters for inter-coding segments) and parameters controlling and signaling the subdivision of each of the pictures 12 and 12' into segments. The decoder 20 uses these parameters to sub-divide the picture in the same way as the encoder, assigning the same prediction modes to the segments and performing the same predictions to obtain the same prediction signals.

[0038] Fig. 3 shows the relationship between the reconstructed signal, i.e. reconstructed image 12', on the one hand, and the combination of the predicted residual signal 24'''' and the prediction signal 26 signaled in the data stream 14 on the other hand. As mentioned above, this combination may be additive. In Fig. 3, the prediction signal 26 is shown as a subdivision of the image area into intra-coding blocks, shown hatched, and inter-coding blocks, shown without hatching. This subdivision may be any subdivision, such as a regular subdivision of the image area into rows and columns of square or non-square blocks, or a multi-tree subdivision of the image 12 from a root block (e.g. CTU) into multiple leaf blocks (e.g. CU) of different sizes. This subdivision may be any subdivision, such as a quad-tree subdivision or a bi- or tri-partite subdivision, a mixture of which is shown in Fig. 3, where the image area is first subdivided into rows and columns of a root block, which is then further subdivided into one or more leaf blocks according to a recursive multi-tree subdivision. Recursive multitree subdivision may also be referred to as recursive multitree partitioning.

[0039] Again, the data stream 14 may be coded with an intra-coding mode for the intra-coding blocks 80, which assigns one of a number of supported intra-coding modes to each intra-coding block 80. For the inter-coding blocks 82, one or more motion parameters may be coded in the data stream 14. In general terms, the inter-coding blocks 82 are not limited to being temporally coded. Alternatively, the inter-coding blocks 82 may be any block predicted from previously coded parts beyond the current picture 12 itself, such as previously coded pictures of the video to which the picture 12 belongs, or pictures of another representation or lower hierarchy if the encoder and decoder are scalable encoder and decoder, respectively.

[0040] The predicted residual signal 24'''' in Fig. 3 is also shown as a subdivision of the image area into blocks 84, which may also be called transform blocks to distinguish them from the coding blocks 80 and 82. In fact, Fig. 3 shows that the encoder 10 and the decoder 20 can use two different subdivisions into blocks of the image 12 and the image 12', respectively, one into blocks 80 and 82, respectively, and another into transform blocks 84. Both subdivisions may be the same, i.e. each coding block 80 and 82 may simultaneously constitute a transform block 84. However, Fig. 3 shows the case where the subdivision into transform blocks 84 constitutes an extension of the subdivision into the coding blocks 80, 82, for example, such that any boundary between the two blocks 80 and 82 overlaps with the boundary between the two blocks 84, or each block 80, 82 corresponds to one of the transform blocks 84 or to a cluster of transform blocks 84. However, the subdivisions may be determined or selected independently of one another, such that the transformation blocks 84 may selectively cross the block boundaries between the blocks 80, 82. Thus, as far as the subdivision into transformation blocks 84 is concerned, the same statements made above with respect to the subdivision into blocks 80, 82 apply. That is, the blocks 84 may be the result of a regular subdivision of the image area into blocks (whether or not arranged into rows and columns), a recursive multi-tree subdivision (recursive multi-tree decomposition) of the image area, or a combination of both, or any other type of blocking. It is noted in passing that the blocks 80, 82, and 84 are not limited to being square, rectangular, or any other shape.

[0041] 3 further illustrates that the combination of the prediction signal 26 and the prediction residual signal 24'''' directly results in the reconstructed signal 12'. However, it should be noted that image 12' according to alternative embodiments may be obtained by combining two or more prediction signals 26 with the prediction residual signal 24''''.

[0042] In Fig. 3, the transform blocks 84 have the following meaning. That is, the transform unit 28 and the inverse transform unit 54 perform their respective transforms in units of these transform blocks 84. For example, many codecs use some kind of DST or DCT for all transform blocks 84. For some transform blocks 84, some codecs can omit the transform so that the predicted residual signal is directly coded in the spatial domain. However, according to the embodiment described below, the encoder 10 and the decoder 20 are configured to support multiple transforms. For example, the transforms supported by the encoder 10 and the decoder 20 include the following: DCT-II (or DCT-III) (where DCT stands for discrete cosine transform) · DST-IV (where DST stands for discrete sine transform) DCT-IV DST-VII Identity Transformation (IT)

[0043] Of course, all of the forward transform types of these transforms are supported by transform unit 28, while decoder 20 or inverse transform unit 54 supports the corresponding backward or inverse transform types. Inverse DCT-II (or inverse DCT-III) Reverse DST-IV ·Inverse DCT-IV · Reverse DST-VII Identity Transformation (IT)

[0044] The following describes in more detail the subdivision or division schemes of the root block into one or more leaf blocks that can be supported by the encoder 10 and the decoder 20. For example, these division schemes can provide a means to obtain the coding blocks 80, 82 and / or the transform blocks 84, 84a.

[0045] 10A and 10B show an example of a quadtree partition and the resulting nodes (e.g., child blocks). FIG. 10A shows a partition tree in which node A is further partitioned into four nodes. FIG. 10B shows the result of this partition, where block A is subdivided into four disjoint equal-sized blocks. For example, the partitioning of node A into four nodes B, C, D, and E as shown in FIG. 10A and 10B may represent the partitioning of a parent block into child blocks, as may be performed by one recursion of a recursive multitree partitioning.

[0046] The division as shown in Figures 10A and 10B may be applied recursively. That is, for example, the division may divide a parent block into one or more child blocks, one of which may act as a parent block for another recursion of the division. For example, multiple divisions of a root block may result in one or more leaf blocks. Different leaf blocks may differ in shape and size, for example, because different leaf blocks may have been obtained by different or the same number of recursions of different or the same type of division. The number of recursions of the divisions that obtain a particular block of an image may be referred to as the tree depth of the particular block.

[0047] A scheme for dividing a parent block into child blocks may include information regarding whether to divide the parent block and information regarding how to divide the parent block, and such a scheme may be represented by a partitioning tree.

[0048] Fig. 11 shows a partitioning tree 1100 (e.g. rules for partitioning a parent block 1111 into one or more child blocks 1112) of the current VVC development, with nested binary and ternary trees. Besides existing blocks (e.g. blocks known from past codecs) resulting from the quadtree partitioning, the partitioning tree 1100 can represent, for example, other rectangular shapes. Deviations from the quadtree can occur if the quadtree partitioning flag is equal to zero. For example, if the quadtree partitioning flag indicates that the parent block 1111 is not partitioned into four child blocks, then the binary ternary tree starts at the leaf nodes of the quadtree. The binary ternary tree constitutes a recursive partitioning tree, similar to the quadtree, but with a different partitioning that can be applied at each node (e.g. each parent block), for example if the parent block is not partitioned into four child blocks. Also, not all partitions are available at all nodes, depending on the specific node characteristics, such as size, position, or tree depth. Only a flag that cannot be estimated based on already available data needs to be sent. If mtt_split_flag is signaled or estimated to be equal to zero, the split tree is terminated at this node (i.e. the corresponding node represents a leaf node and the associated block is used for prediction and transform coding).

[0049] As shown in Figure 2, up to four syntax elements are required to specify the last CU shape. In this scheme, subdivision stop requires at least two syntax elements (qt_split_flag equal to 0 and mtt_split_flag equal to 0). The context modeling for qt_split_flag is similar to the approach used in HEVC. The quadtree depth of the current node is compared with the last quadtree depth of the neighboring coding trees (above the current block and to the left of the current block). Furthermore, a separate context model set is used if the current quadtree depth is greater than 1. Instead of the quadtree depth, the width and height of the current node are compared against the width of the upper neighbor and the height of the left neighbor of mtt_split_flag. For luma components, three different context model sets are used depending on the current CU size, while for chroma components, a dedicated context model set is used. Note that if the slice type is internal, i.e. prediction inside the current picture (or slice or tile) is limited to intra-picture prediction only, then the current VVC draft allows different partitioning trees for luma and chroma.

[0050] The mtt_split_vertical_flag comes with three context models depending on the aspect ratio of the current node: one if the node is a square block, another if the width is greater than the height, and a third if the opposite is true, whereas for the mtt_split_binary_flag a single context model is used.

[0051] As mentioned above, Figures 1-3 are presented as examples in which the inventive concepts detailed below can be implemented to construct specific examples of the inventive encoder and decoder according to the present application. So far, the encoders and decoders of Figures 1 and 2 may represent possible implementations of the encoder and decoder described herein. However, Figures 1 and 2 are merely examples. However, an encoder according to embodiments of the present application may perform block-based encoding of an image 12 using concepts described below that differ from the encoder of Figure 1, for example being a still image encoder instead of a video encoder, not supporting inter-prediction, or the subdivision into blocks 80 is performed in a different manner than illustrated in Figure 3. Similarly, a decoder according to an embodiment of the present application may perform block-based decoding from the data stream 14 of the image 12′ using the coding concepts detailed below, but may differ from the decoder 20 of FIG. 2, for example in that it is a still image encoder rather than a video encoder, that it does not support intra prediction or that it subdivides the image 12′ into blocks in a different manner than described with respect to FIG. 3, and / or that it derives the prediction residual from the data stream 14 in the spatial domain rather than the transform domain.

[0052] FIG. 4 illustrates an apparatus 400 for decoding an image 12′ according to an embodiment of the present disclosure. For example, the apparatus 400 may be similar to the decoder 20. The apparatus 400 is configured to partition the image 12′ into coding blocks 425 using recursive multi-tree partitioning in response to partitioning information 415 signaled in the data stream 14. The apparatus 400 is further configured to decode the image 12′ from coding information 440 signaled in the data stream 14. The coding information 416 is related to the coding blocks 425. In case of partitioning the image 12′ into coding blocks 425, the apparatus 400 is configured to decode a partition flag 416 of the partitioning information 415 from the data stream 14. The partition flag 416 indicates whether a given block 411 of the image 12′ is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block 411 is one of the coding blocks 425. If the split flag 416 indicates that the given block 411 of the image 12' is split, the device 400 is configured to decode from the data stream 14 a quad flag 417 of the split information 415 indicating whether the given block 411 of the image 12' is split into four child blocks 412.

[0053] If the split flag 416 indicates that a given block of image 12' is to be split and the quad flag 417 indicates that the given block 411 of image 12' is not to be split into four child blocks 412, splitting the image 12' includes decoding one or more further flags 418 of the split information 415 from the data stream 14 that indicate whether the given block 411 of image 12' is to be split vertically or horizontally into two or three child blocks 412.

[0054] Further, if the split flag 416 indicates that the given block 411 of the image 12′ is to be split, splitting the image 12′ includes resuming the recursive multi-tree splitting for the child block 412 using a further flag in the split information 415. For example, in another recursion of the recursive multi-tree splitting, one of the child blocks 412 may be the given block 411.

[0055] For example, the device 400 may be configured to receive a data stream 14 including the partition information 415 and the coding information 440. The device 400 may further be configured to decode the image 12' from the data stream to provide a decoded signal including the image 12'. For example, the given block 411 may be any block of the image 12' that is subject to a current recursion of the recursive multiple tree partitioning, i.e., a block for which the current recursion may estimate a partition. For example, the given block 411 of the first recursion of the recursive multiple tree partitioning may be a root block, such as a CTU. If the partition flag 416 indicates that the given block 411 of the image 12' is partitioned, the device 400 is configured to resume the recursive multiple tree partitioning for child blocks of the given block 411. The child blocks 412 may be one or more sub-blocks of the given block 411 resulting from a partition of the given block 411. For example, the apparatus 400 may be configured to resume the recursive multi-tree partitioning by selecting one of the child blocks 412 of the given block as the given block 411 of a subsequent recursion of the partitioning and performing the partitioning as described for the given block. For example, if the partitioning flag 416 indicates that the given block 411 of the image 12' is not to be partitioned, the apparatus 400 may be configured to stop the recursive multi-tree partitioning at the state where the given block 411 is one of the coding blocks 425. The apparatus 400 may then continue the partitioning at another block (e.g., an older sister block of the given block or an older sister block of a parent block of the given block or another block).

[0056] Thus, according to one embodiment, the apparatus 400 is configured to resume recursive multiple tree partitioning for the child block 412 using a further flag in the partitioning information 415 by decoding from the data stream 14 another split flag 416 in the partitioning information 415 indicating whether the given child block of the image 12' is split or not, thereby stopping the recursive multiple tree partitioning at the state where the given child block becomes a coding block, for the given child block of the child blocks 412. If the further split flag 416 indicates that the given child block of the image 12' is split, resuming the recursive multiple tree partitioning for the child block 412 includes decoding from the data stream 14 another quad flag 417 in the partitioning information 415 indicating whether the given child block of the image 12' is split or not into four child blocks 412. If the further split flag 416 indicates that the given child block of image 12′ is split and the further quad flag 417 indicates that the given child block of image 12′ is not split into four child blocks 412, then resuming the recursive multiple tree partitioning for the child block 412 includes decoding from the data stream 14 one or more further flags 418 of the partition information 415 that indicate whether the given child block of image 12′ is split vertically or horizontally into two or three child blocks 412. Furthermore, if the further split flag 416 indicates that the given child block of image 12′ is split, then resuming the recursive multiple tree partitioning for the child block 412 of the given child block includes resuming the recursive multiple tree partitioning for the child block 412 of the given child block using the further flag of the partition information 415.

[0057] That is, for example, the apparatus 400 may be configured to resume recursive multitree splitting for a child block 412 in one recursion of the recursive multitree splitting by selecting one of the child blocks 425 resulting from splitting the given block 411 for a subsequent recursion of the recursive multitree splitting. For example, the recursive splitting may be stopped if a split flag 416 referencing the given block 411 (e.g., the given block or a given child block) of the current recursion indicates that the given block 411 is not to be split.

[0058] For example, the division of node A into four nodes B, C, D, and E as shown in Figures 10A and 10B may represent the division of a given block 411 into child blocks 412, such as a possible outcome of one recursion of a recursive multitree partitioning, as described with respect to apparatus 400 and the apparatus in subsequent figures.

[0059] 12 illustrates an alternative partitioning tree 1200 that separates partitioning and type information (e.g., information about the type of partitioning). For example, partitioning tree 1200 may represent one recursion of a recursive partitioning according to an exemplary embodiment of apparatus 400.

[0060] As a characteristic of the partitioning tree 1100 in FIG. 11, the "stop partitioning" option requires the transmission of two syntax elements. For example, a first syntax element may be required to indicate that no quadtree partitioning is performed, and a second syntax element may be required to indicate that the parent block 1111 is not to be further partitioned. Since partitioning information can be expressed independently of the subsequent shape type, an exemplary embodiment of the present invention modifies the partitioning tree as shown in FIG. 12. Note that when the second depth is reached, i.e., when mtt_vertical_flag is transmitted, the syntax remains the same for the partitioning tree 1100 shown in FIG. 11. Therefore, the modification of the syntax elements mtt_vertical_flag and mtt_split_binary_flag is applicable to the bisection schemes shown in both FIG. 11 and FIG. 12. For example, the partitioning scheme of the embodiment of the present invention may be similar to the partitioning tree 1100 in FIG. 1100, but may use modified syntax to specify the type of partitioning. By separating the partitioning and type information, the cost of the partitioning stop option can be reduced, which can be important at low bitrate operating points.

[0061] In other words, embodiments of the present invention describe a general concept that further improves compression efficiency by involving adaptive tree structures and associated context modeling.

[0062] For example, the partitioning trees shown in Figures 11 and 12 may represent only the common case where all options are possible. However, each node may inherit availability restrictions. Examples of such restrictions are size restrictions (e.g., partitioning stops are allowed where a child node has a dimension smaller than the minimum allowed block size), consecutive partitioning restrictions (e.g., only quadtree partitioning can be signaled if the previous partition was also a quadtree partitioning). For these reasons, each syntax element in the partitioning tree may slightly change its meaning depending on the specific availability restrictions. That is, for example, for a given block 411, some or all options of partitioning may be unavailable.

[0063] In an embodiment of the present invention, the context modeling for syntax elements of the partitioning tree may explicitly use availability information (e.g., information about options available for partitioning a given block 411). The availability information enhances the context modeling, e.g., to allow additional options for the context modeling. For example, the context model may be used to estimate information indicated by a given flag in the partitioning information 415, such that the information is estimated without decoding the given flag. Thus, the partitioning information 415 does not necessarily have to include the given flag, which may reduce the size of the data stream 14. For example, the context modeling may depend on one or more criteria.

[0064] In general, embodiments of the present invention may employ various implementations of partition trees for recursively partitioning an image. The partitioning may be based on a number of flags, each of which may indicate whether the partitioning option it refers to is applicable for a given block undergoing a current recursion of the recursive partitioning. These flags may be part of the partitioning information that may be included in the data stream. However, the flags may be inferred from said availability information. Furthermore, context modeling from the data stream or partitioning information may be used when decoding the flags. For example, context modeling may use available information to reduce the number of possible options, thereby reducing the size of the data stream by encoding or decoding one or more flags to or from less information. For example, partitioning of an image may be based on one or more of the partition flags 416, the quadrant flags 417, the partition direction flags 518, and the trisection flags 519. An exemplary order for evaluating such flags is shown in FIG. 12. Each of the embodiments described with respect to FIGS. 4-9 and 13-18 may employ different orders or dependencies or conditions for evaluating or decoding one or more of the flags. For example, different types of context modeling may be employed, which may for example rely on the availability information mentioned above, or on information about neighboring blocks (e.g., blocks that have been partitioned).

[0065] For example, the first context may be used to decode the split flag 416, but different embodiments may employ different criteria, assumptions, or information for deriving the first context.

[0066] For example, the second context may be used to decode the split direction flag 418, but different embodiments may employ different criteria, assumptions, or information for deriving the second context.

[0067] For example, a third context may be used to decode the ternary flag 419, although different embodiments may employ different criteria, assumptions, or information for deriving the third context.

[0068] In other words, the context modeling of some or all of the syntax elements of the partition tree may be determined only by the availability information. Secondly, the context modeling of some or all of the syntax elements of the partition tree may be a mixture of the availability information and some other information (e.g., partition structure information of adjacent blocks (tree depth or size)).

[0069] According to one embodiment, the apparatus 400 may be configured to infer that one or more flags of the split information 415 assume a predefined flag state without the one or more flags of the split information 415 being decoded from the data stream 14 depending on whether one or more criteria are met.

[0070] For example, data stream 14 does not necessarily include all or some of the partition flags 416, quad flags 417, and further flags 418 of a given block. For example, device 400 may be configured to infer the flag states of one, more, or all of said flags of a given block from information about the given block 411 or adjacent blocks.

[0071] According to an embodiment, the one or more criteria relate to one or more of child block area, child block width, child block height, current division depth, and division line alignment with image border. For example, there may be a lower limit on the area, width, or height of the child block 425 resulting from the division of the given block 411. The device 400 may predict the criteria for the child block 425, thereby inferring that one or more flags of the division information 415 (e.g., the division flag 416, the quad flag 417, or one or more further flags 418) assume a given flag state. For example, the device 400 may infer that the criteria will not cause the given block 411 to be further divided or that the given block 411 will not be divided into four child blocks 412. For example, the current division depth may represent a tree depth or a quad tree depth, i.e., the number of recursions of a recursive division performed to obtain, for example, the given block 411.

[0072] According to one embodiment, the apparatus 400 is configured to initiate a recursive multi-tree decomposition at each root block where the image 12' is subdivided into rows and columns.

[0073] According to one embodiment, the apparatus 400 is configured to initiate a recursive multi-tree partitioning at a root block where the image 12' is subdivided into rows and columns.

[0074] According to one embodiment, the device 400 is configured to infer that the quad flag 417 indicates that a given block 411 of the image 12' is not divided into four child blocks 412 if a first predetermined criterion is met, and to suppress decoding of the quad flag 417 from the data stream 14.

[0075] According to one embodiment, the apparatus 400 is configured such that a first predetermined criterion is met if the given block 411 is derived from a non-quadrant of a parent block.

[0076] According to one embodiment, the device 400 is configured to decode from the data stream 14 a split direction flag indicating whether the given block 411 of the image 12' is split vertically or horizontally for decoding the one or more further flags 418. Furthermore, for decoding the one or more further flags 418, the device 400 may be configured to decode from the data stream 14 a trisection flag indicating whether the given block 411 of the image 12' is split into three child blocks 412 or two child blocks 412.

[0077] According to one embodiment, the device 400 is configured to infer that the split direction flag indicates that a given block 411 of the image 12' is split in the vertical direction and to suppress decoding of the split direction flag from the data stream 14 if a second predetermined criterion is met, and to infer that the split direction flag indicates that a given block 411 of the image 12' is split in the horizontal direction and to suppress decoding of the split direction flag from the data stream 14 if a third predetermined criterion is met.

[0078] According to one embodiment, the second predetermined criterion is met if, by bisecting the given block 411 horizontally, the width is less than a predetermined minimum dimension, and the third predetermined criterion is met if, by bisecting the given block 411 vertically, the height is less than a predetermined minimum dimension.

[0079] According to one embodiment, the device 400 is configured to infer that the triangular flag indicates that a given block 411 of the image 12' is split into two child blocks 412 if a fourth predetermined criterion is met, and to suppress decoding of the triangular flag from the data stream 14.

[0080] According to one embodiment, the device 400 is configured to deduce that the triangular flag indicates that a given block 411 of the image 12' is split into two child blocks 412 if a fourth predetermined criterion is met and to suppress decoding of the triangular flag from the data stream 14, and further to deduce that the triangular flag indicates that a given block 411 of the image 12' is split into three child blocks 412 if a fifth predetermined criterion is met and to suppress decoding of the triangular flag from the data stream 14.

[0081] According to one embodiment, the fourth predetermined criterion is met if dividing the given block 411 into thirds in the split direction indicated by the directional flag results in a dimension of the given block 411 along the split direction falling below a predetermined minimum dimension.

[0082] According to one embodiment, the fifth predetermined criterion is met if bisecting the given block 411 in the split direction indicated by the directional flag would cause a dimension of the given block 411 along the split direction to exceed a predetermined maximum dimension.

[0083] According to one embodiment, the apparatus 400 is configured to resume recursive multiple tree partitioning for a given one of the child blocks 412 using a further flag of the partitioning information 415 by decoding from the data stream 14 a further quad flag 417 of the partitioning information 415 indicating whether the given child block of the image 12' is split into four child blocks 412. If the further quad flag 417 indicates that the given child block of the image 12' is not split into four child blocks 412, resuming recursive multiple tree partitioning for the given child block includes decoding from the data stream 14 a further split flag 416 of the partitioning information 415 indicating whether the given child block of the image 12' is split or not, thereby stopping the recursive multiple tree partitioning with the given child block becoming a coding block. If the further quad flag 417 indicates that the given child block of image 12′ is not to be split into four child blocks 412 and the further split flag 416 indicates that the given child block of image 12′ is to be split, resuming the recursive multiple tree partitioning for the given child block includes decoding from data stream 14 one or more further flags 418 of partition information 415 that indicate whether the given child block of image 12′ is to be split vertically or horizontally into two or three child blocks 412. If the further quad flag 417 indicates that the given child block of image 12′ is not to be split into four child blocks 412 or if the further split flag 416 indicates that the given child block of image 12′ is to be split, resuming the recursive multiple tree partitioning for the given child block includes resuming the recursive multiple tree partitioning for the child blocks 412 of the given child block using the further flag of partition information 415. That is, for example, the order of the split flags 416 and the quaternion flags 417 may be different for different recursions of the recursive division.

[0084] According to one embodiment, the device 400 is configured to deduce that the quad flag 417 indicates that a given block 411 of the image 12' is not split into four child blocks 412 if a first predefined criterion is met, and to suppress decoding of the quad flag 417 from the data stream 14. According to this embodiment, the device 400 is further configured to decode a split flag 416 of the split information 415 from the data stream 14 by context-adaptive entropy decoding using a first context depending on whether the first predefined criterion is met. For example, in the bisection presented in FIG. 12, the split_flag (eg, split flag 416) may be modeled as shown in Table 1 (see FIG. 19), subject to the following information: ·Quadtree partitioning (QT) availability Current quadtree depth Current width and height Current luminance area Upper adjacent width Left adjacent part height

[0085] 19 shows an example context modeling of the syntax element split_flag (e.g., split flag 416) using availability information and existing context modeling, which is conditional on the availability of quadtree split (QT), the current quadtree depth, the current width and height, the current luminance area (W×H), and the width of the top neighbor and the height of the left neighbor.

[0086] According to one embodiment, the first context is further determined by the number of divisions of the recursive multitree division used in obtaining the given block 411. For example, such a dependency may be modeled as shown in the second column of Table 1. Alternatively or additionally, the first context is further determined by the size of the given block 411. For example, such a dependency may be modeled as shown in the third column of Table 1.

[0087] According to one embodiment, the first context is further determined or distinguished by the number of recursive multitree partitions used to obtain the given block 411 being below a predetermined threshold number of partitions, or the first context is further determined or distinguished by the size of the given block 411 being above a predetermined threshold size.

[0088] According to one embodiment, the first context is further determined by the width of the coding block above the given block 411 and the height of the coding block to the left of the given block 411. An example of such a dependency of the context model is shown in the fourth and fifth columns of Table 1.

[0089] According to one embodiment, the first context is: The width of the coding block above the given block 411 is smaller than the width of the given block 411, and the height of the coding block to the left of the given block 411 is smaller than the height of the given block 411, or Whether the width of a coding block above the given block 411 is smaller than the width of the given block 411 and the height of a coding block to the left of the given block 411 is greater than the height of the given block 411; and The width of a coding block above the given block 411 is smaller than the width of the given block 411, and the height of a coding block to the left of the given block 411 is larger than the height of the given block 411, or the width of a coding block above the given block 411 is larger than the width of the given block 411, and the height of a coding block to the left of the given block 411 is smaller than the height of the given block 411, which further determines and distinguishes between them. For example, such dependencies of the context model are represented by the context modeling shown in Table 1 of FIG.

[0090] According to one embodiment, the apparatus 400 is configured to perform a division into four child blocks 412 that are of equal size and arranged in a 2×2 array. According to this embodiment, the apparatus 400 is configured to perform the recursive multitree division using a depth-first traversal order from left to right for horizontal divisions and from top to bottom for vertical divisions, and to traverse the child blocks resulting from the division of one parent block in a row-wise raster scan order from top left to bottom right for division into four child blocks 412.

[0091] According to an embodiment, for decoding from the data stream 14 one or more further flags 418 of the partition information 415 indicating whether the given block 411 of the image 12' is divided vertically or horizontally into two or three child blocks 412, the device 400 is configured to decode from the data stream 14 a partition direction flag indicating whether the given block 411 of the image 12' is divided vertically or horizontally and to decode from the data stream 14 a trisection flag indicating whether the given block 411 of the image 12' is divided into three or two child blocks 412. Furthermore, if a first predetermined criterion is met, the device 400 is configured to deduce that the quaternary flag 417 indicates that the given block 411 of the image 12' is not divided into four child blocks 412 and to suppress the decoding from the data stream 14 of the quaternary flag 417. If a second predetermined criterion is met, the device 400 is configured to deduce that the splitting method flag indicates that the given block 411 of the image 12' is split vertically and suppress the decoding of the split direction flag from the data stream 14. If a third predetermined criterion is met, the device 400 is configured to deduce that the splitting method flag indicates that the given block 411 of the image 12' is split horizontally and suppress the decoding of the split direction flag from the data stream 14. If a fourth predetermined criterion is met, the device 400 is configured to deduce that the trichotomy flag indicates that the given block 411 of the image 12' is split into two child blocks 412 and suppress the decoding of the trichotomy flag from the data stream 14. Furthermore, the device is configured to decode the split flag 416 of the split information 415 from the data stream 14 by context-adaptive entropy decoding using a first context that depends on a sum of addends that are respectively associated with one of the following scenarios and assume a non-zero value if met and zero otherwise: The first specified criterion is not met - The second specified criterion is not met. The third specified criterion is not met. If the second predetermined criterion is not met and the division direction indicated by the division direction flag is horizontal, the fourth predetermined criterion is not met. If the third predetermined criterion is not met and the division direction indicated by the division direction flag is vertical, the fourth predetermined criterion is not met. For example, we consider Tx to imply Bx, and use the following Boolean logic rules to describe agreement with the above statement: First predefined criterion: not QT, i.e., QT The second predefined criterion: not((not BH)and(not TH)), i.e., BH or TH Third predefined criterion: not ((not BV) and (not TV)), i.e., BV or TV The fourth predetermined criterion: (not((not BH)and(not TH)))and(not(not TH)), i.e. (BH or TH)and TH, i.e. TH Fifth predetermined criterion: (not((not BV)and(not TV)))and(not(not TV)), i.e. (BV or TV)and TV, i.e. TV

[0092] According to one embodiment, the device 400 is configured to decode from the data stream 14 one or more further flags 418 of the partition information 415 indicating whether the given block 411 of the image 12' is split vertically or horizontally into two or three child blocks 412, and to decode from the data stream 14 a partition direction flag indicating whether the given block 411 of the image 12' is split vertically or horizontally, and to decode from the data stream 14 a trisection flag indicating whether the given block 411 of the image 12' is split into three or two child blocks 412. The device 400 is further configured to deduce that the quaternary flag 417 indicates that the given block 411 of the image 12' is not split into four child blocks 412 and to suppress the decoding of the quaternary flag 417 from the data stream 14 if a first predetermined criterion is met. The apparatus 400 is further configured to deduce that the split direction flag indicates that the given block 411 of the image 12' is split vertically if a second predetermined criterion is met, and suppress decoding of the split direction flag from the data stream 14. The apparatus 400 is further configured to deduce that the split direction flag indicates that the given block 411 of the image 12' is split horizontally if a third predetermined criterion is met, and suppress decoding of the split direction flag from the data stream 14. The apparatus 400 is further configured to deduce that the trichotomous flag indicates that the given block 411 of the image 12' is split into two child blocks 412 if a fourth predetermined criterion is met, and suppress decoding of the trichotomous flag from the data stream 14 if a fifth predetermined criterion is met, and suppress decoding of the trichotomous flag from the data stream 14. The apparatus 400 is further configured to decode a split flag 416 of the split information 415 from the data stream 14 by context-adaptive entropy decoding using a first context that depends on a sum of addends respectively associated with one of the following scenarios:Each addend assumes a non-zero value if the respective scenario is satisfied, and zero otherwise. The first specified criterion is not met If the second predetermined criterion is not met and the division direction indicated by the division direction flag is horizontal, the fifth predetermined criterion is not met. If the third predetermined criterion is not met and the division direction indicated by the division direction flag is vertical, the fifth predetermined criterion is not met. If the second predetermined criterion is not met and the division direction indicated by the division direction flag is horizontal, the fourth predetermined criterion is not met. If the third predetermined criterion is not met and the division direction indicated by the division direction flag is vertical, the fourth predetermined criterion is not met.

[0093] According to one embodiment, the first context further depends on and distinguishes between one third of the sum of the addends plus one resulting in 0, one and two. According to this embodiment, the non-zero value of the addend associated with the first predefined criterion that is not met is 2 and the non-zero value of the other addends is 1.

[0094] According to one embodiment, the first context is further determined by the width of the coding block above the given block 411 and the height of the coding block to the left of the given block 411 .

[0095] According to one embodiment, the first context is: The width of the coding block above the given block 411 is smaller than the width of the given block 411, and the height of the coding block to the left of the given block 411 is smaller than the height of the given block 411, or The width of the coding block above the given block 411 is smaller than the width of the given block 411, and the height of the coding block to the left of the given block 411 is greater than the height of the given block 411, or The width of a coding block above the given block 411 is smaller than the width of the given block 411, and the height of a coding block to the left of the given block 411 is larger than the height of the given block 411, or the width of a coding block above the given block 411 is larger than the width of the given block 411, and the height of a coding block to the left of the given block 411 is smaller than the height of the given block 411, which further determines and distinguishes between them. In other words, the modeling of split_flag (e.g., the first context that decodes the split flag 416) is s The number of available divisions, N, is defined as: = (2·QT+BH+BV+TH+TV-1) s where QT, BH, BV, TH, and TV represent the availability of 4th, 2nd, 2nd, 3rd, and 4th divisions. Thus, for example, an alternative context modeling of the first context decoding the split flag 416 may depend on: · Number of available divisions N s Current width and height Upper adjacent width Left adjacent part height

[0096] Table 2 shown in FIG. 20 illustrates the availability of all splits as well as alternative context modeling of the syntax element split_flag (eg, split flag 416) depending on the size of the neighboring block.

[0097] According to one embodiment, the device 400 is configured to decode from the data stream 14 a split direction flag indicating whether the given block 411 of the image 12' is split vertically or horizontally if neither the second nor the third predetermined criterion is met in decoding from the data stream 14 one or more further flags 418 of the split information 415 indicating whether the given block 411 of the image 12' is split vertically or horizontally into two or three child blocks 412. If the second predetermined criterion is met, decoding the one or more further flags 418 includes estimating the split direction flag to indicate that the given block 411 of the image 12' is split vertically. If the third predetermined criterion is met, decoding the one or more further flags 418 includes estimating the split direction flag to indicate that the given block 411 of the image 12' is split horizontally. If the fourth predetermined criterion is not met, decoding the one or more further flags 418 includes decoding a trichotomous flag from the data stream 14 indicating whether the given block 411 of the image 12' is split into three child blocks 412 or two child blocks 412. If the fourth predetermined criterion is met, decoding the one or more further flags 418 includes deducing that the trichotomous flag indicates that the given block 411 of the image 12' is split into two child blocks 412. Furthermore, the apparatus 400 is The fourth predetermined criterion is not satisfied when the division direction indicated by the division direction flag is the horizontal direction and is not satisfied when the division direction indicated by the division direction flag is the vertical direction, or is satisfied when the division direction indicated by the division direction flag is the horizontal direction and is not satisfied when the division direction indicated by the division direction flag is the vertical direction; the fourth predetermined criterion is satisfied when the division direction indicated by the division direction flag is a horizontal direction, and is not satisfied when the division direction indicated by the division direction flag is a vertical direction; the fourth predetermined criterion is not satisfied when the division direction indicated by the division direction flag is a horizontal direction, and is satisfied when the division direction indicated by the division direction flag is a vertical direction; and is adapted to decode the split direction flag from the data stream 14 by context adaptive entropy decoding using a second context that distinguishes between them.

[0098] According to one embodiment, the device 400 is configured to decode from the data stream 14 a split direction flag indicating whether the given block 411 of the image 12' is split vertically or horizontally if neither the second nor the third predetermined criterion is met in decoding from the data stream 14 one or more further flags 418 of the split information 415 indicating whether the given block 411 of the image 12' is split vertically or horizontally into two or three child blocks 412. If the second predetermined criterion is met, decoding the one or more further flags 418 includes estimating the split direction flag to indicate that the given block 411 of the image 12' is split vertically. If the third predetermined criterion is met, decoding the one or more further flags 418 includes estimating the split direction flag to indicate that the given block 411 of the image 12' is split horizontally. If neither the fourth nor the fifth predetermined criterion is met, the decoding of the one or more further flags 418 includes decoding a trichotomous flag from the data stream 14, the trichotomous flag indicating whether the given block 411 of the image 12' is split into three or two child blocks 412. If the fourth predetermined criterion is met, the decoding of the one or more further flags 418 includes presuming that the trichotomous flag indicates that the given block 411 of the image 12' is split into two child blocks 412 and suppressing the decoding of the trichotomous flag from the data stream 14. If the fifth predetermined criterion is met, the decoding of the one or more further flags 418 includes presuming that the trichotomous flag indicates that the given block 411 of the image 12' is split into three child blocks 412 and suppressing the decoding of the trichotomous flag from the data stream 14. Furthermore, the apparatus 400 is A first criterion number of the fourth predetermined criterion and the fifth predetermined criterion that are satisfied when the division direction indicated by the division direction flag is the horizontal direction is equal to a second criterion number of the fourth predetermined criterion and the fifth predetermined criterion that are satisfied when the division direction indicated by the division direction flag is the vertical direction; and the first number is greater than the second number; and the first number is smaller than the second number; and and is adapted to decode the split direction flag from the data stream 14 by context adaptive entropy decoding using a second context that distinguishes between them.

[0099] FIG. 5 illustrates an apparatus 500 for decoding an image 12′ according to an embodiment of the present disclosure. For example, the apparatus 500 may be similar to the decoder 20. The apparatus 500 is configured to partition the image 12′ into coding blocks 425 using recursive multi-tree partitioning according to partitioning information 415 signaled in the data stream 14. Furthermore, the apparatus 500 is configured to decode the image 12′ from coding information 440 signaled in the data stream 14 and related to the coding blocks 425. The apparatus 500 is configured to partition the image 12′ into coding blocks 425 according to partitioning information 415 signaled in the data stream 14 by decoding from the data stream 14 a partition flag 416 and a quad flag 417 of the partitioning information 415 indicating whether a given block 411 of the image 12′ is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block 411 is one of the coding blocks 425. The quadrant flag 417 indicates whether the given block 411 of the image 12' is split into four child blocks 412. If the given block 411 of the image 12' is split but not into four child blocks 412 and neither the second nor the third predetermined criterion is met, splitting the image 12' includes decoding a split direction flag 518 from the data stream 14, which indicates whether the given block 411 of the image 12' is split vertically or horizontally. If the given block 411 of the image 12' is split but not into four child blocks 412 and the second predetermined criterion is met, splitting the image 12' includes inferring that the split direction flag 518 indicates that the given block 411 of the image 12' is split vertically. If the given block 411 of the image 12' is split but not into four child blocks 412, and a third predetermined criterion is met, splitting the image 12' includes inferring that the split direction flag 518 indicates that the given block 411 of the image 12' is split horizontally.If the given block 411 of the image 12' is split but not into four child blocks 412 and the fourth predefined criterion is not met, splitting the image 12' includes decoding a trichotomy flag 519 from the data stream 14 indicating whether the given block 411 of the image 12' is split into three or two child blocks 412. If the given block 411 of the image 12' is split but not into four child blocks 412 and the fourth predefined criterion is met, splitting the image 12' includes inferring that the trichotomy flag 519 indicates that the given block 411 of the image 12' is split into two child blocks 412. If the given block 411 of the image 12' is split, splitting the image 12' includes resuming recursive multi-tree splitting for the child blocks 412 using a further flag in the split information 415. Additionally, the apparatus 500. The fourth predetermined criterion is not satisfied when the division direction indicated by the division direction flag 518 is the horizontal direction, nor is it satisfied when the division direction indicated by the division direction flag 518 is the vertical direction, or is satisfied when the division direction indicated by the division direction flag 518 is the horizontal direction, nor is it satisfied when the division direction indicated by the division direction flag 518 is the vertical direction; The fourth predetermined criterion is satisfied when the division direction indicated by the division direction flag 518 is horizontal, and is not satisfied when the division direction indicated by the division direction flag 518 is vertical; The fourth predetermined criterion is not satisfied when the division direction indicated by the division direction flag 518 is horizontal, and is satisfied when the division direction indicated by the division direction flag 518 is vertical; The split direction flag 518 is adapted to be decoded from the data stream 14 by context-adaptive entropy decoding using a second context 552 which is determined by and distinguishes between the first and second contexts 552 .

[0100] 6 shows an apparatus 600 for decoding an image 12' according to an embodiment of the present disclosure. For example, the apparatus 500 may be similar to the decoder 20. Compared to the apparatus 600, the apparatus 500 may additionally use a fifth criterion for estimating a predefined state of the trichotomy flag 519 and may differ in the second context used for decoding the split direction flag 518.

[0101] The device 600 is configured to partition the image 12' into coding blocks 425 using recursive multi-tree partitioning in response to partition information 415 signaled in the data stream 14 and to decode the image 12' from coding information 440 signaled in the data stream 14 and related to the coding blocks 425. The device 600 is configured to partition the image 12' into coding blocks 425 in response to partition information 415 signaled in the data stream 14 by decoding from the data stream 14 a partition flag 416 and a quad flag 417 of the partition information 415 indicating whether a given block 411 of the image 12' is partitioned or not and thus stopping the recursive multi-tree partitioning when the given block 411 is one of the coding blocks 425. The quad flag 417 indicates whether a given block 411 of the image 12' is partitioned or not into four child blocks 412. If the given block 411 of the image 12' is split but not into four child blocks 412 and neither the second nor the third predetermined criterion is met, splitting the image 12' includes decoding a split direction flag 518 from the data stream 14, the split direction flag 518 indicating whether the given block 411 of the image 12' is split vertically or horizontally. If the given block 411 of the image 12' is split but not into four child blocks 412 and the second predetermined criterion is met, splitting the image 12' includes inferring the split direction flag 518 to indicate that the given block 411 of the image 12' is split vertically. If the given block 411 of the image 12' is split but not into four child blocks 412 and the third predetermined criterion is met, splitting the image 12' includes inferring the split direction flag 518 to indicate that the given block 411 of the image 12' is split horizontally.If the given block 411 of the image 12' is split but not into four child blocks 412 and the fourth predetermined criterion is not met, splitting the image 12' includes decoding a trichotomy flag 519 from the data stream 14 indicating whether the given block 411 of the image 12' is split into three child blocks 412 or two child blocks 412. If the given block 411 of the image 12' is split but not into four child blocks 412 and if a third predefined criterion is met, the splitting of the image 12' includes inferring that the trichotomy flag 519 indicates that the given block 411 of the image 12' is split into two child blocks 412 if a fourth predefined criterion is met and that the trichotomy flag 519 indicates that the given block 411 of the image 12' is split into three child blocks 412 if a fifth predefined criterion is met, and suppressing decoding of the trichotomy flag 519 from the data stream 14. If the given block 411 of the image 12' is split, the splitting of the image 12' includes resuming recursive multi-tree splitting for the child blocks 412 using a further flag in the split information 415. The apparatus 600 is further configured to decode the split direction flag 518 from the data stream 14 by context adaptive entropy decoding using the second context 552. According to the present embodiment, the second context 552 depends on and distinguishes between the following scenarios, which are met: An example of a scenario for the second context 552 is shown in FIG. The first number of the fourth predetermined criterion and the fifth predetermined criterion that are satisfied when the division direction indicated by the division direction flag 518 is the horizontal direction is equal to the second number of the fourth predetermined criterion and the fifth predetermined criterion that are satisfied when the division direction indicated by the division direction flag 518 is the vertical direction (this case may be represented by scenario 791 in FIG. 7). The first number is greater than the second number (this case may be represented by scenario 792 in FIG. 7). The first number is smaller than the second number (this case may be represented by scenario 793 in FIG. 7).

[0102] According to one embodiment, the second context 552 is - The width of the given block 411 is equal to the height of the current block, - The width of the given block 411 is greater than the height of the current block, - The width of the given block 411 is smaller than the height of the current block, which further determines and distinguishes between them.

[0103] According to one embodiment, if the fourth predetermined criterion is not satisfied when the split direction flag 518 indicates that the split direction is horizontal and when the split direction flag 518 indicates that the split direction is vertical, or is satisfied when the split direction flag 518 indicates that the split direction is horizontal and when the split direction flag 518 indicates that the split direction is vertical, the second context 552 is Whether the width of the given block 411 is equal to the height of the current block (e.g., the height of the given block 411); Whether the width of the given block 411 is greater than the height of the current block (e.g., the height of the given block 411); The width of the given block 411 is smaller than the height of the current block (e.g., the height of the given block 411), which further determines and distinguishes between them.

[0104] According to the present embodiment, if the fourth predetermined criterion is satisfied when the split direction flag 518 indicates that the split direction is horizontal or when the split direction flag 518 indicates that the split direction is vertical, the second context 552 is - The width of the given block 411 is equal to the height of the current block, - The width of the given block 411 is greater than the height of the current block, - The width of the given block 411 is smaller than the height of the current block, does not distinguish between In other words, in the case of mtt_split_vertical_flag (e.g., split direction flag 518), two spare contexts may be employed in case the number of possible results of the syntax element becomes unstable. For example, the context modeling of the second context may be: The current width and height, Availability of horizontal and vertical divisions (BH and BV) and Availability of horizontal and vertical thirds (TH and TV) and It may be determined by:

[0105] Table 3 shown in Figure 21 illustrates an example context modeling of the mtt_split_vertical_flag syntax element, as may be adopted for the second context of decoding the split direction flag 518. W and H represent the width and height of the current node. BH, TH, BV, and TV represent the availability of horizontal and vertical bisection and trisection syntax elements. If either BH+TH or BV+TV is equal to 0, the value of the syntax element can be inferred and no context modeling is required.

[0106] Alternatively, another dependency that can be exploited for better context modeling of mtt_split_vertical_flag (e.g., split direction flag 518) is the size with respect to the upper and left neighbors. Given that block sizes are locally correlated, partitions that subdivide a block into parts that are more similarly shaped to its neighbors are more likely to occur than other partitions. A simple formulation of this dependency is d0=w / w above , d1=h / h left This can be achieved based on two variables: w and h are the current width and height, and w above is the width of the upper adjacent block, and h left is the height of the left neighboring block). An alternative context modeling for mtt_split_vertical_flag is Availability of the left and upper flanks; The current width and height, The height of the left adjacent part, -Width of the upper abutment; Availability of horizontal and vertical divisions (BH and BV) and Availability of horizontal and vertical thirds (TH and TV) and is determined by.

[0107] Table 4 in Figure 22 shows an example of such context modeling of mtt_split_vertical_flag based on split availability and similarity of the current block shape to neighboring CU shapes (represented by d0 and d1 as described above). For example, the illustrated context modeling may be applied to a second context that decodes the split direction flag 518.

[0108] Thus, according to one embodiment, the second context 552 is: a first ratio between the width of the given block 411 and the width of the coding block above the given block 411 is equal to a second ratio between the height of the current block and the height of the coding block to the left of the given block 411, The first ratio is greater than the second ratio, or The first ratio is less than the second ratio, or which further determines and distinguishes between them.

[0109] According to one embodiment, if the fourth predetermined criterion is not satisfied when the split direction flag 518 indicates that the split direction is horizontal and when the split direction flag 518 indicates that the split direction is vertical, or is satisfied when the split direction flag 518 indicates that the split direction is horizontal and when the split direction flag 518 indicates that the split direction is vertical, the second context 552 is a first ratio between the width of the given block 411 and the width of the coding block above the given block 411 is equal to a second ratio between the height of the current block and the height of the coding block to the left of the given block 411, The first ratio is greater than the second ratio, or The first ratio is less than the second ratio, or which further determines and distinguishes between them.

[0110] According to the present embodiment, if the fourth predetermined criterion is satisfied when the split direction flag 518 indicates that the split direction is horizontal or when the split direction flag 518 indicates that the split direction is vertical, the second context 552 is a first ratio between the width of the given block 411 and the width of the coding block above the given block 411 is equal to a second ratio between the height of the current block and the height of the coding block to the left of the given block 411, The first ratio is greater than the second ratio, or The first ratio is less than the second ratio, or does not distinguish between

[0111] According to one embodiment, the second context 552 is The fourth predetermined criterion is not satisfied when the division direction flag 518 indicates that the division direction is horizontal, and is not satisfied when the division direction flag 518 indicates that the division direction is vertical; and Whether the fourth predetermined criterion is satisfied both when the division direction indicated by the division direction flag 518 is the horizontal direction and when the division direction indicated by the division direction flag 518 is the vertical direction; does not distinguish between

[0112] According to one embodiment, the devices 400, 500, 600 are configured to decode the ternary flag 519 from the data stream 14 by context-adaptive entropy decoding using a third context that depends on the number of recursive multi-tree partitions used to obtain the given block 411 or on the size of the given block 411.

[0113] According to one embodiment, the devices 400, 500, 600 are configured to decode the third flag 519 from the data stream 14 by context-adaptive entropy decoding using a third context that depends on and distinguishes between whether the split direction flag 518 indicates a horizontal split direction and whether the split direction flag 518 indicates a vertical split direction.

[0114] In other words, the configuration of mtt_split_binary_flag (e.g., trichotomous flag 519) may use different context models depending on previously communicated or inferred information (in both illustrated bichotomous schemes (e.g., schemes shown in Figs. 11 and 12), mtt_split_binary_flag follows mtt_split_vertical_flag) and the current split tree state, as summarized in Table 5 shown in Fig. 23. Context modeling of flags (e.g., trichotomous flag 519) may be: -Current BT depth (number of non-QT divisions up to the current node) ...or BT depth is (current QT depth d QT , CTU size W CTU , and the current width and height) can be calculated as d BT =log2((W CTU W CTU ) / (W curr H curr ))-2·d QT The value of the flag mtt_split_vertical_flag previously communicated or estimated for the current node, It may be determined by:

[0115] Table 5 shown in Figure 23 illustrates an example context modeling for the mtt_split_binary_flag syntax element (e.g., trichotomy flag 519). The binary tree depth (BT depth) represents the number of bisections or its equivalent for the current node (e.g., the current recursion of a recursive partition). The value of the mtt_split_vertical_flag column represents the value signaled or inferred at the current partition level prior to coding of the syntax element mtt_split_binary_flag.

[0116] 8 illustrates an apparatus 800 for decoding an image 12' according to an embodiment of the present disclosure. For example, the apparatus 800 may be similar to the decoder 20. The apparatus 800 for decoding an image 12' is configured to partition the image 12' into coding blocks 425 using recursive multi-tree partitioning according to partitioning information 415 signaled in the data stream 14, and further to decode the image 12' from coding information 440 signaled in the data stream 14 and related to the coding blocks 425. The apparatus 800 is configured to partition the image 12' into coding blocks 425 according to partitioning information 415 signaled in the data stream 14 by decoding from the data stream 14 a partition flag 416 and a quad flag 417 of the partitioning information 415 indicating whether a given block 411 of the image 12' is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block 411 is one of the coding blocks 425. The quaternion flag 417 indicates whether the given block 411 of the image 12' is split into four child blocks 412. If the given block 411 of the image 12' is split but not into four child blocks 412, splitting the image 12' includes decoding a split direction flag 518 from the data stream 14 indicating whether the given block 411 of the image 12' is split vertically or horizontally, and further decoding a trisection flag 519 from the data stream 14 indicating whether the given block 411 of the image 12' is split into three or two child blocks 412. If the given block 411 of the image 12' is split, splitting the image 12' includes resuming recursive multitree splitting for the child blocks 412 using yet another flag in the split information 415. The apparatus 800 is further configured to decode the ternary flag 519 from the data stream 14 by context-adaptive entropy decoding using a third context 853 that depends on the number of divisions of the recursive multi-tree division used in obtaining the given block 411 or on the size of the given block 411.Additionally or alternatively, the third context 853 distinguishes between a horizontal split direction flag 518 and a vertical split direction flag 518 depending on whether the split direction flag 518 indicates a horizontal split direction and whether the split direction flag 518 indicates a vertical split direction.

[0117] FIG. 9 illustrates an apparatus 900 for decoding an image 12′ according to an embodiment of the present disclosure. For example, the apparatus 900 may be similar to the decoder 20.40. The apparatus 900 is configured to partition the image 12′ into coding blocks 425 using recursive multi-tree partitioning according to partitioning information 415 signaled in the data stream 14, and further to decode the image 12′ from coding information 440 signaled in the data stream 14 and related to the coding blocks 425. The apparatus 900 is configured to partition the image 12′ into coding blocks 425 according to partitioning information 415 signaled in the data stream 14 by decoding from the data stream 14 a partition flag 416 and a quad flag 417 of the partitioning information 415 indicating whether a given block 411 of the image 12′ is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block 411 is one of the coding blocks 425. The quad flag 417 indicates whether the given block 411 of the image 12' is split into four child blocks 412. If the given block 411 of the image 12' is split but not into four child blocks 412, splitting the image 12' includes decoding from the data stream 14 one or more further flags 418 of the split information 415 indicating whether the given block 411 of the image 12' is split vertically or horizontally into two or three child blocks 412. If the given block 411 of the image 12' is split, splitting the image 12' includes resuming recursive multiple tree splitting for the child blocks 412 using the further flag of the split information 415. The apparatus 900 is further configured to select one of the first and second modes. In a first mode of operation, the apparatus 900 is configured to decode the quad flag 417 after the split flag 416 if the split flag 416 indicates that the given block 411 of the image 12' is to be split. In a second mode of operation, the apparatus 900 is configured to decode the split flag 416 after the quad flag 417 if the quad flag 417 indicates that the given child block of the image 12' is not to be split into four child blocks 412.

[0118] For example, due to availability limitations, existing partitioning trees (e.g., tree 1100) already use adaptive tree structures. The adaptive tree structure is also used for shape type and direction permutation. In general, the ordering of syntax elements reflects a certain probability at each given node. However, this probability is determined by the signal characteristics and the operating point of the codec. For example, leaf nodes tend to be large when the quantization parameter is large, i.e., when the bit rate of the operating point is low. In such a case, partitioning is less likely to occur, so the configuration of FIG. 12 is preferred. However, at the other end of the operating point, the partitioning information is often positive, so the configuration of FIG. 11 is preferred. The adaptive partitioning tree configuration allows both signaling bisection of the partitioning tree and switching between the two options depending on the context characteristics. An extension would be to maintain multiple different partitioning trees and switch trees depending on adjacent partitioning trees (backward adaptation) or syntax elements at the root that define the partitioning tree (forward adaptation).

[0119] Thus, according to one embodiment, the device 900 is configured to perform the selection depending on the mode signaling in the data stream 14. In other words, the selection may be forward-adaptive.

[0120] According to an alternative embodiment, the device 900 is configured to perform the selection backward-adaptively.

[0121] For example, according to one embodiment, the device 900 includes: the block size of a set of previous coding blocks 425 (e.g. coding blocks of the coding blocks 425 originating from a previous partitioning of a block or part of the image 12′ (e.g. a previously partitioned CTU or an adjacent CTU)) (this option may be realized by means of a sliding window), the number of partitions from which the set of past coding blocks 425 originates; a quantization parameter signaled in the data stream 14; and The device is configured to perform the selection in response to an evaluation of one or more of the following:

[0122] According to an embodiment, syntax elements (e.g. flags) are bound to depths with respect to nested split trees. According to another embodiment, the bound depth centralizes information (e.g. depth information), so that the context modeling of syntax elements related to split trees relies only on a single depth value. The easiest implementation would be a single depth value that increases after each split. Alternatively, the depths may be weighted depending on the type of split. For example, in QT depth, a constant positive value may contribute to the depth counter, while in bipartitioning, only a weighted number of constant positive values ​​of the quadtree (weight w≦1) contribute.

[0123] According to an embodiment, the binary and ternary trees are combined, i.e. the direction of the split is signaled first, followed by information on whether the resulting split is binary or trichotomous. In some circumstances, a shift in probability occurs for the direction given the final shape type. In one configuration of the invention, the two syntax elements may be adaptively swapped, and this information is incorporated into the context modeling.

[0124] A further extension of the adaptive partitioning tree concept is the backward or forward adaptive signaling of shape sizes. For example, if a 16x16 block is horizontally bisected, the result can be a 16x4 and a 16x12 shape, or two 16x8 shapes. In the current VVC draft, the final ratio is constant. In the shape size approach, adjacent partitioning trees can be analyzed and a decision can be made as to which shape size to use. Note that this extension is the same as the additional partitioning trees that are available in the adaptive partitioning scheme.

[0125] The features and embodiments described in the decoder background are equally applicable to the encoder. Thus, an embodiment provides an apparatus for encoding an image, for example the apparatus 1300 shown in FIG. 13. The apparatus 1300 for encoding an image 12 is configured to partition the image 12 into coding blocks 425 using recursive multiple tree partitioning. The encoder is configured to encode partition information 415 defining the partition in the data stream 14. Furthermore, the apparatus 1300 is configured to encode the image 12 into coding information 440 related to the coding blocks 425 and to encode the coding information 440 in the data stream 14. The recursive multiple tree partitioning for partitioning the image 12 into coding blocks 425 can be performed by any of the embodiments of recursive multiple tree partitioning as described in relation to the decoders 400, 500, 600, 800, 900. That is, the coding blocks 425 may result from said recursive multiple tree partitioning. Similarly, the partition information may result from recursive multiple tree partitioning. The number and type of flags that the encoder 1300 encodes to obtain the partition information 415 may depend on each embodiment of the recursive partitioning. For example, the encoding of the partition information 415 is specific to the current recursion of the recursive partitioning, depending on the partitioning of the given block 411 subjected to the current recursion of the recursive partitioning. That is, with reference to the embodiments of the recursive partitioning described with respect to the decoders 400, 500, 600, 800, 900, the device 1300 is configured to encode the given flag into the data stream 14 whenever the partitioning of the image 12 suggests the decoding of the given flag. For example, whenever the partitioning or the image suggests the estimation of the given flag, the encoder is not necessarily configured to encode the given flag, but may be configured to suppress the encoding of the given flag.

[0126] Fig. 14 is a flow chart of a method 1400 for decoding an image 12' according to an embodiment. For example, the method 1400 may be performed by the device 400. The method includes a step 1401 of partitioning the image 12' into coding blocks 425 using recursive multi-tree partitioning in response to partition information 415 signaled in the data stream 14. The method 1400 further includes a step 1402 of decoding the image 12' from coding information 440 signaled in the data stream 14 and related to the coding blocks 425. The step 1401 includes decoding from the data stream 14 a partition flag 416 of the partition information 415 indicating whether a given block 411 of the image 12' is partitioned or not, thereby stopping the recursive multi-tree partitioning when the given block 411 is one of the coding blocks 425. The step 1401 further includes a step 1420 that is performed if the partition flag 416 indicates that the given block 411 of the image 12' is partitioned. Step 1420 includes a step 1430 of decoding from the data stream 14 a quad flag 417 of the partition information 415 indicating whether the given block 411 of the image 12' is divided into four child blocks 412. Step 1420 further includes a step 1431 that is executed if the quad flag 417 indicates that the given block 411 of the image 12' is not divided into four child blocks 412. Step 1431 includes decoding from the data stream 14 one or more further flags 418 of the partition information 415 that indicate whether the given block 411 of the image 12' is divided vertically or horizontally into two or three child blocks 412. Step 1420 further includes resuming recursive multiple tree partitioning for the child block 412 using the further flag of the partition information 415.

[0127] 15 is a flow chart of a method 1500 for decoding an image 12′ according to an embodiment. For example, the method 1500 may be performed by the device 500. The method includes a step 1501 of dividing the image 12′ into coding blocks 425 using recursive multi-tree division in response to the division information 415 signaled in the data stream 14. The method 1500 further includes a step 1402. The step 1501 includes a step 1511 of decoding a division flag 416 and a quad flag 417 of the division information 415 from the data stream 14, the division flag 416 indicating whether a given block 411 of the image 12′ is divided or not, thereby stopping the recursive multi-tree division when the given block 411 is one of the coding blocks 425. The quad flag 417 indicating whether the given block 411 of the image 12′ is divided or not into four child blocks 412. Step 1501 further includes a step 1521, which is executed if the given block 411 of the image 12' is split but not into four child blocks 412. Step 1521 includes a step 1533 of decoding a split direction flag 518 from the data stream 14, which indicates whether the given block 411 of the image 12' is split vertically or horizontally, if neither the second nor the third predetermined criterion is met. The decoding 1533 of the split direction flag 518 includes: The fourth predetermined criterion is not satisfied when the division direction indicated by the division direction flag 518 is the horizontal direction, nor is it satisfied when the division direction indicated by the division direction flag 518 is the vertical direction, or is satisfied when the division direction indicated by the division direction flag 518 is the horizontal direction, nor is it satisfied when the division direction indicated by the division direction flag 518 is the vertical direction; The fourth predetermined criterion is satisfied when the division direction indicated by the division direction flag 518 is horizontal, and is not satisfied when the division direction indicated by the division direction flag 518 is vertical; The fourth predetermined criterion is not satisfied when the division direction indicated by the division direction flag 518 is horizontal, and is satisfied when the division direction indicated by the division direction flag 518 is vertical; , and uses a second context 552 to distinguish between them.

[0128] Step 1521 further includes step 1534 of estimating that the split direction flag 518 indicates that the given block 411 of the image 12' is split vertically if a second predetermined criterion is met. Step 1521 further includes step 1535 of estimating that the split direction flag 518 indicates that the given block 411 of the image 12' is split horizontally if a third predetermined criterion is met. Step 1521 further includes step 1536 of decoding from the data stream 14 a trichotomy flag 519 indicating whether the given block 411 of the image 12' is split into three or two child blocks 412 if a fourth predetermined criterion is not met. Step 1521 further includes step 1537 of estimating that the trichotomy flag 519 indicates that the given block 411 of the image 12' is split into two child blocks 412 if a fourth predetermined criterion is met. Step 1501 further includes step 1503. In step 1503, if a given block 411 of the image 12' is to be divided, step 1403 is performed.

[0129] Fig. 16 is a flow chart of a method 1600 for decoding an image 12' according to an embodiment. For example, the method 1600 may be performed by the device 600. The method includes a step 1601 for partitioning the image 12' into coding blocks 425 using recursive multi-tree partitioning according to partition information 415 signaled in the data stream 14. The method 1600 further includes a step 1402. The step 1601 includes a step 1511. The step 1601 further includes a step 1622, which is executed if a given block 411 of the image 12' is partitioned but not partitioned into four child blocks 412. The step 1622 includes steps 1661, 1534, 1535, 1536 and 1662. Step 1661 includes decoding a split direction flag 518 from the data stream 14, indicating whether the given block 411 of the image 12' is split vertically or horizontally if neither the second nor the third predetermined criterion is met. The decoding 1661 of the split direction flag 518 includes the use of a second context 552. The configuration of the second context 552 used by the method 1600 or the apparatus 600 may be different from the configuration of the second context 552 used by the method 1500 or the apparatus 500. For the method 1600 and the apparatus 600, the second context is: A first criterion number of the fourth predetermined criterion and the fifth predetermined criterion that are satisfied when the division direction indicated by the division direction flag 518 is the horizontal direction is equal to a second criterion number of the fourth predetermined criterion and the fifth predetermined criterion that are satisfied when the division direction indicated by the division direction flag 518 is the vertical direction; and the first number is greater than the second number; and the first number is smaller than the second number; and and distinguish between them.

[0130] Step 1662 further includes deducing that if a fourth predetermined criterion is met, the triangular flag 519 indicates that the given block 411 of the image 12' is split into two child blocks 412, and if a fifth predetermined criterion is met, the triangular flag 519 indicates that the given block 411 of the image 12' is split into three child blocks 412, and suppressing decoding of the triangular flag 519 from the data stream 14. Step 1601 further includes step 1503.

[0131] Fig. 17 is a flow chart of a method 1800 for decoding an image 12' according to an embodiment. For example, the method 1800 may be performed by the device 800. The method includes a step 1801 of partitioning the image 12' into coding blocks 425 using recursive multi-tree partitioning in response to partition information 415 signaled in the data stream 14. The method 1800 further includes a step 1402. The step 1801 includes a step 1511. The step 1801 further includes a step 1823 that is performed if the given block 411 of the image 12' is partitioned but not into four child blocks 412. The step 1823 includes a step 1881 of decoding a partition direction flag 518 from the data stream 14, the flag indicating whether the given block 411 of the image 12' is partitioned vertically or horizontally. Step 1823 further includes a step 1882 of decoding from the data stream 14 a trichotomy flag 519 indicating whether a given block 411 of the image 12' is split into three or two child blocks 412. Step 1801 further includes step 1503.

[0132] Fig. 18 is a flow chart of a method 1900 for decoding an image 12' according to an embodiment. For example, the method 1900 may be performed by the device 900. The method includes a step 1901 of dividing the image 12' into coding blocks 425 using recursive multi-tree division in response to the division information 415 signaled in the data stream 14. The method 1900 further includes a step 1402. The step 1901 includes a step 1911 of decoding a division flag 416 and a quad flag 417 of the division information 415 from the data stream 14, the division flag 416 indicating whether a given block 411 of the image 12' is divided or not, thereby stopping the recursive multi-tree division when the given block 411 is one of the coding blocks 425. The quad flag 417 indicating whether the given block 411 of the image 12' is divided or not into four child blocks 412. Step 1901 further includes a step 1905 of selecting one of the first and second modes. In the first mode, the method 1900 includes, for example, in step 1911, decoding the quad flag 417 after the split flag 416 if the split flag 416 indicates that the given block 411 of the image 12' is to be split. In the second mode, the method 1900 includes, for example, in step 1911, decoding the quad flag 417 after the split flag 416 if the quad flag 417 indicates that the given child block of the image 12' is not to be split into four child blocks 412. Step 1901 includes a step 1991 that is executed if the given block 411 of the image 12' is to be split but not into four child blocks 412. Step 1901 includes decoding from the data stream 14 one or more further flags 418 of the split information 415 indicating whether a given block 411 of the image 12' is split vertically or horizontally into two or three child blocks 412. Step 1901 further includes step 1503.

[0133] Another embodiment provides a method of encoding an image 12. The method of encoding an image includes dividing the image 12 into coding blocks 425 using recursive multi-tree partitioning and encoding partition information 415 defining the partition in the data stream 14. The methods further include encoding the image 12 into coding information 440 associated with the coding blocks 425 and encoding the coding information 440 in the data stream 14. Similar to the correspondence between the encoders and decoders described above, the method of encoding an image is similar to the methods 1400, 1500, 1600, 1800, 1900. For example, the division of the image 12 relies on the same steps as described for these methods, i.e., the encoding method includes encoding each flag whenever the flag is to be decoded. The steps of the methods 1400, 1500, 1600, 1800, 1900 including the estimation of the flag are not necessarily part of the method of encoding an image, instead, these methods may include suppressing the encoding of the flag.

[0134] Although certain aspects have been described in the context of an apparatus, it will be appreciated that these aspects also serve as a description of a corresponding method, where a block or apparatus corresponds to a method step or feature thereof, and similarly, aspects described in the context of a method step also serve as a description of a corresponding block, item or feature of a corresponding apparatus.

[0135] Some or all of the method steps may be performed by (or using) hardware apparatus such as, for example, a microprocessor, a programmable computer, or electronic circuits, and in some embodiments, one or more of the most important method steps may be performed by such apparatus.

[0136] Depending on certain implementation requirements, the embodiments of the present invention or at least parts thereof can be implemented in hardware or in software. The implementations can be carried out using a digital storage medium (e.g., floppy disk, DVD, Blu-Ray, CD, ROM, PROM, EPROM, EEPROM, or flash memory) on which electronically readable control signals are stored that cooperate (or can cooperate) with a programmable computer system to perform the respective methods. The digital storage medium may therefore be computer readable.

[0137] Some embodiments according to the invention comprise a data carrier having electronically readable control signals operable with a programmable computer system to perform one of the methods described herein.

[0138] Generally, embodiments of the present invention can be implemented as a computer program product comprising a program code operable to perform one of the above methods when run on a computer, the program code may for example be stored on a machine readable carrier.

[0139] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.

[0140] In other words, an embodiment of the invention is therefore a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

[0141] A further embodiment of the method according to the invention is therefore a data carrier (or a digital storage medium or a computer readable medium) having recorded thereon a computer program for performing one of the methods described herein. The data carrier, digital storage medium or recording medium is typically tangible and / or non-transitory.

[0142] A further embodiment of the inventive method is therefore a data stream or a sequence of signals representing the computer program for performing one of the methods described herein, the data stream or sequence of signals being for example adapted to be transmitted via a data communications connection (for example the Internet).

[0143] Another embodiment comprises a processing means (for example a computer, or a programmable logic device) configured to or adapted to perform one of the methods described herein.

[0144] Another embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

[0145] Another embodiment according to the invention comprises an apparatus or a system configured to transmit (e.g. electronically or optically) a computer program for performing one of the methods described herein to a receiver. The receiver may be e.g. a computer, a mobile device, a memory device, etc. The apparatus or system comprises e.g. a file server which transmits the computer program to the receiver.

[0146] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor to perform one of the methods described herein. In general, the methods are preferably performed by any hardware apparatus.

[0147] The devices described herein may be implemented using a hardware device, a computer, or a combination of a hardware device and a computer.

[0148] The methods described herein may be adapted to be performed using a hardware apparatus, a computer, or a combination of a hardware apparatus and a computer.

[0149] The above-described embodiments are merely illustrative of the principles of the present invention. It will be understood that modifications and variations of the arrangements and details described herein will be apparent to those skilled in the art. It is therefore intended to be limited only by the scope of the appended claims and not by the specific details presented by the description and illustration of the embodiments herein.

Claims

1. 1. A method of decoding an image, the method comprising the steps of: determining a split flag from the data stream indicating whether a given block of the image is split or not, thereby stopping the recursive tree splitting when the given block becomes one of the coding blocks; If the split flag indicates that the given block of the image is to be split, determining a quadrant flag of the partition information from the data stream indicating whether the given block of the image is partitioned into four child blocks; If the quadrant flag indicates that the given block of the image is not divided into four child blocks, determining from the data stream one or more further flags of the partitioning information indicating whether the given block of the image is divided vertically or horizontally into two or three child blocks; resuming the recursive multitree partitioning for the child block using a further flag in the partitioning information; obtaining the coding block in response to the partitioning information signaled in the data stream by

2. The method of claim 1 , further comprising: decoding one or more of the split flags, the quaternion flags, and / or the one or more further flags from the data stream.

3. The method of claim 1 or 2, further comprising inferring that one or more flags of the split information assume a predetermined flag state without decoding the one or more flags of the split information from the data stream depending on whether one or more criteria are met.

4. The method of claim 2 , wherein the one or more criteria relate to one or more of child block area, child block width, child block height, current split depth, and split line alignment with an image boundary.

5. determining from the data stream one or more further flags of the partitioning information indicating whether the given child block of the image is vertically or horizontally partitioned into two or three child blocks, decoding a split direction flag from the data stream indicating whether the given block of the image is split vertically or horizontally; decoding a trichotomy flag from the data stream indicating whether the given block of the image is divided into three or two child blocks; The method according to any one of claims 1 to 4, adapted to perform the following:

6. 1. A method for encoding an image, comprising the steps of: partitioning the image into coding blocks using recursive multitree partitioning and encoding partition information defining the partitioning in a data stream; encoding the image into coding information associated with the coding blocks and encoding the coding information in the data stream; Including, encoding the split information into the data stream; encoding a split flag of the split information into the data stream, which indicates whether a given block of the image is split or not, thereby stopping the recursive multitree splitting when the given block becomes one of the coding blocks; If the split flag indicates that the given block of the image is to be split, encoding a quadtree division flag of the division information indicating whether the given block of the image is divided into four child blocks into the data stream; If the quadtree split flag indicates that the given block of the image is not split into four child blocks, encoding one or more further flags of the partitioning information into the data stream indicating whether the given block of the image is divided vertically or horizontally into two or three child blocks; resuming encoding of the partition information for the child block using a further flag of the partition information; encoding the split information in the data stream by A method comprising:

7. encoding into the data stream one or more further flags of the partitioning information indicating whether the given child block of the image is divided vertically or horizontally into two or three child blocks, encoding a split direction flag into the data stream indicating whether the given block of the image is split vertically or horizontally; encoding a trichotomy flag into the data stream indicating whether the given block of the image is divided into three or two child blocks; The method of claim 6 further comprising:

8. A non-transitory storage medium storing instructions which, when executed by at least one processor, cause the at least one processor to perform the method of any one of claims 1 to 7.

9. A non-transitory computer readable medium; At least one processor in cooperation with said non-transitory computer readable medium configured to perform the method of any one of claims 1 to 7; An apparatus comprising:

Citation Information

Patent Citations

  • Image encoding / decoding method and device, and recording medium storing bitstream

    JP2019525577A

  • Method for coding and an apparatus

    US20120169519A1

  • Image encoding / decoding method and device, and recording medium in which bitstream is stored

    WO2018016823A1