A method, apparatus, and medium for processing video data

Abstract

Methods, systems, and apparatus, including computer programs, are described for video processing. One example video processing method includes performing, according to a rule, a conversion between a video comprising a video block and a bitstream of the video, wherein the video block is a coding tree node comprising one or more coding units, and wherein the rule specifies that coding information of the video block indicates whether a coding mode is enabled for the one or more coding units of the video block.

Claims

1. A method for processing video data, comprising: Perform conversions between video blocks and video bitstreams according to the rules. The video block mentioned therein is a codec tree node that includes one or more codec blocks. The rule specifies that one or more of the following codec modes are allowed to be used by one or more luma blocks within the one or more codec blocks: intra-predictive codec mode, intra-block copy (IBC) mode, and palette codec mode, and that when a local dual tree is applied to the one or more codec blocks within the codec tree node, the intra-predictive codec mode is applied to one or more chroma blocks within the one or more codec blocks, and The rule states that the presence of the first syntax element is based at least on the value of the variable named mode type being MODE_TYPE_INTRA or MODE_TYPE_ALL, and that the first syntax element is absent if the value of the variable named mode type is MODE_TYPE_INTER, and that the first syntax element indicates whether palette encoding / decoding mode is enabled for the encoding / decoding blocks in the one or more encoding / decoding blocks.

2. The method of claim 1, wherein the rule specifies that more than one of the intra-predictive coding mode, IBC mode, and palette coding mode is allowed to be applied to multiple luma blocks, wherein the more than one coding mode includes any two or more of the intra-predictive coding mode, IBC mode, and palette coding mode.

3. The method of claim 1, wherein the rule specifies that inter-frame prediction codec mode is not allowed for one or more codec blocks in the codec tree node to which the local dual tree is applied.

4. The method of claim 1, wherein MODE_TYPE_INTER specifies that only inter-frame prediction codec mode is allowed for the codec block. Where MODE_TYPE_INTRA specifies that only intra-frame prediction codec mode, IBC mode, and palette codec mode are allowed for the codec block, and MODE_TYPE_ALL specifies that inter-frame prediction codec mode, intra-frame prediction codec mode, IBC mode, and palette codec mode are allowed to be used in the codec block.

5. The method of claim 1, wherein the variable named mode type is based on a variable named modeTypeCondition and a second syntax element non_inter_flag indicating whether only inter-frame prediction codec modes are allowed.

6. The method of claim 1, wherein MODE_TYPE_INTER, MODE_TYPE_INTRA, and MODE_TYPE_ALL are also used in the segmentation process, and wherein the segmentation process includes at least one of a quadrilateral partitioning process, a binary partitioning process, or a ternary partitioning process.

7. The method of claim 1, wherein the rule specifies the value of a fourth syntax element in the sequence parameter set controlled by a third syntax element in the general constraint information syntax structure, wherein the fourth syntax element indicates whether sub-picture information exists in the codec layer video sequence and whether more than one sub-picture is included in each picture of the codec layer video sequence.

8. The method of claim 1, wherein the rule specifies the value of a sixth syntax element in the sequence parameter set controlled by a fifth syntax element in the general constraint information syntax structure, wherein the sixth syntax element indicates whether the maximum transform size of the luminance sample is equal to 64.

9. The method of claim 1, wherein performing the conversion includes encoding the video into the bitstream.

10. The method of claim 1, wherein performing the conversion includes decoding the video from the bitstream.

11. An apparatus for processing video data, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to: Perform conversions between video blocks and video bitstreams according to the rules. The video block mentioned therein is a codec tree node that includes one or more codec blocks. The rule specifies that one or more of the following codec modes are allowed to be used by one or more luma blocks within the one or more codec blocks: intra-predictive codec mode, intra-block copy (IBC) mode, and palette codec mode, and that when a local dual tree is applied to the one or more codec blocks within the codec tree node, the intra-predictive codec mode is applied to one or more chroma blocks within the one or more codec blocks, and The rule states that the presence of the first syntax element is based at least on the value of the variable named mode type being MODE_TYPE_INTRA or MODE_TYPE_ALL, and that the first syntax element is absent if the value of the variable named mode type is MODE_TYPE_INTER, and that the first syntax element indicates whether palette encoding / decoding mode is enabled for the encoding / decoding blocks in the one or more encoding / decoding blocks.

12. The apparatus of claim 11, wherein the rule specifies that more than one of the following codec modes—intra-predictive coding mode, IBC mode, and palette coding mode—is permitted to be applied to multiple luma blocks, wherein the more than one codec mode includes any two or more of the following: intra-predictive coding mode, IBC mode, and palette coding mode, and The rule specifies that inter-frame prediction codec modes are not allowed for one or more codec blocks in the codec tree node to which the local dual tree is applied.

13. The apparatus of claim 11, wherein MODE_TYPE_INTER specifies that only inter-frame prediction codec mode is allowed for the codec block. The MODE_TYPE_INTRA setting specifies that only intra-frame prediction codec mode, IBC mode, and palette codec mode are allowed for the codec block. MODE_TYPE_ALL specifies that inter-frame prediction codec mode, intra-frame prediction codec mode, IBC mode, and palette codec mode are allowed to be used in the codec block. The variable named mode type is based on a variable named modeTypeCondition and a second syntax element, non_inter_flag, indicating whether only inter-frame prediction codec modes are allowed. MODE_TYPE_INTER, MODE_TYPE_INTRA, and MODE_TYPE_ALL are also used in the segmentation process, and the segmentation process includes at least one of a quadrilateral partitioning process, a binary partitioning process, or a trilateral partitioning process.

14. The apparatus of claim 11, wherein the rule specifies the value of a fourth syntax element in the sequence parameter set controlled by a third syntax element in the general constraint information syntax structure, wherein the fourth syntax element indicates whether sub-picture information exists in the codec layer video sequence and whether more than one sub-picture is included in each picture of the codec layer video sequence, and The rule specifies the value of the sixth syntax element in the sequence parameter set controlled by the fifth syntax element in the general constraint information syntax structure, wherein the sixth syntax element indicates whether the maximum transformation size of the luminance sample is equal to 64.

15. A non-transitory computer-readable storage medium for storing instructions, said instructions causing a processor to: Perform conversions between video blocks and video bitstreams according to the rules. The video block mentioned therein is a codec tree node that includes one or more codec blocks. The rule specifies that one or more of the following codec modes are allowed to be used by one or more luma blocks within the one or more codec blocks: intra-predictive codec mode, intra-block copy (IBC) mode, and palette codec mode, and that when a local dual tree is applied to the one or more codec blocks within the codec tree node, the intra-predictive codec mode is applied to one or more chroma blocks within the one or more codec blocks, and The rule states that the presence of the first syntax element is based at least on the value of the variable named mode type being MODE_TYPE_INTRA or MODE_TYPE_ALL, and that the first syntax element is absent if the value of the variable named mode type is MODE_TYPE_INTER, and that the first syntax element indicates whether palette encoding / decoding mode is enabled for the encoding / decoding blocks in the one or more encoding / decoding blocks.

16. The non-transitory computer-readable storage medium of claim 15, wherein the rule specifies that more than one of the intra-predictive coding mode, IBC mode, and palette coding mode is permitted to be applied to multiple luma blocks, wherein the more than one coding mode includes any two or more of the intra-predictive coding mode, IBC mode, and palette coding mode. The rule specifies that inter-frame prediction of codec modes is not allowed for one or more codec blocks in the codec tree node to which the local dual tree is applied. The MODE_TYPE_INTER setting specifies that only inter-frame prediction codec mode is allowed for the codec block. The MODE_TYPE_INTRA setting specifies that only intra-frame prediction codec mode, IBC mode, and palette codec mode are allowed for the codec block. MODE_TYPE_ALL specifies that inter-frame prediction codec mode, intra-frame prediction codec mode, IBC mode, and palette codec mode are allowed to be used in the codec block. The variable named mode type is based on a variable named modeTypeCondition and a second syntax element non_inter_flag that indicates whether only inter-frame prediction codec modes are allowed. MODE_TYPE_INTER, MODE_TYPE_INTRA, and MODE_TYPE_ALL are also used in the segmentation process, and the segmentation process includes at least one of a quadrilateral partitioning process, a binary partitioning process, or a trilateral partitioning process. The rule specifies that the value of the fourth syntax element in the sequence parameter set is controlled by the third syntax element in the general constraint information syntax structure. This fourth syntax element indicates whether sub-picture information exists in the codec layer video sequence and whether more than one sub-picture is included in each picture of the codec layer video sequence. The rule specifies the value of the sixth syntax element in the sequence parameter set controlled by the fifth syntax element in the general constraint information syntax structure, wherein the sixth syntax element indicates whether the maximum transformation size of the luminance sample is equal to 64.

17. A non-transitory computer-readable recording medium storing instructions and a bit stream, wherein the instructions cause a processor to: Generate a bitstream of video including video blocks according to the rules. The video block mentioned therein is a codec tree node that includes one or more codec blocks. The rule specifies that one or more of the following codec modes are allowed to be used by one or more luma blocks within the one or more codec blocks: intra-predictive codec mode, intra-block copy (IBC) mode, and palette codec mode, and that when a local dual tree is applied to the one or more codec blocks within the codec tree node, the intra-predictive codec mode is applied to one or more chroma blocks within the one or more codec blocks, and The rule states that the presence of the first syntax element is based at least on the value of the variable named mode type being MODE_TYPE_INTRA or MODE_TYPE_ALL, and that the first syntax element is absent if the value of the variable named mode type is MODE_TYPE_INTER, and that the first syntax element indicates whether palette encoding / decoding mode is enabled for the encoding / decoding blocks in the one or more encoding / decoding blocks.

18. The non-transitory computer-readable recording medium of claim 17, wherein the rule specifies that more than one of the intra-predictive coding mode, IBC mode, and palette coding mode is permitted to be applied to multiple luma blocks, wherein the more than one coding mode includes any two or more of the intra-predictive coding mode, IBC mode, and palette coding mode. The rule specifies that inter-frame prediction of codec modes is not allowed for one or more codec blocks in the codec tree node to which the local dual tree is applied. The MODE_TYPE_INTER setting specifies that only inter-frame prediction codec mode is allowed for the codec block. The MODE_TYPE_INTRA setting specifies that only intra-frame prediction codec mode, IBC mode, and palette codec mode are allowed for the codec block. MODE_TYPE_ALL specifies that inter-frame prediction codec mode, intra-frame prediction codec mode, IBC mode, and palette codec mode are allowed to be used in the codec block. The variable named mode type is based on a variable named modeTypeCondition and a second syntax element, non_inter_flag, indicating whether only inter-frame prediction codec modes are allowed. MODE_TYPE_INTER, MODE_TYPE_INTRA, and MODE_TYPE_ALL are also used in the segmentation process, and the segmentation process includes at least one of a quadrilateral partitioning process, a binary partitioning process, or a trilateral partitioning process.

19. The non-transitory computer-readable recording medium of claim 17, wherein the rule specifies that a third syntax element in the general constraint information syntax structure controls the value of a fourth syntax element in the sequence parameter set, wherein the fourth syntax element indicates whether sub-picture information exists in the codec layer video sequence, and whether more than one sub-picture is included in each picture of the codec layer video sequence, and The rule specifies the value of the sixth syntax element in the sequence parameter set controlled by the fifth syntax element in the general constraint information syntax structure, wherein the sixth syntax element indicates whether the maximum transformation size of the luminance sample is equal to 64.

20. A method for storing a bitstream of video, comprising: Generate a bitstream of video including video blocks according to the rules; The bitstream is stored in a non-transitory computer-readable recording medium. The video block mentioned therein is a codec tree node that includes one or more codec blocks. The rule specifies that one or more of the following codec modes are allowed to be used by one or more luma blocks within the one or more codec blocks: intra-predictive codec mode, intra-block copy (IBC) mode, and palette codec mode, and that when a local dual tree is applied to the one or more codec blocks within the codec tree node, the intra-predictive codec mode is applied to one or more chroma blocks within the one or more codec blocks, and The rule states that the presence of the first syntax element is based at least on the value of the variable named mode type being MODE_TYPE_INTRA or MODE_TYPE_ALL, and that the first syntax element is absent if the value of the variable named mode type is MODE_TYPE_INTER, and that the first syntax element indicates whether palette encoding / decoding mode is enabled for the encoding / decoding blocks in the one or more encoding / decoding blocks.

21. A computer program product having computer instructions stored thereon, which, when executed by a processor, cause the processor to perform the method of any one of claims 1-10, 20.

Images