Transferring generic constraint information for video coding

By introducing the transmission and initialization method of universal constraint information in video encoding, the incompatibility problem between multi-function video encoding standards is solved, the stability of video encoding and the behavior consistency of the decoder is improved, and VVC No. 1 is ensured. The decoder of the second edition of the VVC version can successfully decode the video signal.

CN118921493AActive Publication Date: 2024-11-08GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD

Patent Information

Application Number
CN202411250760.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-01-13
Filing Date
2022-11-08
Publication Date
2024-11-08
Estimated Expiration
2042-11-08

AI Technical Summary

Technical Problem

The incompatibility between multifunctional video encoding standards leads to out-of-synchronization of video decoding, especially in the VVC version 2 transmission method, which leads to unclear and inconsistent decoder implementation, affecting the stability of video encoding.

Method used

By introducing a method of transmission and initialization of general constraint information for video encoding, additional bit counts in the code stream are extracted, and the decoder can decode the video code stream based on the general constraint flag in part, ensuring backward compatibility and eliminating VVC version 2 decoding Ambiguousness of behavior.

Benefits of technology

Improves the stability and compatibility of video encoding, allowing VVC Edition 1 and VVC Edition 2 decoders to successfully decode video signals, solve the problem of out-of-sync and ensure the behavior consistency of the decoder.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118921493A_ABST
    Figure CN118921493A_ABST
Patent Text Reader

Abstract

In some embodiments, a video decoder decodes video from a bitstream of video. A video decoder extracts an additional bit count M from a bitstream of a video, where the additional bit count M indicates a number of additional generic constraint information (GCI) bits contained in the bitstream of the video. The additional bits comprise flag bits, the flag bits respectively indicate that each additional coding tool is constrained for the video, and the expected value of the additional bit count is 0 or 6. In a case where it is determined that the extracted additional bit count M is greater than 6, the decoder extracts M-6 bits after the six flag bits in the code stream. Further, the decoder also decodes the remainder of the code stream as a picture, independent of the extracted M-6 bits, and based at least in part on constraints specified for each additional encoding tool, respectively, by the six flag bits.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the PCT international patent application PCT / US2022 / 079490 with an application date of November 8, 2022, which has entered the Chinese national phase and has Chinese patent application number 202280088199.0 and the invention name is "General constraint information for transmitting video coding".

[0002] Cross-references

[0003] This application claims priority to U.S. Provisional Application No. 63 / 266,615, filed on January 10, 2022, entitled “Signaling Methods for General Constraints Information for Video Coding”, U.S. Provisional Application No. 63 / 266,616, filed on January 10, 2022, entitled “Initialization Method for General Constraint Information Flags for Video Coding”, and U.S. Provisional Application No. 63 / 266,765, filed on January 13, 2022, entitled “Signaling and Initialization Methods for General Constraints Information for Video Coding”. The entire contents of the above applications are incorporated herein by reference in their entirety. Technical Field

[0004] The present disclosure relates generally to video processing. In particular, the present disclosure relates to signaling and initialization of general constraint information for video encoding. Background Art

[0005] Ubiquitous video devices, such as smartphones, tablets, and computers, have made it easier than ever to capture videos or images. However, the amount of data required to capture even a short video can be very large. Video coding techniques (including video encoding and decoding) allow video data to be compressed to a smaller size, allowing storage and transmission of various videos. Video coding has been widely used in the fields of digital television broadcasting, Internet and mobile network video transmission, real-time applications (such as video chat, video conferencing), DVDs and Blu-ray discs, etc. In order to reduce the storage space used to store videos and / or the network bandwidth consumption used to transmit videos, it is expected to improve the efficiency of video coding schemes. Summary of the invention

[0006] Some embodiments relate to transmission and initialization of general constraint information for video encoding. In one example, a video decoding method includes: extracting an additional bit count M from a bitstream of a video, wherein the additional bit count M indicates the number of additional general constraint information (GCI) bits contained in the bitstream of the video, the additional bits include flag bits, the flag bits respectively indicate that each additional coding tool is constrained for the video, and the expected value of the additional bit count is 0 or 6; if it is determined that the extracted additional bit count M is greater than 6, extracting M-6 bits after six flag bits in the bitstream; and independently of the extracted M-6 bits, and at least partially based on the constraints specified by the six flag bits for each additional coding tool, decoding the remaining part of the bitstream of the video into an image.

[0007] In another example, a non-transitory computer-readable medium stores program code thereon, and the program code can be executed by one or more processing devices to perform operations. The operations include: extracting an additional bit count M from a bitstream of a video, wherein the additional bit count M indicates the number of additional general constraint information (GCI) bits contained in the bitstream of the video, the additional bits include flag bits, the flag bits respectively indicate that each additional coding tool is constrained for the video, and the expected value of the additional bit count is 0 or 6; if it is determined that the extracted additional bit count M is greater than 6, extracting M-6 bits after six flag bits in the bitstream; and independently of the extracted M-6 bits, and at least partially based on the constraints specified by the six flag bits for each additional coding tool, decoding the remaining part of the bitstream of the video into an image.

[0008] In another example, a system includes a processing device and a non-transitory computer-readable medium communicatively coupled to the processing device. The processing device is used to execute program code stored in the non-transitory computer-readable medium to perform operations. The operations include: extracting an additional bit count M from a bitstream of a video, wherein the additional bit count M indicates the number of additional general constraint information (GCI) bits contained in the bitstream of the video, the additional bits include flag bits, the flag bits respectively indicate that each additional coding tool is constrained for the video, and the expected value of the additional bit count is 0 or 6; when it is determined that the extracted additional bit count M is greater than 6, extracting M-6 bits after six flag bits in the bitstream; and decoding the remaining part of the bitstream of the video into an image independently of the extracted M-6 bits and at least partially based on the constraints specified by the six flag bits for each additional coding tool.

[0009] These illustrative embodiments are mentioned not to limit or define the present disclosure, but to provide examples to aid understanding of the present disclosure. Other embodiments are discussed and further described in the detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The features, embodiments, and advantages of the present disclosure will be better understood when the following detailed description is read with reference to the accompanying drawings.

[0011] Figure 1 FIG. 1 is a block diagram showing an example of a video encoder for implementing the embodiments proposed herein.

[0012] Figure 2 FIG. 4 is a block diagram showing an example of a video decoder for implementing the embodiments proposed herein.

[0013] Figure 3 An example of dividing a picture in a video into coding tree units according to some embodiments of the present disclosure is described.

[0014] Figure 4 An example of dividing a coding tree unit into coding units according to some embodiments of the present disclosure is described.

[0015] Figure 5 An example of a video decoding process according to some embodiments of the present disclosure is depicted.

[0016] Figure 6 Another example of a video decoding process according to some embodiments of the present disclosure is depicted.

[0017] Figure 7 Another example of a video decoding process according to some embodiments of the present disclosure is depicted.

[0018] Figure 8 An example of a computing system that can be used to implement some embodiments of the present disclosure is depicted. DETAILED DESCRIPTION

[0019] The embodiments provide for the transmission and initialization of general constraint information for video coding. As described above, more and more video data is generated, stored and transmitted. It is beneficial to improve the efficiency of video coding technology and the stability of video coding so that the video signal can be successfully decoded at the decoder end. Problems related to video decoding stability include incompatibility and inconsistency. With the development of video coding technology, newer video coding standards have also emerged. One of the video coding standards is the Versatile Video Coding Standard Version 1, which is jointly issued by the International Organization for Standardization (ISO) under the name of "ISO / IEC 23090-3:2021 Information Technology - Coding Representation for Immersive Media - Part 3: Versatile Video Coding" and by the International Telecommunication Union (ITU) under the name of "ITU-T H.26 Recommendation (08 / 2020): Versatile Video Coding". In the present disclosure, Version 1 of the Versatile Video Coding Standard may be referred to as "VVC Version 1" or "VVCvl". VVC version 1 has been superseded by version 2 of the Versatile Video Coding standard, which will be jointly published by ISO as "ISO / IEC 23090-3:2022 Information technology - Coded representation for immersive media - Part 3: Versatile video coding" and by ITU as "ITU-TH.266 Recommendation (04 / 2022): Versatile video coding". In this disclosure, version 2 of the Versatile Video Coding standard may be referred to as "VVC version 2" or "VVCv2". In order for a video signal encoded with an older version of the video coding standard to be successfully decoded by a video decoder using a newer version of the video coding standard, the video coding scheme should be designed to be backward compatible with the older version of the coding standard. However, the transmission of the generic constraint information used in the current draft of VVC version 2 results in asynchronous video decoding, which is a serious incompatibility issue between different versions of the video coding standard. In addition, in the current draft of VVC version 2, the generic constraint flag associated with the generic constraint information may be undefined in some cases, resulting in unclear and inconsistent decoder implementations. Various embodiments described herein address these issues by introducing a method for transmitting and initializing general constraint information for video coding, thereby improving the stability of video coding.

[0020] In the VVC standard, the general constraint information (GCI) syntax structure general_constraints_info() is used to indicate specific constraint properties of a code stream. GCI contains a list of constraint flags and non-flag syntax elements. The binary flag gci_present_flag is used to specify whether the GCI syntax element exists. In some embodiments, if the VVC version 2 code stream transmits general constraint information (i.e., the value of gci_present_flag is 1), and the VVC version 2 general constraint information consists of N additional coding tools that may be constrained, the value of the syntax element gci_num_additional_bits corresponding to these N additional coding tools can only be set to 0 or N. If gci_num_additional_bits is set to 0, the general constraint flags of these N additional coding tools will not be transmitted. If gci_num_additional_bits is set to N, the next N bits in the code stream are used to transmit the general constraint flags of these N additional coding tools. In one example, N is set to 6.

[0021] In some examples, the VVC version 2 codestream does not allow gci_num_additional_bits to be set to a value other than 0 or N. However, the VVC version 2 decoder can still process the general constraint information that sets gci_num_additional_bits to a value other than 0 or N. For example, gci_num_additional_bits can be set to M, M is greater than 0 and less than N, or M is greater than N. If M is greater than 0 and less than N, after decoding the gci_num_additional_bits syntax element, the decoder extracts M bits from the codestream and discards them. If M is greater than N, after decoding the gci_num_additional_bits syntax element, the decoder extracts N bits from the codestream and interprets them as a general constraint flag for N additional coding tools. Then, the decoder extracts MN bits from the codestream and discards them. In other examples, the VVC version 2 decoder does not need to process the general constraint information that sets gci_num_additional_bits to a value greater than 0 but less than N. Legal VVC version 2 bitstreams can only set the value of gci_num_reserved_bits to 0 or N. VVC future version bitstreams will not allow gci_num_additional_bits to be set to a value between 0 and N.

[0022] In some embodiments, the general constraint information flag is initialized to resolve the above-mentioned problem of ambiguity and inconsistency in decoder implementation. In these embodiments, when gci_present_flag is equal to 1 and gci_num_additional_bits is equal to 0, general_constraints_info() does not impose constraints on the coding tools associated with the general constraint information flag. In examples where the flag value is 0 indicating no constraints, the value of the general constraint information flag is inferred to be equal to 0 when the flag is not present.

[0023] The embodiments described in the present disclosure provide a method for transmitting and inferring general constraint flags for additional coding tools in VVC version 2. Unlike the prior art, the high-level syntax code stream generated by the method described in the present disclosure is compatible with the VVC version 1 decoder and can be decoded without causing asynchrony between the behaviors of the VVC version 1 decoder and the VVC version 2 decoder. The inference rules described in the present disclosure eliminate the ambiguity of the VVC version 2 decoding behavior of the VVC version 2 GCI syntax element. These techniques can become effective coding tools in various video coding standards.

[0024] Referring now to the drawings, FIG. 1 is a block diagram showing an example of a video encoder 100, which is used to implement the embodiments proposed herein. Figure 1 In the example shown, the video encoder 100 includes a segmentation module 112, a transform module 114, a quantization module 115, an inverse quantization module 118, an inverse transform module 119, a loop filter module 120, an intra-frame prediction module 126, an inter-frame prediction module 124, a motion estimation module 122, a decoded picture buffer 130 and an entropy encoding module 116.

[0025] The input to the video encoder 100 is an input video 102, which contains a series of pictures (also called frames or images). In a block-based video encoder, for each picture, the video encoder 100 uses a segmentation module 112 to segment the picture into blocks 104, each block containing a plurality of pixels. These blocks can be macroblocks, coding tree units, coding units, prediction units and / or prediction blocks. A picture may include blocks of different sizes, and the block segmentation may be different for different pictures in the video. Each block can be encoded using different predictions, such as intra-frame prediction, inter-frame prediction, or mixed intra-frame and inter-frame prediction.

[0026] Typically, the first picture of a video signal is an intra-coded picture, which is encoded using only intra-frame prediction. In intra-frame prediction mode, only the already coded data in the same picture is used to predict the blocks of the picture. Intra-coded pictures can be decoded without using information from other pictures. To perform intra-frame prediction, Figure 1The video encoder 100 shown may use an intra prediction module 126. The intra prediction module 126 is used to generate an intra prediction block (prediction block 134) using the reconstructed samples in the reconstruction block 136 of the neighboring blocks of the same picture. Intra prediction is performed according to the intra prediction mode selected for the block. Afterwards, the video encoder 100 calculates the difference between the block 104 and the intra prediction block 134. The difference is called the residual block 106.

[0027] To further eliminate redundancy in the block, the transform module 114 transforms the residual block 106 into a transform domain by transforming the samples in the block. Examples of transforms may include, but are not limited to, discrete cosine transforms (DCT) or discrete sine transforms (DST). The transformed values ​​may be referred to as transform coefficients, representing the residual block in the transform domain. In some examples, the residual block may be quantized directly without being transformed by the transform module 114. This mode is referred to as a transform skip mode.

[0028] The video encoder 100 may further quantize the transform coefficients using the quantization module 115 to obtain quantized coefficients. Quantization involves dividing the samples by the quantization step size and then rounding, while inverse quantization involves multiplying the quantized value by the quantization step size. This quantization process is called scalar quantization. Quantization is used to reduce the dynamic range of (transformed or untransformed) video samples, thereby using fewer bits to represent the video samples.

[0029] The quantization of coefficients / samples within a block can be done independently, and this quantization method is used in some existing video compression standards (such as H.264 and HEVC). For an N*M block, a certain scanning order can be used to convert the two-dimensional coefficients of the block into a one-dimensional array for coefficient quantization and encoding. The quantization of coefficients within a block can utilize the scanning order information. For example, the quantization of a given coefficient in a block may depend on the state of the previous quantization value in the scanning order. In order to further improve the coding efficiency, multiple quantizers can be used. Which quantizer is used to quantize the current coefficient depends on the information before the current coefficient in the encoding / decoding scanning order. This quantization method is called dependent quantization.

[0030] The degree of quantization can be adjusted by the quantization step size. For example, for scalar quantization, different quantization step sizes can be used to achieve finer or coarser quantization. A smaller quantization step size corresponds to finer quantization, while a larger quantization step size corresponds to coarser quantization. The quantization step size can be indicated by a quantization parameter (QP). The quantization parameter is provided in the encoded bitstream of the video so that the video decoder can access and apply the quantization parameter for decoding.

[0031] Afterwards, the entropy coding module 116 encodes the quantized samples to further reduce the size of the video signal. The entropy coding module 116 is used to apply an entropy coding algorithm to the quantized samples. In some examples, the quantized samples are binarized into a binary container, and the coding algorithm further compresses the binary container into bits. Examples of binarization methods include, but are not limited to, truncated Rice (TR) and finite k-order exponential Golomb (EGk) combined binarization, and k-order exponential Golomb binarization. Examples of entropy coding algorithms include, but are not limited to, variable length coding (VLC) schemes, content adaptive VLC schemes (CAVLC), arithmetic coding schemes, binarization, content adaptive binary arithmetic coding (CABAC), grammar-based content adaptive binary arithmetic coding (SBAC), probability interval segmentation entropy (PIPE) coding or other entropy coding techniques. The entropy-coded data is added to the bitstream of the output coded video 132.

[0032] As described above, the reconstructed blocks 136 from neighboring blocks are used for intra-frame prediction of blocks of the picture. Generating the reconstructed block 136 of a block involves calculating the reconstructed residual of the block. The reconstructed residual can be determined by applying inverse quantization and inverse transformation to the quantized residual of the block. The inverse quantization module 118 is used to apply inverse quantization to the quantized samples to obtain dequantized coefficients. The inverse quantization module 118 applies a scheme opposite to the quantization scheme applied by the quantization module 115 with the same quantization step size as the quantization module 115. The inverse transform module 119 is used to apply the inverse transform of the transform applied by the transform module 114 to the dequantized samples, such as inverse DCT or inverse DST. The output of the inverse transform module 119 is the reconstructed residual of the block in the pixel domain. The reconstructed residual can be added to the prediction block 134 of the block to obtain the reconstructed block 136 in the pixel domain. For blocks that skip the transform, the inverse transform module 119 will not be applied. The dequantized samples are the reconstructed residual of the block.

[0033] Blocks in subsequent pictures after the first intra-predicted picture can be encoded using inter-prediction or intra-prediction. In inter-prediction, predictions for blocks in a picture come from one or more previously encoded video pictures. To perform inter-prediction, the video encoder 100 uses an inter-prediction module 124. The inter-prediction module 124 is used to perform motion compensation on blocks based on the motion estimate provided by the motion estimation module 122.

[0034] The motion estimation module 122 compares the current block 104 of the current picture with the decoded reference picture 108 for motion estimation. The decoded reference picture 108 is stored in the decoded picture buffer 130. The motion estimation module 122 selects a reference block from the decoded reference picture 108 that best matches the current block. The motion estimation module 122 further identifies the offset between the position (e.g., x, y coordinates) of the reference block and the position of the current block. This offset is called a motion vector (MV), which is provided to the inter-frame prediction module 124 along with the selected reference block. In some cases, multiple reference blocks are identified for the current block in multiple decoded reference pictures 108. Therefore, multiple motion vectors are generated and provided to the inter-frame prediction module 124 along with the corresponding reference blocks.

[0035] The inter-frame prediction module 124 uses the motion vector and other inter-frame prediction parameters to perform motion compensation to generate a prediction of the current block, i.e., an inter-frame prediction block 134. For example, based on the motion vector, the inter-frame prediction module 124 can locate the prediction block indicated by the motion vector in the corresponding reference picture. If there is more than one prediction block, these prediction blocks are merged with a certain weight to generate the prediction block 134 of the current block.

[0036] For the inter-frame prediction block, the video encoder 100 can subtract the inter-frame prediction block 134 from the block 104 to generate a residual block 106. The residual block 106 can be transformed, quantized, and entropy encoded in the same manner as the residual of the intra-frame prediction block described above. Similarly, the reconstructed block 136 of the inter-frame prediction block can be obtained by inverse quantizing and inverse transforming the residual and then combining it with the corresponding prediction block 134.

[0037] In order to obtain the decoded picture 108 for motion estimation, the reconstructed block 136 is processed by the loop filter module 120. The loop filter module 120 is used to smooth pixel transitions, thereby improving video quality. The loop filter module 120 can be used to implement one or more loop filters, such as an unblocking filter, a sample adaptive offset (SAO) filter, an adaptive loop filter (ALF), etc.

[0038] Figure 2 An example of a video decoder 200 is depicted, which is used to implement the embodiments presented herein. The video decoder 200 processes the encoded video 202 in the bitstream and generates a decoded picture 208. Figure 2 In the example shown, the video decoder 200 includes an entropy decoding module 216 , an inverse quantization module 218 , an inverse transform module 219 , a loop filter module 220 , an intra prediction module 226 , an inter prediction module 224 , and a decoded picture buffer 230 .

[0039] The entropy decoding module 216 is used to perform entropy decoding on the encoded video 202. The entropy decoding module 216 decodes the quantized coefficients, the coding parameters (including the intra-frame prediction parameters and the inter-frame prediction parameters), and other information. In some examples, the entropy decoding module 216 decodes the bitstream of the encoded video 202 into a binary representation, and then converts the binary representation into the quantized level of the coefficients. The entropy decoded coefficient levels are dequantized by the dequantization module 218 and then inversely transformed to the pixel domain by the inverse transformation module 219. The functions of the dequantization module 218 and the inverse transformation module 219 are similar to those described above with respect to Figure 1 The inverse quantization module 118 and the inverse transform module 119 are described. The inverse transformed residual block can be added to the corresponding prediction block 234 to generate a reconstructed block 236. For blocks that skip the transform, the inverse transform module 219 is not applied. The dequantized samples generated by the inverse quantization module 218 are used to generate the reconstructed block 236.

[0040] The prediction block 234 for a particular block is generated based on the prediction mode of the block. If the encoding parameters of the block indicate that the block is intra-predicted, a reconstructed block 236 of a reference block in the same picture may be input to the intra-prediction module 226 to generate the prediction block 234 for the block. If the encoding parameters of the block indicate that the block is inter-predicted, the prediction block 234 is generated by the inter-prediction module 224. The functions of the intra-prediction module 226 and the inter-prediction module 224 are similar to Figure 1 The intra-frame prediction module 126 and the inter-frame prediction module 124 in.

[0041] As above relative to Figure 1 As described, inter-frame prediction involves one or more reference pictures. The video decoder 200 generates a decoded picture 208 of the reference picture by applying the loop filter module 220 to the reconstructed block of the reference picture. The decoded picture 208 is stored in the decoded picture buffer 230 for use by the inter-frame prediction module 224 and output.

[0042] Reference now Figure 3 , Figure 3 An example of dividing a picture in a video into coding tree units according to some embodiments of the present disclosure is described. Figure 1 and Figure 2 As described above, in order to encode a picture of a video, the picture is divided into blocks, such as Figure 3 The CTU (Coding Tree Unit) 302 in the VVC is shown. For example, the CTU 302 may be a block of 128x128 pixels. Figure 3 In some examples, such as Figure 4As shown, each CTU 302 in the picture can be divided into one or more CUs (coding units) 402, and the CU 402 can be further divided into prediction units or transform units (TUs) for prediction and transformation. According to different coding schemes, the CTU 302 can be divided into CUs 402 in different ways. For example, in VVC, the CU 402 can be rectangular or square and can be encoded without further division into prediction units or transform units. Each CU 402 can be as large as its root CTU 302, or it can be a subdivision of the root CTU 302 as small as 4x4 blocks. Figure 4 As shown, the partitioning of CTU 302 to CU 402 in the VVC may be quadtree partitioning, binary tree partitioning, or ternary tree partitioning. Figure 4 In the figure, the solid line indicates a quadtree partition, and the dashed line indicates a binary or ternary tree partition.

[0043] General constraints in VVC version 1 (VVCv1)

[0044] In VVC version 1, the general constraint information (GCI) syntax structure general_constraints_info() is used to indicate specific constraint properties of a codestream. GCI contains a list of constraint flags and non-flag syntax elements. The binary flag gci_present_flag is used to specify whether a GCI syntax element is present. gci_present_flag equal to 1 specifies that a GCI syntax element is present in the general_constraints_info() syntax structure. gci_present_flag equal to 0 specifies that there is no GCI field in the general_constraints_info() syntax structure and that the general_constraint_info() syntax structure does not impose any constraints.

[0045] The general constraint information can be transmitted in a high-level syntax in a variety of contexts. For example, the GCI can be transmitted in a network packet that contains only decoding capability information, such as a network abstraction layer (NAL) packet with nal_unit_type set to 13 (i.e., DCI_NUT as the name of nal_unit_type), which only carries decoding capability information. Alternatively, the GCI can be transmitted in a video parameter set or a sequence parameter set.

[0046] The purpose of the GCI syntax structure is to enable discovery of configuration information related to the functionality required to decode a codestream and to allow the transmission of interoperability points that impose constraints beyond those specified by the configurations, tiers, and levels (PTLs) and at a finer granularity than allowed by previous video coding standards. Similar to sub-configurations, the use of the GCI syntax structure enables interoperability to be defined for decoder implementations that do not support all functionality of the VVC configuration but meet specific application requirements. Decoder implementations are able to review GCI syntax elements to check whether the codestream avoids the use of specific functionality, thereby determining how to configure the decoding process and identifying whether the codestream can be decoded by the decoder. Decoder implementations that support all functionality of the VVC configuration can ignore the GCI syntax element values, as such decoders are able to decode any codestream that conforms to the indicated PTL.

[0047] The general constraint information syntax structure specified in VVC version 1 is defined as follows.

[0048]

[0049]

[0050] The presence of the general constraint flag depends on the value of gci_present_flag. When the value of gci_present_flag is 1, the general constraint flag is present in the bitstream. When the value of gci_present_flag is 0, the general constraint flag is not present in the bitstream.

[0051] In addition to the common constraint flags defined by VVCvl, the syntax element gci_num_reserved_bits specifies additional common constraint flags.

[0052] gci_num_reserved_bits is an 8-bit unsigned integer whose value indicates the number of additional bits transmitted in the general constraint syntax structure. In the VVC specification, these additional bits (called syntax elements gci_reserved_zero_bit[i]) are extracted from the bitstream and discarded. This provision enables the VVCvl decoder to be at least forward compatible with the high-level syntax part of the bitstream generated by subsequent versions of VVC.

[0053] General constraints in VVC version 2 (VVCv2)

[0054] In the current draft of VVC version 2 ("VVC operating range extension (Draft 5)", ITU-T SG 16 WP 3 and ISO / IEC JTC 1 / SC29 Joint Video Experts Group document, JVET-X2005), some additional coding tools constrained by the general constraint flag are proposed. It is recommended to rename the 8-bit field called gc_num_reserved_bits in VVCvl to gci_num_additional_bits. The syntax of the VVCv2 proposal adjustment is as follows.

[0055]

[0056] There are 6 additional general constraint flags: gci_all_rap_pictures_constraint_flag, gci_no_extended_precision_processing_constraint_flag, gci_no_ts_residual_coding_rice_constraint_flag, gci_no_rrc_rice_extension_constraint_flag, gci_no_persistent_rice_adaptation_constraint_flag, and gci_no_reverse_last_sig_coeff_constraint_flag. The suggested interpretation ("semantics") of the gci_num_additional_bits syntax element is as follows.

[0057] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 1. Values ​​of gci_num_additional_bits greater than 1 are reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that values ​​of gci_num_additional_bits be equal to 0 or 1, decoders conforming to this version of this document shall allow values ​​of gci_num_additional_bits greater than 1 to be present in the syntax and shall ignore the values ​​of all gci_reserved_zero_bit[i] syntax elements when gci_num_additional_bits is greater than 1.

[0058] It is recommended that if the VVCv2 codestream transmits general constraint information, the syntax element gci_num_additional_bits should be set to 0 if the 6 VVCv2 general constraint flags are not transmitted, and gci_num_additional_bits should be set to 1 if the 6 VVCv2 general constraint flags are transmitted.

[0059] However, the VVCv2 general constraint syntax specification recommended above will result in incompatibility with the VVCvl decoder. Specifically, when transmitting an additional general constraint flag, the recommended VVCv2 syntax transmits the flag by setting gci_num_additional_bits to 1. In the VVCv2 decoder, when transmitting general constraint information, the gci_num_additional_bits syntax element is decoded from the bitstream as an 8-bit unsigned integer. If the value of gci_num_additional_bits is decoded to 1, 6 additional bits will be decoded from the bitstream. These 6 bits are interpreted as general constraint flags for additional decoding tools that may be constrained in VVCv2.

[0060] In a VVCv1 decoder, the same 8-bit field is interpreted as gci_num_reserved_bits. However, if the value of this syntax element is decoded as 1, only 1 additional bit will be decoded from the bitstream. This bit will be discarded and will not be used. Therefore, a VVCv1 decoder that is decoding a VVCv2 bitstream may experience desynchronization issues due to the presence of 5 additional bits in the bitstream that are not recognized by the VVCv1 specification.

[0061] As mentioned above, desynchronization is a serious incompatibility issue between different versions of the video coding standard. The VVCvl decoder cannot decode the entire content of the VVCv2 codestream because the VVCv2 codestream can use coding tools that are defined in the VVCv2 specification but are unknown to the VVCvl decoder. However, the VVCvl decoder should preferably be able to decode at least the high-level syntax portion of the VVCv2 codestream. By successfully decoding the high-level syntax, the video decoder can determine not only the general constraint information, but also the configuration and level information. This information provides the decoder with hints about the capabilities required to decode the codestream. For example, the general constraint information provides an indication to the decoder as to which coding tools are constrained by the codestream. The configuration and level information provide an indication to the decoder as to the uncompressed video data throughput (such as video data rate, frame rate, resolution, etc.) that needs to be supported.

[0062] If the high-level syntax is decoded successfully, the video decoder can determine whether the current bitstream can be decoded. If not, the decoder can gracefully terminate the decoding process. Conversely, asynchrony during high-level syntax decoding means that the information provided in the high-level syntax cannot be correctly decoded. In the worst case, the decoder may decode completely incorrect syntax element values ​​after asynchrony occurs, which in turn leads to incorrect parameter settings and incorrect decoding of subsequent low-level syntax, resulting in decoding failure.

[0063] Furthermore, in the VVCv2 decoder, when transmitting generic constraint information, the gci_num_additional_bits syntax element is decoded from the bitstream as an 8-bit unsigned integer. If the value of gci_num_additional_bits is decoded as 0, no further generic constraint flags are transmitted. In this case, no inferred value is specified for the additional generic constraint flag and its value is undefined. Therefore, it is unclear whether the coding tools associated with the additional generic constraint flag should be constrained or unconstrained, which may lead to inconsistent decoder implementations.

[0064] In the VVC specification, the name of the syntax element gci_reserved_zero_bit[i] misleadingly implies that the value of such syntax elements must be 0. Normally, when an encoder writes reserved syntax elements as placeholders into a bitstream, a default value is embedded in the name of the reserved syntax element. However, the design of the generic constraint syntax structure means that the encoder never writes to gci_reserved_zero_bit[i]. gci_reserved_zero_bit[i] is only used when a specific version of the VVC decoder reads a higher version of the VVC bitstream. In this case, the value of gci_reserved_zero_bit[i] cannot be guaranteed to be 0. Some solutions are proposed below to address the above issues.

[0065] Transmitting general constraint information

[0066] In one embodiment, general constraint information is transmitted to solve the above-mentioned out-of-sync problem. If the VVCv2 bitstream transmits general constraint information (i.e., the value of gci_present_flag is 1), and the VVCv2 general constraint information consists of N additional coding tools that may be constrained, then the value of the syntax element gci_num_additional_bits can only be set to 0 or N. If gci_num_additional_bits is set to 0, the general constraint flags of these N additional coding tools are not transmitted. If gci_num_additional_bits is set to N, the subsequent N bits in the bitstream are used to transmit the general constraint flags of these N additional coding tools. In one example, N is set to 6.

[0067] The VVCv2 bitstream does not allow the value of gci_num_additional_bits to be set to a value other than 0 or N. However, the VVCv2 decoder can still process general constraint information with the value of gci_num_additional_bits set to a value other than 0 or N. For example, the value of gci_num_additional_bits can be set to be greater than 0 and less than N, or greater than N. Let the decoded value of gci_num_additional_bits be M. Then if M is greater than 0 but less than N (i.e., 0 < M < N), after decoding the gci_num_additional_bits syntax element, the decoder extracts M bits from the bitstream as the gci_reserved_zero_bit[i] syntax element and discards them. If M is greater than N (i.e., N < M), after decoding the gci_num_additional_bits syntax element, the decoder extracts N bits from the bitstream and interprets them as the general constraint flags of N additional coding tools. Then, the decoder extracts M - N bits from the bitstream as the gci_reserved_zero_bit[i] syntax element and discards them.

[0068] In other examples, the VVCv2 decoder does not need to process general constraint information with the value of gci_num_additional_bits set to a value greater than 0 but less than N. A legal VVCv1 bitstream can only set the value of gci_num_reserved_bits to 0. A legal VVCv2 bitstream can only set the value of gci_num_reserved_bits to 0 or N. Future versions of the VVC bitstream will not allow the value of gci_num_additional_bits to be set to a value between 0 and N.

[0069] In an example of this embodiment, the general constraint information syntax of VVCv2 is modified to the 6 general constraint flags currently proposed for the VVCv2 encoding tool, as shown in Table 1 below (the added parts are shown with underscores and the deleted parts are shown with strikethroughs), where "if (gci_num_additional_bits>0)" is replaced with "if (gci_num_additional_bits>5)".

[0070] Table 1

[0071]

[0072]

[0073] In one example, if the coding tool in VVCv2 has 6 additional general constraint flags, the corresponding semantics of gci_num_additional_bits are (additions are shown underlined and deletions are shown in strikethrough):

[0074] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 6 . Other than 0 and 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow Other than 0 and 6 The gci_num_additional_bits value appears in the syntax and should be in the gci_num_additional_bits Other than 0 and 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when

[0075] In the example of gci_num_additional_bits semantics above, in addition to the above-mentioned 0 or 6, gci_num_additional_bits is also allowed to take values ​​other than 0 or 6. In other words, the value of gci_num_additional_bits can be between 1 and 5. The value of gci_num_additional_bits can also be greater than 6. If the value of gci_num_additional_bits (denoted as M) is between 1 and 5, according to the syntax shown in Table 1 above, the decoder will skip the steps executed when the "if" condition is true, jump to the "else" step, and assign the value of "numAdditionalBitsUsed" to 0. After that, M bits are read in the "for" loop and discarded. In this way, the problem of asynchronous synchronization can be avoided. If the value M of gci_num_additional_bits is greater than 6, 6 additional general constraint flags will be extracted, and the remaining M-6 bits will be further extracted and discarded.

[0076] In another example, if the coding tool in VVCv2 has 6 additional general constraint flags, the corresponding semantics of gci_num_additional_bits are (additions are shown underlined and deletions are shown in strikethrough):

[0077] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 6 . Greater than 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow greater than 6 The gci_num_additional_bits value appears in the syntax and should be greater than gci_num_additional_bits. 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when

[0078] In another embodiment of transmitting general constraint information, if the VVCv2 codestream transmits general constraint information (i.e., the value of gci_present_flag is 1), and the VVCv2 general constraint information consists of N additional coding tools that may be constrained, the syntax element gci_num_additional_bits may be set to a value of M. The range of M is 0 to N (including 0 and N) (0≤M≤N). If gci_num_additional_bits is set to 0, the general constraint flags of these N additional coding tools are not transmitted. If gci_num_additional_bits is set to a non-zero value M, the next M bits in the codestream are used to transmit the general constraint flags of M of these N additional coding tools. Which M of the additional coding tools are constrained is determined by the order in which the general constraint flags appear in the general constraint information syntax table.

[0079] In an example of this embodiment, the general constraint information syntax of VVCv2 is modified to 6 general constraint flags currently proposed for the VVCv2 coding tool, and the modification is shown in the following table.

[0080]

[0081] In another example of this embodiment, equivalent behavior can be achieved through a more compact syntax table.

[0082]

[0083]

[0084] An alternative arrangement of this embodiment can be expressed in the generic constraint information syntax by changing the order of the generic constraint flags of the VVCv2 coding tool.

[0085] If the coding tool in VVCv2 has 6 additional general constraint flags, the corresponding semantics of gci_num_additional_bits may be as follows.

[0086] gci_num_additional_bits specifies the additional bits in the general constraint information syntax structure except gci_alignment_ The number of additional GCI bits beyond the zero_bit syntax element (when present). In codestreams conforming to this version of this document, gci_ The value of num_additional_bits shall be between 0 and 6 (inclusive). Values ​​of gci_num_additional_bits greater than 6 Reserved for future use by ITU-T|ISO / IEC. Although gci_num_additional_bits is required in this version of this document The value of gci_num_ can be 0 to 6 (inclusive), but decoders conforming to this version of this document shall allow gci_num_ to be greater than 6. The additional_bits value appears in the syntax and should be ignored if gci_num_additional_bits is greater than 6. The value of the gci_reserved_zero_bit[i] syntax element.

[0087] In this embodiment, some or all of the additional general constraint flags may not be transmitted, depending on the value of gci_num_additional_bits. In one arrangement of this embodiment, when the VVCv2 codestream transmits general constraint information (i.e., if the value of the gci_present_flag flag is 1), no constraints are imposed on the coding tools corresponding to the additional general constraint flags that are not transmitted. This behavior can be expressed by modifying the semantics of gci_num_additional_bits as follows.

[0088] gci_num_additional_bits specifies the additional bits in the general constraint information syntax structure except gci_alignment_ The number of additional GCI bits beyond the zero_bit syntax element (when present). In codestreams conforming to this version of this document, gci_ The value of num_additional_bits shall be between 0 and 6 (inclusive). Values ​​of gci_num_additional_bits greater than 6 Reserved for future use by ITU-T|ISO / IEC. Although gci_num_additional_bits is required in this version of this document The value of gci_num_ can be 0 to 6 (inclusive), but decoders conforming to this version of this document shall allow gci_num_ to be greater than 6. The additional_bits value appears in the syntax and should be ignored if gci_num_additional_bits is greater than 6. gci_reserved_zero_bit[i] is the value of the syntax element. In addition, when gci_present_flag is equal to 1, it is not A coding tool imposes constraints for which there is no corresponding constraint flag in the syntax of general_constraints_info().

[0089] In another arrangement of this embodiment, when the VVCv2 code stream transmits general constraint information (i.e., if the value of gci_present_flag is 1) and the additional general constraint flag is not transmitted, the corresponding tool will be constrained. As follows, this behavior can be expressed by modifying the semantics of the additional general constraint flag.

[0090] gci_num_additional_bits specifies the additional bits in the general constraint information syntax structure except gci_alignment_ The number of additional GCI bits beyond the zero_bit syntax element (when present). In codestreams conforming to this version of this document, gci_ The value of num_additional_bits shall be between 0 and 6 (inclusive). Values ​​of gci_num_additional_bits greater than 6 Reserved for future use by ITU-T|ISO / IEC. Although gci_num_additional_bits is required in this version of this document The value of gci_num_ can be 0 to 6 (inclusive), but decoders conforming to this version of this document shall allow gci_num_ to be greater than 6. The additional_bits value appears in the syntax and should be ignored if gci_num_additional_bits is greater than 6. The value of the gci_reserved_zero_bit[i] syntax element.

[0091] gci_all_rap_pictures_constraint_flag equal to 1 specifies that all pictures in OlsInScope are GDR pictures or IRAP pictures with ph_recovery_poc_cnt equal to 0. gci_all_rap_pictures_constraint_flag equal to 0 does not impose this constraint. When gci_present_flag is equal to 1 and gci_all_rap_ When pictures_constraint_flag does not exist, the value of gci_all_rap_pictures_constraint_flag is pushed It is considered equal to 1.

[0092] gci_no_extended_precision_processing_constraint_flag equal to 1 specifies that the sps_extended_precision_flag of all pictures in OlsInScope shall be equal to 0. gci_no_extended_precision_processing_constraint_flag equal to 0 does not impose this constraint. When gci_present_flag When gci_no_extended_precision_processing_constraint_flag is equal to 1 and gci_no_extended_precision_processing_constraint_flag does not exist, gci_no_ The value of extended_precision_processing_constraint_flag is inferred to be equal to 1.

[0093] gci_no_ts_residual_coding_rice_constraint_flag equal to 1 specifies that the sps_ts_residual_coding_rice_present_in_sh_flag of all pictures in OlsInScope shall be equal to 0. gci_no_ts_residual_coding_rice_constraint_flag equal to 0 does not impose this constraint. When gci_present_flag When gci_no_ts_residual_coding_rice_constraint_flag is equal to 1 and gci_no_ts_residual_coding_rice_constraint_flag does not exist, gci_no_ts_ The value of residual_coding_rice_constraint_flag is inferred to be equal to 1.

[0094] gci_no_rrc_rice_extension_constraint_flag equal to 1 specifies that the sps_rrc_rice_extension_flag of all pictures in OlsInScope shall be equal to 0. gci_no_rrc_rice_extension_constraint_flag equal to 0 does not impose this constraint. When gci_present_flag is equal to 1 and gci_no_rrc_ When rice_extension_constraint_flag does not exist, gci_no_rrc_rice_extension_constraint_ The value of flag is inferred to be equal to 1.

[0095] gci_no_persistent_rice_adaptation_constraint_flag equal to 1 specifies that the sps_persistent_rice_adaptation_enabled_flag of all pictures in OlsInScope shall be equal to 0. gci_no_persistent_rice_adaptation_constraint_flag equal to 0 does not impose this constraint. When gci_ When present_flag is equal to 1 and gci_no_persistent_rice_adaptation_constraint_flag does not exist, The value of gci_no_persistent_rice_adaptation_constraint_flag is inferred to be equal to 1.

[0096] gci_no_reverse_last_sig_coeff_constraint_flag equal to 1 specifies that the sps_reverse_last_sig_coeff_enabled_flag of all pictures in OlsInScope shall be equal to 0. gci_no_reverse_last_sig_coeff_constraint_flag equal to 0 does not impose this constraint. When gci_present_flag is equal to 1 and gci_ When no_reverse_last_sig_coeff_constraint_flag does not exist, gci_no_reverse_last_sig_ The value of coeff_constraint_flag is inferred to be equal to 1.

[0097] Initializes the general constraint information flag

[0098] This article describes an embodiment of initializing the general constraint information flags to solve the above-mentioned problem of unclear and inconsistent decoder implementations. In this embodiment, when gci_present_flag is equal to 1 and gci_num_additional_bits is equal to 0, general_constraints_info() does not impose constraints on coding tools related to gci_all_rap_pictures_constraint_flag, gci_no_extended_precision_processing_constraint_flag, gci_no_ts_residual_coding_rice_constraint_flag, gci_no_reverse_last_sig_coeff_constraint_flag, gci_no_rrc_rice_extension_constraint_flag, and gci_no_persistent_rice_adaptation_constraint_flag.

[0099] As an example, possible changes in the semantics of gci_num_additional_bits are shown below, which are based on the current version of the VVC version 2 specification (additions are shown underlined and deletions are shown in strikethrough).

[0100] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 1. Values ​​of gci_num_additional_bits greater than 1 are reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that values ​​of gci_num_additional_bits be equal to 0 or 1, decoders conforming to this version of this document shall allow values ​​of gci_num_additional_bits greater than 1 to be present in the syntax and shall ignore the values ​​of all gci_reserved_zero_bit[i] syntax elements when gci_num_additional_bits is greater than 1. When gci_present_flag is equal to 1 and gci_num_additional_bits is equal to 0, general_ constraints_info() does not work with gci_all_rap_pictures_constraint_flag, gci_no_ extended_precision_processing_constraint_flag, gci_no_ts_residual_coding_rice_ constraint_flag, gci_no_reverse_last_sig_coeff_constraint_flag, gci_no_rrc_ rice_extension_constraint_flag and gci_no_persistent_rice_adaptation_ constraint_flag The associated coding tools impose constraints.

[0101] As another example, gci_num_ additional The possible changes to the semantics of _bits are shown below, based on the current version of the VVC version 2 specification.

[0102] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 6 . Other than 0 and 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow Other than 0 and 6 The gci_num_additional_bits value appears in the syntax and should be in the gci_num_additional_bits Other than 0 and 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when When gci_present_flag is equal to 1 and gci_ When num_additional_bits is equal to 0, general_constraints_info() does not match gci_all_rap_ pictures_constraint_flag, gci_no_extended_precision_processing_constraint_ flag, gci_no_ts_residual_coding_rice_constraint_flag, gci_no_reverse_last_sig_ coeff_constraint_flag, gci_no_rrc_rice_extension_constraint_flag and gci_no_ persistent_rice_adaptation_constraint_flag related coding tools impose constraints.

[0103] In the current version of the VVC version 2 specification, the semantics of gci_num_additional_bits is only used when gci_present_flag is equal to 1. The scenario of gci_present_flag equal to 0 is addressed in other sections of the VVC version 2 specification. Therefore, the "when gci_present_flag is equal to 1" in the above gci_num_additional_bits semantics is automatically satisfied. In addition, since the VVC version 2 specification does not allow the value of gci_num_additional_bits to be between 1 and 5, "gci_num_additional_bits is equal to 0" is equivalent to "gci_num_additional_bits is less than or equal to 5" or "gci_all_rap_pictures_constraint_flag, gci_no_extended_precision_processing_constraint_flag, gci_no_ts_residual_coding_rice_constraint_flag, gci_no_reverse_last_sig_coeff_constraint_flag, gci_no_rrc_rice_extension_ constraint _flag and gci_no_persistent_rice_adaptation_constraint_flag do not exist". Therefore, the above modification to the gci_num_additional_bits semantics is equivalent to the following.

[0104] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 6 . Other than 0 and 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow Other than 0 and 6The gci_num_additional_bits value appears in the syntax and should be in the gci_num_additional_bits Other than 0 and 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when When gci_all_rap_pictures_ constraint_flag, gci_no_extended_precision_processing_constraint_flag, gci_no_ ts_residual_coding_rice_constraint_flag, gci_no_reverse_last_sig_coeff_ constraint_flag, gci_no_rrc_rice_extension_constraint_flag and gci_no_ When persistent_rice_adaptation_constraint_flag does not exist, general_constraints_info () does not match gci_all_rap_pictures_constraint_flag, gci_no_extended_precision_ processing_constraint_flag, gci_no_ts_residual_coding_rice_constraint_flag, gci_no_reverse_last_sig_coeff_constraint_flag, gci_no_rrc_rice_extension_ constraint_flag and gci_no_persistent_rice_adaptation_constraint_flag related Code tools impose constraints.

[0105] Below are a few examples where the inferred value of the additional generic constraint flag can be set in a manner similar to the semantics described above. For example, the semantics of the additional generic constraint flag can be modified as follows to include inferred value setting.

[0106] gci_all_rap_pictures_constraint_flag equal to 1 specifies that all pictures in OlsInScope are GDR pictures or IRAP pictures with ph_recovery_poc_cnt equal to 0. gci_all_rap_pictures_constraint_flag equal to 0 does not impose this constraint. When not present, gci_all_rap_pictures_ The value of constraint_flag is inferred to be equal to 0.

[0107] gci_no_extended_precision_processing_constraint_flag equal to 1 specifies that the sps_extended_precision_flag of all pictures in OlsInScope shall be equal to 0. gci_no_extended_precision_processing_constraint_flag equal to 0 does not impose this constraint. When not present, gci_no_ The value of extended_precision_processing_constraint_flag is inferred to be equal to 0.

[0108] gci_no_ts_residual_coding_rice_constraint_flag is equal to 1 to specify that all pictures in OlsInScope sps _ts_residual_coding_rice_present_in_sh_flag shall be equal to 0. gci_no_ts_residual_coding_rice_constraint_flag is equal to 0 to not impose this constraint. When not present, gci_no_ The value of ts_residual_coding_rice_constraint_flag is inferred to be equal to 0.

[0109] gci_no_rrc_rice_extension_constraint_flag equal to 1 specifies that the sps_rrc_rice_extension_flag of all pictures in OlsInScope should be equal to 0. extension _constraint_flag equal to 0 does not impose this constraint. When not present, gci_no_rrc_rice_extension_ The value of constraint_flag is inferred to be equal to 0.

[0110] gci_no_persistent_rice_adaptation_constraint_flag is equal to 1 to specify the sps_ persistent _rice_adaptation_enabled_flag shall be equal to 0. gci_no_persistent_rice_adaptation_constraint_flag equal to 0 does not impose this constraint. When it does not exist, The value of gci_no_persistent_rice_adaptation_constraint_flag is inferred to be equal to 0.

[0111] gci_no_reverse_last_sig_coeff_constraint_flag equal to 1 specifies that the sps_reverse_last_sig_coeff_enabled_flag of all pictures in OlsInScope shall be equal to 0. gci_no_reverse_last_sig_coeff_constraint_flag equal to 0 does not impose this constraint. When not present, gci_no_reverse_ The value of last_sig_coeff_constraint_flag is inferred to be equal to 0.

[0112] In another example, the semantics of the additional general constraint flag is modified as follows.

[0113] gci_all_rap_pictures_constraint_flag equal to 1 specifies that all pictures in OlsInScope are GDR pictures with ph_recovery_poc_cnt equal to 0, or IRAP pictures. pictures _constraint_flag equal to 0 does not impose this constraint. When gci_all_rap_pictures_constraint_flag is not When present, its value is inferred to be equal to 0.

[0114] gci_no_extended_precision_processing_constraint_flag equal to 1 specifies that the sps_extended_precision_flag of all pictures in OlsInScope shall be equal to 0. gci_no_extended_precision_processing_constraint_flag equal to 0 does not impose this constraint. When gci_no_extended_ When precision_processing_constraint_flag is not present, its value is inferred to be equal to 0.

[0115] gci_no_ts_residual_coding_rice_constraint_flag equal to 1 specifies that the sps_ts_residual_coding_rice_present_in_sh_flag of all pictures in OlsInScope shall be equal to 0. gci_no_ts_residual_coding_rice_constraint_flag equal to 0 does not impose this constraint. When gci_no_ts_ When residual_coding_rice_constraint_flag is not present, its value is inferred to be equal to 0.

[0116] gci_no_rrc_rice_extension_constraint_flag equal to 1 specifies that the sps_rrc_rice_extension_flag of all pictures in OlsInScope shall be equal to 0. gci_no_rrc_rice_extension_constraint_flag equal to 0 does not impose this constraint. When gci_no_rrc_rice_extension_constraint_ When flag is not present, its value is inferred to be equal to 0.

[0117] gci_no_persistent_rice_adaptation_constraint_flag equal to 1 specifies that the sps_persistent_rice_adaptation_enabled_flag of all pictures in OlsInScope should be equal to 0. persistent If _rice_adaptation_constraint_flag is equal to 0, this constraint is not imposed. When gci_no_ When persistent_rice_adaptation_constraint_flag is not present, its value is inferred to be equal to 0.

[0118] gci_no_reverse_last_sig_coeff_constraint_flag equal to 1 specifies that the sps_reverse_last_sig_coeff_enabled_flag of all pictures in OlsInScope should be equal to 0. last _sig_coeff_constraint_flag equal to 0 does not impose this constraint. When gci_no_reverse_last_sig_ When coeff_constraint_flag is not present, its value is inferred to be equal to 0.

[0119] In another example, the semantics of gci_num_additional_bits is modified as follows.

[0120] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 6 . Greater than 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow greater than 6 The gci_num_additional_bits value appears in the syntax and should be greater than gci_num_additional_bits. 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when When gci_num_additional_bits is equal to 0, all constraints specified by the additional GCI bits Flags is inferred to be equal to 0.

[0121] In another example, the semantics of gci_num_additional_bits is modified as follows.

[0122] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). VersionIn the code stream, the value of gci_num_additional_bits shall be equal to 0 or 6 . Greater than 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow greater than 6 The gci_num_additional_bits value appears in the syntax and should be greater than gci_num_additional_bits. 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when When not present, all constraint flags specified by the additional GCI bits are inferred to be equal to 0.

[0123] In another Example The syntax and semantics of the general constraint information syntax element are modified as follows.

[0124]

[0125]

[0126]

[0127] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, gci_num_ additional The value of _bits should be equal to 0 or 6 . Greater than 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow greater than 6 The gci_num_additional_bits value appears in the syntax and should be greater than gci_num_additional_bits. 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when When gci_num_additional_bits is equal to 0, additional_general_ The constraints_info() syntax does not impose any constraints.

[0128] In another example, the semantics of the general constraint information syntax element is modified as follows.

[0129] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 6 . Greater than 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow greater than 6 The gci_num_additional_bits value appears in the syntax and should be greater than gci_num_additional_bits. 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when When not present, the additional_general_constraints_info() syntax structure is not applied. Add any constraints.

[0130] exist initializationIn another embodiment of the general constraint information flag, when gci_present_flag is equal to 1 and gci_num_additional_bits is equal to 0, gci_all_rap_pictures_constraint_flag, gci_no_extended_precision_processing_constraint_flag, gci_no_ts_residual_coding_rice_constraint_flag, gci_no_reverse_last_sig_coeff_constraint_flag, gci_no_rrc_rice_extension_constraint_flag, and gci_no_persistent_rice_adaptation_constraint_flag may always impose the corresponding constraints specified by the semantics of these flags respectively. In other words, when the GCI flag is present and gci_num_additional_bits is equal to 0, these 6 GCI flags are inferred to be equal to 1.

[0131] As an example, possible changes to the semantics of gci_num_additional_bits are shown below, based on the current additions to the VVC version 2 specification.

[0132] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 1. Values ​​of gci_num_additional_bits greater than 1 are reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that values ​​of gci_num_additional_bits be equal to 0 or 1, decoders conforming to this version of this document shall allow values ​​of gci_num_additional_bits greater than 1 to be present in the syntax and shall ignore the values ​​of all gci_reserved_zero_bit[i] syntax elements when gci_num_additional_bits is greater than 1. When gci_present_flag is equal to 1 and gci_num_additional_bits is equal to 0, gci_all_rap_ pictures_constraint_flag, gci_no_extended_precision_processing_constraint_ flag, gci_no_ts_residual_coding_rice_constraint_flag, gci_no_reverse_last_sig_ coeff_constraint_flag, gci_no_rrc_rice_extension_constraint_flag and gci_no_ persistent_rice_adaptation_constraint_flag is inferred to be equal to 1.

[0133] As another example, possible changes to the semantics of gci_num_additional_bits are shown below, based on the current additions to the VVC version 2 specification.

[0134] gci_num_additional_bits specifies the number of additional GCI bits in the general constraint information syntax structure, excluding the gci_alignment_zero_bit syntax element (when present). In codestreams conforming to this version of this document, the value of gci_num_additional_bits shall be equal to 0 or 6 . Other than 0 and 6 The value of gci_num_additional_bits is reserved by ITU-T|ISO / IEC for future use. Although this version of this document requires that the value of gci_num_additional_bits be equal to 0 or 6 , but decoders conforming to this version of this document shall allow Other than 0 and 6 The gci_num_additional_bits value appears in the syntax and should be in the gci_num_additional_bits Other than 0 and 6 The values ​​of all gci_reserved_zero_bit[i] syntax elements are ignored when When gci_present_flag is equal to 1 and gci_ When num_additional_bits is equal to 0, gci_all_rap_pictures_constraint_flag, gci_no_ extended_precision_processing_constraint_flag, gci_no_ts_residual_coding_rice_ constraint_flag, gci_no_reverse_last_sig_coeff_constraint_flag, gci_no_rrc_ rice_extension_constraint_flag and gci_no_persistent_rice_adaptation_ constraint_flag is inferred to be equal to 1.

[0135] As a supplement or alternative to the above embodiment, the misleading syntax element gci_reserved_zero_bit[i] may be renamed as gci_reserved_bit[i]. For example, the modified syntax and semantics may be as follows.

[0136]

[0137] gci_reserved_bit[i] MAY have any value. Its presence and value do not affect the decoding process as specified in this version of this specification. Decoders conforming to this version of this specification SHOULD ignore all gci_reserved_bit[i] The value of the syntax element.

[0138] In another embodiment, the syntax element gci_reserved_zero_bit[i] is renamed to gci_reserved_bit[i]. For example, the modified syntax and semantics may be as follows.

[0139]

[0140] gci_reserved_bit[i] Can have any value. Its existence and value do not affect this specification This version specifies the decoding process. Decoders conforming to this version of this specification should ignore all gci_reserved_bit[i] The value of the syntax element.

[0141] General restriction signs

[0142] gci_all_rap_pictures_constraint_flag

[0143] gci_all_rap_pictures_constraint_flag is used to indicate that pictures are restricted to IRAP or GDR pictures.

[0144] The Network Abstraction Layer (NAL) is a system interface that organizes VVC syntax elements into "NAL units". This structure allows VVC to be easily and effectively customized to suit a wide range of use cases, from real-time communication applications to file formats for storage applications. The complete list of NAL unit types in the VVC standard is shown in the following table.

[0145]

[0146]

[0147] NAL units classified as Video Coding Layer (VCL) contain low-level syntax elements, while NAL units classified as non-VCL contain high-level syntax elements. Pictures of a video sequence are decoded from VCL NAL units. Different types of VCL categories can be used to indicate dependencies at a high level. For example, NAL units from TRAIL_NUT (0) to RSV_VCL_6 (6) can typically use inter-frame prediction tools, depending on whether a previously decoded (reference) picture can be accessed. Pictures encoded using inter-frame prediction tools can be compressed more efficiently than pictures compressed using only intra-frame prediction tools. However, this decoding dependency can cause problems when reference pictures are not available.

[0148] An intra random access point (IRAP) picture is a coded picture whose VCL NAL units have the same nal_unit_type value, which is in the range of IDR_W_RADL to CRA_NUT (inclusive). An IRAP picture can be either a CRA picture or an IDR picture. An IRAP picture does not use inter prediction from the same-layer reference pictures during decoding. The first picture in the bitstream in decoding order is an IRAP picture or a gradual decoding refresh (GDR) picture. For a single-layer bitstream, the IRAP picture and all subsequent non-RASL pictures in the decoding order of the CLVS can be correctly decoded without performing decoding processing on any pictures that precede the IRAP picture in the decoding order, as long as the necessary parameter sets are available when the reference is needed. The pps_mixed_nalu_types_in_pic_flag value of an IRAP picture is equal to 0. When pps_mixed_nalu_types_in_pic_flag of a picture is equal to 0 and the nal_unit_type of any slice of the picture is in the range of IDR_W_RADL to CRA_NUT (including IDR_W_RADL and CRA_NUT), the nal_unit_type value of all other slices of the picture is the same and the picture is known to be an IRAP picture after the first slice is received.

[0149] Therefore, IRAP pictures do not use inter-frame prediction across the same layer. This restriction allows IRAP pictures to be used as error recovery points for streaming video applications, or as seek locations for video in on-demand playback applications. However, IRAP pictures are typically less compressed than non-IRAP pictures.

[0150] Gradual Decoding Refresh (GDR) pictures were introduced in the VVC standard as a trade-off between non-IRAP and IRAP pictures. GDR pictures have some "clean" parts that do not use inter-frame prediction, while the rest of the picture is free to use inter-frame prediction. By splitting the picture in this way, the "clean" parts can still be decoded correctly in the event of error events such as packet loss. In consecutive GDR pictures, the spatial position of the "clean" parts is rotated, so that the entire picture can eventually be recovered from the error.

[0151] For video applications where streaming recovery capabilities for playback flexibility are important, it may be desirable to restrict all pictures to be either IRAP or GDR pictures. In VVCv2, the GCI flag gci_all_rap_pictures_constraint_flag was introduced to be able to indicate this restriction at a high level. gci_all_rap_pictures_constraint_flag equal to 1 specifies that all pictures in OlsInScope are either GDR pictures with ph_recovery_poc_cnt equal to 0, or IRAP pictures. gci_all_rap_pictures_constraint_flag equal to 0 does not impose this constraint. When gci_all_rap_pictures_constraint_flag is not present, its value is inferred to be equal to 0.

[0152] When the profile_tier_level() syntax structure is included in a VPS, OlsInScope is one or more output layer sets (OLS) specified by the VPS. When the profile_tier_level() syntax structure is included in an SPS, OlsInScope is an OLS that includes only the lowest layer among the layers that reference the SPS, and the lowest layer is an independent layer.

[0153] gci_no_extended_precision_processing_constraint_flag

[0154] The GCI flag gci_no_extended_precision_processing_constraint_flag communicates at a high level whether the VVCv2 tools for extended transform precision are constrained. In the VVC standard, pixels of a video signal are represented by integer values. All computations and processing described in the VVC standard are represented by operations on integers. This constraint is very important for reasons of complexity and interoperability. First, the computational cost of performing integer operations (addition, multiplication, and division) is generally lower than the equivalent floating-point operations. Second, floating-point operations are not deterministically standardized. Floating-point addition and multiplication are not necessarily commutative (for example, (a+b)+c is not necessarily equal to a+(b+c)), and the evaluation of floating-point operations on different platforms is not guaranteed to be exactly the same.

[0155] The bit depth of the video signal samples is a property of the video source and is denoted as BitDepth in the VVC standard. In a hybrid video coding system, video samples are predicted by inter-frame prediction or intra-frame prediction tools. The difference between the original video sample and the predicted sample is called the residual. In the worst case, the bit depth of these residual coefficients may be enlarged (for example, BitDepth+1); but in the VVC standard, these residual coefficients are clipped to maintain the bit depth BitDepth. In practice, the worst case will not occur because a practical encoder will not choose a prediction tool that produces a residual with a larger amplitude than the original video signal.

[0156] The residual coefficients are then usually analyzed by an integer discrete cosine transform (DCT) to produce transform coefficients. The discrete cosine transform (DCT) is a linear, reversible function that can be expressed as:

[0157] f: in, Represents an N-dimensional space of real numbers. The VVC standard uses an integer approximation of DCT (i.e., f: ). Unlike prediction, some extension of the bit depth is usually allowed at the transform stage, since the accuracy of the transform affects the coding gain. The bit depth of the approximated DCT coefficients and the resulting bit depth of the transform coefficients are design decisions that are a trade-off between hardware complexity and coding performance.

[0158] In VVCv1, the bit depth of the transform coefficient is 16. That is, the value range of each transform coefficient is [-2 15 ,2 15 -1]. Multiplication of the video samples with the integerized DCT coefficients usually produces intermediate transform coefficients with a bit depth greater than 16. To generate transform coefficients with the required bit depth, the intermediate transform coefficients are shifted to the right. This operation is inherently lossy.

[0159] In VVCv2, extended transform precision can be enabled by setting the SPS flag sps_extended_precision_flag to 1. If extended transform precision is enabled, the transform coefficient bit depth will be increased to (Log2TransformRange+1). The exact transform coefficient bit depth depends on BitDepth. sps_extended_precision_flag equal to 1 specifies that the extended dynamic range is used for transform coefficients during scaling and transformation, and that the extended dynamic range is used for binarization of the abs_remaining[] and dec_abs_level[] syntax elements. sps_extended_precision_flag equal to 0 specifies that the extended dynamic range is not used during scaling and transformation, and that the extended dynamic range is not used for binarization of the abs_remaining[] and dec_abs_level[] syntax elements. When not present, the value of sps_extended_precision_flag is inferred to be equal to 0. The derivation process of the variable Log2TransformRange is as follows.

[0160] Log2TransformRange=sps_extended_precision_flag? Max(15,Min(20,BitDepth+6)):15

[0161] CoeffMin=-(1<<(sps_extended_precision_flag?Max(15,Min(20,BitDepth+6)):15))

[0162] CoeffMax=(1<<(sps_extended_precision_flag?Max(15,Min(20,BitDepth+6)):15))-1

[0163] gci_no_extended_precision_processing_constraint_flag equal to 1 specifies that the sps_extended_precision_flag of all pictures in OlsInScope should be equal to 0. OlsInScope is also referred to as the "scoped output layer set" in this document. When the profile_tier_level() syntax structure is included in the VPS, OlsInScope is one or more output layer sets (OLS) specified by the VPS. When the profile_tier_level() syntax structure is included in the SPS, OlsInScope is an OLS that includes only the lowest layer of the layers that reference the SPS, and the lowest layer is an independent layer. gci_no_extended_precision_processing_constraint_flag equal to 0 does not impose this constraint. When gci_no_extended_precision_processing_constraint_flag is not present, its value is inferred to be equal to 0.

[0164] gci_no_ts_residual_coding_rice_constraint_flag

[0165] The GCI flag gci_no_ts_residual_coding_rice_constraint_flag transmits at a high level whether the VVCv2 tool for explicit Rice parameter transmission is constrained. During entropy coding, the entropy coding process encodes each syntax element value into a bit sequence and inserts it into the codestream.

[0166] The two entropy coding processes used in VVC are Content Adaptive Binary Arithmetic Coding (CABAC) and Rice coding. The CABAC engine is adaptive and can compress syntax elements to a bit rate very close to the theoretical Shannon limit. However, arithmetic coding is very complex. In order to encode non-binary syntax elements (for example, syntax elements with a value range outside of 0 or 1) using CABAC, the syntax elements must first be binarized into a set of "containers". The following table gives two examples of binarization. The second example shows that for variable-length binarization, there may be no containers for some values ​​of the syntax elements.

[0167] Table: Fixed-length binarization example

[0168] value Binarization 0 00 1 01 2 10 3 11

[0169] Table: Variable-length binarization example

[0170] value Binarization 0 0 1 10 2 110 3 1110 4 1111

[0171] Each container in the binarization can be encoded by a CABAC engine. However, in order to encode a container using CABAC, the engine must store and update the associated "content". This content models the probability distribution of the container. In the binarization of syntax elements, each container requires a separate content.

[0172] Syntax elements with a large range of values ​​are not suitable for pure CABAC coding, because the binarization of such syntax elements is long, which would cause too much overhead in content storage and update. For example, residual coefficient values ​​are not suitable for pure CABAC coding. Compared with CABAC, Rice coding can model the probability distribution of non-binary values ​​with compact parameters.

[0173] Rice coding can also be called Golomb coding or Rice-Golomb coding. Golomb coding is an entropy encoder controlled by a single parameter M, which is restricted to be a positive integer. Rice coding is a subset of Golomb coding, in which the entropy encoder is controlled by a single Rice parameter R, which is a non-negative integer. Rice coding with Rice parameter R is equivalent to Golomb coding, where M = 2 R .

[0174] As follows, the non-negative integer value x is binarized into a Rice code with Rice parameter R. The calculation formula of the quotient q and the remainder r is:

[0175]

[0176] r = x modulo 2 R

[0177] The Rice code of x is a combination of prefix code and suffix code. The prefix code is determined by the unary code of q. For example, the prefix code used in VVC is a truncated unary code:

[0178]

[0179]

[0180] Since the unary encoding is truncated, the Rice encoding is also truncated, which means that the range of values ​​of x that can be encoded is limited. In VVC, truncated Rice encoding is applied to the range [0,6*2 R ]’s x value.

[0181] The suffix code is the binarization of the fixed-length code r with a length of R bits. For example, if R = 3, the suffix code is:

[0182] r Fixed length encoding 0 000 1 001 2 010 3 011 4 100 5 101 6 110 7 111

[0183] In VVC, the residual coefficients are encoded by a combination of CABAC, Rice coding, and exponential Golomb coding. A small number of syntax element flags are defined, which are sufficient to transmit small residual values. For example, sig_coeff_flag indicates whether the residual amplitude is zero. If sig_coeff_flag is 1, more flags (usually named abs_level_gtx_flag) can be transmitted, which indicate whether the residual amplitude is greater than 1, 2, 3, etc. These flags are content-encoded by the CABAC engine. Since most residual coefficients have small amplitudes, CABAC can effectively encode most residuals using relatively few containers.

[0184] Any remaining magnitude of the residual coefficients that cannot be transmitted via the residual coefficient flag are transmitted in the syntax element abs_remainder. If the value of abs_remainder is less than or equal to 6*2 R , then all syntax elements are transmitted through the Rice coding of abs_remainder. If it is greater than 6*2 R , then the syntax element is passed through 6*2 R The Rice code and (abs_remainder-6*2 R ) is associated with the exponential Golomb coding of the . The exponential Golomb coding process is not described here.

[0185] Although Rice coding is simpler than CABAC, it can also be effectively compressed to low bit rates under appropriate conditions. For residual coefficients whose values ​​are all small, Rice coding with smaller Rice parameters is more efficient. Conversely, when the values ​​of some residual coefficients are large, larger Rice parameters may be more appropriate. In order to adapt to the statistics of the residual coefficients, the Rice parameter is adaptively determined by the value locSumAbs, which is calculated based on the amplitudes of adjacent residual coefficients.

[0186] locSumAbs 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 cRiceParam 0 0 0 0 0 0 0 1 1 1 1 1 1 1 2 2 locSumAbs 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 cRiceParam 2 2 2 2 2 2 2 2 2 2 2 2 3 3 3 3

[0187] Adaptive Rice parameter determination is designed for residual coefficients in "regular residual coding" (RRC), which are residual coefficients obtained by performing a discrete cosine transform (DCT). However, in VVCv1, it is also applicable to residual coefficients in "transform skip residual coding" (TSRC). In VVCv2, it is realized that an alternative mechanism for Rice parameter determination may be beneficial for transform-skip coefficients.

[0188] An alternative mechanism in VVCv2 allows the Rice parameter to be explicitly transmitted through the slice-level syntax element sh_ts_residual_coding_rise_idx_minus1. When this syntax element is transmitted, the Rice parameter will be set to R=sh_ts_residual_coding_rise_idx_minus1+1. This value of the Rice parameter is maintained for the duration of the slice.

[0189]

[0190]

[0191] sh_ts_residual_coding_rice_idx_minus1 plus 1 specifies the Rice parameter for the residual_ts_coding() syntax structure in the current slice. When not present, the value of sh_ts_residual_coding_rice_idx_minus1 is inferred to be equal to 0.

[0192] Whether the alternative mechanism is enabled is controlled by the SPS level flag sps_ts_residual_coding_rice_present_in_sh_flag. If this flag is set to 0, alternative Rice parameter transmission is not enabled. The GCI flag gci_no_ts_residual_coding_rice_constraint_flag signals at a high level whether the VVCv2 tools for explicit Rice parameter transmission are constrained. gci_no_ts_residual_coding_rice_constraint_flag equal to 1 specifies that sps_ts_residual_coding_rice_present_in_sh_flag should be equal to 0 for all pictures in OlsInScope. gci_no_ts_residual_coding_rice_constraint_flag equal to 0 does not impose this constraint. When gci_no_ts_residual_coding_rice_constraint_flag is not present, its value is inferred to be equal to 0.

[0193] gci_no_rrc_rice_extension_constraint_flag

[0194] gci_no_rrc_rice_extension_constraint_flag specifies the sps_rrc_rice_extension_flag of all pictures in OlsInScope. gci_no_rrc_rice_extension_constraint_flag equal to 1 specifies that the sps_rrc_rice_extension_flag of all pictures in OlsInScope shall be equal to 0. gci_no_rrc_rice_extension_constraint_flag equal to 0 does not impose this constraint.

[0195] For high bit depth and high bit rate applications, there are many large quantization levels in many locations of the RRC. For such applications, larger Rice parameters will result in a reduction in the number of containers required to represent the remaining levels. The method of deriving Rice parameters in VVCvl may not be optimal for VVCv2 applications. Therefore, alternative Rice parameter derivation can be used, which can be transmitted via sps_rrc_rice_extension_flag. sps_rrc_rice_extension_flag equal to 1 specifies that alternative Rice parameter derivation is used for the binarization of abs_remaining[] and dec_abs_level[]. sps_rrc_rice_extension_flag equal to 0 specifies that alternative Rice parameter derivation is not used for the binarization of abs_remaining[] and dec_abs_level[]. When not present, the value of sps_rrc_rice_extension_flag is inferred to be equal to 0.

[0196] An example of using sps_rrc_rice_extension_flag to determine Rice parameters in VVCv2 is shown below. Given an array AbsLevel[x][y] of a transform block with component index cIdx and an upper left luminance position (x0, y0), the variable locSumAbs is derived as specified in the following pseudo code process (the underlined part is what VVCv2 adds relative to VVCvl).

[0197]

[0198] The lists Tx[] and Rx[] are defined as follows:

[0199] Tx[]={32,128,512,2048} (1523)

[0200] Rx[]={0,2,4,6,8} (1524)

[0201] The value of the variable shiftVal is derived as follows:

[0202]

[0203]

[0204] The value of locSumAbs is updated as follows:

[0205] locSumAbs=Clip3(0,31,(locSumAbs>>shiftVal)-baseLevel*5)(1526X2)

[0206] Given the variable locSumAbs, first The Rice parameter cRiceParam is derived as specified in Table 128, Then more New as follows :

[0207] cRiceParam=cRiceParam+shiftVal (1526X3)

[0208] When baseLevel is equal to 0, the variable ZeroPos[n] is derived as follows:

[0209] ZeroPos[ n ] = ( QState < 2 ? 1 : 2 ) << cRiceParam (1518)

[0210] Table 128 - cRiceParam specification based on locSumAbs

[0211] locSumAbs 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 cRiceParam 0 0 0 0 0 0 0 1 1 1 1 1 1 1 2 2 locSumAbs 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 cRiceParam 2 2 2 2 2 2 2 2 2 2 2 2 3 3 3 3

[0212] It can be seen from formula (1526X3) that compared with VVCvl, cRiceParam used to binarize the remaining part of the absolute level in VVCv2 can be larger.

[0213] gci_no_persistent_rice_adaptation_constraint_flag

[0214] gci_no_persistent_rice_adaptation_constraint_flag conveys a constraint on the derivation of Rice parameters for binarization using the previous TU state. gci_no_persistent_rice_adaptation_constraint_flag equal to 1 specifies that sps_persistent_rice_adaptation_enabled_flag shall be equal to 0 for all pictures in OlsInScope. gci_no_persistent_rice_adaptation_constraint_flag equal to 0 does not impose this constraint. When gci_no_persistent_rice_adaptation_constraint_flag is not present, its value is inferred to be equal to 0.

[0215] sps_persistent_rice_adaptation_enabled_flag equal to 1 specifies that at the beginning of each TU, the Rice parameter derivation for binarizing abs_remainder[] and dec_abs_level[] is initialized using the statistical data accumulated by the previous TU. sps_persistent_rice_adaptation_enabled_flag equal to 0 specifies that the previous TU state is not used in the Rice parameter derivation. When not present, the value of sps_persistent_rice_adaptation_enabled_flag is inferred to be equal to 0. An example of using sps_persistent_rice_adaptation_enabled_flag to determine Rice parameters in VVCv2 is shown below (the underlined part is the content added by VVCv2 relative to VVCvl).

[0216] If the CTU is the first CTU in a slice or tile, the array PredictorPaletteSize[chType] (chType=0,1) is initialized to 0 according to the initialization process of the call content variables specified in subclause 9.3.2.2, and the array StatCoeff[i] (i=0...2) is initialized as follows:

[0217] StatCoeff[i]= sps_persistent_rice_adaptation_enabled_flag? 2*

[0218] Floor(Log2(BitDepth-10) :0(1513X3)

[0219] StatCoeff[i] is used to calculate HisValue, which is used to calculate locSumAbs in equation (1517), and HisValue can be updated once per TU. With the help of HisValue, the derived value of the Rice parameter at the block boundary can be made more accurate.

[0220] gci_no_reverse_last_sig_coeff_constraint_flag

[0221] gci_no_reverse_last_sig_coeff_constraint_flag equal to 1 specifies that the sps_reverse_last_sig_coeff_enabled_flag of all pictures in OlsInScope shall be equal to 0. gci_no_reverse_last_sig_coeff_constraint_flag equal to 0 does not impose this constraint. When gci_no_reverse_last_sig_coeff_constraint_flag is not present, its value is inferred to be equal to 0.

[0222] In conventional residual coding (RRC), the position (x,y) of the last non-zero level in a TU is coded by up to four syntax elements, namely, last_sig_coeffx_x_prefix, last_sig_coeff_y_prefix, last_sig_coeff_x_suffix, and last_sig_coeff_y_suffix. The position is coded using the difference between (x,y) and (0,0) of the current TU in VVCvl. This is reasonable for VVCvl because there are many zero levels within a TU and most of the non-zero levels are located in the upper left corner of the TU. However, this may not be the case for VVCv2 applications, where many non-zero levels are distributed throughout the TU, so it may be beneficial to code the position (x,y) relative to the lower right corner instead of the upper left corner (0,0). sh_reverse_last_sig_coeff_flag provides tools to handle such applications.

[0223] sh_reverse_last_sig_coeff_flag equal to 1 specifies that for each transform block of the current slice, the coordinates of the last significant coefficient are encoded relative to ((Log2ZoTbWidth<<1)-1, (Log2ZoTbHeight<<1)-1). sh_reverse_last_sig_coeff_flag equal to 0 specifies that for each transform block of the current slice, the coordinates of the last significant coefficient are encoded relative to (0,0). When not present, the value of sh_reverse_last_sig_coeff_flag is inferred to be equal to 0.

[0224] In the slice header, sps_reverse_last_sig_coeff_enabled_flag is used to conditionally parse sh_reverse_last_sig_coeff_flag as follows.

[0225] - If last_sig_coeff_x_suffix does not exist, the following formula applies:

[0226] LastSignificantCoeffX = last_sig_coeff_x_prefix (193)

[0227] - Otherwise (last_sig_coeff_x_suffix exists), the following formula applies:

[0228] LastSignificantCoeffX = ( 1 << ( (last_sig_coeff_x_prefix >> 1 ) - 1) ) * (194)

[0229] (2+(last_sig_coeff_x_prefix&1))+last_sig_coeff_x_suffix

[0230] When sh_reverse_last_sig_coeff_flag is equal to 1, the value of LastSignificantCoeffX is modified as follows:

[0231] LastSignificantCoeffX = ( 1 << Log2ZoTbWidth ) - 1 -LastSignificantCoeffX (195)

[0232] - If last_sig_coeff_y_suffix does not exist, the following formula applies:

[0233] LastSignificantCoeffY = last_sig_coeff_y_prefix (196)

[0234] - Otherwise (last_sig_coeff_y_suffix exists), the following formula applies:

[0235] LastSignificantCoeffY = ( 1 << ( ( last_sig_coeff_y_prefix >> 1 ) -1 ) ) * (197)

[0236] (2+(last_sig_coeff_y_prefix&1))+last_sig_coeff_y_suffix

[0237] When sh_reverse_last_sig_coeff_flag is equal to 1, the value of LastSignificantCoeffY is modified as follows:

[0238] LastSignificantCoeffY = ( 1 << Log2ZoTbHeight ) - 1 -LastSignificantCoeffY (198)

[0239] VVCv2 slice header

[0240]

[0241] Figure 5 An example of a process 500 for performing video decoding according to some embodiments of the present disclosure is depicted. One or more computing devices implement the process 500 by executing appropriate program code. Figure 5 For example, a computing device implementing the video decoder 200 may implement the operations described in Figure 5 The computing device includes, for example, an entropy decoding module 216, an inverse quantization module 218, an inverse transform module 219, a loop filter module 220, an inter-frame prediction module 224, and an intra-frame prediction module 226. For illustration purposes, process 500 is described with reference to some examples depicted in the figure. However, other implementations may also be used.

[0242] In step 502, process 500 involves accessing a bitstream of a video signal, such as encoded video 202. In step 504, process 500 involves extracting a general constraint information (GCI) flag from the bitstream of the video. As described above, the binary flag gci_present_flag is used to specify whether a GCI syntax element is present. gci_present_flag equal to 1 specifies that a GCI syntax element is present in the general_constraints_info() syntax structure, and the GCI syntax element is used to indicate constraints imposed on additional coding tools. gci_present_flag equal to 0 specifies that no GCI syntax element is present and no general constraints are imposed on the video. Depending on the encoder, the GCI flag can be extracted from a network data packet of the video, a video parameter set of the video, or a sequence parameter set of the video.

[0243] In step 506, process 500 involves determining whether one or more general constraints are imposed on the video based on the value of the GCI flag. If yes (i.e., the GCI flag is 1), in step 508, process 500 involves extracting from the bitstream of the video a value M indicating the number of additional bits included in the video bitstream. These additional bits include flag bits, respectively indicating that additional coding tools are constrained for the video.

[0244] In step 510, process 500 involves determining whether M is greater than 5. If so, in step 512, process 500 involves extracting six flag bits from the codestream, the six flag bits representing flags indicating respective constraints of six additional coding tools. The six flags include: the gci_all_rap_pictures_constraint_flag flag, indicating that the pictures of the video are restricted to intra random access point IRAP pictures or progressive decoding refresh GDR pictures; the gci_no_extended_precision_processing_constraint_flag flag, indicating whether to constrain the extended transform precision; the gci_no_ts_residual_coding_rice_constraint_flag flag, indicating whether to constrain explicit Rice parameter transmission; the gci_no_rrc_rice_extension_constraint_flag flag, indicating an alternative Rice parameter derivation for binarization of the quantized residual of the video; the gci_no_persistent_rice_adaptation_constraint_flag flag, indicating whether to initialize the Rice parameter derivation for binarization based on the previous transform unit; and the gci_no_reverse_last_sig_coeff_constraint_flag flag, indicating whether to impose constraints on the pictures in OlsInScope when decoding the position of the final non-zero level in the TU.

[0245] If M is greater than 6, process 500 involves extracting the remaining M-6 bits from the bitstream and discarding them in step 513. In other words, the decoding of the video will be performed independently of these M-6 bits.

[0246] In step 514, process 500 involves decoding the remaining portion of the codestream of the video into pictures according to the constraints indicated by the six flags for the six additional coding tools. For example, if the flag gci_all_rap_pictures_constraint_flag is 1, the decoder can determine that all pictures in one or more output layer sets are GDR pictures with ph_recovery_poc_cnt equal to 0, or IRAP pictures, and decode the GDR pictures or IRAP pictures in the one or more output layer sets. If the flag gci_no_extended_precision_processing_constraint_flag is 1, the decoder can determine that the extended transform precision is constrained and decode the video by setting the sps_extended_precision_flag of the pictures in OlsInScope to 0 to not use the extended dynamic range. If the flag gci_no_ts_residual_coding_rice_constraint_flag is 1, the decoder can determine that explicit Rice parameter transmission is constrained and decode the remaining portion of the codestream of the video by disabling alternative Rice parameter transmission for the pictures in OlsInScope. If the flag gci_no_rrc_rice_extension_constraint_flag is 1, the decoder can determine that the derivation of alternative Rice parameters for binarization of the quantized residual of the video is constrained, and decode the rest of the bitstream of the video by disabling the transmission of alternative Rice parameters for the pictures in OlsInScope. If the flag gci_no_persistent_rice_adaptation_constraint_flag is 1, the decoder can determine that the initialization of the derivation of Rice parameters for binarization based on the previous transform unit state is constrained, and decode the rest of the bitstream of the video without initializing the Rice parameters based on the previous transform unit state for the pictures in OlsInScope. If the flag gci_no_reverse_last_sig_coeff_constraint_flag is 1, the decoder can determine that the sps_reverse_last_sig_coeff_enabled_flag of all pictures in OlsInScope is equal to 0, and for each transform block of the current slice, the coordinates of the final significant coefficient are encoded relative to the upper left corner (0,0); and decode the remaining part of the video bitstream by interpreting the decoded coordinates of the final significant coefficient as relative to the upper left corner (0,0) of each transform block of the current slice.

[0247] If it is determined in step 510 that M is not greater than 5, then in step 518, process 500 involves extracting M bits from the bitstream and discarding them. In other words, decoding of the video will be performed independently of the M bits. In step 520, the decoder decodes the video without applying constraints to the six additional coding tools. If it is determined in step 506 that the GCI flag indicates that no general constraints are applied to the video (i.e., the GCI flag is 0), process 500 involves decoding the video into pictures without general constraints. In some examples, according to the relative Figure 2 The above process performs decoding. The decoded video can be output for display.

[0248] Figure 6 Another example of a process 600 for performing video decoding according to some embodiments of the present disclosure is depicted. One or more computing devices implement the process 600 by executing appropriate program code. Figure 6 For example, a computing device implementing the video decoder 200 may implement the operations described in Figure 6 The computing device includes, for example, an entropy decoding module 216, an inverse quantization module 218, an inverse transform module 219, a loop filter module 220, an inter-frame prediction module 224, and an intra-frame prediction module 226. For illustration purposes, process 600 is described with reference to some examples depicted in the figure. However, other implementations may also be used.

[0249] In step 602, process 600 involves accessing a bitstream of a video signal, such as encoded video 202. In step 604, process 600 involves extracting a general constraint information (GCI) flag from the bitstream of the video. As described above, the binary flag gci_present_flag is used to specify whether a GCI syntax element is present. gci_present_flag equal to 1 specifies that a GCI syntax element is present in the general_constraints_info() syntax structure, and the GCI syntax element is used to indicate constraints imposed on additional coding tools. gci_present_flag equal to 0 specifies that no GCI syntax element is present and no general constraints are imposed on the video. Depending on the encoder, the GCI flag can be extracted from a network data packet of the video, a video parameter set of the video, or a sequence parameter set of the video.

[0250] In step 606, process 600 involves determining whether one or more general constraints are imposed on the video based on the value of the GCI flag. If yes (i.e., the GCI flag is 1), in step 608, process 600 involves extracting a value M representing the number of additional bits included in the video bitstream from the video bitstream. These additional bits include flag bits that respectively indicate that additional coding tools are constrained for the video.

[0251] In step 610, process 600 involves determining whether M is greater than 6. If so, in step 612, process 600 involves extracting six flag bits from the codestream, the six flag bits representing flags indicating respective constraints of six additional coding tools. The six flags include: the gci_all_rap_pictures_constraint_flag flag, indicating that the pictures of the video are restricted to intra random access point IRAP pictures or progressive decoding refresh GDR pictures; the gci_no_extended_precision_processing_constraint_flag flag, indicating whether to constrain the extended transform precision; the gci_no_ts_residual_coding_rice_constraint_flag flag, indicating whether to constrain explicit Rice parameter transmission; the gci_no_rrc_rice_extension_constraint_flag flag, indicating an alternative Rice parameter derivation for binarization of the quantized residual of the video; the gci_no_persistent_rice_adaptation_constraint_flag flag, indicating whether to initialize the Rice parameter derivation for binarization based on the previous transform unit; and the gci_no_reverse_last_sig_coeff_constraint_flag flag, indicating whether to impose constraints on the pictures in OlsInScope when decoding the position of the final non-zero level in the TU.

[0252] In step 614, process 600 involves extracting M-6 bits after the six flag bits from the bitstream and discarding the extracted M-6 bits. In other words, decoding of the video will be independent of these M-6 bits. In step 616, process 600 involves decoding the remaining portion of the bitstream of the video into pictures according to the constraints indicated by the six flags for the six additional coding tools. For example, if the flag gci_all_rap_pictures_constraint_flag is 1, the decoder can determine that all pictures in one or more output layer sets are GDR pictures with ph_recovery_poc_cnt equal to 0, or IRAP pictures, and decode the GDR pictures or IRAP pictures in the one or more output layer sets. If the flag gci_no_extended_precision_processing_constraint_flag is 1, the decoder can determine that the extended transform precision is constrained and decode the video by setting the sps_extended_precision_flag of the picture in OlsInScope to 0 to not use the extended dynamic range. If the flag gci_no_ts_residual_coding_rice_constraint_flag is 1, the decoder can determine that explicit Rice parameter transmission is constrained and decode the remaining part of the video bitstream by disabling alternative Rice parameter transmission for pictures in OlsInScope. If the flag gci_no_rrc_rice_extension_constraint_flag is 1, the decoder can determine that alternative Rice parameter derivation for binarization of quantized residual of the video is constrained and decode the remaining part of the video bitstream by disabling alternative Rice parameter transmission for pictures in OlsInScope. If the flag gci_no_persistent_rice_adaptation_constraint_flag is 1, the decoder can determine that initialization of Rice parameter derivation for binarization based on previous transform unit state is constrained and decode the remaining part of the video bitstream without initializing Rice parameters based on previous transform unit state for pictures in OlsInScope.If the flag gci_no_reverse_last_sig_coeff_constraint_flag is 1, the decoder can determine that the sps_reverse_last_sig_coeff_enabled_flag of all pictures in OlsInScope is equal to 0, and for each transform block of the current slice, the coordinates of the final significant coefficient are encoded relative to the upper left corner (0,0); and decode the remaining part of the video bitstream by interpreting the decoded coordinates of the final significant coefficient as relative to the upper left corner (0,0) of each transform block of the current slice.

[0253] If it is determined in step 610 that M is not greater than 6, then M is 0 or 6. If M is 6, then in step 620, process 600 involves extracting the six flag bits described above. In step 622, the decoder decodes the video based on the extracted flag bits by imposing constraints on the six additional coding tools. If M is 0, the flag bits are not extracted. In step 624, the decoder decodes the video by not imposing constraints on the six additional coding tools because the flag bits are not extracted. If it is determined in step 606 that the GCI flag indicates that no general constraints are imposed on the video (i.e., the GCI flag is 0), then in step 618, process 600 involves decoding the video into an image without general constraints. In some examples, based on the information relative to the GCI flag, the video is decoded into an image. Figure 2 The above process performs decoding. The decoded video can be output for display.

[0254] Figure 7 Another example of a process 700 for performing video decoding according to some embodiments of the present disclosure is depicted. One or more computing devices implement the process 700 by executing appropriate program code. Figure 7 For example, a computing device implementing the video decoder 200 may implement the operations described in Figure 7 The computing device includes, for example, an entropy decoding module 216, an inverse quantization module 218, an inverse transform module 219, a loop filter module 220, an inter-frame prediction module 224, and an intra-frame prediction module 226. For illustration purposes, process 700 is described with reference to some examples depicted in the figure. However, other implementations may also be used.

[0255] In step 702, process 700 involves accessing a bitstream of a video signal, such as encoded video 202. In step 704, process 700 involves extracting a general constraint information (GCI) flag from the bitstream of the video. As described above, the binary flag gci_present_flag is used to specify whether a GCI syntax element is present. gci_present_flag equal to 1 specifies that a GCI syntax element is present in the general_constraints_info() syntax structure, and the GCI syntax element is used to indicate constraints imposed on additional coding tools. gci_present_flag equal to 0 specifies that no GCI syntax element is present and no general constraints are imposed on the video. Depending on the encoder, the GCI flag can be extracted from a network data packet of the video, a video parameter set of the video, or a sequence parameter set of the video.

[0256] In step 706, process 700 involves determining whether one or more general constraints are imposed on the video based on the value of the GCI flag. If yes (i.e., the GCI flag is 1), in step 708, process 700 involves extracting a value M representing the number of additional bits included in the video bitstream from the bitstream of the video. These additional bits include flag bits, respectively indicating that additional coding tools are constrained for the video.

[0257] In step 710, process 700 involves determining whether M is greater than 5. If not, in step 712, process 700 involves extracting M bits from the bitstream and discarding the M bits. In step 714, process 700 involves decoding the remainder of the bitstream of the video into an image independently of the M bits. If it is determined in step 710 that M is not greater than 5, in step 718, process 700 involves extracting the six flag bits described above. If M is greater than 6, in step 719, process 700 involves extracting the remaining M-6 bits from the bitstream and discarding them. In other words, the decoding of the video will be performed independently of the M-6 bits. In step 720, the decoder decodes the video based on the extracted six flag bits by imposing constraints on the six additional coding tools, as described above.

[0258] If it is determined in step 706 that the GCI flag indicates that no general constraints are imposed on the video (i.e., the GCI flag is 0), process 700 involves decoding the video into pictures without the general constraints. Figure 2 The above process performs decoding. The decoded video can be output for display.

[0259] Example of a computing system implementing transmission of general constraint information

[0260] Any suitable computing system may be used to perform the operations described herein. For example, Figure 8Describes what can be achieved Figure 1 The video encoder 100 or Figure 2 800. In some embodiments, the computing device 800 may include a processor 812 that is communicatively coupled to a memory 814 and executes computer executable program code and / or accesses information stored in the memory 814. The processor 812 may include a microprocessor, an application specific integrated circuit ("ASIC"), a state machine, or other processing device. The processor 812 may include any one or more of a variety of processing devices. Such a processor may include a computer readable medium storing instructions, or may communicate with a computer readable medium storing instructions that, when executed by the processor 812, cause the processor to perform the steps described herein.

[0261] The memory 814 may include any suitable non-transitory computer-readable medium. Computer-readable media may include any electronic, optical, magnetic, or other storage device capable of providing computer-readable instructions or other program code to the processor. Non-limiting examples of computer-readable media include disks, memory chips, ROM, RAM, ASICs, configured processors, optical storage, tapes or other magnetic storage, or any other medium from which a computer processor can read instructions. These instructions may include processor-specific instructions generated by a compiler and / or interpreter from code written in any suitable computer programming language (e.g., including C, C++, C#, Visual Basic, Java, Python, Perl, JavaScript, and ActionScript).

[0262] The computing device 800 may also include a bus 816. The bus 816 may be communicatively coupled to one or more components of the computing device 800. The computing device 800 may also include multiple external or internal devices, such as input or output devices. For example, the computing device 800 shown has an input / output ("I / O") interface 818 that can receive input from one or more input devices 820 or provide output to one or more output devices 822. One or more input devices 820 and one or more output devices 822 may be communicatively coupled to the I / O interface 818. The communicatively coupled may be implemented in any suitable manner (e.g., connected by a printed circuit board, connected by a cable, communicated by wireless transmission, etc.). Non-limiting examples of input devices 820 include a touch screen (e.g., one or more cameras for imaging a touch area, or a pressure sensor for detecting pressure changes caused by a touch), a mouse, a keyboard, or any other device that can be used to generate input events in response to physical manipulations by a computing device user. Non-limiting examples of output devices 822 include an LCD screen, an external display, a speaker, or any other device that can be used to display or otherwise present output generated by a computing device.

[0263] The computing device 800 may execute program code that configures the processor 812 to perform the above-mentioned Figure 1-7 The program code may include one or more steps of the video encoder 100 or the video decoder 200. The program code may reside in the memory 814 or any suitable computer-readable medium and may be executed by the processor 812 or any other suitable processor.

[0264] The computing device 800 may also include at least one network interface device 824. The network interface device 824 may include any device or group of devices suitable for establishing a wired or wireless data connection with one or more data networks 828. Non-limiting examples of the network interface device 824 include an Ethernet network adapter, a modem, and / or similar devices. The computing device 800 may transmit messages in the form of electronic or optical signals through the network interface device 824.

[0265] General considerations

[0266] Many details are set forth herein to provide a thorough understanding of the claimed subject matter. However, those skilled in the art will appreciate that the claimed subject matter may be practiced without these details. In other instances, methods, devices, or systems known to those of ordinary skill in the art are not described in detail in order to avoid obscuring the claimed subject matter.

[0267] Unless otherwise specifically noted, it is understood that in this specification, discussions using terms such as "processing," "computing," "determining," "identifying," or similar terms refer to the operations or processes of a computing device (e.g., one or more computers, or similar electronic computing devices) that operate on or transform data represented as physical electronic or magnetic quantities in the memory, registers, or other information storage devices, transmission devices, or display devices of a computing platform.

[0268] The systems discussed herein are not limited to any particular hardware architecture or configuration. A computing device may include any suitable arrangement of components that provide a result conditional on one or more inputs. Suitable computing devices include multi-purpose computer systems based on microprocessors that access stored software that programs or configures the computing system from a general-purpose computing device to a dedicated computing device that implements one or more embodiments of the present subject matter. In the software used to program or configure a computing device, any suitable programming language, scripting language, or other type of language or language combination may be used to implement the teachings contained herein.

[0269] The method embodiments disclosed herein may be performed in the operation of such a computing device. The order of the steps presented in the above examples may be changed—for example, the steps may be reordered, combined, and / or decomposed into sub-steps. Certain steps or processes may be performed in parallel.

[0270] As used herein, "suitable for" or "configured to" is open and inclusive language and does not exclude devices adapted or configured to perform additional tasks or steps. In addition, the use of the term "based on" is also open and inclusive, because a process, step, calculation or other operation "based on" one or more stated conditions or values ​​may actually be based on other conditions or values ​​other than those stated. The headings, lists and numbers contained herein are for convenience of explanation only and are not meant to be limiting.

[0271] Although the subject matter has been described in detail with respect to its specific embodiments, it is understood that those skilled in the art can easily make changes, modifications and equivalents to these embodiments after understanding the foregoing. Therefore, it should be understood that the present disclosure is provided for the purpose of illustration rather than limitation, and does not exclude such changes, modifications and / or additions to the subject matter that are obvious to those of ordinary skill in the art.

Claims

1. A video decoding method, comprising: Decoding an additional bit count M from a bitstream of a video, wherein the additional bit count M indicates the number of additional general constraint information GCI bits included in the bitstream of the video, the additional bits include flag bits, the flag bits indicate respective additional coding tools to be constrained for the video, and wherein an expected value of the additional bit count is 0, 6, or greater than 6; In response to determining that the decoded additional bit count M is greater than 6, decoding M-6 bits after the six flag bits in the code stream; and Independently of the decoded M-6 bits, and based at least in part on the constraints respectively specified by the six flag bits for the respective additional coding tools, the remaining portion of the code stream of the video is decoded into images.

2. The method according to claim 1, further comprising: Before decoding the M-6 bits, decoding the six flag bits representing six flags respectively from the bitstream of the video, the six flags respectively indicating six additional coding tools to be constrained for the video; as well as Based at least in part on the constraints indicated by the six flags for the six additional encoding tools, a remaining portion of the codestream of the video is decoded into pictures.

3. The method according to claim 2, wherein: The six signs include: A first flag indicating that the picture of the video is limited to an intra random access point IRAP picture or a gradual decoding refresh GDR picture; The second flag indicates whether to constrain the extended transform precision; The third flag indicates whether to constrain explicit Rice parameter transmission; A fourth flag indicating an alternative Rice parameter derivation for binarization of a quantized residual of the video; A fifth flag indicating whether to initialize Rice parameter derivation for binarization based on a previous transform unit; and The sixth flag indicates whether to impose constraints on pictures in the in-scope output layer set OlsInScope when decoding the position of the final non-zero level in the transform unit.

4. The method according to claim 3, wherein: The decoding of the remaining portion of the bitstream of the video into images based at least in part on the constraints indicated by the six flags for the six additional encoding tools comprises one or more of the following steps: Based on the first flag being 1, determining that all pictures in one or more output layer sets are GDR pictures or IRAP pictures with ph_recovery_poc_cnt equal to 0, and decoding the GDR pictures or the IRAP pictures in the one or more output layer sets; Based on the second flag being 1, determining that the extended transform precision is constrained, and decoding the remaining part of the bitstream of the video by setting the sps_extended_precision_flag of the pictures in the output layer set OlsInScope within the scope to be equal to 0 so as not to use the extended dynamic range; Based on the third flag being 1, determining that explicit Rice parameter transmission is constrained, and decoding the remaining portion of the bitstream of the video by disabling alternative Rice parameter transmission of pictures in the output layer set OlsInScope within the scope; Based on the fourth flag being 1, determining that the derivation of alternative Rice parameters for binarizing the quantized residual of the video is constrained, and decoding the remaining part of the bitstream of the video by disabling the transmission of alternative Rice parameters for pictures in the output layer set OlsInScope within the scope; Based on determining that the fifth flag is 1, it is determined that the initialization of the Rice parameter derivation for binarization based on the previous transform unit state is constrained, and the remaining part of the bitstream of the video is decoded without initializing the Rice parameters based on the previous transform unit state for the pictures in the output layer set OlsInScope within the range; or Based on the sixth flag being 1, it is determined that the coordinates of the final significant coefficient are encoded relative to the upper left corner of each transform block of the slice, and the remaining part of the video code stream is decoded by interpreting the decoded coordinates of the final significant coefficient as relative to the upper left corner of each transform block of the slice.

5. The method according to claim 3, further comprising one or more of the following steps: Determining that the first flag does not exist in the codestream, and inferring a value of the first flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the second flag does not exist in the codestream, and inferring a value of the second flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the third flag does not exist in the codestream, and inferring a value of the third flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the fourth flag does not exist in the codestream, and inferring the value of the fourth flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determine that the fifth flag does not exist in the codestream, and infer the value of the fifth flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; or It is determined that the sixth flag does not exist in the code stream, and the value of the sixth flag is inferred to be 0, indicating that no constraint is imposed on the corresponding coding tool.

6. The method according to claim 1, wherein: Before decoding the additional bit count M, the method further comprises: Decoding a general constraint information (GCI) flag from a bitstream of the video; and Based on the value of the GCI flag, it is determined that one or more general constraints are imposed on the video.

7. The method according to claim 6, wherein: The GCI flag is decoded from a network data packet of the video, a video parameter set of the video, or a sequence parameter set of the video.

8. A non-transitory computer readable medium having program code stored thereon, the program code being executable by one or more processing devices to perform operations comprising: Decoding an additional bit count M from a bitstream of a video, wherein the additional bit count M indicates the number of additional general constraint information GCI bits included in the bitstream of the video, the additional bits include flag bits, the flag bits indicate respective additional coding tools to be constrained for the video, and wherein an expected value of the additional bit count is 0, 6, or greater than 6; In response to determining that the decoded additional bit count M is greater than 6, decoding M-6 bits after the six flag bits in the code stream; and Independently of the decoded M-6 bits, and based at least in part on the constraints respectively specified by the six flag bits for the respective additional coding tools, the remaining portion of the code stream of the video is decoded into images.

9. The non-transitory computer readable medium of claim 8, wherein: The operations also include: Before decoding the M-6 bits, decoding the six flag bits representing six flags respectively from the bitstream of the video, the six flags respectively indicating six additional coding tools to be constrained for the video; and Based at least in part on the constraints indicated by the six flags for the six additional encoding tools, a remaining portion of the codestream of the video is decoded into pictures.

10. The non-transitory computer readable medium of claim 9, wherein: The six signs include: A first flag indicating that the picture of the video is limited to an intra random access point IRAP picture or a gradual decoding refresh GDR picture; The second flag indicates whether to constrain the extended transform precision; The third flag indicates whether to constrain explicit Rice parameter transmission; A fourth flag indicating an alternative Rice parameter derivation for binarization of a quantized residual of the video; A fifth flag indicating whether to initialize Rice parameter derivation for binarization based on a previous transform unit; and The sixth flag indicates whether to impose constraints on pictures in the in-scope output layer set OlsInScope when decoding the position of the final non-zero level in the transform unit.

11. The non-transitory computer readable medium of claim 10, wherein: The decoding of the remaining portion of the bitstream of the video into images based at least in part on the constraints indicated by the six flags for the six additional encoding tools comprises one or more of the following steps: Based on the first flag being 1, determining that all pictures in one or more output layer sets are GDR pictures or IRAP pictures with ph_recovery_poc_cnt equal to 0, and decoding the GDR pictures or the IRAP pictures in the one or more output layer sets; Based on the second flag being 1, determining that the extended transform precision is constrained, and decoding the remaining part of the bitstream of the video by setting the sps_extended_precision_flag of the pictures in the output layer set OlsInScope within the scope to be equal to 0 so as not to use the extended dynamic range; Based on the third flag being 1, determining that explicit Rice parameter transmission is constrained, and decoding the remaining portion of the bitstream of the video by disabling alternative Rice parameter transmission of pictures in the output layer set OlsInScope within the scope; Based on the fourth flag being 1, determining that the derivation of alternative Rice parameters for binarizing the quantized residual of the video is constrained, and decoding the remaining part of the bitstream of the video by disabling the transmission of alternative Rice parameters for pictures in the output layer set OlsInScope within the scope; Based on determining that the fifth flag is 1, it is determined that the initialization of the Rice parameter derivation for binarization based on the previous transform unit state is constrained, and the remaining part of the bitstream of the video is decoded without initializing the Rice parameters based on the previous transform unit state for the pictures in the output layer set OlsInScope within the range; or Based on the sixth flag being 1, it is determined that the coordinates of the final significant coefficient are encoded relative to the upper left corner of each transform block of the slice, and the remaining part of the video code stream is decoded by interpreting the decoded coordinates of the final significant coefficient as relative to the upper left corner of each transform block of the slice.

12. The non-transitory computer readable medium of claim 10, wherein: The operations may also include one or more of the following: Determining that the first flag does not exist in the codestream, and inferring a value of the first flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the second flag does not exist in the codestream, and inferring a value of the second flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the third flag does not exist in the codestream, and inferring a value of the third flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the fourth flag does not exist in the codestream, and inferring the value of the fourth flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determine that the fifth flag does not exist in the codestream, and infer the value of the fifth flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; or It is determined that the sixth flag does not exist in the code stream, and the value of the sixth flag is inferred to be 0, indicating that no constraint is imposed on the corresponding coding tool.

13. The non-transitory computer readable medium of claim 8, wherein: Before decoding the additional bit count M, the operation further comprises: Decoding a general constraint information (GCI) flag from a bitstream of the video; and Based on the value of the GCI flag, it is determined that one or more general constraints are imposed on the video.

14. The non-transitory computer readable medium of claim 13, wherein: The GCI flag is decoded from a network data packet of the video, a video parameter set of the video, or a sequence parameter set of the video.

15. A system comprising: Processing equipment; A non-transitory computer-readable medium communicatively coupled to the processing device; wherein the processing device is configured to execute program code stored in the non-transitory computer-readable medium to perform operations, the operations comprising: Decoding an additional bit count M from a bitstream of a video, wherein the additional bit count M indicates the number of additional general constraint information GCI bits included in the bitstream of the video, the additional bits include flag bits, the flag bits indicate respective additional coding tools to be constrained for the video, and wherein an expected value of the additional bit count is 0, 6, or greater than 6; In response to determining that the decoded additional bit count M is greater than 6, decoding M-6 bits after the six flag bits in the code stream; and Independently of the decoded M-6 bits, and based at least in part on the constraints respectively specified by the six flag bits for the respective additional coding tools, the remaining portion of the code stream of the video is decoded into images.

16. The system of claim 15, wherein: The operations also include: Before decoding the M-6 bits, decoding the six flag bits representing six flags respectively from the bitstream of the video, the six flags respectively indicating six additional coding tools to be constrained for the video; and Based at least in part on the constraints indicated by the six flags for the six additional encoding tools, a remaining portion of the codestream of the video is decoded into pictures.

17. The system of claim 16, wherein: The six signs include: A first flag indicating that the picture of the video is limited to an intra random access point IRAP picture or a gradual decoding refresh GDR picture; The second flag indicates whether to constrain the extended transform precision; The third flag indicates whether to constrain explicit Rice parameter transmission; A fourth flag indicating an alternative Rice parameter derivation for binarization of a quantized residual of the video; A fifth flag indicating whether to initialize Rice parameter derivation for binarization based on a previous transform unit; and The sixth flag indicates whether to impose constraints on pictures in the in-scope output layer set OlsInScope when decoding the position of the final non-zero level in the transform unit.

18. The system of claim 17, wherein: The decoding of the remaining portion of the bitstream of the video into images based at least in part on the constraints indicated by the six flags for the six additional encoding tools comprises one or more of the following steps: Based on the first flag being 1, determining that all pictures in one or more output layer sets are GDR pictures or IRAP pictures with ph_recovery_poc_cnt equal to 0, and decoding the GDR pictures or the IRAP pictures in the one or more output layer sets; Based on the second flag being 1, determining that the extended transform precision is constrained, and decoding the remaining part of the bitstream of the video by setting the sps_extended_precision_flag of the pictures in the output layer set OlsInScope within the scope to be equal to 0 so as not to use the extended dynamic range; Based on the third flag being 1, determining that explicit Rice parameter transmission is constrained, and decoding the remaining portion of the bitstream of the video by disabling alternative Rice parameter transmission of pictures in the output layer set OlsInScope within the scope; Based on the fourth flag being 1, determining that the derivation of alternative Rice parameters for binarizing the quantized residual of the video is constrained, and decoding the remaining part of the bitstream of the video by disabling the transmission of alternative Rice parameters for pictures in the output layer set OlsInScope within the scope; Based on determining that the fifth flag is 1, it is determined that the initialization of the Rice parameter derivation for binarization based on the previous transform unit state is constrained, and the remaining part of the bitstream of the video is decoded without initializing the Rice parameters based on the previous transform unit state for the pictures in the output layer set OlsInScope within the range; or Based on the sixth flag being 1, it is determined that the coordinates of the final significant coefficient are encoded relative to the upper left corner of each transform block of the slice, and the remaining part of the video code stream is decoded by interpreting the decoded coordinates of the final significant coefficient as relative to the upper left corner of each transform block of the slice.

19. The system of claim 17, wherein: The operations may also include one or more of the following: Determining that the first flag does not exist in the codestream, and inferring a value of the first flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the second flag does not exist in the codestream, and inferring a value of the second flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the third flag does not exist in the codestream, and inferring a value of the third flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determining that the fourth flag does not exist in the codestream, and inferring the value of the fourth flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; Determine that the fifth flag does not exist in the codestream, and infer the value of the fifth flag to be 0, indicating that no constraint is imposed on the corresponding coding tool; or It is determined that the sixth flag does not exist in the code stream, and the value of the sixth flag is inferred to be 0, indicating that no constraint is imposed on the corresponding coding tool.

20. The system of claim 15, wherein: Before decoding the additional bit count M, the operation further comprises: Decoding the GCI flag from the bitstream of the video by decoding the GCI flag from the network data packet of the video, the video parameter set of the video, or the sequence parameter set of the video; and Based on the value of the GCI flag, it is determined that one or more general constraints are imposed on the video.

Citation Information

Patent Citations

  • A video encoder, a video decoder and corresponding methods

    CN112740689A

  • High level syntax for video coding and decoding

    GB202007554D0

  • Method and appartus for video coding

    US20210314587A1

  • Systems and methods for signaling general constraint information in video coding

    US20210368208A1

  • Level information in video coding

    WO2021195026A1

Cited By

  • Transferring generic constraint information for video coding

    CN118511532A

  • General constraint information for transport video coding

    CN118511532B