Signaling of non-picture-level syntax elements at the picture level
Patent Information
- Application Number
- IN202438015328
- Authority / Receiving Office
- IN · IN
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-09-24
- Filing Date
- 2024-03-01
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2040-09-23
AI Technical Summary
Current video coding techniques face challenges in efficiently compressing video data for transmission over limited bandwidth networks and storage, as they often result in redundant bitstream redundancy due to repetitive signaling of non-picture-level syntax elements across multiple slices within a picture.
The method involves signaling non-picture-level syntax elements at the picture level, where these elements are included in the picture header if they are the same for all slices, and in slice headers if they vary, thereby reducing redundancy and bitstream waste by ensuring they are only encoded once per picture.
This approach enhances compression efficiency by minimizing redundant data transmission and storage, improving the compression ratio without compromising image quality by ensuring non-picture-level syntax elements are only signaled once per picture, thus optimizing bandwidth usage and storage efficiency.
Abstract
Description
TECHNICAL FIELD[2] The disclosed embodiments relate to video coding in general andsignaling of non-picture-level syntax elements at the picture level in particular.BACKGROUND[3] The amount of video data needed to depict even a relatively shortvideo can be substantial, which may result in difficulties when the data is to bestreamed or otherwise communicated across a communications network withlimited bandwidth capacity. Thus, video data is generally compressed beforebeing communicated across modern day telecommunications networks. The sizeof a video could also be an issue when the video is stored on a storage devicebecause memory resources may be limited. Video compression devices often usesoftware and / or hardware at the source to code the video data prior totransmission or storage, thereby decreasing the quantity of data needed torepresent digital video images. The compressed data is then received at thedestination by a video decompression device that decodes the video data. Withlimited network resources and ever increasing demands of higher video quality,improved compression and decompression techniques that improve compressionratio with little to no sacrifice in image quality are desirable.SUMMARY[4] A first aspect relates to a method implemented by a video decoder andcomprising: receiving, by the video decoder, a video bitstream comprising an RPLflag, wherein the RPL flag equal to a first value specifies that RPL signaling ispresent in a PH, and wherein the RPL flag equal to a second value specifies thatRPL signaling is not present in the PH and may be present in slice headers.[5] In the embodiments, syntax elements are included in a picture headerwhen the syntax elements are the same or included in a slice header when thesyntax elements vary. However, in some embodiments, the syntax elements maynot be included in both. First, non-picture-level syntax elements may be presentin the PH. Non-picture-level syntax elements are syntax elements that are at alevel of a video bitstream other than the picture level. Second, for each categoryof non-picture-level syntax elements, a flag specifies when syntax elements of thecategory are present in the PH or slice headers. The flag may be in the PH. Thenon-picture-level syntax elements include those related to signaling of RPLs, jointCb Cr sign flags, SAO tool enabling and parameters, ALF tool enabling andparameters, LMCS tool enabling and parameters, and scaling list tool enablingand parameters. Third, when non-picture-level syntax elements are present in thePH, the corresponding syntax elements shall not be present in any slice of thepicture associated with the picture header containing the syntax elements. Thevalues of non-picture-level syntax elements that are present in the PH are appliedto all slices of the picture associated with the picture header containing the syntaxelements. Fourth, when non-picture-level syntax elements are not present in thePH, the corresponding syntax elements may be present in slice headers of slices ofthe picture associated with the picture header. By moving signaling of nonpicture-level syntax elements to the picture level, redundancy is reduced and thereare fewer wasted bits in the encoded bitstream.[6] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the RPL flag equal to 1 specifies that the RPL signaling ispresent in the PH.[7] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the RPL flag equal to 1 specifies that the RPL signaling isnot in a slice.[8] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the RPL flag equal to 0 specifies that the RPL signaling isnot present in the PH.[9] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the RPL flag equal to 0 specifies that the RPL signalingmay be present in the slice headers.
[10] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the bitstream further comprises an RPL SPS flag, whereinthe RPL SPS flag specifies that RPL i is derived based on one ofref_pic_list_struct( listIdx, rplsIdx ) syntax structures with listIdx equal to i in anSPS or specifies that RPL i is derived based on one of ref_pic_list_struct( listIdx,rplsIdx ) syntax structures with listIdx equal to i that is directly included.
[11] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the bitstream further comprises an RPL index, whereinthe RPL index specifies an index, into a list of ref_pic_list_struct( listIdx, rplsIdx) syntax structures with listIdx equal to i included in a sequence parameter set(SPS), of a ref_pic_list_struct( listIdx, rplsIdx ) syntax structure with listIdx equalto i that is used for derivation of RPL i of a current picture.
[12] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the method further comprises displaying the decodedpicture on a display of an electronic device.
[13] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that when non-picture level syntax elements are present in thePH, corresponding syntax elements shall not be present in any slice of the pictureassociated with the PH containing the syntax elements.
[14] A second aspect relates to a method implemented by a video encoderand comprising: generating an RPL flag, wherein the RPL flag equal to a firstvalue specifies that RPL signaling is present in a PH, and wherein the RPL flagequal to a second value specifies that RPL signaling is not present in the PH andmay be present in slice headers.
[15] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the RPL flag equal to 1 specifies that the RPL signaling ispresent in the PH.
[16] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the RPL flag equal to 1 specifies that the RPL signaling isnot in a slice.
[17] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the RPL flag equal to 0 specifies that the RPL signaling isnot present in the PH.
[18] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the RPL flag equal to 0 specifies that the RPL signalingmay be present in the slice headers.
[19] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the method further comprises generating an RPL SPSflag, wherein the RPL SPS flag specifies that RPL i is derived based on one ofref_pic_list_struct( listIdx, rplsIdx ) syntax structures with listIdx equal to i in anSPS or specifies that RPL i is derived based on one of ref_pic_list_struct( listIdx,rplsIdx ) syntax structures with listIdx equal to i that is directly included.
[20] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the method further comprises generating an RPL index,wherein the RPL index specifies an index, into a list of ref_pic_list_struct( listIdx,rplsIdx ) syntax structures with listIdx equal to i included in an SPS, of aref_pic_list_struct( listIdx, rplsIdx ) syntax structure with listIdx equal to i that isused for derivation of RPL i of a current picture.
[21] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that when non-picture level syntax elements are present in thePH, corresponding syntax elements shall not be present in any slice of the pictureassociated with the PH containing the syntax elements.
[22] A third aspect relates to a method implemented by a video decoder andcomprising: receiving, by the video decoder, a video bitstream comprising anSAO flag, wherein the SAO flag equal to a first value specifies that SAOsignaling is present in a PH, and wherein the SAO flag equal to a second valuespecifies that SAO signaling is not present in the PH and may be present in sliceheaders; and decoding, by the video decoder using the SAO flag, a coded pictureto obtain a decoded picture.
[23] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the method further comprises displaying the decodedpicture on a display of an electronic device.
[24] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that when non-picture level syntax elements are present in thePH, corresponding syntax elements shall not be present in any slice of the pictureassociated with the PH containing the syntax elements.
[25] A fourth aspect relates to a method implemented by a video encoderand comprising: generating an SAO flag, wherein the SAO flag equal to a firstvalue specifies that SAO signaling is present in a PH, and wherein the SAO flagequal to a second value specifies that SAO signaling is not present in the PH andmay be present in slice headers; encoding, by the video encoder, the SAO flaginto a video bitstream; and storing, by the video encoder, the video bitstream forcommunication toward a video decoder.
[26] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that when non-picture level syntax elements are present in thePH, corresponding syntax elements shall not be present in any slice of the pictureassociated with the PH containing the syntax elements.
[27] A fifth aspect relates to a method implemented by a video decoder andcomprising: receiving, by the video decoder, a video bitstream comprising anALF flag, wherein the ALF flag equal to a first value specifies that ALF signalingis present in a PH, and wherein the ALF flag equal to a second value specifies thatALF signaling is not present in the PH and may be present in slice headers; anddecoding, by the video decoder using the ALF flag, a coded picture to obtain adecoded picture.
[28] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that the method further comprises displaying the decodedpicture on a display of an electronic device.
[29] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that when non-picture level syntax elements are present in thePH, corresponding syntax elements shall not be present in any slice of the pictureassociated with the PH containing the syntax elements.
[30] A sixth aspect relates to a method implemented by a video encoder andcomprising: generating an ALF flag, wherein the ALF flag equal to a first valuespecifies that ALF signaling is present in a PH, and wherein the ALF flag equal toa second value specifies that ALF signaling is not present in the PH and may bepresent in slice headers; encoding, by the video encoder, the ALF flag into a videobitstream; and storing, by the video encoder, the video bitstream forcommunication toward a video decoder.
[31] Optionally, in any of the preceding aspects, another implementation ofthe aspect provides that when non-picture level syntax elements are present in thePH, corresponding syntax elements shall not be present in any slice of the pictureassociated with the PH containing the syntax elements.
[32] A seventh aspect relates to a method implemented by a video decoderand comprising: receiving, by the video decoder, a video bitstream comprising asyntax element, wherein the syntax element specifies that information may bepresent or is not present in a PH or specifies that the information may be presentor is not present in slice headers; and decoding, by the video decoder using thesyntax element, a coded picture to obtain a decoded picture.
[33] Any of the above embodiments may be combined with any of the otherabove embodiments to create a new embodiment. These and other features willbe more clearly understood from the following detailed description taken inconjunction with the accompanying drawings and claims.BRIEF DESCRIPTION OF THE DRAWINGS
[34] For a more complete understanding of this disclosure, reference is nowmade to the following brief description, taken in connection with theaccompanying drawings and detailed description, wherein like reference numeralsrepresent like parts.
[35] FIG. 1 is a flowchart of an example method of coding a video signal.
[36] FIG. 2 is a schematic diagram of an example coding and decoding(codec) system for video coding.
[37] FIG. 3 is a schematic diagram illustrating an example video encoder.
[38] FIG. 4 is a schematic diagram illustrating an example video decoder.
[39] FIG. 5 illustrates an embodiment of a video bitstream.
[40] FIG. 6 is a flowchart illustrating a method of decoding a bitstreamaccording to a first embodiment.
[41] FIG. 7 is a flowchart illustrating a method of encoding a bitstreamaccording to a first embodiment.
[42] FIG. 8 is a flowchart illustrating a method of decoding a bitstreamaccording to a second embodiment.
[43] FIG. 9 is a flowchart illustrating a method of encoding a bitstreamaccording to a second embodiment.
[44] FIG. 10 is a flowchart illustrating a method of decoding a bitstreamaccording to a third embodiment.
[45] FIG. 11 is a flowchart illustrating a method of encoding a bitstreamaccording to a third embodiment.
[46] FIG. 12 is a schematic diagram of a video coding device.
[47] FIG. 13 is a schematic diagram of an embodiment of a means forcoding.DETAILED DESCRIPTION
[48] It should be understood at the outset that, although an illustrativeimplementation of one or more embodiments are provided below, the disclosedsystems and / or methods may be implemented using any number of techniques,whether currently known or in existence. The disclosure should in no way belimited to the illustrative implementations, drawings, and techniques illustratedbelow, including the exemplary designs and implementations illustrated anddescribed herein, but may be modified within the scope of the appended claimsalong with their full scope of equivalents.
[49] The following abbreviations apply:ALF: adaptive loop filterAPS: adaptation parameter setASIC: application-specific integrated circuitAU: access unitAUD: access unit delimiterBT: binary treeCABAC: context-adaptive binary arithmetic codingCAVLC: context-adaptive variable-length codingCb: blue difference chromaCLVS: coded layer-wise video sequenceCLVS: coded layer video sequenceCPU: central processing unitCr: red difference chromaCRA: clean random accessCTB: coding tree blockCTU: coding tree unitCU: coding unitCVS: coded video sequenceDC: direct currentDCI: decoding capability informationDCT: discrete cosine transformDMM: depth modeling modeDPB: decoded picture bufferDPS: decoding parameter setDSP: digital signal processorDST: discrete sine transformEO: electrical-to-opticalFPGA: field-programmable gate arrayGDR: gradual decoding refreshHEVC: High Efficiency Video CodingID: identifierIDR: instantaneous decoding refreshIEC: International Electrotechnical CommissionI / O: input / outputIRAP: intra random access picturesISO: International Organization for StandardizationITU: International Telecommunication UnionITU-T: ITU Telecommunication Standardization SectorLMCS: luma mapping with chroma scalingLTRP: long-term reference pictureMVP: motion vector predictorNAL: network abstraction layerOE: optical-to-electricalPH: picture headerPIPE: probability interval partitioning entropyPOC: picture order countPPS: picture parameter setPU: picture unitQT: quad treeRADL: random access decodable leadingRAM: random-access memoryRASL: random access skipped leadingRBSP: raw byte sequence payloadRDO: rate-distortion optimizationROM: read-only memoryRPL: reference picture listRx: receiver unitSAD: sum of absolute differencesSAO: sample adaptive offsetSBAC: syntax-based arithmetic codingSOP: sequence of picturesSPS: sequence parameter setSRAM: static RAMSSD: sum of squared differencesTCAM: ternary content-addressable memoryTT: triple treeTU: transform unitTx: transmitter unitVCL: video coding layerVPS: video parameter setVVC: Versatile Video Coding.
[50] The following definitions apply unless modified elsewhere: Abitstream is a sequence of bits including video data that is compressed fortransmission between an encoder and a decoder. An encoder is a device thatemploys encoding processes to compress video data into a bitstream. A decoderis a device that employs decoding processes to reconstruct video data from abitstream for display. A picture is an array of luma samples or chroma samplesthat creates a frame or a field. A picture that is being encoded or decoded can bereferred to as a current picture. A reference picture contains reference samplesthat can be used when coding other pictures by reference according to interpredictionor inter-layer prediction. A reference picture list is a list of referencepictures used for inter-prediction or inter-layer prediction. A flag is a variable orsingle-bit syntax element that can take one of the two possible values: 0 or 1.Some video coding systems utilize two reference picture lists, which can bedenoted as reference picture list one and reference picture list zero. A referencepicture list structure is an addressable syntax structure that contains multiplereference picture lists. Inter-prediction is a mechanism of coding samples of acurrent picture by reference to indicated samples in a reference picture that isdifferent from the current picture, where the reference picture and the currentpicture are in the same layer. A reference picture list structure entry is anaddressable location in a reference picture list structure that indicates a referencepicture associated with a reference picture list. A slice header is a part of a codedslice containing data elements pertaining to all video data within a tile representedin the slice. A PPS contains data related to an entire picture. More specifically,the PPS is a syntax structure containing syntax elements that apply to zero ormore entire coded pictures as determined by a syntax element found in eachpicture header. An SPS contains data related to a sequence of pictures. An AU isa set of one or more coded pictures associated with the same display time (e.g.,the same picture order count) for output from a DPB (e.g., for display to a user).An AUD indicates the start of an AU or the boundary between AUs. A decodedvideo sequence is a sequence of pictures that have been reconstructed by adecoder in preparation for display to a user.
[51] FIG. 1 is a flowchart of an example operating method 100 of coding avideo signal. Specifically, a video signal is encoded at an encoder. The encodingprocess compresses the video signal by employing various mechanisms to reducethe video file size. A smaller file size allows the compressed video file to betransmitted toward a user, while reducing associated bandwidth overhead. Thedecoder then decodes the compressed video file to reconstruct the original videosignal for display to an end user. The decoding process generally mirrors theencoding process to allow the decoder to consistently reconstruct the video signal.
[52] At step 101, the video signal is input into the encoder. For example,the video signal may be an uncompressed video file stored in memory. Asanother example, the video file may be captured by a video capture device, suchas a video camera, and encoded to support live streaming of the video. The videofile may include both an audio component and a video component. The videocomponent contains a series of image frames that, when viewed in a sequence,gives the visual impression of motion. The frames contain pixels that areexpressed in terms of light, referred to herein as luma components (or lumasamples), and color, which is referred to as chroma components (or colorsamples). In some examples, the frames may also contain depth values to supportthree dimensional viewing.
[53] At step 103, the video is partitioned into blocks. Partitioning includessubdividing the pixels in each frame into square and / or rectangular blocks forcompression. For example, in HEVC, the frame can first be divided into CTUs,which are blocks of a predefined size (e.g., sixty-four pixels by sixty-four pixels).The CTUs contain both luma and chroma samples. Coding trees may beemployed to divide the CTUs into blocks and then recursively subdivide theblocks until configurations are achieved that support further encoding. Forexample, luma components of a frame may be subdivided until the individualblocks contain relatively homogenous lighting values. Further, chromacomponents of a frame may be subdivided until the individual blocks containrelatively homogenous color values. Accordingly, partitioning mechanisms varydepending on the content of the video frames.
[54] At step 105, various compression mechanisms are employed tocompress the image blocks partitioned at step 103. For example, inter-predictionand / or intra-prediction may be employed. Inter-prediction is designed to takeadvantage of the fact that objects in a common scene tend to appear in successiveframes. Accordingly, a block depicting an object in a reference frame need not berepeatedly described in adjacent frames. Specifically, an object, such as a table,may remain in a constant position over multiple frames. Hence the table isdescribed once and adjacent frames can refer back to the reference frame. Patternmatching mechanisms may be employed to match objects over multiple frames.Further, moving objects may be represented across multiple frames, for exampledue to object movement or camera movement. As a particular example, a videomay show an automobile that moves across the screen over multiple frames.Motion vectors can be employed to describe such movement. A motion vector is atwo-dimensional vector that provides an offset from the coordinates of an objectin a frame to the coordinates of the object in a reference frame. As such, interpredictioncan encode an image block in a current frame as a set of motion vectorsindicating an offset from a corresponding block in a reference frame.
[55] Intra-prediction encodes blocks in a common frame. Intra-predictiontakes advantage of the fact that luma and chroma components tend to cluster in aframe. For example, a patch of green in a portion of a tree tends to be positionedadjacent to similar patches of green. Intra-prediction employs multiple directionalprediction modes (e.g., 33 in HEVC), a planar mode, and a DC mode. Thedirectional modes indicate that a current block is similar / the same as samples of aneighbor block in a corresponding direction. Planar mode indicates that a seriesof blocks along a row / column (e.g., a plane) can be interpolated based onneighbor blocks at the edges of the row. Planar mode, in effect, indicates asmooth transition of light / color across a row / co lumn by employing a relativelyconstant slope in changing values. DC mode is employed for boundarysmoothing and indicates that a block is similar / the same as an average valueassociated with samples of all the neighbor blocks associated with the angulardirections of the directional prediction modes. Accordingly, intra-predictionblocks can represent image blocks as various relational prediction mode valuesinstead of the actual values. Further, inter-prediction blocks can represent imageblocks as motion vector values instead of the actual values. In either case, theprediction blocks may not exactly represent the image blocks in some cases. Anydifferences are stored in residual blocks. Transforms may be applied to theresidual blocks to further compress the file.
[56] At step 107, various filtering techniques may be applied. In HEVC,the filters are applied according to an in-loop filtering scheme. The block basedprediction discussed above may result in the creation of blocky images at thedecoder. Further, the block based prediction scheme may encode a block and thenreconstruct the encoded block for later use as a reference block. The in-loopfiltering scheme iteratively applies noise suppression filters, de-blocking filters,adaptive loop filters, and SAO filters to the blocks / frames. These filters mitigatesuch blocking artifacts so that the encoded file can be accurately reconstructed.Further, these filters mitigate artifacts in the reconstructed reference blocks so thatartifacts are less likely to create additional artifacts in subsequent blocks that areencoded based on the reconstructed reference blocks.
[57] Once the video signal has been partitioned, compressed, and filtered,the resulting data is encoded in a bitstream at step 109. The bitstream includes thedata discussed above as well as any signaling data desired to support proper videosignal reconstruction at the decoder. For example, such data may include partitiondata, prediction data, residual blocks, and various flags providing codinginstructions to the decoder. The bitstream may be stored in memory fortransmission toward a decoder upon request. The bitstream may also be broadcastand / or multicast toward a plurality of decoders. The creation of the bitstream isan iterative process. Accordingly, steps 101, 103, 105, 107, and 109 may occurcontinuously and / or simultaneously over many frames and blocks. The ordershown in FIG. 1 is presented for clarity and ease of discussion, and is not intendedto limit the video coding process to a particular order.
[58] The decoder receives the bitstream and begins the decoding process atstep 111. Specifically, the decoder employs an entropy decoding scheme toconvert the bitstream into corresponding syntax and video data. The decoderemploys the syntax data from the bitstream to determine the partitions for theframes at step 111. The partitioning should match the results of block partitioningat step 103. Entropy encoding / decoding as employed in step 111 is nowdescribed. The encoder makes many choices during the compression process,such as selecting block partitioning schemes from several possible choices basedon the spatial positioning of values in the input image(s). Signaling the exactchoices may employ a large number of bins. As used herein, a bin is a binaryvalue that is treated as a variable (e.g., a bit value that may vary depending oncontext). Entropy coding allows the encoder to discard any options that areclearly not viable for a particular case, leaving a set of allowable options. Eachallowable option is then assigned a code word. The length of the code words isbased on the number of allowable options (e.g., one bin for two options, two binsfor three to four options, etc.) The encoder then encodes the code word for theselected option. This scheme reduces the size of the code words as the codewords are as big as desired to uniquely indicate a selection from a small sub-set ofallowable options as opposed to uniquely indicating the selection from apotentially large set of all possible options. The decoder then decodes theselection by determining the set of allowable options in a similar manner to theencoder. By determining the set of allowable options, the decoder can read thecode word and determine the selection made by the encoder.
[59] At step 113, the decoder performs block decoding. Specifically, thedecoder employs reverse transforms to generate residual blocks. Then thedecoder employs the residual blocks and corresponding prediction blocks toreconstruct the image blocks according to the partitioning. The prediction blocksmay include both intra-prediction blocks and inter-prediction blocks as generatedat the encoder at step 105. The reconstructed image blocks are then positionedinto frames of a reconstructed video signal according to the partitioning datadetermined at step 111. Syntax for step 113 may also be signaled in the bitstreamvia entropy coding as discussed above.
[60] At step 115, filtering is performed on the frames of the reconstructedvideo signal in a manner similar to step 107 at the encoder. For example, noisesuppression filters, de-blocking filters, adaptive loop filters, and SAO filters maybe applied to the frames to remove blocking artifacts. Once the frames arefiltered, the video signal can be output to a display at step 117 for viewing by anend user.
[61] FIG. 2 is a schematic diagram of an example coding and decoding(codec) system 200 for video coding. Specifically, codec system 200 providesfunctionality to support the implementation of operating method 100. Codecsystem 200 is generalized to depict components employed in both an encoder anda decoder. Codec system 200 receives and partitions a video signal as discussedwith respect to steps 101 and 103 in operating method 100, which results in apartitioned video signal 201. Codec system 200 then compresses the partitionedvideo signal 201 into a coded bitstream when acting as an encoder as discussedwith respect to steps 105, 107, and 109 in method 100. When acting as a decoder,codec system 200 generates an output video signal from the bitstream as discussedwith respect to steps 111, 113, 115, and 117 in operating method 100. The codecsystem 200 includes a general coder control component 211, a transform scalingand quantization component 213, an intra-picture estimation component 215, anintra-picture prediction component 217, a motion compensation component 219, amotion estimation component 221, a scaling and inverse transform component229, a filter control analysis component 227, an in-loop filters component 225, adecoded picture buffer component 223, and a header formatting and CABACcomponent 231. Such components are coupled as shown. In FIG. 2, black linesindicate movement of data to be encoded / decoded while dashed lines indicatemovement of control data that controls the operation of other components. Thecomponents of codec system 200 may all be present in the encoder. The decodermay include a subset of the components of codec system 200. For example, thedecoder may include the intra-picture prediction component 217, the motioncompensation component 219, the scaling and inverse transform component 229,the in-loop filters component 225, and the decoded picture buffer component 223.These components are now described.
[62] The partitioned video signal 201 is a captured video sequence that hasbeen partitioned into blocks of pixels by a coding tree. A coding tree employsvarious split modes to subdivide a block of pixels into smaller blocks of pixels.These blocks can then be further subdivided into smaller blocks. The blocks maybe referred to as nodes on the coding tree. Larger parent nodes are split intosmaller child nodes. The number of times a node is subdivided is referred to as thedepth of the node / coding tree. The divided blocks can be included in CUs insome cases. For example, a CU can be a sub-portion of a CTU that contains aluma block, Cr block(s), and a Cb block(s) along with corresponding syntaxinstructions for the CU. The split modes may include a BT, TT, and QTemployed to partition a node into two, three, or four child nodes, respectively, ofvarying shapes depending on the split modes employed. The partitioned videosignal 201 is forwarded to the general coder control component 211, the transformscaling and quantization component 213, the intra-picture estimation component215, the filter control analysis component 227, and the motion estimationcomponent 221 for compression.
[63] The general coder control component 211 is configured to makedecisions related to coding of the images of the video sequence into the bitstreamaccording to application constraints. For example, the general coder controlcomponent 211 manages optimization of bitrate / bitstream size versusreconstruction quality. Such decisions may be made based on storagespace / bandwidth availability and image resolution requests. The general codercontrol component 211 also manages buffer utilization in light of transmissionspeed to mitigate buffer underrun and overrun issues. To manage these issues, thegeneral coder control component 211 manages partitioning, prediction, andfiltering by the other components. For example, the general coder controlcomponent 211 may dynamically increase compression complexity to increaseresolution and increase bandwidth usage or decrease compression complexity todecrease resolution and bandwidth usage. Hence, the general coder controlcomponent 211 controls the other components of codec system 200 to balancevideo signal reconstruction quality with bit rate concerns. The general codercontrol component 211 creates control data, which controls the operation of theother components. The control data is also forwarded to the header formattingand CABAC component 231 to be encoded in the bitstream to signal parametersfor decoding at the decoder.
[64] The partitioned video signal 201 is also sent to the motion estimationcomponent 221 and the motion compensation component 219 for inter-prediction.A frame or slice of the partitioned video signal 201 may be divided into multiplevideo blocks. Motion estimation component 221 and the motion compensationcomponent 219 perform inter-predictive coding of the received video blockrelative to one or more blocks in one or more reference frames to providetemporal prediction. Codec system 200 may perform multiple coding passes, e.g.,to select an appropriate coding mode for each block of video data.
[65] Motion estimation component 221 and motion compensationcomponent 219 may be highly integrated, but are illustrated separately forconceptual purposes. Motion estimation, performed by motion estimationcomponent 221, is the process of generating motion vectors, which estimatemotion for video blocks. A motion vector, for example, may indicate thedisplacement of a coded object relative to a predictive block. A predictive blockis a block that is found to closely match the block to be coded, in terms of pixeldifference. A predictive block may also be referred to as a reference block. Suchpixel difference may be determined by an SAD, an SSD, or other differencemetrics. HEVC employs several coded objects including a CTU, CTBs, and CUs.For example, a CTU can be divided into CTBs, which can then be divided intoCBs for inclusion in CUs. A CU can be encoded as a prediction unit containingprediction data and / or a TU containing transformed residual data for the CU. Themotion estimation component 221 generates motion vectors, prediction units, andTUs by using a rate-distortion analysis as part of a rate distortion optimizationprocess. For example, the motion estimation component 221 may determinemultiple reference blocks, multiple motion vectors, etc. for a current block / frame,and may select the reference blocks, motion vectors, etc. having the best ratedistortioncharacteristics. The best rate-distortion characteristics balance bothquality of video reconstruction (e.g., amount of data loss by compression) withcoding efficiency (e.g., size of the final encoding).
[66] In some examples, codec system 200 may calculate values for subintegerpixel positions of reference pictures stored in decoded picture buffercomponent 223. For example, video codec system 200 may interpolate values ofone-quarter pixel positions, one-eighth pixel positions, or other fractional pixelpositions of the reference picture. Therefore, motion estimation component 221may perform a motion search relative to the full pixel positions and fractionalpixel positions and output a motion vector with fractional pixel precision. Themotion estimation component 221 calculates a motion vector for a prediction unitof a video block in an inter-coded slice by comparing the position of theprediction unit to the position of a predictive block of a reference picture. Motionestimation component 221 outputs the calculated motion vector as motion data toheader formatting and CABAC component 231 for encoding and motion to themotion compensation component 219.
[67] Motion compensation, performed by motion compensation component219, may involve fetching or generating the predictive block based on the motionvector determined by motion estimation component 221. Again, motionestimation component 221 and motion compensation component 219 may befunctionally integrated, in some examples. Upon receiving the motion vector forthe prediction unit of the current video block, motion compensation component219 may locate the predictive block to which the motion vector points. A residualvideo block is then formed by subtracting pixel values of the predictive blockfrom the pixel values of the current video block being coded, forming pixeldifference values. In general, motion estimation component 221 performs motionestimation relative to luma components, and motion compensation component 219uses motion vectors calculated based on the luma components for both chromacomponents and luma components. The predictive block and residual block areforwarded to transform scaling and quantization component 213.
[68] The partitioned video signal 201 is also sent to intra-picture estimationcomponent 215 and intra-picture prediction component 217. As with motionestimation component 221 and motion compensation component 219, intrapictureestimation component 215 and intra-picture prediction component 217may be highly integrated, but are illustrated separately for conceptual purposes.The intra-picture estimation component 215 and intra-picture predictioncomponent 217 intra-predict a current block relative to blocks in a current frame,as an alternative to the inter-prediction performed by motion estimationcomponent 221 and motion compensation component 219 between frames, asdescribed above. In particular, the intra-picture estimation component 215determines an intra-prediction mode to use to encode a current block. In someexamples, intra-picture estimation component 215 selects an appropriate intrapredictionmode to encode a current block from multiple tested intra-predictionmodes. The selected intra-prediction modes are then forwarded to the headerformatting and CABAC component 231 for encoding.
[69] For example, the intra-picture estimation component 215 calculatesrate-distortion values using a rate-distortion analysis for the various tested intrapredictionmodes, and selects the intra-prediction mode having the best ratedistortioncharacteristics among the tested modes. Rate-distortion analysisgenerally determines an amount of distortion (or error) between an encoded blockand an original un-encoded block that was encoded to produce the encoded block,as well as a bitrate (e.g., a number of bits) used to produce the encoded block.The intra-picture estimation component 215 calculates ratios from the distortionsand rates for the various encoded blocks to determine which intra-prediction modeexhibits the best rate-distortion value for the block. In addition, intra-pictureestimation component 215 may be configured to code depth blocks of a depthmap using a DMM based on RDO.
[70] The intra-picture prediction component 217 may generate a residualblock from the predictive block based on the selected intra-prediction modesdetermined by intra-picture estimation component 215 when implemented on anencoder or read the residual block from the bitstream when implemented on adecoder. The residual block includes the difference in values between thepredictive block and the original block, represented as a matrix. The residualblock is then forwarded to the transform scaling and quantization component 213.The intra-picture estimation component 215 and the intra-picture predictioncomponent 217 may operate on both luma and chroma components.
[71] The transform scaling and quantization component 213 is configuredto further compress the residual block. The transform scaling and quantizationcomponent 213 applies a transform, such as a DCT, a DST, or a conceptuallysimilar transform, to the residual block, producing a video block comprisingresidual transform coefficient values. Wavelet transforms, integer transforms,sub-band transforms or other types of transforms could also be used. Thetransform may convert the residual information from a pixel value domain to atransform domain, such as a frequency domain. The transform scaling andquantization component 213 is also configured to scale the transformed residualinformation, for example based on frequency. Such scaling involves applying ascale factor to the residual information so that different frequency information isquantized at different granularities, which may affect final visual quality of thereconstructed video. The transform scaling and quantization component 213 isalso configured to quantize the transform coefficients to further reduce bit rate.The quantization process may reduce the bit depth associated with some or all ofthe coefficients. The degree of quantization may be modified by adjusting aquantization parameter. In some examples, the transform scaling and quantizationcomponent 213 may then perform a scan of the matrix including the quantizedtransform coefficients. The quantized transform coefficients are forwarded to theheader formatting and CABAC component 231 to be encoded in the bitstream.
[72] The scaling and inverse transform component 229 applies a reverseoperation of the transform scaling and quantization component 213 to supportmotion estimation. The scaling and inverse transform component 229 appliesinverse scaling, transformation, and / or quantization to reconstruct the residualblock in the pixel domain, e.g., for later use as a reference block which maybecome a predictive block for another current block. The motion estimationcomponent 221 and / or motion compensation component 219 may calculate areference block by adding the residual block back to a corresponding predictiveblock for use in motion estimation of a later block / frame. Filters are applied tothe reconstructed reference blocks to mitigate artifacts created during scaling,quantization, and transform. Such artifacts could otherwise cause inaccurateprediction (and create additional artifacts) when subsequent blocks are predicted.
[73] The filter control analysis component 227 and the in-loop filterscomponent 225 apply the filters to the residual blocks and / or to reconstructedimage blocks. For example, the transformed residual block from the scaling andinverse transform component 229 may be combined with a correspondingprediction block from intra-picture prediction component 217 and / or motioncompensation component 219 to reconstruct the original image block. The filtersmay then be applied to the reconstructed image block. In some examples, thefilters may instead be applied to the residual blocks. As with other components inFIG. 2, the filter control analysis component 227 and the in-loop filterscomponent 225 are highly integrated and may be implemented together, but aredepicted separately for conceptual purposes. Filters applied to the reconstructedreference blocks are applied to particular spatial regions and include multipleparameters to adjust how such filters are applied. The filter control analysiscomponent 227 analyzes the reconstructed reference blocks to determine wheresuch filters should be applied and sets corresponding parameters. Such data isforwarded to the header formatting and CABAC component 231 as filter controldata for encoding. The in-loop filters component 225 applies such filters based onthe filter control data. The filters may include a de-blocking filter, a noisesuppression filter, a SAO filter, and an adaptive loop filter. Such filters may beapplied in the spatial / pixel domain (e.g., on a reconstructed pixel block) or in thefrequency domain, depending on the example.
[74] When operating as an encoder, the filtered reconstructed image block,residual block, and / or prediction block are stored in the decoded picture buffercomponent 223 for later use in motion estimation as discussed above. Whenoperating as a decoder, the decoded picture buffer component 223 stores andforwards the reconstructed and filtered blocks toward a display as part of anoutput video signal. The decoded picture buffer component 223 may be anymemory device capable of storing prediction blocks, residual blocks, and / orreconstructed image blocks.
[75] The header formatting and CABAC component 231 receives the datafrom the various components of codec system 200 and encodes such data into acoded bitstream for transmission toward a decoder. Specifically, the headerformatting and CABAC component 231 generates various headers to encodecontrol data, such as general control data and filter control data. Further,prediction data, including intra-prediction and motion data, as well as residualdata in the form of quantized transform coefficient data are all encoded in thebitstream. The final bitstream includes all information desired by the decoder toreconstruct the original partitioned video signal 201. Such information may alsoinclude intra-prediction mode index tables (also referred to as codeword mappingtables), definitions of encoding contexts for various blocks, indications of mostprobable intra-prediction modes, an indication of partition information, etc. Suchdata may be encoded by employing entropy coding. For example, the informationmay be encoded by employing CAVLC, CABAC, SBAC, PIPE coding, oranother entropy coding technique. Following the entropy coding, the codedbitstream may be transmitted to another device (e.g., a video decoder) or archivedfor later transmission or retrieval.
[76] FIG. 3 is a block diagram illustrating an example video encoder 300.Video encoder 300 may be employed to implement the encoding functions ofcodec system 200 and / or implement steps 101, 103, 105, 107, and / or 109 ofoperating method 100. Encoder 300 partitions an input video signal, resulting in apartitioned video signal 301, which is substantially similar to the partitioned videosignal 201. The partitioned video signal 301 is then compressed and encoded intoa bitstream by components of encoder 300.
[77] Specifically, the partitioned video signal 301 is forwarded to an intrapictureprediction component 317 for intra-prediction. The intra-pictureprediction component 317 may be substantially similar to intra-picture estimationcomponent 215 and intra-picture prediction component 217. The partitionedvideo signal 301 is also forwarded to a motion compensation component 321 forinter-prediction based on reference blocks in a decoded picture buffer component323. The motion compensation component 321 may be substantially similar tomotion estimation component 221 and motion compensation component 219. Theprediction blocks and residual blocks from the intra-picture prediction component317 and the motion compensation component 321 are forwarded to a transformand quantization component 313 for transform and quantization of the residualblocks. The transform and quantization component 313 may be substantiallysimilar to the transform scaling and quantization component 213. The transformedand quantized residual blocks and the corresponding prediction blocks (along withassociated control data) are forwarded to an entropy coding component 331 forcoding into a bitstream. The entropy coding component 331 may be substantiallysimilar to the header formatting and CABAC component 231.
[78] The transformed and quantized residual blocks and / or thecorresponding prediction blocks are also forwarded from the transform andquantization component 313 to an inverse transform and quantization component329 for reconstruction into reference blocks for use by the motion compensationcomponent 321. The inverse transform and quantization component 329 may besubstantially similar to the scaling and inverse transform component 229. In-loopfilters in an in-loop filters component 325 are also applied to the residual blocksand / or reconstructed reference blocks, depending on the example. The in-loopfilters component 325 may be substantially similar to the filter control analysiscomponent 227 and the in-loop filters component 225. The in-loop filterscomponent 325 may include multiple filters as discussed with respect to in-loopfilters component 225. The filtered blocks are then stored in a decoded picturebuffer component 323 for use as reference blocks by the motion compensationcomponent 321. The decoded picture buffer component 323 may be substantiallysimilar to the decoded picture buffer component 223.
[79] FIG. 4 is a block diagram illustrating an example video decoder 400.Video decoder 400 may be employed to implement the decoding functions ofcodec system 200 and / or implement steps 111, 113, 115, and / or 117 of operatingmethod 100. Decoder 400 receives a bitstream, for example from an encoder 300,and generates a reconstructed output video signal based on the bitstream fordisplay to an end user.
[80] The bitstream is received by an entropy decoding component 433. Theentropy decoding component 433 is configured to implement an entropy decodingscheme, such as CAVLC, CABAC, SBAC, PIPE coding, or other entropy codingtechniques. For example, the entropy decoding component 433 may employheader information to provide a context to interpret additional data encoded ascodewords in the bitstream. The decoded information includes any desiredinformation to decode the video signal, such as general control data, filter controldata, partition information, motion data, prediction data, and quantized transformcoefficients from residual blocks. The quantized transform coefficients areforwarded to an inverse transform and quantization component 429 forreconstruction into residual blocks. The inverse transform and quantizationcomponent 429 may be similar to inverse transform and quantization component329.
[81] The reconstructed residual blocks and / or prediction blocks areforwarded to intra-picture prediction component 417 for reconstruction into imageblocks based on intra-prediction operations. The intra-picture predictioncomponent 417 may be similar to intra-picture estimation component 215 and anintra-picture prediction component 217. Specifically, the intra-picture predictioncomponent 417 employs prediction modes to locate a reference block in the frameand applies a residual block to the result to reconstruct intra-predicted imageblocks. The reconstructed intra-predicted image blocks and / or the residual blocksand corresponding inter-prediction data are forwarded to a decoded picture buffercomponent 423 via an in-loop filters component 425, which may be substantiallysimilar to decoded picture buffer component 223 and in-loop filters component225, respectively. The in-loop filters component 425 filters the reconstructedimage blocks, residual blocks and / or prediction blocks, and such information isstored in the decoded picture buffer component 423. Reconstructed image blocksfrom decoded picture buffer component 423 are forwarded to a motioncompensation component 421 for inter-prediction. The motion compensationcomponent 421 may be substantially similar to motion estimation component 221and / or motion compensation component 219. Specifically, the motioncompensation component 421 employs motion vectors from a reference block togenerate a prediction block and applies a residual block to the result to reconstructan image block. The resulting reconstructed blocks may also be forwarded via thein-loop filters component 425 to the decoded picture buffer component 423. Thedecoded picture buffer component 423 continues to store additional reconstructedimage blocks, which can be reconstructed into frames via the partitioninformation. Such frames may also be placed in a sequence. The sequence isoutput toward a display as a reconstructed output video signal.
[82] FIG. 5 illustrates an embodiment of a video bitstream 500. The videobitstream 500 may also be referred to as a coded video bitstream, a bitstream, orvariations thereof. The bitstream 500 comprises at least one PU 501. While threeof PUs 501 are shown in FIG. 5, a different number of PUs 501 may be present inthe bitstream 500 in practical applications. Each PU 501 is a set of NAL unitsthat are associated with each other according to a specified classification rule, areconsecutive in decoding order, and contain exactly one coded picture (e.g., picture514). In an embodiment, each PU 501 has or is associated with a temporal ID519.
[83] In an embodiment, each PU 501 contains one or more of the following:a DCI 502, a VPS 504, an SPS 506, a PPS 508, a PH 512, and a picture 514. Eachof the DCI 502, the VPS 504, the SPS 506, and the PPS 508 may be genericallyreferred to as a parameter set. Other parameter sets not shown in FIG. 5 may alsobe included in the bitstream 500 such as, for example, an APS, which is a syntaxstructure containing syntax elements that apply to zero or more slices asdetermined by zero or more syntax elements found in slice headers 520.
[84] The DCI 502, which may also be referred to a DPS, is a syntaxstructure containing syntax elements that apply to the entire bitstream. The DCI502 includes parameters that stay constant for the lifetime of the video bitstream(e.g., bitstream 500), which can translate to the lifetime of a session. The DCI502 can include profile, level, and sub-profile information to determine amaximum complexity interop point that is guaranteed to never be exceeded, evenif splicing of video sequences occurs within a session. It further optionallyincludes constraint flags, which indicate that the video bitstream will beconstrained to the use of certain features as indicated by the values of those flags.With this, a bitstream can be labelled as not using certain tools, which allowsamong other things for resource allocation in a decoder implementation. Like allparameter sets, the DCI 502 is present when first referenced, and referenced bythe very first picture in a video sequence, implying that it has to be sent among thefirst NAL units in the bitstream. While multiple DCIs 502 can be in the bitstream,the value of the syntax elements therein cannot be inconsistent when beingreferenced.
[85] The VPS 504 includes decoding dependency or information forreference picture set construction of enhancement layers. The VPS 504 providesan overall perspective or view of a scalable sequence, including what types ofoperation points are provided, the profile, tier, and level of the operation points,and some other high-level properties of the bitstream that can be used as the basisfor session negotiation and content selection, etc.
[86] The SPS 506 contains data that is common to all the pictures in anSOP. The SPS 506 is a syntax structure containing syntax elements that apply tozero or more entire CLVSs as determined by the content of a syntax elementfound in the PPS referred to by a syntax element found in each picture header. Incontrast, the PPS 508 contains data that is common to the entire picture. The PPS508 is a syntax structure containing syntax elements that apply to zero or moreentire coded pictures as determined by a syntax element found in each pictureheader (e.g., PH 512).
[87] The DCI 502, the VPS 504, the SPS 506, and the PPS 508 arecontained in different types of NAL units. A NAL unit is a syntax structurecontaining an indication of the type of data to follow (e.g., coded video data).NAL units are classified into VCL and non-VCL NAL units. The VCL NALunits contain the data that represents the values of the samples in the videopictures, and the non-VCL NAL units contain any associated additionalinformation such as parameter sets (important data that can apply to a number ofVCL NAL units) and supplemental enhancement information (timing informationand other supplemental data that may enhance usability of the decoded videosignal but are not necessary for decoding the values of the samples in the videopictures).
[88] The PH 512 is a syntax structure containing syntax elements that applyto all slices (e.g., slices 518) of a coded picture (e.g., picture 514). In anembodiment, the PH 512 is in a new type of non-VCL NAL unit designated as aPH NAL unit. Therefore, the PH NAL unit has a PH NUT (e.g., PH_NUT). In anembodiment, there is one and only one PH 512 included in each PU 501. That is,the PU 501 contains a single or lone PH 512. In an embodiment, exactly one PHNAL unit is present for each picture 501 in the bitstream 500.
[89] The picture 514 is an array of luma samples in monochrome format oran array of luma samples and two corresponding arrays of chroma samples in4:2:0, 4:2:2, and 4:4:4 color format. In an embodiment, there is one and only onepicture 514 included in each PU 501. As such, there is only one PH 512 and onlyone picture 514 corresponding to that PH 512 in each PU 501. That is, the PU501 contains a single or lone picture 514.
[90] Each picture 514 contains one or more slices 518. A slice 518 is aninteger number of complete tiles or an integer number of consecutive completeCTU rows within a tile of a picture (e.g., picture 514). Each slice 518 isexclusively contained in a single NAL unit (e.g., a VCL NAL unit). In anembodiment, the single NAL unit is associated with or has a layer ID 515. A tile(not shown) is a rectangular region of CTUs within a particular tile column and aparticular tile row in a picture (e.g., picture 514). A tile is a partitioned portion ofa picture created by horizontal and vertical boundaries. Tiles may be rectangularand / or square. Specifically, a tile includes four sides that are connected at rightangles. The four sides include two pair of parallel sides. Further, the sides in aparallel side pair are of equal length. As such, a tile may be any rectangularshape, where a square is a special case of a rectangle where all four sides are ofequal length. An image / picture can contain one or more tiles. A CTU (notshown) is a CTB of luma samples, two corresponding CTBs of chroma samples ofa picture that has three sample arrays, or a CTB of samples of a monochromepicture or a picture that is coded using three separate color planes and syntaxstructures used to code the samples. A CTB (not shown) is an NxN block ofsamples for some value of N such that the division of a component into CTBs is apartitioning. A block (not shown) is an MxN (M-column by N-row) array ofsamples (e.g., pixels), or an MxN array of transform coefficients.
[91] The pictures 514 and their slices 518 comprise data associated with theimages or video being encoded or decoded. Thus, the pictures 514 and their slices518 may be simply referred to as the payload or data being carried in the bitstream500. The PH 512 and the slice headers 520 may comprise a flag 522. The flag522 may be an RPL flag, an SAO flag, or an ALF flag as described below.
[92] While the VVC specification specifies only a handful of syntaxelements that are picture level, in common-use cases there are more syntaxelements whose values may be different among slices of the same picture, butusually are the same for all slices of the same picture. Examples of such syntaxelements are syntax elements related to RPLs, joint chroma sign flags, SAOenable flags, ALF enable flags and parameters, LMCS enable flags andparameters, and scaling list enable flags and parameters. Non-picture-level syntaxelements such as those are not signaled in the PH so that, even when they have thesame values for all slices of the same picture, they still have to be repeated inevery slice header of those slices. In other words, in some approaches, thosesyntax elements were signaled in a slice header. This was because the data theycarry can vary from slice to slice. However, in most cases, they are the same foran entire picture containing the slices. The result is that these elements aresignaled several times per picture, but the values are generally the same, which isredundant and wastes bits in the encoded bitstream.
[93] Disclosed herein are embodiments for signaling of non-picture-levelsyntax at the picture level. In the embodiments, syntax elements are included in apicture header when the syntax elements are the same or included in a slice headerwhen the syntax elements vary. However, in some embodiments, the syntaxelements may not be included in both. First, non-picture-level syntax elementsmay be present in the PH. Non-picture-level syntax elements are syntax elementsthat are at a level of a video bitstream other than the picture level. Second, foreach category of non-picture-level syntax elements, a flag specifies when syntaxelements of the category are present in the PH or slice headers. The flag may bein the PH. The non-picture-level syntax elements include those related tosignaling of RPLs, joint Cb Cr sign flags, SAO tool enabling and parameters, ALFtool enabling and parameters, LMCS tool enabling and parameters, and scalinglist tool enabling and parameters. Third, when non-picture-level syntax elementsare present in the PH, the corresponding syntax elements shall not be present inany slice of the picture associated with the picture header containing the syntaxelements. The values of non-picture-level syntax elements that are present in thePH are applied to all slices of the picture associated with the picture headercontaining the syntax elements. Fourth, when non-picture-level syntax elementsare not present in the PH, the corresponding syntax elements may be present inslice headers of slices of the picture associated with the picture header. Bymoving signaling of non-picture-level syntax elements to the picture level,redundancy is reduced and there are fewer wasted bits in the encoded bitstream.PH RBSP Syntaxpicture_header_rbsp( ) { Descriptorpic_type u(3)pic_parameter_set_id ue(v)non_reference_picture_flag u(1)if( separate_colour_plane_flag = = 1 )colour_plane_id u(2)pic_order_cnt_lsb u(v)if( pic_type = = 2 )recovery_poc_cnt ue(v)if(pic_type = = 0 | | pic_type = = 1 | | pic_type = = 2 )no_output_of_prior_pics_flag u(1)if( output_flag_present_flag )pic_output_flag u(1)if( pic_type != 0 | | sps_idr_rpl_present_flag )pic_rpl_present_flag u(1)if( pic_rpl_present_flag ) {for( i = 0; i < 2; i++ ) {if( num_ref_pic_lists_in_sps[ i ] > 0 &&pps_ref_pic_list_sps_idc[ i ] &&( i = = 0 | | ( i = = 1 &&rpl1_idx_present_flag ) ) )pic_rpl_sps_flag[ i ] u(1)if( pic_rpl_sps_flag[ i ] ) {if( num_ref_pic_lists_in_sps[ i ] > 1 &&( i = = 0 | | ( i = = 1&& rpl1_idx_present_flag ) ) )pic_rpl_idx[ i ] u(v)} elseref_pic_list_struct( i,num_ref_pic_lists_in_sps[ i ] )for( j = 0; j < NumLtrpEntries[ i ][ RplsIdx[ i ] ]; j++ )if( ltrp_in_slice_header_flag[ i ][ RplsIdx[ i ] ]pic_poc_lsb_lt[ i ][ j ] u(v)pic_delta_poc_msb_present_flag[ i ][ j ] u(1)if( pic_delta_poc_msb_present_flag[ i ][ j ] )pic_delta_poc_msb_cycle_lt[ i ][ j ] ue(v)}}}if ( pic_type != 0 && pic_type != 1 && pic_type != 3 )if( sps_temporal_mvp_enabled_flag &&pps_temporal_mvp_enabled_idc )pic_temporal_mvp_enabled_flag u(1)if( sps_joint_cbcr_enabled_flag )pic_level_joint_cbcr_sign_flag u(1)if( sps_sao_enabled_flag ) {pic_level_sao_luma_enabled_flag u(1)if(ChromaArrayType != 0 )pic_level_sao_chroma_enabled_flag u(1)}if( sps_alf_enabled_flag ) {pic_level_alf_enabled_flag u(1)if( pic_level_alf_enabled_flag ) {pic_num_alf_aps_ids_luma u(3)for( i = 0; i < pic_num_alf_aps_ids_luma; i++ )pic_alf_aps_id_luma[ i ] u(3)if( ChromaArrayType != 0 )pic_alf_chroma_idc u(2)if( pic_alf_chroma_idc )pic_alf_aps_id_chroma u(3)}}if( sps_lmcs_enabled_flag ) {pic_level_lmcs_enabled_flag u(1)if( pic_lmcs_enabled_flag ) {pic_lmcs_aps_id u(2)if( ChromaArrayType != 0 )pic_chroma_residual_scale_flag u(1)}}if( sps_scaling_list_enabled_flag ) {pic_level_scaling_list_present_flag u(1)if( pic_level_scaling_list_present_flag )pic_scaling_list_aps_id u(3)}rbsp_trailing_bits( )Slice Header RBSP Syntaxslice_header( ) { Descriptorif( rect_slice_flag | | NumBricksInPic > 1 )slice_address u(v)if( !rect_slice_flag && !single_brick_per_slice_flag )num_bricks_in_slice_minus1 ue(v)if( pic_type != 0 && pic_type != 1 && pic_type != 3 )slice_type ue(v)if( ( ( pic_type != 0 | | sps_idr_rpl_present_flag ) &&pic_rpl_present_flag ) {for( i = 0; i < 2; i++ ) {if( num_ref_pic_lists_in_sps[ i ] > 0 &&pps_ref_pic_list_sps_idc[ i ] &&( i = = 0( i = = 1 && rpl1_idx_present_flag ) ) )slice_rpl_sps_flag[ i ] u(1)if( slice_rpl_sps_flag[ i ] ) {if( num_ref_pic_lists_in_sps[ i ] > 1 &&( i = = 0 | | ( i= 1 && rpl1_idx_present_flag ) ) )slice_rpl_idx[ i ] u(v)} elseref_pic_list_struct( i,num_ref_pic_lists_in_sps[ i ] )for( j = 0; j < NumLtrpEntries[ i ][ RplsIdx[ i ] ]; j++ )if( ltrp_in_slice_header_flag[ i ][ RplsIdx[ i ] ]slice_poc_lsb_lt[ i ][ j ] u(v)slice_delta_poc_msb_present_flag[ i ][ j ] u(1)if( slice_delta_poc_msb_present_flag[ i ][ j ] )slice_delta_poc_msb_cycle_lt[ i ][ j ] ue(v)}}}if( ( slice_type != I && num_ref_entries[ 0 ][ RplsIdx[ 0 ] ] > 1 ) | |( slice_type = = B && num_ref_entries[ 1 ][ RplsIdx[ 1 ] ]1 ) ) {num_ref_idx_active_override_flag u(1)if( num_ref_idx_active_override_flag )for( i = 0; i < ( slice_type = = B ? 2: 1 ); i++ )if( num_ref_entries[ i ][ RplsIdx[ i ] ] > 1 )num_ref_idx_active_minus1[ i ] ue(v)}if( partition_constraints_override_enabled_flag ) {partition_constraints_override_flag ue(v)if( partition_constraints_override_flag ) {slice_log2_diff_min_qt_min_cb_luma ue(v)slice_max_mtt_hierarchy_depth_luma ue(v)if( slice_max_mtt_hierarchy_depth_luma != 0 )slice_log2_diff_max_bt_min_qt_luma ue(v)slice_log2_diff_max_tt_min_qt_luma ue(v)}if( slice_type = = I && qtbtt_dual_tree_intra_flag ) {slice_log2_diff_min_qt_min_cb_chroma ue(v)slice_max_mtt_hierarchy_depth_chroma ue(v)if( slice_max_mtt_hierarchy_depth_chroma !=slice_log2_diff_max_bt_min_qt_chromaue(v)slice_log2_diff_max_tt_min_qt_chromaue(v)}}}}if ( slice_type != I ) {if( slice_type = = B && !pps_mvd_l1_zero_idc )mvd_l1_zero_flag u(1)if( cabac_init_present_flag )cabac_init_flag u(1)if( pic_temporal_mvp_enabled_flag ) {if( slice_type = = B &&pps_collocated_from_l0_idc )collocated_from_l0_flag u(1)if( ( collocated_from_l0_flag &&NumRefIdxActive[ 0 ] > 1 ) | |( !collocated_from_l0_flag &&NumRefIdxActive[ 1 ] > 1 ) )collocated_ref_idx ue(v)}if( ( pps_weighted_pred_flag && slice_type = = P ) | |( pps_weighted_bipred_flag && slice_type = = B ) )pred_weight_table( )if( !pps_six_minus_max_num_merge_cand_plus1 )six_minus_max_num_merge_cand ue(v)if( sps_affine_enabled_flag &&!pps_five_minus_max_num_subblock_merge_cand_plus1 )five_minus_max_num_subblock_merge_cand ue(v)if( sps_fpel_mmvd_enabled_flag )slice_fpel_mmvd_enabled_flag u(1)if( sps_bdof_dmvr_slice_present_flag )slice_disable_bdof_dmvr_flag u(1)if( sps_triangle_enabled_flag && MaxNumMergeCand >= 2&&!pps_max_num_merge_cand_minus_max_num_triangle_cand_minusmax_num_merge_cand_minus_max_num_triangle_candue(v)}if ( sps_ibc_enabled_flag )slice_six_minus_max_num_ibc_merge_cand ue(v)if( sps_joint_cbcr_enabled_flag && !pic_level_joint_cbcr_sign_flagslice_joint_cbcr_sign_flag u(1)slice_qp_delta se(v)if( pps_slice_chroma_qp_offsets_present_flag ) {slice_cb_qp_offset se(v)slice_cr_qp_offset se(v)if( sps_joint_cbcr_enabled_flag )slice_joint_cbcr_qp_offset se(v)}if( sps_sao_enabled_flag ) {if( !pic_level_sao_luma_enabled_flag )slice_sao_luma_flag u(1)if( ChromaArrayType != 0 &&pic_level_sao_chroma_enabled_flag )slice_sao_chroma_flag u(1)}if( sps_alf_enabled_flag && !pic_level_alf_enabled_flag ) {slice_alf_enabled_flag u(1)if( slice_alf_enabled_flag ) {slice_num_alf_aps_ids_luma u(3)for( i = 0; i < slice_num_alf_aps_ids_luma; i++ )slice_alf_aps_id_luma[ i ] u(3)if( ChromaArrayType != 0 )slice_alf_chroma_idc u(2)if( slice_alf_chroma_idc )slice_alf_aps_id_chroma u(3)}}if ( !pps_dep_quant_enabled_flag )dep_quant_enabled_flag u(1)if( !dep_quant_enabled_flag )sign_data_hiding_enabled_flag u(1)if( deblocking_filter_override_enabled_flag )deblocking_filter_override_flag u(1)if( deblocking_filter_override_flag ) {slice_deblocking_filter_disabled_flag u(1)if( !slice_deblocking_filter_disabled_flag ) {slice_beta_offset_div2 se(v)slice_tc_offset_div2 se(v)}}if( sps_lmcs_enabled_flag && !pic_level_lmcs_enabled_flag ) {slice_lmcs_enabled_flag u(1)if( slice_lmcs_enabled_flag ) {slice_lmcs_aps_id u(2)if( ChromaArrayType != 0 )slice_chroma_residual_scale_flag u(1)}}if( sps_scaling_list_enabled_flag &&pic_level_scaling_list_present_flag ) {slice_scaling_list_present_flag u(1)if( slice_scaling_list_present_flag )slice_scaling_list_aps_id u(3)}if( entry_point_offsets_present_flag && NumEntryPoints > 0 ) {offset_len_minus1 ue(v)for( i = 0; i < NumEntryPoints; i++ )entry_point_offset_minus1[ i ] u(v)}if( slice_header_extension_present_flag ) {slice_header_extension_length ue(v)for( i = 0; i < slice_header_extension_length; i++)slice_header_extension_data_byte[ i ] u(8)}byte_alignment( )PH RBSP semantics
[94] The PH contains information that is common for all slices of the codedpicture for which the next VCL NAL unit in decoding order is the first codedslice.
[95] pic_type indicates the characterization of the coded pictures as listed inTable 1 for the given value of pic_type. The value of pic_type shall be equal to 0to 5, inclusive, in bitstreams conforming to this version of this specification.Other values of pic_type are reserved for future use by ITU-T ISO / IEC. Decodersconforming to this version of this specification shall ignore reserved values ofpic_type.Table 1. Interpretation of pic_type
[96] pic_parameter_set_id specifies the value of pps_pic_parameter_set_idfor the PPS in use. The value of pic_parameter_set_id shall be in the range of 0 to63, inclusive.
[97] non_reference_picture_flag equal to 1 specifies the picture associatedwith the PH is never used as a reference picture. non_reference_picture_flagequal to 0 specifies the picture may or may not be used as a reference picture.
[98] colour_plane_id specifies the colour plane associated with the pictureassociated with the PH when separate_colour_plane_flag is equal to 1. The valueof colour_plane_id shall be in the range of 0 to 2, inclusive. colour_plane_idvalues 0, 1, and 2 correspond to the Y, Cb, and Cr planes, respectively. There isno dependency between the decoding processes of pictures having different valuesof colour_plane_id.
[99] pic_order_cnt_lsb specifies the picture order count moduloMaxPicOrderCntLsb for the picture associated with the PH. The length of thepic_order_cnt_lsb syntax element is log2_max_pic_order_cnt_lsb_minus4 + 4bits. The value of the pic_order_cnt_lsb shall be in the range of 0 toMaxPicOrderCntLsb - 1, inclusive.
[100] recovery_poc_cnt specifies the recovery point of decoded pictures inoutput order. If there is a picture picA that follows the current GDR picture indecoding order in the CVS and that has PicOrderCntVal equal to thePicOrderCntVal of the current GDR picture plus the value of recovery_poc_cnt,the picture picA is referred to as the recovery point picture. Otherwise, the firstpicture in output order that has PicOrderCntVal greater than the PicOrderCntValof the current picture plus the value of recovery_poc_cnt is referred to as therecovery point picture. The recovery point picture shall not precede the currentGDR picture in decoding order. The value of recovery_poc_cnt shall be in therange of 0 to MaxPicOrderCntLsb - 1, inclusive.
[101] The variable RpPicOrderCntVal is derived as follows:RpPicOrderCntVal = PicOrderCntVal + recovery_poc_cnt.
[102] no_output_of_prior_pics_flag affects the output of previously-decodedpictures in the decoded picture buffer after the decoding of a CLVSS picture thatis not the first picture in the bitstream as specified in Annex C.
[103] pic_output_flag affects the decoded picture output and removalprocesses as specified in Annex C. When pic_output_flag is not present, it isinferred to be equal to 1.
[104] pic_rpl_present_flag equals 1 specifies that RPL signaling is present inthe PH. pic_rpl_present_flag equals 0 specifies that RPL signaling is not presentin the PH and may be present in slice headers of slices of the picture. When notpresent, the value of pic_rpl_present_flag is inferred to be equal to 0. RPLsignaling is RPL information comprised in the video bitstream 500.
[105] pic_rpl_sps_flag[ i ] equal to 1 specifies that RPL i of the picture isderived based on one of the ref_pic_list_struct( listIdx, rplsIdx ) syntax structureswith listIdx equal to i in the SPS. ref_pic_list_sps_flag[ i ] equal to 0 specifiesthat reference picture list i of the picture is derived based on theref_pic_list_struct( listIdx, rplsIdx ) syntax structure with listIdx equal to i that isdirectly included in the picture header.
[106] When pic_rpl_sps_flag[ i ] is not present, the following applies: Ifnum_ref_pic_lists_in_sps[ i ] is equal to 0, the value of pic_rpl_sps_flag[ i ] isinferred to be equal to 0. Otherwise (num_ref_pic_lists_in_sps[ i ] is greater than0), if rpl1_idx_present_flag is equal to 0, the value of pic_rpl_sps_flag[ 1 ] isinferred to be equal to pic_rpl_sps_flag[ 0 ]. Otherwise, the value ofpic_rpl_sps_flag[ i ] is inferred to be equal to pps_ref_pic_list_sps_idc[ i ] - 1.
[107] pic_rpl_idx[ i ] specifies the index, into the list of theref_pic_list_struct( listIdx, rplsIdx ) syntax structures with listIdx equal to iincluded in the SPS, of the ref_pic_list_struct( listIdx, rplsIdx ) syntax structurewith listIdx equal to i that is used for derivation of RPL i of the current picture.The syntax element pic_rpl_idx[ i ] is represented by Ceil( Log2(num_ref_pic_lists_in_sps[ i ] ) ) bits. When not present, the value of pic_rpl_idx[i ] is inferred to be equal to 0. The value of pic_rpl_idx[ i ] shall be in the rangeof 0 to num_ref_pic_lists_in_sps[ i ] - 1, inclusive. When pic_rpl_sps_flag[ i ] isequal to 1 and num_ref_pic_lists_in_sps[ i ] is equal to 1, the value ofpic_rpl_idx[ i ] is inferred to be equal to 0. When pic_rpl_sps_flag[ i ] is equal to1 and rpl1_idx_present_flag is equal to 0, the value of pic_rpl_idx[ 1 ] is inferredto be equal to pic_rpl_idx[ 0 ].
[108] The variable PicRplsIdx[ i ] is derived as follows: PicRplsIdx[ i ] =pic_rpl_sps_flag[ i ] ? pic_rpl_idx[ i ] : num_ref_pic_lists_in_sps[ i ].
[109] pic_poc_lsb_lt[ i ][ j ] specifies the value of the picture order countmodulo MaxPicOrderCntLsb of the j-th LTRP entry in the i-th reference picturelist for the picture associated with the PH. The length of the pic_poc_lsb_lt[ i ][ j] syntax element is log2_max_pic_order_cnt_lsb_minus4 + 4 bits.
[110] The variable PicPocLsbLt[ i ][ j ] is derived as follows: PicPocLsbLt[ i][ j ] = ltrp_in_slice_header_flag[ i ][ PicRplsIdx[ i ] ] ? pic_poc_lsb_lt[ i ][ j ] :rpls_poc_lsb_lt[ listIdx ][ PicRplsIdx[ i ] ][ j ].
[111] pic_delta_poc_msb_present_flag[ i ][ j ] equal to 1 specifies thatpic_delta_poc_msb_cycle_lt[ i ][ j ] is present. pic_delta_poc_msb_present_flag[i ][ j ] equal to 0 specifies that pic_delta_poc_msb_cycle_lt[ i ][ j ] is not present.
[112] Let prevTid0Pic be the previous picture in decoding order that hasnuh_layer_id the same as the PH, has TemporalId equal to 0, and is not a RASLor RADL picture. Let setOfPrevPocVals be a set consisting of the following: thePicOrderCntVal of prevTid0Pic; the PicOrderCntVal of each picture that isreferred to by entries in RefPicList[ 0 ] or RefPicList[ 1 ] of prevTid0Pic and hasnuh_layer_id the same as the current picture; and the PicOrderCntVal of eachpicture that follows prevTid0Pic in decoding order, has nuh_layer_id the same asthe current picture, and precedes the current picture in decoding order.
[113] When there is more than one value in setOfPrevPocVals for which thevalue modulo MaxPicOrderCntLsb is equal to PicPocLsbLt[ i ][ j ], the value ofpic_delta_poc_msb_present_flag[ i ][ j ] shall be equal to 1.
[114] pic_delta_poc_msb_cycle_lt[ i ][ j ] specifies the value of the variablePicFullPocLt[ i ][ j ] as follows:if( j = = 0 )deltaPocMsbCycleLt[ i ][ j ] = pic_delta_poc_msb_cycle_lt[ i ][ j ]else (7 97)deltaPocMsbCycleLt[ i ][ j ] = pic_delta_poc_msb_cycle_lt[ i ][ j ] +deltaPocMsbCycleLt[ i ][ j - 1 ]PicFullPocLt[ i ][ j ] = PicOrderCntVal - deltaPocMsbCycleLt[ i ][ j ] *MaxPicOrderCntLsb -( PicOrderCntVal & ( MaxPicOrderCntLsb - 1 ) ) + PicPocLsbLt[i ][ j ]
[115] The value of pic_delta_poc_msb_cycle_lt[ i ][ j ] shall be in the rangeof 0 to 2(32 - log2_max_pic_order_cnt_lsb_minus4 - 4 ), inclusive. When notpresent, the value of pic_delta_poc_msb_cycle_lt[ i ][ j ] is inferred to be equal to0.
[116] pic_temporal_mvp_enabled_flag specifies whether temporal MVPscan be used for inter prediction. If pic_temporal_mvp_enabled_flag is equal to 0,the syntax elements of the picture associated with the picture header shall beconstrained such that no temporal MVP is used in decoding of the picture.Otherwise (pic_temporal_mvp_enabled_flag is equal to 1), temporal MVPs maybe used in decoding of the picture.
[117] When pic_temporal_mvp_enabled_flag is not present, the followingapplies: If sps_temporal_mvp_enabled_flag is equal to 0, the value ofpic_temporal_mvp_enabled_flag is inferred to be equal to 0. Otherwise(sps_temporal_mvp_enabled_flag is equal to 1), the value ofpic_temporal_mvp_enabled_flag is inferred to be equal topps_temporal_mvp_enabled_idc - 1.
[118] pic_level_joint_cbcr_sign_flag equal to 1 specifies thatslice_joint_cbcr_sign_flag is not present in slice header.pic_level_joint_cbcr_sign_flag equal to 0 specifies that slice_joint_cbcr_sign_flagmay be present in slice header. When not present, the value ofpic_level_joint_cbcr_sign_flag is inferred to be equal to 0.
[119] pic_level_alf_enabled_flag equal to 1 specifies that ALF is enabled forall slices belonging to the picture associated with the PH and may be applied to Y,Cb, or Cr colour component in the slices. pic_level_alf_enabled_flag equal to 0specifies that ALF may be disabled for one, or more, or all slices belonging to thepicture associated with the PH. When not present, pic_level_alf_enabled_flag isinferred to be equal to 0.
[120] pic_num_alf_aps_ids_luma specifies the number of ALF APSs that theslices belong to the picture associated with the PH refers to. The value ofslice_num_alf_aps_ids_luma shall be in the range of 0 to 7, inclusive.
[121] pic_alf_aps_id_luma[ i ] specifies the adaptation_parameter_set_id ofthe i-th ALF APS that the luma component of the slices of the picture associatedwith the PH refers to.
[122] pic_alf_chroma_idc equal to 0 specifies that the ALF is not applied toCb and Cr colour components. pic_alf_chroma_idc equal to 1 indicates that theALF is applied to the Cb colour component. pic_alf_chroma_idc equal to 2indicates that the ALF is applied to the Cr colour component. pic_alf_chroma_idcequal to 3 indicates that the ALF is applied to Cb and Cr colour components.When pic_alf_chroma_idc is not present, it is inferred to be equal to 0.
[123] pic_alf_aps_id_chroma specifies the adaptation_parameter_set_id ofthe ALF APS that the chroma component of the slices of the picture associatedwith the picture header refers to.
[124] pic_level_lmcs_enabled_flag equal to 1 specifies that luma mappingwith chroma scaling is enabled for all slices belonging to the picture associatedwith the picture header. pic_level_lmcs_enabled_flag equal to 0 specifies thatluma mapping with chroma scaling may be disabled for one, or more, or all slicesbelonging to the picture associated with the picture header. When not present, thevalue of pic_level_lmcs_enabled_flag is inferred to be equal to 0.
[125] pic_lmcs_aps_id specifies the adaptation_parameter_set_id of theLMCS APS that the slices of the picture associated with the picture header referto.
[126] pic_chroma_residual_scale_flag equal to 1 specifies that chromaresidual scaling is enabled for the all slices belonging to the picture associatedwith the picture header. pic_chroma_residual_scale_flag equal to 0 specifies thatchroma residual scaling may be disabled for one, or more, or all slices belongingto the picture associated with the picture header. Whenpic_chroma_residual_scale_flag is not present, it is inferred to be equal to 0.
[127] pic_level_scaling_list_present_flag equal to 1 specifies that the scalinglist data used for slices of the picture associated with the picture header is derivedbased on the scaling list data contained in the referenced scaling list APS.pic_level_scaling_list_present_flag equal to 0 specifies that the scaling list dataused for one, or more, or all slices of the picture associated with the picture headeris the default scaling list data derived specified in clause 7.4.3.16. When notpresent, the value of pic_level_scaling_list_present_flag is inferred to be equal to0.
[128] pic_scaling_list_aps_id specifies the adaptation_parameter_set_id ofthe scaling list APS.Slice Header RBSP Semantics
[129] slice_rpl_sps_flag[ i ] equal to 1 specifies that RPL i of the currentslice is derived based on one of the ref_pic_list_struct( listIdx, rplsIdx ) syntaxstructures with listIdx equal to i in the SPS. slice_rpl_sps_flag[ i ] equal to 0specifies that RPL i of the current slice is derived based on the ref_pic_list_struct(listIdx, rplsIdx ) syntax structure with listIdx equal to i that is directly included inthe slice headers of the current picture.
[130] When slice_rpl_sps_flag[ i ] is not present, the following applies: Ifpic_rpl_present_flag is equal to 1, the value of slice_rpl_sps_flag[ i ] is inferred tobe equal to pic_rpl_sps_flag[ i ]. Otherwise, if num_ref_pic_lists_in_sps[ i ] isequal to 0, the value of slice_rpl_sps_flag[ i ] is inferred to be equal to 0.Otherwise (num_r ef_pic_lists_in_sps[ i ] is greater than 0), ifrpl1_idx_present_flag is equal to 0, the value of slice_rpl_sps_flag[ 1 ] is inferredto be equal to slice_rpl_sps_flag[ 0 ]. Otherwise, the value of slice_rpl_sps_flag[i ] is inferred to be equal to pps_ref_pic_list_sps_idc[ i ] - 1.
[131] slice_rpl_idx[ i ] specifies the index, into the list of theref_pic_list_struct( listIdx, rplsIdx ) syntax structures with listIdx equal to iincluded in the SPS, of the ref_pic_list_struct( listIdx, rplsIdx ) syntax structurewith listIdx equal to i that is used for derivation of reference picture list i of thecurrent slice. The syntax element slice_rpl_idx[ i ] is represented by Ceil( Log2(num_ref_pic_lists_in_sps[ i ] ) ) bits. The value of slice_rpl_idx[ i ] shall be inthe range of 0 to num_ref_pic_lists_in_sps[ i ] - 1, inclusive. Whenslice_rpl_sps_flag[ i ] is equal to 1 and num_ref_pic_lists_in_sps[ i ] is equal to 1,the value of slice_rpl_idx[ i ] is inferred to be equal to 0. Whenslice_rpl_sps_flag[ i ] is equal to 1 and rpl1_idx_present_flag is equal to 0, thevalue of slice_rpl_idx[ 1 ] is inferred to be equal to slice_rpl_idx[ 0 ].
[132] The variable RplsIdx[ i ] is derived as follows:if( pic_rpl_present_flag )RplsIdx[ i ] = PicRplsIdx[ i ]elseRplsIdx[ i ] = slice_rpl_sps_flag[ i ] ? slice_rpl_idx[ i ] :num_ref_pic_lists_in_sps[ i ]
[133] slice_poc_lsb_lt[ i ][ j ] specifies the value of the picture order countmodulo MaxPicOrderCntLsb of the j-th LTRP entry in the i-th reference picturelist for the current slice. The length of the slice_poc_lsb_lt[ i ][ j ] syntax elementis log2_max_pic_order_cnt_lsb_minus4 + 4 bits.
[134] The variable PocLsbLt[ i ][ j ] is derived as follows:if( pic_rpl_present_flag )PocLsbLt[ i ][ j ] = PocLsbLt[ i ][ j ]elsePocLsbLt[ i ][ j ] = ltrp_in_slice_header_flag[ i ][ RplsIdx[ i ] ] ?slice_poc_lsb_lt[ i ][ j ] : rpls_poc_lsb_lt[ listIdx ][ RplsIdx[ i ] ][ j]
[135] slice_delta_poc_msb_present_flag[ i ][ j ] equal to 1 specifies thatslice_delta_poc_msb_cycle_lt[ i ][ j ] is present.slice_delta_poc_msb_present_flag[ i ][ j ] equal to 0 specifies thatslice_delta_poc_msb_cycle_lt[ i ][ j ] is not present.
[136] Let prevTid0Pic be the previous picture in decoding order that hasnuh_layer_id the same as the current picture, has TemporalId equal to 0, and isnot a RASL or RADL picture. Let setOfPrevPocVals be a set consisting of thefollowing: the PicOrderCntVal of prevTid0Pic, the PicOrderCntVal of eachpicture that is referred to by entries in RefPicList[ 0 ] or RefPicList[ 1 ] ofprevTid0Pic and has nuh_layer_id the same as the current picture, thePicOrderCntVal of each picture that follows prevTid0Pic in decoding order, hasnuh_layer_id the same as the current picture, and precedes the current picture indecoding order.
[137] When pic_rpl_present_flag is equal to 0 and there is more than onevalue in setOfPrevPocVals for which the value modulo MaxPicOrderCntLsb isequal to PocLsbLt[ i ][ j ], the value of slice_delta_poc_msb_present_flag[ i ][ j ]shall be equal to 1.
[138] slice_delta_poc_msb_cycle_lt[ i ][ j ] specifies the value of thevariable FullPocLt[ i ][ j ] as follows:if( pic_rpl_present_flag )FullPocLt[ i ][ j ] = PicFullPocLt[ i ][ j ]else {if( j = = 0 )deltaPocMsbCycleLt[ i ][ j ] =slice_delta_poc_msb_cycle_lt[ i ][ j ]elsedeltaPocMsbCycleLt[ i ][ j ] =slice_delta_poc_msb_cycle_lt[ i ][ j ] +deltaPocMsbCycleLt[ i ][ j - 1 ]FullPocLt[ i ][ j ] = PicOrderCntVal - deltaPocMsbCycleLt[ i ][ j ]* MaxPicOrderCntLsb - ( PicOrderCntVal & (MaxPicOrderCntLsb - 1 ) ) + PocLsbLt[ i ][ j ]}
[139] The value of slice_delta_poc_msb_cycle_lt[ i ][ j ] shall be in the rangeof 0 to 2(32 - log2_max_pic_order_cnt_lsb_minus4 - 4 ), inclusive. When notpresent, the value of slice_delta_poc_msb_cycle_lt[ i ][ j ] is inferred to be equalto 0.
[140] slice_joint_cbcr_sign_flag specifies whether, in transform units withtu_joint_cbcr_residual_flag[ x0 ][ y0 ] equal to 1, the co-located residual samplesof both chroma components have inverted signs. Whentu_joint_cbcr_residual_flag[ x0 ][ y0 ] equal to 1 for a transform unit,slice_joint_cbcr_sign_flag equal to 0 specifies that the sign of each residualsample of the Cr (or Cb) component is identical to the sign of the co-located Cb(or Cr) residual sample and slice_joint_cbcr_sign_flag equal to 1 specifies that thesign of each residual sample of the Cr (or Cb) component is given by the invertedsign of the co-located Cb (or Cr) residual sample. When not present, the value ofslice_joint_cbcr_sign_flag is inferred to be equal topic_level_joint_cbcr_sign_flag.
[141] slice_sao_luma_flag equal to 1 specifies that SAO is enabled for theluma component in the current slice. slice_sao_luma_flag equal to 0 specifies thatSAO is disabled for the luma component in the current slice. Whenslice_sao_luma_flag is not present, it is inferred to be equal topic_level_sao_luma_enabled_flag.
[142] slice_sao_chroma_flag equal to 1 specifies that SAO is enabled for thechroma component in the current slice. slice_sao_chroma_flag equal to 0specifies that SAO is disabled for the chroma component in the current slice.When slice_sao_chroma_flag is not present, it is inferred to be equal topic_level_sao_chroma_enabled_flag.
[143] slice_alf_enabled_flag equal to 1 specifies that ALF is enabled andmay be applied to Y, Cb, or Cr colour component in a slice.slice_alf_enabled_flag equal to 0 specifies that ALF is disabled for all colourcomponents in a slice. When not present, the value of slice_alf_enabled_flag isinferred to be equal to pic_level_alf_enabled_flag.
[144] slice_num_alf_aps_ids_luma specifies the number of ALF APSs thatthe slice refers to. When slice_alf_enabled_flag is equal to 1 andslice_num_alf_aps_ids_luma is not present, the value ofslice_num_alf_aps_ids_luma is inferred to be equal to the value ofpic_num_alf_aps_ids_luma. The value of slice_num_alf_aps_ids_luma shall bein the range of 0 to 7, inclusive.
[145] slice_alf_aps_id_luma[ i ] specifies the adaptation_parameter_set_id ofthe i-th ALF APS that the luma component of the slice refers to. The TemporalIdof the APS NAL unit having aps_params_type equal to ALF_APS andadaptation_parameter_set_id equal to slice_alf_aps_id_luma[ i ] shall be less thanor equal to the TemporalId of the coded slice NAL unit. Whenslice_alf_enabled_flag is equal to 1 and slice_alf_aps_id_luma[ i ] is not present,the value of slice_ alf_aps_id_luma[ i ] is inferred to be equal to the value ofpic_alf_aps_id_luma[ i ].
[146] For intra slices and slices in an IRAP picture, slice_alf_aps_id_luma[ i] shall not refer to an ALF APS associated with other pictures rather than thepicture containing the intra slices or the IRAP picture.
[147] slice_alf_chroma_idc equal to 0 specifies that the ALF is not appliedto Cb and Cr colour components. slice_alf_chroma_idc equal to 1 indicates thatthe ALF is applied to the Cb colour component. slice_alf_chroma_idc equal to 2indicates that the ALF is applied to the Cr colour component.slice_alf_chroma_idc equal to 3 indicates that the ALF is applied to Cb and Crcolour components. When slice_alf_chroma_idc is not present, it is inferred to beequal to pic_alf_chroma_idc.
[148] slice_alf_aps_id_chroma specifies the adaptation_parameter_set_id ofthe ALF APS that the chroma component of the slice refers to. The TemporalIdof the APS NAL unit having aps_params_type equal to ALF_APS andadaptation_parameter_set_id equal to slice_alf_aps_id_chroma shall be less thanor equal to the TemporalId of the coded slice NAL unit. Whenslice_alf_enabled_flag is equal to 1 and slice_alf_aps_id_chroma is not present,the value of slice_ alf_aps_id_chroma is inferred to be equal to the value ofpic_alf_aps_id_chroma.
[149] For intra slices and slices in an IRAP picture, slice_alf_aps_id_chromashall not refer to an ALF APS associated with other pictures rather than thepicture containing the intra slices or the IRAP picture.
[150] slice_lmcs_enabled_flag equal to 1 specifies that luma mapping withchroma scaling is enabled for the current slice. slice_lmcs_enabled_flag equal to0 specifies that luma mapping with chroma scaling is not enabled for the currentslice. When slice_lmcs_enabled_flag is not present, it is inferred to be equal topic_lmcs_enabled_flag.
[151] slice_lmcs_aps_id specifies the adaptation_parameter_set_id of theLMCS APS that the slice refers to. The TemporalId of the APS NAL unit havingaps_params_type equal to LMCS_APS and adaptation_parameter_set_id equal toslice_lmcs_aps_id shall be less than or equal to the TemporalId of the coded sliceNAL unit. When slice_lmcs_enabled_flag is equal to 1 and slice_lmcs_aps_id isnot present, the value of slice_lmcs_aps_id is inferred to be equal to the value ofpic_lmcs_aps_id.
[152] When present, the value of slice_lm cs_aps_id shall be the same for allslices of a picture.
[153] slice_chroma_residual_scale_flag equal to 1 specifies that chromaresidual scaling is enabled for the current slice. slice_chroma_residual_scale_flagequal to 0 specifies that chroma residual scaling is not enabled for the currentslice. When slice_chroma_residual_scale_flag is not present, it is inferred to beequal to pic_chroma_residual_scale_flag.
[154] slice_scaling_list_present_flag equal to 1 specifies that the scaling listdata used for the current slice is derived based on the scaling list data contained inthe referenced scaling list APS. slice_scaling_list_present_flag equal to 0specifies that the scaling list data used for the current picture is the default scalinglist data derived specified in clause 7.4.3.16. When not present, the value ofslice_scaling_list_present_flag is inferred to be equal topic_level_scaling_list_present_flag.
[155] slice_scaling_list_aps_id specifies the adaptation_parameter_set_id ofthe scaling list APS. The TemporalId of the APS NAL unit havingaps_params_type equal to SCALING_APS and adaptation_parameter_set_idequal to slice_scaling_list_aps_id shall be less than or equal to the TemporalId ofthe coded slice NAL unit. When slice_scaling_list_enabled_flag is equal to 1 andslice_scaling_list_aps_id is not present, the value of slice_scaling_list_aps_id isinferred to be equal to the value of pic_scaling_list_aps_id.
[156] FIG. 6 is a flowchart illustrating a method 600 of decoding a bitstreamaccording to a first embodiment. The decoder 400 may implement the method600. At step 610, a video bitstream comprising an RPL flag is received. The RPLflag equal to a first value specifies that RPL signaling is present in a PH. TheRPL flag equal to a second value specifies that RPL signaling is not present in thePH and may be present in slice headers. Finally, at step 620, a coded picture isdecoded using the RPL flag to obtain a decoded picture.
[157] The method 600 may implement additional embodiments. Forinstance, the first value is 1. The second value is 0. The bitstream furthercomprises an RPL SPS flag, wherein the RPL SPS flag specifies that RPL i isderived based on one of ref_pic_list_struct( listIdx, rplsIdx ) syntax structureswith listIdx equal to i in an SPS or specifies that RPL i is derived based on one ofref_pic_list_struct( listIdx, rplsIdx ) syntax structures with listIdx equal to i that isdirectly included. The bitstream further comprises an RPL index, wherein theRPL index specifies an index, into a list of ref_pic_list_struct( listIdx, rplsIdx )syntax structures with listIdx equal to i included in an SPS, of aref_pic_list_struct( listIdx, rplsIdx ) syntax structure with listIdx equal to i that isused for derivation of RPL i of a current picture. The decoded picture is displayedon a display of an electronic device.
[158] FIG. 7 is a flowchart illustrating a method 700 of encoding a bitstreamaccording to a first embodiment. The encoder 300 may implement the method700. At step 710, an RPL flag is generated. The RPL flag equal to a first valuespecifies that RPL signaling is present in a PH. The RPL flag equal to a secondvalue specifies that RPL signaling is not present in the PH and may be present inslice headers. Finally, at step 730, the video bitstream is stored forcommunication toward a video decoder.
[159] The method 700 may implement additional embodiments. Forinstance, the first value is 1. The second value is 0. An RPL SPS flag isgenerated, wherein the RPL SPS flag specifies that RPL i is derived based on oneof ref_pic_list_struct( listIdx, rplsIdx ) syntax structures with listIdx equal to i inan SPS or specifies that RPL i is derived based on one of ref_pic_list_struct(listIdx, rplsIdx ) syntax structures with listIdx equal to i that is directly included.An RPL index is generated, wherein the RPL index specifies an index, into a listof ref_pic_list_struct( listIdx, rplsIdx ) syntax structures with listIdx equal to iincluded in a sequence parameter set (SPS), of a ref_pic_list_struct( listIdx,rplsIdx ) syntax structure with listIdx equal to i that is used for derivation of RPL iof a current picture.
[160] FIG. 8 is a flowchart illustrating a method 800 of decoding a bitstreamaccording to a second embodiment. The decoder 400 may implement the method800. At step 810, a video bitstream comprising an SAO flag is received. TheSAO flag equal to a first value specifies that SAO signaling is present in a PH,and the SAO flag equal to a second value specifies that SAO signaling is notpresent in the PH and may be present in slice headers. Finally, at step 820, acoded picture is decoded using the SAO flag to obtain a decoded picture. Themethod 800 may implement additional embodiments. For instance, the decodedpicture may be displayed on a display of an electronic device.
[161] FIG. 9 is a flowchart illustrating a method 900 of encoding a bitstreamaccording to a second embodiment. The encoder 300 may implement the method900. At step 910, an SAO flag is generated. The SAO flag equal to a first valuespecifies that SAO signaling is present in a PH, and the SAO flag equal to asecond value specifies that SAO signaling is not present in the PH and may bepresent in slice headers. At step 920, the RPL flag is encoded into a videobitstream. Finally, at step 930, the video bitstream is stored for communicationtoward a video decoder.
[162] FIG. 10 is a flowchart illustrating a method 1000 of decoding abitstream according to a third embodiment. The decoder 400 may implement themethod 1000. At step 1010, a video bitstream comprising an ALF flag isreceived. The ALF flag equal to a first value specifies that ALF signaling ispresent in a PH, and the ALF flag equal to a second value specifies that ALFsignaling is not present in the PH and may be present in slice headers. Finally, atstep 1020, a coded picture is decoded using the ALF flag to obtain a decodedpicture. The method 1000 may implement additional embodiments. For instance,the decoded picture may be displayed on a display of an electronic device.
[163] FIG. 11 is a flowchart illustrating a method 1100 of encoding abitstream according to a third embodiment. The encoder 300 may implement themethod 1100. At step 1110, an ALF flag is generated. The ALF flag equal to afirst value specifies that ALF signaling is present in a PH, and the ALF flag equalto a second value specifies that ALF signaling is not present in the PH and may bepresent in slice headers. At step 1120, the ALF flag is encoded into a videobitstream. Finally, at step 1130, the video bitstream is stored for communicationtoward a video decoder.
[164] FIG. 12 is a schematic diagram of a video coding device 1200 (e.g., avideo encoder 300 or a video decoder 400) according to an embodiment of thedisclosure. The video coding device 1200 is suitable for implementing thedisclosed embodiments. The video coding device 1200 comprises ingress ports1210 and an Rx 1220 for receiving data; a processor, logic unit, or CPU 1230 toprocess the data; a Tx 1240 and egress ports 1250 for transmitting the data; and amemory 1260 for storing the data. The video coding device 1200 may alsocomprise OE components and EO components coupled to the ingress ports 1210,the receiver units 1220, the transmitter units 1240, and the egress ports 1250 foregress or ingress of optical or electrical signals.
[165] The processor 1230 is implemented by hardware and software. Theprocessor 1230 may be implemented as one or more CPU chips, cores (e.g., as amulti-core processor), FPGAs, ASICs, and DSPs. The processor 1230 is incommunication with the ingress ports 1210, Rx 120, Tx 1240, egress ports 1250,and memory 1260. The processor 1230 comprises a coding module 1270. Thecoding module 1270 implements the disclosed embodiments. For instance, thecoding module 1270 implements, processes, prepares, or provides the variouscodec functions. The inclusion of the coding module 1270 therefore provides asubstantial improvement to the functionality of the video coding device 1200 andeffects a transformation of the video coding device 1200 to a different state.Alternatively, the coding module 1270 is implemented as instructions stored in thememory 1260 and executed by the processor 1230.
[166] The video coding device 1200 may also include I / O devices 1280 forcommunicating data to and fr om a user. The I / O devices 1280 may include outputdevices such as a display for displaying video data, speakers for outputting audiodata, etc. The I / O devices 1280 may also include input devices, such as akeyboard, mouse, or trackball, or corresponding interfaces for interacting withsuch output devices.
[167] The memory 1260 comprises one or more disks, tape drives, and solidstatedrives and may be used as an over-flow data storage device, to storeprograms when such programs are selected for execution, and to store instructionsand data that are read during program execution. The memory 1260 may bevolatile and / or non-volatile and may be ROM, RAM, TCAM, or SRAM.
[168] FIG. 13 is a schematic diagram of an embodiment of a means forcoding 1300. In an embodiment, the means for coding 1300 is implemented in avideo coding device 1302 (e.g., the video encoder 300 or the video decoder 400).The video coding device 1302 includes receiving means 1301. The receivingmeans 1301 is configured to receive a picture to encode or to receive a bitstreamto decode. The video coding device 1302 includes transmission means 1307coupled to the receiving means 1301. The transmission means 1307 is configuredto transmit the bitstream to a decoder or to transmit a decoded image to a displaymeans (e.g., one of the I / O devices 1280).
[169] The video coding device 1302 includes a storage means 1303. Thestorage means 1303 is coupled to at least one of the receiving means 1301 or thetransmission means 1307. The storage means 1303 is configured to storeinstructions. The video coding device 1302 also includes processing means 1305.The processing means 1305 is coupled to the storage means 1303. The processingmeans 1305 is configured to execute the instructions stored in the storage means1303 to perform the methods disclosed herein.
[170] In an embodiment, a receiving means receives a video bitstreamcomprising an RPL flag. The RPL flag specifies that RPL signaling is present ornot present in a PH or specifies that the RPL signaling may be present in sliceheaders. A processing means decodes a coded picture using the RPL flag toobtain a decoded picture.
[171] The term "about" means a range including ±10% of the subsequentnumber unless otherwise stated. While several embodiments have been providedin the present disclosure, it may be understood that the disclosed systems andmethods might be embodied in many other specific forms without departing fromthe spirit or scope of the present disclosure. The present examples are to beconsidered as illustrative and not restrictive, and the intention is not to be limitedto the details given herein. For example, the various elements or components maybe combined or integrated in another system or certain features may be omitted, ornot implemented.
[172] In addition, techniques, systems, subsystems, and methods describedand illustrated in the various embodiments as discrete or separate may becombined or integrated with other systems, components, techniques, or methodswithout departing from the scope of the present disclosure. Other items shown ordiscussed as coupled may be directly coupled or may be indirectly coupled orcommunicating through some interface, device, or intermediate componentwhether electrically, mechanically, or otherwise. Other examples of changes,substitutions, and alterations are ascertainable by one skilled in the art and may bemade without departing from the spirit and scope disclosed herein.
Claims
1. A method implemented by a video decoder and comprising: receiving a video bitstream comprising an adaptive loop filter (ALF) flag, wherein the ALF flag equal to a first value specifies that ALF signaling is present in a picture header (PH) and not present in slice headers, and wherein the ALF flag equal to a second value specifies that ALF signaling is not present in the PH and may be present in slice headers; and decoding, by using the ALF flag, a coded picture to obtain a decoded picture.
2. The method of claim 1, wherein the first value is 1.
3. The method of claim 1 or 2, wherein the second value is 0.
4. The method of any one of claims 1-3, further comprising displaying the decoded picture on a display of an electronic device.
5. The method of any one of claims 1-4, wherein when non-picture level syntax elements are present in the PH, corresponding syntax elements shall not be present in any slice of the picture associated with the PH containing the syntax elements.
6. A method implemented by a video encoder and comprising: generating an adaptive loop filter (ALF) flag, wherein the ALF flag equal to a first value specifies that ALF signaling is present in a picture header (PH) and not present in slice headers, and wherein the ALF flag equal to a second value specifies that ALF signaling is not present in the PH and may be present in slice headers; encoding the ALF flag into a video bitstream.
7. The method of claim 6, wherein further comprises: storing, the video bitstream in a storage device for communication toward a video decoder.
8. The method of claim 6 or 7, wherein the first value is 1.
9. The method of any one of claims 6-8, wherein the second value is 0.
10. The method of any one of claims 6-9, wherein when non-picture level syntax elements are present in the PH, corresponding syntax elements shall not be present in any slice of the picture associated with the PH containing the syntax elements.
11. A video decoder comprising: a memory configured to store instructions; and a processor coupled to the memory and configured to execute the instructions to perform any one of claims 1-5.
12. A computer program product comprising computer-executable instructions for storage on a non-transitory medium and that, when executed by a processor, cause a video decoder to perform any one of claims 1-5.
13. A video encoder comprising: a memory configured to store instructions; and a processor coupled to the memory and configured to execute the instructions to perform any one of claims 6-10.
14. A computer program product comprising computer-executable instructions for storage on a non-transitory medium and that, when executed by a processor, cause a video encoder to perform any one of claims 6-10.
15. A computer-readable medium comprising a bitstream encoded by the method of any one of claims 6-10.
16. A data structure of a bitstream encoded by the method of any one of claims 6- 10, wherein the ALF flag equal to the first value causes a decoder to look for the ALF signaling in the PH and the ALF flag equal to the second value causes the decoder to look for the ALF signaling in slice headers.
17. A bitstream comprising an adaptive loop filter (ALF) flag, wherein the ALF flag equal to a first value specifies that ALF signaling is present in a picture header (PH) and not present in slice headers, and wherein the ALF flag equal to a second value specifies that ALF signaling is not present in the PH and may be present in slice headers.
18. The bitstream of any claim 17, wherein the first value is 1.
19. The bitstream of claim 17 or 18, wherein the second value is 0.
20. An apparatus for storing a bitstream, comprising one or more storage mediums and a receiver, wherein the receiver is configured to receive one or more bitstreams, wherein the bitstream comprises an adaptive loop filter (ALF) flag, wherein the ALF flag equal to a first value specifies that ALF signaling is present in a picture header (PH) and not present in slice headers, and wherein the ALF flag equal to a second value specifies that ALF signaling is not present in the PH and may be present in slice headers; wherein the one or more storage mediums are configured to store the one or more bitstreams.
21. The apparatus of claim 20, wherein further comprises a processor, configured to retrieve a bitstream from the one or more storage medium, and transmit the bitstream to another device.
22. A system for processing a bitstream, comprising: an encoding device, one or more storage devices, and a decoding device, wherein: the encoding device is configured to obtain video signal, and encode the video signal to obtain one or more bitstreams; and the bitstream comprises an adaptive loop filter (ALF) flag, wherein the ALF flag equal to a first value specifies that ALF signaling is present in a picture header (PH) and not present in slice headers, and wherein the ALF flag equal to a second value specifies that ALF signaling is not present in the PH and may be present in slice headers; the one or more storage devices are used to store the one or more bitstreams; the decoding device is used to decode the one or more bitstreams.
23. A method for storing a bitstream, comprising: receiving a bitstream through a receiver; storing the bitstream in one or more storage mediums, wherein the bitstream comprises an adaptive loop filter (ALF) flag, wherein the ALF flag equal to a first value specifies that ALF signaling is present in a picture header (PH) and not present in slice headers, and wherein the ALF flag equal to a second value specifies that ALF signaling is not present in the PH and may be present in slice headers.
24. A device for transmitting a bitstream, wherein the device comprises: at least one storage medium, configured to store at least one bitstream, wherein the bitstream comprises an adaptive loop filter (ALF) flag, wherein the ALF flag equal to a first value specifies that ALF signaling is present in a picture header (PH) and not present in slice headers, and wherein the ALF flag equal to a second value specifies that ALF signaling is not present in the PH and may be present in slice headers; at least one processor, configured to obtain one or more bitstreams from one of the at least one storage medium, and transmit the one or more bitstreams to another device.
25. A method for transmitting a bitstream, wherein the method comprises: obtaining one or more bitstreams from one of at least one storage medium, wherein the at least one storage medium storing at least one bitstream, wherein the bitstream comprises an adaptive loop filter (ALF) flag, wherein the ALF flag equal to a first value specifies that ALF signaling is present in a picture header (PH) and not present in slice headers, and wherein the ALF flag equal to a second value specifies that ALF signaling is not present in the PH and may be present in slice headers; and transmit the one or more bitstreams to another device.
