Video encoder, video decoder, methods for encoding and decoding and video data stream for realizing advanced video coding concepts

Abstract

21580276_1 (GHMatters) P120267.AU.11 Video Encoder, Video Decoder, Methods for Encoding and Decoding and Video Data Stream for realizing advanced Video Coding Concepts Abstract 5 The present invention relates to a video decoder (300) for receiving a video data stream a video stored therein, wherein the video decoder (300) is configured to decode the video from the video data stream, wherein the video decoder (300) is configured to decode the video depending on an access unit removal time of a current picture of a plurality of pictures of the video from a coded picture buffer, wherein the video decoder (300) is configured to 10 decode the video depending on an indication indicating whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture from the coded picture buffer, wherein the video decoder (300) is configured to determine whether or not to determine the access unit removal time of the current picture depending on a position of a previous non-discardable picture which precedes the current 15 picture within the video. Fig. 2 20 Video Encoder, Video Decoder, Methods for Encoding and Decoding and Video Data Stream for realizing advanced Video Coding Concepts Abstract 5 The present invention relates to a video decoder (300) for receiving a video data stream a video stored therein, wherein the video decoder (300) is configured to decode the video from the video data stream, wherein the video decoder (300) is configured to decode the video depending on an access unit removal time of a current picture of a plurality of pictures 10 of the video from a coded picture buffer, wherein the video decoder (300) is configured to decode the video depending on an indication indicating whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture from the coded picture buffer, wherein the video decoder (300) is configured to determine whether or not to determine the access unit removal time of the current picture 15 depending on a position of a previous non-discardable picture which precedes the current picture within the video. Fig. 2 20 21580276_1 (GHMatters) P120267.AU.11 20 25 20 16 83 07 M ar 2 02 5 2 0 2 5 2 0 1 6 8 3 0 7 M a r 2 0 2 5 5 (output) 200 data (input) apparatus data Fig. 2 20 25 20 16 83 07 M ar 2 02 5 w o 2 0 2 1 / 2 3 4 1 3 2 P C T / E P 2 0 2 1 / 0 6 3 5 8 7 2 / 1 0 2 0 2 5 2 0 1 6 8 3 0 7 M a r 2 0 2 5 v i d e o S U B S T I T U T E S H E E T ( R U L E 2 6 )

Description

5 The present application is a divisional application of Australian patent application no. 2023200765, which is a divisional application of Australian patent application no. 202177524, the entire content of both applications is incorporated herein by reference. 10 The present invention relates to video encoding and video decoding and, in particular, to a video encoder, to a video decoder, to methods for encoding and decoding and to a video data stream for realizing advanced video coding concepts. H.265 / HEVC (HEVC = High Efficiency Video Coding) is a video codec which already 15 provides tools for elevating or even enabling parallel processing at an encoder and / or at a decoder. For example, HEVC supports a sub-division of pictures into an array of tiles which are encoded independently from each other. Another concept supported by HEVC pertains to WPP, according to which CTU-rows or CTU-lines of the pictures may be processed in parallel from left to right, e.g. in stripes, provided that some minimum CTU offset is obeyed 20 in the processing of consecutive CTU lines (CTU = coding tree unit). It would be favorable, however, to have a video codec at hand which supports parallel processing capabilities of video encoders and / or video decoders even more efficiently. In the following, an introduction to VCL partitioning according to the state-of-the-art is 25 described (VCL = video coding layer). Typically, in video coding, a coding process of picture samples requires smaller partitions, where samples are divided into some rectangular areas for joint processing such as prediction or transform coding. Therefore, a picture is partitioned into blocks of a particular 30 size that is constant during encoding of the video sequence. In H.264 / AVC standard fixed-size blocks of 16x16 samples, so called macroblocks, are used (AVC = Advanced Video Coding). In the state-of-the-art HEVC standard (see [1]), there are Coded Tree Blocks (CTB) or 35 Coding Tree Units (CTU) of a maximum size of 64 x 64 samples. In the further description of HEVC, for such a kind of blocks, the more common term CTU is used. 2025201683   07 Mar 2025 CTUs are processed in raster scan order, starting with the top-left CTU, processing CTUs in the picture line-wise, down to the bottom-right CTU. 5 The coded CTU data is organized into a kind of container called slice. Originally, in former video coding standards, slice means a segment comprising one or more consecutive CTUs of a picture. Slices are employed for a segmentation of coded data. From another point of view, the complete picture can also be defined as one big segment and hence, historically, the term slice is still applied. Besides the coded picture samples, slices also comprise 10 additional information related to the coding process of the slice itself which is placed into a so-called slice header. According to the state-of-the-art, a VCL (video coding layer) also comprises techniques for fragmentation and spatial partitioning. Such partitioning may, e.g., be applied in video 15 coding for various reasons, among which are processing load-balancing in parallelization, CTU size matching in network transmission, error-mitigation etc. Other examples relate to Rol (Rol = Region of Interest) encodings, where there is for example a region in the middle of the picture that viewers can select e.g. with a zoom in 20 operation (decoding only the Rol), or gradual decoder refresh (GDR) in which intra data (that is typically put into one frame of a video sequence) is temporally distributed over several successive frames, e.g. as a column of intra blocks that swipes over the picture plane and resets the temporal prediction chain locally in the same fashion as an intra picture does it for the whole picture plane. For the latter, two regions exist in each picture, one that 25 is recently reset and one that is potentially affected by errors and error propagation. Reference Picture Resampling (RPR) is a technique used in video coding to adapt the quality / rate of the video not only by using a coarser quantization parameter but by adapting the resolution of potentially each transmitted picture. Thus, references used for inter 30 prediction might have a different size that the picture that is currently being predicted for encoding. Basically, RPR requires a resampling process in the prediction loop, e.g., upsampling and downsampling filters to be defined. Depending on flavor, RPR can result in a change of coded picture size at any picture, or be 35 limited to happen at only some particular picture, e.g. only at particular positions bounded for instance to segment boundaries adaptive HTTP streaming. 2025201683   07 Mar 2025 The object of the present invention is to provide improved or alternative concepts for video encoding and video decoding. 5 In accordance with a first aspect of the invention, there is provided a video decoder, wherein the video decoder is configured to decode a video of a video data stream, wherein the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more 10 coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit, wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit, wherein, if the 15 indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit, wherein the video decoder is configured to decode the video depending on said indication, wherein, if the 20 indication has the first value, then all supplemental enhancement information messages have a same payload type. In accordance with a second aspect of the invention, there is provided a video encoder, wherein the video encoder is configured to generate a video data stream comprising an 25 encoding of a video, wherein the video encoder is configured to generate the video data stream such that the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined 30 to apply to all output layer sets of a plurality of output layer sets of said access unit, wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit, wherein, if the indication has a value being different from the first value, then 35 the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of 2025201683   07 Mar 2025 said access unit applies to all output layer sets of the plurality of output layer sets of said access unit, wherein, if the indication has the first value, then all supplemental enhancement information messages have a same payload type. 5 In accordance with a third aspect of the invention, there is provided a video data stream, wherein the video data stream comprises information on a video, wherein the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more 10 coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit, wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit, wherein, if the 15 indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit, wherein, if the indication has the first value, then all supplemental enhancement information messages 20 have a same payload type. In accordance with a fourth aspect of the invention, there is provided a method for generating a video data stream comprising an encoding of a video, wherein the method comprises generating the video data stream such that the video data stream comprises an 25 indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit, wherein, if the indication has a first value, then the 30 non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit, wherein, if the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said 35 network abstraction layer unit of said access unit applies to all output layer sets of the 2025201683   07 Mar 2025 plurality of output layer sets of said access unit, wherein, if the indication has the first value, then all supplemental enhancement information messages have a same payload type. In accordance with a further aspect of the invention, an apparatus for receiving an input 5 video data stream is provided. The input video data stream has a video encoded thereinto. The apparatus is configured to generate an output video data stream from the input video data stream. Moreover, the apparatus is to determine whether a picture of the video preceding a dependent random access picture shall be output or not. 10 Moreover, a video data stream is provided. The video data stream has a video encoded thereinto. The video data stream comprises an indication that indicates whether a picture of the video preceding a dependent random access picture shall be output or not. Furthermore, a video encoder is provided. The video encoder is configured to encode a 15 video into a video data stream. Moreover, the video encoder is configured to generate the video data stream such that the video data stream comprises an indication that indicates whether a picture of the video preceding a dependent random access picture shall be output or not. 20 Moreover, a video decoder for receiving a video data stream having a video stored therein is provided. The video decoder is configured to decode the video from the video data stream. The video decoder is configured to decode the video depending on an indication indicating whether a picture of the video preceding a dependent random access picture shall be output or not. 25 Furthermore, a method for receiving an input video data stream is provided. The input video data stream has a video encoded thereinto. The method comprises generating an output video data stream from the input video data stream. Moreover, the method comprises determining whether a picture of the video preceding a dependent random access picture 30 shall be output or not. Moreover, a method for encoding a video into a video data stream is provided. The method comprises generating the video data stream such that the video data stream comprises an indication that indicates whether a picture of the video preceding a dependent random 35 access picture shall be output or not. 2025201683   07 Mar 2025 Furthermore, a method for receiving a video data stream having a video stored therein is provided. The method comprises decoding the video from the video data stream. Decoding the video is conducted depending on an indication indicating whether a picture of the video preceding a dependent random access picture shall be output or not. 5 Moreover, computer programs for implementing one of the above-described methods when being executed on a computer or signal processor are provided. In accordance with a further aspect of the invention, an apparatus for receiving one or more 10 input video data streams is provided. Each of the one or more input video data streams has an input video encoded thereinto. The apparatus is configured to generate an output video data stream from the one or more input video data streams, the output video data stream encoding an output video, wherein the apparatus is configured to generate the output video data stream such that the output video is the input video being encoded within one of the 15 one or more input video data streams, or such that the output video depends on the input video of at least one of the one or more input video data streams. Moreover, the apparatus is configured to determine an access unit removal time of a current picture of a plurality of pictures of the output video from a coded picture buffer. The apparatus is configured to determine whether or not to use coded picture buffer delay offset information for determining 20 the access unit removal time of the current picture from the coded picture buffer. Furthermore, a video data stream is provided. The video data stream has a video encoded thereinto. The video data stream comprises coded picture buffer delay offset information. 25 Furthermore, a video decoder for receiving a video data stream a video stored therein is provided. The video decoder is configured to decode the video from the video data stream. Moreover, the video decoder is configured to decode the video depending on an access unit removal time of a current picture of a plurality of pictures of the video from a coded picture buffer. The video decoder is configured to decode the video depending on an 30 indication indicating whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture from the coded picture buffer. Moreover, a method for receiving one or more input video data streams is provided. Each 35 of the one or more input video data streams has an input video encoded thereinto. The method comprises generating an output video data stream from the one or more input video 2025201683   07 Mar 2025 data streams, the output video data stream encoding an output video, wherein generating the output video data stream is conducted such that the output video is the input video being encoded within one of the one or more input video data streams, or such that the output video depends on the input video of at least one of the one or more input video data streams. 5 Moreover, the method comprises determining an access unit removal time of a current picture of a plurality of pictures of the output video from a coded picture buffer. Furthermore, the method comprises determining whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture from the coded picture buffer. 10 Furthermore, a method for encoding a video into a video data stream according to an embodiment is provided. The method comprises generating the video data stream such that the video data stream comprises coded picture buffer delay offset information. 15 Moreover, a method for receiving a video data stream a video stored therein is provided. The method comprises decoding the video from the video data stream. Decoding the video is conducted depending on an access unit removal time of a current picture of a plurality of pictures of the video from a coded picture buffer. Moreover, decoding the video is conducted depending on an indication indicating whether or not to use coded picture buffer delay offset 20 information for determining the access unit removal time of the current picture from the coded picture buffer. Furthermore, computer programs for implementing one of the above-described methods when being executed on a computer or signal processor are provided. 25 In accordance with a further aspect of the invention, a video data stream is provided. The video data stream has a video encoded thereinto. Moreover, the video data stream comprises an initial coded picture buffer removal delay. Furthermore, the video data stream comprises an initial coded picture buffer removal offset. Moreover, the video data stream 30 comprises information that indicates whether or not a sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. Furthermore, a video encoder is provided. The video encoder is configured to encode a 35 video into a video data stream. Moreover, the video encoder is configured to generate the video data stream such that the video data stream comprises an initial coded picture buffer 2025201683   07 Mar 2025 removal delay. Furthermore, the video encoder is configured to generate the video data stream such that the video data stream comprises an initial coded picture buffer removal offset. Moreover, the video encoder is configured to generate the video data stream such that the video data stream comprises information that indicates whether or not a sum of the 5 initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. Moreover, an apparatus for receiving two input video data streams, being a first input video data stream and a second input video data stream, is provided. Each of the two input video 10 data streams has an input video encoded thereinto. The apparatus is configured to generate an output video data stream from the two input video data streams, the output video data stream encoding an output video, wherein the apparatus is configured to generate an output video data stream by concatenating the first input video data stream and the second input video data stream. Moreover, the apparatus is configured to generate the output video data 15 stream such that the output video data stream comprises an initial coded picture buffer removal delay. Furthermore, the apparatus is configured to generate the output video data stream such that the output video data stream comprises an initial coded picture buffer removal offset. Moreover, the apparatus is configured to generate the output video data stream such that the output video data stream comprises information that indicates whether 20 or not a sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. Furthermore, a video decoder for receiving a video data stream a video stored therein is provided. The video decoder is configured to decode the video from the video data stream. 25 Moreover, the video data stream comprises an initial coded picture buffer removal delay. Furthermore, the video data stream comprises an initial coded picture buffer removal offset. Moreover, the video data stream comprises information that indicates whether or not a sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. Furthermore, the video 30 decoder is configured to decode the video depending on the information that indicates whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods. 35 Moreover, a method for encoding a video into a video data stream is provided. The method comprises generating the video data stream such that the video data stream comprises an 2025201683   07 Mar 2025 initial coded picture buffer removal delay. Furthermore, the method comprises generating the video data stream such that the video data stream comprises an initial coded picture buffer removal offset. Moreover, the method comprises generating the video data stream such that the video data stream comprises information that indicates whether or not a sum 5 of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. Furthermore, a method for receiving two input video data streams, being a first input video data stream and a second input video data stream, is provided. Each of the two input video 10 data streams has an input video encoded thereinto. The method comprises generating an output video data stream from the two input video data streams, the output video data stream encoding an output video, wherein the apparatus is configured to generate an output video data stream by concatenating the first input video data stream and the second input video data stream. Moreover, the method comprises generating the output video data 15 stream such that the output video data stream comprises an initial coded picture buffer removal delay. Furthermore, the method comprises generating the output video data stream such that the output video data stream comprises an initial coded picture buffer removal offset. Moreover, the method comprises generating the output video data stream such that the output video data stream comprises information that indicates whether or not a sum of 20 the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. Moreover, a method for receiving a video data stream a video stored therein is provided. The method comprises decoding the video from the video data stream. The video data 25 stream comprises an initial coded picture buffer removal delay. Moreover, the video data stream comprises an initial coded picture buffer removal offset. Furthermore, the video data stream comprises information that indicates whether or not a sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. The method comprises decoding the video 30 depending on the information that indicates whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods. Furthermore, computer programs for implementing one of the above-described methods 35 when being executed on a computer or signal processor are provided. 2025201683   07 Mar 2025 In accordance with a further aspect of the invention, a video data stream is provided. The video data stream has a video encoded thereinto. Moreover, the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an 5 access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer 10 sets of the plurality of output layer sets of said access unit. If the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. 15 Moreover, a video encoder is provided. The video encoder is configured to encode a video into a video data stream. Moreover, the video encoder is configured to generate the video data stream such that the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message 20 of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of 25 said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said 30 access unit. Furthermore, an apparatus for receiving an input video data stream is provided., The input video data stream has a video encoded thereinto. The apparatus is configured to generate an processed video data stream from the input video data stream. Moreover, the apparatus 35 is configured to generate the processed video data stream such that the processed video data stream comprises an indication indicating whether or not a non-scalable nested picture 2025201683   07 Mar 2025 timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the processed video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the indication has a first 5 value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information 10 message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. Moreover, a video decoder for receiving a video data stream having a video stored therein is provided. The video decoder is configured to decode the video from the video data 15 stream. The video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the 20 indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing 25 supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. Furthermore, a method for encoding a video into a video data stream is provided. The 30 method comprises generating the video data stream such that the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets 35 of a plurality of output layer sets of said access unit. If the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of 2025201683   07 Mar 2025 said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said 5 network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. Moreover, a method for receiving an input video data stream is provided. The input video data stream has a video encoded thereinto. The method comprises generating an 10 processed video data stream from the input video data stream. Moreover, the method comprises generating the processed video data stream such that the processed video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more 15 coded video sequences of the processed video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication has 20 a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. 25 Furthermore, a method for receiving a video data stream having a video stored therein is provided. The method comprises decoding the video from the video data stream. The video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more 30 coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication has a value 35 being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said 2025201683   07 Mar 2025 network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. Moreover, computer programs for implementing one of the above-described methods when 5 being executed on a computer or signal processor are provided. In accordance with a further aspect of the invention, a video data stream is provided. The video data stream has a video encoded thereinto. Moreover, the video data stream comprises one or more scalable nested supplemental enhancement information messages. 10 The one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream. 15 Moreover, a video encoder is provided. The video encoder is configured to encode a video into a video data stream. Moreover, the video encoder is configured to generate the video data stream such that the video data stream comprises one or more scalable nested supplemental enhancement information messages. Furthermore, the video encoder is 20 configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Moreover, the video encoder is configured to generate the video data stream such that each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement 25 information messages of the video data stream or of a portion of the video data stream. Furthermore, an apparatus for receiving an input video data stream is provided. The input video data stream has a video encoded thereinto. The apparatus is configured to generate an output video data stream from the input video data stream. The video data stream 30 comprises one or more scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data 35 stream or of a portion of the video data stream. The apparatus is configured to process the one or more scalable nested supplemental enhancement information messages. 2025201683   07 Mar 2025 Moreover, a video decoder for receiving a video data stream having a video stored therein is provided. The video decoder is configured to decode the video from the video data stream. The video data stream comprises one or more scalable nested supplemental 5 enhancement information messages. The one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream. The 10 video decoder is configured to decode the video depending on the one or more syntax elements of the plurality of syntax elements. Furthermore, a method for encoding a video into a video data stream is provided. The method comprises generating the video data stream such that the video data stream 15 comprises one or more scalable nested supplemental enhancement information messages. Moreover, the method comprises generating the video data stream such that the one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Furthermore, the method comprises generating the video data stream such that each syntax element of one or more syntax elements of the plurality of 20 syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream. Moreover, a method for receiving an input video data stream is provided. The input video 25 data stream has a video encoded thereinto. The method comprises generating an output video data stream from the input video data stream. The video data stream comprises one or more scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Each syntax element of one or more syntax elements of the 30 plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream. The method comprises processing the one or more scalable nested supplemental enhancement information messages. 35 Furthermore, a method for receiving a video data stream having a video stored therein is provided. The method comprises decoding the video from the video data stream. The video 2025201683   07 Mar 2025 data stream comprises one or more scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size 5 in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream. Decoding the video is conducted depending on the one or more syntax elements of the plurality of syntax elements. 10 Moreover, computer programs for implementing one of the above-described methods when being executed on a computer or signal processor are provided. Preferred embodiments are provided in the dependent claims. 15 In the following, embodiments of the present invention are described in detail with reference to the figures, in which: Fig. 1 illustrates a video encoder for encoding a video into a video data stream according to an embodiment. 20 Fig. 2 illustrates an apparatus for receiving an input video data stream according to an embodiment. Fig. 3 illustrates a video decoder for receiving a video data stream having a video stored therein according to an embodiment. Fig. 4 illustrates an original bitstream (depicted at the top of Fig. 4), and a bitstream 25                  after dropping pictures (depicted at the bottom of Fig. 4) according to an embodiment. Fig. 5 illustrates a splicing of two bitstreams after pictures have been dropped from the one of the two bitstreams according to an embodiment. Fig. 6         illustrates a splicing of two bitstreams according to another embodiment. Fig. 7        illustrates two sets of HRD SEIs, scalable nested SEIs and non-scalable 2025201683   07 Mar 2025 nested SEIs, in a two-layer bitstream according to an embodiment. Fig. 8         illustrates a video encoder. Fig. 9         illustrates a video decoder. 5 Fig. 10 illustrates the relationship between the reconstructed signal, e.g., the reconstructed picture, on the one hand, and the combination of the prediction residual signal as signaled in the data stream, and the prediction signal, on the other hand. 10 The following description of the figures starts with a presentation of a description of an encoder and a decoder of a block-based predictive codec for coding pictures of a video in order to form an example for a coding framework into which embodiments of the present 15 invention may be built in. The respective encoder and decoder are described with respect to Fig. 8 to Fig. 10. Thereinafter the description of embodiments of the concept of the present invention is presented along with a description as to how such concepts could be built into the encoder and decoder of Fig. 8 and Fig. 9, respectively, although the embodiments described with Fig. 1 to Fig. 3 and following, may also be used to form 20 encoders and decoders not operating according to the coding framework underlying the encoder and decoder of Fig. 8 and Fig. 9. Fig. 8 shows a video encoder, an apparatus for predictively coding a picture 12 into a data stream 14 exemplarily using transform-based residual coding. The apparatus, or encoder, 25 is indicated using reference sign 10. Fig. 9 shows a corresponding video decoder 20, e.g., an apparatus 20 configured to predictively decode the picture 12’ from the data stream 14 also using transform-based residual decoding, wherein the apostrophe has been used to indicate that the picture 12’ as reconstructed by the decoder 20 deviates from picture 12 originally encoded by apparatus 10 in terms of coding loss introduced by a quantization of 30 the prediction residual signal. Fig. 8 and Fig. 9 exemplarily use transform based prediction residual coding, although embodiments of the present application are not restricted to this kind of prediction residual coding. This is true for other details described with respect to Fig. 8 and Fig. 9, too, as will be outlined hereinafter. 2025201683   07 Mar 2025 The encoder 10 is configured to subject the prediction residual signal to spatial-to-spectral transformation and to encode the prediction residual signal, thus obtained, into the data stream 14. Likewise, the decoder 20 is configured to decode the prediction residual signal from the data stream 14 and subject the prediction residual signal thus obtained to spectral-5 to-spatial transformation. Internally, the encoder 10 may comprise a prediction residual signal former 22 which generates a prediction residual 24 so as to measure a deviation of a prediction signal 26 from the original signal, e.g., from the picture 12. The prediction residual signal former 22 10 may, for instance, be a subtractor which subtracts the prediction signal from the original signal, e.g., from the picture 12. The encoder 10 then further comprises a transformer 28 which subjects the prediction residual signal 24 to a spatial-to-spectral transformation to obtain a spectral-domain prediction residual signal 24’ which is then subject to quantization by a quantizer 32, also comprised by the encoder 10. The thus quantized prediction residual 15 signal 24” is coded into bitstream 14. To this end, encoder 10 may optionally comprise an entropy coder 34 which entropy codes the prediction residual signal as transformed and quantized into data stream 14. The prediction signal 26 is generated by a prediction stage 36 of encoder 10 on the basis of the prediction residual signal 24” encoded into, and decodable from, data stream 14. To this end, the prediction stage 36 may internally, as is 20 shown in Fig. 8, comprise a dequantizer 38 which dequantizes prediction residual signal 24” so as to gain spectral-domain prediction residual signal 24”’, which corresponds to signal 24’ except for quantization loss, followed by an inverse transformer 40 which subjects the latter prediction residual signal 24’” to an inverse transformation, e.g., a spectral-to-spatial transformation, to obtain prediction residual signal 24””, which corresponds to the 25 original prediction residual signal 24 except for quantization loss. A combiner 42 of the prediction stage 36 then recombines, such as by addition, the prediction signal 26 and the prediction residual signal 24”” so as to obtain a reconstructed signal 46, e.g., a reconstruction of the original signal 12. Reconstructed signal 46 may correspond to signal 12’. A prediction module 44 of prediction stage 36 then generates the prediction signal 26 30 on the basis of signal 46 by using, for instance, spatial prediction, e.g., intra-picture prediction, and / or temporal prediction, e.g., inter-picture prediction. Likewise, decoder 20, as shown in Fig. 9, may be internally composed of components corresponding to, and interconnected in a manner corresponding to, prediction stage 36. In 35 particular, entropy decoder 50 of decoder 20 may entropy decode the quantized spectral-domain prediction residual signal 24” from the data stream, whereupon dequantizer 52, 2025201683   07 Mar 2025 inverse transformer 54, combiner 56 and prediction module 58, interconnected and cooperating in the manner described above with respect to the modules of prediction stage 36, recover the reconstructed signal on the basis of prediction residual signal 24” so that, as shown in Fig. 9, the output of combiner 56 results in the reconstructed signal, namely 5 picture 12’. Although not specifically described above, it is readily clear that the encoder 10 may set some coding parameters including, for instance, prediction modes, motion parameters and the like, according to some optimization scheme such as, for instance, in a manner 10 optimizing some rate and distortion related criterion, e.g., coding cost. For example, encoder 10 and decoder 20 and the corresponding modules 44, 58, respectively, may support different prediction modes such as intra-coding modes and inter-coding modes. The granularity at which encoder and decoder switch between these prediction mode types may correspond to a subdivision of picture 12 and 12’, respectively, into coding segments or 15 coding blocks. In units of these coding segments, for instance, the picture may be subdivided into blocks being intra-coded and blocks being inter-coded. Intra-coded blocks are predicted on the basis of a spatial, already coded / decoded neighborhood of the respective block as is outlined in more detail below. Several intra-coding modes may exist and be selected for a respective intra-coded segment including directional or angular intra-20 coding modes according to which the respective segment is filled by extrapolating the sample values of the neighborhood along a certain direction which is specific for the respective directional intra-coding mode, into the respective intra-coded segment. The intracoding modes may, for instance, also comprise one or more further modes such as a DC coding mode, according to which the prediction for the respective intra-coded block assigns 25 a DC value to all samples within the respective intra-coded segment, and / or a planar intracoding mode according to which the prediction of the respective block is approximated or determined to be a spatial distribution of sample values described by a two-dimensional linear function over the sample positions of the respective intra-coded block with driving tilt and offset of the plane defined by the two-dimensional linear function on the basis of the 30 neighboring samples. Compared thereto, inter-coded blocks may be predicted, for instance, temporally. For inter-coded blocks, motion vectors may be signaled within the data stream, the motion vectors indicating the spatial displacement of the portion of a previously coded picture of the video to which picture 12 belongs, at which the previously coded / decoded picture is sampled in order to obtain the prediction signal for the respective inter-coded 35 block. This means, in addition to the residual signal coding comprised by data stream 14, such as the entropy-coded transform coefficient levels representing the quantized spectral- 2025201683   07 Mar 2025 domain prediction residual signal 24”, data stream 14 may have encoded thereinto coding mode parameters for assigning the coding modes to the various blocks, prediction parameters for some of the blocks, such as motion parameters for inter-coded segments, and optional further parameters such as parameters for controlling and signaling the 5 subdivision of picture 12 and 12’, respectively, into the segments. The decoder 20 uses these parameters to subdivide the picture in the same manner as the encoder did, to assign the same prediction modes to the segments, and to perform the same prediction to result in the same prediction signal. 10 Fig. 10 illustrates the relationship between the reconstructed signal, e.g., the reconstructed picture 12’, on the one hand, and the combination of the prediction residual signal 24”” as signaled in the data stream 14, and the prediction signal 26, on the other hand. As already denoted above, the combination may be an addition. The prediction signal 26 is illustrated in Fig. 10 as a subdivision of the picture area into intra-coded blocks which are illustratively 15 indicated using hatching, and inter-coded blocks which are illustratively indicated nothatched. The subdivision may be any subdivision, such as a regular subdivision of the picture area into rows and columns of square blocks or non-square blocks, or a multi-tree subdivision of picture 12 from a tree root block into a plurality of leaf blocks of varying size, such as a quadtree subdivision or the like, wherein a mixture thereof is illustrated in Fig. 10 20 in which the picture area is first subdivided into rows and columns of tree root blocks which are then further subdivided in accordance with a recursive multi-tree subdivisioning into one or more leaf blocks. Again, data stream 14 may have an intra-coding mode coded thereinto for intra-coded 25 blocks 80, which assigns one of several supported intra-coding modes to the respective intra-coded block 80. For inter-coded blocks 82, the data stream 14 may have one or more motion parameters coded thereinto. Generally speaking, inter-coded blocks 82 are not restricted to being temporally coded. Alternatively, inter-coded blocks 82 may be any block predicted from previously coded portions beyond the current picture 12 itself, such as 30 previously coded pictures of a video to which picture 12 belongs, or picture of another view or an hierarchically lower layer in the case of encoder and decoder being scalable encoders and decoders, respectively. The prediction residual signal 24”” in Fig. 10 is also illustrated as a subdivision of the picture 35 area into blocks 84. These blocks might be called transform blocks in order to distinguish same from the coding blocks 80 and 82. In effect, Fig. 10 illustrates that encoder 10 and 2025201683   07 Mar 2025 decoder 20 may use two different subdivisions of picture 12 and picture 12’, respectively, into blocks, namely one subdivisioning into coding blocks 80 and 82, respectively, and another subdivision into transform blocks 84. Both subdivisions might be the same, e.g., each coding block 80 and 82, may concurrently form a transform block 84, but Fig. 10 5 illustrates the case where, for instance, a subdivision into transform blocks 84 forms an extension of the subdivision into coding blocks 80,82 so that any border between two blocks of blocks 80 and 82 overlays a border between two blocks 84, or alternatively speaking each block 80, 82 either coincides with one of the transform blocks 84 or coincides with a cluster of transform blocks 84. However, the subdivisions may also be determined or 10 selected independent from each other so that transform blocks 84 could alternatively cross block borders between blocks 80, 82. As far as the subdivision into transform blocks 84 is concerned, similar statements are thus true as those brought forward with respect to the subdivision into blocks 80, 82, e.g., the blocks 84 may be the result of a regular subdivision of picture area into blocks (with or without arrangement into rows and columns), the result 15 of a recursive multi-tree subdivisioning of the picture area, or a combination thereof or any other sort of blockation. Just as an aside, it is noted that blocks 80, 82 and 84 are not restricted to being of quadratic, rectangular or any other shape. Fig. 10 further illustrates that the combination of the prediction signal 26 and the prediction 20 residual signal 24”” directly results in the reconstructed signal 12’. However, it should be noted that more than one prediction signal 26 may be combined with the prediction residual signal 24”” to result into picture 12’ in accordance with alternative embodiments. In Fig. 10, the transform blocks 84 shall have the following significance. Transformer 28 and 25 inverse transformer 54 perform their transformations in units of these transform blocks 84. For instance, many codecs use some sort of DST or DCT for all transform blocks 84. Some codecs allow for skipping the transformation so that, for some of the transform blocks 84, the prediction residual signal is coded in the spatial domain directly. However, in accordance with embodiments described below, encoder 10 and decoder 20 are configured 30 in such a manner that they support several transforms. For example, the transforms supported by encoder 10 and decoder 20 could comprise: o      DCT-II (or DCT-III), where DCT stands for Discrete Cosine Transform o     DST-IV, where DST stands for Discrete Sine Transform 35 o     DCT-IV o     DST-VII 2025201683   07 Mar 2025 o Identity Transformation (IT) Naturally, while transformer 28 would support all of the forward transform versions of these transforms, the decoder 20 or inverse transformer 54 would support the corresponding 5 backward or inverse versions thereof: o Inverse DCT-II (or inverse DCT-III) o     Inverse DST-IV o     Inverse DCT-IV 10 o      Inverse DST-VII o      Identity Transformation (IT) The subsequent description provides more details on which transforms could be supported by encoder 10 and decoder 20. In any case, it should be noted that the set of supported 15 transforms may comprise merely one transform such as one spectral-to-spatial or spatial-to-spectral transform. As already outlined above, Fig. 8 to Fig. 10 have been presented as an example where the inventive concept described further below may be implemented in order to form specific 20 examples for encoders and decoders according to the present application. Insofar, the encoder and decoder of Fig. 8 and Fig. 9, respectively, may represent possible implementations of the encoders and decoders described herein below. Fig. 8 and Fig. 9 are, however, only examples. An encoder according to embodiments of the present application may, however, perform block-based encoding of a picture 12 using the concept 25 outlined in more detail below and being different from the encoder of Fig. 8 such as, for instance, in that same is no video encoder, but a still picture encoder, in that same does not support inter-prediction, or in that the sub-division into blocks 80 is performed in a manner different than exemplified in Fig. 10. Likewise, decoders according to embodiments of the present application may perform block-based decoding of picture 12’ from data stream 14 30 using the coding concept further outlined below, but may differ, for instance, from the decoder 20 of Fig. 9 in that same is no video decoder, but a still picture decoder, in that same does not support intra-prediction, or in that same sub-divides picture 12’ into blocks in a manner different than described with respect to Fig. 10 and / or in that same does not derive the prediction residual from the data stream 14 in transform domain, but in spatial 35 domain, for instance. 2025201683   07 Mar 2025 Fig. 1 illustrates a video encoder 100 for encoding a video into a video data stream according to an embodiment. The video encoder 100 is configured to generate the video data stream such that the video data stream comprises an indication that indicates whether a picture of the video preceding a dependent random access picture shall be output or not. 5 Fig. 2 illustrates an apparatus 200 for receiving an input video data stream according to an embodiment. The input video data stream has a video encoded thereinto. The apparatus 200 is configured to generate an output video data stream from the input video data stream. 10 Fig. 3 illustrates a video decoder 300 for receiving a video data stream having a video stored therein according to an embodiment. The video decoder 300 is configured to decode the video from the video data stream. The video decoder 300 is configured to decode the video depending on an indication indicating whether a picture of the video preceding a dependent random access picture shall be output or not. 15 Moreover, a system according to an embodiment is provided. The system comprises the apparatus of Fig. 2 and the video decoder of Fig. 3. The video decoder 300 of Fig. 3 is configured to receive the output video data stream of the apparatus of Fig. 2. The video decoder 300 of Fig. 3 is configured to decode the video from the output video data stream 20 of the apparatus 200 of Fig. 2. In an embodiment, the system may, e.g., further comprise a video encoder 100 of Fig. 1. The apparatus 200 of Fig. 2 may, e.g., be configured to receive the video data stream from the video encoder 100 of Fig. 1 as the input video data stream. 25 The (optional) intermediate device 210 of the apparatus 200 may, e.g., be configured to receive the video data stream from the video encoder 100 as an input video data stream and to generate an output video data stream from the input video data stream. For example, the intermediate device may, e.g., be configured to modify (header / meta data) information 30 of the input video data stream and / or may, e.g., be configured to delete pictures from the input video data stream and / or may configured to mix / splice the input video data stream with an additional second bitstream having a second video encoded thereinto. The (optional) video decoder 221 may, e.g., be configured to decode the video from the 35 output video data stream. 2025201683   07 Mar 2025 The (optional) Hypothetical Reference Decoder 222 may, e.g., be configured to determine timing information for the video depending on the output video data stream, or may, e.g., be configured to determine buffer information for a buffer into which the video or a portion of the video is to be stored. 5 The system comprises the video encoder 101 of Fig. 1 and the video decoder 151 of Fig. 2. The video encoder 101 is configured to generate the encoded video signal. The video 10 decoder 151 is configured to decode the encoded video signal to reconstruct the picture of the video. In the following, the first aspect of the invention is now described in detail. 15 In accordance with the first aspect of the invention, an apparatus 200 for receiving an input video data stream is provided. The input video data stream has a video encoded thereinto. The apparatus 200 is configured to generate an output video data stream from the input video data stream. Moreover, the apparatus 200 is to determine whether a picture of the video preceding a dependent random access picture shall be output or not. 20 According to an embodiment, the apparatus 200 may, e.g., be configured to determine a first variable (e.g., a NoOutputBeforeDrapFlag) indicating whether the picture of the video that precedes the dependent random access picture shall be output or not. 25 In an embodiment, the apparatus 200 may, e.g., be configured to generate the output video data stream such that the output video data stream may, e.g., comprise an indication that may, e.g., indicate whether the picture of the video preceding the dependent random access picture shall be output or not. 30 According to an embodiment, the apparatus 200 may, e.g., be configured to generate the output video data stream such that the output video data stream may, e.g., comprise supplemental enhancement information comprising the indication that may, e.g., indicate whether the picture of the video preceding the dependent random access picture shall be output or not. 35 2025201683   07 Mar 2025 In an embodiment, the picture of the video that precedes the dependent random access picture may, e.g., be an independent random access picture. The apparatus 200 may, e.g., be configured to generate the output video data stream such that the output video data stream may, e.g., comprise a flag (e.g., a ph_pic_output_flag) having a predefined value 5   (e.g., 0) in a picture header of the independent random access picture, such that the predefined value (e.g., 0) of the flag (e.g., a ph_pic_output_flag) may, e.g., indicate for the independent random access picture directly precedes said dependent random access picture within the video data stream, and that said independent random access picture shall not be output. 10 According to an embodiment, the flag may, e.g., be a first flag, wherein the apparatus 200 may, e.g., be configured to generate the output video data stream such that the output video data stream may, e.g., comprise a further flag in a picture parameter set of the video data stream, wherein the further flag may, e.g., indicate whether or not the first flag (e.g., a 15 ph_pic_output_flag) exists in the picture header of the independent random access picture. In an embodiment, the apparatus 200 may, e.g., be configured to generate the output video data stream such that the output video data stream may, e.g., comprise as the indication that may, e.g., indicate whether the picture of the video preceding the dependent random 20 access picture shall be output or not a supplemental enhancement information flag within a supplemental enhancement information of the output video data stream, or a picture parameter set flag within a picture parameter set of the output video data stream, or a sequence parameter set flag within a sequence parameter set of the output video data stream, or an external means flag, wherein a value of the external means flag may, e.g., be 25 set by an external unit being external to the apparatus 200. According to an embodiment, the apparatus 200 may, e.g., be configured to determine a value of a second variable (e.g., a PictureOutputFlag) for the picture of the video that precedes the dependent random access picture depending on the first variable (e.g., a 30 NoOutputBeforeDrapFlag), wherein the second variable (e.g., a PictureOutputFlag) may, e.g., indicate for said picture whether said picture shall be output or not, and wherein the apparatus 200 may, e.g., be configured to output or to not output said picture depending on the second variable (e.g., a PictureOutputFlag). 35 In an embodiment, the picture of the video that precedes the dependent random access picture may, e.g., be an independent random access picture. The first variable (e.g., a 2025201683   07 Mar 2025 NoOutputBeforeDrapFlag) may, e.g., indicate that the independent random access picture shall not be output. According to an embodiment, the picture of the video that precedes the dependent random 5 access picture may, e.g., be an independent random access picture. The apparatus 200 may, e.g., be configured to set the first variable (e.g., a NoOutputBeforeDrapFlag) such that the first variable (e.g., a NoOutputBeforeDrapFlag) may, e.g., indicate that the independent random access picture shall be output. 10 In an embodiment, the apparatus 200 may, e.g., be configured to signal to a video decoder 300, whether a picture of the video preceding a dependent random access picture shall be output or not. Moreover, a video data stream is provided. The video data stream has a video encoded 15 thereinto. The video data stream comprises an indication that indicates whether a picture of the video preceding a dependent random access picture shall be output or not. According to an embodiment, the video data stream may, e.g., comprise supplemental enhancement information comprising the indication that may, e.g., indicate whether the 20 picture of the video preceding the dependent random access picture shall be output or not. In an embodiment, the picture of the video that precedes the dependent random access picture may, e.g., be an independent random access picture. The video data stream may, e.g., comprise a flag (e.g., a ph_pic_output_flag) having a predefined value (e.g., 0) in a 25 picture header of the independent random access picture, such that the predefined value (e.g., 0) of the flag (e.g., a ph_pic_output_flag) may, e.g., indicate for the independent random access picture directly precedes said dependent random access picture within the video data stream, and that said independent random access picture shall not be output. 30 According to an embodiment, the flag may, e.g., be a first flag, wherein the video data stream may, e.g., comprise a further flag in a picture parameter set of the video data stream, wherein the further flag may, e.g., indicate whether or not the first flag (e.g., a ph_pic_output_flag) exists in the picture header of the independent random access picture. 35 In an embodiment, the video data stream may, e.g., comprise as the indication that may, e.g., indicate whether the picture of the video preceding the dependent random access 2025201683   07 Mar 2025 picture shall be output or not a supplemental enhancement information flag within a supplemental enhancement information of the output video data stream, or a picture parameter set flag within a picture parameter set of the output video data stream, or a sequence parameter set flag within a sequence parameter set of the output video data 5 stream, or an external means flag, wherein a value of the external means flag may, e.g., be set by an external unit being external to an apparatus 200. Furthermore, a video encoder 100 is provided. The video encoder 100 may, e.g., be configured to encode a video into a video data stream. Moreover, the video encoder 100 10 may, e.g., be configured to generate the video data stream such that the video data stream comprises an indication that indicates whether a picture of the video preceding a dependent random access picture shall be output or not. According to an embodiment, the video encoder 100 may, e.g., be configured to generate 15 the video data stream such that the video data stream may, e.g., comprise supplemental enhancement information comprising the indication that may, e.g., indicate whether the picture of the video preceding the dependent random access picture shall be output or not. In an embodiment, the picture of the video that precedes the dependent random access 20 picture may, e.g., be an independent random access picture. The video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise a flag (e.g., a ph_pic_output_flag) having a predefined value (e.g., 0) in a picture header of the independent random access picture, such that the predefined value (e.g., 0) of the flag (e.g., a ph_pic_output_flag) may, e.g., indicate for the independent 25 random access picture directly precedes said dependent random access picture within the video data stream, and that said independent random access picture shall not be output. According to an embodiment, the flag may, e.g., be a first flag, wherein the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data 30 stream may, e.g., comprise a further flag in a picture parameter set of the video data stream, wherein the further flag may, e.g., indicate whether or not the first flag (e.g., a ph_pic_output_flag) exists in the picture header of the independent random access picture. In an embodiment, the video encoder 100 may, e.g., be configured to generate the video 35 data stream such that the video data stream may, e.g., comprise as the indication that may, e.g., indicate whether the picture of the video preceding the dependent random access 2025201683   07 Mar 2025 picture shall be output or not a supplemental enhancement information flag within a supplemental enhancement information of the output video data stream, or a picture parameter set flag within a picture parameter set of the output video data stream, or a sequence parameter set flag within a sequence parameter set of the output video data 5 stream, or an external means flag, wherein a value of the external means flag may, e.g., be set by an external unit being external to an apparatus 200. Moreover, a video decoder 300 for receiving a video data stream having a video stored therein is provided. The video decoder 300 is configured to decode the video from the video 10 data stream. The video decoder 300 is configured to decode the video depending on an indication indicating whether a picture of the video preceding a dependent random access picture shall be output or not. According to an embodiment, the video decoder 300 may, e.g., be configured to decode 15 the video depending on a first variable (e.g., a NoOutputBeforeDrapFlag) indicating whether the picture of the video that precedes the dependent random access picture shall be output or not. In an embodiment, the video data stream may, e.g., comprise the indication that may, e.g., 20 indicate whether the picture of the video preceding the dependent random access picture shall be output or not. The video decoder 300 may, e.g., be configured to decode the video depending on the indication within the video data stream. According to an embodiment, the video data stream may, e.g., comprise supplemental 25 enhancement information comprising the indication that may, e.g., indicate whether the picture of the video preceding the dependent random access picture shall be output or not. The video decoder 300 may, e.g., be configured to decode the video depending on the supplemental enhancement information. 30 In an embodiment, the picture of the video that precedes the dependent random access picture may, e.g., be an independent random access picture. The video data stream may, e.g., comprise a flag (e.g., a ph_pic_output_flag) having a predefined value (e.g., 0) in a picture header of the independent random access picture, such that the predefined value (e.g., 0) of the flag (e.g., a ph_pic_output_flag) may, e.g., indicate for the independent 35 random access picture directly precedes said dependent random access picture within the 2025201683   07 Mar 2025 video data stream, and that said independent random access picture shall not be output. The video decoder 300 may, e.g., be configured to decode the video depending on the flag. According to an embodiment, the flag may, e.g., be a first flag, wherein the video data 5 stream may, e.g., comprise a further flag in a picture parameter set of the video data stream, wherein the further flag may, e.g., indicate whether or not the first flag (e.g., a ph_pic_output_flag) exists in the picture header of the independent random access picture. The video decoder 300 may, e.g., be configured to decode the video depending on the further flag. 10 In an embodiment, the video data stream may, e.g., comprise as the indication that may, e.g., indicate whether the picture of the video preceding the dependent random access picture shall be output or not a supplemental enhancement information flag within a supplemental enhancement information of the output video data stream, or a picture 15 parameter set flag within a picture parameter set of the output video data stream, or a sequence parameter set flag within a sequence parameter set of the output video data stream, or an external means flag, wherein a value of the external means flag may, e.g., be set by an external unit being external to an apparatus 200. The video decoder 300 may, e.g., be configured to decode the video depending on the indication within the video data 20 stream. According to an embodiment, the video decoder 300 may, e.g., be configured to reconstruct the video from the video data stream. The video decoder 300 may, e.g., be configured to output or to not output the picture of the video that precedes the dependent random access 25 picture depending on the first variable (e.g., a NoOutputBeforeDrapFlag). In an embodiment, the video decoder 300 may, e.g., be configured to determine a value of a second variable (e.g., a PictureOutputFlag) for the picture of the video that precedes the dependent random access picture depending on the first variable (e.g., a 30 NoOutputBeforeDrapFlag), wherein the second variable (e.g., a PictureOutputFlag) may, e.g., indicate for said picture whether said picture shall be output or not, and wherein the apparatus 200 may, e.g., be configured to output or to not output said picture depending on the second variable (e.g., a PictureOutputFlag). 35 According to an embodiment, the picture of the video that precedes the dependent random access picture may, e.g., be an independent random access picture. The video decoder 2025201683   07 Mar 2025 300 may, e.g., be configured to decode the video depending on the first variable (e.g., a NoOutputBeforeDrapFlag) which may, e.g., indicate that the independent random access picture shall not be output. 5 In an embodiment, the picture of the video that precedes the dependent random access picture may, e.g., be an independent random access picture. The video decoder 300 may, e.g., be configured to decode the video depending on the first variable (e.g., a NoOutputBeforeDrapFlag) which may, e.g., indicate that the independent random access picture shall be output. 10 Furthermore, a system is provided. The system comprises an apparatus 200 as described above and a video decoder 300 as described above. The video decoder 300 is configured to receive the output video data stream of the apparatus 200. Moreover, the video decoder 300 is configured to decode the video from the output video data stream of the apparatus 15   200. According to an embodiment, the system may, e.g., further comprise a video encoder 100. The apparatus 200 may, e.g., be configured to receive the video data stream from the video encoder 100 as the input video data stream. 20 In particular, the first aspect of the invention relates to CVS start at DRAP and to omit IDR output in decoding and conformance testing. When a bitstream comprises pictures marked as DRAP (i.e. only using the previous IRAP 25 as reference for the DRAP and from there on in the bitstream) it is possible to utilize these DRAP pictures for random access functionality at lower rate overhead. However, when using some target DRAP for random accessing a stream, it is undesirable to display any initial picture before the target DRAP (i.e. the associated IRAP of target DRAP) at the decoder output as the temporal distance between these pictures would lead to a 30 shacky / jittery video playback when played back at the rate of the original video until the video is played back in a smooth way from the target DRAP on. Therefore, it is desirable to omit the output of the pictures preceding the DRAP picture. This aspect of the invention presents means to control the decoder accordingly. 35 2025201683   07 Mar 2025 In one embodiment, an external means to set the PicOutputFlag variable of an IRAP picture is made available for implementations to use as follows: - If some external means not specified in this Specification is available to set the 5               variable NoOutputBeforeDrapFlag for the picture to a value, NoOutputBeforeDrapFlag for the picture is set equal to the value provided by the external means. [■•■] - The variable PictureOutputFlag of the current picture is derived as follows: 10           - If sps_video_parameter_set_id is greater than 0 and the current layer is not an output layer (i.e., nuh layer id is not equal to OutputLayerIdInOls[ TargetOlsIdx ][ i ] for any value of i in the range of 0 to NumOutputLayersInOls[ TargetOlsIdx ] - 1, inclusive), or one of the following conditions is true, PictureOutputFlag is set equal to 0: 15             - The current picture is a RASL picture and NoOutputBeforeRecoveryFlag of the associated IRAP picture is equal to 1. - The current picture is a GDR picture with NoOutputBeforeRecoveryFlag equal to 1 or is a recovering picture of a GDR picture with NoOutputBeforeRecoveryFlag equal to 1. 20              - The current picture is a IRAP picture with NoOutputBeforeDrapFlag equal to 1. - Otherwise, PictureOutputFlag is set equal to ph_pic_output_flag. 25 In another embodiment, the NoOutputBeforeDrapFlag is set by external means only for the first IRAP picture in a CVS, and set to 0 otherwise. - If some external means not specified in this Specification is available to set the variable NoOutputBeforeDrapFlag for the picture to a value, 30               NoOutputBeforeDrapFlag for the first picture in the CVS is set equal to the value provided by the external means. Otherwise, NoOutputBeforeDrapFlag is set to 0. 2025201683   07 Mar 2025 The above mentioned flag NoOutputBeforeDrapFlag could also be associated with the usage of alternative HRD timings conveyed in the bitstream for the case of removal of pictures between the IRAP picture and the DRAP picture, e.g. a the flag UseAltCpbParamsFlag in the WC specification. 5 In an alternative embodiment, it is a constraint that IRAP pictures that directly precede DRAP pictures without non-DRAP pictures in between shall have a value of 0 in the output flag ph_pic_output flag in the picture header. In this case, whenever an extractor or player uses a DRAP for random accessing, i.e. it removes intermediate pictures between IRAP 10 and DRAP from the bitstream, it is also required to verify or adjust that the respective output flag is set to 0 and output of the IRAP is omitted. For this operation to be simple the original bitstream needs to be prepareed correspondingly. More concretely, pps output_flag_present flag, which determines the 15 presence of the flag ph_pic_output flag in the picture header shall be equal to 1 so that the picture header can be easily change and it is not required to change also parameter sets. That is: It is a requirement of bitstream conformance that the value of pps_output_flag_present_flag 20 shall be equal to 1 if the PPS is referred to by a picture within a CVSS AU that has associated DRAP AUs. In addition to the options listed above, in another embodiment, it is indicated in a parameter set PPS or an SPS whether the first AU in the bitstream, i.e. a CRA or IDR that constitutes 25 a CLVS start, is to be output or not after decoding. Thus, the system integration is simpler, as only a parameter set needs to be adjusted instead of requiring comparatively low-level syntax such as a PHs also to be changed, e.g. when parsing a file in file format ISOBMFF. An example is shown in the following: 30 seq_parameter_set_rbsp( ) { Descript or if( sps conformance window flag ) { spsconfwinleftoffset ue(v) spsconfwinrightoffset ue(v) 2025201683   07 Mar 2025 spsconfwintopoffset ue(v) spsconfwinbottomoffset ue(v) } sps_pic_in_cvss_au_no_output_flag u(l) sps_log2_ctu_size_minus5 u(2) [...I } sps_pic_in_cvss_au_no_output_flag equal to 1 specifies that a picture in a CVSS AU referring to the SPS is not ouput. sps_pic_in_cvss_au_no_output_flag equal to 0 specifies that a picture in a CVSS AU referring to the SPS may or may not be ouput. 5 It is a requirement of bitstream conformance that the value of sps_pic_in_cvss_au_no_output_flag shall be the same for any SPS referred to by any output layer in an OLS. In 8.1.2 - The variable PictureOutputFlag of the current picture is derived as follows: 10               - If sps_video_parameter_set_id is greater than 0 and the current layer is not an output layer (i.e., nuhlayerid is not equal to OutputLayerIdInOls[ TargetOlsIdx ][ i ] for any value of i in the range of 0 to NumOutputLayersInOls[ TargetOlsIdx ] - 1, inclusive), or one of the following conditions is true, PictureOutputFlag is set equal to 0: 15                  - The current picture is a RASL picture and NoOutputBeforeRecoveryFlag of the associated IRAP picture is equal to 1. - The current picture is a GDR picture with NoOutputBeforeRecoveryFlag equal to 1 or is a recovering picture of a GDR picture with NoOutputBeforeRecoveryFlag equal to 1. 20              - Otherwise, if the current AU is a CVSS AU and sps_pic_in_cvss_au_no_output_flag equal to 1 PictureOutputFlag is set equal to 0. - Otherwise, PictureOutputFlag is set equal to ph_pic_output_flag. NOTE - In an implementation, the decoder could output a picture not 25                       belonging to an output layer. For example, when there is only one output layer while in an AU the picture of the output layer is not available, e.g., due to a loss or layer down-switching, the decoder could set PictureOutputFlag set equal to 1 for the picture that has the highest value of nuh layer id among all pictures of the AU available to the 30                       decoder and having ph_pic_output_flag equal to 1, and set PictureOutputFlag equal to 0 for all other pictures of the AU available to the decoder. In another embodiment, for example, a requirement may, e.g., be defined as follows: 2025201683   07 Mar 2025 It is a requirement of bitstream conformance that the value of ph_pic_output_flag shall be equal to 0 if the a picture belongs to a IRAP AU and the IRAP AU is directly preceding a DRAP AU. 5 In the following, the second aspect of the invention is now described in detail. In accordance with the second aspect of the invention, an apparatus 200 for receiving one or more input video data streams is provided. Each of the one or more input video data 10 streams has an input video encoded thereinto. The apparatus 200 is configured to generate an output video data stream from the one or more input video data streams, the output video data stream encoding an output video, wherein the apparatus is configured to generate the output video data stream such that the output video is the input video being encoded within one of the one or more input video data streams, or such that the output video depends on 15 the input video of at least one of the one or more input video data streams. Moreover, the apparatus 200 is configured to determine an access unit removal time of a current picture of a plurality of pictures of the output video from a coded picture buffer. The apparatus 200 is configured to determine whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture from the coded picture 20 buffer. According to an embodiment, the apparatus 200 may, e.g., be configured to drop a group of one or more pictures of the input video of a first video data stream of the one or more input video data streams to generate the output video data stream. The apparatus 200 may, 25   e.g., be configured to determine an access unit removal time for at least one of the plurality of pictures of the output video from the coded picture buffer depending on the coded picture buffer delay offset information. In an embodiment, the first video received by the apparatus 200 may, e.g., be a 30 preprocessed video which results from an original video from which a group of one or more pictures has been dropped to generate the preprocessed video. The apparatus 200 may, e.g., be configured to determine an access unit removal time for at least one of the plurality of pictures of the output video from the coded picture buffer depending on the coded picture buffer delay offset information. 35 2025201683   07 Mar 2025 According to an embodiment, the buffer delay offset information depends on a number of pictures of the input video that have been dropped. In an embodiment, the one or more input video data streams are two or more input video 5 data streams. The apparatus 200 may, e.g., be configured to splice the processed video and the input video of a second video data stream of the two or more input video data streams to obtain the output video, and may, e.g., be configured to encode the output video into the output video data stream. 10 According to an embodiment, the apparatus 200 may, e.g., be configured to determine whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture depending on a location of the current picture within the output video. Or, the apparatus 200 may, e.g., be configured to determine whether or not to set a coded picture buffer delay offset value of the coded picture buffer 15 delay offset information to 0 for determining the access unit removal time of the current picture depending on the location of the current picture within the output video. In an embodiment, the apparatus 200 may, e.g., be configured to determine whether or not to use coded picture buffer delay offset information for determining the access unit removal 20 time of the current picture depending on a position of a previous non-discardable picture which precedes the current picture within the output video. According to an embodiment, the apparatus 200 may, e.g., be configured to determine whether or not to use coded picture buffer delay offset information for determining the 25 access unit removal time of the current picture depending on whether or not the previous non-discardable picture which precedes the current picture within the output video may, e.g., be a first picture in a previous buffering period. In an embodiment, the apparatus 200 may, e.g., be configured to determine whether or not 30 to use coded picture buffer delay offset information for determining the access unit removal time of the current picture depending on a concatenation flag, the current picture being a first picture of the input video of the second video data stream. According to an embodiment, the apparatus 200 may, e.g., be configured to determine the 35 access unit removal time of the current picture depending on a removal time of a preceding picture. 2025201683   07 Mar 2025 In an embodiment, the apparatus 200 may, e.g., be configured to determine the access unit removal time of the current picture depending on initial coded picture buffer removal delay information. 5 According to an embodiment, the apparatus 200 may, e.g., be configured to update the initial coded picture buffer removal delay information depending on a clock tick to obtain temporary coded picture buffer removal delay information to determine the access unit removal time of the current picture. 10 According to an embodiment, if the concatenation flag is set to a first value, then the apparatus 200 is configured to use the coded picture buffer delay offset information to determine one or more removal times. If the concatenation flag is set to a second value being different from the first value then the apparatus 200 is configured to not use the coded 15 picture buffer delay offset information to determine the one or more removal times. In an embodiment, the apparatus 200 may, e.g., be configured to signal to a video decoder 300, whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture from the coded picture buffer. 20 According to an embodiment, the current picture may, e.g., be located at a splicing point of the output video, where two input videos have been spliced. Furthermore, a video data stream is provided. The video data stream has a video encoded 25 thereinto. The video data stream comprises coded picture buffer delay offset information. According to an embodiment, the video data stream may, e.g., comprise a concatenation flag. 30 In an embodiment, the video data stream may, e.g., comprise initial coded picture buffer removal delay information. According to an embodiment, if the concatenation flag is set to a first value (e.g., 0) then the concatenation flag indicates that the coded picture buffer delay offset information needs 35 to be used to determine one or more (picture or access unit) removal times, e.g., when it is known that some pictures (e.g., RASL pictures) have been dropped. If the concatenation 2025201683   07 Mar 2025 flag is set to a second value being different from the first value (e.g., 1) then the concatenation flag indicates that the indicated offset is not used to determine the one or more (picture or access unit) removal times, e.g., irrespective of an offset signaling and, e.g., irrespective of whether RASL pictures have been dropped. If pictures are not dropped, 5 then, e.g., the offset is not to be used. Moreover, a video encoder 100, is provided. The video encoder 100 is configured to encode a video into a video data stream. The video encoder 100 is configured to generate the video data stream such that the video data stream comprises coded picture buffer delay offset 10 information. According to an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise a concatenation flag. 15 In an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise coded picture buffer delay offset information. 20 Furthermore, a video decoder 300 for receiving a video data stream a video stored therein is provided. The video decoder 300 is configured to decode the video from the video data stream. Moreover, the video decoder 300 is configured to decode the video depending on an access unit removal time of a current picture of a plurality of pictures of the video from a coded picture buffer. The video decoder 300 is configured to decode the video depending 25 on an indication indicating whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture from the coded picture buffer. According to an embodiment, the access unit removal time for at least one of the plurality 30 of pictures of the video from the coded picture buffer depends on the coded picture buffer delay offset information. In an embodiment, the video decoder 300 is configured to decode the video depending on whether or not to use coded picture buffer delay offset information for determining the 35 access unit removal time of the current picture depending on a location of the current picture within the video. 2025201683   07 Mar 2025 According to an embodiment, the video decoder 300 may, e.g., be configured to decode the video depending on whether or not a coded picture buffer delay offset value of the coded picture buffer delay offset information may, e.g., be set to 0. 5 In an embodiment, the video decoder 300 may, e.g., be configured to determine whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture depending on a position of a previous non-discardable picture which precedes the current picture within the video. 10 According to an embodiment, the video decoder 300 may, e.g., be configured to determine whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture depending on whether or not the previous non-discardable picture which precedes the current picture within the video may, e.g., be a 15 first picture in a previous buffering period. In an embodiment, the video decoder 300 may, e.g., be configured to determine whether or not to use coded picture buffer delay offset information for determining the access unit removal time of the current picture depending on a concatenation flag, the current picture 20 being a first picture of the input video of the second video data stream. According to an embodiment, the video decoder 300 may, e.g., be configured to determine the access unit removal time of the current picture depending on a removal time of a preceding picture. 25 In an embodiment, the video decoder 300 may, e.g., be configured to determine the access unit removal time of the current picture depending on initial coded picture buffer removal delay information. 30 According to an embodiment, the video decoder 300 may, e.g., be configured to update the initial coded picture buffer removal delay information depending on a clock tick to obtain temporary coded picture buffer removal delay information to determine the access unit removal time of the current picture. 35 According to an embodiment, if the concatenation flag is set to a first value, then the video decoder 300 is configured to use the coded picture buffer delay offset information to 2025201683   07 Mar 2025 determine one or more removal times. If the concatenation flag is set to a second value being different from the first value then the video decoder 300 is configured to not use the coded picture buffer delay offset information to determine the one or more removal times. 5 Furthermore, a system is provided. The system comprises an apparatus 200 as described above and a video decoder 300 as described above. The video decoder 300 is configured to receive the output video data stream of the apparatus 200. Moreover, the video decoder 300 is configured to decode the video from the output video data stream of the apparatus 200. 10 According to an embodiment, the system may, e.g., further comprise a video encoder 100. The apparatus 200 may, e.g., be configured to receive the video data stream from the video encoder 100 as the input video data stream. 15 In particular, the second aspect of the invention relates to that prevNonDiscardable in case of alternative timing may (when it is not a BP start) already include the alternative offset (CpbDelayOffset), so for the AU with concatenation flag == 1 , CpbDelayOffset should be temporally set to zero. 20 When splicing of two bitstreams happens the derivation of the removal time of an AU from the CPB is done differently than for non-spliced bitstreams. At the splicing point a Buffering Period SEI message (BP SEI message; SEI = supplemental enhancement information) comprises a concatenationFlag being equal to 1. Then the decoder needs to check among 2 values and take the bigger one of both: 25 • previous Non Discardable Pic (prevNonDiscardablePic) removal time plus a delta signalled in the BP SEI message (auCpbRemovalDelayDeltaMinusl + 1), or • preceding Pic removal time plus InitCpbRemovalDelay 30 However, when the previous Pic with a BP SEI message was an AU for which alternative timings have been used (i.e. a second timing information used when the RASL picture or pictures up to a DRAP have been dropped) for derivation of the removal times, an offset is used (CpbDelayOffset) to compute each removal time that computed as a delta to the previous pic with    a buffering period,    i.e. AuNominalRemovalTime[ 2025201683   07 Mar 2025 firstPicInPrevBuffPeriod ] plus AuCpbRemovalDelayVal - CpbDelayOffset, as illustrated in Fig. 4. Fig. 4 illustrates an original bitstream (top of Fig. 4), and a bitstream after dropping pictures 5 (bottom of Fig. 4): An offset is incorporated into a calculation of the removal delay after dropping Alls (lines 1, 2 and 3 in the original bitstream). The offset is added since the removal time is computed using a delta to the removal time of the picture referred to as firstPicInPrevBuffPeriod, after which some AUs have been 10 dropped and therefore a CpbDelayOffset is necessary to account (compensate) for the AU dropping. Fig. 5 illustrates the splicing of two bitstreams (at a different position), a first bitstream (in Fig. 5 middle left) and a second bitstream (in Fig. 5, middle, right), after pictures were dropped from the original first bitstream (in Fig. 5, middle, left). The example for using the preceding Pic removal time as anchor instead of the previous non-discardable picture is similar and would not require the “-3” correction factor 15 (CpbDelayOffset) neither. However, in the splicing case as illustrated in Fig. 5, note that it is not necessarily the case that the two derivations use the removal time of the AU associated with a BP SEI message (firstPicInPrevBuffPeriod). As discussed, for the splicing case a delta added to either the 20 prevNonDiscardablePic or just the preceding Pic. This means that when the prevNonDiscardablePic is not the firstPicInPrevBuffPeriod, the CpbDelayOffset cannot be used to derive the removal time from the CPB of the current AU, as the removal time of prevNonDiscardablePic already accounts for AU dropping and no AUs are dropped between prevNonDiscardablePic and the AU for which the removal time is computed. Now 25 imagine that the preceding Pic removal time is used instead, as for the case that the current AU (i.e. the splicing point with a new BP SEI message) has an InitialCpbRemovalDelay that forces the removal time of the current AU to come after its desired removal time, which would have achieved an equidistant removal time (when the prevNonDiscardablePic is used instead). In such a case, the removal time of the current AU cannot be smaller than the time 30 computed by using the preceding Pic removal time plus InitCpbRemovalDelay as this could lead to buffer underruns (AUs not in the buffer before they need to be removed). Therefore, 2025201683   07 Mar 2025 as part of the invention, for this case the CpbDelayOffset is not used for the computation or considered to be equal to 0. Summarizing the embodiment herein is to use a CpbDelayOffset for the computation of AU 5 removal times when RASL AUs are dropped from a bitstream or AUs in between an IRAP and DRAP AUs are dropped depending on a check. The check to determine whether CpbDelayOffset is not used or considered to be equal to 0 being one of the following: • prevNonDiscardablePic is not the firstPielnPrevBuffPeriod 10   • preceding Pic removal time plus InitCpbRemovalDelay is used for the computation of the removal of the current AU The implementation in the specification could be as follows: 15       - When AU n is the first AU of a BP that does not initialize the HRD, the following applies: The nominal removal time of the AU n from the CPB is specified by: if( IconcatenationFlag ) { baseTime = AuNominalRemovalTime[ firstPielnPrevBuffPeriod ] 20         tmpCpbRemovalDelay = AuCpbRemovalDelayVal tmpCpbDelayOffset = CpbDelayOffset } else { baseTime 1 = AuNominalRemovalTime[ prevNonDiscardablePic ] tmpCpbRemovalDelay 1 = ( auCpbRemovalDelayDeltaMinusl + 1 ) 25          baseTime2 = AuNominalRemovalTime[ n - 1 ] tmpCpbRemovalDelay2 =                                         (C.10) Ceil( (InitCpbRemovalDelay[ Htid ][ Scldx ] 90000 + AuFinalArrivalTime[ n - 1 ] - AuNominalRemovalTime[ n - 1 ] ) -^ ClockTick ) 30           if( baseTime 1 + ClockTick * tmpCpbRemovalDelay 1 < baseTime2 + ClockTick * tmpCpbRemovalDelay2 ) { baseTime = baseTime2 tmpCpbRemovalDelay = tmpCpbRemovalDelay2 2025201683   07 Mar 2025 tmpCpbDelayOffset = 0 } else { baseTime = baseTime 1 tmpCpbRemovalDelay = tmpCpbRemovalDelayl 5             tmpCpbDelayOffset = ((prevNonDiscardablePic= =firstPicInPrevBuffPeriod)?CpbDelayOffset:0) } } AuNominalRemovalTime[ n ] = 10 baseTime + ( ClockTick * tmpCpbRemovalDelay - tmpCpbDelayOffset ) Alternatively, in another embodiment illustrated in Fig. 6, the CpbDelayOffset for the computation of AU removal times when RASL AUs are dropped from a bitstream or AUs in between an IRAP and DRAP AUs are dropped depending on a different check that 15 comprises checking the concatenationFlag. In that case the delta in the bitstream when concatenationFlag is set to 1 needs to match the proper value as if the CpbDelayOffset was accounted for (as evident when comparing Fig. 5 and 6), as for that figure CpbDelayOffset is not applied or considered to be 0. 20 The implementation in the specification could be as follows: - When AU n is the first AU of a BP that does not initialize the HRD, the following applies: 25 The nominal removal time of the AU n from the CPB is specified by: if( ! concatenationFlag ) { baseTime = AuNominalRemovalTime[ firstPicInPrevBuffPeriod ] tmpCpbRemovalDelay = AuCpbRemovalDelayVal tmpCpbDelayOffset = CpbDelayOffset 30          } else { baseTime 1 = AuNominalRemovalTime[ prevNonDiscardablePic ] tmpCpbRemovalDelayl = ( auCpbRemovalDelayDeltaMinusl + 1 ) 2025201683   07 Mar 2025 baseTime2 = AuNominalRemovalTime[ n - 1 ] tmpCpbRemovalDelay2 =                                         (C.10) Ceil( (InitCpbRemovalDelay[ Htid ][ Scldx ] 90000 + 5          AuFinalArrivalTime[ n - 1 ] - AuNominalRemovalTime[ n - 1 ] ) -^ ClockTick ) if( baseTime 1 + ClockTick * tmpCpbRemovalDelayl < baseTime2 + ClockTick * tmpCpbRemovalDelay2 ) { baseTime = baseTime2 tmpCpbRemovalDelay = tmpCpbRemovalDelay2 10              } else { baseTime = baseTime 1 tmpCpbRemovalDelay = tmpCpbRemovalDelayl } tmpCpbDelayOffset = 0 15          } AuNominalRemovalTime[ n ] = baseTime + ( ClockTick * tmpCpbRemovalDelay - tmpCpbDelayOffset In the following, the third aspect of the invention is now described in detail. 20 In accordance with the third aspect of the invention, a video data stream is provided. The video data stream has a video encoded thereinto. Moreover, the video data stream comprises an initial coded picture buffer removal delay. Furthermore, the video data stream comprises an initial coded picture buffer removal offset. Moreover, the video data stream 25 comprises information that indicates whether or not a sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. According to an embodiment, the initial coded picture buffer removal delay may, e.g., 30 indicate a time that needs to pass for a first access unit of a picture of the video data stream that initializes a video decoder 300 before sending the first access unit to the video decoder 300. 2025201683   07 Mar 2025 In an embodiment, the video data stream may, e.g., comprise a single indication that may, e.g., indicate whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may, e.g., be defined to be constant across the two or more buffering periods. 5 According to an embodiment, the video data stream may, e.g., comprise a concatenation flag as the single indication, that may, e.g., indicate whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may, e.g., be defined to be constantacross the two or more buffering periods. If the concatenation 10 flag is equal to a first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant across the two or more buffering periods. If the concatenation flag is different from the first value, the concatenation flag does not define whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant across the two or more buffering 15 periods. In an embodiment, if the single indication does not indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods, the video data stream may, e.g., 20 comprise continuously updated information on the initial coded picture buffer removal delay information and continuously updated information on the initial coded picture buffer removal offset information. According to an embodiment, if the video data stream comprises the information that 25 indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may, e.g., be defined to be constant starting from a current position within the video data stream. 30 Furthermore, a video encoder 100 is provided. The video encoder 100 is configured to encode a video into a video data stream. Moreover, the video encoder 100 is configured to generate the video data stream such that the video data stream comprises an initial coded picture buffer removal delay. Furthermore, the video encoder 100 is configured to generate 35 the video data stream such that the video data stream comprises an initial coded picture buffer removal offset. Moreover, the video encoder 100 is configured to generate the video 2025201683   07 Mar 2025 data stream such that the video data stream comprises information that indicates whether or not a sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. 5 According to an embodiment, the initial coded picture buffer removal delay may, e.g., indicate a time that needs to pass for a first access unit of a picture of the video data stream that initializes a video decoder 300 before sending the first access unit to the video decoder 300. 10 In an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise a single indication that may, e.g., indicate whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may, e.g., be defined to be constant across the two or more buffering periods. 15 According to an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise a concatenation flag as the single indication, that may, e.g., indicate whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may, 20   e.g., be defined to be constantacross the two or more buffering periods. If the concatenation flag is equal to a first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant across the two or more buffering periods. If the concatenation flag is different from the first value, the concatenation flag does not define whether or not the sum of the initial coded picture buffer removal delay and the 25 initial coded picture buffer removal offset is constant across the two or more buffering periods. In an embodiment, if the single indication does not indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to 30 be constant across the two or more buffering periods, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise continuously updated information on the initial coded picture buffer removal delay information and continuously updated information on the initial coded picture buffer removal offset information. 35 2025201683   07 Mar 2025 According to an embodiment, if the video data stream comprises the information that may, e.g., indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods, the sum of the initial coded picture buffer removal delay and the initial 5 coded picture buffer removal offset is defined to be constant starting from a current position within the video data stream. Moreover, an apparatus 200 for receiving two input video data streams, being a first input video data stream and a second input video data stream, is provided. Each of the two input 10 video data streams has an input video encoded thereinto. The apparatus 200 is configured to generate an output video data stream from the two input video data streams, the output video data stream encoding an output video, wherein the apparatus is configured to generate an output video data stream by concatenating the first input video data stream and the second input video data stream. Moreover, the apparatus 200 is configured to 15 generate the output video data stream such that the output video data stream comprises an initial coded picture buffer removal delay. Furthermore, the apparatus 200 is configured to generate the output video data stream such that the output video data stream comprises an initial coded picture buffer removal offset. Moreover, the apparatus 200 is configured to generate the output video data stream such that the output video data stream comprises 20 information that indicates whether or not a sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. According to an embodiment, the initial coded picture buffer removal delay may, e.g., 25 indicate a time that needs to pass for a first access unit of a picture of the output video data stream that initializes a video decoder 300 before sending the first access unit to the video decoder 300. In an embodiment, the apparatus 200 may, e.g., be configured to generate the output video 30 data stream such that the output video data stream may, e.g., comprise a single indication that may, e.g., indicate whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may, e.g., be defined to be constant across the two or more buffering periods. 35 According to an embodiment, the apparatus 200 may, e.g., be configured to generate the output video data stream such that the output video data stream may, e.g., comprise a 2025201683   07 Mar 2025 concatenation flag as the single indication, that may, e.g., indicate whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may, e.g., be defined to be constant across the two or more buffering periods. If the concatenation flag is equal to a first value, the sum of the initial coded picture buffer removal 5 delay and the initial coded picture buffer removal offset is constant across the two or more buffering periods. If the concatenation flag is different from the first value, the concatenation flag does not define whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant across the two or more buffering periods. 10 In an embodiment, if the single indication does not indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods, the apparatus 200 is configured to generate the output video data stream such that the output video data stream comprises 15 continuously updated information on the initial coded picture buffer removal delay information and continuously updated information on the initial coded picture buffer removal offset information. According to an embodiment, if the video data stream comprises the information that 20 indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from a current position within the video data stream. 25 Furthermore, a video decoder 300 for receiving a video data stream a video stored therein is provided. The video decoder 300 is configured to decode the video from the video data stream. Moreover, the video data stream comprises an initial coded picture buffer removal delay. Furthermore, the video data stream comprises an initial coded picture buffer removal 30 offset. Moreover, the video data stream comprises information that indicates whether or not a sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across two or more buffering periods. Furthermore, the video decoder 300 is configured to decode the video depending on the information that indicates whether or not the sum of the initial coded picture buffer removal delay and the 35 initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods. 2025201683   07 Mar 2025 According to an embodiment, the initial coded picture buffer removal delay may, e.g., indicate a time that needs to pass for a first access unit of a picture of the output video data stream that initializes the video decoder 300 before sending the first access unit to the video 5 decoder 300. In an embodiment, the video data stream may, e.g., comprise a single indication that may, e.g., indicate whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may, e.g., be defined to be constant across 10 the two or more buffering periods. The video decoder 300 may, e.g., be configured to decode the video depending on the single indication. According to an embodiment, the video data stream may, e.g., comprise a concatenation flag as the single indication, that may, e.g., indicate whether or not the sum of the initial 15 coded picture buffer removal delay and the initial coded picture buffer removal offset may, e.g., be defined to be constantacross the two or more buffering periods. If the concatenation flag is equal to a first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant across the two or more buffering periods. If the concatenation flag is different from the first value, the concatenation flag does 20 not define whether or not the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant across the two or more buffering periods. The video decoder 300 is configured to decode the video depending on the concatenation flag. 25 In an embodiment, if the single indication does not indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant across the two or more buffering periods, the video data stream comprises continuously updated information on the initial coded picture buffer removal delay information and continuously updated information on the initial coded picture buffer removal 30 offset information. The video decoder 300 is configured to decode the video depending on the continuously updated information on the initial coded picture buffer removal delay information and on the continuously updated information on the initial coded picture buffer removal offset information. 35 According to an embodiment, if the video data stream comprises the information that indicates that the sum of the initial coded picture buffer removal delay and the initial coded 2025201683   07 Mar 2025 picture buffer removal offset is defined to be constant across the two or more buffering periods, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from a current position within the video data stream. 5 Moreover, a system is provided. The system comprises an apparatus 200 as described above and a video decoder 300 as described above. The video decoder 300 is configured to receive the output video data stream of the apparatus 200. Moreover, the video decoder 300 is configured to decode the video from the output video data stream of the apparatus 10   200. According to an embodiment, the system may, e.g., further comprise a video encoder 100. The apparatus 200 according to one of claims 221 to 226 may, e.g., be configured to receive the video data stream from the video encoder 100 according to one of claims 211 to 216 as 15 the input video data stream. In particular, the third aspect of the invention relates to splicing, to an Initial Cpb Removal Delay and to an Initial Cpb Removal Offset 20 Currently the specification indicates that the sum of Initial Cpb Removal Delay and Initial Cpb Removal Offset are constant within a CVS. The same constraint is expressed for the alternative timings. The Initial Cpb Removal Delay indicates the time that needs to pass for the first AU in the bitstream that initializes the decoder before sending the first AU for decoding. The Initial Cpb Removal Offset is a property of the bitstream that means that the 25 AUs earliest arrival time in the decoder is not necessarily equidistant with respect to the time 0 at which the first AU arrive the decoder. It helps determining when the first bit of an AU can earliest reach the decoder. The current constraint in the VVC draft specification indicates that the sum of these two 30 values needs to be constant within a CVS: Over the entire CVS, for each value pair of i and j, the sum of nal_initial_cpb_removal_delay[ i ][ j ] and nal_initial_cpb_removal_offset[ i ][ j ] shall be constant, and the sum of nal_initial_alt_cpb_removal_delay[ i ][ j ] and 35           nal_initial_alt_cpb_removal_offset[ i ] [ j ] shall be constant. 2025201683   07 Mar 2025 The problem appears when editing or splicing bitstreams to form a new joint bitstream. It is desirable also to be able to indicate whether this property is fulfilled across the CVS boundary for the bitstream as having a different value of the sum could lead to buffer underruns or overflows. 5 Therefore, in an embodiment an indication is carried in the bitstream that from a certain point in the bitstream on (e.g. splicing point), the value constraint regarding the constant sum of InitCpbRemovalDelay and InitCpbRemovalDelayOffset (and the alternative counterparts) is reset and the sums before and after the point in the bitstream may be 10 different. Unless this indication is present in the bitstream the sum stays constant. For instance: When concatenationFlag is equal to 0, it is a constraint of bitstream conformance that the 15 sum of InitCpbRemovalDelay and InitCpbRemovalDelayOffset is constant across buffering periods. Otherwise, sum of InitCpbRemovalDelay and InitCpbRemovalDelayOffset does not have to be constant across buffering periods. The values of InitCpbRemovalDelay and 20 InitCpbRemovalDelayOffset are updated to account for the arrival times. In an embodiment, if several bitstreams are spliced, at each splicing point a concatenation flag may, e.g., define whether the sum stays constant or not. 25 In the following, the fourth aspect of the invention is now described in detail. In accordance with the fourth aspect of the invention, a video data stream is provided. The video data stream has a video encoded thereinto. Moreover, the video data stream comprises an indication (e.g., a general_same_pic_timing_in_all_ols_flag) indicating 30 whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the indication (e.g., a general_same_pic_timing_in_all_ols_flag) has a first 35 value, then the non-scalable nested picture timing supplemental enhancement information 2025201683   07 Mar 2025 message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication (e.g., a general_same_pic_timing_in_all_ols flag) has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture 5 timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. According to an embodiment, for example, if the indication (e.g., a 10 general_same_pic_timing_in_all_ols flag) has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message. In an embodiment, e.g., if the indication (e.g., a general_same_pic_timing_in_all_ols flag) 15 has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message. According to an embodiment, for example, if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then for each network 20 abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of a coded video sequence of the one or more coded video sequences, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or 25 does not comprise any other supplemental enhancement information message. In an embodiment, if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit 30 of the plurality of access units of each of the one or more coded video sequences of the video data stream, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message. 35 2025201683   07 Mar 2025 Moreover, a video encoder 100 may, e.g., be provided. The video encoder 100 is configured to encode a video into a video data stream. Moreover, the video encoder 100 is configured to generate the video data stream such that the video data stream comprises an indication (e.g., a general_same_pic_timing_in_all_ols flag) indicating whether or not a non-scalable 5 nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the indication (e.g., a general_same_pic_timing_in_all_ols flag) has a first value, then the non-10 scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication (e.g., a general_same_pic_timing_in_all_ols flag) has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing 15 supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. According to an embodiment, for example, if the indication (e.g., a 20 general_same_pic_timing_in_all_ols flag) has the first value, then the video encoder 100 is configured to generate the video data stream such that said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message. 25 In an embodiment, e.g., if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then the video encoder 100 is configured to generate the video data stream such that said network abstraction layer unit does not comprise any other supplemental enhancement information message. 30 According to an embodiment, for example, if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then the video encoder 100 may, e.g., be configured to generate the video data stream such that for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of a 35 coded video sequence of the one or more coded video sequences, said network abstraction 2025201683   07 Mar 2025 layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message. 5 In an embodiment, e.g., if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then the video encoder 100 may, e.g., be configured to generate the video data stream such that for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of each of the one or more coded video 10 sequences of the video data stream, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message. 15 Furthermore, an apparatus 200 for receiving an input video data stream is provided. The input video data stream has a video encoded thereinto. The apparatus 200 is configured to generate an processed video data stream from the input video data stream. Moreover, the apparatus 200 is configured to generate the processed video data stream such that the processed video data stream comprises an indication (e.g., a 20 general_same_pic_timing_in_all_ols flag) indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the processed video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. If the indication 25   (e.g., a general_same_pic_timing_in_all_ols flag) has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit. If the indication (e.g., a general_same_pic_timing_in_all_ols flag) has a value being different from the first value, 30 then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit. 35 According to an embodiment, for example, if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then the apparatus 200 is 2025201683   07 Mar 2025 configured to generate the processed video data stream such that said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message. 5 In an embodiment, e.g., if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then the apparatus 200 is configured to generate the processed video data stream such that said network abstraction layer unit does not comprise any other supplemental enhancement information message. 10 According to an embodiment, for example, if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then the apparatus 200 may, e.g., be configured to generate the processed video data stream such that for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of a 15 coded video sequence of the one or more coded video sequences, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message. 20 In an embodiment, e.g., if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then the apparatus 200 may, e.g., be configured to generate the processed video data stream such that for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of each of the one or more 25 coded video sequences of the processed video data stream, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message. 30 Moreover, a video decoder 300 for receiving a video data stream having a video stored therein is provided. The video decoder 300 is configured to decode the video from the video data stream. The video data stream comprises an indication (e.g., a general_same_pic_timing_in_all_ols flag) indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction 35 layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output 2025201683   07 Mar 2025 layer sets of a plurality of output layer sets of said access unit. If the indication (e.g., a general_same_pic_timing_in_all_ols flag) has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of 5 output layer sets   of said access unit. If the indication (e.g., a general_same_pic_timing_in_all_ols flag) has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said 10 access unit. The video decoder 300 is configured to decode the video depending on said indication. According to an embodiment, for example, if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then said network abstraction 15 layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message. In an embodiment, e.g., if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then said network abstraction layer unit does not comprise any other 20 supplemental enhancement information message. The video decoder 300 is configured to decode the video depending on said indication. According to an embodiment, for example, if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then for each network 25 abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of a coded video sequence of the one or more coded video sequences, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or 30 does not comprise any other supplemental enhancement information message. In an embodiment, e.g., if the indication (e.g., a general_same_pic_timing_in_all_ols flag) has the first value, then for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each 35 access unit of the plurality of access units of each of the one or more coded video 2025201683   07 Mar 2025 sequences of the video data stream, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message. 5 Furthermore, a system is provided. The system comprises an apparatus 200 as described above and a video decoder 300 as described above. The video decoder 300 is configured to receive the processed video data stream of the apparatus 200. Moreover, the video decoder 300 is configured to decode the video from the output video data stream of the 10 apparatus 200. According to an embodiment, the system may, e.g., further comprise a video encoder 100. The apparatus 200 may, e.g., be configured to receive the video data stream from the video encoder 100 as the input video data stream. 15 In particular, the fourth aspect of the invention relates to constraining PT SEI to not be paired with other HRD SEIs when general_same_pic_timing_in_all_ols_flag equal to 1 The VVC draft specification comprises a flag called 20 general_same_pic_timing_in_all_ols_flag in the general HRD parameter structure which the following semantics: general_same_pic_timing_in_all_ols_flag equal to 1 specifies that the non-scalable-nested PT SEI message in each AU applies to the AU for any OLS in the bitstream 25          and no scalable-nested PT SEI messages are present. general_same_pic_timing_in_all_ols_flag equal to 0 specifies that the non-scalable-nested PT SEI message in each AU may or may not apply to the AU for any OLS in the bitstream and scalable-nested PT SEI messages may be present. 30 In general, when an OLS sub-bitstream is extracted from an original bitstream (comprises OLS data plus non-OLS data), corresponding HRD-related timing / buffer information for the target OLS in the form of Buffering Period, Picture Timing and Decoding Unit Information SEI messages which are encapsulated in so called scalable-nesting SEI messages are decapsulated. This decapsulated SEI messages are subsequently used to replace the non-35 scalable nested HRD SEI information in the original bitstream. However, in many scenarios, 2025201683   07 Mar 2025 the content of some messages, e.g. the Picture Timing SEI message, may remain the same when a layer is dropped, i.e. from one OLS to a sub-set thereof. Therefore, general_same_pic_timingjn_all_ols_flag provides a shortcut so that only BP and DUI SEI messages are to be replaced, but the PT SEI in the original bitstream may stay in effect, 5 i.e. it is simply not removed during extraction when general_same_pic_timing_in_all_ols flag is equal to 1. Therefore, no replacement PT SEI message needs to be encapsulated in the scalable-nesting SEI message carrying the replacement BP and DUI SEI messages and no bitrate overhead is introduced for this information. 10 However, in the state-of-the-art, the PT SEI message is allowed to be carried within one SEI NAL unit (NAL unit = network abstraction layer unit) jointly with other HRD SEI messages, i.e. BP, PT and SEI messages may all be encapsulated within the same Prefix SEI NAL unit. Hence, an extractor would have to do a deeper inspection of such an SEI 15 NAL unit to understand the comprised messages and when only one of the comprised messages (PT) is to be kept during the extraction procedure, it would be required to practically re-write the show SEI NAL units (i.e. remove non-PT SEI messages). In order to avoid this cumbersome low-level processing and allow an extractor to operate on the nonparameter-set portion of a bitstream entirely on the NAL unit level, it is part of the invention 20 that a bitstream constraint disallows such bitstream construction. In one embodiment, the constraint is phrased as follows: general_same_pic_timing_in_all_ols flag equal to 1 specifies that the non-scalable-nested PT SEI message in each AU applies to the AU for any OLS in the bitstream 25          and no scalable-nested PT SEI messages are present. general_same_pic_timing_in_all_ols_flag equal to 0 specifies that the non-scalable-nested PT SEI message in each AU may or may not apply to the AU for any OLS in the bitstream and scalable-nested PT SEI messages may be present. When general_same_pic_timing_in_all_ols_flag equal to 1, it is a constraint of bitstream 30          conformance that all general SEI messages in the bitstream containing an SEI message with payload type equal to 1 (Picture Timing ) shall not contain SEI messages with payload type unequal to 1. In the following, the fifth aspect of the invention is now described in detail. 2025201683   07 Mar 2025 In accordance with the fifth aspect of the invention, a video data stream is provided. The video data stream has a video encoded thereinto. Moreover, the video data stream comprises one or more scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages 5 comprise a plurality of syntax elements. Each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream. 10 According to an embodiment, the video data stream may, e.g., comprise one or more non-scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of 15 the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream. 20 In an embodiment, the video data stream may, e.g., comprise a plurality of access units, wherein each access unit of the plurality of access units may, e.g., be assigned to one of a plurality of pictures of the video. The portion of the video data stream may, e.g., be an access unit of the plurality of access units of the video data stream. Each syntax element 25 of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit. According to an embodiment, the video data stream may, e.g., comprise one or more non-30 scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of 35 the scalable nested supplemental enhancement information messages of the access unit 2025201683   07 Mar 2025 and in in every one of the non-scalable nested supplemental enhancement information messages of the access unit. In an embodiment, the portion of the video data stream may, e.g., be a coded video 5 sequence of the video data stream. Each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence. 10 According to an embodiment, the video data stream may, e.g., comprise one or more non-scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of 15 the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence and in in every one of the non-scalable nested supplemental enhancement information messages of the coded video sequence. 20 In an embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream. According to an embodiment, each syntax element of the one or more syntax elements of 25 the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream. 30 In an embodiment, the video data stream or the portion of the video data stream may, e.g., comprise at least one buffering period supplemental enhancement information message, wherein said buffering period supplemental enhancement information message defines the size for each syntax element of the one or more syntax elements of the plurality of syntax elements. 35 2025201683   07 Mar 2025 According to an embodiment, said buffering period supplemental enhancement information message comprises, for defining the size for each syntax element of the one or more syntax elements of the plurality of syntax elements, at least one of 5        a bpcpbinitialremovaldelaylengthminusl element, a bpcpbremovaldelaylengthminusl element, a bp dpb output delay length minusl element, 10 a bpducpbremovaldelayincrementlengthminusl element, a bp_dpb_output_delay_du_length_minusl element. 15 In an embodiment, for each access unit of a plurality of access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said access unit may, e.g., also comprise a non-scalable-nested buffering period supplemental enhancement information message. 20 According to an embodiment, for each single-layer access unit of a plurality of single-layer access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said single-layer access unit may, e.g., also comprise a non-scalable-nested buffering period supplemental enhancement information message. 25 Moreover, a video encoder 100 is provided. The video encoder 100 is configured to encode a video into a video data stream. Moreover, the video encoder 100 is configured to generate the video data stream such that the video data stream comprises one or more scalable nested supplemental enhancement information messages. Furthermore, the video encoder 30   100 is configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Moreover, the video encoder 100 is configured to generate the video data stream such that each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental 2025201683   07 Mar 2025 enhancement information messages of the video data stream or of a portion of the video data stream. According to an embodiment, the video encoder 100 may, e.g., be configured to generate 5 the video data stream such that the video data stream may, e.g., comprise one or more non-scalable nested supplemental enhancement information messages. The video encoder 100 may, e.g., be configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the 10 plurality of syntax elements. The video encoder 100 may, e.g., be configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream and in in every one of the non-scalable 15 nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream. In an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise a plurality of access units, 20 wherein each access unit of the plurality of access units may, e.g., be assigned to one of a plurality of pictures of the video. The portion of the video data stream may, e.g., be an access unit of the plurality of access units of the video data stream. The video encoder 100 may, e.g., be configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined 25 to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit. According to an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise one or more 30 non-scalable nested supplemental enhancement information messages. The video encoder 100 may, e.g., be configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. The video encoder 100 may, e.g., be configured to generate 35 the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one 2025201683   07 Mar 2025 of the scalable nested supplemental enhancement information messages of the access unit and in in every one of the non-scalable nested supplemental enhancement information messages of the access unit. 5 In an embodiment, the portion of the video data stream may, e.g., be a coded video sequence of the video data stream. The video encoder 100 may, e.g., be configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the 10 coded video sequence. According to an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream may, e.g., comprise one or more non-scalable nested supplemental enhancement information messages. The video encoder 15   100 may, e.g., be configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. The video encoder 100 may, e.g., be configured to generate the video data stream such that each syntax element of the one or more syntax elements 20 of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence and in in every one of the non-scalable nested supplemental enhancement information messages of the coded video sequence. 25 In an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream. 30 According to an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data 35 stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream. 2025201683   07 Mar 2025 In an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that the video data stream or the portion of the video data stream may, e.g., comprise at least one buffering period supplemental enhancement information 5 message, wherein said buffering period supplemental enhancement information message defines the size for each syntax element of the one or more syntax elements of the plurality of syntax elements. According to an embodiment, the video encoder 100 may, e.g., be configured to generate 10 the video data stream such that said buffering period supplemental enhancement information message comprises, for defining the size for each syntax element of the one or more syntax elements of the plurality of syntax elements, at least one of a bp_cpb_initial_removal_delay_length_minusl element, 15 a bp cpb removal delay length minusl element, a bp dpb output delay length minusl element, 20 a bp_du_cpb_removal_delay_increment_length_minusl element, a bp_dpb_output_delay_du_length_minusl element. In an embodiment, the video encoder 100 may, e.g., be configured to generate the video 25 data stream such that for each access unit of a plurality of access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said access unit may, e.g., also comprise a non-scalable-nested buffering period supplemental enhancement information message. 30 According to an embodiment, the video encoder 100 may, e.g., be configured to generate the video data stream such that for each single-layer access unit of a plurality of singlelayer access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said single-layer access unit may, e.g., also comprise a non-scalable-nested buffering period supplemental enhancement 35 information message. 2025201683   07 Mar 2025 Furthermore, an apparatus 200 for receiving an input video data stream is provided. The input video data stream has a video encoded thereinto. The apparatus 200 is configured to generate an output video data stream from the input video data stream. The video data 5 stream comprises one or more scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video 10 data stream or of a portion of the video data stream. The apparatus 200 is configured to process the one or more scalable nested supplemental enhancement information messages. According to an embodiment, the video data stream may, e.g., comprise one or more non-15 scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable 20 nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream. The apparatus 200 is configured to process the one or more scalable nested supplemental enhancement information messages and the one or more 25 non-scalable nested supplemental enhancement information messages. In an embodiment, the video data stream may, e.g., comprise a plurality of access units, wherein each access unit of the plurality of access units may, e.g., be assigned to one of a plurality of pictures of the video. The portion of the video data stream may, e.g., be an 30 access unit of the plurality of access units of the video data stream. Each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit. 35 According to an embodiment, the video data stream may, e.g., comprise one or more non-scalable nested supplemental enhancement information messages. The one or more 2025201683   07 Mar 2025 scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of 5 the scalable nested supplemental enhancement information messages of the access unit and in in every one of the non-scalable nested supplemental enhancement information messages of the access unit. The apparatus 200 may, e.g., be configured to process the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information messages. 10 In an embodiment, the portion of the video data stream may, e.g., be a coded video sequence of the video data stream. Each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the 15 coded video sequence. According to an embodiment, the video data stream may, e.g., comprise one or more non-scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more 20 non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence and in in every one of the non-scalable nested supplemental enhancement 25 information messages of the coded video sequence. The apparatus 200 may, e.g., be configured to process the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information messages. 30 In an embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream. According to an embodiment, each syntax element of the one or more syntax elements of 35 the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data 2025201683   07 Mar 2025 stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream. The apparatus 200 may, e.g., be configured to process the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement 5 information messages. In an embodiment, the video data stream or the portion of the video data stream may, e.g., comprise at least one buffering period supplemental enhancement information message, wherein said buffering period supplemental enhancement information message defines the 10 size of the one or more of the plurality of syntax elements. The apparatus 200 may, e.g., be configured to process the at least one buffering period supplemental enhancement information message. According to an embodiment, said buffering period supplemental enhancement information 15 message comprises, for defining the size of the one or more of the plurality of syntax elements, at least one of a bpcpbinitialremovaldelaylengthminusl element, 20 a bp cpb removal delay length minusl element, a bp dpb output delay length minusl element, a bp du cpb removal delay increment length minusl element, 25 a bp_dpb_output_delay_du_length_minusl element. In an embodiment, for each access unit of a plurality of access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement 30 information message, said access unit may, e.g., also comprise a non-scalable-nested buffering period supplemental enhancement information message. The apparatus 200 may, e.g., be configured to process the scalable nested supplemental enhancement information messages and the non-scalable nested supplemental enhancement information messages. 2025201683   07 Mar 2025 According to an embodiment, for each single-layer access unit of a plurality of single-layer access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said single-layer access unit may, e.g., also comprise a non-scalable-nested buffering period supplemental enhancement 5 information message. The apparatus 200 may, e.g., be configured to process the scalable nested supplemental enhancement information messages and the non-scalable nested supplemental enhancement information messages. Moreover, a video decoder 300 for receiving a video data stream having a video stored 10 therein is provided. The video decoder 300 is configured to decode the video from the video data stream. The video data stream comprises one or more scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements. Each syntax element of one or more syntax elements of the plurality of syntax elements is defined to 15 have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream. The video decoder 300 is configured to decode the video depending on the one or more syntax elements of the plurality of syntax elements. 20 According to an embodiment, the video data stream may, e.g., comprise one or more non-scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of 25 the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream. 30 In an embodiment, the video data stream may, e.g., comprise a plurality of access units, wherein each access unit of the plurality of access units may, e.g., be assigned to one of a plurality of pictures of the video. The portion of the video data stream may, e.g., be an access unit of the plurality of access units of the video data stream. Each syntax element 35 of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined 2025201683   07 Mar 2025 to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit. According to an embodiment, the video data stream may, e.g., comprise one or more non-5 scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of 10 the scalable nested supplemental enhancement information messages of the access unit and in in every one of the non-scalable nested supplemental enhancement information messages of the access unit. In an embodiment, the portion of the video data stream may, e.g., be a coded video 15 sequence of the video data stream. Each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence. 20 According to an embodiment, the video data stream may, e.g., comprise one or more non-scalable nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements. Each syntax element of the one or more syntax elements of 25 the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence and in in every one of the non-scalable nested supplemental enhancement information messages of the coded video sequence. 30 In an embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream. According to an embodiment, each syntax element of the one or more syntax elements of 35 the plurality of syntax elements may, e.g., be defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data 2025201683   07 Mar 2025 stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream. In an embodiment, the video data stream or the portion of the video data stream may, e.g., 5 comprise at least one buffering period supplemental enhancement information message, wherein said buffering period supplemental enhancement information message defines the size for each syntax element of the one or more syntax elements of the plurality of syntax elements. 10 According to an embodiment, said buffering period supplemental enhancement information message comprises, for defining the size for each syntax element of the one or more syntax elements of the plurality of syntax elements, at least one of a bpcpbinitialremovaldelaylengthminusl element, 15 a bp cpb removal delay length minusl element, a bp dpb output delay length minusl element, 20 a bp du cpb removal delay increment length minusl element, a bp_dpb_output_delay_du_length_minusl element. In an embodiment, for each access unit of a plurality of access units of the video data 25 stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said access unit may, e.g., also comprise a non-scalable-nested buffering period supplemental enhancement information message. According to an embodiment, for each single-layer access unit of a plurality of single-layer 30 access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said single-layer access unit may, e.g., also comprise a non-scalable-nested buffering period supplemental enhancement information message. 2025201683   07 Mar 2025 Furthermore, a system is provided. The system comprises an apparatus 200 as described above and a video decoder 300 as described above. The video decoder 300 is configured to receive the output video data stream of the apparatus 200. Moreover, the video decoder 300 configured to decode the video from the output video data stream of the apparatus 200. 5 According to an embodiment, the system may, e.g., further comprise a video encoder 100. The apparatus 200 may, e.g., be configured to receive the video data stream from the video encoder 100 as the input video data stream. 10 In particular, the fifth aspect of the invention relates to constraining all BP SEIs messages in a bitstream to indicate the same length of certain variable-length coded syntax elements and not be scalable-nested without a non-scalable nested variant in the same AU The buffering period SEI message, the picture timing SEI message and the decoding unit 15 information SEI message are used to provide precise timing information for the NAL units within a bitstream to control their transition through the buffers of a decoder in conformance tests. Some syntax elements in the PT and DUI SEI message are coded with variable length and the length of these syntax elements is conveyed in the BP SEI message. This parsing dependency is a design trade-off. For the cost of not allowing PT and DUI SEI message 20 parsing without parsing the associated BP SEI message first, the benefit of saving sending of those length syntax elements at each PT or DUI SEI message is achieved. As the BP SEI message (once per multiple frames) is send much less often than PT (once per each frame) or DUI SEI messages (multiple times per frame), a bit-saving is achieved through this common design trade-off similar as to how picture header structures can reduce the bit-25 cost of slice headers when many slices are used. More specifically, the BP SEI message in the current WC draft specification includes the syntax elements that are the root of parsing dependencies: 30      • bp_cpb_initial_removal_delay_length_minusl that specifies the coded length of alternative timing initial CPB removal delays of AUs in the PT SEI message and, • bpcpbremovaldelaylengthminusl that specifies the coded length of CPB removal delays and removal delay offsets of AUs in the PT SEI message and, • bp dpb output delay length minusl that specifies the coded length of DPB 35         output delays of AUs in the PT SEI message and, 2025201683   07 Mar 2025 • bp_du_cpb_removal_delay_increment_length_minusl that specifies the coded length of the individual and common CPB removal delays of DUs in the PT SEI message and the CPB removal delays of DUs in the DUI SEI message and, • bp_dpb_output_delay_du_length_minusl that specifies the coded length DPB 5         output delays of AUs in the PT SEI message and in the DU SEI message. However, a problem arises when a bitstream comprises multiple OLSs. While the BP / PT / DUI SEI messages that apply to the OLS that represents the bitstream are carried in a verbatim fashion in the bitstream are keeping track of the parsing dependency is trivial, 10 other pairs of BP / PT / DUI SEI messages that correspond to the OLSs representing (sub-)bitstreams are to be carried in an encapsulated form in so-called scalable nesting SEI messages. Still, the parsing dependencies apply and given that the number of OLS might be very high, it is a considerable burden for a decoder or parser to keep track of the correct encapsulated BP SEI message for the sake of the parsing dependency when processing 15 the encapsulated PT and DUI SEI messages. Especially, since those messages can also be encapsulated in different scalable nesting SEI messages. Therefore, as part of the invention, in one embodiment, a bitstream constraint is established that the coded value of the respective syntax elements describing the lengths must be the 20 same in all scalable-nested and non-scalable nested BP SEI messages in an AU. Therefore, a decoder or parser only needs to store the respective length values when parsing the first non-scalable BP SEI message in the AU and can resolve the parsing dependencies of all PT and DUI SEI message in the buffering periods that start at the respective AU, whether encapsulated in scalable-nesting SEI messages or not. The 25 following is an example of the respective specification text: It is a requirement of bitstream conformance that all scalable-nested and non-scalable nested buffering period SEI messages in an AU have the same respective value of the syntax elements bpcpbinitialremovaldelaylengthminusl, 30        bpcpbremovaldelaylengthminus 1,    bpdpboutputdelaylengthminus 1, bp_du_cpb_removal_delay_increment_length_minus 1, bpdpboutputdcl aydul cngthm i n us 1. 2025201683   07 Mar 2025 In another embodiment, the constraint is expressed only for scalable-nested BP SEI messages that are in the buffering period that the current non-scalable-nested BP SEI message determine as follows: 5          It is a requirement of bitstream conformance that all scalable nested buffering period SEI messages in a buffering period have the same respective value of the syntax elements                         bp_cpb_initial_removal_delay_length_minus 1, bpcpbremovaldelaylengthminus 1, bpdpboutputdelaylengthminus 1, bp_du_cpb_removal_delay_increment_length_minus 1, 10          bp_dpb_output_delay_du_length_minusl then the non-scalable nested buffering period SEI messages of the buffering period. Here, the BPs of the bitstream define the scope of the constraints for the scalable-nested BPs from one scalable nested BP to the next scalable nested BP. 15 In another embodiment, the constraint is expressed for all Alls of the bitstream, e.g. as follows: It is a requirement of bitstream conformance that all scalable-nested and non-scalable 20          nested buffering period SEI messages in the bitstream have the same respective value of the syntax elements bp_cpb_initial_removal_delay_length_minusl, bpcpbremovaldelaylengthminus 1,    bpdpboutputdelaylengthminus 1, bp_du_cpb_removal_delay_increment_length_minus 1, bpdpboutputdcl aydul cngthm i n us 1. 25 In another embodiment, the constraint is expressed only for the AUs in a CVS, so a smart encoder may still be able to facilitate the difference in duration of BPs in the bitstream for the coding of the relevant delay and offset syntax elements. Specification text would be as follows: 30 It is a requirement of bitstream conformance that all scalable-nested and non-scalable nested buffering period SEI messages in a CVS have the same respective value of the syntax elements bpcpbinitialremovaldelaylengthminusl, bpcpbremovaldelaylengthminus 1,    bpdpboutputdelaylengthminus 1, 2025201683   07 Mar 2025 bp_du_cpb_removal_delay_increment_length_minus 1, bpdpboutputdcl aydul cngthm i n us 1. Here, the constraint scope is the CVS. 5 More specifically, the buffering period or BP SEI message defines a so-called buffering period in which timings of individual pictures use the picture at the start of a buffering period as an anchor. The beginning of a buffering period is instrumental, for instance, to test conformance of random-access functionality in a bitstream. 10 Fig. 7 illustrates two sets of HRD SEIs, scalable nested SEIs and non-scalable nested SEIs, in a two-layer bitstream according to an embodiment. In a multi-layer scenario as shown in Fig. 7, for instance, the scalable-nested HRD SEIs provide a different buffering period setup (through the BP at POC 0 and POC 3) than the non-scalable nested SEIs (only POC 0) to be used when only layer L0 is extracted and 15 played from POC3 onwards. However, this also comes at the increased complexity cost of tracking the parsing dependencies between the PT and the individual BP messages as explained above which is undesirable. Therefore, as part of the invention, in one embodiment, it is prohibited to 20 have scalable-nested BP SEI message in Alls without a non-scalable nested BP SEI message as follows: It is a requirement of bitstream conformance that no scalable-nested BP SEI message shall be in an AU that does not contain a non-scalable-nested BP SEI message. 25 As the above usage scenario is limited to multi-layer bitstreams, in another embodiment, the related constraint is limited to single-layer bitstreams as follows: It is a requirement of bitstream conformance that no scalable-nested BP SEI message 30          shall be in a single-layer AU that does not contain a non-scalable-nested BP SEI message. 2025201683   07 Mar 2025 Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent a description of the corresponding method, where a block or device corresponds to a method step or a feature of a method step. Analogously, aspects described in the context of a method step also represent a description of a corresponding 5 block or item or feature of a corresponding apparatus. Some or all of the method steps may be executed by (or using) a hardware apparatus, like for example, a microprocessor, a programmable computer or an electronic circuit. In some embodiments, one or more of the most important method steps may be executed by such an apparatus. 10 Depending on certain implementation requirements, embodiments of the invention can be implemented in hardware or in software or at least partially in hardware or at least partially in software. The implementation can be performed using a digital storage medium, for example a floppy disk, a DVD, a Blu-Ray, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, having electronically readable control signals stored thereon, which 15 cooperate (or are capable of cooperating) with a programmable computer system such that the respective method is performed. Therefore, the digital storage medium may be computer readable. Some embodiments according to the invention comprise a data carrier having electronically 20 readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed. Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing 25 one of the methods when the computer program product runs on a computer. The program code may for example be stored on a machine readable carrier. Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier. 30 In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer. 35 A further embodiment of the inventive methods is, therefore, a data carrier (or a digital storage medium, or a computer-readable medium) comprising, recorded thereon, the 2025201683   07 Mar 2025 computer program for performing one of the methods described herein. The data carrier, the digital storage medium or the recorded medium are typically tangible and / or non-transitory. 5 A further embodiment of the inventive method is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or the sequence of signals may for example be configured to be transferred via a data communication connection, for example via the Internet. 10 A further embodiment comprises a processing means, for example a computer, or a programmable logic device, configured to or adapted to perform one of the methods described herein. A further embodiment comprises a computer having installed thereon the computer program 15 for performing one of the methods described herein. A further embodiment according to the invention comprises an apparatus or a system configured to transfer (for example, electronically or optically) a computer program for performing one of the methods described herein to a receiver. The receiver may, for 20 example, be a computer, a mobile device, a memory device or the like. The apparatus or system may, for example, comprise a file server for transferring the computer program to the receiver. In some embodiments, a programmable logic device (for example a field programmable 25 gate array) may be used to perform some or all of the functionalities of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor in order to perform one of the methods described herein. Generally, the methods are preferably performed by any hardware apparatus. 30 The apparatus described herein may be implemented using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer. The methods described herein may be performed using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer. 35 2025201683   07 Mar 2025 The above described embodiments are merely illustrative for the principles of the present invention. It is understood that modifications and variations of the arrangements and the details described herein will be apparent to others skilled in the art. It is the intent, therefore, to be limited only by the scope of the impending patent claims and not by the specific details 5 presented by way of description and explanation of the embodiments herein. It is to be understood that any reference to a prior art publication herein does not constitute an admission that the publication forms a part of the common general knowledge in the art, in Australia or any other country. 10 In the claims which follow and in the preceding description of the invention, except where the context requires otherwise due to express language or necessary implication, the word “comprise” or variations such as “comprises” or “comprising” is used in an inclusive sense, i.e. to specify the presence of the stated features but not to preclude the presence or 15 addition of further features in various embodiments of the invention. 2025201683   07 Mar 2025 References [1] ISO / IEC, ITU-T. High efficiency video coding. ITU-T Recommendation H.265 | ISO / IEC 23008 10 (HEVC), edition 1,2013; edition 2, 2014. 5

Claims

1. A video decoder,5          wherein the video decoder is configured to decode a video of a video data stream,wherein the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of 10         access units of a coded video sequence of a one or more coded video sequencesof the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit,wherein, if the indication has a first value, then the non-scalable nested picture timing 15          supplemental enhancement information message of said network abstraction layerunit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit,wherein, if the indication has a value being different from the first value, then the 20          indication does not define whether or not the non-scalable nested picture timingsupplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit,25          wherein the video decoder is configured to decode the video depending on saidindication,wherein, if the indication has the first value, then all supplemental enhancement information messages have a same payload type.

302. A video decoder according to claim 1,wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message that 35          is different from a picture timing supplemental enhancement information message.2025201683   07 Mar 20253. A video decoder according to claim 1 or 2,wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message.

54. A video encoder,wherein the video encoder is configured to generate a video data stream comprising an encoding of a video,10wherein the video encoder is configured to generate the video data stream such that the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a 15         coded video sequence of a one or more coded video sequences of the video datastream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit,wherein, if the indication has a first value, then the non-scalable nested picture timing 20          supplemental enhancement information message of said network abstraction layerunit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit,wherein, if the indication has a value being different from the first value, then the 25          indication does not define whether or not the non-scalable nested picture timingsupplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit,30           wherein, if the indication has the first value, then all supplemental enhancementinformation messages have a same payload type.

5. A video encoder according to claim 4,2025201683   07 Mar 2025wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message.5   6. A video encoder according to claim 4 or 5,wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message.10   7. A video data stream,wherein the video data stream comprises information on a video,wherein the video data stream comprises an indication indicating whether or not a 15          non-scalable nested picture timing supplemental enhancement informationmessage of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit,20wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit,25wherein, if the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer 30           sets of said access unit,wherein, if the indication has the first value, then all supplemental enhancement information messages have a same payload type.35   8. A video data stream according to claim 7,2025201683   07 Mar 2025wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message.5   9. A video data stream according to claim 7 or 8,wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message.10   10. A method for video decoding,wherein the method comprises decoding a video of a video data stream,wherein the video data stream comprises an indication indicating whether or not a 15          non-scalable nested picture timing supplemental enhancement informationmessage of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit,20wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit,25wherein, if the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer 30           sets of said access unit,wherein decoding the video is conducted depending on said indication,wherein, if the indication has the first value, then all supplemental enhancement 35          information messages have a same payload type.2025201683   07 Mar 202511. A method for generating a video data stream comprising an encoding of a video,wherein the method comprises generating the video data stream such that the video data stream comprises an indication indicating whether or not a non-scalable nested5          picture timing supplemental enhancement information message of a networkabstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit,10wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit,15wherein, if the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer20           sets of said access unit,wherein, if the indication has the first value, then all supplemental enhancement information messages have a same payload type.25   12. A computer program for implementing the method of claim 10 or 11 when beingexecuted on a computer or signal processor.

Images