Improvements on the bitdepth range information SEI message
The improved BRI SEI message addresses inefficiencies in video coding by specifying color components and optimizing partition types, ensuring accurate and efficient bitdepth range information processing, enhancing video decoding accuracy and reducing bandwidth.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-09-03
- Publication Date
- 2026-03-12
AI Technical Summary
Existing bitdepth range information (BRI) SEI messages in video coding standards face issues such as inefficient use of chroma components, unclear conversion methods for chroma formats, excessive bit usage for partition IDs, unspecified syntax elements, range overlaps, improper bit depth settings, and inconsistent semantics, leading to inefficiencies and errors in video decoding.
The proposed solutions include specifying color components for conveying original source picture information, allowing certain chroma formats, optimizing partition types, ensuring unique range identifiers, and clarifying syntax element defaults to address these issues, thereby enhancing the accuracy and efficiency of bitdepth range information processing.
The improved BRI SEI message processing ensures efficient use of chroma components, correct conversion, reduced bit usage, and consistent semantics, resulting in improved video decoding accuracy and reduced bandwidth requirements.
Smart Images

Figure US2025044652_12032026_PF_FP_ABST
Abstract
Description
Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)Improvements On The Bitdepth Range Information SEI MessageCROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the priority to and benefits of U.S. Provisional Patent Application No. 63 / 690,551 filed on September 4, 2024, U.S. Provisional Patent Application No. 63 / 725,790 filed on November 27, 2024, U.S. Provisional Patent Application No. 63 / 742,599 filed on January 7, 2025, and U.S. Provisional Patent Application No. 63 / 746,767 filed on January 17, 2025, all of which are herein incorporated by reference in their entireties.TECHNICAL FIELD
[0002] The present disclosure relates to generation, storage, and consumption of digital audio video media information in a file format.BACKGROUND
[0003] Digital video accounts for the largest bandwidth used on the Internet and other digital communication networks. As the number of connected user devices capable of receiving and displaying video increases, the bandwidth demand for digital video usage is likely to continue to grow.SUMMARY
[0004] A first aspect relates to a method for processing video data comprising: determining one or more sy ntax elements in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specify which colour components are used to convey an original source picture information in a range; and performing a conversion between a visual media data and a bitstream based on the BRI SEI message.
[0005] A second aspect relates to an apparatus for processing video data comprising: a processor; and a non- transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to perform any of the preceding aspects.
[0006] A third aspect relates to non-transitory computer readable medium comprising a computer program product for use by a video coding device, the computer program product comprising computer executable instructions stored on the non-transitory computer readable medium such that when executed by a processor cause the video coding device to perform the method of any of the preceding aspects.
[0007] A fourth aspect relates to a non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises: determining one or more syntax elements in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specify which colour components are used to convey an original source picture information in a range; and generating a bitstream based on the determining.
[0008] A fifth aspect relates to a method for storing bitstream of a video comprising: determining one or more syntax elements in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specify’ which colour components are used to convey an original source picture information in a range; generating a bitstream based on the determining; and storing the bitstream in a non-transitory computer-readable recording medium.
[0009] A sixth aspect relates to a method, apparatus, or system described in the present disclosure.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0010] For the purpose of clarity, any one of the foregoing embodiments may be combined with any one or more of the other foregoing embodiments to create a new embodiment within the scope of the present disclosure.
[0011] These and other features will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings and claims.BRIEF DESCRIPTION OF THE DRAWINGS
[0012] For a more complete understanding of this disclosure, reference is now made to the following brief description, taken in connection with the accompanying drawings and detailed description, wherein like reference numerals represent like parts.
[0013] FIG. 1 is a block diagram showing an example video processing system.
[0014] FIG. 2 is a block diagram of an example video processing apparatus.
[0015] FIG. 3 is a flowchart for an example method of video processing.
[0016] FIG. 4 is a block diagram that illustrates an example video coding system.
[0017] FIG. 5 is a block diagram that illustrates an example encoder.
[0018] FIG. 6 is a block diagram that illustrates an example decoder.
[0019] FIG. 7 is a schematic diagram of an example encoder.DETAILED DESCRIPTION
[0020] It should be understood at the outset that although an illustrative implementation of one or more embodiments are provided below, the disclosed systems and / or methods may be implemented using any number of techniques, whether currently known or yet to be developed. The disclosure should in no way be limited to the illustrative implementations, drawings, and techniques illustrated below, including the exemplary designs and implementations illustrated and described herein, but may be modified within the scope of the appended claims along with their full scope of equivalents.
[0021] Section headings arc used in the present disclosure for case of understanding and do not limit the applicability of techniques and embodiments disclosed in each section only to that section. Furthermore, H.266 terminology is used in some description only for ease of understanding and not for limiting scope of the disclosed techniques. As such, the embodiments described herein are applicable to other video codec protocols and designs also. In the present disclosure, editing changes are shown to text by bold italics indicating cancelled text and bold indicating added text, with respect to the Versatile Video Coding (WC) specification.1. Initial discussion
[0022] This disclosure is related to image / video coding technologies. Specifically, this disclosure is related to the bitdepth range information SEI messages. The ideas may be applied individually or in various combinations, for video bitstreams coded by any codec, e.g., the versatile video coding (WC) standard and / or the versatile supplemental enhancement information (SEI) messages for coded video bitstreams (VSEI) standard.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)2. Abbreviations
[0023] The following abbreviations may be used herein: adaptation parameter set (APS), access unit (AU), coded layer video sequence (CLVS), coded layer video sequence start (CLVSS), cyclic redundancy check (CRC), coded video sequence (CVS), finite impulse response (FIR), intra random access point (IRAP), network abstraction layer (NAL), neural-network post-processing filter (NNPF), neural-network post-filter activation (NNPFA), neural-network postfilter characteristics (NNPFC), picture parameter set (PPS), picture unit (PU), random access skipped leading (RASL) picture, supplemental enhancement information (SEI), step-wise temporal sublay er access (STSA), uniform resource identifier (URI), video coding layer (VCL). versatile supplemental enhancement information as described in Rec. ITU- T H.274 | ISO / IEC 23002-7 (VSEI), video usability information (VUI), versatile video coding as described in Rec. ITU- T H.266 | ISO / IEC 23090-3 (WC).3. Further discussion3.1 Video coding standards
[0024] Video coding standards have evolved primarily through the development of International Telecommunication Union (ITU) telecommunication standardization sector (ITU-T) and International Organization for Standardization (ISO) / International Electrotechnical Commission (IEC) standards. The ITU-T produced H.261 and H.263, ISO / IEC produced motion picture experts group (MPEG)-1 and MPEG-4 Visual, and the two organizations jointly produced the H.262 / MPEG-2 Video and H.264 / MPEG-4 Advanced Video Coding (AVC) and H.265 / high efficiency video coding (HE VC) [1] standards. Since H.262, the video coding standards are based on the hybrid video coding structure wherein temporal prediction plus transform coding are utilized. To explore video coding technologies beyond high efficiency video coding (HEVC), the Joint Video Exploration Team (JVET) was founded by video coding experts group (VCEG) and motion picture experts group (MPEG). Further, methods have been adopted by JVET and put into the reference software named Joint Exploration Model (JEM) [2], The JVET was later renamed to be the Joint Video Experts Team (JVET) when the Versatile Video Coding (WC) project officially started. WC [3] is a coding standard targeting a 50% bitrate reduction as compared to HEVC.
[0025] The Versatile Video Coding (WC) standard (ITU-T H.266 | ISO / IEC 23090-3) [3] and the associated Versatile Supplemental Enhancement Information for coded video bitstreams (VSEI) standard (ITU-T H.274 | ISO / IEC 23002-7) [4] are designed for use in a maximally broad range of applications, including both the simple uses such as television broadcast, video conferencing, or playback from storage media, and also more advanced use cases such as adaptive bit rate streaming, video region extraction, composition and merging of content from multiple coded video bitstreams, multiview video, scalable layered coding, and viewport-adaptive 360° immersive media.
[0026] The Essential Video Coding (EVC) standard (ISO / IEC 23094-1) is another video coding standard under development by MPEG.3.2 SEI messages in general and in WC and VSEI
[0027] SEI messages assist in processes related to decoding, display or other purposes. However, SEI messages are not required for constructing the luma or chroma samples by the decoding process. Conforming decoders are not required to process this information for output order conformance. Some SEI messages are required for checkingAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) bitstream conformance and for output timing decoder conformance. Other SEI messages are not required for check bitstream conformance.
[0028] Annex D of WC specifies syntax and semantics for SEI message payloads for some SEI messages, and specifies the use of the SEI messages and VUI parameters for which the syntax and semantics are specified in ITU-T H.274 | ISO / IEC 23002-7.3.3 Bitdepth range information message
[0029] In JVET-AI0182, a SEI message, denoted as a bitdepth range information message, was proposed and incorporated into the document of technologies under consideration for future extensions of VSEI[5], The major use case is to use a codec with low bitdepth support, e.g., 8-bit, to encode depth data, which are of high bitdepth to provide enough accuracy.The specification of the bitdepth range SEI message in JVET-AI2032 I4IU4 is as follows.8.44 Bitdepth range information SEI message8.44.1 Bitdepth range information SEI message syntaxAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)8.44.2 Bitdepth range information SEI message semantics
[0030] The Bitdepth range information (BRI) SEI message enables reconstruction of a target picture of the same bit depth as an original source picture by inverting operations performed by the encoder to allocate bit ranges of the original source picture to one or more ranges coded in separate layer pictures, subpictures, or constituent rectangles.
[0031] Use of this SEI message requires the definition of the following variables, where i is the layer identifier of a layer that may be present in the current CVS:- A chroma format indicator, denoted herein by ChromaFormatldcf i ], as described in clause 7.3.- A bit depth for the samples, denoted herein by BitDepthf i ].- An array of picture width and picture height in units of luma samples, denoted herein byPicWidthlnLumaSamplesf i ] and PicHeightlnLumaSamplesf i ], respectively.- An array of subpicture counts, denoted by NumSubpics[ i ].- Arrays of the width and height of the subpicturcs, denoted herein by SubPicWidth[ i ] [ j ] and SubPicHcightf i ] [ j ] respectively, where j is the subpicture index in 0 .. NumSubpics[ i ] - 1.
[0032] bri orig bit depth minusl plus 1 specifies the bit depth of the original picture.
[0033] The variable OrigBitDepth is set equal to bri orig bit depth minusl + 1.
[0034] bri num ranges minusl + 1 specifies the number of ranges used for allocating bits of the original picture.
[0035] The variable briNumRangcs is set equal to bri num ranges minus 1 + 1.
[0036] bri_nuli_layer_id_present_flag equal to 1 specifies that the bri_nuh_layer_id[ i ] syntax element is present in the SEI message. bri_nuh_layer_id_present_flag equal to 0 specifies that the bri_nuh_layer_id[ i ] syntax element is not present in the SEI message.
[0037] bri_pic_partition_flag equal to 1 specifies that the bri_partition_id[ i ] syntax element is present. bri_pic_partition_flag equal to 0 specifies that the bri_partition_id[ i ] syntax element is not present.
[0038] bri_partition_type_flag equal to 1 specifies that each range is coded as a constituent rectangle. bri_partition_typc_flag equal to 0 specifics that each range is coded as a subpicturc.
[0039] When bri_partition_type_flag equal to 1, it is a requirement of bitstream conformance that there is a constituent rectangles SEI message preceding the BRI SEI message in decoding order in the current PU.
[0040] bri_partition_id_len_minusl + 1 specifies the length of the bri_rect_id[ i ] and bri_subpic_id[ i ] syntax elements.
[0041] bri_nuh_layer_id[ i ], when present, specifies the layer identifier of the texture component of the i-th display overlay. When not present, the value of bri_nuh_layer_id[ i ] is inferred to be equal to the layer identifier of the PU containing the BDR SEI message.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0042] If this SET message is present in any layer in the current AU, it is a requirement of bitstream conformance that a BRI SEI message with the same payload is present in the layer with layer identifier bri_nuh_layer_id
[0000] .
[0043] bri_partition_id[ i ], when present and bri_partition_typc_flag equal to 1, specifics the cr_rcct_id[j ] ofthc texture component of the i-th display overlay. bri_partition_id[ i ], when present and bri_partition_type_flag equal to 0, specifies the subpicture index of the texture component of the i-th display overlay. When not present, the value of bri_partition_id[ i ] is inferred to be equal to 0.
[0044] When bri_partition type flag equal to 1, bri partition id [ i ] shall be in the range of 0 .. cr_num_rects_minusl [ bri_nuh_layer_id[ i ] ] - 1. When bri_partition_type_flag equal to 0, bri_partition_id[ i ] shall be in the range of 0 to NumSubpics[ bri_nuh_layer_id[ i ] ] - 1, inclusive.
[0045] bri_num_bits_in_range_minusl [ i ] + 1 specifies the number of bits in the i-th range, bri num bits in range minusl [ i ] shall be in the range of 0 to BitDepthf i ] - 1, inclusive.
[0046] The variable NumB its [ i ] is set equal to bri_num_bits_in_range_minusl[ i ] + 1.
[0047] The sum of bri num bits in range minusl [ i ] for i in 0 to bri num ranges minusl shall be less than or equal to OrigBitDepth.
[0048] bri_bit_offset[ i ] specifies a bit shifting parameter used to derive the target picture. bri_bit_offset[ i ] shall be in the range of 0 to BitDepth[ i ] - NumBits[ i ].
[0049] The variables CodedRangeRegionf i ] CodedWidthf i ], and CodedHeight[ i ] are derived as follows:- If bri_pic_partition_flag is equal to 0, the following applies:- CodedWidthf i ] is set equal to PicWidthInLumaSamples[ bri_niih_laycr_id| i ] ] ].- CodedHeight[ i ] is set equal to PicWidthInLumaSamples[ bri_nuh_layer_id[ i ] ].CodedRangeRegion[ i ] is set equal to the cropped decoded picture from the layer with layer identifier bri_nuh_layer_id[ i ] in the AU- Otherwise, if bri_partition_type_flag is equal to 0, the following applies:Coded Width, i ] is set equal to Sub Pic Width, bri nuh layer id [ i ] ][ bn partition id[ i ] ].CodedHeight[ i ] is set equal to SubPicHeight[ bri_nuh_layer_id[ i ] ][ bri_partition_id[ i ] ]. CodedRangeRegion[ i ] is set equal to the subpicture with subpicture index bri_partition_id[ i ] from the layer with layer identifier bri_nuh_layer_id[ i ].- Otherwise (bri_partition_type_flag is equal to 1), the following applies:- CodedWidthf i ] is set equal to CrRectWidthf bri_nuh_layer_id[ i ] ][ bri_rect_id[ i ] ].- CodedHeight[ i ] is set equal to CrRectHeight[ bri nuh lay er_id[ i ] ][ bri_rect_id[ i ] ].- CodedRangeRegionf i ] is set equal to the constituent rectangle with cr_rect_id[ j ] equal to bri_partition_id[ i ] from the layer with layer identifier bri_niih_laycr_id| i ].
[0050] It is a requirement of bitstream conformance that CodedWidth[ i ] equal CodedWidth[ j ] and CodedHeight[ i ] equal CodedHeight[ i ] for all i and j in 0 .. bri num ranges - 1.
[0051] The samples SampleToCode[ i ] of CodedRangeRegion[ i ], for i in 0 .. briNumRanges, are indicated to have been pre-processed prior to encoding from an original source picture of resolution CodedWidth
[0000] xAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)CodedHeight
[0000] with chroma format ChromaFormatldc and bit depth OrigBitDepth, according to the process of subclause 8.X.2. I.
[0052] Each sample, TargetSample, of a target picture of resolution CodedWidth
[0000] x CodedHeight
[0000] with chroma format ChromaFormatldc and bit depth OrigBitDepth, may be reconstructed using the Target sample reconstruction process described in subclause 8.X.2.2, for each sample, DecodedSample[ i ] of CodedRangeRegion[ i ] for i in 0 .. briNumRanges.8.X.2.1 Sample pre-process prior to encoding
[0053] The sample to code for the i-th range SampleToCodef i ] for i in 0 .. briNumRanges is derived as follows, with InputSample as the input sample: currOrigBitPos = 0 for (i = 0; i < briNumRanges; i++) { mask = ( 1 « NumBits[ i ] ) - 1 k = OrigBitDepth - currOrigBitPos - NumBits[ i ] shiftedlnput = InputSample » kSampleToCode[ i ] = ( shiftedlnput & mask ) « bri_bit_offset[ i ] currOrigBitPos += NumBits[ i ]}8.X.2.2 Target sample reconstruction process
[0054] The target sample TargetSample is derived as follows, with DecodedSample[ i ] as the decoded sample of the i-th range: currTargetBitPos = 0TargetSample = 0 for (i = 0; i < briNumRanges; i++) { k = OrigBitDepth - currTargetBitPos - NumBits[ i ] maxVal = (1 « ( NumBits[ i ] + bri_bit_offsct[ i ] ) ) - 1 if (bri_bit_offset[ i ] > 0) decRoundingOffset = 1« ( bri_bit_offset[ i ] - 1 ) else decRoundingOffset = 0 adjustedDecodedSample = Clip3( 0, maxVal, DecodedSample[ i ] + decRoundingOffset) shiftedDecodedSample = adjustedDecodedSample » bri bit offset! i 1 TargetSample += shiftedDecodedSample « kAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) currTargetBitPos += NumBits[ i ]}
[0055] At the 36th JVET meeting, multiple layers are supported in the constituent rectangle SEI message. In the bitdepth range information SEI message, bri partition typc llag is changed to bn partition typc idc.
[0056] An exemplary updated syntax and semantics of the updated BRI SEI are shown below:8.44.1 Bitdepth range information SEI message syntaxAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)8.44.2 Bitdepth range information SEI message semantics
[0057] The Bitdepth range information (BRI) SEI message enables reconstruction of a target picture of the same bit depth as an original source picture by inverting operations performed by the encoder to allocate bit ranges of the original source picture to one or more ranges coded in separate layer pictures, subpictures, or constituent rectangles.
[0058] Use of this SEI message requires the definition of the following variables, where i is the layer identifier of a layer that may be present in the current CVS:- A chroma format indicator, denoted herein by ChromaFormatldcf i ], as described in clause 7.3.- A bit depth for the samples, denoted herein by BitDepthf i ].- An array of picture width and picture height in units of luma samples, denoted herein byPicWidthlnLumaSamplesf i ] and PicHeightlnLumaSamplesf i ], respectively.- An array of subpicturc counts, denoted by NumSubpics[ i ].- Arrays of the width and height of the subpictures, denoted herein by SubPicWidth[ i ] [ j ] and SubPicHeightf i ] [ j ] respectively, where j is the subpicture index in 0 .. NumSubpics[ i ] - 1.
[0059] bri orig bit depth minusl plus 1 specifies the bit depth of the original picture.
[0060] The variable OrigBitDepth is set equal to bri orig bit depth minusl + 1.
[0061] bri num ranges minusl + 1 specifies the number of ranges used for allocating bits of the original picture.
[0062] The variable briNumRanges is set equal to bri num ranges minusl + 1.
[0063] bri_nuli_layer_id_present_flag equal to 1 specifies that the bri_nuh_layer_id[ i ] syntax element is present in the SEI message. bri_nuh_layer_id_present_flag equal to 0 specifies that the bri_nuh_layer_id[ i ] syntax element is not present in the SEI message.
[0064] bri_pic_partition_flag equal to 1 specifies that the bri_partition_id[ i ] syntax element is present. bri_pic_partition_flag equal to 0 specifies that the bri_partition_id[ i ] syntax element is not present.
[0065] It is a requirement of bitstream conformance that at least one of bri_nuh_laycr_id_prcscnt_flag or bri_pic_partition_flag shall be equal to 1 when bri num ranges minusl is greater than 0.
[0066] bri _partition_typc_idc equal to 0 specifies that each range is coded as a subpicture. bri_partition_type_idc equal to 1 specifies that each range is coded as a constituent rectangle. bri_partition_type_idc equal to 2 specifies that the partition information is explicitly defined, and the syntax elements bri partition top left _x[ i ], bri_partition_top_left_y[ i ]. bri_partition_width_minusl. bri_partition_height_minusl are present. Value 3 for bn partition typc idc is reserved for future use by ITU-T | ISO / IEC and shall not be present in bitstreams conforming to this version of this Specification. Decoders conforming to this version of this Specification shall ignore BRI SEI messages with bn partition typc idc equal to 3.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0067] When bri_partition_type_idc equal to 1, it is a requirement of bitstream conformance that there is a constituent rectangles SEI message preceding the BRI SEI message in decoding order in the current PU.
[0068] bri_partition_idx_lcn_minusl + 1 specifies the length of the bri_partition_idx[ i ].
[0069] bri_partition_param_length_minusl plus 1 specifies the length of the bri_partition_width_minusl, bri_partition_height_minusl, bri_partition_top_left_x[ i ]. bri_partition_top_left_y[ i ] syntax elements in bits.
[0070] bri_partition_width_minusl plus 1, when present, indicates the width of the partition, which is equal to the width of the target picture in luma samples that can be reconstructed from the allocated bit ranges described in this SEI message. The length of the syntax elements is bri_partition_param_length_minus l + 1 bits.
[0071] bri_partition_height_minusl plus 1, when present, indicates the height of the partition, which is equal to the height of the target picture in luma samples that can be reconstructed from the allocated bit ranges described in this SEI message. The length of the syntax elements is bri_partition_param_length_minusl + 1 bits.
[0072] bri_nuli_layer_id[ i ]. when present, specifies the layer identifier of the texture component of the i-th range. When not present, the value of bri_nuh_layer_id[ i ] is inferred to be equal to the layer identifier of the PU containing the BRI SEI message.
[0073] If this SEI message is present in any layer in the current AU, it is a requirement of bitstream conformance that a BRI SEI message with the same payload is present in the layer with layer identifier bri_nuh_layer_id
[0000] .
[0074] bri_partition_idx[ i ], when present and bn partition type idc equal to 1, specifies the constituent rectangle index for the i-th range. bri_partition_idx[ i ], when present and bri_partition_typc_idc equal to 0, specifies the subpicture index for the i-th range. When not present, the value of bri_partition_idx[ i ] is inferred to be equal to 0.
[0075] When bri_partition_type_idc is equal to 1, bri_partition_idx[ i ] shall be in the range of 0 to cr_num_rects_minusl [ bri_nuh_layer_id[ i ] ] - 1, inclusive. When bri_partition_type_idc equal to 0, bn partition idx[ i J shall be in the range of 0 to NumSubpics[ bri null layer id| i J J - 1. inclusive.
[0076] bri_partition_top_left_x[ i ], bri_partition_top_left_y[ i ] specify the horizontal and vertical positions, respectively, of the top left comer of the i-th partition in the coded picture, in luma samples. The length of the syntax elements is bri_partition_param_length_minusl + 1 bits.
[0077] bri_num_bits_in_range_minusl[ i ] + 1 specifies the number of bits in the i-th range, bri num bits in range minusl [ i ] shall be in the range of 0 to BitDepthf i ] - 1, inclusive.
[0078] The variable NumB its [ i ] is set equal to bri_num_bits_in_range_minusl [ i ] + 1.
[0079] The sum of bri num bits in range minusl [ i ] for i in 0 to bri num ranges minusl shall be less than or equal to OrigBitDepth.
[0080] bri_bit_offset[ i ] specifies a bit shifting parameter used to derive the target picture. bri_bit_offset[ i ] shall be in the range of 0 to BitDepthf i ] - NumBits[ i ].
[0081] The variables CodedRangeRegion[ i ] CodedWidth[ i ]. and CodedHeight[ i ] are derived as follows:- If bri_pic_partition_flag is equal to 0, the following applies:CodedWidth[ i ] is set equal to PicWidthInLumaSamples[ bri_nuh_layer_id[ i ] ] ].Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)CodedHeight[ i ] is set equal to PicWidthInLumaSamples[ bri_nuh_layer_id[ i ] ].CodedRangeRegion[ i ] is set equal to the cropped decoded picture from the layer with layer identifier bri_nuh_layer_id[ i ] in the AU- Otherwise, if bri_partition_type_idc is equal to 0, the following applies:- CodedWidth[ i ] is set equal to SubPicWidth[ bri_nuh_layer_id[ i ] ][ bri_partition_idx[ i ] ].- CodedHeight[ i ] is set equal to SubPicHeight[ bri_nuh_layer_id[ i ] ][ bri_partition_idx[ i ] ].- CodedRangeRegion[ i ] is set equal to the subpicture with subpicture index bri_partition_idx[ i ] from the layer with layer identifier bri_nuh_la cr_id| i ].- Otherwise (bri_partition_type_idc is equal to 1), the following applies:- CodedWidth[ i ] is set equal to CrRectWidth[ bri nuh lay er_id[ i ] ][ bri_rect_idx[ i ] ].CodedHeight[ i ] is set equal to CrRectHeight[ bri_nuh_layer_id[ i ] ][ bri_rect_idx[ i ] ].CodedRangeRegion[ i ] is set equal to the constituent rectangle with cr_rect_id[ j ] equal to bri_partition_idx[ i ] from the layer with layer identifier bri_nuh_layer_id[ i ].- Otherwise, if bn partition type ide is equal to 2, the following applies:CodedWidth[ i ] is set equal to bri_partition_width_minusl + 1. CodedHeight[ i ] is set equal to bri partition hcight minus 1 + 1.- CodedRangeRegion[ i ] is set equal to the region defined by CodedWidth[ i ] and CodedHeight[ i ] and bri_partition_top_left_x[ i ], bri_partition_top_left_y[ i ].
[0082] It is a requirement of bitstream conformance that CodedWidth[ i ] equal CodedWidth[j ] and CodedHeight[ i ] equal CodedHeight[ i ] for all i and j in 0 .. bri num ranges - 1.
[0083] The samples SampleToCode[ i ] of CodedRangeRegionf i ], for i in 0 .. briNumRanges, are indicated to have been pre-processed prior to encoding from an original source picture of resolution CodedWidth
[0000] x CodedHeightf 0 ] with chroma format ChromaFormatldc and bit depth OrigBitDepth, according to the process of subclause 8.X.2. I.
[0084] Each sample, TargetSample, of a target picture of resolution CodedWidthf 0 ] x CodedHeight
[0000] with chroma format ChromaFormatldc and bit depth OrigBitDepth, may be reconstructed using the Target sample reconstruction process described in subclause 8.X.2.2, for each sample, DecodedSample[ i ] of CodedRangeRegion[ i ] for i in 0 .. briNumRanges.4. Tcclmical problems addressed by disclosed embodiments
[0085] An example design for the n Bitdepth range information (BRI) SEI message has the following problems:
[0086] First, when the original source picture is of depth data, only the luma channel of the coded bitstream is used, while the chroma components may still be present and the bits for coding of the chroma components are purely wasted.
[0087] Second, when the original source picture chroma format is different from each range's chroma format, it is unclear how7to convert source picture to the data in each range. Also, some chroma format combinations may be problematic.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0088] Third, when bri_partition_flag is equal to 1 , the partition ID specifies the range's constituent rectangle ID, which may cost many bits. It is also not consistent with the case when bri_partition_flag is equal to 0.
[0089] Fourth, some syntax elements may be used while the values arc unspecified when the syntax elements arc not present, e.g., bri_nuh_layer_id_present flag, bri_pic_partition_flag and bri_partition_type_flag which max' cause unspecified behavior.
[0090] Fifth, some ranges may be overlapped. For example, when bri_nuli_layer_id[ i ] is equal to bri null layer id| j ] and bn partition idx[ i ] is equal to bri_partition idx[ j ]. ranges i and j are the same, while they cannot convey different data.
[0091] Sixth, the relationship betw een the sum of bitdepths of all ranges and the original source picture bitdepth are not specified or set properly.
[0092] Seventh, the range of bri bit offset is not set properly.
[0093] Eighth, when each range's signals are most significant bit aligned (MSB-aligned), which usually is more coding efficient, bri num bits in range minusl and bri bit offset are redundant. Here MSB-aligned means that for a range, the signals are filled from the most significant bit-plane to the least significant bit-plane.
[0094] Ninth, layer id is not needed in the BRI SEI message when constituent rectangles with multiple layer support are used.
[0095] Tenth, when subpicture is used in BRI SEI, for any two different ranges, layer ID and subpicture index shall not be the same.
[0096] Eleventh, when partition information is explicitly signalled, it may be out of picture range and different ranges may overlap.
[0097] Twelfth, the range of bri_partition_idx is not set properly when bri_partition_type_idc equal to 1.
[0098] Thirteenth, the semantics of bri_pic_partition_flag are not described correctly.
[0099] Fourteenth, currently, any two ranges do not have overlapped bit-planes, which is too restricted.
[0100] Fifteenth, when constituent rectangles are used by BRI. for some layers, there may be no constituent rectangle defined but used by a range.5. A listing of solutions and embodiments
[0101] To address at least some of the above-described problems, methods as summarized below are disclosed. The aspects should be considered as examples to explain the general concepts and should not be interpreted in a narrow way. Furthermore, these examples can be applied individually or combined in any manner.1) To address problem 1, one or more syntax elements may be used to specify which colour components are used to convey the original source picture information in a range. a. In one example, a component index may be signalled to indicate if a certain colour component is used to convey the original source picture in the current range. i. In one example, signalling of the component index may be conditioned by the chroma format of a range.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) ii. In one example, signalling of the component index may be conditioned by the chroma format of the original source picture. iii. In one example, when the component index is not present, its value is inferred to be equal to indicate only luma component is used. iv. Alternatively, in one example, when the component index is not present, its value is inferred to be equal to indicate all available components are used. b. In one example, an index may be signalled to indicate which one or two or all three colour components arc used to convey the original source picture in the current range. i. In one example, signalling of the index may be conditioned by the chroma format of a range. ii. In one example, signalling of the index may be conditioned by the chroma format of the original source picture. iii. In one example, when the index is not present, its value is inferred to be equal to indicate only luma component is used. iv. Alternatively, in one example, when the index is not present, its value is inferred to be equal to indicate all available components are used.2) To address problem 2, some combinations of the original source picture chroma format and the bitstream's chroma format may be disallowed. a. In one example, one or more syntax elements are used to indicate the original source picture's chroma format, denoted as OrigChromaFormatldc. i. In one example, a chroma format indicator is signalled to indicate the original source picture's chroma format. b. In one example, the SEI message only supports 4:0:0 original source picture, i.e., OrigChromaFormatldc being 0. c. In one example, it is required that each range's chroma format indicator, i.e., ChromaFormatIdc[ i ] shall be greater than or equal to OrigChromaFormatldc. d. In one example, when OrigChromaFormatldc is not equal to 0, i.e., indicating a non-4:0:0 chroma format, each range's chroma format indicator ChromaFonnatIdc[ i ] shall not be equal to 0. e. In one example, it is specified that the chroma format conversion from the original source picture to each range may be before the sample pre-process prior to encoding. i. Alternatively, in one example, it is specified that chroma format conversion from the original source picture to each range may be after the sample pre-process prior to encoding. f. In one example, it is specified that the chroma format conversion from each range to the original source picture may be after the target sample reconstruction process. i. Alternatively, in one example, it is specified that the chroma format conversion from each range to the original source picture may be after the target sample reconstruction process.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)3) To address problem 3, partition ID may be used to specify constituent rectangle index but not constituent rectangle ID. a. In one example, a syntax element is used to specify constituent rectangle index when bri_partition_type_flag indicates constituent rectangle. b. In one example, a syntax element is always used to specify index regardless of partition type.4) To address problem 4, one or more of the following aspects are specified: a. When not present, the value of bri_nuh_layer_id_present_flag is inferred to be equal to 0. i. Alternatively’, in one example, the inferred value is equal to 1. b. When not present, the value of bri_pic_partition_flag is inferred to be equal to 0. i. Alternatively , in one example, the inferred value is equal to 1. c. When not present, the value of bri_partition_type_flag is inferred to be equal to 0. i. Alternatively, in one example, the inferred value is equal to 1.5) To address problem 5, a constraint is imposed for two different ranges, so that when they have the same layer ID, they shall not have the same partition ID or partition index. a. In one example, it is specified that it is a requirement of bitstream conformance that, for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri_nuh_layer_id[ i ] is equal to bri_nuh_layer_id[ j ], bri_partition_id[ i ] shall not be equal to bri_partition_id[ j ].6) To address problem 6, it is specified that the sum of the number of bits of all ranges shall be less than or equal to the original source picture bitdepth.7) To address problem 7, it is specified that the bit shifting parameter value shall be in the range of 0 to the bitdepth of the decoded bitstream minus the number of bits of the current range, inclusive.8) To address problem 8, one or more of the folloyving aspects are specified: a. In one example, one or more syntax elements are signalled to indicate if each range's signals are of MSB-aligned or not. i. Alternatively, in one example, non MSB-aligned signals are not allowed in all ranges, i.e., every range's signals are of MSB-aligned. b. For MSB-aligned ranges, either bri num bits in range minusl or bri bit offset can be omitted in the bitstream and they can derived from each other. i. In one example, for a range, the number of bits may be omitted and derived by subtracting the bit offset from the bitdepth, i.e., bri num bits in range minusl is set equal to BitDepth - bri bit offset - 1. ii. In one example, for a range, the offset may be omitted and derived by subtracting the number of bits from the bitdepth, i.e., bri bit offset is set equal to BitDepth - ( bri num bits in range minusl + 1 ).9) To address problem 9, in one example, when bri partition typc idc indicates that constituent rectangles are used, layer ID should not be signalled and / or inferred.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) a. In one example, when bri_partition_type_idc is equal to 1. the value of bri_nuh_layer_id_present flag shall be equal to 0. b. In one example, when bri_partition_type_idc is not equal to 1 and bri_nuh_layer_id[ i ] is not present, the value of bri_nuh_layer_id[ i ] may be inferred.10) To address problem 10, in one example, when bri_partition_type_idc indicates that subpictures are used, any two different ranges shall not have the same layer ID and subpicture index. a. In one example, it is specified that for any two different values of i and j in the range of 0 to briNumRangcs - 1, inclusive, when bn partition ty pe idc is equal to 0 and bri_nuh_laycr_id[ i ] is equal to bri_nuh_layer_id[ j ]. bri_partition_idx[ i ] shall not be equal to bri_partition_idx[ j ]. b. Alternatively , in one example, it is specified that for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri_partition_type_idc is less than 2 and bri_nuh_layer_id[ i ] is equal to bri_nuli_layer_id[ j ], bri_partition_idx[ i ] shall not be equal to bri_partition_idx[ j ].11) To address problem 11. the following constraints may be specified. a. In one example, it is specified that the whole range shall be within the picture. b. In one example, it is specified that any example belongs to at most one range.12) To address problem 5, in one example, it is specified that for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri_nuh_layer_id[ i ] is equal to bri_nuh_layer_id[ j ], and both bri_partition_idx[ i ] and bri_partition_idx[ j ] are present, bri_partition_idx[ i ] shall not be equal to bri_partition_idx[ j ].13) To address problem 12, when bn partition ty pe idc is equal to 1, the following constraints may be specified. a. In one example, it is specified that cr_num_rects_in_layer_minusl [ bri_nuh_lay cr_id| i ] ] shall be present. b. In one example, it is specified that bri_partition_idx[ i ] shall be in the range of 0 to cr_num_rects_in_layer_minusl [ bri nuh lay er_id[ i ] ], inclusive.14) To address problem 13, in one example. bri_pic_partition_flag equal to 1 specifies that the bri_partition_idx[ i ] syntax element may be present in the SEI message. bri_pic_partition_flag equal to 0 specifies that the bri_partition_idx[ i ] syntax element is not present in the SEI message.15) To address problem 14. in one example, it is allowed that a bit-plane exists in two different ranges.16) To address problem 15, in one example, when a range corresponds to a constituent rectangle in a layer, the constituent rectangle shall have been described in a CR SEI message. a. In one example, when bn partition ty pe idc is equal to 1 , there shall be a constituent rectangles SEI message crSei that precedes the BRI SEI message in decoding order, and cr_num_rects_in_lay er_minusl [ idx ] for which cr_lay er_id[ idx ] is equal to bri_nuli_lay er_id| i ], for each i in the range of 0 to bri num ranges minusl, inclusive, shall be present in crSEI. b. Alternatively, in one example, when bri_partition_type_idc is equal to 1, there shall be a constituent rectangles SEI message crSei that precedes the BRI SEI message in decoding order, and there shallAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) be an entry of cr_layer_id[ idx ] in crSei. such that cr_layer_id[ idx ] is equal to bri_nuh_layer_id[ i ], for each i in the range of 0 to bri num ranges minusl, inclusive. c. In one example, when bri_partition_type_idc is equal to 1 , it is specified that bri_partition_idx[ i ] shall be in the range of 0 to cr num rects in layer minusl [ idx ], inclusive, for which the value if idx shall be such that cr_layer_id| idx ] is equal to bri_nuh_layer_id[ i ].6. Embodiments
[0102] Below are some example embodiments for the aspects summarized in section 5. Most relevant parts that have been added or modified are shown enclosed in double braces (i.e., {{a}} indicates that ‘a’ is added), and some of the deleted parts are shown enclosed in triple brackets (i.e., [[[a]]] indicates that ‘a' is deleted). There may be some other changes that are editorial in nature and thus not highlighted.6.1 Embodiment 1
[0103] This embodiment covers the aspects for items 1, l a, l.a.i, l.a.ii, l.a.iii, 2, 2. a, 2 d., 2.e., 2.f.8.44.1 Bitdepth range information SEI message syntaxAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)8.44.2 Bitdepth range information SEI message semantics
[0104] bri orig bit depth minusl plus 1 specifies the bit depth of the original picture.
[0105] The variable OrigBitDepth is set equal to bri orig bit depth minusl + 1.
[0106] {{bri orig chroma format idc specifies the chroma format of the original source picture.}}
[0107] bri_partition_id[ i ], when present and bri_partition_type_flag equal to 1, specifies the cr rect idfj ] ofthe texture component of the i-th display overlay. bri_partition_id[ i ], when present and bri_partition_type_flag equal to 0, specifies the subpicture index of the texture component of the i-th display overlay’. When not present, the value of bri_partition_id[ i ] is inferred to be equal to 0.
[0108] When bri_partition_type_flag equal to 1, bri_partition_id[ i ] shall be in the range of 0 .. cr num rects minusl f bri nuh layer idf i ] ] - 1. When bri_partition_type_flag equal to 0, bri_partition_id[ i ] shall be in the range of 0 to NumSubpics[ bri nuh layer idf i ] ] - 1, inclusive.
[0109] {{bri comp idxf i ], when bri orig chroma format idc is equal to 0, specifies the colour component index of the i-th range. The value of bri comp idxf i ] shall be in the range of 0 to 2, inclusive. When not present, the value of bri comp idxf i ] is inferred to be equal to 0.}}
[0110] It is a requirement of bitstream conformance that CodedWidthf i ] {{shall be}} equal {{to}} CodedWidth[j ] and CodedHeightf i ] {{shall be}} equal { {to}} CodedHeightf [ffi]]] {{j} } ] for all i and j in [[[0 .. bri num ranges - 1]]] {{the range of 0 to briNumRanges - 1. inclusive.}}
[0111] {{When bri orig chroma format idc is equal to 0, the samples SampleToCode[ i ] of the colour component indicated by bri comp idxf i ] of CodedRangeRegionf i ], for i in the range of 0 to briNumRanges - 1, inclusive, are indicated to have been pre-processed prior to encoding from an original source picture of resolution CodedWidth
[0000] by CodedHeightf 0 ] with chroma format ChromaFormatldc being 0 and bit depth OrigBitDepth, according to the process of subclause 8.X.2.I. Each sample, TargetSample, of a target picture of resolution CodedWidth
[0000] by CodedHeight
[0000] with chroma format ChromaFormatldc being 0 and bit depth OrigBitDepth, may be reconstructed using the target sample reconstruction process described in subclause 8.X.2.2, for each sample, DecodedSamplef i ] of the colour component indicated by bri comp idxf i ] of CodedRangeRegionf i ] for i in the range of 0 to briNumRanges - 1, inclusive.}}
[0112] { {When bri orig chroma format idc is not equal to 0. it is a requirement of bitstream conformance thatChromaFormatldcf i ], for i in the range of 0 to briNumRanges - 1, inclusive, shall not be 0.}} The samples SampleToCodef i ] of CodedRangeRegionf i ]. for i in [[[0 .. briNumRanges]]] {{the range of 0 to briNumRanges - 1, inclusive}}, are indicated to have been pre-processed prior to encoding from an original source picture of resolution Coded Widthf 0 ] x CodedHeightf 0 ] with chroma format ChromaFormatldc {{after a chroma format conversionAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) process}} and bit depth OrigBitDepth. according to the process of subclause 8.X.2.1. Each sample. TargetSample, of a target picture of resolution CodedWidth
[0000] x CodedHeightf 0 ] with chroma format ChromaFormatldc and bit depth OrigBitDepth, may be reconstructed using the Target sample reconstruction process described in subclause 8.X.2.2, for each sample, DecodedSamplef i ] of CodedRangeRegionf i ] for i in [[[0 .. briNumRanges]]] {{the range of 0 to briNumRanges - 1, inclusive. A chroma format conversion process from the chroma format being ChromaFormatldc} i ], for i in the range of 0 to briNumRanges - 1, inclusive, to the chroma format being ChromaFormatldc may be followed.}}6.2 Embodiment 2
[0113] This embodiment covers the aspects for items 3, 3. a, 3.b.8.44.1 Bitdepth range information SEI message syntax8.44.2 Bitdepth range information SEI message semantics
[0114] bri_partition_id{ {x}}_len_minusl + 1 specifies the length, {{in bits.}} of the }[}bri_rect_id[ i J and bri subpic id} i ] ]]] { {bri_partition_idx[ i ]}} syntax elements.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0115] bri _nuh_layer_id[ i ], when present, specifies the layer identifier of the texture component of the i-th display overlay. When not present, the value of bri_nuh_layer_id[ i ] is inferred to be equal to the layer identifier of the PU containing the BDR SEI message.
[0116] If this SEI message is present in any layer in the current AU, it is a requirement of bitstream conformance that a BRI SEI message with the same payload is present in the layer with layer identifier bri_nuh_layer_id
[0000] .
[0117] bri_partition_id{ {x}}[ i ], when present and bri_partition_type_flag equal to 1, specifies the 11 |cr rcct id| j ] ]]] { {constituent rectangle index} } of the texture component of the i-th [[[display overlay]]] { {range} }. bri_partition_id{{x}}[ i ]. when present and bri_partition_type_flag equal to 0, specifies the subpicture index of the texture component of the i-th [[[display overlay ]]] {{range}}. When not present, the value of bri_partition_id {{x}}[ i ] is inferred to be equal to 0.
[0118] When bri_partition_type_flag {{is}} equal to 1, bri_partition_id{{x}}[ i ] shall be in the range of 0 {{.. to}} cr_num_rects_minusl [ bri_nuh_layer_id[ i ] ] - 1, {{inclusive} }. When bri_partition_type_flag {{is}} equal to 0, bri_partition_id{{x}}[ i ] shall be in the range of 0 to NumSubpics[ bri_nuh_laycr_id| i ] ] - 1, inclusive.6.3 Embodiment 3
[0119] This embodiment covers the aspects for items 4, 4.a, 4.b.8.44.2 Bitdepth range information SEI message semantics
[0120] bri_nuh_layer_id_present_flag equal to 1 specifies that the bri_nuh_layer_id[ i ] syntax element is present in the SEI message. bri_nuh_layer_id_present_flag equal to 0 specifies that the bri_nuh_layer_id[ i ] syntax element is not present in the SEI message. {{When not present, the value of bri_nuh_laycr_id_prcscnt_flag is inferred to be equal to 0.}}
[0121] bri_pic_partition_flag equal to 1 specifies that the bri_partition_id[ i ] syntax element is present. bri_pic_partition_flag equal to 0 specifies that the bri_partition_id[ i ] syntax element is not present. { {When not present, the value of bri pic partition flag is inferred to be equal to 0.} }
[0122] bri_partition_type_flag equal to 1 specifies that each range is coded as a constituent rectangle, bri parti tion_typc_nag equal to 0 specifies that each range is coded as a subpicture. { {When not present, the value of bri_partition_type_flag is inferred to be equal to 0.}}
[0123] When bri partition typc fiag equal to 1, it is a requirement of bitstream conformance that there is a constituent rectangles SEI message preceding the BRI SEI message in decoding order in the current PU.6.4 Embodiment 4
[0124] This embodiment covers the aspects for items 5.8.44.2 Bitdepth range information SEI message semanticsAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0125] bri_partition_id[ i ], when present and bri partition typc flag equal to 1 , specifies the cr_rect_id[ j ] of the texture component of the i-th display overlay. bri_partition_id[ i ], when present and bri_partition_type_flag equal to 0, specifies the subpicture index of the texture component of the i-th display overlay. When not present, the value of bri_partition_id[ i ] is inferred to be equal to 0.When bri_partition_type_riag equal to 1, bri_partition_id[ i ] shall be in the range of 0 cr_num_rects_minusl [ bri_nuh_layer_id[ i ] ] - 1. When bri_partition_type_flag equal to 0, bri_partition_id[ i ] shall be in the range of 0 to NumSubpics[ bri_nuh_layer_id[ i ] ] - 1, inclusive.
[0126] {{It is a requirement of bitstream conformance that, for any two different values of i and j in the range of 0 to briNumRanges - 1. inclusive, when bri_nuh_layer_id[ i ] is equal to bri_nuh_layer_id[ j ], bri_partition_id[ i ] shall not be equal to bri_partition_id[ j ]. } }6.5 Embodiment 5
[0127] This embodiment covers the aspects for items 6.8.44.2 Bitdepth range information SEI message semantics
[0128] The sum of [[[bri_num_bits_in_range_minusl [ i ] ]]] {{NumBits[ i ]}} for i in {{the range of}} 0 to bri num ranges minusl, {{inclusive,}} shall be less than or equal to OrigBitDepth.6.6 Embodiment 6
[0129] This embodiment covers the aspects for items 7.8.44.2 Bitdepth range information SEI message semantics
[0130] bri_bit_offset[ i ] specifies a bit shifting parameter used to derive the target picture. bri_bit_offset[ i ] shall be in the range of 0 to BitDepth[ i ] - NumBits[ i ]{{, inclusive} }.6.7 Embodiment 7
[0131] This embodiment covers items 9, 9.a, 9.b, 10, 10. a. The text changes are based on the updated BRI SEI text in section 3.3.8.44.1 Bitdepth range information SEI message syntaxAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)8.44.2 Bitdepth range information SEI message semantics bri_nuh_layer_id_present_flag equal to 1 specifies that the bri_nuh_layer_id[ i ] syntax element is present in the SEI message. bri_nuh_layer_id_present flag equal to 0 specifies that the bri_nuli_layer_id[ i ] syntax element is not present in the SEI message. { {When bri_partition_type_idc is equal to 1, bri_nuh_layer_id_present_flag shall be equal to 0. }}Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) bri nuh layer idf i ]. when present, specifies the layer identifier of the texture component of the i-th range. When not present {{and bri_partition_type_idc is not equal to 1 }}, the value of bri nuh layer idf i ] is inferred to be equal to the layer identifier of the PU containing the BRI SET message.If this SEI message is present in any layer in the current AU, it is a requirement of bitstream conformance that a BRI SEI message with the same payload is present in the lax er with lax er identifier bri nuh layer idf 0 ]. bri_partition_idx[ i ], when present and bri partition typc idc equal to 1, specifies the constituent rectangle index for the i-th range. bri_partition_idx[ i ], when present and bri_partition_type_idc equal to 0, specifies the subpicture index for the i-th range. When not present, the value of bri_partition_idx[ i ] is inferred to be equal to 0.When bri_partition_type_idc is equal to 1, bri_partition_idx[ i ] shall be in the range of 0 to cr_num_rects_minusl [ bri_nuli_layer_id[ i ] ] - 1, inclusive. When bri_partition_type_idc equal to 0, bri parti tion idx | i ] shall be in the range of 0 to NumSubpics[ bri nuh layer idf i ] ] - 1. inclusive.{{It is a requirement of bitstream conformance that, for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri_partition_type_idc is equal to 0 and bri nuh layer idf i ] is equal to bri null layer id [j ]. bn partition idxf i ] shall not be equal to bn partition idxf j ].} }6.8 Embodiment 8
[0132] This embodiment covers items 11. a, l l.b. The text changes are based on the updated BRI SEI text in section 3.3.8.44.2 Bitdepth range information SEI message semantics- Otherwise, if bri_partition_type_idc is equal to 2, the following applies:- CodedWidthf i ] is set equal to bri_partition_width_minusl + 1.CodedHeight[ i ] is set equal to bri_partition_height_minus 1 + 1.CodedRangeRegion[ i ] is set equal to the region defined by CodedWidth[ i ] and CodedHeight[ i ] and bri_partition_top_left_x[ i ], bri_partition_top_left_y[ i ].{ {Let MaxPicWidth
[0001] and MaxPicHeightf 1 ] denote the maximum picture width and maximum picture height in units of luma samples of layer 1.It is a requirement of bitstream conformance that for the i-th range, bri_partition_top_left_x[ i ] + CodedWidthf i ] shall be less than or equal to MaxPicWidthf 1 ], bri_partition_top_left_y[ i ] + CodedHeightf i ] shall be less than or equal to MaxPicHeightf 1 ], where 1 is the layer at which the i-th range is.It is a requirement of bitstream conformance that for any sample (x, y), it belongs to at most one range.}}It is a requirement of bitstream conformance that CodedWidthf i ] equal CodedWidthf j ] and CodedHeightf i ] equal CodedHeightf i ] for all i and j in 0 .. bri num ranges - 1.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)6.9 Embodiment 9
[0133] This embodiment covers the items 12, 13, 13. a, 13.b, 14. The text changes are based on JVET-AJ2032- v2.8.44.2 Bitdepth range information SEI message semantics bri_pic_partition_flag equal to 1 specifies that the bri_partition_idx[ i ] syntax element {{max’ be}} [[[is]]] present in the SEI message. bri_pic_partition_flag equal to 0 specifies that the bri_partition_idx[ i ] syntax element is not present in the SEI message. When not present, the value of bri_pic_partition_flag is inferred to be equal to 0. bri_nuli_layer_id_present_flag equal to 1 specifies that the bri_nuli_layer_id[ i ] syntax element is present in the SEI message. bri_nuh_layer_id_present_flag equal to 0 specifies that the bri_nuli_layer_id[ i ] syntax element is not present in the SEI message. bri_nuli_layer_id[ i ], when present, specifies the layer identifier of the texture component of the i-th range. When not present, the value of bri nuh lax er_id[ i ] is inferred to be equal to the layer identifier of the PU containing the BRI SEI message.If this SEI message is present in any layer in the current AU, it is a requirement of bitstream conformance that a BRI SEI message with the same payload is present in the lax er with lax er identifier bri_nuh_layer_id
[0000] . bri_partition_idx[ i ], when present and bri_partition_type_idc equal to 1, specifies the constituent rectangle index for the i-th range. bri_partition_idx[ i ], when present and bri_partition_type_idc equal to 0, specifies the subpicture index for the i-th range. When not present, the value of bri_partition_idx[ i ] is inferred to be equal to 0.When bri_partition_type_idc is equal to 1, {{cr_num_rects_in_layer_minusl [ bri_nuh_layer_id[ i ] ] shall be present in the constituent rectangles SEI message and} } bri_partition_idx[ i ] shall be in the range of 0 to cr_num_rects_{{in_layer}}_minusl [ bri_nuh_layer_id[ i ] ] [[[- 1]]], inclusive. When bri_partition_type_idc equal to 0, bri_partition_idx[ i ] shall be in the range of 0 to NumSubpicsf bri_nuh_layer_id[ i ] ] - 1, inclusive.It is a requirement of bitstream conformance that, for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri nuh layer id[ i ] is equal to bri nuh layer id[ j ] {{, and both bri_partition_idx[ i ] and bri_partition_idx[ j ] are present}}, bri_partition_idx[ i ] shall not be equal to bri_partition_idx [ j ] .6.10 Embodiment 10
[0134] This embodiment covers items 16, 16. a, 16. c. The text changes arc based on JVET-AJ2032-v2.8.44.2 Bitdepth range information SEI message semantics bri_partition_type_idc equal to 0 specifies that each range is coded as a subpicture. bri_partition_type_idc equal to 1 specifies that each range is coded as a constituent rectangle. bri_partition_type_idc equal to 2 specifies that the partition information is explicitly defined, and the syntax elements bri_partition_top_left_x[ i ], bri_partition_top_left_y [ i ],Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) bri_partition_width_minusl, bri_partition_height_minusl are present. Value 3 for bri_partition_type_idc is reserved for future use by ITU-T | ISO / IEC and shall not be present in bitstreams conforming to this version of this Specification. Decoders conforming to this version of this Specification shall ignore BRI SEI messages with bri_partition_type_idc equal to 3.[[[When bri_partition_type_idc equal to 1, it is a requirement of bitstream conformance that there is a constituent rectangles SEI message preceding the BRI SEI message in decoding order in the current PU.]]]{ {When bn_partition_typc_idc is equal to 1, it is a requirement of bitstream conformance that both of the following shall be true:- There is a constituent rectangles SEI message crSei that precedes the BRI SEI message in decoding order.- cr num rects in layer minus 1 [ idx ] for which cr_layer_id[ idx ] is equal to bri_nuh_layer_id[ i ], for each i in the range of 0 to bri num ranges minus 1. inclusive, shall be present in crSEI. } } bri_partition_idx[ i ], when present and bri_partition_type_idc equal to 1, specifies the constituent rectangle index for the i-th range. bri_partition idx[ i ], when present and bn partition type ide equal to 0, specifies the subpicture index for the i-th range. When not present, the value of bri_partition_idx[ i ] is inferred to be equal to 0.When bri partition typc idc is equal to 1, bri_partition_idx[ i ] shall be in the range of 0 to cr_num_rects_{ {in layer} { minus 1 [ idx ] [[[- 1]]], inclusive{{, for which the value of idx shall be such that cr_layer_id[ idx ] is equal to bri_nuh_layer_id[ i ] } } . When bri parti tion typc idc equal to 0, bri_partition_idx[ i ] shall be in the range of 0 to NumSubpics[ bri_nuh_layer_id[ i ] ] - 1, inclusive.7. References[1] ITU-T and ISO / IEC, ‘‘High efficiency video coding”, Rec. ITU-T H.265 | ISO / IEC 23008-2 (in force edition).[2] Rec. ITU-T H.266 | ISO / IEC 23090-3, “Versatile Video Coding”, 2022.[3] Rec. ITU-T Rec. H.274 | ISO / IEC 23002-7, “Versatile Supplemental Enhancement Information Messages for Coded Video Bitstreams”, 2023.[4] S. McCarthy, J. Boyce, J. Chen. S. Deshpande. M. M. Hannuksela, H. Tan, Y.-K. Wang (editors), “Technologies under consideration for future extensions of VSEI (version 5),” JVET output document JVET-AI2032, publicly available online herein: https: / / jvet-experts.org / doc_end_user / documents / 35_Sapporo / wgl l / JVET-AI2032-v2.zip
[0135] FIG. 1 is a block diagram showing an example video processing system 4000 in which various embodiments disclosed herein may be implemented. Various implementations may include some or all of the components of the system 4000. The system 4000 may include input 4002 for receiving video content. The video content may be received in a raw or uncompressed format, e.g., 8- or 10-bit multi-component pixel values, or may be in a compressed or encoded format. The input 4002 may represent a network interface, a peripheral bus interface, or a storage interface. Examples of network interface include wired interfaces such as Ethernet, passive optical network (PON), etc. and wireless interfaces such as Wi-Fi or cellular interfaces.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0136] The system 4000 may include a coding component 4004 that may implement the various coding or encoding methods described in the present disclosure. The coding component 4004 may reduce the average bitrate of video from the input 4002 to the output of the coding component 4004 to produce a coded representation of the video. The coding techniques are therefore sometimes called video compression or video transcoding techniques. The output of the coding component 4004 may be either stored, or transmitted via a communication connected, as represented by the component 4006. The stored or communicated bitstream (or coded) representation of the video received at the input 4002 may be used by a component 4008 for generating pixel values or displayable video that is sent to a display interface 4010. The process of generating user- viewable video from the bitstream representation is sometimes called video decompression. Furthermore, while certain video processing operations are referred to as “‘coding” operations or tools, it will be appreciated that the coding tools or operations are used at an encoder and corresponding decoding tools or operations that reverse the results of the coding will be performed by a decoder.
[0137] Examples of a peripheral bus interface or a display interface may include universal serial bus (USB) or high definition multimedia interface (HDMI) or DisplayPort, and so on. Examples of storage interfaces include serial advanced technology attachment (SATA), peripheral component interconnect (PCI), integrated drive electronics (IDE) interface, and the like. The embodiments described in the present disclosure may be embodied in various electronic devices such as mobile phones, laptops, smartphones or other devices that are capable of performing digital data processing and / or video display.
[0138] FIG. 2 is a block diagram of an example video processing apparatus 4100. The apparatus 4100 may be used to implement one or more of the methods described herein. The apparatus 4100 may be embodied in a smartphone, tablet, computer, Internet of Things (loT) receiver, and so on. The apparatus 4100 may include one or more processors 4102, one or more memories 4104 and video processing circuitry 4106. The processor(s) 4102 may be configured to implement one or more methods described in the present disclosure. The memory (memories) 4104 may be used for storing data and code used for implementing the methods and embodiments described herein. The video processing circuitry 4106 may be used to implement, in hardware circuitry', some embodiments described in the present disclosure. In some embodiments, the video processing circuitry 4106 may be at least partly' included in the processor 4102, e g., a graphics co-processor.
[0139] FIG. 3 is a flowchart for an example method 4200 of video processing. The method 4200 determines one or more syntax elements in a BRI SEI message specify- which colour components are used to convey an original source picture information in a range at step 4202. A conversion is performed between a visual media data and a bitstream based on the BRI SEI message at step 4204. The conversion may include encoding at an encoder, decoding at a decoder, or combinations thereof.
[0140] It should be noted that the method 4200 can be implemented in an apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, such as video encoder 4400, video decoder 4500, and / or encoder 4600. In such a case, the instructions upon execution by the processor, cause the processor to perform the method 4200. Further, the method 4200 can be performed by a non-transitory computer readable medium comprising a computer program product for use by- a video coding device. The computer program product comprisesAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) computer executable instructions stored on the non-transitory computer readable medium such that when executed by a processor cause the video coding device to perform the method 4200.
[0141] FIG. 4 is a block diagram that illustrates an example video coding system 4300 that may utilize the embodiments of this disclosure. The video coding system 4300 may include a source device 4310 and a destination device 4320. Source device 4310 generates encoded video data which may be referred to as a video encoding device. Destination device 4320 may decode the encoded video data generated by source device 4310 which may be referred to as a video decoding device.
[0142] Source device 4310 may include a video source 4312. a video encoder 4314. and an input / output (I / O) interface 4316. Video source 4312 may include a source such as a video capture device, an interface to receive video data from a video content provider, and / or a computer graphics system for generating video data, or a combination of such sources. The video data may comprise one or more pictures. Video encoder 4314 encodes the video data from video source 4312 to generate a bitstream. The bitstream may include a sequence of bits that form a coded representation of the video data. The bitstream may include coded pictures and associated data. The coded picture is a coded representation of a picture. The associated data may include sequence parameter sets, picture parameter sets, and other sy ntax structures. I / O interface 4316 may include a modulator / demodulator (modem) and / or a transmitter. The encoded video data may be transmitted directly to destination device 4320 via I / O interface 4316 through network 4330. The encoded video data may also be stored onto a storage medium / server 4340 for access by destination device 4320.
[0143] Destination device 4320 may include an I / O interface 4326, a video decoder 4324, and a display device 4322. I / O interface 4326 may include a receiver and / or a modem. I / O interface 4326 may acquire encoded video data from the source device 4310 or the storage medium / server 4340. Video decoder 4324 may decode the encoded video data. Display device 4322 may display the decoded video data to a user. Display device 4322 may be integrated with the destination device 4320. or may be external to destination device 4320, which can be configured to interface with an external display device.
[0144] Video encoder 4314 and video decoder 4324 may operate according to a video compression standard, such as the High Efficiency Video Coding (HEVC) standard, Versatile Video Coding (WC) standard and other current and / or further standards.
[0145] FIG. 5 is a block diagram illustrating an example of video encoder 4400, which may be video encoder 4314 in the system 4300 illustrated in FIG. 4. Video encoder 4400 may be configured to perform any or all of the embodiments of this disclosure. The video encoder 4400 includes a plurality of functional components. The embodiments described in this disclosure may be shared among the various components of video encoder 4400. In some examples, a processor may be configured to perform any or all of the embodiments described in this disclosure.
[0146] The functional components of video encoder 4400 may include a partition unit 4401; a prediction unit 4402, which may include a mode select unit 4403, a motion estimation unit 4404, a motion compensation unit 4405, and an intra prediction unit 4406; a residual generation unit 4407; a transform processing unit 4408; a quantization unit 4409 ; an inverse quantization unit 4410 ; an inverse transform unit 4411 ; a reconstruction unit 4412 ; a buffer 4413; and an entropy encoding unit 4414.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0147] In other examples, video encoder 4400 may include more, fewer, or different functional components. Tn an example, prediction unit 4402 may include an intra block copy (IBC) unit. The IBC unit may perform prediction in an IBC mode in which at least one reference picture is a picture where the current video block is located.
[0148] Furthermore, some components, such as motion estimation unit 4404 and motion compensation unit 4405 may be highly integrated, but are represented in the example of video encoder 4400 separately for purposes of explanation.
[0149] Partition unit 4401 may partition a picture into one or more video blocks. Video encoder 4400 and video decoder 4500 may support various video block sizes.
[0150] Mode select unit 4403 may select one of the coding modes, intra or inter, e g., based on error results, and provide the resulting intra or inter coded block to a residual generation unit 4407 to generate residual block data and to a reconstruction unit 4412 to reconstruct the encoded block for use as a reference picture. In some examples, mode select unit 4403 may select a combination of intra and inter prediction (CIIP) mode in which the prediction is based on an inter prediction signal and an intra prediction signal. Mode select unit 4403 may also select a resolution for a motion vector (e g., a sub-pixel or integer pixel precision) for the block in the case of inter prediction.
[0151] To perform inter prediction on a current video block, motion estimation unit 4404 may generate motion information for the current video block by comparing one or more reference frames from buffer 4413 to the current video block. Motion compensation unit 4405 may determine a predicted video block for the current video block based on the motion information and decoded samples of pictures from buffer 4413 other than the picture associated with the current video block.
[0152] Motion estimation unit 4404 and motion compensation unit 4405 may perform different operations for a current video block, for example, depending on whether the current video block is in an I slice, a P slice, or a B slice.
[0153] In some examples, motion estimation unit 4404 may perform uni-directional prediction for the current video block, and motion estimation unit 4404 may search reference pictures of list 0 or list 1 for a reference video block for the current video block. Motion estimation unit 4404 may then generate a reference index that indicates the reference picture in list 0 or list 1 that contains the reference video block and a motion vector that indicates a spatial displacement between the current video block and the reference video block. Motion estimation unit 4404 may output the reference index, a prediction direction indicator, and the motion vector as the motion information of the current video block. Motion compensation unit 4405 may generate the predicted video block of the current block based on the reference video block indicated by the motion information of the current video block.
[0154] In other examples, motion estimation unit 4404 may perform bi-directional prediction for the current video block, motion estimation unit 4404 may7search the reference pictures in list 0 for a reference video block for the current video block and may also search the reference pictures in list 1 for another reference video block for the current video block. Motion estimation unit 4404 may then generate reference indexes that indicate the reference pictures in list 0 and list 1 containing the reference video blocks and motion vectors that indicate spatial displacements between the reference video blocks and the current video block. Motion estimation unit 4404 may output the reference indexes and the motion vectors of the current video block as the motion information of the current video block. Motion compensation unit 4405Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) may generate the predicted video block of the current video block based on the reference video blocks indicated by the motion information of the current video block.
[0155] In some examples, motion estimation unit 4404 may output a full set of motion information for decoding processing of a decoder. In some examples, motion estimation unit 4404 may not output a full set of motion information for the current video. Rather, motion estimation unit 4404 may signal the motion information of the current video block with reference to the motion information of another video block. For example, motion estimation unit 4404 max’ determine that the motion information of the current video block is sufficiently similar to the motion information of a neighboring video block.
[0156] In one example, motion estimation unit 4404 may indicate, in a syntax structure associated with the current video block, a value that indicates to the video decoder 4500 that the current video block has the same motion information as another video block.
[0157] In another example, motion estimation unit 4404 may identify, in a syntax structure associated with the current video block, another video block and a motion vector difference (MVD). The motion vector difference indicates a difference betw een the motion vector of the current video block and the motion vector of the indicated video block. The video decoder 4500 may use the motion vector of the indicated video block and the motion vector difference to determine the motion vector of the current video block.
[0158] As discussed above, video encoder 4400 may predictively signal the motion vector. Two examples of predictive signaling techniques that may be implemented by video encoder 4400 include advanced motion vector prediction (AMVP) and merge mode signaling.
[0159] Intra prediction unit 4406 may perform intra prediction on the current video block. When intra prediction unit 4406 performs intra prediction on the current video block, intra prediction unit 4406 may generate prediction data for the current video block based on decoded samples of other video blocks in the same picture. The prediction data for the current video block may include a predicted video block and various syntax elements.
[0160] Residual generation unit 4407 may generate residual data for the current video block by subtracting the predicted video block(s) of the current video block from the current video block. The residual data of the current video block may include residual video blocks that correspond to different sample components of the samples in the current video block.
[0161] In other examples, there may be no residual data for the current video block for the current video block, for example in a skip mode, and residual generation unit 4407 may not perform the subtracting operation.
[0162] Transform processing unit 4408 may generate one or more transform coefficient video blocks for the current video block by applying one or more transforms to a residual video block associated with the current video block.
[0163] After transform processing unit 4408 generates a transform coefficient video block associated with the current video block, quantization unit 4409 may quantize the transform coefficient video block associated with the current video block based on one or more quantization parameter (QP) values associated with the current video block.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0164] Inverse quantization unit 4410 and inverse transform unit 441 1 may apply inverse quantization and inverse transforms to the transform coefficient video block, respectively, to reconstruct a residual video block from the transform coefficient video block. Reconstruction unit 4412 may add the reconstructed residual video block to corresponding samples from one or more predicted video blocks generated by the prediction unit 4402 to produce a reconstructed video block associated with the current block for storage in the buffer 4413.
[0165] After reconstruction unit 4412 reconstructs the video block, the loop filtering operation may be performed to reduce video blocking artifacts in the video block.
[0166] Entropy encoding unit 4414 may receive data from other functional components of the video encoder 4400. When entropy encoding unit 4414 receives the data, entropy encoding unit 4414 may perform one or more entropy encoding operations to generate entropy encoded data and output a bitstream that includes the entropy encoded data.
[0167] FIG. 6 is a block diagram illustrating an example of video decoder 4500 which may be video decoder 4324 in the system 4300 illustrated in FIG. 4. The video decoder 4500 may be configured to perform any or all of the embodiments of this disclosure. In the example shown, the video decoder 4500 includes a plurality of functional components. The embodiments described in this disclosure may be shared among the various components of the video decoder 4500. In some examples, a processor may be configured to perform any or all of the embodiments described in this disclosure.
[0168] In the example shown, video decoder 4500 includes an entropy decoding unit 4501. a motion compensation unit 4502, an intra prediction unit 4503, an inverse quantization unit 4504, an inverse transformation unit 4505, a reconstruction unit 4506, and a buffer 4507. Video decoder 4500 may, in some examples, perform a decoding pass generally reciprocal to the encoding pass described with respect to video encoder 4400.
[0169] Entropy decoding unit 4501 may retrieve an encoded bitstream. The encoded bitstream may include entropy’ coded video data (c.g., encoded blocks of video data). Entropy decoding unit 4501 may decode the entropy coded video data, and from the entropy decoded video data, motion compensation unit 4502 may determine motion information including motion vectors, motion vector precision, reference picture list indexes, and other motion information. Motion compensation unit 4502 may, for example, determine such information by performing the AMVP and merge mode.
[0170] Motion compensation unit 4502 may produce motion compensated blocks, possibly performing interpolation based on interpolation filters. Identifiers for interpolation filters to be used with sub-pixel precision may be included in the syntax elements.
[0171] Motion compensation unit 4502 may use interpolation filters as used by video encoder 4400 during encoding of the video block to calculate interpolated values for sub-integer pixels of a reference block. Motion compensation unit 4502 may determine the interpolation filters used by video encoder 4400 according to received syntax information and use the interpolation filters to produce predictive blocks.
[0172] Motion compensation unit 4502 may use some of the syntax information to determine sizes of blocks used to encode frame(s) and / or slice(s) of the encoded video sequence, partition information that describes how each macroblock of a picture of the encoded video sequence is partitioned, modes indicating how each partition is encoded,Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) one or more reference frames (and reference frame lists) for each inter coded block, and other information to decode the encoded video sequence.
[0173] Intra prediction unit 4503 may use intra prediction modes for example received in the bitstream to form a prediction block from spatially adjacent blocks. Inverse quantization unit 4504 inverse quantizes, i.e., de-quantizes, the quantized video block coefficients provided in the bitstream and decoded by entropy decoding unit 4501. Inverse transform unit 4505 applies an inverse transform.
[0174] Reconstruction unit 4506 may sum the residual blocks with the corresponding prediction blocks generated by motion compensation unit 4502 or intra prediction unit 4503 to form decoded blocks. If desired, a deblocking filter may also be applied to filter the decoded blocks in order to remove blockiness artifacts. The decoded video blocks are then stored in buffer 4507, which provides reference blocks for subsequent motion compensation / intra prediction and also produces decoded video for presentation on a display device.
[0175] FIG. 7 is a schematic diagram of an example encoder 4600. The encoder 4600 is suitable for implementing the techniques of WC. The encoder 4600 includes three in-loop filters, namely a deblocking filter (DF) 4602, a sample adaptive offset (SAG) 4604, and an adaptive loop filter (ALF) 4606. Unlike the DF 4602, which uses predefined filters, the SAO 4604 and the ALF 4606 utilize the original samples of the current picture to reduce the mean square errors between the original samples and the reconstructed samples by adding an offset and by applying a finite impulse response (FIR) filter, respectively, with coded side information signaling the offsets and filter coefficients. The ALF 4606 is located at the last processing stage of each picture and can be regarded as a tool hying to catch and fix artifacts created by the previous stages.
[0176] The encoder 4600 further includes an intra prediction component 4608 and a motion estimation / compensation (ME / MC) component 4610 configured to receive input video. The intra prediction component 4608 is configured to perform intra prediction, while the ME / MC component 4610 is configured to utilize reference pictures obtained from a reference picture buffer 4612 to perform inter prediction. Residual blocks from inter prediction or intra prediction are fed into a transform (T) component 4614 and a quantization (Q) component 4616 to generate quantized residual transform coefficients, which are fed into an entropy coding component 4618. The entropy coding component 4618 entropy codes the prediction results and the quantized transform coefficients and transmits the same toward a video decoder (not shown). Quantization components output from the quantization component 4616 may be fed into an inverse quantization (IQ) components 4620, an inverse transform component 4622, and a reconstruction (REC) component 4624. The REC component 4624 is able to output images to the DF 4602, the SAO 4604, and the ALF 4606 for filtering prior to those images being stored in the reference picture buffer 4612.
[0177] A listing of solutions preferred by some examples is provided next.
[0178] The following solutions show examples of embodiments discussed herein.
[0179] 1. A method for processing media data comprising: determining one or more syntax elements in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specify which colour components are used to convex' an original source picture information in a range; and performing a conversion between a visual media data and a bitstream based on the BRI SEI message.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0180] 2. The method of solution 1 , wherein a component index is signalled in the BRI SEI message to indicate when a certain colour component is used to convey an original source picture in a current range.
[0181] 3. The method of any of solutions 1-2, wherein signalling of the component index is conditional based one a chroma format of a range or the chroma format of an original source picture, or wherein when the component index is not present, a value of the component index is inferred to indicate only a luma component is used or to indicate that all available components are used.
[0182] 4. The method of any of solutions 1-3, wherein an index is signalled in the BRI SEI message to indicate which of one or more colour components are used to convey the original source picture in the current range.
[0183] 5. The method of any of solutions 1-4, wherein signalling of the index is conditional based one a chroma format of a range or the chroma format of an original source picture, or wherein when the index is not present, a value of the index is inferred to indicate only a luma component is used or to indicate that all available components are used.
[0184] 6. The method of any of solutions 1-5, wherein one or more combinations of a picture chroma format of the original source picture chroma format and a chroma format of the bitstream are disallowed.
[0185] 7. The method of any of solutions 1-6. wherein one or more syntax elements, denoted asOrigChromaFormatldc. are used in the BRI SEI message to indicate the original source picture's chroma format, or wherein a chroma format indicator is signalled in the BRI SEI message to indicate the original source picture's chroma format.
[0186] 8. The method of any of solutions 1-7, wherein the BRI SEI message only supports a 4:0:0 original source picture where OrigChromaFormatldc is 0.
[0187] 9. The method of any of solutions 1-8, wherein each range's chroma format indicator, denoted asChromaFormatIdc[ i ], shall be greater than or equal to OrigChromaFormatldc.
[0188] 10. The method of any of solutions 1-9, wherein when OrigChromaFormatldc is not equal to 0. whereOrigChromaFormatldc indicates a non-4:0:0 chroma format, each range's chroma format indicator ChromaFormatIdc[ i ] shall not be equal to 0.
[0189] 11. The method of any of solutions 1-10, wherein a chroma format conversion from the original source picture to each range is performed before a sample pre-process prior to encoding, or wherein a chroma fonnat conversion from the original source picture to each range is performed after the sample pre-process prior to encoding.
[0190] 12. The method of any of solutions 1-11. wherein a chroma format conversion from each range to the original source picture is performed after a target sample reconstruction process, or wherein the chroma format conversion from each range to the original source picture is performed after the target sample reconstruction process.
[0191] 13. The method of any of solutions 1-12, wherein a partition identifier (ID) in the BRI SEI message specifies a constituent rectangle index but not a constituent rectangle ID.
[0192] 14. The method of any of solutions 1-13, wherein a syntax element in the BRI SEI message specifies a constituent rectangle index when bri_partition_type_flag indicates a constituent rectangle.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)
[0193] 15. The method of any of solutions 1 -14, wherein , a syntax element in the BRI SEI message is always used to specify an index regardless of a partition type.
[0194] 16. The method of any of solutions 1-15, wherein when not present, a value of a bri_nuh_layer_id_present_flag in the BRI SEI message is inferred to be equal to 0 or is inferred to be equal to 1, or wherein when not present, a value of a bri_pic_partition_flag in the BRI SEI message is inferred to be equal to 0 or is inferred to be equal to 1, or wherein when not present, a value of a bri_partition_type_flag in the BRI SEI message is inferred to be equal to 0 or is inferred to be equal to 1.
[0195] 17. The method of any of solutions 1-16, wherein a constraint is imposed for two different ranges, so that when the two different ranges have a same layer ID, the two different ranges shall not have a same partition ID or a same partition index.
[0196] 18. The method of any of solutions 1-17, wherein for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri_nuh_layer_id[ i ] is equal to bri_nuh_layer_id[ j ], bri_partition_id[ i ] shall not be equal to bri_partition_id[ j ].
[0197] 19. The method of any of solutions 1-18, wherein a sum of a number of bits of all ranges shall be less than or equal to the original source picture bitdepth.
[0198] 20. The method of any of solutions 1-19, wherein a bit shifting parameter value shall be in the range of 0 to the bitdepth of a decoded bitstream minus a number of bits of the current range, inclusive.
[0199] 21. The method of any of solutions 1-20, wherein one or more syntax elements are signalled in the BRISEI message to indicate when each range's signals are of MSB-aligned or not, or wherein non MSB-aligned signals are not allow ed in all ranges such that every range's signals arc of MSB-aligned.
[0200] 22. The method of any of solutions 1-21, wherein bri num bits in range minusl is omitted from the bitstream and bri num bits in range minusl is derived from bri bit offset, or wherein bri bit offset is omitted from the bitstream and bri bit offset is derived from bri num bits in range minusl.
[0201] 23. The method of any of solutions 1-22, wherein for a range, a number of bits is omitted and derived by subtracting a bit offset from a bitdepth such that bri num bits in range minus 1 is set equal to BitDepth - bri bit offset - 1.
[0202] 24. The method of any’ of solutions 1-23, wherein for a range, the offset is omitted and derived by’ subtracting a number of bits from a bitdepth such that bri bit offset is set equal to BitDepth - ( bri num bits in range minusl + 1 ).
[0203] 25. An apparatus for processing video data comprising: a processor; and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to perform the method of any of solutions 1-24.
[0204] 26. A non-transitory computer readable medium comprising a computer program product for use by a video coding device, the computer program product comprising computer executable instructions stored on the nonAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) transitory computer readable medium such that when executed by a processor cause the video coding device to perform the method of any of solutions 1-24.
[0205] 27. A non -Iran si ton computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises: determining one or more syntax elements in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specify which colour components are used to convey an original source picture information in a range; and generating a bitstream based on the determining.
[0206] 28. A method for storing bitstream of a video comprising: determining one or more syntax elements in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specify’ which colour components are used to convey an original source picture information in a range; generating a bitstream based on the determining; and storing the bitstream in a non-transitory computer-readable recording medium.
[0207] 29. A method, apparatus, or system described in the present disclosure.
[0208] In the solutions described herein, an encoder may conform to the format rule by producing a coded representation according to the format rule. In the solutions described herein, a decoder may use the format rule to parse syntax elements in the coded representation with the know ledge of presence and absence of syntax elements according to the fonnat rule to produce decoded video.
[0209] In the present disclosure, the term "video processing” may refer to video encoding, video decoding, video compression or video decompression. For example, video compression algorithms max' be applied during conversion from pixel representation of a video to a corresponding bitstream representation or vice versa. The bitstream representation of a current video block may, for example, correspond to bits that are either co-located or spread in different places within the bitstream, as is defined by the syntax. For example, a macroblock may be encoded in terms of transformed and coded error residual values and also using bits in headers and other fields in the bitstream. Furthermore, during conversion, a decoder may parse a bitstream with the knowledge that some fields may be present, or absent, based on the determination, as is described in the above solutions. Similarly, an encoder may determine that certain syntax fields are or are not to be included and generate the coded representation accordingly by including or excluding the syntax fields from the coded representation.
[0210] The disclosed and other solutions, examples, embodiments, modules and the functional operations described in this disclosure can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this disclosure and their structural equivalents, or in combinations of one or more of them. The disclosed and other embodiments can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a computer readable medium for execution by, or to control the operation of, data processing apparatus. The computer readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter effecting a machine- readable propagated signal, or a combination of one or more them. The term “data processing apparatus” encompasses all apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, or multiple processors or computers. The apparatus can include, in addition to hardw are, code that createsAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) an execution environment for the computer program in question, e.g.. code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them. A propagated signal is an artificially generated signal, e g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to suitable receiver apparatus.
[0211] A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and it can be deploy ed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g.. one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g.. files that store one or more modules, sub programs, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
[0212] The processes and logic flows described in this disclosure can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC).
[0213] Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read only memory or a random-access memory or both. The essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e g., magnetic, magneto optical disks, or optical disks. However, a computer need not have such devices. Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memory', media and memory' devices, including by way of example semiconductor memory' devices, e.g., erasable programmable read-only' memory (EPROM), electrically erasable programmable read-only' memory (EEPROM), and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto optical disks; and compact disc read-only memory (CD ROM) and Digital versatile disc-read only memory (DVD-ROM) disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
[0214] While the present disclosure contains many specifics, these should not be construed as limitations on the scope of any subject matter or of what may be claimed, but rather as descriptions of features that may be specific to particular embodiments of the present disclosure. Certain features that are described in the present disclosure in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodimentsAtty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W) separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
[0215] Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Moreover, the separation of various system components in the embodiments described in the present disclosure should not be understood as requiring such separation in all embodiments.
[0216] Only a few implementations and examples are described and other implementations, enhancements and variations can be made based on what is described and illustrated in the present disclosure.
[0217] A first component is directly coupled to a second component when there are no intervening components, except for a line, a trace, or another medium between the first component and the second component. The first component is indirectly coupled to the second component when there are intervening components other than a line, a trace, or another medium between the first component and die second component. The term “coupled’' and its variants include both directly coupled and indirectly coupled. The use of the term “about” means a range including ±10% of the subsequent number unless otherwise stated.
[0218] While several embodiments have been provided in the present disclosure, it should be understood that the disclosed systems and methods might be embodied in many other specific forms without departing from the spirit or scope of the present disclosure. The present examples are to be considered as illustrative and not restrictive, and the intention is not to be limited to the details given herein. For example, the various elements or components may be combined or integrated in another system or certain features may be omitted, or not implemented.
[0219] In addition, techniques, systems, subsystems, and methods described and illustrated in the various embodiments as discrete or separate may be combined or integrated with other systems, modules, techniques, or methods without departing from the scope of the present disclosure. Other items shown or discussed as coupled may be directly connected or may be indirectly coupled or communicating through some interface, device, or intermediate component whether electrically, mechanically, or otherwise. Other examples of changes, substitutions, and alterations are ascertainable by one skilled in the art and could be made without departing from the spirit and scope disclosed herein.
Claims
Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)CLAIMSWhat is claimed is:
1. A method for processing media data, comprising: determining a partition identifier (ID) in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specifies a constituent rectangle index but not a constituent rectangle ID; and. performing a conversion between a visual media data and a bitstream based on the BRI SEI message.
2. The method of claim 1, wherein a syntax element in the BRI SEI message specifies a constituent rectangle index when bri_partition_type_flag indicates a constituent rectangle.
3. The method of any of claims 1-2, wherein a syntax element in the BRI SEI message is always used to specify an index regardless of a partition type.
4. The method of any of claims 1 -3, wherein when not present, a value of a bri_nuh_layer_id_present_flag in the BRI SEI message is inferred to be equal to 0 or is inferred to be equal to 1.
5. The method of any of claims 1-4, wherein when not present, a value of a bri_pic_partition_flag in the BRI SEI message is inferred to be equal to 0 or is inferred to be equal to 1.
6. The method of any of claims 1-5, wherein w hen not present, a value of a bri partitioii typc flag in the BRI SEI message is inferred to be equal to 0 or is inferred to be equal to 1.
7. The method of any of claims 1-6, wherein a constraint is imposed for two different ranges, such that when the two different ranges have a same layer ID, the two different ranges shall not have a same partition ID or a same partition index.
8. The method of any of claims 1-7, wherein for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri_nuh_layer_id[ i ] is equal to bri_nuh_layer_id[ j ], bri_partition_id[ i ] shall not be equal to bri_partition_id[ j ].
9. The method of any of claims 1-8, wherein a layer ID is not signalled or inferred when a value of bri_partition_type_idc in the BRI SEI message indicates that constituent rectangles are used.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)10. The method of any of claims 1-9, wherein when bri_partition_type_idc is equal to 1, the value of bri_nuh_layer_id_present_flag shall be equal to 0.
11. The method of any of claims 1-10, wherein when bri_partition_type_idc is not equal to 1 and bri_nuh_layer_id[ i ] is not present, the value of bri_nuh_layer_id[ i ] is inferred.
12. The method of any of claims 1-11, wherein when bri partition type idc indicates that subpicturcs are used, any two different ranges shall not have the same layer ID and subpicturc index.
13. The method of any of claims 1-12, wherein for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri_partition_type_idc is equal to 0 and bri_nuh_layer_id[ i ] is equal to bri_nuh_layer_id[ j ]. bri_partition_idx[ i ] shall not be equal to bri_partition_idx[ j ].
14. The method of any of claims 1-13, wherein for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, when bri_partition_type_idc is less than 2 and bri_nuh_layer_id[ i ] is equal to bri_nuh_layer_id[ j ], bri_partition_idx[ i ] shall not be equal to bri_partition_idx[ j ].
15. The method of any of claims 1-14, wherein all of a range is within a picture, or wherein a given example belongs to at most one range.
16. The method of any of claims 1-15, wherein for any two different values of i and j in the range of 0 to briNumRanges - 1, inclusive, whenbri_nuh_layer_id[ i ] is equal to bri_nuh_layer_id[j ], and both bri_partition_idx[ i ] and bri_partition_idx[ j ] are present, bri_partition_idx[ i ] shall not be equal to bri_partition_idx[ j ].
17. The method of any of claims 1-16, wherein when bri_partition_type_idc is equal to 1, cr_num_rects_in_layer_minusl[ bri_nuh_layer_id[ i ] ] shall be present in the BRI SEI message, or wherein when bri_partition_type_idc is equal to 1, bri_partition_idx[ i ] shall be in the range of 0 to cr num rects in layer minus If bri nuh layer id [ i 1 1, inclusive.
18. The method of any of claims 1-17, wherein bri_pic_partition_flag being equal to 1 specifies that the bri_partition_idx[ i ] syntax element may be present in the BRI SEI message.
19. The method of any of claims 1-18, wherein bri_pic_partition_flag being equal to 0 specifies that the bri_partition_idx[ i ] syntax element is not present in the BRI SEI message.Atty. Dkt. No.: 4824-58804 (P24082428499WO1; G25N20987W)20. The method of any of claims 1-19, wherein the conversion includes encoding the visual media data into the bitstream.
21. The method of any of claims 1-19, wherein the conversion includes decoding the visual media data from the bitstream.
22. An apparatus for processing video data comprising: a processor; and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to perform the method of any of claims 1-21.
23. A non-transitory computer readable medium comprising a computer program product for use by a video coding device, the computer program product comprising computer executable instructions stored on the non-transitory computer readable medium such that when executed by a processor cause the video coding device to perform the method of any of claims 1-21.
24. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises: determining a partition identifier (ID) in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specifies a constituent rectangle index but not a constituent rectangle ID; and generating a bitstream based on the determining.
25. A method for storing bitstream of a video comprising: determining a partition identifier (ID) in a bitdepth range information (BRI) supplemental enhancement information (SEI) message specifies a constituent rectangle index but not a constituent rectangle ID; generating a bitstream based on the determining; and storing the bitstream in a non-transitory computer-readable recording medium.
Citation Information
Patent Citations
Video encoding / decoding method, apparatus, and recording medium having bitstream stored thereon
US20220109846A1
Method and apparatus for video encoding and decoding
WO2022268608A2
Method, apparatus, and medium for video processing
WO2024145229A1