Syntax for signaling video subpictures

By modifying the coding of sps_num_subpics_minus1 and conditionally signaling subpicture IDs, the limitations of VVC subpicture signaling are addressed, enabling efficient handling of multiple subpictures and reducing coding overhead in video encoding and decoding.

JP7949134B2Active Publication Date: 2026-11-11BYTEDANCE INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2025172473
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-12-27
Filing Date
2025-10-14
Publication Date
2026-11-11
Estimated Expiration
2040-12-27

AI Technical Summary

Technical Problem

Existing video coding standards like VVC face issues with signaling subpictures, tiles, and slices, including limitations on the number of subpictures per picture, redundancy in syntactic elements, and inefficient handling of subpicture IDs, leading to undesirable modifications and coding overhead.

Method used

Modify the coding of sps_num_subpics_minus1 to ue(v) to allow more than 256 subpictures per picture, conditionally signal subpic_id_present_flag, remove subpicture IDs from the picture header, and adjust the signaling of subpicture IDs and slice addresses to eliminate redundancy and inefficiencies.

Benefits of technology

Enhances the flexibility and efficiency of subpicture signaling in VVC, allowing for more subpictures without unnecessary modifications and reducing coding overhead, thereby optimizing video encoding and decoding processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007949134000018
    Figure 0007949134000018
  • Figure 0007949134000019
    Figure 0007949134000019
  • Figure 0007949134000020
    Figure 0007949134000020
Patent Text Reader

Abstract

To provide a method for signaling usage of sub-pictures in coded video pictures.SOLUTION: One example method of video processing includes performing a conversion between a video and a bitstream of the video, wherein the bitstream conforms to a format rule, wherein the format rule specifies that a first syntax element signaled in a sequence parameter set (SPS) of the bitstream indicates a length of an identifier of a subpicture in the SPS, and wherein a signaling of the first syntax element is independent of a value of a second syntax element that indicates an explicit signaling of the identifier of the subpicture in the SPS or a picture parameter set (PPS).SELECTED DRAWING: Figure 10
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] Cross-Reference to Related Applications Under applicable patent laws and / or regulations in accordance with the Paris Convention, this application is made to timely claim the priority and benefit of U.S. Provisional Patent Application No. 62 / 954,364 filed on December 27, 2019. For all purposes under the law, the entire disclosure of the aforementioned application is incorporated by reference as part of the disclosure of this application.

[0002] This specification relates to image and video coding and decoding. BACKGROUND ART

[0003] Digital video accounts for the largest bandwidth usage on the Internet and other digital communication networks. As the number of connected user devices capable of receiving and displaying video increases, bandwidth demand for digital video utilization is expected to continue to rise. SUMMARY OF THE INVENTION

[0004] This specification discloses methods, apparatuses and systems for subpicture signaling that can be used by a video encoder and a video decoder respectively for video encoding and decoding.

[0005] In one exemplary aspect, a video processing method is disclosed. The method includes performing a conversion between a video comprising pictures and a bitstream of the video, wherein the number of subpictures in a picture is signaled in a sequence parameter set (SPS) of the bitstream as a field whose bit width is based on the value of the number of subpictures, and the field is a syntax element coded with a left-bit-first unsigned integer 0th-order Exponential-Golomb (Exp-Golomb) code.

[0006] In another exemplary embodiment, a video processing method is disclosed, which comprises performing a conversion between a video and a bitstream of the video, wherein the bitstream conforms to a format rule, which specifies that the picture parameter set (PPS) of the bitstream conditionally includes a first syntactic element indicating whether the pictures of the video can be partitioned, a second syntactic element indicating whether sub-picture identifiers are signaled in the PPS, and a third syntactic element indicating the number of sub-pictures in the PPS.

[0007] In yet another exemplary embodiment, a video processing method is disclosed. The method comprises performing a conversion between a video and a video bitstream, wherein the bitstream conforms to a format rule, which specifies that a first syntactic element indicating whether the video's pictures can be partitioned is included in the picture parameter set (PPS) of the bitstream prior to a set of syntactic elements in the PPS indicating identifiers of the subpictures of the picture.

[0008] In yet another exemplary embodiment, a video processing method is disclosed. The method comprises performing a conversion between a video region of a video and a bitstream of a video, wherein the bitstream conforms to a format rule, which specifies that a first syntactic element indicating whether information of a subpicture identifier is included in the bitstream's parameter set is conditionally included in the sequence parameter set (SPS) based on the value of a second syntactic element indicating whether information of the subpicture is included in the SPS.

[0009] In yet another exemplary embodiment, a video processing method is disclosed. The method comprises performing a conversion between a picture of a video and a bitstream of a video, the bitstream conforming to a format rule, the format rule specifying a mapping between identifiers of one or more subpictures of the picture, one or more subpictures not included in the picture header of the picture, and the format rule further specifying that the identifiers of one or more subpictures are derived based on syntactic elements of a sequence parameter set (SPS) and a picture parameter set (PPS) referenced by the picture.

[0010] In yet another exemplary embodiment, a video processing method is disclosed. The method comprises performing a conversion between a video and a bitstream of the video, the bitstream conforming to a format rule, the format rule specifying that the mapping between a subpicture identifier and one or more subpictures of a picture is signaled in either a sequence parameter set (SPS) or a picture parameter set (PPS) if the value of a first syntactic element indicates that the mapping between a subpicture identifier and one or more subpictures of the picture is explicitly signaled for one or more subpictures.

[0011] In yet another exemplary embodiment, a video processing method is disclosed. The method comprises performing a conversion between video and a video bitstream, the bitstream conforming to format rules, the format rules specifying that signaling the length of subpicture identifiers in a sequence parameter set (SPS) is not based on the value of a syntactic element indicating whether the identifier is signaled in the SPS.

[0012] In yet another exemplary embodiment, a video processing method is disclosed. The method comprises performing a conversion between a video and a video bitstream, the bitstream conforming to a format rule, the format rule specifying that the length of a subpicture identifier in the picture parameter set (PPS) is signaled by a syntactic element indicating that the identifier is explicitly signaled in the PPS.

[0013] In yet another exemplary embodiment, a video processing method is disclosed. The method comprises performing a conversion between a video and a video bitstream, the bitstream conforming to a format rule, the format rule specifying that a first syntactic element signaled in the bitstream's sequence parameter set (SPS) indicates the length of a subpicture identifier in the SPS, and the signaling of the first syntactic element is independent of the value of a second syntactic element indicating explicit signaling of a subpicture identifier in the SPS or picture parameter set (PPS).

[0014] In yet another exemplary embodiment, a video encoder device is disclosed. The video encoder has a processor configured to implement the method described above.

[0015] In yet another exemplary embodiment, a video decoder device is disclosed. The video decoder has a processor configured to implement the method described above.

[0016] In yet another exemplary embodiment, a computer-readable medium containing code is disclosed. The code embodies one of the methods described herein in the form of processor-executable code.

[0017] These and other features will be described throughout this specification. [Brief explanation of the drawing]

[0018] [Figure 1]An example of partitioning a picture using luma coding tree units (CTUs) is shown.

[0019] [Figure 2] Another example of partitioning a picture using luma CTUs is shown.

[0020] [Figure 3] An exemplary partitioning of a picture is shown.

[0021] [Figure 4] Another exemplary partitioning of a picture is shown.

[0022] [Figure 5] This is a block diagram of an exemplary video processing system in which the disclosed techniques may be implemented.

[0023] [Figure 6] This is a block diagram of an exemplary hardware platform used for video processing.

[0024] [Figure 7] This is a block diagram illustrating a video coding system according to some embodiments of the present disclosure.

[0025] [Figure 8] This is a block diagram illustrating an encoder according to some embodiments of the present disclosure.

[0026] [Figure 9] This is a block diagram illustrating a decoder according to some embodiments of the present disclosure.

[0027] [Figure 10] A flowchart of an exemplary method for video processing is shown.

[0028] [Figure 11]A flowchart illustrating an exemplary method of video processing is shown.

[0029] [Figure 12] A flowchart illustrating an exemplary method of video processing is shown. [Modes for carrying out the invention]

[0030] Section headings are used herein for the purpose of facilitating understanding and do not limit the applicability of the technologies and embodiments disclosed in each section to that section only. Furthermore, H.266 terminology is used solely for the purpose of facilitating understanding and does not limit the scope of the disclosed technologies. Thus, the technologies described herein are also applicable to other video codec protocols and designs.

[0031] 1. Overview This specification relates to video coding techniques, specifically to the signaling of subpictures, tiles, and slices. These ideas can be applied individually or in various combinations to any video coding standard or non-standard video codec that supports multi-layer video coding, such as the Versatile Video Coding (VVC) currently under development. 2. Abbreviations APS Adaptive Parameter Set AU Access Unit AUD Access Unit Delimiter AVC Advanced Video Coding CLVS Coded Layer Video Sequence CPB (Coded Picture Buffer) CRA (Clean Random Access) CTU Coding Tree Unit CVS Coded Video Sequence DPB (Decoded Picture Buffer) DPS Decoding Parameter Set EOB (End of Bitstream) EOS (End of Sequence) GDR Gradual Decoding Refresh HEVC (High Efficiency Video Coding) HRD (Hypothetical Reference Decoder) IDR Instantaneous Decoding Refresh JEM Joint Exploration Model MCTS Motion-Constrained Tile Sets NAL (Network Abstraction Layer) OLS Output Layer Set PH Picture Header PPS Picture Parameter Set PTL Profile, Tier, and Level PU Picture Unit RBSP Raw Byte Sequence Payload SEI Supplemental Enhancement Information SPS Sequence Parameter Set SVC (Scalable Video Coding) VCL Video Coding Layer VPS Video Parameter Set VTM (VVC Test Model) VUI (Video User Interface) Video Usability Information VVC (Versatile Video Coding)

[0032] 3. Initial discussion Video coding standards have primarily evolved through the development of well-known ITU-T and ISO / IEC standards. ITU-T created H.261 and H.263, ISO / IEC created MPEG-1 and MPEG-4 Visual, and the two organizations jointly developed the H.262 / MPEG-2 Video, H.264 / MPEG-4 Advanced Video Coding (AVC), and H.265 / HEVC standards. Since H.262, video coding standards have been based on a hybrid video coding structure, utilizing temporal prediction and transformation coding. To explore future video coding technologies beyond HEVC, the Joint Video Exploration Team (JVET) was jointly established by VCEG and MPEG in 2015. Since then, many new methods have been adopted by JVET and incorporated into reference software called the Joint Exploration Model (JEM). JVET meetings are held quarterly, and new coding standards aim for a 50% bitrate reduction compared to HEVC. The new video coding standard was officially named Multipurpose Video Coding (VVC) at the JVET meeting in April 2018, and the first version of the VVC Test Model (VTM) was released at that time. Due to ongoing efforts to contribute to VVC standardization, new coding techniques are being adopted into the VVC standard at each JVET meeting. The VVC Working Draft and Test Model VTM are subsequently updated at each meeting. The VVC project is currently aiming for Technical Filling Inspection (FDIS) at the July 2020 meeting.

[0033] 3.1. Picture Partitioning Scheme in HEVC HEVC includes four different picture partitioning schemes: normal slice, dependent slice, tile, and wavefront parallel processing (WPP), which can be applied for maximum transmission unit (MTU) size matching, parallel processing, and end-to-end latency reduction.

[0034] Normalized slices are similar to those in H.264 / AVC. Each normalized slice is encapsulated in its own NAL unit, and in-picture predictions (intra-sample predictions, motion information predictions, coding mode predictions) and entropy coding dependencies across slice boundaries are disabled. Therefore, normalized slices can be reconstructed independently of other normalized slices within the same picture (however, interdependencies may still exist due to loop filtering operations).

[0035] Normalized slicing is the only tool available for parallelization, and it is available in almost the same format in H.264 / AVC. Parallelization based on normalized slicing requires little inter-processor or inter-core communication (typically much heavier for in-picture prediction, except for inter-processor or inter-core data sharing for motion compensation when decoding predictively coded pictures). However, for the same reasons, using normalized slicing can result in considerable coding overhead due to the bit cost of the slice header and the lack of prediction across slice boundaries. Furthermore, normalized slicing (in contrast to the other tools described below) also functions as a key mechanism for bitstream partitioning to accommodate MTU size requirements, due to the in-picture independence of normalized slicing and the fact that each normalized slice is encapsulated in its own NAL unit. Often, the goals of parallelization and MTU size matching impose conflicting demands on the slice layout in the picture. Recognizing this situation led to the development of the parallelization tools described below.

[0036] Dependent slices have a short slice header and allow for the partitioning of the bitstream at tree block boundaries without any interruption to in-picture prediction. Essentially, dependent slices provide fragmentation of a canonical slice into multiple NAL units to reduce end-to-end latency by allowing a portion of the canonical slice to be sent before the encoding of the entire canonical slice is complete.

[0037] In WPP, a picture is partitioned into single-row coding tree blocks (CTBs). Entropy decoding and prediction are made possible by using data from CTBs in other partitions. Parallel processing is possible by parallel decoding of CTB rows, and the start of decoding a CTB row is delayed by two CTBs, thereby ensuring that data related to the CTB to the upper right of the subject CTB is available before the subject CTB is decoded. Using this staggered start (which looks like a wavefront graphically), a picture can be parallelized across up to the number of processors / cores that contain the CTB rows. Since in-picture prediction is possible between adjacent tree block rows within a picture, the inter-processor / inter-core communication required to enable in-picture prediction may be sufficient. WPP partitioning does not result in the generation of additional NAL units compared to when it is not applied, and therefore WPP is not a tool for MTU size matching. However, if MTU size matching is required, canonical slices can be used with WPP, with certain coding overhead.

[0038] Tiles define the horizontal and vertical boundaries that partition a picture into rows and columns of tiles. Tile columns extend from the top to the bottom of the picture. Similarly, tile columns extend from the left to the right of the picture. The number of tiles in a picture can be derived simply by multiplying the number of tile columns by the number of tile rows.

[0039] The CTB scan order is modified to be local within the tile (in the order of the tile's CTB raster scan) before decoding the top-left CTB of the next tile in the order of the picture's tile raster scan. Similar to normal slices, tiles impair in-picture prediction dependency and entropy decoding dependency. However, they do not need to be included in individual NAL units (similar to WPP in this respect), and therefore tiles cannot be used for MTU size matching. Each tile can be processed by one processor / core, and the inter-processor / inter-core communication required for in-picture prediction between processing units decoding adjacent tiles is limited to conveying a shared slice header when a slice spans two or more tiles, and sharing related to loop filtering of reconstructed samples and metadata. If a slice contains more than one tile or WPP segment, the entry point byte offset of each tile or WPP segment in the slice other than the first tile or WPP segment is signaled in the slice header.

[0040] For simplicity, HEVC specifies limitations on the application of four different picture partitioning schemes. A given coded video sequence cannot contain both tiles and wavefronts for most profiles specified in HEVC. For each slice and tile, one or both of the following conditions must be met: 1) All coded tree blocks within a slice belong to the same tile. 2) All coded tree blocks within a tile belong to the same slice. Finally, a wavefront segment must contain exactly one CTB row, and when WPP is used, if a slice begins within a CTB row, it must end within the same CTB row.

[0041] The latest amendment to HEVC is the JCT-VC output document JCTVC-AC1005, edited by J. Boyce, A. Ramasubramonian, R. Skupin, GJ Sullivan, A. Tourapis, and Y.-K. Wang, "HEVC Additional Supplemental Enhancement Information (Draft 4)," dated October 24, 2017, and published here: http: / / phenix.int-evry.fr / jct / doc_end_user / documents / 29_Macau / wg11 / JCTVC-AC1005-v2.zip. Including this amendment, HEVC defines three MCTS-related SEI messages: the Temporal MCTS SEI message, the MCTS Extraction Information Set SEI message, and the MCTS Extraction Information Nest SEI message.

[0042] The temporal MCTS SEI message indicates the presence of an MCTS in the bitstream and signals the MCTS. For each MCTS, the motion vector is restricted to pointing to full sample locations within the MCTS and fractional sample locations that require only full sample locations within the MCTS for interpolation; the use of motion vector candidates for temporal motion vector prediction derived from blocks outside the MCTS is not permitted. In this way, each MCTS can be decoded independently, without the presence of tiles not included in the MCTS.

[0043] The MCTS Extraction Information Set SEI message provides supplemental information that can be used in MCTS sub-bitstream extraction (specified as part of the semantics of the SEI message) to generate a suitable bitstream for the MCTS set. This information consists of several extraction information sets, each set defining several MCTS sets and containing RBSP bytes for alternative VPS, SPS, and PPS used during the MCTS sub-bitstream extraction process. When extracting sub-bitstreams according to the MCTS sub-bitstream extraction process, the parameter sets (VPS, SPS, and PPS) may need to be rewritten or replaced, and the slice header may need to be slightly updated because one or all of the slice address-related syntax elements (including first_slice_segment_in_pic_flag and slice_segment_address) will typically need to have different values.

[0044] 3.2. Partitioning Pictures in VVC In VVC, a picture is divided into one or more tile rows and one or more tile columns. A tile is a sequence of CTUs that cover a rectangular area of ​​the picture. The CTUs within a tile are scanned in raster scan order within that tile.

[0045] A slice consists of an integer number of complete tiles or an integer number of consecutive complete CTU rows within a picture tile.

[0046] Two slicing modes are supported: raster scan slicing mode and rectangular slicing mode. In raster scan slicing mode, a slice contains a complete sequence of tiles in the tile raster scan of the picture. In rectangular slicing mode, a slice contains either several complete tiles that collectively form a rectangular region of the picture, or several consecutive complete CTU rows of a single tile that collectively form a rectangular region of the picture. Tiles within a rectangular slice are scanned in tile raster scan order within the rectangular region corresponding to that slice.

[0047] A subpicture contains one or more slices that collectively cover the rectangular area of ​​the picture.

[0048] Figure 1 shows an example of raster scan slice partitioning of a picture, where the picture is divided into 12 tiles and 3 raster scan slices.

[0049] Figure 2 shows an example of rectangular slice partitioning of a picture, where the picture is divided into 24 tiles (6 tile rows and 4 tile columns) and 9 rectangular slices.

[0050] Figure 3 shows an example of a picture partitioned into tiles and rectangular slices, where the picture is divided into four tiles (two tile rows and two tile columns) and four rectangular slices.

[0051] Figure 4 shows an example of sub-picture partitioning of a picture, where the picture is partitioned into 18 tiles, with the 12 on the left covering one 4x4 CTU slice and the 6 on the right covering two vertically stacked 2x2 CTU slices, resulting in a total of 24 slices and 24 sub-pictures of various dimensions (each slice being a sub-picture).

[0052] 3.3. Signaling of subpictures, tiles, and slices in VVC In the latest VVC draft text, subpicture information includes the subpicture layout (i.e., the number of subpictures for each picture, as well as the position and size of each picture) and other sequence-level subpicture information, which is signaled in the SPS. The order of subpictures signaled in the SPS defines the subpicture index. A list of one subpicture ID for each subpicture may be explicitly signaled, for example, in the SPS or PPS.

[0053] In VVC, tiles are conceptually the same as in HEVC. That is, each picture is partitioned into tile columns and tile rows, but the PPS syntax for tile signaling is different.

[0054] In VVC, the slice mode is also signaled in PPS. When the slice mode is rectangular slice mode, the slice layout of each picture (i.e., the number of slices for each picture, as well as the position and size of each slice) is signaled in PPS. The order of rectangular slices within a picture, as signaled in PPS, defines the picture-level slice index. The sub-picture-level slice index is defined as the order of slices within the sub-picture in ascending order of those picture-level slice indices. The position and size of rectangular slices are signaled / derived based on the sub-picture position and size signaled in SPS (if each sub-picture contains only one slice), or based on the tile position and size signaled in PPS (if a sub-picture may contain more than one slice). When the slice mode is raster scan slice mode, the layout of slices within a picture is signaled to the slices themselves, along with various details, similar to HEVC.

[0055] The syntax and semantics of the SPS, PPS, and slice headers in the latest VVC draft text most relevant to this invention are as follows: [Table 1] TIFF0007949134000002.tif240170 TIFF0007949134000003.tif87170 [Table 2] TIFF0007949134000005.tif221170 TIFF0007949134000006.tif226170 TIFF0007949134000007.tif208170 [Table 3] TIFF0007949134000009.tif231170 TIFF0007949134000010.tif92170

[0056] 4. Examples of technical problems solved by the solutions described herein Existing designs for signaling subpictures, tiles, and slices in VVC have the following problems: 1) The coding for sps_num_subpics_minus1 is u(8), which does not allow more than 256 subpictures per picture. However, certain applications may require a maximum number of subpictures per picture to exceed 256. 2) It is permissible to set subpics_present_flag to equal to 0 and sps_subpic_id_present_flag to equal to 1. However, this does not make sense because subpics_present_flag being equal to 0 means that CLVS has no information about the subpict. 3) A list of subpicture IDs can be signaled in the picture header (PH), one for each subpicture. However, when a list of subpicture IDs is signaled in the PH, and a subset of subpictures is extracted from the bitstream, all PHs must be modified. This is undesirable. 4) Currently, when a subpicture ID is indicated to be explicitly signaled by sps_subpic_id_present_flag (or the syntax element name has been changed to subpic_ids_explicitly_signalled_flag), the subpicture ID may not be signaled anywhere. This is problematic because when a subpicture ID is indicated to be explicitly signaled, it must be explicitly signaled in either the SPS or PPS. 5) When the subpicture ID is not explicitly signaled, the slice header syntax element slice_subpic_id still needs to be signaled as long as subpics_present_flag is equal to 1, including when sps_num_subpics_minus1 is equal to 0. However, the length of slice_subpics_id is currently specified as Ceil(Log2(sps_num_subpics_minus1+1)) bits, which is 0 bits when sps_num_subpics_minus1 is equal to 0. This is problematic because the length of the current syntax element cannot be 0 bits. 6) The subpicture layout, including the number, size, and position of subpictures, does not change throughout the CLVS. Even if subpicture IDs are not explicitly signaled in the SPS or PPS, the length of the subpicture ID must be signaled for the subpicture ID syntax element in the slice header. 7) Whenever rect_slice_flag is equal to 1, the syntax element slice_address is signaled in the slice header and specifies the slice index in the subpicture containing the slice, including when the number of slices in the subpicture (i.e., NumSlicesInSubpic[SubPicIdx]) is equal to 1. However, currently, when rect_slice_flag is equal to 1, the length of slice_address is specified as Ceil(Log2(NumSlicesInSubpic[SubPicIdx])) bits, which is 0 bits when NumSlicesInSubpic[SubPicIdx] is equal to 1. This is problematic because the length of the current syntax element cannot be 0 bits. 8) There is redundancy between the syntactic elements no_pic_partition_flag and pps_num_subpics_minus1, but the following constraint exists in the latest VVC text: if sps_num_subpics_minus1 is greater than 0, then the value of no_pic_partition_flag must be equal to 1.

[0057] 5. Exemplary Embodiments and Solutions To address the above-mentioned problems, the following methods are disclosed. This invention should be considered as an illustrative example to illustrate a general concept and should not be interpreted narrowly. Furthermore, these inventions can be applied individually or in any combination.

[0058] To solve the first problem, change the coding of sps_num_subpics_minus1 from u(8) to ue(v) to enable more than 256 subpics per picture. a. Furthermore, the value of sps_num_subpics_minus1 is limited to the range of 0 to Ceil(pic_width_max_in_luma_samples÷CtbSizeY)*Ceil(pic_height_max_in_luma_samples÷CtbSizeY)-1. b. Furthermore, the number of sub-pictures per picture is further restricted in the level definition. 2) To solve the second problem, we set "if(subpics_present_flag)" as the signaling condition for the syntactic element sps_subpic_id_present_flag. That is, the syntactic element sps_subpic_id_present_flag is not signaled when subpics_present_flag is equal to 0, and the value of sps_subpic_id_present_flag is inferred to be equal to 0 when it does not exist. a. Alternatively, the syntactic element sps_subpic_id_present_flag is still signaled when subpics_present_flag is equal to 0, but when subpics_present_flag is equal to 0, its value is required to be equal to 0. b. Furthermore, the names of the syntactic elements subpics_present_flag and sps_subpic_id_present_flag are changed to subpic_info_present_flag and subpic_ids_explicity_signalled_flag, respectively. 3) To solve the third problem, the signaling of subpicture IDs in the PH syntax is removed. Thus, the list SubpicIdList[i] for i in the range of 0 to sps_num_subpics_minus1 is derived as follows: for(i=0; i<=sps_num_subpics_minus1; i++) if(subpic_ids_explicitly_signalled_flag) SubpicIdList[i]=subpic_ids_in_pps_flag?pps_subpic_id[i]:sps_subpic_id[i] else SubpicIdList[i]=i 4) To resolve the fourth issue, when it is indicated that a subpicture will be explicitly signaled, the subpicture ID will be signaled using either SPS or PPS. a. This is achieved by adding the following constraint: if subpic_ids_explicity_signalled_flag is 0 or subpic_ids_in_sps_flag is equal to 1, then subpic_ids_in_pps_flag must be equal to 0. Otherwise (subpic_ids_explicity_signalled_flag is 1 and subpic_ids_in_sps_flag is equal to 0), then subpic_ids_in_pps_flag must be equal to 1. 5) To resolve the fifth and sixth issues, the length of a subpicture ID is signaled in the SPS regardless of the value of the SPS flag sps_subpic_id_present_flag (or, renamed to subpic_ids_explicitly_signaled_flag), however, if a subpicture ID is explicitly signaled in the PPS to avoid parsing the PPS dependency on the SPS, then the length may also be signaled in the PPS. In this case, the length also specifies the length of the subpicture ID in the slice header, even though the subpicture ID is not explicitly signaled in the SPS or PPS. Therefore, the length of slice_subpic_id is also specified by the length of the subpicture ID signaled in the SPS, if present. 6) Alternatively, to resolve the fifth and sixth issues, a flag has been added to the SPS syntax, with a value of 1 to indicate the presence of subpicture ID length in the SPS syntax. This flag exists independently of the value of the flag indicating whether subpicture IDs are explicitly signaled in SPS or PPS. The value of this flag can be 1 or 0 if subpic_ids_explicitly_signalled_flag is equal to 0, but the value of the flag must be equal to 1 if subpic_ids_expliclity_signalled_flag is equal to 1. If this flag is equal to 0, i.e., there is no subpicture length, the length of slice_subpic_id is specified as Max(Log2(sps_num_subpics_minus1 + 1)), 1) bits (not Ceil(Log2(sps_num_subpics_minus1 + 1)) bits in the latest VVC draft text). a. Alternatively, this flag exists only if subpic_ids_explicity_signalled_flag is equal to 0, and if subpic_ids_explicitly_signalled_flag is equal to 1, the value of this flag is assumed to be equal to 1. 7) To solve the seventh problem, if rect_slice_flag is equal to 1, the length of slice_address is Max( Ceil( Log2( NumSlicesInSubpic[SubPicIdx])),1) It is specified in the bits. a. Alternatively, if rect_slice_flag is equal to 0, the length of slice_address is specified as Max(Ceil(Log2(NumTilesInPic))), 1) bits instead of Ceil(Log2(NumTilesInPic)) bits. 8) To solve the eighth problem, the signaling of no_pic_partition_flag is conditioned on "if(subpic_ids_in_pps_flag && pps_num_subpics_minus1 > 0)" and the following assumption is made: If it does not exist, the value of no_pic_partition_flag is assumed to be equal to 1. a. Alternatively, move the subpicture ID syntax (all four syntax elements) after the PPS tile and slice syntax, for example, immediately before the syntax element entropy_coding_sync_enabled_flag, and then condition the signaling of pps_num_subpics_minus1 to "if(no_pic_partition_flag)". 6. Embodiments The following are some exemplary embodiments relating to all aspects of the invention, except for item 8 summarized in Section 5 above, which may be applied to the VVC specification. The modified text is based on the latest VVC text of JVET-P2001-v14. The most relevant parts added or modified are: Underlined, bold, and italicized text The most relevant deleted portion is highlighted in bold double brackets. For example, [[a]] indicates that "a" has been deleted. Some changes are not highlighted because they are essentially editorial changes. 6.1. First Embodiment [Table 4] TIFF0007949134000012.tif233170 TIFF0007949134000013.tif123170 [Table 5] TIFF0007949134000015.tif206170 [Table 6] TIFF0007949134000017.tif36170

[0059] Figure 5 is a block diagram showing an exemplary video processing system 500 in which various technologies disclosed herein may be implemented. Various implementations may include some or all of the components of system 500. System 500 may include an input 502 for receiving video content. Video content may be received in raw or uncompressed format, e.g., with 8 or 10-bit multi-component pixel values, or in a compressed or encoded format. Input 502 may represent a network interface, a peripheral bus interface, or a storage interface. Examples of network interfaces include wired interfaces such as Ethernet® and passive optical networking (PON), and wireless interfaces such as Wi-Fi or cellular interfaces.

[0060] System 500 may include a coding component 504 that can implement various coding or encoding methods described herein. The coding component 504 may reduce the average bitrate of the video from input 502 to the output of the coding component 504 in order to produce a coded representation of the video. Thus, coding techniques are sometimes referred to as video compression or video transcoding techniques. The output of the coding component 504 may be stored or transmitted via connected communications, as represented by component 506. The stored or transmitted bitstream (or coded) representation of the video received at input 502 may be used by component 508 to generate pixel values ​​or a viewable video to be sent to the display interface 510. The process of generating a video that a user can see from the bitstream representation is sometimes referred to as video decompression. Furthermore, while certain video processing operations are referred to as “coding” operations or tools, it will be understood that coding tools or operations are used by encoders, and corresponding decoding tools or operations that invert the results of coding are performed by decoders.

[0061] Examples of peripheral bus interfaces or display interfaces may include Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI®), or DisplayPort. Examples of storage interfaces include SATA (Serial Advanced Technology Attachment), PCI, and IDE interfaces. The technologies described herein may be embodied in various electronic devices such as mobile phones, laptops, smartphones, or other devices capable of performing digital data processing and / or video display.

[0062] Figure 6 is a block diagram of a video processing device 600. The device 600 may be used to implement one or more of the methods described herein. The device 600 may be embodied in smartphones, tablets, computers, Internet of Things (IoT) receivers, etc. The device 600 may include one or more processors 602, one or more memories 604, and video processing hardware 606. The processor(s) 602 may be configured to implement one or more of the methods described herein. The memories 604 may be used to store data and code used to implement the methods and techniques described herein. The video processing hardware 606 may be used in hardware circuitry to implement some of the techniques described herein. In some embodiments, the hardware 606 may be partially or entirely within the processor 602, for example, a graphics processor.

[0063] Figure 7 is a block diagram showing an exemplary video coding system 100 that may utilize the technology of this disclosure.

[0064] As shown in Figure 7, the video coding system 100 may include a source device 110 and a destination device 120. The source device 110 generates encoded video data and may be referred to as a video encoding device. The destination device 120 can decode the encoded video data generated by the source device 110 and may be referred to as a video decoding device.

[0065] The source device 110 may include a video source 112, a video encoder 114, and an input / output (I / O) interface 116.

[0066] The video source 112 may include a source such as a video capture device, an interface for receiving video data from a video content provider, and / or a computer graphics system for generating video data, or a combination of such sources. The video data may include one or more pictures. The video encoder 114 encodes the video data from the video source 112 to produce a bitstream. The bitstream may include a sequence of bits that form a coded representation of the video data. The bitstream may include coded pictures and associated data. A coded picture is a coded representation of a picture. Associated data may include a sequence parameter set, a picture parameter set, and other syntactic structures. The I / O interface 116 may include a modulator / demodulator (modem) and / or a transmitter. The encoded video data may be transmitted directly to the destination device 120 via the I / O interface 116 through the network 130a. The encoded video data may also be stored on a storage medium / server 130b for access by the destination device 120.

[0067] The destination device 120 may include an I / O interface 126, a video decoder 124, and a display device 122.

[0068] The I / O interface 126 may include a receiver and / or modem. The I / O interface 126 may acquire encoded video data from the source device 110 or storage medium / server 130b. The video decoder 124 may decode the encoded video data. The display device 122 may display the decoded video data to the user. The display device 122 may be integrated with the destination device 120, or it may be outside the destination device 120 and may be configured to interface with an external display device.

[0069] The video encoder 114 and video decoder 124 may operate in accordance with video compression standards such as the High Efficiency Video Coding (HEVC) standard, the General-Purpose Video Coding (VVM) standard, and other current and / or further standards.

[0070] Figure 8 is a block diagram showing an example of a video encoder 200 that may be a video encoder 114 in the system 100 shown in Figure 7.

[0071] The video encoder 200 may be configured to perform any or all of the technologies of this disclosure. In the example in Figure 8, the video encoder 200 includes several functional components. The technologies described in this disclosure may be shared among the various components of the video encoder 200. In some examples, the processor may be configured to perform any or all of the technologies described in this disclosure.

[0072] The functional components of the video encoder 200 may include a partition unit 201, a prediction unit 202 which may include a mode selection unit 203, a motion estimation unit 204, a motion compensation unit 205, and an intra-prediction unit 206, a residual generation unit 207, a transformation unit 208, a quantization unit 209, an inverse quantization unit 210, an inverse transformation unit 211, a reconstruction unit 212, a buffer 213, and an entropy encoding unit 214.

[0073] In other examples, the video encoder 200 may include more, fewer, or different functional components. In one example, the prediction unit 202 may include an intra-block copy (IBC) unit. The IBC unit may perform prediction in IBC mode, where at least one reference picture is the picture in which the current video block is located.

[0074] Furthermore, several components, such as the motion estimation unit 204 and the motion compensation unit 205, can be highly integrated, but are shown separately in the example in Figure 8 for illustrative purposes.

[0075] The partition unit 201 can partition a picture into one or more video blocks. The video encoder 200 and video decoder 300 can support various video block sizes.

[0076] The mode selection unit 203 may, for example, select one of the intra or intercoding modes based on the error result, and provide the resulting intra or intercoded block to the residual generation unit 207 to generate residual block data, and to the reconstruction unit 212 to reconstruct the encoded block for use as a reference picture. In some examples, the mode selection unit 203 may select a combination of intra and interpredication (CIIP) mode, where the prediction is based on an interprediction signal and an intraprediction signal. The mode selection unit 203 may also select the resolution of the motion vector for the block (e.g., subpixel or integer pixel precision) in the case of interprediction.

[0077] To perform interpretation on the current video block, the motion estimation unit 204 may generate motion information for the current video block by comparing one or more reference frames from buffer 213 with the current video block. The motion compensation unit 205 may determine the predicted video block for the current video block based on the motion information of pictures from buffer 213 other than the picture associated with the current video block and the decoded samples.

[0078] The motion estimation unit 204 and the motion compensation unit 205 may perform different actions on the current video block depending, for example, whether the current video block is in an I-slice, P-slice, or B-slice.

[0079] In some examples, the motion estimation unit 204 may perform a unidirectional prediction for the current video block and may look up a reference picture in List 0 or List 1 for a reference video block relative to the current video block. Next, the motion estimation unit 204 may generate a reference index that indicates the reference picture in List 0 or List 1, which includes the reference video block and a motion vector indicating the spatial displacement between the current video block and the reference video block. The motion estimation unit 204 may output the reference index, a prediction direction indicator, and a motion vector as motion information for the current video block. The motion compensation unit 205 may generate a predicted video block for the current block based on the reference video block indicated by the motion information for the current video block.

[0080] In another example, the motion estimation unit 204 may perform bidirectional prediction for the current video block, retrieve a reference picture in List 0 for a reference video block relative to the current video block, and retrieve a reference picture in List 1 for a reference video block relative to the current video block. Next, the motion estimation unit 204 may generate a reference index that indicates the reference video block and the reference picture in Lists 0 and 1, which include a motion vector indicating the spatial displacement between the reference video block and the current video block. The motion estimation unit 204 may output the reference index and motion vector of the current video block as motion information for the current video block. The motion compensation unit 205 may generate a predicted video block for the current video block based on the reference video block indicated by the motion information of the current video block.

[0081] In some examples, the motion estimation unit 204 may output the entire set of motion information for the decoder's decoding process.

[0082] In some cases, the motion estimation unit 204 may not output a complete set of motion information for the current video. Rather, the motion estimation unit 204 may signal the motion information for the current video block by referring to the motion information of other video blocks. For example, the motion estimation unit 204 may determine that the motion information for the current video block is sufficiently similar to the motion information of an adjacent video block.

[0083] In one example, the motion estimation unit 204 may indicate a value in the syntactic structure associated with the current video block that tells the video decoder 300 that the current video block has the same motion information as another video block.

[0084] In another example, the motion estimation unit 204 may identify another video block and its motion vector difference (MVD) in the syntactic structure associated with the current video block. The motion vector difference represents the difference between the motion vector of the current video block and the motion vector of the indicated video block. The video decoder 300 may use the motion vector and motion vector difference of the indicated video block to determine the motion vector of the current video block.

[0085] As described above, the video encoder 200 can predictively signal motion vectors. Two examples of predictive signaling techniques that can be implemented by the video encoder 200 include advanced motion vector prediction (AMVP) and merge mode signaling.

[0086] The intra-prediction unit 206 may perform an intra-prediction on the current video block. When the intra-prediction unit 206 performs an intra-prediction on the current video block, it may generate prediction data for the current video block based on decoded samples from other video blocks within the same picture. The prediction data for the current video block may include the predicted video block and various syntactic elements.

[0087] The residual generation unit 207 may generate residual data for the current video block by subtracting (for example, indicated by a minus sign) the predicted video block(s) for the current video block from the current video block. The residual data for the current video block may include residual video blocks corresponding to different sample components of the sample within the current video block.

[0088] In another example, for instance in skip mode, residual data for the current video block may not exist, and the residual generation unit 207 may not perform the subtraction operation.

[0089] The conversion processing unit 208 may generate one or more conversion coefficient video blocks for the current video block by applying one or more conversions to the residual video blocks associated with the current video block.

[0090] After the conversion processing unit 208 generates a conversion coefficient video block associated with the current video block, the quantization unit 209 may quantize the conversion coefficient video block associated with the current video block based on one or more quantization parameter (QP) values ​​associated with the current video block.

[0091] The inverse quantization unit 210 and the inverse transform unit 211 may apply inverse quantization and inverse transform, respectively, to the transformed coefficient video block in order to reconstruct the residual video block from the transformed coefficient video block. The reconstruction unit 212 may add the reconstructed residual video block to the corresponding samples from one or more predicted video blocks generated by the prediction unit 202 in order to generate a reconstructed video block related to the current block for storage in the buffer 213.

[0092] After the reconstruction unit 212 reconstructs the video block, it may perform a loop filtering operation to reduce video blocking artifacts within the video block.

[0093] The entropy encoding unit 214 may receive data from other functional components of the video encoder 200. When the entropy encoding unit 214 receives data, it may perform one or more entropy encoding operations to generate entropy-encoded data and output a bitstream containing the entropy-encoded data.

[0094] Figure 9 is a block diagram showing an example of a video decoder 300 that may be a video decoder 114 in the system 100 shown in Figure 7.

[0095] The video decoder 300 may be configured to perform any or all of the technologies of this disclosure. In the example shown in Figure 8, the video decoder 300 includes several functional components. The technologies described in this disclosure may be shared among the various components of the video decoder 300. In some examples, the processor may be configured to perform any or all of the technologies described in this disclosure.

[0096] In the example shown in Figure 9, the video decoder 300 includes an entropy decoding unit 301, a motion compensation unit 302, an intra-prediction unit 303, an inverse quantization unit 304, an inverse transform unit 305, a reconstruction unit 306, and a buffer 307. In some examples, the video decoder 300 may perform a decoding path that is roughly the reverse of the encoding path described for the video encoder 200 (Figure 8).

[0097] The entropy decoding unit 301 may retrieve an encoded bitstream. The encoded bitstream may contain entropy-coded video data (e.g., encoded blocks of video data). The entropy decoding unit 301 may decode the entropy-coded video data, and from the entropy-coded video data, the motion compensation unit 302 may determine motion information, including motion vectors, motion vector precision, reference picture list index, and other motion information. The motion compensation unit 302 may determine such information, for example, by performing AMVP and merge modes.

[0098] The motion compensation unit 302 may generate motion-compensated blocks and perform interpolation based on interpolation filters. Identifiers for the interpolation filters, which will be used with sub-pixel precision, may be included in the syntax elements.

[0099] The motion compensation unit 302 may calculate interpolated values ​​for sub-integer pixels of a reference block using an interpolation filter used by the video encoder 200 during video block encoding. The motion compensation unit 302 may determine the interpolation filter used by the video encoder 200 according to the received syntactic information and use the interpolation filter to generate a prediction block.

[0100] The motion compensation unit 302 may use some syntactic information to determine the size of the blocks used to encode the frames and / or slices of the encoded video sequence, partition information describing how each macroblock of the picture in the encoded video sequence is partitioned, a mode indicating how each partition is encoded, one or more reference frames (and reference frame lists) for each inter-encoded block, and other information for decoding the encoded video sequence.

[0101] The intra-prediction unit 303 can, for example, use an intra-prediction mode received in a bitstream to form a prediction block from spatially adjacent blocks. The inverse quantization unit 303 inversely quantizes, i.e., dequantizes, the quantized video block coefficients provided in the bitstream and decoded by the entropy decoding unit 301. The inverse transform unit 303 applies the inverse transform.

[0102] The reconstruction unit 306 may combine the residual blocks with the corresponding predicted blocks generated by the motion compensation unit 202 or the intra-prediction unit 303 to form a decoded block. If necessary, a deblocking filter may be applied to filter the decoded block to remove block noise artifacts. The decoded video block is then stored in a buffer 307, which provides a reference block for subsequent motion compensation / intra-prediction and generates a decoded video for presentation on a display device.

[0103] Figures 10 to 12 illustrate exemplary methods by which the above-described technical solutions can be implemented, for example, in the embodiments shown in Figures 5 to 9.

[0104] Figure 10 shows a flowchart for an exemplary method 1000 of video processing. Method 1000 includes, in operation 1010, performing a conversion between video and a video bitstream, the bitstream conforming to formatting rules that specify that signaling the length of subpicture identifiers in a Sequence Parameter Set (SPS) is not based on the value of a syntactic element indicating whether an identifier is signaled in the SPS.

[0105] Figure 11 shows a flowchart for an exemplary method 1100 of video processing. Method 1100 includes, in operation 1110, performing a conversion between video and a video bitstream, the bitstream conforming to formatting rules that specify that the length of subpicture identifiers in the Picture Parameter Set (PPS) is signaled by syntactic elements indicating that the identifiers are explicitly signaled in the PPS.

[0106] Figure 12 shows a flowchart for an exemplary method 1200 of video processing. Method 1200 includes, in operation 1210, performing a conversion between video and a video bitstream, the bitstream conforming to a formatting rule that specifies that a first syntactic element signaled in the bitstream's sequence parameter set (SPS) indicates the length of a subpicture identifier in the SPS, and that the signaling of the first syntactic element is independent of the value of a second syntactic element indicating explicit signaling of a subpicture identifier in the SPS or picture parameter set (PPS).

[0107] Next, we provide a list of preferred solutions by several embodiments.

[0108] A1. A video processing method comprising performing a conversion between a video containing a picture and a bitstream of the video, wherein the number of subpictures within the picture is signaled in the Sequence Parameter Set (SPS) of the bitstream as a field whose bit width is based on a value for the number of subpictures, and the field is a syntactic element coded in an unsigned integer zero-order exponential Golomb (Exp-Golomb) with the left bit being the first bit.

[0109] A2. The method of Solution A1, wherein the value of the field is limited to a range from zero to a maximum value based on the maximum width and maximum height of the picture in the luma sample.

[0110] A3. The maximum value is equal to the integer number of coding tree blocks that fit within the picture, as in the method of solution A2.

[0111] A4. The method of solution A1, wherein the number of subpictures is limited based on the coding level associated with the bitstream.

[0112] A5. A video processing method comprising performing a conversion between a video and a video bitstream, wherein the bitstream conforms to a format rule, the format rule specifies that a first syntactic element indicating whether the pictures of the video can be partitioned is conditionally included in the picture parameter set (PPS) of the bitstream, based on a second syntactic element indicating whether sub-picture identifiers are signaled in the PPS, and a third syntactic element indicating the number of sub-pictures in the PPS.

[0113] A6. Solution A5 method, where the first syntactic element is no_pic_partition_flag, the second syntactic element is subpic_ids_in_pps_flag, and the third syntactic element is pps_num_subpics_minus1.

[0114] A7. The method of Solution A5 or A6, wherein the first syntactic element is presumed to be excluded from the PPS and to indicate that picture partitioning is not applied to each picture that references the PPS.

[0115] A8. The first syntactic element is not signaled in the PPS and is presumed to be equal to 1, in the manner of solution A5 or A6.

[0116] A9. The method of solution A5 or A6, wherein the second syntactic element is signaled after one or more tile and / or slice syntactic elements of the PPS.

[0117] A10. A video processing method comprising performing a conversion between a video and a video bitstream, wherein the bitstream conforms to a format rule, the format rule specifies that a first syntactic element indicating whether the pictures of the video can be partitioned is included in the picture parameter set (PPS) of the bitstream, prior to a set of syntactic elements indicating identifiers of the subpictures of the picture in the PPS.

[0118] A11. The method of Solution A10, wherein a second syntactic element indicating the number of subpictures is conditionally included in the set of syntactic elements based on the value of the first syntactic element.

[0119] A12. The conversion is any of the methods of solutions A1 to A11, wherein the conversion includes decoding the video from the bitstream.

[0120] A13. The conversion is any of the methods of solutions A1 to A11, which includes encoding the video into the bitstream.

[0121] A14. A method for storing a bitstream representing video on a computer-readable recording medium, comprising generating a bitstream from video and writing the bitstream to a computer-readable recording medium, in accordance with one or more of the methods described in Solutions A1 to A11.

[0122] A15. A video processing device comprising a processor configured to implement one or more of the methods described in Solution A1 to A14.

[0123] A16. A computer-readable medium on which instructions are stored, wherein, when executed, the instructions cause a processor to implement one or more of the methods of solutions A1 to A14.

[0124] A17. A computer-readable medium for storing a bitstream generated according to one or more of the solutions A1-A14.

[0125] A18. A video processing device for storing a bitstream, wherein the video processing device is configured to implement one or more of the methods described in any one of solutions A1 to A14.

[0126] Next, we provide another list of preferred solutions by some embodiments.

[0127] B1. A video processing method comprising performing a conversion between a video region of a video and a bitstream of the video, wherein the bitstream conforms to a format rule, the format rule specifies that a first syntactic element indicating whether information of a subpicture identifier is included in the parameter set of the bitstream is conditionally included in a sequence parameter set (SPS) based on the value of a second syntactic element indicating whether information of a subpicture is included in the SPS.

[0128] B2. The method of Solution B1, wherein the format rule further specifies that the value of the second syntactic element is zero, which indicates that the information of the subpicture is omitted from the SPS, and as a result each of the video regions associated with the SPS is not divided into multiple subpictures, and based on the value being zero, the first syntactic element is omitted from the SPS.

[0129] B3. Solution B1 or B2, wherein the first syntactic element is subpic_ids_explicity_signalled_flag and the second syntactic element is subpic_info_present_flag.

[0130] B4. The method of Solution B1 or B3, wherein the formatting rule further specifies that if the value of the first syntactic element is zero, the first syntactic element is included in the SPS with a value of zero.

[0131] B5. The video area is a video picture, one of the solutions B1 to B4.

[0132] B6. A video processing method comprising performing a conversion between a picture of a video and a bitstream of the video, wherein the bitstream conforms to a format rule, the format rule stipulates that the mapping between identifiers of one or more subpictures of the picture and the one or more subpictures is not included in the picture header of the picture, and the format rule further stipulates that the identifiers of the one or more subpictures are derived based on syntactic elements of a sequence parameter set (SPS) and a picture parameter set (PPS) referenced by the picture.

[0133] B7. The method of Solution B6, wherein the flag of the SPS takes a first value indicating that the identifier of the one or more subpictures is derived based on the syntactic elements of the PPS, or a second value indicating that the identifier of the one or more subpictures is derived based on the syntactic elements of the SPS.

[0134] B8. The flag corresponds to the subpic_ids_in_pps_flag field, where the first value is 1 and the second value is zero, according to the method of solution B7.

[0135] B9. The identifier (indicated as SubpicIdList[i]) is derived as follows: for(i = 0; i <= sps_num_subpics_minus1; i++) if(subpic_ids_explicitly_signalled_flag) SubpicIdList[i] = subpic_ids_in_pps_flag ?pps_subpic_id[i] sps_subpic_id[i] else SubpicIdList[i] = i Solution B6 method.

[0136] B10. A video processing method comprising performing a conversion between a video and a bitstream of the video, wherein the bitstream conforms to a format rule, the format rule stipulating that the mapping between a subpicture identifier and one or more subpictures of a picture is signaled in either a sequence parameter set (SPS) or a picture parameter set (PPS) when the value of a first syntactic element indicates that the mapping is explicitly signaled for the one or more subpictures.

[0137] B11. The first syntactic element is subpic_ids_explicity_signalled_flag, solution method B10.

[0138] B12. The method of Solution B11, wherein the identifier is signaled in the SPS based on the value of a second syntactic element (indicated as subpic_ids_in_sps_flag), and the identifier is signaled in the PPS based on the value of a third syntactic element (indicated as subpic_ids_in_pps_flag).

[0139] B13. subpic_ids_in_pps_flag is equal to zero because subpic_ids_explicity_signalled_flag is zero or subpic_ids_in_sps_flag is 1, solution method B12.

[0140] Solution B13 method, where B14.subpic_ids_in_pps_flag is equal to zero, indicating that the identifier is not signaled in the PPS.

[0141] B15. subpic_ids_in_pps_flag is equal to 1 because subpic_ids_explicity_signalled_flag is 1 and subpic_ids_in_sps_flag is zero, solution method B12.

[0142] Solution B15 method, where B16.subpic_ids_in_pps_flag equals 1, indicating that an identifier for each of the one or more subpictures is explicitly signaled in the PPS.

[0143] B17. The conversion is any of the methods of solutions B1 to B15, which includes decoding the video from the bitstream.

[0144] B18. The conversion is any of the methods of solutions B1 to B15, which includes encoding the video into the bitstream.

[0145] B19. A method for storing a bitstream representing video on a computer-readable recording medium, comprising generating a bitstream from video and writing the bitstream to the computer-readable recording medium, in accordance with one or more of the methods described in Solutions B1 to B15.

[0146] B20. A video processing device comprising a processor configured to implement one or more of the methods described in solutions B1 to B19.

[0147] B21. A computer-readable medium on which instructions are stored, wherein, when executed, the instructions cause a processor to implement one or more of the methods described in solutions B1 to B19.

[0148] B22. A computer-readable medium for storing a bitstream generated according to one or more of the solutions B1-B19.

[0149] B23. A video processing device for storing a bitstream, wherein the video processing device is configured to implement one or more of the methods described in solutions B1 to B19.

[0150] A further list of preferred solutions by some embodiments is provided below.

[0151] C1. A video processing method comprising performing a conversion between a video and a video bitstream, wherein the bitstream conforms to a format rule, the format rule stipulating that signaling the length of a subpicture identifier in a sequence parameter set (SPS) is not based on the value of a syntactic element indicating whether the identifier is signaled in the SPS.

[0152] C2. A video processing method comprising performing a conversion between a video and a video bitstream, wherein the bitstream conforms to a format rule, and the format rule specifies that in a picture parameter set (PPS), the length of a subpicture identifier is signaled by a syntactic element indicating that the identifier is explicitly signaled in the PPS.

[0153] C3. The length further corresponds to the length of the subpicture identifier in the slice header, according to solution C1 or C2.

[0154] C4. The aforementioned syntactic element is subpic_ids_explicity_signalled_flag, resolved by any of the methods C1-C3.

[0155] C5. The method of solution C3 or C4, wherein the identifier is not signaled in the SPS and the identifier is not signaled in the PPS.

[0156] C6. The method of solution C5, wherein the length of the subpicture identifier corresponds to the length of the subpicture identifier signaled in the SPS.

[0157] C7. A video processing method comprising performing a conversion between a video and a video bitstream, wherein the bitstream conforms to a format rule, the format rule specifies that a first syntactic element signaled in the sequence parameter set (SPS) of the bitstream indicates the length of a subpicture identifier in the SPS, and the signaling of the first syntactic element is independent of the value of a second syntactic element indicating explicit signaling of the identifier of the subpicture in the SPS or picture parameter set (PPS).

[0158] C8. The second syntactic element is subpic_ids_explicity_signalled_flag, solution method C7.

[0159] C9. The method of Solution C7 or C8, wherein the second syntactic element being equal to 1 indicates that for each of the subpictures, one set of identifiers is explicitly signaled for each of the subpictures in the SPS or the PPS, and the second syntactic element being equal to zero indicates that no identifiers are explicitly signaled in the SPS or the PPS.

[0160] C10. Solution C7 or C8, wherein the value of the first syntactic element is either zero or one, because the value of the second syntactic element is zero.

[0161] C11. Solution C7 or C8 method, where the value of the first syntactic element is 1 because the value of the second syntactic element is 1.

[0162] C12. The value of the second syntactic element is zero, solution method C7 or C8.

[0163] C13. The conversion is any of the methods of solutions C1 to C12, which include decoding the video from the bitstream.

[0164] C14. The conversion is any of the methods of solutions C1 to C12, which includes encoding the video into the bitstream.

[0165] C15. A method for storing a bitstream representing video on a computer-readable recording medium, comprising generating the bitstream from the video and writing the bitstream to the computer-readable recording medium, in accordance with one or more of the methods described in Solutions C1 to C12.

[0166] C16. A video processing device having a processor configured to implement one or more of the methods described in any of the solutions C1 to C15.

[0167] C17. A computer-readable medium on which instructions are stored, wherein, when executed, the instructions cause a processor to implement one or more of the methods described in solutions C1 to C15.

[0168] C18. A computer-readable medium for storing the bitstream generated according to one or more of the solutions C1 to C15.

[0169] C19. A video processing device for storing a bitstream, wherein the video processing device is configured to implement one or more of the methods described in any one of solutions C1 to C15.

[0170] A further list of preferred solutions by some embodiments is provided below.

[0171] P1. A video processing method comprising performing a conversion between a picture of a video and a coded representation of the video, wherein the number of subpictures in the picture is included in the coded representation as a field whose bit width depends on the value of the number of subpictures.

[0172] P2. The field represents the number of subpictures using a codeword, according to the method of solution P1.

[0173] P3. The method of solution P2, where the aforementioned codeword includes the Golomb codeword.

[0174] P4. The number of subpictures is limited to an integer number of coding tree blocks that fit within the picture, by any of the solutions P1 to P3.

[0175] P5. The field depends on the coding level associated with the coded representation, using one of the solutions P1-P4.

[0176] P6. A video processing method comprising performing a conversion between a video region of a video and a coded representation of the video, wherein the coded representation conforms to a format rule, and the format rule specifies that syntactic elements indicating subpicture identifiers are omitted by the video region which does not contain subpictures.

[0177] P7. The method of solution P6, wherein the coded representation includes a field having a value of 0 indicating that the video region does not contain a subpicture.

[0178] P8. A video processing method comprising performing a conversion between a video region of a video and a coded representation of the video, wherein the coded representation conforms to a format rule, and the format rule specifies that the coded representation omits the identifier of a subpicture within the video region at the video region header level.

[0179] P9. The method of solution P8, wherein the coded representation numerically identifies the subpictures in the order in which they are listed in the video area header.

[0180] P10. A video processing method comprising performing a conversion between a video region of a video and a coded representation of the video, wherein the coded representation conforms to a format rule, and the format rule specifies that the subpicture identifier and / or the length of the subpicture identifier are included in the video region at the sequence parameter set level or the picture parameter set level.

[0181] P11. The length is included in the picture parameter set level, according to the method of solution P10.

[0182] P12. A video processing method comprising performing a conversion between a video region of a video and a coded representation of the video, wherein the coded representation conforms to a format rule, and the format rule specifies that a field in the coded representation is included at the video sequence level to indicate whether or not a subpicture identifier length field is included in the coded representation at the video sequence level.

[0183] P13. The method of Solution P12, wherein the format rule specifies that the field should be set to "1" if another field in the coded representation indicates that a length identifier for the video region is included in the coded representation.

[0184] P14. The video region includes subpictures of the video, in any of the solutions described above.

[0185] P15. The conversion is any method of the solution, which includes parsing and decoding the coded representation in order to generate the video.

[0186] P16. The conversion includes any one method of the solution, which includes encoding the video to produce the coded representation.

[0187] P17. A video decoding device having a processor configured to implement one or more of the methods described in P1 to P16.

[0188] P18. A video encoding device having a processor configured to implement one or more of the methods described in P1-P16.

[0189] P19. A computer program product that stores computer code, wherein, when executed by a processor, the code causes the processor to implement one of the methods described in solutions P1 to P16.

[0190] The solutions, examples, embodiments, modules, and functional operations disclosed herein may be implemented in digital electronic circuits, or in computer software, firmware, or hardware, or one or more combinations thereof, including the structures disclosed herein and their equivalents. The disclosed embodiments and other embodiments may be implemented as one or more modules of computer program instructions encoded on a computer-readable medium for execution by a data processing device, i.e., for control of the operation of a data processing device. The computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of a material affecting machine-readable propagation signals, or one or more combinations thereof. The term “data processing device” encompasses all devices, machines, and equipment for processing data, including, for example, a programmable processor, a computer, or multiple processors or computers. In addition to hardware, the device may include code that generates the execution environment for the computer program in question, such as processor firmware, a protocol stack, a database management system, an operating system, or one or more combinations thereof. The transmitted signals are artificially generated signals, such as mechanically generated electrical signals, optical signals, or electromagnetic signals generated to encode information for transmission to a suitable receiving device.

[0191] A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and can be deployed in any form, including as a standalone program or as modules, components, subroutines, or other units suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be contained in part of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., a file containing one or more modules, subprograms, or parts of code). A computer program can be located on one computer or site, or deployed to run on multiple computers distributed across multiple sites and interconnected by a communication network.

[0192] The processes and logic flows described herein can be executed by one or more programmable processors that run one or more computer programs to perform their functions by manipulating input data and generating outputs. The processes and logic flows can also be executed by special-purpose logic circuits such as FPGAs (Field-Programmable Gate Arrays) or ASICs (Application-Specific Integrated Circuits), and the devices themselves can be implemented as special-purpose logic circuits.

[0193] Processors suitable for executing computer programs include, for example, both general-purpose and dedicated microprocessors, and any one or more processors of any type of digital computer. Generally, a processor receives instructions and data from read-only memory or random-access memory or both. Essential elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer is also operably coupled to one or more mass storage devices for storing data, such as magnetic disks, magneto-optical disks, or optical disks, to receive or transfer data from them. However, a computer is not required to have such devices. Computer-readable media suitable for storing computer program instructions and data include, for example, semiconductor memory devices such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks, and all forms of non-volatile memory, media, and memory devices. Processors and memory may be supplemented by or integrated into special-purpose logic circuits.

[0194] While this patent document contains many details, these should not be interpreted as limiting the scope of any subject matter or what may be claimed, but rather as descriptions of features specific to particular embodiments of a particular technology. Certain features described in this patent document in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented separately in multiple embodiments or in any suitable subcombination. Furthermore, features may be described above as acting in a particular combination and may initially be described as such in a claim, but one or more features from a claimed combination may, in some cases, be extracted from the combination, and the claimed combination may be directed towards a subcombination or a variation of a subcombination.

[0195] Similarly, although the drawings show operations in a specific order, this should not be understood as requiring such operations to be performed in a specific or sequential order, or to perform all the exemplified operations, in order to achieve the desired result. Furthermore, the isolation of various system components in the embodiments described in this patent document should not be understood as requiring such isolation in all embodiments.

[0196] Although only a few embodiments and examples are described, other embodiments, extensions, and variations may be made based on the content described and explained in this patent document.

Claims

1. A method for storing a video bitstream: To generate the bitstream of the video which includes one or more pictures which include one or more subpictures, This includes storing the bitstream on a non-temporary computer-readable recording medium, The aforementioned bitstream conforms to the format rules, The formatting rule stipulates that the length of the subpicture identifier in the bitstream sequence parameter set (SPS) is signaled based on the value of the first syntactic element subpic_info_present_flag in the SPS and independent of the value of the second syntactic element in the SPS. The first syntactic element, subpic_info_present_flag, indicates whether subpicture information exists, and the second syntactic element indicates whether the identifier is explicitly signaled. The aforementioned length is signaled by the sixth syntactic element sps_subpic_id_len_minus1, where the value of sps_subpic_id_len_minus1 plus 1 is equal to the aforementioned length. method.

2. The length corresponds to the number of bits used to represent a third syntactic element indicating a subpicture identifier in the SPS, a fourth syntactic element indicating a subpicture identifier in the Picture Parameter Set (PPS) if present, and a fifth syntactic element indicating a subpicture identifier in the slice header if present. The method according to claim 1.

3. The value of sps_subpic_id_len_minus1 is within the range of 0 to 15. The method according to claim 1.

4. The second syntactic element equal to 1 specifies that for each subpicture, one set of identifiers is explicitly signaled for each subpicture in either the SPS or the Picture Parameter Set (PPS), and the second syntactic element equal to zero specifies that no identifiers are explicitly signaled in either the SPS or the PPS. The method according to claim 1.

Citation Information

Patent Citations

  • Image segment ordering

    JP2023508880A

  • Picture segment ordering

    WO2021126044A1